2024-09-15T22:03:45.789 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-15T22:03:45.814 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T22:03:45.909 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906236 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/fsstress}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7906236' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 8921c8ef947807b717db041d85f0761b7914d5fc subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt install: ceph: flavor: default sha1: 8921c8ef947807b717db041d85f0761b7914d5fc kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - nowsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ad35db06e8924912f01e32b35576297c0f1352b4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 3393 sha1: 8921c8ef947807b717db041d85f0761b7914d5fc sleep_before_teardown: 0 subset: 294/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ad35db06e8924912f01e32b35576297c0f1352b4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi001.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIVstvCGfcimgSBsRIQ564ohYM2jPvqMmncPfLLuyrzdnygtde8lbtiW3/HbbLzQZUTPBUBXlRYPOr4H6OgHGGc= smithi012.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA81wPAXdBH4Ay4zQE/ZbHKJ2nDDDh+T6L3FbsO++nfFaxu/M4Hpa7kh8qH1vJctl++d/QWcjvfjM42gWcK4Xa4= smithi098.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFBIVY03nsYKmntPBM5nTOaCLHMZ2CSclzFvbGDp8vExJWu3F0tYurcb/czXRO3qI2bA5J/pflLrmRQGPLwmxlM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_21:24:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-15T22:03:45.909 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa; will attempt to use it 2024-09-15T22:03:45.910 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks 2024-09-15T22:03:45.910 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-15T22:03:45.912 INFO:teuthology.task.internal:Checking packages... 2024-09-15T22:03:45.934 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8921c8ef947807b717db041d85f0761b7914d5fc' 2024-09-15T22:03:45.934 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-15T22:03:45.934 INFO:teuthology.packaging:ref: None 2024-09-15T22:03:45.934 INFO:teuthology.packaging:tag: None 2024-09-15T22:03:45.935 INFO:teuthology.packaging:branch: squid 2024-09-15T22:03:45.935 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:03:45.935 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-15T22:03:46.130 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-326.g8921c8ef 2024-09-15T22:03:46.132 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-15T22:03:46.139 INFO:teuthology.task.internal:no buildpackages task found 2024-09-15T22:03:46.139 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-15T22:03:46.151 INFO:teuthology.task.internal:Saving configuration 2024-09-15T22:03:46.170 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-15T22:03:46.177 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-15T22:03:46.203 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi001.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906236', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 21:58:51.926388', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIVstvCGfcimgSBsRIQ564ohYM2jPvqMmncPfLLuyrzdnygtde8lbtiW3/HbbLzQZUTPBUBXlRYPOr4H6OgHGGc='} 2024-09-15T22:03:46.225 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906236', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 21:58:51.924734', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA81wPAXdBH4Ay4zQE/ZbHKJ2nDDDh+T6L3FbsO++nfFaxu/M4Hpa7kh8qH1vJctl++d/QWcjvfjM42gWcK4Xa4='} 2024-09-15T22:03:46.250 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906236', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 21:58:51.922645', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFBIVY03nsYKmntPBM5nTOaCLHMZ2CSclzFvbGDp8vExJWu3F0tYurcb/czXRO3qI2bA5J/pflLrmRQGPLwmxlM='} 2024-09-15T22:03:46.250 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-15T22:03:46.257 INFO:teuthology.task.internal:roles: ubuntu@smithi001.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-15T22:03:46.257 INFO:teuthology.task.internal:roles: ubuntu@smithi012.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-15T22:03:46.257 INFO:teuthology.task.internal:roles: ubuntu@smithi098.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-15T22:03:46.257 INFO:teuthology.run_tasks:Running task console_log... 2024-09-15T22:03:46.342 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0fcea5b520>, signals=[15]) 2024-09-15T22:03:46.342 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-15T22:03:46.349 INFO:teuthology.task.internal:Opening connections... 2024-09-15T22:03:46.349 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi001.front.sepia.ceph.com 2024-09-15T22:03:46.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:03:46.430 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi012.front.sepia.ceph.com 2024-09-15T22:03:46.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:03:46.507 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi098.front.sepia.ceph.com 2024-09-15T22:03:46.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:03:46.583 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-15T22:03:46.590 DEBUG:teuthology.orchestra.run.smithi001:> uname -m 2024-09-15T22:03:46.608 INFO:teuthology.orchestra.run.smithi001.stdout:x86_64 2024-09-15T22:03:46.608 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release 2024-09-15T22:03:46.666 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="CentOS Stream" 2024-09-15T22:03:46.667 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="9" 2024-09-15T22:03:46.667 INFO:teuthology.orchestra.run.smithi001.stdout:ID="centos" 2024-09-15T22:03:46.667 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE="rhel fedora" 2024-09-15T22:03:46.667 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="9" 2024-09-15T22:03:46.667 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM_ID="platform:el9" 2024-09-15T22:03:46.667 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-15T22:03:46.667 INFO:teuthology.orchestra.run.smithi001.stdout:ANSI_COLOR="0;31" 2024-09-15T22:03:46.667 INFO:teuthology.orchestra.run.smithi001.stdout:LOGO="fedora-logo-icon" 2024-09-15T22:03:46.667 INFO:teuthology.orchestra.run.smithi001.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-15T22:03:46.667 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://centos.org/" 2024-09-15T22:03:46.668 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-15T22:03:46.668 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-15T22:03:46.668 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-15T22:03:46.668 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server 2024-09-15T22:03:46.686 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2024-09-15T22:03:46.704 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2024-09-15T22:03:46.705 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2024-09-15T22:03:46.763 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2024-09-15T22:03:46.763 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9" 2024-09-15T22:03:46.763 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2024-09-15T22:03:46.763 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2024-09-15T22:03:46.763 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9" 2024-09-15T22:03:46.763 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9" 2024-09-15T22:03:46.763 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-15T22:03:46.764 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2024-09-15T22:03:46.764 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon" 2024-09-15T22:03:46.764 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-15T22:03:46.764 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2024-09-15T22:03:46.764 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-15T22:03:46.764 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-15T22:03:46.764 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-15T22:03:46.764 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2024-09-15T22:03:46.786 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2024-09-15T22:03:46.805 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2024-09-15T22:03:46.805 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2024-09-15T22:03:46.863 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2024-09-15T22:03:46.863 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9" 2024-09-15T22:03:46.863 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2024-09-15T22:03:46.863 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2024-09-15T22:03:46.863 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9" 2024-09-15T22:03:46.863 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9" 2024-09-15T22:03:46.863 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-15T22:03:46.863 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2024-09-15T22:03:46.863 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon" 2024-09-15T22:03:46.864 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-15T22:03:46.864 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2024-09-15T22:03:46.864 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-15T22:03:46.864 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-15T22:03:46.864 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-15T22:03:46.864 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2024-09-15T22:03:46.919 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-15T22:03:46.930 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-15T22:03:46.936 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-15T22:03:46.936 DEBUG:teuthology.orchestra.run.smithi001:> test '!' -e /home/ubuntu/cephtest 2024-09-15T22:03:46.939 DEBUG:teuthology.orchestra.run.smithi012:> test '!' -e /home/ubuntu/cephtest 2024-09-15T22:03:46.941 DEBUG:teuthology.orchestra.run.smithi098:> test '!' -e /home/ubuntu/cephtest 2024-09-15T22:03:46.958 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-15T22:03:46.965 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-15T22:03:46.965 DEBUG:teuthology.orchestra.run.smithi001:> test -z $(ls -A /var/lib/ceph) 2024-09-15T22:03:46.997 DEBUG:teuthology.orchestra.run.smithi012:> test -z $(ls -A /var/lib/ceph) 2024-09-15T22:03:46.999 DEBUG:teuthology.orchestra.run.smithi098:> test -z $(ls -A /var/lib/ceph) 2024-09-15T22:03:47.034 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-15T22:03:47.108 INFO:teuthology.run_tasks:Running task kernel... 2024-09-15T22:03:47.122 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-15T22:03:47.122 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-09-15T22:03:47.122 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-09-15T22:03:47.123 DEBUG:teuthology.orchestra.run.smithi001:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T22:03:47.139 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:03:47.140 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-15T22:03:47.300 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-15T22:03:47.300 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-15T22:03:47.301 DEBUG:teuthology.orchestra.run.smithi001:> uname -r 2024-09-15T22:03:47.318 INFO:teuthology.orchestra.run.smithi001.stdout:5.14.0-503.el9.x86_64 2024-09-15T22:03:47.319 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-15T22:03:47.319 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-15T22:03:47.320 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum upgrade -y linux-firmware 2024-09-15T22:03:51.785 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 8.2 MB 00:02 2024-09-15T22:03:57.294 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - AppStream 4.7 MB/s | 20 MB 00:04 2024-09-15T22:04:04.002 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 6.5 MB 00:02 2024-09-15T22:04:05.436 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - Extras packages 135 kB/s | 19 kB 00:00 2024-09-15T22:04:06.790 INFO:teuthology.orchestra.run.smithi001.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-15T22:04:12.571 INFO:teuthology.orchestra.run.smithi001.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-15T22:04:14.749 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-09-15T22:04:14.750 INFO:teuthology.orchestra.run.smithi001.stdout:Nothing to do. 2024-09-15T22:04:14.750 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-09-15T22:04:14.871 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-15T22:04:14.871 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-15T22:04:15.015 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-15T22:04:15.015 DEBUG:teuthology.orchestra.run.smithi001:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-15T22:04:15.018 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi001.front.sepia.ceph.com to complete... 2024-09-15T22:04:21.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15 22:04:21 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-15T22:04:21.390 INFO:teuthology.orchestra.run.smithi001.stderr:FINISHED --2024-09-15 22:04:21-- 2024-09-15T22:04:21.390 INFO:teuthology.orchestra.run.smithi001.stderr:Total wall clock time: 6.3s 2024-09-15T22:04:21.390 INFO:teuthology.orchestra.run.smithi001.stderr:Downloaded: 1 files, 343M in 6.0s (57.0 MB/s) 2024-09-15T22:04:21.393 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-15T22:04:21.393 DEBUG:teuthology.orchestra.run.smithi001:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-15T22:04:23.618 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying... ######################################## 2024-09-15T22:04:23.729 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing... ######################################## 2024-09-15T22:04:23.858 INFO:teuthology.orchestra.run.smithi001.stdout:Updating / installing... 2024-09-15T22:04:32.174 INFO:teuthology.orchestra.run.smithi001.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-15T22:05:12.078 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi001.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-15T22:05:12.079 DEBUG:teuthology.orchestra.run.smithi001:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-15T22:05:12.173 INFO:teuthology.orchestra.run.smithi001.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:05:12.174 INFO:teuthology.orchestra.run.smithi001.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:05:12.174 INFO:teuthology.orchestra.run.smithi001.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:05:12.174 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:05:12.174 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-15T22:05:12.174 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-15T22:05:12.174 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-15T22:05:12.174 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-15T22:05:12.174 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-15T22:05:12.174 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-15T22:05:12.174 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-15T22:05:12.175 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-15T22:05:12.175 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-15T22:05:12.175 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-15T22:05:12.175 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-15T22:05:12.175 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-15T22:05:12.175 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-15T22:05:12.175 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-15T22:05:12.175 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-15T22:05:12.175 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-15T22:05:12.175 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-15T22:05:12.175 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-15T22:05:12.175 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-15T22:05:12.175 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-15T22:05:12.176 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-15T22:05:12.176 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-15T22:05:12.176 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-15T22:05:12.176 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-15T22:05:12.176 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-15T22:05:12.176 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-15T22:05:12.176 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-15T22:05:12.176 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-15T22:05:12.176 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-15T22:05:12.176 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-15T22:05:12.176 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-15T22:05:12.176 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-15T22:05:12.176 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-15T22:05:12.177 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-15T22:05:12.177 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-15T22:05:12.177 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-15T22:05:12.177 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-15T22:05:12.177 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-15T22:05:12.177 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-15T22:05:12.177 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-15T22:05:12.177 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-15T22:05:12.177 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-15T22:05:12.177 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-15T22:05:12.177 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-15T22:05:12.177 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-15T22:05:12.178 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-15T22:05:12.178 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-15T22:05:12.178 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-15T22:05:12.178 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-15T22:05:12.178 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-15T22:05:12.178 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-15T22:05:12.178 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-15T22:05:12.178 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-15T22:05:12.178 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-15T22:05:12.178 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-15T22:05:12.178 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-15T22:05:12.178 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-15T22:05:12.178 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-15T22:05:12.179 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-15T22:05:12.179 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-15T22:05:12.179 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-15T22:05:12.179 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-15T22:05:12.179 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-15T22:05:12.179 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-15T22:05:12.179 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-15T22:05:12.179 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-15T22:05:12.179 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-15T22:05:12.179 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-15T22:05:12.179 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-15T22:05:12.179 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-15T22:05:12.179 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-15T22:05:12.179 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-15T22:05:12.180 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-15T22:05:12.180 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-15T22:05:12.180 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-15T22:05:12.180 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-15T22:05:12.180 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-15T22:05:12.180 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-15T22:05:12.180 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-15T22:05:12.180 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-15T22:05:12.180 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-15T22:05:12.180 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-15T22:05:12.180 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-15T22:05:12.180 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-15T22:05:12.180 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-15T22:05:12.181 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-15T22:05:12.181 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-15T22:05:12.181 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-15T22:05:12.181 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-15T22:05:12.181 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-15T22:05:12.181 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-15T22:05:12.181 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-15T22:05:12.181 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-15T22:05:12.181 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-15T22:05:12.181 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-15T22:05:12.181 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-15T22:05:12.181 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-15T22:05:12.181 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-15T22:05:12.182 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-15T22:05:12.182 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-15T22:05:12.182 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-15T22:05:12.182 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-15T22:05:12.182 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-15T22:05:12.182 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-15T22:05:12.182 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-15T22:05:12.182 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-15T22:05:12.182 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-15T22:05:12.182 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-15T22:05:12.182 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-15T22:05:12.182 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-15T22:05:12.182 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-15T22:05:12.183 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-15T22:05:12.183 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-15T22:05:12.183 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-15T22:05:12.183 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-15T22:05:12.183 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-15T22:05:12.183 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-15T22:05:12.183 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-15T22:05:12.183 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-15T22:05:12.183 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-15T22:05:12.183 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-15T22:05:12.183 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-15T22:05:12.183 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-15T22:05:12.183 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-15T22:05:12.184 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-15T22:05:12.184 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-15T22:05:12.184 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-15T22:05:12.184 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-15T22:05:12.184 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-15T22:05:12.184 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-15T22:05:12.184 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-15T22:05:12.184 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-15T22:05:12.184 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-15T22:05:12.184 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-15T22:05:12.184 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-15T22:05:12.184 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-15T22:05:12.185 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-15T22:05:12.185 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-15T22:05:12.185 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-15T22:05:12.185 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-15T22:05:12.185 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-15T22:05:12.185 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-15T22:05:12.185 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-15T22:05:12.185 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-15T22:05:12.185 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-15T22:05:12.185 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-15T22:05:12.185 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-15T22:05:12.185 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-15T22:05:12.185 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-15T22:05:12.186 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-15T22:05:12.186 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-15T22:05:12.186 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-15T22:05:12.186 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-15T22:05:12.186 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-15T22:05:12.186 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-15T22:05:12.186 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-15T22:05:12.186 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-15T22:05:12.186 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-15T22:05:12.186 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-15T22:05:12.186 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-15T22:05:12.186 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-15T22:05:12.186 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-15T22:05:12.186 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-15T22:05:12.187 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-15T22:05:12.187 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-15T22:05:12.187 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-15T22:05:12.187 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-15T22:05:12.187 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-15T22:05:12.187 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-15T22:05:12.187 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-15T22:05:12.187 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-15T22:05:12.187 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-15T22:05:12.187 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-15T22:05:12.187 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-15T22:05:12.187 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-15T22:05:12.187 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-15T22:05:12.187 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-15T22:05:12.188 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-15T22:05:12.188 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-15T22:05:12.188 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-15T22:05:12.188 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-15T22:05:12.188 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-15T22:05:12.188 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-15T22:05:12.189 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-15T22:05:12.189 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-15T22:05:12.189 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-15T22:05:12.189 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-15T22:05:12.189 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-15T22:05:12.190 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-15T22:05:12.190 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-15T22:05:12.190 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-15T22:05:12.190 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-15T22:05:12.190 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-15T22:05:12.191 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-15T22:05:12.191 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-15T22:05:12.191 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-15T22:05:12.191 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-15T22:05:12.191 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-15T22:05:12.192 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-15T22:05:12.192 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-15T22:05:12.192 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-15T22:05:12.192 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-15T22:05:12.192 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-15T22:05:12.193 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-15T22:05:12.193 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-15T22:05:12.193 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-15T22:05:12.193 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-15T22:05:12.193 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-15T22:05:12.193 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-15T22:05:12.194 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-15T22:05:12.194 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-15T22:05:12.194 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-15T22:05:12.194 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-15T22:05:12.194 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-15T22:05:12.195 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-15T22:05:12.195 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-15T22:05:12.195 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-15T22:05:12.195 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-15T22:05:12.195 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-15T22:05:12.196 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-15T22:05:12.196 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-15T22:05:12.196 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-15T22:05:12.196 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-15T22:05:12.196 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-15T22:05:12.197 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-15T22:05:12.197 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-15T22:05:12.197 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-15T22:05:12.197 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-15T22:05:12.197 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-15T22:05:12.197 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-15T22:05:12.198 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-15T22:05:12.198 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-15T22:05:12.198 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-15T22:05:12.198 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-15T22:05:12.198 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-15T22:05:12.199 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-15T22:05:12.199 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-15T22:05:12.199 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-15T22:05:12.199 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-15T22:05:12.199 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-15T22:05:12.200 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-15T22:05:12.200 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-15T22:05:12.200 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-15T22:05:12.200 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-15T22:05:12.200 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-15T22:05:12.201 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-15T22:05:12.201 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-15T22:05:12.201 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-15T22:05:12.201 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-15T22:05:12.201 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-15T22:05:12.202 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-15T22:05:12.202 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-15T22:05:12.202 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-15T22:05:12.202 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-15T22:05:12.202 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-15T22:05:12.203 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-15T22:05:12.203 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-15T22:05:12.203 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-15T22:05:12.203 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-15T22:05:12.203 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-15T22:05:12.203 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-15T22:05:12.204 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-15T22:05:12.204 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-15T22:05:12.204 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-15T22:05:12.204 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-15T22:05:12.204 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-15T22:05:12.205 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-15T22:05:12.205 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-15T22:05:12.205 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-15T22:05:12.205 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-15T22:05:12.205 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-15T22:05:12.206 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-15T22:05:12.206 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-15T22:05:12.206 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-15T22:05:12.206 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-15T22:05:12.206 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-15T22:05:12.206 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-15T22:05:12.207 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-15T22:05:12.207 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-15T22:05:12.207 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-15T22:05:12.207 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-15T22:05:12.208 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-15T22:05:12.208 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-15T22:05:12.208 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-15T22:05:12.208 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-15T22:05:12.209 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-15T22:05:12.209 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-15T22:05:12.210 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-15T22:05:12.210 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-15T22:05:12.210 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-15T22:05:12.210 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-15T22:05:12.210 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-15T22:05:12.211 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-15T22:05:12.211 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-15T22:05:12.211 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-15T22:05:12.211 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-15T22:05:12.211 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-15T22:05:12.211 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-15T22:05:12.211 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-15T22:05:12.211 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-15T22:05:12.211 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-15T22:05:12.212 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-15T22:05:12.212 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-15T22:05:12.212 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-15T22:05:12.212 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-15T22:05:12.212 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-15T22:05:12.212 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-15T22:05:12.212 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-15T22:05:12.212 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-15T22:05:12.212 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-15T22:05:12.213 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-15T22:05:12.213 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-15T22:05:12.213 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-15T22:05:12.213 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-15T22:05:12.213 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-15T22:05:12.213 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-15T22:05:12.213 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-15T22:05:12.213 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-15T22:05:12.213 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-15T22:05:12.213 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-15T22:05:12.213 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-15T22:05:12.213 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-15T22:05:12.213 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-15T22:05:12.213 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-15T22:05:12.214 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-15T22:05:12.214 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-15T22:05:12.214 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-15T22:05:12.214 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-15T22:05:12.214 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-15T22:05:12.214 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-15T22:05:12.214 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-15T22:05:12.214 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-15T22:05:12.214 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-15T22:05:12.214 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-15T22:05:12.214 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-15T22:05:12.214 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-15T22:05:12.214 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-15T22:05:12.215 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-15T22:05:12.215 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-15T22:05:12.215 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-15T22:05:12.215 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-15T22:05:12.215 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-15T22:05:12.215 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-15T22:05:12.215 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-15T22:05:12.215 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-15T22:05:12.215 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-15T22:05:12.215 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-15T22:05:12.216 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-15T22:05:12.216 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-15T22:05:12.216 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-15T22:05:12.216 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-15T22:05:12.216 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-15T22:05:12.217 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-15T22:05:12.217 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-15T22:05:12.217 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-15T22:05:12.217 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-15T22:05:12.217 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-15T22:05:12.217 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-15T22:05:12.217 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-15T22:05:12.217 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-15T22:05:12.217 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-15T22:05:12.217 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-15T22:05:12.217 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-15T22:05:12.218 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-15T22:05:12.218 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-15T22:05:12.218 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-15T22:05:12.218 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-15T22:05:12.218 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-15T22:05:12.218 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-15T22:05:12.219 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-15T22:05:12.219 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-15T22:05:12.219 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-15T22:05:12.219 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-15T22:05:12.219 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-15T22:05:12.219 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-15T22:05:12.219 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-15T22:05:12.219 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-15T22:05:12.219 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-15T22:05:12.219 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-15T22:05:12.219 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-15T22:05:12.219 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-15T22:05:12.220 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-15T22:05:12.220 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-15T22:05:12.220 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-15T22:05:12.220 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-15T22:05:12.220 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-15T22:05:12.220 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-15T22:05:12.220 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-15T22:05:12.220 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-15T22:05:12.220 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-15T22:05:12.220 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-15T22:05:12.220 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-15T22:05:12.220 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-15T22:05:12.221 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-15T22:05:12.221 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-15T22:05:12.221 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-15T22:05:12.221 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-15T22:05:12.221 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-15T22:05:12.221 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-15T22:05:12.221 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-15T22:05:12.221 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-15T22:05:12.221 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-15T22:05:12.221 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-15T22:05:12.221 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-15T22:05:12.221 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-15T22:05:12.221 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-15T22:05:12.222 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-15T22:05:12.222 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-15T22:05:12.222 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-15T22:05:12.222 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-15T22:05:12.222 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-15T22:05:12.222 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-15T22:05:12.222 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-15T22:05:12.222 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-15T22:05:12.222 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-15T22:05:12.222 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-15T22:05:12.222 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-15T22:05:12.222 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-15T22:05:12.222 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-15T22:05:12.223 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-15T22:05:12.223 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-15T22:05:12.223 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-15T22:05:12.223 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-15T22:05:12.223 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-15T22:05:12.223 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-15T22:05:12.223 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-15T22:05:12.223 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-15T22:05:12.223 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-15T22:05:12.223 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-15T22:05:12.223 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-15T22:05:12.223 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-15T22:05:12.223 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-15T22:05:12.224 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-15T22:05:12.224 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-15T22:05:12.224 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-15T22:05:12.224 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-15T22:05:12.224 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-15T22:05:12.224 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-15T22:05:12.224 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-15T22:05:12.224 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-15T22:05:12.224 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-15T22:05:12.224 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-15T22:05:12.224 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-15T22:05:12.224 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-15T22:05:12.224 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-15T22:05:12.225 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-15T22:05:12.225 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-15T22:05:12.225 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-15T22:05:12.225 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-15T22:05:12.225 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-15T22:05:12.225 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-15T22:05:12.225 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-15T22:05:12.225 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-15T22:05:12.225 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-15T22:05:12.225 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-15T22:05:12.225 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-15T22:05:12.225 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-15T22:05:12.225 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-15T22:05:12.225 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-15T22:05:12.226 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-15T22:05:12.226 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-15T22:05:12.226 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-15T22:05:12.226 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-15T22:05:12.226 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-15T22:05:12.226 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-15T22:05:12.226 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-15T22:05:12.226 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-15T22:05:12.226 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-15T22:05:12.226 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-15T22:05:12.226 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-15T22:05:12.226 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-15T22:05:12.227 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-15T22:05:12.227 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-15T22:05:12.227 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-15T22:05:12.227 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-15T22:05:12.227 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-15T22:05:12.227 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-15T22:05:12.227 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-15T22:05:12.227 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-15T22:05:12.227 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-15T22:05:12.227 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-15T22:05:12.227 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-15T22:05:12.227 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-15T22:05:12.227 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-15T22:05:12.227 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-15T22:05:12.228 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-15T22:05:12.228 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-15T22:05:12.228 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-15T22:05:12.228 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-15T22:05:12.228 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-15T22:05:12.228 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-15T22:05:12.228 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-15T22:05:12.228 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-15T22:05:12.228 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-15T22:05:12.228 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-15T22:05:12.228 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-15T22:05:12.228 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-15T22:05:12.228 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-15T22:05:12.229 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-15T22:05:12.229 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-15T22:05:12.229 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-15T22:05:12.229 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-15T22:05:12.229 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-15T22:05:12.229 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-15T22:05:12.229 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-15T22:05:12.229 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-15T22:05:12.229 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-15T22:05:12.229 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-15T22:05:12.229 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-15T22:05:12.229 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-15T22:05:12.229 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-15T22:05:12.230 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-15T22:05:12.230 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-15T22:05:12.230 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-15T22:05:12.230 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-15T22:05:12.230 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-15T22:05:12.230 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-15T22:05:12.230 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-15T22:05:12.230 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-15T22:05:12.230 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-15T22:05:12.230 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-15T22:05:12.230 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-15T22:05:12.230 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-15T22:05:12.230 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-15T22:05:12.230 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-15T22:05:12.231 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-15T22:05:12.231 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-15T22:05:12.231 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-15T22:05:12.231 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-15T22:05:12.231 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-15T22:05:12.231 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-15T22:05:12.231 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-15T22:05:12.231 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-15T22:05:12.231 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-15T22:05:12.231 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-15T22:05:12.231 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-15T22:05:12.231 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-15T22:05:12.231 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-15T22:05:12.231 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-15T22:05:12.232 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-15T22:05:12.232 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-15T22:05:12.232 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-15T22:05:12.232 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-15T22:05:12.232 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-15T22:05:12.232 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-15T22:05:12.232 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-15T22:05:12.232 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-15T22:05:12.232 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-15T22:05:12.232 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-15T22:05:12.232 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-15T22:05:12.232 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-15T22:05:12.233 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-15T22:05:12.233 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-15T22:05:12.233 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-15T22:05:12.233 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-15T22:05:12.233 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-15T22:05:12.233 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-15T22:05:12.233 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-15T22:05:12.233 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-15T22:05:12.233 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-15T22:05:12.233 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-15T22:05:12.233 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-15T22:05:12.233 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-15T22:05:12.233 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-15T22:05:12.234 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-15T22:05:12.234 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-15T22:05:12.234 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-15T22:05:12.234 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-15T22:05:12.234 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-15T22:05:12.234 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-15T22:05:12.234 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-15T22:05:12.234 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-15T22:05:12.234 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-15T22:05:12.234 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-15T22:05:12.234 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-15T22:05:12.234 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-15T22:05:12.234 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-15T22:05:12.235 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-15T22:05:12.235 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-15T22:05:12.235 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-15T22:05:12.235 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-15T22:05:12.235 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-15T22:05:12.235 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-15T22:05:12.235 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-15T22:05:12.235 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-15T22:05:12.235 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-15T22:05:12.235 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-15T22:05:12.235 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-15T22:05:12.235 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-15T22:05:12.235 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-15T22:05:12.235 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-15T22:05:12.236 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-15T22:05:12.236 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-15T22:05:12.236 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-15T22:05:12.236 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-15T22:05:12.236 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-15T22:05:12.236 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-15T22:05:12.236 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-15T22:05:12.236 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-15T22:05:12.236 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-15T22:05:12.236 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-15T22:05:12.237 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-15T22:05:12.237 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-15T22:05:12.237 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-15T22:05:12.237 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-15T22:05:12.237 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-15T22:05:12.237 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-15T22:05:12.237 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-15T22:05:12.237 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-15T22:05:12.237 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-15T22:05:12.237 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-15T22:05:12.237 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-15T22:05:12.238 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-15T22:05:12.238 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-15T22:05:12.238 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-15T22:05:12.238 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-15T22:05:12.238 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-15T22:05:12.238 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-15T22:05:12.238 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-15T22:05:12.238 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-15T22:05:12.238 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-15T22:05:12.238 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-15T22:05:12.238 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-15T22:05:12.238 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-15T22:05:12.238 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-15T22:05:12.238 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-15T22:05:12.239 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-15T22:05:12.239 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-15T22:05:12.239 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-15T22:05:12.239 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-15T22:05:12.239 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-15T22:05:12.239 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-15T22:05:12.239 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-15T22:05:12.239 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-15T22:05:12.239 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-15T22:05:12.239 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-15T22:05:12.239 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-15T22:05:12.239 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-15T22:05:12.239 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-15T22:05:12.240 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-15T22:05:12.240 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-15T22:05:12.240 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-15T22:05:12.240 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-15T22:05:12.240 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-15T22:05:12.240 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-15T22:05:12.240 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-15T22:05:12.240 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-15T22:05:12.240 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-15T22:05:12.240 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-15T22:05:12.241 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-15T22:05:12.241 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-15T22:05:12.241 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-15T22:05:12.241 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-15T22:05:12.241 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-15T22:05:12.241 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-15T22:05:12.241 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-15T22:05:12.241 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-15T22:05:12.242 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-15T22:05:12.242 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-15T22:05:12.242 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-15T22:05:12.242 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-15T22:05:12.242 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-15T22:05:12.242 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-15T22:05:12.242 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-15T22:05:12.242 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-15T22:05:12.242 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-15T22:05:12.242 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-15T22:05:12.242 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-15T22:05:12.242 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-15T22:05:12.243 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-15T22:05:12.243 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-15T22:05:12.243 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-15T22:05:12.243 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-15T22:05:12.243 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-15T22:05:12.243 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-15T22:05:12.243 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-15T22:05:12.244 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-15T22:05:12.244 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-15T22:05:12.244 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-15T22:05:12.244 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-15T22:05:12.244 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-15T22:05:12.244 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-15T22:05:12.244 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-15T22:05:12.244 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-15T22:05:12.244 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-15T22:05:12.245 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-15T22:05:12.245 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-15T22:05:12.245 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-15T22:05:12.245 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-15T22:05:12.245 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-15T22:05:12.245 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-15T22:05:12.245 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-15T22:05:12.245 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-15T22:05:12.245 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-15T22:05:12.245 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-15T22:05:12.245 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-15T22:05:12.246 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-15T22:05:12.246 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-15T22:05:12.246 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-15T22:05:12.246 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-15T22:05:12.246 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-15T22:05:12.246 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-15T22:05:12.246 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-15T22:05:12.246 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-15T22:05:12.246 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-15T22:05:12.246 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-15T22:05:12.246 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-15T22:05:12.246 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-15T22:05:12.247 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-15T22:05:12.247 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-15T22:05:12.247 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-15T22:05:12.247 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-15T22:05:12.247 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-15T22:05:12.247 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-15T22:05:12.247 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-15T22:05:12.247 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-15T22:05:12.247 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-15T22:05:12.247 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-15T22:05:12.247 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-15T22:05:12.247 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-15T22:05:12.247 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-15T22:05:12.247 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-15T22:05:12.248 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-15T22:05:12.248 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-15T22:05:12.248 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-15T22:05:12.248 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-15T22:05:12.248 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-15T22:05:12.248 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-15T22:05:12.248 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-15T22:05:12.248 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-15T22:05:12.248 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-15T22:05:12.249 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-15T22:05:12.249 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-15T22:05:12.249 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-15T22:05:12.249 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-15T22:05:12.249 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-15T22:05:12.249 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-15T22:05:12.249 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-15T22:05:12.250 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-15T22:05:12.250 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-15T22:05:12.250 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-15T22:05:12.250 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-15T22:05:12.250 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-15T22:05:12.250 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-15T22:05:12.251 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-15T22:05:12.251 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-15T22:05:12.251 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-15T22:05:12.251 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-15T22:05:12.251 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-15T22:05:12.251 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-15T22:05:12.252 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-15T22:05:12.252 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-15T22:05:12.252 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-15T22:05:12.252 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-15T22:05:12.252 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-15T22:05:12.252 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-15T22:05:12.253 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-15T22:05:12.253 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-15T22:05:12.253 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-15T22:05:12.253 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-15T22:05:12.253 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-15T22:05:12.253 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-15T22:05:12.253 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-15T22:05:12.253 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-15T22:05:12.253 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-15T22:05:12.254 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-15T22:05:12.254 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-15T22:05:12.254 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-15T22:05:12.254 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-15T22:05:12.254 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-15T22:05:12.254 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-15T22:05:12.254 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-15T22:05:12.254 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-15T22:05:12.254 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-15T22:05:12.254 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-15T22:05:12.254 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-15T22:05:12.254 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-15T22:05:12.254 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-15T22:05:12.254 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-15T22:05:12.255 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-15T22:05:12.255 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-15T22:05:12.255 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-15T22:05:12.255 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-15T22:05:12.255 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-15T22:05:12.255 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-15T22:05:12.255 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-15T22:05:12.255 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-15T22:05:12.255 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-15T22:05:12.255 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-15T22:05:12.255 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-15T22:05:12.255 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-15T22:05:12.255 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-15T22:05:12.256 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-15T22:05:12.256 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-15T22:05:12.256 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-15T22:05:12.256 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-15T22:05:12.256 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-15T22:05:12.256 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-15T22:05:12.256 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-15T22:05:12.256 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-15T22:05:12.256 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-15T22:05:12.256 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-15T22:05:12.256 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-15T22:05:12.256 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-15T22:05:12.257 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-15T22:05:12.257 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-15T22:05:12.257 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-15T22:05:12.257 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-15T22:05:12.257 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-15T22:05:12.257 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-15T22:05:12.257 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-15T22:05:12.257 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-15T22:05:12.257 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-15T22:05:12.257 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-15T22:05:12.257 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-15T22:05:12.257 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-15T22:05:12.257 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-15T22:05:12.258 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-15T22:05:12.258 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-15T22:05:12.258 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-15T22:05:12.258 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-15T22:05:12.258 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-15T22:05:12.258 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-15T22:05:12.258 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-15T22:05:12.258 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-15T22:05:12.258 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-15T22:05:12.258 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-15T22:05:12.258 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-15T22:05:12.259 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-15T22:05:12.259 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-15T22:05:12.259 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-15T22:05:12.259 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-15T22:05:12.259 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-15T22:05:12.259 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-15T22:05:12.259 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-15T22:05:12.259 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-15T22:05:12.259 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-15T22:05:12.259 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-15T22:05:12.259 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-15T22:05:12.259 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-15T22:05:12.259 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-15T22:05:12.260 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-15T22:05:12.260 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-15T22:05:12.260 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-15T22:05:12.260 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-15T22:05:12.260 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-15T22:05:12.260 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-15T22:05:12.260 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-15T22:05:12.260 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-15T22:05:12.260 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-15T22:05:12.260 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-15T22:05:12.261 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-15T22:05:12.261 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-15T22:05:12.261 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-15T22:05:12.261 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-15T22:05:12.261 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-15T22:05:12.261 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-15T22:05:12.261 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-15T22:05:12.261 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-15T22:05:12.261 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-15T22:05:12.261 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-15T22:05:12.261 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-15T22:05:12.261 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-15T22:05:12.261 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-15T22:05:12.262 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-15T22:05:12.262 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-15T22:05:12.262 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-15T22:05:12.262 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-15T22:05:12.262 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-15T22:05:12.262 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-15T22:05:12.262 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-15T22:05:12.262 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-15T22:05:12.262 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-15T22:05:12.262 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-15T22:05:12.262 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-15T22:05:12.262 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-15T22:05:12.262 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-15T22:05:12.262 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-15T22:05:12.263 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-15T22:05:12.263 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-15T22:05:12.263 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-15T22:05:12.263 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-15T22:05:12.263 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-15T22:05:12.263 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-15T22:05:12.263 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-15T22:05:12.263 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-15T22:05:12.263 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-15T22:05:12.263 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-15T22:05:12.263 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-15T22:05:12.263 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-15T22:05:12.263 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-15T22:05:12.264 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-15T22:05:12.264 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-15T22:05:12.264 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-15T22:05:12.264 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-15T22:05:12.264 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-15T22:05:12.264 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-15T22:05:12.264 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-15T22:05:12.264 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-15T22:05:12.264 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-15T22:05:12.264 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-15T22:05:12.264 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-15T22:05:12.264 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-15T22:05:12.264 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-15T22:05:12.264 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-15T22:05:12.265 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-15T22:05:12.265 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-15T22:05:12.265 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-15T22:05:12.265 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-15T22:05:12.265 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-15T22:05:12.265 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-15T22:05:12.265 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-15T22:05:12.265 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-15T22:05:12.265 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-15T22:05:12.265 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-15T22:05:12.265 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-15T22:05:12.265 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-15T22:05:12.265 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-15T22:05:12.266 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-15T22:05:12.266 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-15T22:05:12.266 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-15T22:05:12.266 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-15T22:05:12.266 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-15T22:05:12.266 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-15T22:05:12.266 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-15T22:05:12.266 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-15T22:05:12.266 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-15T22:05:12.266 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-15T22:05:12.266 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-15T22:05:12.266 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-15T22:05:12.266 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-15T22:05:12.266 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-15T22:05:12.266 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-15T22:05:12.267 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-15T22:05:12.267 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-15T22:05:12.267 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-15T22:05:12.267 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-15T22:05:12.267 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-15T22:05:12.267 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-15T22:05:12.267 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-15T22:05:12.267 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-15T22:05:12.267 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-15T22:05:12.267 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-15T22:05:12.267 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-15T22:05:12.267 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-15T22:05:12.267 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-15T22:05:12.267 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-15T22:05:12.268 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-15T22:05:12.268 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-15T22:05:12.268 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-15T22:05:12.268 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-15T22:05:12.268 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-15T22:05:12.268 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-15T22:05:12.268 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-15T22:05:12.268 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-15T22:05:12.268 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-15T22:05:12.268 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-15T22:05:12.268 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-15T22:05:12.268 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-15T22:05:12.268 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-15T22:05:12.269 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-15T22:05:12.269 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-15T22:05:12.269 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-15T22:05:12.269 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-15T22:05:12.269 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-15T22:05:12.269 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-15T22:05:12.269 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-15T22:05:12.269 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-15T22:05:12.269 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-15T22:05:12.269 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-15T22:05:12.269 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-15T22:05:12.269 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-15T22:05:12.269 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-15T22:05:12.269 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-15T22:05:12.270 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-15T22:05:12.270 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-15T22:05:12.270 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-15T22:05:12.270 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-15T22:05:12.270 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-15T22:05:12.270 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-15T22:05:12.270 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-15T22:05:12.270 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-15T22:05:12.270 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-15T22:05:12.270 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-15T22:05:12.271 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-15T22:05:12.271 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-15T22:05:12.271 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-15T22:05:12.271 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-15T22:05:12.271 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-15T22:05:12.271 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-15T22:05:12.271 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-15T22:05:12.271 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-15T22:05:12.271 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-15T22:05:12.271 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-15T22:05:12.271 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-15T22:05:12.271 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-15T22:05:12.271 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-15T22:05:12.271 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-15T22:05:12.272 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-15T22:05:12.272 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-15T22:05:12.272 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-15T22:05:12.272 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-15T22:05:12.272 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-15T22:05:12.272 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-15T22:05:12.272 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-15T22:05:12.272 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-15T22:05:12.272 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-15T22:05:12.272 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-15T22:05:12.272 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-15T22:05:12.272 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-15T22:05:12.272 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-15T22:05:12.273 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-15T22:05:12.273 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-15T22:05:12.273 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-15T22:05:12.273 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-15T22:05:12.273 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-15T22:05:12.273 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-15T22:05:12.273 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-15T22:05:12.273 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-15T22:05:12.273 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-15T22:05:12.273 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-15T22:05:12.273 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-15T22:05:12.273 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-15T22:05:12.273 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-15T22:05:12.273 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-15T22:05:12.274 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-15T22:05:12.274 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-15T22:05:12.274 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-15T22:05:12.274 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-15T22:05:12.274 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-15T22:05:12.274 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-15T22:05:12.274 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-15T22:05:12.274 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-15T22:05:12.274 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-15T22:05:12.274 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-15T22:05:12.274 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-15T22:05:12.274 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-15T22:05:12.274 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-15T22:05:12.275 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-15T22:05:12.275 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-15T22:05:12.275 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-15T22:05:12.275 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-15T22:05:12.275 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-15T22:05:12.275 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-15T22:05:12.275 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-15T22:05:12.275 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-15T22:05:12.275 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-15T22:05:12.275 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-15T22:05:12.275 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-15T22:05:12.275 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-15T22:05:12.275 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-15T22:05:12.275 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-15T22:05:12.276 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-15T22:05:12.276 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-15T22:05:12.276 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-15T22:05:12.276 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-15T22:05:12.276 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-15T22:05:12.276 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-15T22:05:12.276 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-15T22:05:12.276 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-15T22:05:12.276 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-15T22:05:12.276 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-15T22:05:12.276 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-15T22:05:12.276 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-15T22:05:12.276 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-15T22:05:12.277 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-15T22:05:12.277 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-15T22:05:12.277 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-15T22:05:12.277 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-15T22:05:12.277 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-15T22:05:12.277 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-15T22:05:12.277 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-15T22:05:12.277 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-15T22:05:12.277 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-15T22:05:12.277 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-15T22:05:12.277 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-15T22:05:12.277 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-15T22:05:12.277 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-15T22:05:12.278 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-15T22:05:12.278 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-15T22:05:12.278 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-15T22:05:12.278 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-15T22:05:12.278 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-15T22:05:12.278 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-15T22:05:12.278 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-15T22:05:12.278 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-15T22:05:12.278 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-15T22:05:12.278 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-15T22:05:12.278 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-15T22:05:12.278 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-15T22:05:12.278 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-15T22:05:12.278 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-15T22:05:12.279 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-15T22:05:12.279 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-15T22:05:12.279 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-15T22:05:12.279 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-15T22:05:12.279 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-15T22:05:12.279 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-15T22:05:12.279 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-15T22:05:12.279 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-15T22:05:12.279 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-15T22:05:12.279 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-15T22:05:12.279 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-15T22:05:12.279 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-15T22:05:12.279 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-15T22:05:12.279 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-15T22:05:12.280 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-15T22:05:12.280 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-15T22:05:12.280 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-15T22:05:12.280 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-15T22:05:12.280 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-15T22:05:12.280 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-15T22:05:12.280 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-15T22:05:12.280 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-15T22:05:12.280 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-15T22:05:12.280 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-15T22:05:12.280 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-15T22:05:12.280 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-15T22:05:12.280 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-15T22:05:12.281 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-15T22:05:12.281 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-15T22:05:12.281 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-15T22:05:12.281 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-15T22:05:12.281 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-15T22:05:12.281 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-15T22:05:12.281 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-15T22:05:12.281 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-15T22:05:12.281 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-15T22:05:12.281 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-15T22:05:12.281 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-15T22:05:12.281 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-15T22:05:12.281 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-15T22:05:12.282 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-15T22:05:12.282 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-15T22:05:12.282 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-15T22:05:12.282 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-15T22:05:12.282 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-15T22:05:12.282 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-15T22:05:12.282 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-15T22:05:12.282 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-15T22:05:12.282 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-15T22:05:12.282 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-15T22:05:12.282 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-15T22:05:12.282 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-15T22:05:12.282 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-15T22:05:12.282 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-15T22:05:12.283 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-15T22:05:12.283 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-15T22:05:12.283 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-15T22:05:12.283 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-15T22:05:12.283 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-15T22:05:12.283 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-15T22:05:12.283 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-15T22:05:12.283 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-15T22:05:12.283 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-15T22:05:12.283 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-15T22:05:12.284 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-15T22:05:12.284 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-15T22:05:12.284 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-15T22:05:12.284 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-15T22:05:12.284 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-15T22:05:12.284 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-15T22:05:12.284 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-15T22:05:12.284 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-15T22:05:12.284 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-15T22:05:12.284 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-15T22:05:12.284 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-15T22:05:12.285 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-15T22:05:12.285 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-15T22:05:12.285 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-15T22:05:12.285 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-15T22:05:12.285 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-15T22:05:12.285 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-15T22:05:12.285 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-15T22:05:12.285 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-15T22:05:12.285 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-15T22:05:12.285 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-15T22:05:12.285 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-15T22:05:12.285 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-15T22:05:12.286 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-15T22:05:12.286 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-15T22:05:12.286 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-15T22:05:12.286 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-15T22:05:12.286 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-15T22:05:12.286 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-15T22:05:12.286 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-15T22:05:12.286 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-15T22:05:12.286 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-15T22:05:12.286 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-15T22:05:12.286 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-15T22:05:12.286 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-15T22:05:12.287 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-15T22:05:12.287 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-15T22:05:12.287 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-15T22:05:12.287 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-15T22:05:12.287 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-15T22:05:12.287 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-15T22:05:12.287 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-15T22:05:12.287 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-15T22:05:12.287 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-15T22:05:12.287 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-15T22:05:12.287 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-15T22:05:12.287 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-15T22:05:12.288 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-15T22:05:12.288 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-15T22:05:12.288 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-15T22:05:12.288 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-15T22:05:12.288 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-15T22:05:12.288 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-15T22:05:12.288 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-15T22:05:12.288 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-15T22:05:12.288 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-15T22:05:12.288 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-15T22:05:12.288 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-15T22:05:12.288 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-15T22:05:12.289 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-15T22:05:12.289 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-15T22:05:12.289 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-15T22:05:12.289 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-15T22:05:12.289 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-15T22:05:12.289 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-15T22:05:12.289 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-15T22:05:12.289 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-15T22:05:12.289 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-15T22:05:12.289 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-15T22:05:12.289 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-15T22:05:12.289 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-15T22:05:12.289 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-15T22:05:12.290 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-15T22:05:12.290 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-15T22:05:12.290 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-15T22:05:12.290 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-15T22:05:12.290 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-15T22:05:12.290 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-15T22:05:12.290 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-15T22:05:12.290 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-15T22:05:12.290 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-15T22:05:12.290 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-15T22:05:12.290 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-15T22:05:12.290 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-15T22:05:12.290 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-15T22:05:12.290 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-15T22:05:12.291 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-15T22:05:12.291 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-15T22:05:12.291 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-15T22:05:12.291 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-15T22:05:12.291 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-15T22:05:12.291 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-15T22:05:12.291 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-15T22:05:12.291 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-15T22:05:12.291 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-15T22:05:12.291 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-15T22:05:12.291 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-15T22:05:12.291 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-15T22:05:12.291 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-15T22:05:12.292 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-15T22:05:12.292 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-15T22:05:12.292 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-15T22:05:12.292 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-15T22:05:12.292 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-15T22:05:12.292 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-15T22:05:12.292 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-15T22:05:12.292 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-15T22:05:12.292 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-15T22:05:12.292 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-15T22:05:12.292 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-15T22:05:12.292 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-15T22:05:12.292 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-15T22:05:12.293 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-15T22:05:12.293 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-15T22:05:12.293 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-15T22:05:12.293 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-15T22:05:12.293 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-15T22:05:12.293 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-15T22:05:12.293 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-15T22:05:12.293 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-15T22:05:12.293 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-15T22:05:12.293 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-15T22:05:12.293 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-15T22:05:12.293 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-15T22:05:12.293 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-15T22:05:12.294 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-15T22:05:12.294 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-15T22:05:12.294 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-15T22:05:12.294 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-15T22:05:12.294 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-15T22:05:12.294 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-15T22:05:12.294 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-15T22:05:12.294 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-15T22:05:12.294 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-15T22:05:12.294 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-15T22:05:12.294 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-15T22:05:12.294 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-15T22:05:12.294 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-15T22:05:12.295 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-15T22:05:12.295 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-15T22:05:12.295 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-15T22:05:12.295 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-15T22:05:12.295 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-15T22:05:12.295 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-15T22:05:12.295 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-15T22:05:12.295 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-15T22:05:12.295 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-15T22:05:12.295 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-15T22:05:12.295 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-15T22:05:12.296 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-15T22:05:12.296 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-15T22:05:12.296 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-15T22:05:12.296 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-15T22:05:12.296 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-15T22:05:12.296 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-15T22:05:12.296 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-15T22:05:12.296 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-15T22:05:12.296 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-15T22:05:12.296 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-15T22:05:12.296 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-15T22:05:12.297 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-15T22:05:12.297 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-15T22:05:12.297 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-15T22:05:12.297 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-15T22:05:12.297 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-15T22:05:12.297 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-15T22:05:12.297 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-15T22:05:12.297 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-15T22:05:12.297 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-15T22:05:12.297 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-15T22:05:12.297 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-15T22:05:12.297 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-15T22:05:12.297 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-15T22:05:12.297 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-15T22:05:12.298 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-15T22:05:12.298 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-15T22:05:12.298 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-15T22:05:12.298 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-15T22:05:12.298 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-15T22:05:12.298 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-15T22:05:12.298 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-15T22:05:12.298 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-15T22:05:12.298 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-15T22:05:12.298 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-15T22:05:12.298 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-15T22:05:12.298 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-15T22:05:12.298 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-15T22:05:12.299 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-15T22:05:12.299 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-15T22:05:12.299 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-15T22:05:12.299 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-15T22:05:12.299 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-15T22:05:12.299 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-15T22:05:12.299 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-15T22:05:12.299 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-15T22:05:12.299 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-15T22:05:12.299 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-15T22:05:12.299 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-15T22:05:12.299 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-15T22:05:12.299 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-15T22:05:12.300 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-15T22:05:12.300 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-15T22:05:12.300 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-15T22:05:12.300 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-15T22:05:12.300 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-15T22:05:12.300 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-15T22:05:12.300 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-15T22:05:12.300 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-15T22:05:12.300 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-15T22:05:12.300 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-15T22:05:12.300 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-15T22:05:12.300 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-15T22:05:12.300 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-15T22:05:12.300 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-15T22:05:12.301 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-15T22:05:12.301 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-15T22:05:12.301 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-15T22:05:12.301 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-15T22:05:12.301 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-15T22:05:12.301 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-15T22:05:12.301 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-15T22:05:12.301 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-15T22:05:12.301 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-15T22:05:12.301 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-15T22:05:12.301 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-15T22:05:12.301 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-15T22:05:12.301 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-15T22:05:12.302 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-15T22:05:12.302 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-15T22:05:12.302 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-15T22:05:12.302 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-15T22:05:12.302 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-15T22:05:12.302 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-15T22:05:12.302 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-15T22:05:12.302 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-15T22:05:12.302 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-15T22:05:12.302 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-15T22:05:12.302 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-15T22:05:12.302 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-15T22:05:12.302 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-15T22:05:12.302 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-15T22:05:12.303 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-15T22:05:12.303 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-15T22:05:12.303 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-15T22:05:12.303 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-15T22:05:12.303 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-15T22:05:12.303 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-15T22:05:12.303 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-15T22:05:12.303 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-15T22:05:12.303 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-15T22:05:12.303 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-15T22:05:12.303 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-15T22:05:12.303 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-15T22:05:12.303 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-15T22:05:12.304 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-15T22:05:12.304 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-15T22:05:12.304 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-15T22:05:12.304 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-15T22:05:12.304 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-15T22:05:12.304 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-15T22:05:12.304 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-15T22:05:12.304 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-15T22:05:12.304 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-15T22:05:12.304 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-15T22:05:12.304 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-15T22:05:12.304 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-15T22:05:12.304 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-15T22:05:12.305 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-15T22:05:12.305 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-15T22:05:12.305 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-15T22:05:12.305 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-15T22:05:12.305 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-15T22:05:12.305 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-15T22:05:12.305 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-15T22:05:12.305 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-15T22:05:12.305 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-15T22:05:12.305 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-15T22:05:12.305 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-15T22:05:12.305 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-15T22:05:12.305 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-15T22:05:12.305 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-15T22:05:12.306 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-15T22:05:12.306 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-15T22:05:12.306 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-15T22:05:12.306 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-15T22:05:12.306 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-15T22:05:12.306 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-15T22:05:12.306 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-15T22:05:12.306 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-15T22:05:12.306 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-15T22:05:12.306 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-15T22:05:12.306 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-15T22:05:12.306 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-15T22:05:12.306 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-15T22:05:12.306 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-15T22:05:12.307 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-15T22:05:12.307 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-15T22:05:12.307 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-15T22:05:12.307 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-15T22:05:12.307 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-15T22:05:12.307 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-15T22:05:12.307 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-15T22:05:12.307 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-15T22:05:12.307 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-15T22:05:12.307 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-15T22:05:12.307 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-15T22:05:12.307 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-15T22:05:12.307 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-15T22:05:12.307 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-15T22:05:12.308 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-15T22:05:12.308 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-15T22:05:12.308 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-15T22:05:12.308 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-15T22:05:12.308 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-15T22:05:12.308 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-15T22:05:12.308 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-15T22:05:12.308 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-15T22:05:12.308 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-15T22:05:12.308 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-15T22:05:12.309 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-15T22:05:12.309 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-15T22:05:12.309 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-15T22:05:12.309 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-15T22:05:12.309 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-15T22:05:12.309 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-15T22:05:12.309 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-15T22:05:12.309 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-15T22:05:12.309 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-15T22:05:12.310 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-15T22:05:12.310 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-15T22:05:12.310 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-15T22:05:12.310 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-15T22:05:12.310 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-15T22:05:12.311 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-15T22:05:12.311 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-15T22:05:12.311 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-15T22:05:12.311 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-15T22:05:12.311 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-15T22:05:12.311 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-15T22:05:12.311 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-15T22:05:12.311 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-15T22:05:12.312 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-15T22:05:12.312 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-15T22:05:12.312 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-15T22:05:12.312 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-15T22:05:12.312 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-15T22:05:12.312 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-15T22:05:12.312 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-15T22:05:12.312 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-15T22:05:12.312 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-15T22:05:12.312 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-15T22:05:12.313 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-15T22:05:12.313 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-15T22:05:12.313 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-15T22:05:12.313 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-15T22:05:12.313 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-15T22:05:12.313 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-15T22:05:12.313 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-15T22:05:12.313 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-15T22:05:12.313 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-15T22:05:12.313 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-15T22:05:12.313 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-15T22:05:12.313 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-15T22:05:12.313 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-15T22:05:12.314 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-15T22:05:12.314 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-15T22:05:12.314 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-15T22:05:12.314 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-15T22:05:12.314 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-15T22:05:12.314 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-15T22:05:12.314 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-15T22:05:12.314 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-15T22:05:12.314 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-15T22:05:12.314 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-15T22:05:12.314 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-15T22:05:12.314 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-15T22:05:12.314 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-15T22:05:12.315 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-15T22:05:12.315 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-15T22:05:12.315 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-15T22:05:12.315 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-15T22:05:12.315 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-15T22:05:12.315 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-15T22:05:12.315 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-15T22:05:12.315 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-15T22:05:12.315 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-15T22:05:12.315 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-15T22:05:12.315 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-15T22:05:12.315 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-15T22:05:12.315 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-15T22:05:12.316 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-15T22:05:12.316 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-15T22:05:12.316 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-15T22:05:12.316 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-15T22:05:12.316 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-15T22:05:12.316 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-15T22:05:12.316 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-15T22:05:12.316 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-15T22:05:12.316 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-15T22:05:12.316 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-15T22:05:12.316 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-15T22:05:12.316 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-15T22:05:12.316 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-15T22:05:12.317 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-15T22:05:12.317 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-15T22:05:12.317 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-15T22:05:12.317 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-15T22:05:12.317 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-15T22:05:12.317 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-15T22:05:12.317 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-15T22:05:12.317 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-15T22:05:12.317 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-15T22:05:12.317 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-15T22:05:12.317 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-15T22:05:12.317 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-15T22:05:12.317 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-15T22:05:12.318 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-15T22:05:12.318 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-15T22:05:12.318 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-15T22:05:12.318 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-15T22:05:12.318 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-15T22:05:12.318 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-15T22:05:12.318 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-15T22:05:12.318 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-15T22:05:12.318 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-15T22:05:12.318 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-15T22:05:12.318 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-15T22:05:12.318 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-15T22:05:12.318 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-15T22:05:12.318 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-15T22:05:12.319 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-15T22:05:12.319 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-15T22:05:12.319 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-15T22:05:12.319 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-15T22:05:12.319 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-15T22:05:12.319 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-15T22:05:12.319 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-15T22:05:12.319 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-15T22:05:12.319 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-15T22:05:12.319 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-15T22:05:12.319 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-15T22:05:12.319 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-15T22:05:12.320 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-15T22:05:12.320 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-15T22:05:12.320 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-15T22:05:12.320 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-15T22:05:12.320 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-15T22:05:12.320 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-15T22:05:12.320 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-15T22:05:12.320 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-15T22:05:12.320 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-15T22:05:12.320 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-15T22:05:12.320 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-15T22:05:12.320 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-15T22:05:12.320 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-15T22:05:12.321 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-15T22:05:12.321 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-15T22:05:12.321 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-15T22:05:12.321 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-15T22:05:12.321 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-15T22:05:12.321 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-15T22:05:12.321 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-15T22:05:12.321 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-15T22:05:12.321 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-15T22:05:12.321 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-15T22:05:12.321 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-15T22:05:12.321 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-15T22:05:12.321 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-15T22:05:12.322 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-15T22:05:12.322 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-15T22:05:12.322 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-15T22:05:12.322 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-15T22:05:12.322 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-15T22:05:12.322 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-15T22:05:12.322 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-15T22:05:12.322 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-15T22:05:12.322 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-15T22:05:12.322 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-15T22:05:12.322 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-15T22:05:12.322 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-15T22:05:12.322 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-15T22:05:12.323 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-15T22:05:12.323 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-15T22:05:12.323 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-15T22:05:12.323 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-15T22:05:12.323 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-15T22:05:12.323 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-15T22:05:12.323 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-15T22:05:12.323 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-15T22:05:12.323 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-15T22:05:12.323 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-15T22:05:12.323 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-15T22:05:12.323 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-15T22:05:12.323 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-15T22:05:12.324 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-15T22:05:12.324 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-15T22:05:12.324 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-15T22:05:12.324 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-15T22:05:12.324 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-15T22:05:12.324 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-15T22:05:12.324 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-15T22:05:12.324 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-15T22:05:12.324 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-15T22:05:12.324 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-15T22:05:12.324 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-15T22:05:12.324 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-15T22:05:12.325 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-15T22:05:12.325 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-15T22:05:12.325 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-15T22:05:12.325 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-15T22:05:12.325 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-15T22:05:12.325 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-15T22:05:12.325 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-15T22:05:12.325 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-15T22:05:12.325 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-15T22:05:12.325 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-15T22:05:12.326 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-15T22:05:12.326 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-15T22:05:12.326 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-15T22:05:12.326 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-15T22:05:12.326 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-15T22:05:12.326 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-15T22:05:12.326 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-15T22:05:12.326 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-15T22:05:12.326 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-15T22:05:12.326 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-15T22:05:12.326 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-15T22:05:12.326 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-15T22:05:12.326 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-15T22:05:12.326 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-15T22:05:12.327 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-15T22:05:12.327 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-15T22:05:12.327 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-15T22:05:12.327 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-15T22:05:12.327 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-15T22:05:12.327 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-15T22:05:12.327 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-15T22:05:12.327 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-15T22:05:12.327 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-15T22:05:12.327 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-15T22:05:12.327 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-15T22:05:12.327 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-15T22:05:12.327 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-15T22:05:12.327 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-15T22:05:12.328 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-15T22:05:12.328 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-15T22:05:12.328 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-15T22:05:12.328 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-15T22:05:12.328 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-15T22:05:12.328 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-15T22:05:12.328 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-15T22:05:12.328 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-15T22:05:12.328 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-15T22:05:12.328 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-15T22:05:12.328 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-15T22:05:12.328 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-15T22:05:12.329 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-15T22:05:12.329 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-15T22:05:12.329 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-15T22:05:12.329 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-15T22:05:12.329 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-15T22:05:12.329 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-15T22:05:12.329 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-15T22:05:12.329 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-15T22:05:12.329 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-15T22:05:12.329 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-15T22:05:12.329 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-15T22:05:12.329 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-15T22:05:12.329 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-15T22:05:12.330 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-15T22:05:12.330 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-15T22:05:12.330 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-15T22:05:12.330 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-15T22:05:12.330 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-15T22:05:12.330 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-15T22:05:12.330 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-15T22:05:12.330 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-15T22:05:12.330 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-15T22:05:12.330 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-15T22:05:12.330 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-15T22:05:12.330 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-15T22:05:12.330 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-15T22:05:12.330 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-15T22:05:12.331 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-15T22:05:12.331 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-15T22:05:12.331 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-15T22:05:12.331 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-15T22:05:12.331 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-15T22:05:12.331 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-15T22:05:12.331 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-15T22:05:12.331 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-15T22:05:12.331 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-15T22:05:12.331 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-15T22:05:12.331 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-15T22:05:12.331 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-15T22:05:12.331 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-15T22:05:12.331 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-15T22:05:12.332 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-15T22:05:12.332 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-15T22:05:12.332 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-15T22:05:12.332 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-15T22:05:12.332 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-15T22:05:12.332 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-15T22:05:12.332 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-15T22:05:12.332 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-15T22:05:12.332 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-15T22:05:12.332 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-15T22:05:12.332 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-15T22:05:12.332 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-15T22:05:12.332 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-15T22:05:12.333 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-15T22:05:12.333 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-15T22:05:12.333 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-15T22:05:12.333 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-15T22:05:12.333 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-15T22:05:12.333 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-15T22:05:12.333 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-15T22:05:12.333 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-15T22:05:12.333 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-15T22:05:12.333 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-15T22:05:12.333 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-15T22:05:12.334 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-15T22:05:12.334 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-15T22:05:12.334 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-15T22:05:12.334 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-15T22:05:12.334 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-15T22:05:12.334 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-15T22:05:12.334 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-15T22:05:12.334 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-15T22:05:12.334 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-15T22:05:12.334 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-15T22:05:12.334 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-15T22:05:12.334 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-15T22:05:12.334 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-15T22:05:12.335 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-15T22:05:12.335 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-15T22:05:12.335 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-15T22:05:12.335 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-15T22:05:12.335 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-15T22:05:12.335 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-15T22:05:12.335 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-15T22:05:12.335 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-15T22:05:12.335 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-15T22:05:12.335 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-15T22:05:12.335 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-15T22:05:12.335 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-15T22:05:12.335 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-15T22:05:12.335 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-15T22:05:12.336 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-15T22:05:12.336 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-15T22:05:12.336 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-15T22:05:12.336 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-15T22:05:12.336 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-15T22:05:12.336 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-15T22:05:12.336 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-15T22:05:12.336 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-15T22:05:12.336 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-15T22:05:12.336 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-15T22:05:12.336 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-15T22:05:12.336 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-15T22:05:12.337 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-15T22:05:12.337 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-15T22:05:12.337 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-15T22:05:12.337 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-15T22:05:12.337 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-15T22:05:12.337 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-15T22:05:12.337 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-15T22:05:12.337 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-15T22:05:12.337 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-15T22:05:12.337 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-15T22:05:12.337 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-15T22:05:12.337 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-15T22:05:12.338 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-15T22:05:12.338 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-15T22:05:12.338 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-15T22:05:12.338 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-15T22:05:12.338 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-15T22:05:12.338 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-15T22:05:12.338 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-15T22:05:12.338 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-15T22:05:12.338 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-15T22:05:12.338 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-15T22:05:12.338 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-15T22:05:12.338 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-15T22:05:12.338 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-15T22:05:12.339 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-15T22:05:12.339 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-15T22:05:12.339 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-15T22:05:12.339 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-15T22:05:12.339 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-15T22:05:12.339 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-15T22:05:12.339 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-15T22:05:12.339 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-15T22:05:12.339 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-15T22:05:12.339 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-15T22:05:12.339 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-15T22:05:12.339 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-15T22:05:12.339 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-15T22:05:12.340 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-15T22:05:12.340 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-15T22:05:12.340 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-15T22:05:12.340 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-15T22:05:12.340 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-15T22:05:12.340 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-15T22:05:12.340 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-15T22:05:12.340 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-15T22:05:12.340 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-15T22:05:12.340 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-15T22:05:12.340 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-15T22:05:12.340 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-15T22:05:12.340 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-15T22:05:12.341 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-15T22:05:12.341 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-15T22:05:12.341 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-15T22:05:12.341 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-15T22:05:12.341 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-15T22:05:12.341 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-15T22:05:12.341 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-15T22:05:12.341 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-15T22:05:12.341 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-15T22:05:12.341 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-15T22:05:12.341 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-15T22:05:12.341 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-15T22:05:12.341 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-15T22:05:12.341 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-15T22:05:12.342 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-15T22:05:12.342 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-15T22:05:12.342 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-15T22:05:12.342 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-15T22:05:12.342 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-15T22:05:12.342 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-15T22:05:12.342 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-15T22:05:12.342 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-15T22:05:12.342 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-15T22:05:12.342 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-15T22:05:12.342 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-15T22:05:12.342 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-15T22:05:12.342 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-15T22:05:12.342 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-15T22:05:12.343 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-15T22:05:12.343 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-15T22:05:12.343 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-15T22:05:12.343 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-15T22:05:12.343 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-15T22:05:12.343 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-15T22:05:12.343 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-15T22:05:12.343 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-15T22:05:12.343 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-15T22:05:12.343 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-15T22:05:12.343 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-15T22:05:12.343 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-15T22:05:12.343 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-15T22:05:12.344 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-15T22:05:12.344 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-15T22:05:12.344 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-15T22:05:12.344 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-15T22:05:12.344 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-15T22:05:12.344 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-15T22:05:12.344 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-15T22:05:12.344 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-15T22:05:12.344 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-15T22:05:12.344 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-15T22:05:12.344 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-15T22:05:12.344 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-15T22:05:12.344 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-15T22:05:12.344 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-15T22:05:12.345 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-15T22:05:12.345 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-15T22:05:12.345 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-15T22:05:12.345 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-15T22:05:12.345 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-15T22:05:12.345 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-15T22:05:12.345 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-15T22:05:12.345 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-15T22:05:12.345 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-15T22:05:12.345 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-15T22:05:12.345 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-15T22:05:12.345 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-15T22:05:12.345 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-15T22:05:12.346 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-15T22:05:12.346 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-15T22:05:12.346 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-15T22:05:12.346 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-15T22:05:12.346 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-15T22:05:12.346 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-15T22:05:12.346 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-15T22:05:12.346 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-15T22:05:12.346 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-15T22:05:12.346 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-15T22:05:12.346 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-15T22:05:12.346 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-15T22:05:12.346 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-15T22:05:12.346 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-15T22:05:12.346 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-15T22:05:12.347 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-15T22:05:12.351 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:05:12.351 DEBUG:teuthology.orchestra.run.smithi001:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-15T22:05:12.375 INFO:teuthology.orchestra.run.smithi001.stdout:postinstall scriptlet (using /bin/sh): 2024-09-15T22:05:12.375 INFO:teuthology.orchestra.run.smithi001.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-15T22:05:12.375 INFO:teuthology.orchestra.run.smithi001.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-15T22:05:12.375 INFO:teuthology.orchestra.run.smithi001.stdout:fi 2024-09-15T22:05:12.375 INFO:teuthology.orchestra.run.smithi001.stdout:for file in vmlinuz System.map config; do 2024-09-15T22:05:12.375 INFO:teuthology.orchestra.run.smithi001.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-15T22:05:12.375 INFO:teuthology.orchestra.run.smithi001.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-15T22:05:12.375 INFO:teuthology.orchestra.run.smithi001.stdout: fi 2024-09-15T22:05:12.375 INFO:teuthology.orchestra.run.smithi001.stdout:done 2024-09-15T22:05:12.376 INFO:teuthology.orchestra.run.smithi001.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-15T22:05:12.376 INFO:teuthology.orchestra.run.smithi001.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-15T22:05:12.376 INFO:teuthology.orchestra.run.smithi001.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-15T22:05:12.376 INFO:teuthology.orchestra.run.smithi001.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-15T22:05:12.376 INFO:teuthology.orchestra.run.smithi001.stdout:fi 2024-09-15T22:05:12.376 INFO:teuthology.orchestra.run.smithi001.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-15T22:05:12.376 INFO:teuthology.orchestra.run.smithi001.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:05:12.376 INFO:teuthology.orchestra.run.smithi001.stdout:fi 2024-09-15T22:05:12.376 INFO:teuthology.orchestra.run.smithi001.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-15T22:05:12.376 INFO:teuthology.orchestra.run.smithi001.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-15T22:05:12.376 INFO:teuthology.orchestra.run.smithi001.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:05:12.376 INFO:teuthology.orchestra.run.smithi001.stdout:fi 2024-09-15T22:05:12.377 DEBUG:teuthology.orchestra.run.smithi001:> sudo rpm -qi grub2-tools 2024-09-15T22:05:12.460 INFO:teuthology.orchestra.run.smithi001.stdout:Name : grub2-tools 2024-09-15T22:05:12.461 INFO:teuthology.orchestra.run.smithi001.stdout:Epoch : 1 2024-09-15T22:05:12.461 INFO:teuthology.orchestra.run.smithi001.stdout:Version : 2.06 2024-09-15T22:05:12.461 INFO:teuthology.orchestra.run.smithi001.stdout:Release : 82.el9 2024-09-15T22:05:12.461 INFO:teuthology.orchestra.run.smithi001.stdout:Architecture: x86_64 2024-09-15T22:05:12.461 INFO:teuthology.orchestra.run.smithi001.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-15T22:05:12.461 INFO:teuthology.orchestra.run.smithi001.stdout:Group : Unspecified 2024-09-15T22:05:12.461 INFO:teuthology.orchestra.run.smithi001.stdout:Size : 8274670 2024-09-15T22:05:12.461 INFO:teuthology.orchestra.run.smithi001.stdout:License : GPLv3+ 2024-09-15T22:05:12.461 INFO:teuthology.orchestra.run.smithi001.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-15T22:05:12.461 INFO:teuthology.orchestra.run.smithi001.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-15T22:05:12.462 INFO:teuthology.orchestra.run.smithi001.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-15T22:05:12.462 INFO:teuthology.orchestra.run.smithi001.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-15T22:05:12.462 INFO:teuthology.orchestra.run.smithi001.stdout:Packager : builder@centos.org 2024-09-15T22:05:12.462 INFO:teuthology.orchestra.run.smithi001.stdout:Vendor : CentOS 2024-09-15T22:05:12.462 INFO:teuthology.orchestra.run.smithi001.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-15T22:05:12.462 INFO:teuthology.orchestra.run.smithi001.stdout:Summary : Support tools for GRUB. 2024-09-15T22:05:12.462 INFO:teuthology.orchestra.run.smithi001.stdout:Description : 2024-09-15T22:05:12.462 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:05:12.462 INFO:teuthology.orchestra.run.smithi001.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-15T22:05:12.462 INFO:teuthology.orchestra.run.smithi001.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-15T22:05:12.462 INFO:teuthology.orchestra.run.smithi001.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-15T22:05:12.462 INFO:teuthology.orchestra.run.smithi001.stdout:hardware devices. 2024-09-15T22:05:12.463 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:05:12.463 INFO:teuthology.orchestra.run.smithi001.stdout:This subpackage provides tools for support of all platforms. 2024-09-15T22:05:12.463 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-15T22:05:12.464 INFO:teuthology.task.kernel:Updating grub on smithi001 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:05:12.464 DEBUG:teuthology.orchestra.run.smithi001:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-15T22:05:13.214 INFO:teuthology.orchestra.run.smithi001.stderr:Generating grub configuration file ... 2024-09-15T22:05:14.618 INFO:teuthology.orchestra.run.smithi001.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-15T22:05:14.650 INFO:teuthology.orchestra.run.smithi001.stderr:done 2024-09-15T22:05:14.652 DEBUG:teuthology.orchestra.run.smithi001:> mktemp 2024-09-15T22:05:14.667 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/tmp.bY6zmwI8pL 2024-09-15T22:05:14.667 DEBUG:teuthology.orchestra.run.smithi001:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.bY6zmwI8pL 2024-09-15T22:05:14.737 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0666 /tmp/tmp.bY6zmwI8pL 2024-09-15T22:05:14.877 DEBUG:teuthology.orchestra.remote:smithi001:/tmp/tmp.bY6zmwI8pL is 6KB 2024-09-15T22:05:14.926 DEBUG:teuthology.orchestra.run.smithi001:> rm -fr /tmp/tmp.bY6zmwI8pL 2024-09-15T22:05:14.941 DEBUG:teuthology.orchestra.run.smithi001:> sudo /bin/ls /boot/loader/entries || true 2024-09-15T22:05:15.003 INFO:teuthology.orchestra.run.smithi001.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-15T22:05:15.003 INFO:teuthology.orchestra.run.smithi001.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-15T22:05:15.003 INFO:teuthology.orchestra.run.smithi001.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-15T22:05:15.003 INFO:teuthology.orchestra.run.smithi001.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-15T22:05:15.004 DEBUG:teuthology.orchestra.run.smithi001:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:05:15.178 DEBUG:teuthology.orchestra.run.smithi001:> sudo shutdown -r now 2024-09-15T22:05:45.182 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-15T22:05:45.183 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-15T22:05:45.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:06:45.187 DEBUG:teuthology.orchestra.remote:timed out 2024-09-15T22:06:54.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-15T22:06:54.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:06:54.583 DEBUG:teuthology.orchestra.run.smithi001:> true 2024-09-15T22:06:55.136 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-15T22:06:55.136 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-15T22:06:55.136 DEBUG:teuthology.orchestra.run.smithi001:> uname -r 2024-09-15T22:06:55.171 INFO:teuthology.orchestra.run.smithi001.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:06:55.172 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:06:55.172 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-15T22:06:55.172 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-15T22:06:56.175 DEBUG:teuthology.parallel:result is None 2024-09-15T22:06:56.175 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-15T22:06:56.182 INFO:teuthology.task.internal:Creating test directory... 2024-09-15T22:06:56.183 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T22:06:56.187 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T22:06:56.191 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T22:06:56.219 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-15T22:06:56.226 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-15T22:06:56.236 INFO:teuthology.task.internal:Creating archive directory... 2024-09-15T22:06:56.236 DEBUG:teuthology.orchestra.run.smithi001:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T22:06:56.264 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T22:06:56.266 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T22:06:56.309 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-15T22:06:56.316 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-15T22:06:56.316 DEBUG:teuthology.orchestra.run.smithi012:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T22:06:56.359 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:06:56.360 DEBUG:teuthology.orchestra.run.smithi098:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T22:06:56.377 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:06:56.377 DEBUG:teuthology.orchestra.run.smithi001:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T22:06:56.381 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T22:06:56.403 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T22:06:56.441 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:06:56.457 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:06:56.476 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:06:56.494 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:06:56.496 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:06:56.518 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:06:56.521 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-15T22:06:56.528 INFO:teuthology.task.internal:Configuring sudo... 2024-09-15T22:06:56.528 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T22:06:56.532 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T22:06:56.535 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T22:06:56.585 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-15T22:06:56.594 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-15T22:06:56.594 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T22:06:56.600 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T22:06:56.604 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T22:06:56.629 DEBUG:teuthology.orchestra.run.smithi001:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:06:56.729 DEBUG:teuthology.orchestra.run.smithi001:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:06:56.814 DEBUG:teuthology.orchestra.run.smithi001:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:06:56.870 DEBUG:teuthology.orchestra.run.smithi001:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:06:56.948 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T22:06:56.949 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T22:06:57.066 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:06:57.107 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:06:57.165 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:06:57.243 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:06:57.292 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-15T22:06:57.292 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T22:06:57.359 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:06:57.399 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:06:57.464 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:06:57.507 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:06:57.551 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-15T22:06:57.551 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T22:06:57.619 DEBUG:teuthology.orchestra.run.smithi001:> sudo service rsyslog restart 2024-09-15T22:06:57.623 DEBUG:teuthology.orchestra.run.smithi012:> sudo service rsyslog restart 2024-09-15T22:06:57.626 DEBUG:teuthology.orchestra.run.smithi098:> sudo service rsyslog restart 2024-09-15T22:06:57.666 INFO:teuthology.orchestra.run.smithi012.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T22:06:57.694 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T22:06:57.708 INFO:teuthology.orchestra.run.smithi001.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T22:06:58.030 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-15T22:06:58.038 INFO:teuthology.task.internal:Starting timer... 2024-09-15T22:06:58.038 INFO:teuthology.run_tasks:Running task pcp... 2024-09-15T22:06:58.053 INFO:teuthology.run_tasks:Running task selinux... 2024-09-15T22:06:58.061 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-15T22:06:58.062 DEBUG:teuthology.orchestra.run.smithi001:> sudo service auditd rotate 2024-09-15T22:06:58.155 INFO:teuthology.orchestra.run.smithi001.stdout:Rotating logs: 2024-09-15T22:06:58.158 DEBUG:teuthology.orchestra.run.smithi012:> sudo service auditd rotate 2024-09-15T22:06:58.200 INFO:teuthology.orchestra.run.smithi012.stdout:Rotating logs: 2024-09-15T22:06:58.201 DEBUG:teuthology.orchestra.run.smithi098:> sudo service auditd rotate 2024-09-15T22:06:58.262 INFO:teuthology.orchestra.run.smithi098.stdout:Rotating logs: 2024-09-15T22:06:58.265 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-15T22:06:58.265 DEBUG:teuthology.orchestra.run.smithi001:> /usr/sbin/getenforce 2024-09-15T22:06:58.303 INFO:teuthology.orchestra.run.smithi001.stdout:Permissive 2024-09-15T22:06:58.303 DEBUG:teuthology.orchestra.run.smithi012:> /usr/sbin/getenforce 2024-09-15T22:06:58.334 INFO:teuthology.orchestra.run.smithi012.stdout:Permissive 2024-09-15T22:06:58.334 DEBUG:teuthology.orchestra.run.smithi098:> /usr/sbin/getenforce 2024-09-15T22:06:58.357 INFO:teuthology.orchestra.run.smithi098.stdout:Permissive 2024-09-15T22:06:58.358 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi001.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi012.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi098.front.sepia.ceph.com': 'permissive'} 2024-09-15T22:06:58.358 DEBUG:teuthology.orchestra.run.smithi001:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T22:06:58.414 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:06:58.415 DEBUG:teuthology.orchestra.run.smithi012:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T22:06:58.443 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:06:58.444 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T22:06:58.472 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:06:58.472 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-15T22:06:58.472 DEBUG:teuthology.orchestra.run.smithi001:> sudo /usr/sbin/setenforce permissive 2024-09-15T22:06:58.552 DEBUG:teuthology.orchestra.run.smithi012:> sudo /usr/sbin/setenforce permissive 2024-09-15T22:06:58.597 DEBUG:teuthology.orchestra.run.smithi098:> sudo /usr/sbin/setenforce permissive 2024-09-15T22:06:58.626 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-15T22:06:58.637 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-15T22:06:58.640 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-15T22:06:58.746 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-15T22:06:58.757 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-15T22:06:58.758 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi001.front.sepia.ceph.com,smithi012.front.sepia.ceph.com,smithi098.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-15T22:11:46.226 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi001.front.sepia.ceph.com'), Remote(name='ubuntu@smithi012.front.sepia.ceph.com'), Remote(name='ubuntu@smithi098.front.sepia.ceph.com')] 2024-09-15T22:11:46.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-15T22:11:46.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:11:46.320 DEBUG:teuthology.orchestra.run.smithi001:> true 2024-09-15T22:11:46.427 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-15T22:11:46.427 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-15T22:11:46.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:11:46.509 DEBUG:teuthology.orchestra.run.smithi012:> true 2024-09-15T22:11:46.598 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-15T22:11:46.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-15T22:11:46.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:11:46.676 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-09-15T22:11:46.761 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-15T22:11:46.762 INFO:teuthology.run_tasks:Running task clock... 2024-09-15T22:11:46.773 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-15T22:11:46.773 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T22:11:46.773 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:11:46.777 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T22:11:46.777 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:11:46.780 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T22:11:46.780 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:11:46.810 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-15T22:11:46.825 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-15T22:11:46.831 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-15T22:11:46.834 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-15T22:11:46.845 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-15T22:11:46.850 INFO:teuthology.orchestra.run.smithi012.stderr:sudo: ntpd: command not found 2024-09-15T22:11:46.862 INFO:teuthology.orchestra.run.smithi012.stdout:506 Cannot talk to daemon 2024-09-15T22:11:46.864 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-15T22:11:46.870 INFO:teuthology.orchestra.run.smithi098.stderr:sudo: ntpd: command not found 2024-09-15T22:11:46.877 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-15T22:11:46.881 INFO:teuthology.orchestra.run.smithi098.stdout:506 Cannot talk to daemon 2024-09-15T22:11:46.891 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-15T22:11:46.895 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-15T22:11:46.909 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-15T22:11:46.915 INFO:teuthology.orchestra.run.smithi001.stderr:sudo: ntpd: command not found 2024-09-15T22:11:46.940 INFO:teuthology.orchestra.run.smithi001.stdout:506 Cannot talk to daemon 2024-09-15T22:11:46.949 INFO:teuthology.orchestra.run.smithi012.stderr:bash: line 1: ntpq: command not found 2024-09-15T22:11:46.952 INFO:teuthology.orchestra.run.smithi012.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T22:11:46.952 INFO:teuthology.orchestra.run.smithi012.stdout:=============================================================================== 2024-09-15T22:11:46.952 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:11:46.952 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:11:46.952 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:11:46.953 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:11:46.966 INFO:teuthology.orchestra.run.smithi098.stderr:bash: line 1: ntpq: command not found 2024-09-15T22:11:46.969 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-15T22:11:46.969 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T22:11:46.970 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2024-09-15T22:11:46.970 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:11:46.970 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:11:46.970 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:11:46.970 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:11:46.998 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-15T22:11:47.098 INFO:teuthology.orchestra.run.smithi001.stderr:bash: line 1: ntpq: command not found 2024-09-15T22:11:47.104 INFO:teuthology.orchestra.run.smithi001.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T22:11:47.105 INFO:teuthology.orchestra.run.smithi001.stdout:=============================================================================== 2024-09-15T22:11:47.105 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:11:47.105 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:11:47.105 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:11:47.105 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:11:47.106 INFO:teuthology.run_tasks:Running task install... 2024-09-15T22:11:47.115 DEBUG:teuthology.task.install:project ceph 2024-09-15T22:11:47.115 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}} 2024-09-15T22:11:47.115 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'} 2024-09-15T22:11:47.115 INFO:teuthology.task.install:Using flavor: default 2024-09-15T22:11:47.121 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-15T22:11:47.121 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-15T22:11:47.121 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-15T22:11:47.122 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:11:47.124 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-15T22:11:47.124 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:11:47.125 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-15T22:11:47.125 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:11:47.274 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-15T22:11:47.275 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-15T22:11:47.285 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-15T22:11:47.285 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-15T22:11:47.286 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-15T22:11:47.287 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-15T22:11:47.382 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-15T22:11:47.383 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T22:11:47.383 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-15T22:11:47.394 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-15T22:11:47.394 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-15T22:11:47.394 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-15T22:11:47.406 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-15T22:11:47.406 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-15T22:11:47.406 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-15T22:11:47.420 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-15T22:11:47.421 DEBUG:teuthology.orchestra.run.smithi012:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-15T22:11:47.431 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-15T22:11:47.432 DEBUG:teuthology.orchestra.run.smithi098:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-15T22:11:47.439 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-15T22:11:47.439 DEBUG:teuthology.orchestra.run.smithi001:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-15T22:11:47.486 DEBUG:teuthology.orchestra.run.smithi012:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-15T22:11:47.496 DEBUG:teuthology.orchestra.run.smithi098:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-15T22:11:47.537 DEBUG:teuthology.orchestra.run.smithi001:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-15T22:11:47.561 DEBUG:teuthology.orchestra.run.smithi012:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-15T22:11:47.571 DEBUG:teuthology.orchestra.run.smithi098:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-15T22:11:47.615 DEBUG:teuthology.orchestra.run.smithi001:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-15T22:11:47.625 INFO:teuthology.orchestra.run.smithi012.stdout:check_obsoletes = 1 2024-09-15T22:11:47.626 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum clean all 2024-09-15T22:11:47.635 INFO:teuthology.orchestra.run.smithi098.stdout:check_obsoletes = 1 2024-09-15T22:11:47.637 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum clean all 2024-09-15T22:11:47.670 INFO:teuthology.orchestra.run.smithi001.stdout:check_obsoletes = 1 2024-09-15T22:11:47.673 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum clean all 2024-09-15T22:11:47.857 INFO:teuthology.orchestra.run.smithi012.stdout:45 files removed 2024-09-15T22:11:47.863 INFO:teuthology.orchestra.run.smithi098.stdout:45 files removed 2024-09-15T22:11:47.884 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-15T22:11:47.889 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-15T22:11:47.966 INFO:teuthology.orchestra.run.smithi001.stdout:45 files removed 2024-09-15T22:11:47.999 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-15T22:11:48.432 INFO:teuthology.orchestra.run.smithi012.stdout:ceph packages for x86_64 316 kB/s | 83 kB 00:00 2024-09-15T22:11:48.436 INFO:teuthology.orchestra.run.smithi098.stdout:ceph packages for x86_64 310 kB/s | 83 kB 00:00 2024-09-15T22:11:48.716 INFO:teuthology.orchestra.run.smithi012.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-15T22:11:48.729 INFO:teuthology.orchestra.run.smithi098.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-15T22:11:48.737 INFO:teuthology.orchestra.run.smithi001.stdout:ceph packages for x86_64 255 kB/s | 83 kB 00:00 2024-09-15T22:11:48.991 INFO:teuthology.orchestra.run.smithi012.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-15T22:11:48.996 INFO:teuthology.orchestra.run.smithi098.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-15T22:11:49.062 INFO:teuthology.orchestra.run.smithi001.stdout:ceph noarch packages 42 kB/s | 12 kB 00:00 2024-09-15T22:11:49.380 INFO:teuthology.orchestra.run.smithi001.stdout:ceph source packages 6.8 kB/s | 1.9 kB 00:00 2024-09-15T22:11:49.449 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.2 MB 00:00 2024-09-15T22:11:49.996 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - BaseOS 8.5 MB/s | 8.2 MB 00:00 2024-09-15T22:11:51.105 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.2 MB 00:01 2024-09-15T22:11:51.747 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - AppStream 32 MB/s | 20 MB 00:00 2024-09-15T22:11:51.942 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - AppStream 15 MB/s | 20 MB 00:01 2024-09-15T22:11:55.289 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - AppStream 6.8 MB/s | 20 MB 00:02 2024-09-15T22:11:56.809 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - CRB 7.4 MB/s | 6.5 MB 00:00 2024-09-15T22:11:57.265 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-15T22:11:58.534 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 19 kB 00:00 2024-09-15T22:11:58.757 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 19 kB 00:00 2024-09-15T22:11:59.972 INFO:teuthology.orchestra.run.smithi012.stdout:Extra Packages for Enterprise Linux 17 MB/s | 23 MB 00:01 2024-09-15T22:12:00.045 INFO:teuthology.orchestra.run.smithi098.stdout:Extra Packages for Enterprise Linux 19 MB/s | 23 MB 00:01 2024-09-15T22:12:00.965 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 6.5 MB 00:01 2024-09-15T22:12:02.599 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - Extras packages 65 kB/s | 19 kB 00:00 2024-09-15T22:12:04.037 INFO:teuthology.orchestra.run.smithi001.stdout:Extra Packages for Enterprise Linux 17 MB/s | 23 MB 00:01 2024-09-15T22:12:05.484 INFO:teuthology.orchestra.run.smithi098.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-15T22:12:05.669 INFO:teuthology.orchestra.run.smithi012.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-15T22:12:07.755 INFO:teuthology.orchestra.run.smithi098.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T22:12:07.756 INFO:teuthology.orchestra.run.smithi098.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T22:12:07.770 INFO:teuthology.orchestra.run.smithi098.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-15T22:12:07.770 INFO:teuthology.orchestra.run.smithi098.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-15T22:12:07.771 INFO:teuthology.orchestra.run.smithi098.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-15T22:12:07.773 INFO:teuthology.orchestra.run.smithi098.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-15T22:12:07.775 INFO:teuthology.orchestra.run.smithi098.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-15T22:12:07.777 INFO:teuthology.orchestra.run.smithi098.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-15T22:12:07.778 INFO:teuthology.orchestra.run.smithi098.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-15T22:12:07.843 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-15T22:12:07.858 INFO:teuthology.orchestra.run.smithi098.stdout:====================================================================================== 2024-09-15T22:12:07.858 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-15T22:12:07.859 INFO:teuthology.orchestra.run.smithi098.stdout:====================================================================================== 2024-09-15T22:12:07.859 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-15T22:12:07.859 INFO:teuthology.orchestra.run.smithi098.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-15T22:12:07.859 INFO:teuthology.orchestra.run.smithi098.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-15T22:12:07.859 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-15T22:12:07.859 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-15T22:12:07.859 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-15T22:12:07.859 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-15T22:12:07.859 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-15T22:12:07.859 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-15T22:12:07.859 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-15T22:12:07.859 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-15T22:12:07.859 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-15T22:12:07.860 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-15T22:12:07.860 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-15T22:12:07.860 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-15T22:12:07.860 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-15T22:12:07.860 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-15T22:12:07.860 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-15T22:12:07.860 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-15T22:12:07.860 INFO:teuthology.orchestra.run.smithi098.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-15T22:12:07.860 INFO:teuthology.orchestra.run.smithi098.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-15T22:12:07.860 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-15T22:12:07.860 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-15T22:12:07.861 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-15T22:12:07.861 INFO:teuthology.orchestra.run.smithi098.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-15T22:12:07.861 INFO:teuthology.orchestra.run.smithi098.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-15T22:12:07.861 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-15T22:12:07.861 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-15T22:12:07.861 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-15T22:12:07.861 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-15T22:12:07.861 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-15T22:12:07.861 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-15T22:12:07.861 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-15T22:12:07.862 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-15T22:12:07.862 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-15T22:12:07.862 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-15T22:12:07.862 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-15T22:12:07.862 INFO:teuthology.orchestra.run.smithi098.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-15T22:12:07.862 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrading: 2024-09-15T22:12:07.862 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-15T22:12:07.862 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-15T22:12:07.862 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-15T22:12:07.862 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-15T22:12:07.862 INFO:teuthology.orchestra.run.smithi098.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-15T22:12:07.862 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-15T22:12:07.862 INFO:teuthology.orchestra.run.smithi098.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-15T22:12:07.863 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-15T22:12:07.863 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-15T22:12:07.863 INFO:teuthology.orchestra.run.smithi098.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-15T22:12:07.863 INFO:teuthology.orchestra.run.smithi098.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-15T22:12:07.863 INFO:teuthology.orchestra.run.smithi098.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-15T22:12:07.863 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-15T22:12:07.863 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-15T22:12:07.863 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-15T22:12:07.863 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-15T22:12:07.863 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-15T22:12:07.863 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-15T22:12:07.863 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-15T22:12:07.864 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-15T22:12:07.864 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-15T22:12:07.864 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-15T22:12:07.864 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-15T22:12:07.864 INFO:teuthology.orchestra.run.smithi098.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-15T22:12:07.864 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-15T22:12:07.864 INFO:teuthology.orchestra.run.smithi098.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-15T22:12:07.864 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-15T22:12:07.864 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-15T22:12:07.864 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-15T22:12:07.864 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-15T22:12:07.864 INFO:teuthology.orchestra.run.smithi098.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-15T22:12:07.864 INFO:teuthology.orchestra.run.smithi098.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-15T22:12:07.865 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-15T22:12:07.865 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-15T22:12:07.865 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-15T22:12:07.865 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-15T22:12:07.865 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-15T22:12:07.865 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-15T22:12:07.865 INFO:teuthology.orchestra.run.smithi098.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-15T22:12:07.865 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-15T22:12:07.865 INFO:teuthology.orchestra.run.smithi098.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-15T22:12:07.865 INFO:teuthology.orchestra.run.smithi098.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-15T22:12:07.865 INFO:teuthology.orchestra.run.smithi098.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-15T22:12:07.865 INFO:teuthology.orchestra.run.smithi098.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-15T22:12:07.865 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-15T22:12:07.866 INFO:teuthology.orchestra.run.smithi098.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-15T22:12:07.866 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-15T22:12:07.866 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-15T22:12:07.866 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-15T22:12:07.866 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-15T22:12:07.866 INFO:teuthology.orchestra.run.smithi098.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-15T22:12:07.866 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-15T22:12:07.866 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-15T22:12:07.866 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-15T22:12:07.866 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-15T22:12:07.866 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-15T22:12:07.866 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-15T22:12:07.866 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-15T22:12:07.867 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-15T22:12:07.867 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-15T22:12:07.867 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-15T22:12:07.867 INFO:teuthology.orchestra.run.smithi098.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-15T22:12:07.867 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-15T22:12:07.867 INFO:teuthology.orchestra.run.smithi098.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-15T22:12:07.867 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-15T22:12:07.867 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-15T22:12:07.867 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-15T22:12:07.867 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-15T22:12:07.868 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-15T22:12:07.868 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-15T22:12:07.868 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-15T22:12:07.868 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-15T22:12:07.869 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-15T22:12:07.869 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-15T22:12:07.869 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-15T22:12:07.869 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-15T22:12:07.869 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-15T22:12:07.869 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-15T22:12:07.870 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-15T22:12:07.870 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-15T22:12:07.870 INFO:teuthology.orchestra.run.smithi098.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-15T22:12:07.870 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-15T22:12:07.870 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-15T22:12:07.870 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-15T22:12:07.870 INFO:teuthology.orchestra.run.smithi098.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-15T22:12:07.870 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-15T22:12:07.870 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-15T22:12:07.870 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-15T22:12:07.870 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-15T22:12:07.870 INFO:teuthology.orchestra.run.smithi098.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-15T22:12:07.870 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-15T22:12:07.870 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-15T22:12:07.871 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-15T22:12:07.871 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-15T22:12:07.871 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-15T22:12:07.871 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-15T22:12:07.871 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-15T22:12:07.871 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-15T22:12:07.871 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-15T22:12:07.871 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-15T22:12:07.871 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-15T22:12:07.871 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-15T22:12:07.871 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-15T22:12:07.871 INFO:teuthology.orchestra.run.smithi098.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-15T22:12:07.871 INFO:teuthology.orchestra.run.smithi098.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-15T22:12:07.871 INFO:teuthology.orchestra.run.smithi098.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-15T22:12:07.872 INFO:teuthology.orchestra.run.smithi098.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-15T22:12:07.872 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-15T22:12:07.872 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-15T22:12:07.872 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-15T22:12:07.872 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-15T22:12:07.872 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-15T22:12:07.872 INFO:teuthology.orchestra.run.smithi098.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-15T22:12:07.872 INFO:teuthology.orchestra.run.smithi098.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-15T22:12:07.872 INFO:teuthology.orchestra.run.smithi098.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-15T22:12:07.872 INFO:teuthology.orchestra.run.smithi098.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-15T22:12:07.872 INFO:teuthology.orchestra.run.smithi098.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-15T22:12:07.872 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-15T22:12:07.872 INFO:teuthology.orchestra.run.smithi098.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-15T22:12:07.873 INFO:teuthology.orchestra.run.smithi098.stdout:Installing weak dependencies: 2024-09-15T22:12:07.873 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-15T22:12:07.873 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-15T22:12:07.873 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-15T22:12:07.873 INFO:teuthology.orchestra.run.smithi098.stdout:====================================================================================== 2024-09-15T22:12:07.873 INFO:teuthology.orchestra.run.smithi098.stdout:Install 148 Packages 2024-09-15T22:12:07.873 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrade 8 Packages 2024-09-15T22:12:07.873 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-15T22:12:07.874 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 226 M 2024-09-15T22:12:07.874 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-15T22:12:08.039 INFO:teuthology.orchestra.run.smithi012.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T22:12:08.040 INFO:teuthology.orchestra.run.smithi012.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T22:12:08.052 INFO:teuthology.orchestra.run.smithi012.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-15T22:12:08.053 INFO:teuthology.orchestra.run.smithi012.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-15T22:12:08.054 INFO:teuthology.orchestra.run.smithi012.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-15T22:12:08.055 INFO:teuthology.orchestra.run.smithi012.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-15T22:12:08.057 INFO:teuthology.orchestra.run.smithi012.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-15T22:12:08.059 INFO:teuthology.orchestra.run.smithi012.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-15T22:12:08.060 INFO:teuthology.orchestra.run.smithi012.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-15T22:12:08.127 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-15T22:12:08.142 INFO:teuthology.orchestra.run.smithi012.stdout:====================================================================================== 2024-09-15T22:12:08.142 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repository Size 2024-09-15T22:12:08.142 INFO:teuthology.orchestra.run.smithi012.stdout:====================================================================================== 2024-09-15T22:12:08.143 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2024-09-15T22:12:08.143 INFO:teuthology.orchestra.run.smithi012.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-15T22:12:08.143 INFO:teuthology.orchestra.run.smithi012.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-15T22:12:08.143 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-15T22:12:08.143 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-15T22:12:08.143 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-15T22:12:08.143 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-15T22:12:08.143 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-15T22:12:08.143 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-15T22:12:08.143 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-15T22:12:08.143 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-15T22:12:08.143 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-15T22:12:08.144 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-15T22:12:08.144 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-15T22:12:08.144 INFO:teuthology.orchestra.run.smithi012.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-15T22:12:08.144 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-15T22:12:08.144 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-15T22:12:08.144 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-15T22:12:08.144 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-15T22:12:08.144 INFO:teuthology.orchestra.run.smithi012.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-15T22:12:08.144 INFO:teuthology.orchestra.run.smithi012.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-15T22:12:08.144 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-15T22:12:08.144 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-15T22:12:08.144 INFO:teuthology.orchestra.run.smithi012.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-15T22:12:08.144 INFO:teuthology.orchestra.run.smithi012.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-15T22:12:08.145 INFO:teuthology.orchestra.run.smithi012.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-15T22:12:08.145 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-15T22:12:08.145 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-15T22:12:08.145 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-15T22:12:08.145 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-15T22:12:08.145 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-15T22:12:08.145 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-15T22:12:08.145 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-15T22:12:08.145 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-15T22:12:08.146 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-15T22:12:08.146 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-15T22:12:08.146 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-15T22:12:08.146 INFO:teuthology.orchestra.run.smithi012.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-15T22:12:08.146 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrading: 2024-09-15T22:12:08.146 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-15T22:12:08.146 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-15T22:12:08.146 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-15T22:12:08.146 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-15T22:12:08.146 INFO:teuthology.orchestra.run.smithi012.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-15T22:12:08.146 INFO:teuthology.orchestra.run.smithi012.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-15T22:12:08.146 INFO:teuthology.orchestra.run.smithi012.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-15T22:12:08.147 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-15T22:12:08.147 INFO:teuthology.orchestra.run.smithi012.stdout:Installing dependencies: 2024-09-15T22:12:08.147 INFO:teuthology.orchestra.run.smithi012.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-15T22:12:08.147 INFO:teuthology.orchestra.run.smithi012.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-15T22:12:08.147 INFO:teuthology.orchestra.run.smithi012.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-15T22:12:08.147 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-15T22:12:08.147 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-15T22:12:08.147 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-15T22:12:08.147 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-15T22:12:08.147 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-15T22:12:08.147 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-15T22:12:08.147 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-15T22:12:08.148 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-15T22:12:08.148 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-15T22:12:08.148 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-15T22:12:08.148 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-15T22:12:08.148 INFO:teuthology.orchestra.run.smithi012.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-15T22:12:08.148 INFO:teuthology.orchestra.run.smithi012.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-15T22:12:08.148 INFO:teuthology.orchestra.run.smithi012.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-15T22:12:08.148 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-15T22:12:08.148 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-15T22:12:08.148 INFO:teuthology.orchestra.run.smithi012.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-15T22:12:08.148 INFO:teuthology.orchestra.run.smithi012.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-15T22:12:08.148 INFO:teuthology.orchestra.run.smithi012.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-15T22:12:08.148 INFO:teuthology.orchestra.run.smithi012.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-15T22:12:08.149 INFO:teuthology.orchestra.run.smithi012.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-15T22:12:08.149 INFO:teuthology.orchestra.run.smithi012.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-15T22:12:08.149 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-15T22:12:08.149 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-15T22:12:08.149 INFO:teuthology.orchestra.run.smithi012.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-15T22:12:08.149 INFO:teuthology.orchestra.run.smithi012.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-15T22:12:08.149 INFO:teuthology.orchestra.run.smithi012.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-15T22:12:08.149 INFO:teuthology.orchestra.run.smithi012.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-15T22:12:08.149 INFO:teuthology.orchestra.run.smithi012.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-15T22:12:08.149 INFO:teuthology.orchestra.run.smithi012.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-15T22:12:08.149 INFO:teuthology.orchestra.run.smithi012.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-15T22:12:08.149 INFO:teuthology.orchestra.run.smithi012.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-15T22:12:08.149 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-15T22:12:08.150 INFO:teuthology.orchestra.run.smithi012.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-15T22:12:08.150 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-15T22:12:08.150 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-15T22:12:08.150 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-15T22:12:08.150 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-15T22:12:08.150 INFO:teuthology.orchestra.run.smithi012.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-15T22:12:08.150 INFO:teuthology.orchestra.run.smithi012.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-15T22:12:08.150 INFO:teuthology.orchestra.run.smithi012.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-15T22:12:08.150 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-15T22:12:08.150 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-15T22:12:08.150 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-15T22:12:08.150 INFO:teuthology.orchestra.run.smithi012.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-15T22:12:08.150 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-15T22:12:08.151 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-15T22:12:08.151 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-15T22:12:08.151 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-15T22:12:08.151 INFO:teuthology.orchestra.run.smithi012.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-15T22:12:08.151 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-15T22:12:08.151 INFO:teuthology.orchestra.run.smithi012.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-15T22:12:08.151 INFO:teuthology.orchestra.run.smithi012.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-15T22:12:08.151 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-15T22:12:08.151 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-15T22:12:08.152 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-15T22:12:08.152 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-15T22:12:08.152 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-15T22:12:08.152 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-15T22:12:08.152 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-15T22:12:08.152 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-15T22:12:08.152 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-15T22:12:08.152 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-15T22:12:08.152 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-15T22:12:08.152 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-15T22:12:08.152 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-15T22:12:08.152 INFO:teuthology.orchestra.run.smithi012.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-15T22:12:08.152 INFO:teuthology.orchestra.run.smithi012.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-15T22:12:08.153 INFO:teuthology.orchestra.run.smithi012.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-15T22:12:08.153 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-15T22:12:08.153 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-15T22:12:08.153 INFO:teuthology.orchestra.run.smithi012.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-15T22:12:08.153 INFO:teuthology.orchestra.run.smithi012.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-15T22:12:08.153 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-15T22:12:08.153 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-15T22:12:08.153 INFO:teuthology.orchestra.run.smithi012.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-15T22:12:08.153 INFO:teuthology.orchestra.run.smithi012.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-15T22:12:08.153 INFO:teuthology.orchestra.run.smithi012.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-15T22:12:08.153 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-15T22:12:08.153 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-15T22:12:08.153 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-15T22:12:08.154 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-15T22:12:08.154 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-15T22:12:08.154 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-15T22:12:08.154 INFO:teuthology.orchestra.run.smithi012.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-15T22:12:08.154 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-15T22:12:08.154 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-15T22:12:08.154 INFO:teuthology.orchestra.run.smithi012.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-15T22:12:08.154 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-15T22:12:08.154 INFO:teuthology.orchestra.run.smithi012.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-15T22:12:08.154 INFO:teuthology.orchestra.run.smithi012.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-15T22:12:08.155 INFO:teuthology.orchestra.run.smithi012.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-15T22:12:08.155 INFO:teuthology.orchestra.run.smithi012.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-15T22:12:08.155 INFO:teuthology.orchestra.run.smithi012.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-15T22:12:08.155 INFO:teuthology.orchestra.run.smithi012.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-15T22:12:08.155 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-15T22:12:08.155 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-15T22:12:08.155 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-15T22:12:08.156 INFO:teuthology.orchestra.run.smithi012.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-15T22:12:08.156 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-15T22:12:08.156 INFO:teuthology.orchestra.run.smithi012.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-15T22:12:08.156 INFO:teuthology.orchestra.run.smithi012.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-15T22:12:08.156 INFO:teuthology.orchestra.run.smithi012.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-15T22:12:08.156 INFO:teuthology.orchestra.run.smithi012.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-15T22:12:08.156 INFO:teuthology.orchestra.run.smithi012.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-15T22:12:08.156 INFO:teuthology.orchestra.run.smithi012.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-15T22:12:08.156 INFO:teuthology.orchestra.run.smithi012.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-15T22:12:08.156 INFO:teuthology.orchestra.run.smithi012.stdout:Installing weak dependencies: 2024-09-15T22:12:08.156 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-15T22:12:08.156 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-15T22:12:08.156 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-09-15T22:12:08.156 INFO:teuthology.orchestra.run.smithi012.stdout:====================================================================================== 2024-09-15T22:12:08.157 INFO:teuthology.orchestra.run.smithi012.stdout:Install 148 Packages 2024-09-15T22:12:08.157 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrade 8 Packages 2024-09-15T22:12:08.157 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-15T22:12:08.157 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 226 M 2024-09-15T22:12:08.157 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2024-09-15T22:12:08.586 INFO:teuthology.orchestra.run.smithi098.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 28 kB/s | 6.5 kB 00:00 2024-09-15T22:12:08.961 INFO:teuthology.orchestra.run.smithi098.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 2.3 MB/s | 896 kB 00:00 2024-09-15T22:12:09.045 INFO:teuthology.orchestra.run.smithi098.stdout:(3/156): ceph-immutable-object-cache-19.1.1-326 1.7 MB/s | 145 kB 00:00 2024-09-15T22:12:09.078 INFO:teuthology.orchestra.run.smithi012.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 24 kB/s | 6.5 kB 00:00 2024-09-15T22:12:09.270 INFO:teuthology.orchestra.run.smithi098.stdout:(4/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 11 MB/s | 2.4 MB 00:00 2024-09-15T22:12:09.420 INFO:teuthology.orchestra.run.smithi098.stdout:(5/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 10 MB/s | 1.5 MB 00:00 2024-09-15T22:12:09.571 INFO:teuthology.orchestra.run.smithi012.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 1.8 MB/s | 896 kB 00:00 2024-09-15T22:12:09.646 INFO:teuthology.orchestra.run.smithi098.stdout:(6/156): ceph-common-19.1.1-326.g8921c8ef.el9.x 16 MB/s | 21 MB 00:01 2024-09-15T22:12:09.646 INFO:teuthology.orchestra.run.smithi012.stdout:(3/156): ceph-immutable-object-cache-19.1.1-326 1.9 MB/s | 145 kB 00:00 2024-09-15T22:12:09.821 INFO:teuthology.orchestra.run.smithi098.stdout:(7/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 12 MB/s | 4.7 MB 00:00 2024-09-15T22:12:10.088 INFO:teuthology.orchestra.run.smithi098.stdout:(8/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 3.1 MB/s | 5.4 MB 00:01 2024-09-15T22:12:10.147 INFO:teuthology.orchestra.run.smithi098.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 432 kB/s | 25 kB 00:00 2024-09-15T22:12:10.212 INFO:teuthology.orchestra.run.smithi012.stdout:(4/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 4.2 MB/s | 2.4 MB 00:00 2024-09-15T22:12:10.488 INFO:teuthology.orchestra.run.smithi012.stdout:(5/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 5.5 MB/s | 1.5 MB 00:00 2024-09-15T22:12:10.497 INFO:teuthology.orchestra.run.smithi098.stdout:(10/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86 20 MB/s | 17 MB 00:00 2024-09-15T22:12:10.622 INFO:teuthology.orchestra.run.smithi098.stdout:(11/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9 13 MB/s | 11 MB 00:00 2024-09-15T22:12:10.647 INFO:teuthology.orchestra.run.smithi098.stdout:(12/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 1.5 MB/s | 228 kB 00:00 2024-09-15T22:12:10.697 INFO:teuthology.orchestra.run.smithi098.stdout:(13/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 360 kB/s | 27 kB 00:00 2024-09-15T22:12:10.723 INFO:teuthology.orchestra.run.smithi098.stdout:(14/156): libcephfs-devel-19.1.1-326.g8921c8ef. 422 kB/s | 32 kB 00:00 2024-09-15T22:12:10.742 INFO:teuthology.orchestra.run.smithi001.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-15T22:12:10.798 INFO:teuthology.orchestra.run.smithi098.stdout:(15/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 7.3 MB/s | 751 kB 00:00 2024-09-15T22:12:10.823 INFO:teuthology.orchestra.run.smithi098.stdout:(16/156): libcephsqlite-19.1.1-326.g8921c8ef.el 1.6 MB/s | 163 kB 00:00 2024-09-15T22:12:10.874 INFO:teuthology.orchestra.run.smithi098.stdout:(17/156): librados-devel-19.1.1-326.g8921c8ef.e 1.6 MB/s | 127 kB 00:00 2024-09-15T22:12:10.899 INFO:teuthology.orchestra.run.smithi098.stdout:(18/156): libradosstriper1-19.1.1-326.g8921c8ef 6.6 MB/s | 506 kB 00:00 2024-09-15T22:12:10.983 INFO:teuthology.orchestra.run.smithi098.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 541 kB/s | 45 kB 00:00 2024-09-15T22:12:11.063 INFO:teuthology.orchestra.run.smithi012.stdout:(6/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 8.2 MB/s | 4.7 MB 00:00 2024-09-15T22:12:11.066 INFO:teuthology.orchestra.run.smithi098.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 1.6 MB/s | 136 kB 00:00 2024-09-15T22:12:11.130 INFO:teuthology.orchestra.run.smithi012.stdout:(7/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 2.3 MB/s | 5.4 MB 00:02 2024-09-15T22:12:11.150 INFO:teuthology.orchestra.run.smithi098.stdout:(21/156): python3-cephfs-19.1.1-326.g8921c8ef.e 1.9 MB/s | 161 kB 00:00 2024-09-15T22:12:11.267 INFO:teuthology.orchestra.run.smithi098.stdout:(22/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 14 MB/s | 5.3 MB 00:00 2024-09-15T22:12:11.292 INFO:teuthology.orchestra.run.smithi098.stdout:(23/156): python3-rados-19.1.1-326.g8921c8ef.el 2.2 MB/s | 320 kB 00:00 2024-09-15T22:12:11.376 INFO:teuthology.orchestra.run.smithi098.stdout:(24/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 2.7 MB/s | 300 kB 00:00 2024-09-15T22:12:11.401 INFO:teuthology.orchestra.run.smithi098.stdout:(25/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 915 kB/s | 99 kB 00:00 2024-09-15T22:12:11.460 INFO:teuthology.orchestra.run.smithi098.stdout:(26/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.0 MB/s | 85 kB 00:00 2024-09-15T22:12:11.569 INFO:teuthology.orchestra.run.smithi098.stdout:(27/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 1.5 MB/s | 170 kB 00:00 2024-09-15T22:12:11.694 INFO:teuthology.orchestra.run.smithi098.stdout:(28/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 11 MB/s | 3.1 MB 00:00 2024-09-15T22:12:11.711 INFO:teuthology.orchestra.run.smithi098.stdout:(29/156): ceph-grafana-dashboards-19.1.1-326.g8 224 kB/s | 32 kB 00:00 2024-09-15T22:12:11.778 INFO:teuthology.orchestra.run.smithi098.stdout:(30/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 1.7 MB/s | 146 kB 00:00 2024-09-15T22:12:12.078 INFO:teuthology.orchestra.run.smithi098.stdout:(31/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 9.7 MB/s | 3.6 MB 00:00 2024-09-15T22:12:12.170 INFO:teuthology.orchestra.run.smithi098.stdout:(32/156): ceph-mgr-modules-core-19.1.1-326.g892 2.7 MB/s | 249 kB 00:00 2024-09-15T22:12:12.246 INFO:teuthology.orchestra.run.smithi098.stdout:(33/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 659 kB/s | 49 kB 00:00 2024-09-15T22:12:12.304 INFO:teuthology.orchestra.run.smithi098.stdout:(34/156): ceph-prometheus-alerts-19.1.1-326.g89 282 kB/s | 16 kB 00:00 2024-09-15T22:12:12.380 INFO:teuthology.orchestra.run.smithi098.stdout:(35/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 3.7 MB/s | 285 kB 00:00 2024-09-15T22:12:12.380 INFO:teuthology.orchestra.run.smithi012.stdout:(8/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86_ 13 MB/s | 17 MB 00:01 2024-09-15T22:12:12.455 INFO:teuthology.orchestra.run.smithi012.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 336 kB/s | 25 kB 00:00 2024-09-15T22:12:12.463 INFO:teuthology.orchestra.run.smithi098.stdout:(36/156): ceph-mgr-diskprediction-local-19.1.1- 11 MB/s | 7.4 MB 00:00 2024-09-15T22:12:12.505 INFO:teuthology.orchestra.run.smithi098.stdout:(37/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 6.0 MB/s | 765 kB 00:00 2024-09-15T22:12:12.530 INFO:teuthology.orchestra.run.smithi098.stdout:(38/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 273 kB/s | 18 kB 00:00 2024-09-15T22:12:12.689 INFO:teuthology.orchestra.run.smithi012.stdout:(10/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9 6.8 MB/s | 11 MB 00:01 2024-09-15T22:12:12.881 INFO:teuthology.orchestra.run.smithi098.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 213 kB/s | 80 kB 00:00 2024-09-15T22:12:12.931 INFO:teuthology.orchestra.run.smithi012.stdout:(11/156): ceph-common-19.1.1-326.g8921c8ef.el9. 5.1 MB/s | 21 MB 00:04 2024-09-15T22:12:12.957 INFO:teuthology.orchestra.run.smithi012.stdout:(12/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 856 kB/s | 228 kB 00:00 2024-09-15T22:12:12.981 INFO:teuthology.orchestra.run.smithi012.stdout:(13/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 542 kB/s | 27 kB 00:00 2024-09-15T22:12:13.006 INFO:teuthology.orchestra.run.smithi012.stdout:(14/156): libcephfs-devel-19.1.1-326.g8921c8ef. 631 kB/s | 32 kB 00:00 2024-09-15T22:12:13.065 INFO:teuthology.orchestra.run.smithi012.stdout:(15/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 8.8 MB/s | 751 kB 00:00 2024-09-15T22:12:13.090 INFO:teuthology.orchestra.run.smithi012.stdout:(16/156): libcephsqlite-19.1.1-326.g8921c8ef.el 1.9 MB/s | 163 kB 00:00 2024-09-15T22:12:13.116 INFO:teuthology.orchestra.run.smithi012.stdout:(17/156): librados-devel-19.1.1-326.g8921c8ef.e 2.5 MB/s | 127 kB 00:00 2024-09-15T22:12:13.173 INFO:teuthology.orchestra.run.smithi098.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 655 kB/s | 191 kB 00:00 2024-09-15T22:12:13.199 INFO:teuthology.orchestra.run.smithi012.stdout:(18/156): libradosstriper1-19.1.1-326.g8921c8ef 4.5 MB/s | 506 kB 00:00 2024-09-15T22:12:13.250 INFO:teuthology.orchestra.run.smithi012.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 905 kB/s | 45 kB 00:00 2024-09-15T22:12:13.300 INFO:teuthology.orchestra.run.smithi012.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 2.7 MB/s | 136 kB 00:00 2024-09-15T22:12:13.341 INFO:teuthology.orchestra.run.smithi001.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T22:12:13.342 INFO:teuthology.orchestra.run.smithi001.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T22:12:13.357 INFO:teuthology.orchestra.run.smithi001.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-15T22:12:13.358 INFO:teuthology.orchestra.run.smithi001.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-15T22:12:13.358 INFO:teuthology.orchestra.run.smithi012.stdout:(21/156): python3-cephfs-19.1.1-326.g8921c8ef.e 2.7 MB/s | 161 kB 00:00 2024-09-15T22:12:13.359 INFO:teuthology.orchestra.run.smithi001.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-15T22:12:13.360 INFO:teuthology.orchestra.run.smithi001.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-15T22:12:13.362 INFO:teuthology.orchestra.run.smithi001.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-15T22:12:13.369 INFO:teuthology.orchestra.run.smithi001.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-15T22:12:13.369 INFO:teuthology.orchestra.run.smithi001.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-15T22:12:13.426 INFO:teuthology.orchestra.run.smithi012.stdout:(22/156): python3-rados-19.1.1-326.g8921c8ef.el 4.7 MB/s | 320 kB 00:00 2024-09-15T22:12:13.438 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-09-15T22:12:13.458 INFO:teuthology.orchestra.run.smithi001.stdout:====================================================================================== 2024-09-15T22:12:13.459 INFO:teuthology.orchestra.run.smithi001.stdout: Package Arch Version Repository Size 2024-09-15T22:12:13.459 INFO:teuthology.orchestra.run.smithi001.stdout:====================================================================================== 2024-09-15T22:12:13.459 INFO:teuthology.orchestra.run.smithi001.stdout:Installing: 2024-09-15T22:12:13.459 INFO:teuthology.orchestra.run.smithi001.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-15T22:12:13.459 INFO:teuthology.orchestra.run.smithi001.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-15T22:12:13.459 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-15T22:12:13.459 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-15T22:12:13.459 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-15T22:12:13.459 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-15T22:12:13.459 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-15T22:12:13.459 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-15T22:12:13.460 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-15T22:12:13.460 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-15T22:12:13.460 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-15T22:12:13.460 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-15T22:12:13.460 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-15T22:12:13.460 INFO:teuthology.orchestra.run.smithi001.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-15T22:12:13.460 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-15T22:12:13.460 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-15T22:12:13.460 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-15T22:12:13.460 INFO:teuthology.orchestra.run.smithi001.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-15T22:12:13.460 INFO:teuthology.orchestra.run.smithi001.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-15T22:12:13.461 INFO:teuthology.orchestra.run.smithi001.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-15T22:12:13.461 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-15T22:12:13.461 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-15T22:12:13.461 INFO:teuthology.orchestra.run.smithi001.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-15T22:12:13.461 INFO:teuthology.orchestra.run.smithi001.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-15T22:12:13.461 INFO:teuthology.orchestra.run.smithi001.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-15T22:12:13.461 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-15T22:12:13.461 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-15T22:12:13.461 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-15T22:12:13.462 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-15T22:12:13.462 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-15T22:12:13.462 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-15T22:12:13.462 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-15T22:12:13.462 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-15T22:12:13.462 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-15T22:12:13.462 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-15T22:12:13.462 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-15T22:12:13.462 INFO:teuthology.orchestra.run.smithi001.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-15T22:12:13.462 INFO:teuthology.orchestra.run.smithi001.stdout:Upgrading: 2024-09-15T22:12:13.462 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-15T22:12:13.462 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-15T22:12:13.463 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-15T22:12:13.463 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-15T22:12:13.463 INFO:teuthology.orchestra.run.smithi001.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-15T22:12:13.463 INFO:teuthology.orchestra.run.smithi001.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-15T22:12:13.463 INFO:teuthology.orchestra.run.smithi001.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-15T22:12:13.463 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-15T22:12:13.463 INFO:teuthology.orchestra.run.smithi001.stdout:Installing dependencies: 2024-09-15T22:12:13.463 INFO:teuthology.orchestra.run.smithi001.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-15T22:12:13.463 INFO:teuthology.orchestra.run.smithi001.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-15T22:12:13.463 INFO:teuthology.orchestra.run.smithi001.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-15T22:12:13.464 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-15T22:12:13.464 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-15T22:12:13.464 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-15T22:12:13.464 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-15T22:12:13.464 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-15T22:12:13.464 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-15T22:12:13.464 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-15T22:12:13.464 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-15T22:12:13.464 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-15T22:12:13.465 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-15T22:12:13.465 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-15T22:12:13.465 INFO:teuthology.orchestra.run.smithi001.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-15T22:12:13.465 INFO:teuthology.orchestra.run.smithi001.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-15T22:12:13.465 INFO:teuthology.orchestra.run.smithi001.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-15T22:12:13.465 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-15T22:12:13.465 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-15T22:12:13.465 INFO:teuthology.orchestra.run.smithi001.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-15T22:12:13.465 INFO:teuthology.orchestra.run.smithi001.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-15T22:12:13.466 INFO:teuthology.orchestra.run.smithi001.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-15T22:12:13.466 INFO:teuthology.orchestra.run.smithi001.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-15T22:12:13.466 INFO:teuthology.orchestra.run.smithi001.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-15T22:12:13.466 INFO:teuthology.orchestra.run.smithi001.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-15T22:12:13.466 INFO:teuthology.orchestra.run.smithi001.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-15T22:12:13.466 INFO:teuthology.orchestra.run.smithi001.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-15T22:12:13.467 INFO:teuthology.orchestra.run.smithi001.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-15T22:12:13.467 INFO:teuthology.orchestra.run.smithi001.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-15T22:12:13.467 INFO:teuthology.orchestra.run.smithi001.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-15T22:12:13.467 INFO:teuthology.orchestra.run.smithi001.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-15T22:12:13.467 INFO:teuthology.orchestra.run.smithi001.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-15T22:12:13.468 INFO:teuthology.orchestra.run.smithi001.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-15T22:12:13.468 INFO:teuthology.orchestra.run.smithi001.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-15T22:12:13.468 INFO:teuthology.orchestra.run.smithi001.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-15T22:12:13.468 INFO:teuthology.orchestra.run.smithi001.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-15T22:12:13.468 INFO:teuthology.orchestra.run.smithi001.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-15T22:12:13.468 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-15T22:12:13.469 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-15T22:12:13.469 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-15T22:12:13.469 INFO:teuthology.orchestra.run.smithi001.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-15T22:12:13.469 INFO:teuthology.orchestra.run.smithi001.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-15T22:12:13.469 INFO:teuthology.orchestra.run.smithi001.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-15T22:12:13.470 INFO:teuthology.orchestra.run.smithi001.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-15T22:12:13.470 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-15T22:12:13.470 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-15T22:12:13.470 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-15T22:12:13.471 INFO:teuthology.orchestra.run.smithi001.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-15T22:12:13.471 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-15T22:12:13.471 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-15T22:12:13.471 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-15T22:12:13.472 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-15T22:12:13.472 INFO:teuthology.orchestra.run.smithi001.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-15T22:12:13.472 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-15T22:12:13.472 INFO:teuthology.orchestra.run.smithi001.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-15T22:12:13.472 INFO:teuthology.orchestra.run.smithi001.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-15T22:12:13.472 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-15T22:12:13.473 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-15T22:12:13.473 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-15T22:12:13.473 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-15T22:12:13.473 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-15T22:12:13.473 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-15T22:12:13.474 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-15T22:12:13.474 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-15T22:12:13.474 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-15T22:12:13.474 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-15T22:12:13.474 INFO:teuthology.orchestra.run.smithi001.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-15T22:12:13.475 INFO:teuthology.orchestra.run.smithi001.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-15T22:12:13.475 INFO:teuthology.orchestra.run.smithi001.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-15T22:12:13.475 INFO:teuthology.orchestra.run.smithi001.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-15T22:12:13.475 INFO:teuthology.orchestra.run.smithi001.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-15T22:12:13.475 INFO:teuthology.orchestra.run.smithi001.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-15T22:12:13.475 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-15T22:12:13.476 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-15T22:12:13.476 INFO:teuthology.orchestra.run.smithi001.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-15T22:12:13.476 INFO:teuthology.orchestra.run.smithi001.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-15T22:12:13.476 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-15T22:12:13.476 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-15T22:12:13.477 INFO:teuthology.orchestra.run.smithi001.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-15T22:12:13.477 INFO:teuthology.orchestra.run.smithi001.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-15T22:12:13.477 INFO:teuthology.orchestra.run.smithi001.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-15T22:12:13.477 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-15T22:12:13.477 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-15T22:12:13.477 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-15T22:12:13.478 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-15T22:12:13.478 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-15T22:12:13.478 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-15T22:12:13.478 INFO:teuthology.orchestra.run.smithi001.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-15T22:12:13.478 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-15T22:12:13.478 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-15T22:12:13.479 INFO:teuthology.orchestra.run.smithi001.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-15T22:12:13.479 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-15T22:12:13.479 INFO:teuthology.orchestra.run.smithi001.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-15T22:12:13.479 INFO:teuthology.orchestra.run.smithi001.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-15T22:12:13.479 INFO:teuthology.orchestra.run.smithi001.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-15T22:12:13.480 INFO:teuthology.orchestra.run.smithi001.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-15T22:12:13.480 INFO:teuthology.orchestra.run.smithi001.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-15T22:12:13.480 INFO:teuthology.orchestra.run.smithi001.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-15T22:12:13.480 INFO:teuthology.orchestra.run.smithi001.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-15T22:12:13.480 INFO:teuthology.orchestra.run.smithi001.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-15T22:12:13.480 INFO:teuthology.orchestra.run.smithi001.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-15T22:12:13.481 INFO:teuthology.orchestra.run.smithi001.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-15T22:12:13.481 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-15T22:12:13.481 INFO:teuthology.orchestra.run.smithi001.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-15T22:12:13.481 INFO:teuthology.orchestra.run.smithi001.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-15T22:12:13.481 INFO:teuthology.orchestra.run.smithi001.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-15T22:12:13.481 INFO:teuthology.orchestra.run.smithi001.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-15T22:12:13.482 INFO:teuthology.orchestra.run.smithi001.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-15T22:12:13.482 INFO:teuthology.orchestra.run.smithi001.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-15T22:12:13.482 INFO:teuthology.orchestra.run.smithi001.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-15T22:12:13.482 INFO:teuthology.orchestra.run.smithi001.stdout:Installing weak dependencies: 2024-09-15T22:12:13.482 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-15T22:12:13.482 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:12:13.483 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2024-09-15T22:12:13.483 INFO:teuthology.orchestra.run.smithi001.stdout:====================================================================================== 2024-09-15T22:12:13.483 INFO:teuthology.orchestra.run.smithi001.stdout:Install 148 Packages 2024-09-15T22:12:13.483 INFO:teuthology.orchestra.run.smithi001.stdout:Upgrade 8 Packages 2024-09-15T22:12:13.483 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:12:13.485 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 226 M 2024-09-15T22:12:13.485 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2024-09-15T22:12:13.534 INFO:teuthology.orchestra.run.smithi012.stdout:(23/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 13 MB/s | 5.3 MB 00:00 2024-09-15T22:12:13.560 INFO:teuthology.orchestra.run.smithi012.stdout:(24/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 2.2 MB/s | 300 kB 00:00 2024-09-15T22:12:13.585 INFO:teuthology.orchestra.run.smithi012.stdout:(25/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 1.9 MB/s | 99 kB 00:00 2024-09-15T22:12:13.610 INFO:teuthology.orchestra.run.smithi012.stdout:(26/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-15T22:12:13.623 INFO:teuthology.orchestra.run.smithi098.stdout:(41/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 14 MB/s | 49 MB 00:03 2024-09-15T22:12:13.649 INFO:teuthology.orchestra.run.smithi098.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 717 kB/s | 801 kB 00:01 2024-09-15T22:12:13.660 INFO:teuthology.orchestra.run.smithi012.stdout:(27/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 3.3 MB/s | 170 kB 00:00 2024-09-15T22:12:13.699 INFO:teuthology.orchestra.run.smithi098.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 482 kB/s | 253 kB 00:00 2024-09-15T22:12:13.727 INFO:teuthology.orchestra.run.smithi012.stdout:(28/156): ceph-grafana-dashboards-19.1.1-326.g8 479 kB/s | 32 kB 00:00 2024-09-15T22:12:13.766 INFO:teuthology.orchestra.run.smithi098.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 912 kB/s | 106 kB 00:00 2024-09-15T22:12:13.794 INFO:teuthology.orchestra.run.smithi012.stdout:(29/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 2.1 MB/s | 146 kB 00:00 2024-09-15T22:12:13.807 INFO:teuthology.orchestra.run.smithi098.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-09-15T22:12:13.853 INFO:teuthology.orchestra.run.smithi012.stdout:(30/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 12 MB/s | 3.1 MB 00:00 2024-09-15T22:12:13.883 INFO:teuthology.orchestra.run.smithi098.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-09-15T22:12:14.050 INFO:teuthology.orchestra.run.smithi098.stdout:(47/156): automake-1.16.2-8.el9.noarch.rpm 4.0 MB/s | 689 kB 00:00 2024-09-15T22:12:14.079 INFO:teuthology.orchestra.run.smithi098.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 793 kB/s | 215 kB 00:00 2024-09-15T22:12:14.129 INFO:teuthology.orchestra.run.smithi098.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 12 MB/s | 943 kB 00:00 2024-09-15T22:12:14.153 INFO:teuthology.orchestra.run.smithi012.stdout:(31/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 9.9 MB/s | 3.6 MB 00:00 2024-09-15T22:12:14.162 INFO:teuthology.orchestra.run.smithi098.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 655 kB/s | 22 kB 00:00 2024-09-15T22:12:14.194 INFO:teuthology.orchestra.run.smithi001.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 48 kB/s | 6.5 kB 00:00 2024-09-15T22:12:14.203 INFO:teuthology.orchestra.run.smithi012.stdout:(32/156): ceph-mgr-modules-core-19.1.1-326.g892 4.9 MB/s | 249 kB 00:00 2024-09-15T22:12:14.205 INFO:teuthology.orchestra.run.smithi098.stdout:(51/156): boost-program-options-1.75.0-8.el9.x8 852 kB/s | 107 kB 00:00 2024-09-15T22:12:14.238 INFO:teuthology.orchestra.run.smithi098.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-09-15T22:12:14.262 INFO:teuthology.orchestra.run.smithi012.stdout:(33/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 846 kB/s | 49 kB 00:00 2024-09-15T22:12:14.263 INFO:teuthology.orchestra.run.smithi098.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 559 kB/s | 33 kB 00:00 2024-09-15T22:12:14.321 INFO:teuthology.orchestra.run.smithi012.stdout:(34/156): ceph-prometheus-alerts-19.1.1-326.g89 282 kB/s | 16 kB 00:00 2024-09-15T22:12:14.339 INFO:teuthology.orchestra.run.smithi098.stdout:(54/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 30 MB/s | 3.0 MB 00:00 2024-09-15T22:12:14.364 INFO:teuthology.orchestra.run.smithi098.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 181 kB/s | 18 kB 00:00 2024-09-15T22:12:14.389 INFO:teuthology.orchestra.run.smithi098.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-15T22:12:14.423 INFO:teuthology.orchestra.run.smithi098.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-15T22:12:14.438 INFO:teuthology.orchestra.run.smithi012.stdout:(35/156): ceph-mgr-diskprediction-local-19.1.1- 13 MB/s | 7.4 MB 00:00 2024-09-15T22:12:14.448 INFO:teuthology.orchestra.run.smithi098.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 771 kB/s | 45 kB 00:00 2024-09-15T22:12:14.463 INFO:teuthology.orchestra.run.smithi012.stdout:(36/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 2.0 MB/s | 285 kB 00:00 2024-09-15T22:12:14.490 INFO:teuthology.orchestra.run.smithi098.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-15T22:12:14.532 INFO:teuthology.orchestra.run.smithi098.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 588 kB/s | 24 kB 00:00 2024-09-15T22:12:14.536 INFO:teuthology.orchestra.run.smithi001.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 2.6 MB/s | 896 kB 00:00 2024-09-15T22:12:14.575 INFO:teuthology.orchestra.run.smithi098.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-15T22:12:14.600 INFO:teuthology.orchestra.run.smithi098.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 3.8 MB/s | 581 kB 00:00 2024-09-15T22:12:14.603 INFO:teuthology.orchestra.run.smithi001.stdout:(3/156): ceph-immutable-object-cache-19.1.1-326 2.1 MB/s | 145 kB 00:00 2024-09-15T22:12:14.625 INFO:teuthology.orchestra.run.smithi098.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-15T22:12:14.659 INFO:teuthology.orchestra.run.smithi098.stdout:(64/156): python3-cryptography-36.0.1-4.el9.x86 1.2 MB/s | 1.2 MB 00:01 2024-09-15T22:12:14.684 INFO:teuthology.orchestra.run.smithi098.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 658 kB/s | 38 kB 00:00 2024-09-15T22:12:14.709 INFO:teuthology.orchestra.run.smithi098.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-15T22:12:14.793 INFO:teuthology.orchestra.run.smithi098.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-15T22:12:14.835 INFO:teuthology.orchestra.run.smithi098.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-15T22:12:14.877 INFO:teuthology.orchestra.run.smithi098.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 11 MB/s | 910 kB 00:00 2024-09-15T22:12:14.905 INFO:teuthology.orchestra.run.smithi012.stdout:(37/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 20 MB/s | 49 MB 00:02 2024-09-15T22:12:14.910 INFO:teuthology.orchestra.run.smithi098.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.8 MB/s | 137 kB 00:00 2024-09-15T22:12:14.930 INFO:teuthology.orchestra.run.smithi012.stdout:(38/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 39 kB/s | 18 kB 00:00 2024-09-15T22:12:14.955 INFO:teuthology.orchestra.run.smithi012.stdout:(39/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 1.4 MB/s | 765 kB 00:00 2024-09-15T22:12:14.969 INFO:teuthology.orchestra.run.smithi098.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-09-15T22:12:14.978 INFO:teuthology.orchestra.run.smithi001.stdout:(4/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 6.4 MB/s | 2.4 MB 00:00 2024-09-15T22:12:15.053 INFO:teuthology.orchestra.run.smithi098.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 33 MB/s | 5.8 MB 00:00 2024-09-15T22:12:15.056 INFO:teuthology.orchestra.run.smithi012.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 530 kB/s | 80 kB 00:00 2024-09-15T22:12:15.062 INFO:teuthology.orchestra.run.smithi001.stdout:(5/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 5.4 MB/s | 5.4 MB 00:01 2024-09-15T22:12:15.078 INFO:teuthology.orchestra.run.smithi098.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 807 kB/s | 87 kB 00:00 2024-09-15T22:12:15.106 INFO:teuthology.orchestra.run.smithi012.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-15T22:12:15.148 INFO:teuthology.orchestra.run.smithi012.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.6 MB/s | 801 kB 00:00 2024-09-15T22:12:15.162 INFO:teuthology.orchestra.run.smithi098.stdout:(74/156): openblas-openmp-0.3.26-2.el9.x86_64.r 9.8 MB/s | 4.9 MB 00:00 2024-09-15T22:12:15.182 INFO:teuthology.orchestra.run.smithi012.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-09-15T22:12:15.187 INFO:teuthology.orchestra.run.smithi001.stdout:(6/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 7.3 MB/s | 1.5 MB 00:00 2024-09-15T22:12:15.187 INFO:teuthology.orchestra.run.smithi098.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 563 kB/s | 61 kB 00:00 2024-09-15T22:12:15.207 INFO:teuthology.orchestra.run.smithi012.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-15T22:12:15.212 INFO:teuthology.orchestra.run.smithi098.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-15T22:12:15.232 INFO:teuthology.orchestra.run.smithi012.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-15T22:12:15.246 INFO:teuthology.orchestra.run.smithi098.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-09-15T22:12:15.271 INFO:teuthology.orchestra.run.smithi098.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 437 kB/s | 26 kB 00:00 2024-09-15T22:12:15.274 INFO:teuthology.orchestra.run.smithi012.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-15T22:12:15.288 INFO:teuthology.orchestra.run.smithi098.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 459 kB/s | 19 kB 00:00 2024-09-15T22:12:15.299 INFO:teuthology.orchestra.run.smithi012.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-09-15T22:12:15.313 INFO:teuthology.orchestra.run.smithi098.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-09-15T22:12:15.331 INFO:teuthology.orchestra.run.smithi098.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 829 kB/s | 35 kB 00:00 2024-09-15T22:12:15.391 INFO:teuthology.orchestra.run.smithi012.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 4.3 MB/s | 1.2 MB 00:00 2024-09-15T22:12:15.423 INFO:teuthology.orchestra.run.smithi098.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-15T22:12:15.429 INFO:teuthology.orchestra.run.smithi001.stdout:(7/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 13 MB/s | 4.7 MB 00:00 2024-09-15T22:12:15.448 INFO:teuthology.orchestra.run.smithi098.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-15T22:12:15.473 INFO:teuthology.orchestra.run.smithi098.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-15T22:12:15.498 INFO:teuthology.orchestra.run.smithi098.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-15T22:12:15.523 INFO:teuthology.orchestra.run.smithi098.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 841 kB/s | 42 kB 00:00 2024-09-15T22:12:15.533 INFO:teuthology.orchestra.run.smithi012.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 689 kB 00:00 2024-09-15T22:12:15.557 INFO:teuthology.orchestra.run.smithi098.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-15T22:12:15.559 INFO:teuthology.orchestra.run.smithi012.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 640 kB/s | 107 kB 00:00 2024-09-15T22:12:15.582 INFO:teuthology.orchestra.run.smithi098.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-15T22:12:15.593 INFO:teuthology.orchestra.run.smithi012.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 3.1 MB/s | 943 kB 00:00 2024-09-15T22:12:15.608 INFO:teuthology.orchestra.run.smithi098.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-15T22:12:15.618 INFO:teuthology.orchestra.run.smithi012.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 258 kB/s | 22 kB 00:00 2024-09-15T22:12:15.633 INFO:teuthology.orchestra.run.smithi098.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-15T22:12:15.643 INFO:teuthology.orchestra.run.smithi012.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 653 kB/s | 33 kB 00:00 2024-09-15T22:12:15.658 INFO:teuthology.orchestra.run.smithi098.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-15T22:12:15.677 INFO:teuthology.orchestra.run.smithi012.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-15T22:12:15.702 INFO:teuthology.orchestra.run.smithi012.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-09-15T22:12:15.727 INFO:teuthology.orchestra.run.smithi012.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-15T22:12:15.734 INFO:teuthology.orchestra.run.smithi098.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-15T22:12:15.759 INFO:teuthology.orchestra.run.smithi098.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-09-15T22:12:15.761 INFO:teuthology.orchestra.run.smithi012.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-15T22:12:15.784 INFO:teuthology.orchestra.run.smithi098.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 881 kB/s | 44 kB 00:00 2024-09-15T22:12:15.786 INFO:teuthology.orchestra.run.smithi012.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 773 kB/s | 45 kB 00:00 2024-09-15T22:12:15.809 INFO:teuthology.orchestra.run.smithi098.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-15T22:12:15.835 INFO:teuthology.orchestra.run.smithi098.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 717 kB/s | 36 kB 00:00 2024-09-15T22:12:15.860 INFO:teuthology.orchestra.run.smithi098.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-15T22:12:15.861 INFO:teuthology.orchestra.run.smithi012.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-09-15T22:12:15.886 INFO:teuthology.orchestra.run.smithi098.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-15T22:12:15.895 INFO:teuthology.orchestra.run.smithi012.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.8 MB/s | 662 kB 00:00 2024-09-15T22:12:15.911 INFO:teuthology.orchestra.run.smithi098.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-15T22:12:15.920 INFO:teuthology.orchestra.run.smithi012.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-15T22:12:15.937 INFO:teuthology.orchestra.run.smithi098.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-15T22:12:15.945 INFO:teuthology.orchestra.run.smithi012.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 3.6 MB/s | 581 kB 00:00 2024-09-15T22:12:15.961 INFO:teuthology.orchestra.run.smithi098.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-15T22:12:15.971 INFO:teuthology.orchestra.run.smithi012.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 629 kB/s | 47 kB 00:00 2024-09-15T22:12:15.971 INFO:teuthology.orchestra.run.smithi001.stdout:(8/156): ceph-common-19.1.1-326.g8921c8ef.el9.x 11 MB/s | 21 MB 00:01 2024-09-15T22:12:15.987 INFO:teuthology.orchestra.run.smithi098.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-09-15T22:12:15.996 INFO:teuthology.orchestra.run.smithi012.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-15T22:12:16.013 INFO:teuthology.orchestra.run.smithi001.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 610 kB/s | 25 kB 00:00 2024-09-15T22:12:16.021 INFO:teuthology.orchestra.run.smithi012.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-15T22:12:16.047 INFO:teuthology.orchestra.run.smithi012.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 510 kB/s | 38 kB 00:00 2024-09-15T22:12:16.180 INFO:teuthology.orchestra.run.smithi012.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-15T22:12:16.221 INFO:teuthology.orchestra.run.smithi098.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2024-09-15T22:12:16.239 INFO:teuthology.orchestra.run.smithi001.stdout:(10/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9 13 MB/s | 11 MB 00:00 2024-09-15T22:12:16.245 INFO:teuthology.orchestra.run.smithi098.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 78 kB/s | 22 kB 00:00 2024-09-15T22:12:16.304 INFO:teuthology.orchestra.run.smithi098.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 6.4 MB/s | 548 kB 00:00 2024-09-15T22:12:16.305 INFO:teuthology.orchestra.run.smithi012.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 16 MB/s | 4.9 MB 00:00 2024-09-15T22:12:16.330 INFO:teuthology.orchestra.run.smithi098.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 787 kB/s | 19 kB 00:00 2024-09-15T22:12:16.339 INFO:teuthology.orchestra.run.smithi012.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 5.6 MB/s | 910 kB 00:00 2024-09-15T22:12:16.363 INFO:teuthology.orchestra.run.smithi098.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 2.6 MB/s | 308 kB 00:00 2024-09-15T22:12:16.364 INFO:teuthology.orchestra.run.smithi012.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-15T22:12:16.405 INFO:teuthology.orchestra.run.smithi098.stdout:(108/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.0 MB/s | 863 kB 00:00 2024-09-15T22:12:16.430 INFO:teuthology.orchestra.run.smithi098.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 388 kB/s | 26 kB 00:00 2024-09-15T22:12:16.431 INFO:teuthology.orchestra.run.smithi012.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-15T22:12:16.464 INFO:teuthology.orchestra.run.smithi098.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-15T22:12:16.489 INFO:teuthology.orchestra.run.smithi001.stdout:(11/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86 13 MB/s | 17 MB 00:01 2024-09-15T22:12:16.498 INFO:teuthology.orchestra.run.smithi098.stdout:(111/156): liboath-2.6.7-2.el9.x86_64.rpm 528 kB/s | 49 kB 00:00 2024-09-15T22:12:16.514 INFO:teuthology.orchestra.run.smithi001.stdout:(12/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 831 kB/s | 228 kB 00:00 2024-09-15T22:12:16.531 INFO:teuthology.orchestra.run.smithi098.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.3 MB/s | 151 kB 00:00 2024-09-15T22:12:16.539 INFO:teuthology.orchestra.run.smithi001.stdout:(13/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 542 kB/s | 27 kB 00:00 2024-09-15T22:12:16.540 INFO:teuthology.orchestra.run.smithi012.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 5.8 MB/s | 1.0 MB 00:00 2024-09-15T22:12:16.564 INFO:teuthology.orchestra.run.smithi001.stdout:(14/156): libcephfs-devel-19.1.1-326.g8921c8ef. 632 kB/s | 32 kB 00:00 2024-09-15T22:12:16.565 INFO:teuthology.orchestra.run.smithi012.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 655 kB/s | 87 kB 00:00 2024-09-15T22:12:16.598 INFO:teuthology.orchestra.run.smithi098.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 8.1 MB/s | 548 kB 00:00 2024-09-15T22:12:16.615 INFO:teuthology.orchestra.run.smithi001.stdout:(15/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 9.8 MB/s | 751 kB 00:00 2024-09-15T22:12:16.615 INFO:teuthology.orchestra.run.smithi012.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-15T22:12:16.623 INFO:teuthology.orchestra.run.smithi098.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-15T22:12:16.648 INFO:teuthology.orchestra.run.smithi001.stdout:(16/156): libcephsqlite-19.1.1-326.g8921c8ef.el 1.9 MB/s | 163 kB 00:00 2024-09-15T22:12:16.665 INFO:teuthology.orchestra.run.smithi098.stdout:(115/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.9 MB/s | 839 kB 00:00 2024-09-15T22:12:16.673 INFO:teuthology.orchestra.run.smithi001.stdout:(17/156): librados-devel-19.1.1-326.g8921c8ef.e 2.1 MB/s | 127 kB 00:00 2024-09-15T22:12:16.682 INFO:teuthology.orchestra.run.smithi012.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 3.6 MB/s | 245 kB 00:00 2024-09-15T22:12:16.691 INFO:teuthology.orchestra.run.smithi098.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 480 kB/s | 32 kB 00:00 2024-09-15T22:12:16.707 INFO:teuthology.orchestra.run.smithi001.stdout:(18/156): libradosstriper1-19.1.1-326.g8921c8ef 8.4 MB/s | 506 kB 00:00 2024-09-15T22:12:16.716 INFO:teuthology.orchestra.run.smithi098.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 279 kB/s | 14 kB 00:00 2024-09-15T22:12:16.742 INFO:teuthology.orchestra.run.smithi098.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-15T22:12:16.757 INFO:teuthology.orchestra.run.smithi012.stdout:(76/156): postgresql-server-13.16-1.el9.x86_64. 14 MB/s | 5.8 MB 00:00 2024-09-15T22:12:16.766 INFO:teuthology.orchestra.run.smithi001.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 775 kB/s | 45 kB 00:00 2024-09-15T22:12:16.791 INFO:teuthology.orchestra.run.smithi012.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.2 MB/s | 248 kB 00:00 2024-09-15T22:12:16.808 INFO:teuthology.orchestra.run.smithi012.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-09-15T22:12:16.809 INFO:teuthology.orchestra.run.smithi098.stdout:(119/156): libarrow-9.0.0-11.el9.x86_64.rpm 9.2 MB/s | 4.4 MB 00:00 2024-09-15T22:12:16.834 INFO:teuthology.orchestra.run.smithi098.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-09-15T22:12:16.858 INFO:teuthology.orchestra.run.smithi001.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 1.5 MB/s | 136 kB 00:00 2024-09-15T22:12:16.867 INFO:teuthology.orchestra.run.smithi098.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2024-09-15T22:12:16.892 INFO:teuthology.orchestra.run.smithi012.stdout:(79/156): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-15T22:12:16.893 INFO:teuthology.orchestra.run.smithi098.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-15T22:12:16.917 INFO:teuthology.orchestra.run.smithi012.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 152 kB/s | 19 kB 00:00 2024-09-15T22:12:16.918 INFO:teuthology.orchestra.run.smithi098.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-15T22:12:16.943 INFO:teuthology.orchestra.run.smithi012.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-15T22:12:16.943 INFO:teuthology.orchestra.run.smithi098.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-09-15T22:12:16.959 INFO:teuthology.orchestra.run.smithi012.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 519 kB/s | 35 kB 00:00 2024-09-15T22:12:16.969 INFO:teuthology.orchestra.run.smithi098.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-15T22:12:16.975 INFO:teuthology.orchestra.run.smithi001.stdout:(21/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 18 MB/s | 5.3 MB 00:00 2024-09-15T22:12:16.994 INFO:teuthology.orchestra.run.smithi098.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 458 kB/s | 23 kB 00:00 2024-09-15T22:12:17.000 INFO:teuthology.orchestra.run.smithi001.stdout:(22/156): python3-cephfs-19.1.1-326.g8921c8ef.e 1.1 MB/s | 161 kB 00:00 2024-09-15T22:12:17.001 INFO:teuthology.orchestra.run.smithi012.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-15T22:12:17.019 INFO:teuthology.orchestra.run.smithi098.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-09-15T22:12:17.026 INFO:teuthology.orchestra.run.smithi012.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.2 MB/s | 222 kB 00:00 2024-09-15T22:12:17.034 INFO:teuthology.orchestra.run.smithi001.stdout:(23/156): python3-rados-19.1.1-326.g8921c8ef.el 5.4 MB/s | 320 kB 00:00 2024-09-15T22:12:17.045 INFO:teuthology.orchestra.run.smithi098.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-15T22:12:17.059 INFO:teuthology.orchestra.run.smithi001.stdout:(24/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 5.0 MB/s | 300 kB 00:00 2024-09-15T22:12:17.060 INFO:teuthology.orchestra.run.smithi012.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-15T22:12:17.070 INFO:teuthology.orchestra.run.smithi098.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-15T22:12:17.077 INFO:teuthology.orchestra.run.smithi012.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 841 kB/s | 42 kB 00:00 2024-09-15T22:12:17.084 INFO:teuthology.orchestra.run.smithi001.stdout:(25/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 1.9 MB/s | 99 kB 00:00 2024-09-15T22:12:17.103 INFO:teuthology.orchestra.run.smithi098.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-15T22:12:17.109 INFO:teuthology.orchestra.run.smithi001.stdout:(26/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-15T22:12:17.119 INFO:teuthology.orchestra.run.smithi012.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-15T22:12:17.137 INFO:teuthology.orchestra.run.smithi098.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-09-15T22:12:17.144 INFO:teuthology.orchestra.run.smithi012.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-09-15T22:12:17.168 INFO:teuthology.orchestra.run.smithi001.stdout:(27/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 2.9 MB/s | 170 kB 00:00 2024-09-15T22:12:17.178 INFO:teuthology.orchestra.run.smithi012.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-15T22:12:17.187 INFO:teuthology.orchestra.run.smithi098.stdout:(132/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.8 MB/s | 2.0 MB 00:00 2024-09-15T22:12:17.203 INFO:teuthology.orchestra.run.smithi012.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 870 kB/s | 51 kB 00:00 2024-09-15T22:12:17.213 INFO:teuthology.orchestra.run.smithi098.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 654 kB/s | 16 kB 00:00 2024-09-15T22:12:17.238 INFO:teuthology.orchestra.run.smithi098.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-15T22:12:17.263 INFO:teuthology.orchestra.run.smithi098.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-15T22:12:17.270 INFO:teuthology.orchestra.run.smithi012.stdout:(91/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-09-15T22:12:17.277 INFO:teuthology.orchestra.run.smithi001.stdout:(28/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 16 MB/s | 3.1 MB 00:00 2024-09-15T22:12:17.293 INFO:teuthology.orchestra.run.smithi001.stdout:(29/156): ceph-grafana-dashboards-19.1.1-326.g8 254 kB/s | 32 kB 00:00 2024-09-15T22:12:17.295 INFO:teuthology.orchestra.run.smithi012.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 458 kB/s | 54 kB 00:00 2024-09-15T22:12:17.297 INFO:teuthology.orchestra.run.smithi098.stdout:(136/156): python3-kubernetes-26.1.0-2.el9.noar 3.7 MB/s | 1.0 MB 00:00 2024-09-15T22:12:17.322 INFO:teuthology.orchestra.run.smithi098.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 336 kB/s | 28 kB 00:00 2024-09-15T22:12:17.327 INFO:teuthology.orchestra.run.smithi001.stdout:(30/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 2.9 MB/s | 146 kB 00:00 2024-09-15T22:12:17.329 INFO:teuthology.orchestra.run.smithi012.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 715 kB/s | 42 kB 00:00 2024-09-15T22:12:17.348 INFO:teuthology.orchestra.run.smithi098.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 367 kB/s | 31 kB 00:00 2024-09-15T22:12:17.354 INFO:teuthology.orchestra.run.smithi012.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 755 kB/s | 44 kB 00:00 2024-09-15T22:12:17.364 INFO:teuthology.orchestra.run.smithi098.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-09-15T22:12:17.381 INFO:teuthology.orchestra.run.smithi098.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-09-15T22:12:17.388 INFO:teuthology.orchestra.run.smithi012.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-15T22:12:17.407 INFO:teuthology.orchestra.run.smithi098.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-09-15T22:12:17.413 INFO:teuthology.orchestra.run.smithi012.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 612 kB/s | 36 kB 00:00 2024-09-15T22:12:17.432 INFO:teuthology.orchestra.run.smithi098.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 1.1 MB/s | 74 kB 00:00 2024-09-15T22:12:17.447 INFO:teuthology.orchestra.run.smithi012.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 811 kB/s | 47 kB 00:00 2024-09-15T22:12:17.457 INFO:teuthology.orchestra.run.smithi098.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-15T22:12:17.472 INFO:teuthology.orchestra.run.smithi012.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-15T22:12:17.483 INFO:teuthology.orchestra.run.smithi098.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-15T22:12:17.508 INFO:teuthology.orchestra.run.smithi098.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-09-15T22:12:17.528 INFO:teuthology.orchestra.run.smithi012.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 715 kB/s | 58 kB 00:00 2024-09-15T22:12:17.533 INFO:teuthology.orchestra.run.smithi098.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-15T22:12:17.556 INFO:teuthology.orchestra.run.smithi012.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.1 MB/s | 96 kB 00:00 2024-09-15T22:12:17.558 INFO:teuthology.orchestra.run.smithi098.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-15T22:12:17.577 INFO:teuthology.orchestra.run.smithi001.stdout:(31/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 13 MB/s | 3.6 MB 00:00 2024-09-15T22:12:17.589 INFO:teuthology.orchestra.run.smithi012.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.0 MB/s | 64 kB 00:00 2024-09-15T22:12:17.615 INFO:teuthology.orchestra.run.smithi012.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 764 kB/s | 45 kB 00:00 2024-09-15T22:12:17.626 INFO:teuthology.orchestra.run.smithi098.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-15T22:12:17.661 INFO:teuthology.orchestra.run.smithi001.stdout:(32/156): ceph-mgr-modules-core-19.1.1-326.g892 2.9 MB/s | 249 kB 00:00 2024-09-15T22:12:17.778 INFO:teuthology.orchestra.run.smithi001.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 16 MB/s | 7.4 MB 00:00 2024-09-15T22:12:17.803 INFO:teuthology.orchestra.run.smithi001.stdout:(34/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 347 kB/s | 49 kB 00:00 2024-09-15T22:12:17.828 INFO:teuthology.orchestra.run.smithi001.stdout:(35/156): ceph-prometheus-alerts-19.1.1-326.g89 330 kB/s | 16 kB 00:00 2024-09-15T22:12:17.848 INFO:teuthology.orchestra.run.smithi012.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-09-15T22:12:17.854 INFO:teuthology.orchestra.run.smithi001.stdout:(36/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 5.6 MB/s | 285 kB 00:00 2024-09-15T22:12:17.890 INFO:teuthology.orchestra.run.smithi012.stdout:(104/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.1 MB/s | 863 kB 00:00 2024-09-15T22:12:17.896 INFO:teuthology.orchestra.run.smithi001.stdout:(37/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 11 MB/s | 765 kB 00:00 2024-09-15T22:12:17.921 INFO:teuthology.orchestra.run.smithi001.stdout:(38/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 274 kB/s | 18 kB 00:00 2024-09-15T22:12:17.934 INFO:teuthology.orchestra.run.smithi098.stdout:(149/156): librados2-19.1.1-326.g8921c8ef.el9.x 8.5 MB/s | 3.4 MB 00:00 2024-09-15T22:12:17.949 INFO:teuthology.orchestra.run.smithi012.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 5.4 MB/s | 548 kB 00:00 2024-09-15T22:12:17.974 INFO:teuthology.orchestra.run.smithi012.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 856 kB/s | 19 kB 00:00 2024-09-15T22:12:18.016 INFO:teuthology.orchestra.run.smithi012.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 2.4 MB/s | 308 kB 00:00 2024-09-15T22:12:18.038 INFO:teuthology.orchestra.run.smithi001.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 561 kB/s | 80 kB 00:00 2024-09-15T22:12:18.041 INFO:teuthology.orchestra.run.smithi012.stdout:(108/156): lua-devel-5.4.4-4.el9.x86_64.rpm 49 kB/s | 22 kB 00:00 2024-09-15T22:12:18.075 INFO:teuthology.orchestra.run.smithi012.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 444 kB/s | 26 kB 00:00 2024-09-15T22:12:18.109 INFO:teuthology.orchestra.run.smithi098.stdout:(150/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 5.7 MB/s | 3.2 MB 00:00 2024-09-15T22:12:18.117 INFO:teuthology.orchestra.run.smithi012.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-15T22:12:18.151 INFO:teuthology.orchestra.run.smithi012.stdout:(111/156): liboath-2.6.7-2.el9.x86_64.rpm 445 kB/s | 49 kB 00:00 2024-09-15T22:12:18.176 INFO:teuthology.orchestra.run.smithi012.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.6 MB/s | 151 kB 00:00 2024-09-15T22:12:18.243 INFO:teuthology.orchestra.run.smithi012.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 8.1 MB/s | 548 kB 00:00 2024-09-15T22:12:18.268 INFO:teuthology.orchestra.run.smithi012.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-15T22:12:18.310 INFO:teuthology.orchestra.run.smithi012.stdout:(115/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.2 MB/s | 839 kB 00:00 2024-09-15T22:12:18.335 INFO:teuthology.orchestra.run.smithi012.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 482 kB/s | 32 kB 00:00 2024-09-15T22:12:18.361 INFO:teuthology.orchestra.run.smithi012.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-15T22:12:18.386 INFO:teuthology.orchestra.run.smithi012.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-09-15T22:12:18.401 INFO:teuthology.orchestra.run.smithi098.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 140 kB/s | 41 kB 00:00 2024-09-15T22:12:18.419 INFO:teuthology.orchestra.run.smithi012.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-15T22:12:18.487 INFO:teuthology.orchestra.run.smithi012.stdout:(120/156): libarrow-9.0.0-11.el9.x86_64.rpm 8.6 MB/s | 4.4 MB 00:00 2024-09-15T22:12:18.512 INFO:teuthology.orchestra.run.smithi012.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2024-09-15T22:12:18.537 INFO:teuthology.orchestra.run.smithi012.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 1.8 MB/s | 220 kB 00:00 2024-09-15T22:12:18.539 INFO:teuthology.orchestra.run.smithi001.stdout:(40/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 19 MB/s | 49 MB 00:02 2024-09-15T22:12:18.560 INFO:teuthology.orchestra.run.smithi098.stdout:(152/156): NetworkManager-1.49.90-1.el9.x86_64. 2.5 MB/s | 2.3 MB 00:00 2024-09-15T22:12:18.562 INFO:teuthology.orchestra.run.smithi012.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-15T22:12:18.564 INFO:teuthology.orchestra.run.smithi001.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 364 kB/s | 191 kB 00:00 2024-09-15T22:12:18.588 INFO:teuthology.orchestra.run.smithi012.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-15T22:12:18.598 INFO:teuthology.orchestra.run.smithi001.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 801 kB 00:00 2024-09-15T22:12:18.613 INFO:teuthology.orchestra.run.smithi012.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 354 kB/s | 18 kB 00:00 2024-09-15T22:12:18.638 INFO:teuthology.orchestra.run.smithi012.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 463 kB/s | 23 kB 00:00 2024-09-15T22:12:18.640 INFO:teuthology.orchestra.run.smithi001.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-15T22:12:18.660 INFO:teuthology.orchestra.run.smithi098.stdout:(153/156): NetworkManager-libnm-1.49.90-1.el9.x 2.5 MB/s | 1.8 MB 00:00 2024-09-15T22:12:18.663 INFO:teuthology.orchestra.run.smithi012.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 389 kB/s | 19 kB 00:00 2024-09-15T22:12:18.682 INFO:teuthology.orchestra.run.smithi001.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.2 MB 00:00 2024-09-15T22:12:18.688 INFO:teuthology.orchestra.run.smithi012.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-15T22:12:18.703 INFO:teuthology.orchestra.run.smithi098.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 9.5 MB/s | 1.4 MB 00:00 2024-09-15T22:12:18.708 INFO:teuthology.orchestra.run.smithi001.stdout:(45/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2024-09-15T22:12:18.714 INFO:teuthology.orchestra.run.smithi012.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-15T22:12:18.728 INFO:teuthology.orchestra.run.smithi098.stdout:(155/156): NetworkManager-tui-1.49.90-1.el9.x86 763 kB/s | 249 kB 00:00 2024-09-15T22:12:18.732 INFO:teuthology.orchestra.run.smithi001.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-09-15T22:12:18.748 INFO:teuthology.orchestra.run.smithi012.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-15T22:12:18.757 INFO:teuthology.orchestra.run.smithi001.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-15T22:12:18.773 INFO:teuthology.orchestra.run.smithi012.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-15T22:12:18.783 INFO:teuthology.orchestra.run.smithi001.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-15T22:12:18.815 INFO:teuthology.orchestra.run.smithi012.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-09-15T22:12:18.840 INFO:teuthology.orchestra.run.smithi012.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-09-15T22:12:18.865 INFO:teuthology.orchestra.run.smithi012.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 326 kB/s | 16 kB 00:00 2024-09-15T22:12:18.886 INFO:teuthology.orchestra.run.smithi098.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2024-09-15T22:12:18.892 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-15T22:12:18.892 INFO:teuthology.orchestra.run.smithi098.stdout:Total 21 MB/s | 226 MB 00:11 2024-09-15T22:12:18.899 INFO:teuthology.orchestra.run.smithi001.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 920 kB/s | 107 kB 00:00 2024-09-15T22:12:18.916 INFO:teuthology.orchestra.run.smithi012.stdout:(135/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.8 MB/s | 2.0 MB 00:00 2024-09-15T22:12:18.933 INFO:teuthology.orchestra.run.smithi012.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 422 kB/s | 28 kB 00:00 2024-09-15T22:12:18.942 INFO:teuthology.orchestra.run.smithi001.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 689 kB 00:00 2024-09-15T22:12:18.958 INFO:teuthology.orchestra.run.smithi012.stdout:(137/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 766 kB/s | 90 kB 00:00 2024-09-15T22:12:18.967 INFO:teuthology.orchestra.run.smithi001.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 324 kB/s | 22 kB 00:00 2024-09-15T22:12:18.975 INFO:teuthology.orchestra.run.smithi012.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 522 kB/s | 31 kB 00:00 2024-09-15T22:12:18.992 INFO:teuthology.orchestra.run.smithi012.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-09-15T22:12:19.009 INFO:teuthology.orchestra.run.smithi012.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-09-15T22:12:19.010 INFO:teuthology.orchestra.run.smithi001.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.7 MB/s | 943 kB 00:00 2024-09-15T22:12:19.034 INFO:teuthology.orchestra.run.smithi001.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 491 kB/s | 33 kB 00:00 2024-09-15T22:12:19.034 INFO:teuthology.orchestra.run.smithi012.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-15T22:12:19.059 INFO:teuthology.orchestra.run.smithi001.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-15T22:12:19.068 INFO:teuthology.orchestra.run.smithi012.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-09-15T22:12:19.076 INFO:teuthology.orchestra.run.smithi001.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 436 kB/s | 18 kB 00:00 2024-09-15T22:12:19.093 INFO:teuthology.orchestra.run.smithi012.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-09-15T22:12:19.094 INFO:teuthology.orchestra.run.smithi001.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 335 kB/s | 11 kB 00:00 2024-09-15T22:12:19.119 INFO:teuthology.orchestra.run.smithi001.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 160 kB 00:00 2024-09-15T22:12:19.119 INFO:teuthology.orchestra.run.smithi012.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-15T22:12:19.135 INFO:teuthology.orchestra.run.smithi001.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-15T22:12:19.143 INFO:teuthology.orchestra.run.smithi012.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-15T22:12:19.177 INFO:teuthology.orchestra.run.smithi012.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-09-15T22:12:19.178 INFO:teuthology.orchestra.run.smithi001.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-15T22:12:19.202 INFO:teuthology.orchestra.run.smithi012.stdout:(147/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-15T22:12:19.236 INFO:teuthology.orchestra.run.smithi001.stdout:(60/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-09-15T22:12:19.278 INFO:teuthology.orchestra.run.smithi012.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-15T22:12:19.286 INFO:teuthology.orchestra.run.smithi001.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 226 kB/s | 24 kB 00:00 2024-09-15T22:12:19.303 INFO:teuthology.orchestra.run.smithi001.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 714 kB/s | 47 kB 00:00 2024-09-15T22:12:19.337 INFO:teuthology.orchestra.run.smithi001.stdout:(63/156): libtool-2.4.6-46.el9.x86_64.rpm 2.8 MB/s | 581 kB 00:00 2024-09-15T22:12:19.362 INFO:teuthology.orchestra.run.smithi001.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-15T22:12:19.404 INFO:teuthology.orchestra.run.smithi001.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-15T22:12:19.429 INFO:teuthology.orchestra.run.smithi001.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 577 kB/s | 38 kB 00:00 2024-09-15T22:12:19.462 INFO:teuthology.orchestra.run.smithi012.stdout:(149/156): librados2-19.1.1-326.g8921c8ef.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-15T22:12:19.505 INFO:teuthology.orchestra.run.smithi001.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-15T22:12:19.580 INFO:teuthology.orchestra.run.smithi001.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 25 MB/s | 4.4 MB 00:00 2024-09-15T22:12:19.603 INFO:teuthology.orchestra.run.smithi012.stdout:(150/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 7.9 MB/s | 3.2 MB 00:00 2024-09-15T22:12:19.653 INFO:teuthology.orchestra.run.smithi012.stdout:(151/156): NetworkManager-1.49.90-1.el9.x86_64. 6.2 MB/s | 2.3 MB 00:00 2024-09-15T22:12:19.678 INFO:teuthology.orchestra.run.smithi001.stdout:(69/156): openblas-openmp-0.3.26-2.el9.x86_64.r 16 MB/s | 4.9 MB 00:00 2024-09-15T22:12:19.695 INFO:teuthology.orchestra.run.smithi012.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 5.9 MB/s | 249 kB 00:00 2024-09-15T22:12:19.705 INFO:teuthology.orchestra.run.smithi001.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-15T22:12:19.720 INFO:teuthology.orchestra.run.smithi012.stdout:(153/156): NetworkManager-team-1.49.90-1.el9.x8 348 kB/s | 41 kB 00:00 2024-09-15T22:12:19.741 INFO:teuthology.orchestra.run.smithi001.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 3.8 MB/s | 910 kB 00:00 2024-09-15T22:12:19.763 INFO:teuthology.orchestra.run.smithi012.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 20 MB/s | 1.4 MB 00:00 2024-09-15T22:12:19.790 INFO:teuthology.orchestra.run.smithi001.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-09-15T22:12:19.815 INFO:teuthology.orchestra.run.smithi001.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-09-15T22:12:19.857 INFO:teuthology.orchestra.run.smithi001.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-15T22:12:19.949 INFO:teuthology.orchestra.run.smithi001.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 21 MB/s | 5.8 MB 00:00 2024-09-15T22:12:19.974 INFO:teuthology.orchestra.run.smithi001.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.1 MB/s | 245 kB 00:00 2024-09-15T22:12:19.979 INFO:teuthology.orchestra.run.smithi012.stdout:(155/156): NetworkManager-libnm-1.49.90-1.el9.x 3.5 MB/s | 1.8 MB 00:00 2024-09-15T22:12:20.090 INFO:teuthology.orchestra.run.smithi001.stdout:(77/156): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 6.0 MB 00:00 2024-09-15T22:12:20.096 INFO:teuthology.orchestra.run.smithi012.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 6.4 MB/s | 2.4 MB 00:00 2024-09-15T22:12:20.105 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-09-15T22:12:20.105 INFO:teuthology.orchestra.run.smithi012.stdout:Total 19 MB/s | 226 MB 00:11 2024-09-15T22:12:20.107 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-15T22:12:20.116 INFO:teuthology.orchestra.run.smithi001.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 181 kB/s | 26 kB 00:00 2024-09-15T22:12:20.141 INFO:teuthology.orchestra.run.smithi001.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 374 kB/s | 19 kB 00:00 2024-09-15T22:12:20.166 INFO:teuthology.orchestra.run.smithi001.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-15T22:12:20.192 INFO:teuthology.orchestra.run.smithi001.stdout:(81/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.1 MB/s | 248 kB 00:00 2024-09-15T22:12:20.257 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-15T22:12:20.257 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-15T22:12:20.342 INFO:teuthology.orchestra.run.smithi001.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 173 kB/s | 35 kB 00:00 2024-09-15T22:12:20.367 INFO:teuthology.orchestra.run.smithi001.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 250 kB 00:00 2024-09-15T22:12:20.393 INFO:teuthology.orchestra.run.smithi001.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-15T22:12:20.418 INFO:teuthology.orchestra.run.smithi001.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-15T22:12:20.443 INFO:teuthology.orchestra.run.smithi001.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 847 kB/s | 42 kB 00:00 2024-09-15T22:12:20.501 INFO:teuthology.orchestra.run.smithi001.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 3.2 MB/s | 269 kB 00:00 2024-09-15T22:12:20.535 INFO:teuthology.orchestra.run.smithi001.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-09-15T22:12:20.561 INFO:teuthology.orchestra.run.smithi001.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.6 MB/s | 279 kB 00:00 2024-09-15T22:12:20.586 INFO:teuthology.orchestra.run.smithi001.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-15T22:12:20.611 INFO:teuthology.orchestra.run.smithi001.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.1 MB/s | 54 kB 00:00 2024-09-15T22:12:20.653 INFO:teuthology.orchestra.run.smithi001.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-15T22:12:20.737 INFO:teuthology.orchestra.run.smithi001.stdout:(93/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.9 MB/s | 5.1 MB 00:00 2024-09-15T22:12:20.762 INFO:teuthology.orchestra.run.smithi001.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 407 kB/s | 44 kB 00:00 2024-09-15T22:12:20.788 INFO:teuthology.orchestra.run.smithi001.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-15T22:12:20.813 INFO:teuthology.orchestra.run.smithi001.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 718 kB/s | 36 kB 00:00 2024-09-15T22:12:20.838 INFO:teuthology.orchestra.run.smithi001.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-09-15T22:12:20.864 INFO:teuthology.orchestra.run.smithi001.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-15T22:12:20.937 INFO:teuthology.orchestra.run.smithi001.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 589 kB/s | 58 kB 00:00 2024-09-15T22:12:20.964 INFO:teuthology.orchestra.run.smithi001.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 958 kB/s | 96 kB 00:00 2024-09-15T22:12:21.014 INFO:teuthology.orchestra.run.smithi001.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 824 kB/s | 64 kB 00:00 2024-09-15T22:12:21.065 INFO:teuthology.orchestra.run.smithi001.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 447 kB/s | 45 kB 00:00 2024-09-15T22:12:21.298 INFO:teuthology.orchestra.run.smithi001.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2024-09-15T22:12:21.357 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-09-15T22:12:21.365 INFO:teuthology.orchestra.run.smithi001.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-09-15T22:12:21.407 INFO:teuthology.orchestra.run.smithi001.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 7.2 MB/s | 308 kB 00:00 2024-09-15T22:12:21.441 INFO:teuthology.orchestra.run.smithi001.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 584 kB/s | 19 kB 00:00 2024-09-15T22:12:21.500 INFO:teuthology.orchestra.run.smithi001.stdout:(107/156): lua-devel-5.4.4-4.el9.x86_64.rpm 46 kB/s | 22 kB 00:00 2024-09-15T22:12:21.523 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-09-15T22:12:21.524 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-09-15T22:12:21.550 INFO:teuthology.orchestra.run.smithi001.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 525 kB/s | 26 kB 00:00 2024-09-15T22:12:21.584 INFO:teuthology.orchestra.run.smithi001.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-15T22:12:21.626 INFO:teuthology.orchestra.run.smithi001.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-15T22:12:21.659 INFO:teuthology.orchestra.run.smithi001.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-15T22:12:21.759 INFO:teuthology.orchestra.run.smithi001.stdout:(112/156): libarrow-9.0.0-11.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-09-15T22:12:21.810 INFO:teuthology.orchestra.run.smithi001.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.5 MB/s | 839 kB 00:00 2024-09-15T22:12:21.843 INFO:teuthology.orchestra.run.smithi001.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-09-15T22:12:21.860 INFO:teuthology.orchestra.run.smithi001.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 868 kB/s | 43 kB 00:00 2024-09-15T22:12:21.877 INFO:teuthology.orchestra.run.smithi001.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 956 kB/s | 32 kB 00:00 2024-09-15T22:12:21.902 INFO:teuthology.orchestra.run.smithi001.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 339 kB/s | 14 kB 00:00 2024-09-15T22:12:21.928 INFO:teuthology.orchestra.run.smithi001.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-09-15T22:12:21.970 INFO:teuthology.orchestra.run.smithi001.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-15T22:12:21.997 INFO:teuthology.orchestra.run.smithi001.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-15T22:12:22.020 INFO:teuthology.orchestra.run.smithi001.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-15T22:12:22.054 INFO:teuthology.orchestra.run.smithi001.stdout:(122/156): protobuf-compiler-3.14.0-13.el9.x86_ 873 kB/s | 863 kB 00:00 2024-09-15T22:12:22.062 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-15T22:12:22.063 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-15T22:12:22.096 INFO:teuthology.orchestra.run.smithi001.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-09-15T22:12:22.154 INFO:teuthology.orchestra.run.smithi001.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 319 kB/s | 18 kB 00:00 2024-09-15T22:12:22.180 INFO:teuthology.orchestra.run.smithi001.stdout:(125/156): python3-jaraco-8.2.1-3.el9.noarch.rp 85 kB/s | 11 kB 00:00 2024-09-15T22:12:22.205 INFO:teuthology.orchestra.run.smithi001.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 460 kB/s | 23 kB 00:00 2024-09-15T22:12:22.230 INFO:teuthology.orchestra.run.smithi001.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 389 kB/s | 19 kB 00:00 2024-09-15T22:12:22.256 INFO:teuthology.orchestra.run.smithi001.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-15T22:12:22.289 INFO:teuthology.orchestra.run.smithi001.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-15T22:12:22.323 INFO:teuthology.orchestra.run.smithi001.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-15T22:12:22.382 INFO:teuthology.orchestra.run.smithi001.stdout:(131/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.3 MB/s | 2.0 MB 00:00 2024-09-15T22:12:22.407 INFO:teuthology.orchestra.run.smithi001.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 691 kB/s | 58 kB 00:00 2024-09-15T22:12:22.432 INFO:teuthology.orchestra.run.smithi001.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-09-15T22:12:22.457 INFO:teuthology.orchestra.run.smithi001.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-15T22:12:22.491 INFO:teuthology.orchestra.run.smithi001.stdout:(135/156): python3-kubernetes-26.1.0-2.el9.noar 3.9 MB/s | 1.0 MB 00:00 2024-09-15T22:12:22.516 INFO:teuthology.orchestra.run.smithi001.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 482 kB/s | 28 kB 00:00 2024-09-15T22:12:22.566 INFO:teuthology.orchestra.run.smithi001.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 412 kB/s | 31 kB 00:00 2024-09-15T22:12:22.600 INFO:teuthology.orchestra.run.smithi001.stdout:(138/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 536 kB/s | 90 kB 00:00 2024-09-15T22:12:22.625 INFO:teuthology.orchestra.run.smithi001.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-15T22:12:22.651 INFO:teuthology.orchestra.run.smithi001.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 717 kB/s | 36 kB 00:00 2024-09-15T22:12:22.676 INFO:teuthology.orchestra.run.smithi001.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-15T22:12:22.701 INFO:teuthology.orchestra.run.smithi001.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 989 kB/s | 74 kB 00:00 2024-09-15T22:12:22.727 INFO:teuthology.orchestra.run.smithi001.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-15T22:12:22.752 INFO:teuthology.orchestra.run.smithi001.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-15T22:12:22.777 INFO:teuthology.orchestra.run.smithi001.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 400 kB/s | 20 kB 00:00 2024-09-15T22:12:22.813 INFO:teuthology.orchestra.run.smithi001.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-09-15T22:12:22.836 INFO:teuthology.orchestra.run.smithi001.stdout:(147/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-15T22:12:22.928 INFO:teuthology.orchestra.run.smithi001.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-15T22:12:23.078 INFO:teuthology.orchestra.run.smithi001.stdout:(149/156): librados2-19.1.1-326.g8921c8ef.el9.x 13 MB/s | 3.4 MB 00:00 2024-09-15T22:12:23.137 INFO:teuthology.orchestra.run.smithi001.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 11 MB/s | 2.3 MB 00:00 2024-09-15T22:12:23.179 INFO:teuthology.orchestra.run.smithi001.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 989 kB/s | 41 kB 00:00 2024-09-15T22:12:23.221 INFO:teuthology.orchestra.run.smithi001.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 5.8 MB/s | 249 kB 00:00 2024-09-15T22:12:23.380 INFO:teuthology.orchestra.run.smithi001.stdout:(153/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 5.8 MB/s | 3.2 MB 00:00 2024-09-15T22:12:23.427 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-09-15T22:12:23.428 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-09-15T22:12:23.430 INFO:teuthology.orchestra.run.smithi001.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 5.1 MB/s | 1.8 MB 00:00 2024-09-15T22:12:23.472 INFO:teuthology.orchestra.run.smithi001.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 5.4 MB/s | 1.4 MB 00:00 2024-09-15T22:12:23.647 INFO:teuthology.orchestra.run.smithi001.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 9.0 MB/s | 2.4 MB 00:00 2024-09-15T22:12:23.653 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-09-15T22:12:23.653 INFO:teuthology.orchestra.run.smithi001.stdout:Total 22 MB/s | 226 MB 00:10 2024-09-15T22:12:25.734 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2024-09-15T22:12:25.933 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2024-09-15T22:12:25.933 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2024-09-15T22:12:28.415 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2024-09-15T22:12:28.416 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2024-09-15T22:12:28.538 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-15T22:12:28.665 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-15T22:12:28.703 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-15T22:12:28.765 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-15T22:12:28.799 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-15T22:12:28.825 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-15T22:12:28.876 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-15T22:12:29.205 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-15T22:12:29.317 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:12:29.439 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:12:29.477 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:12:29.568 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:12:29.598 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:12:29.737 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-15T22:12:29.786 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-15T22:12:29.815 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:12:29.898 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-09-15T22:12:29.901 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:12:29.924 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T22:12:29.987 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T22:12:29.991 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-15T22:12:30.017 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T22:12:30.043 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T22:12:30.108 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-15T22:12:30.235 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T22:12:30.269 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-15T22:12:30.310 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-15T22:12:30.334 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-15T22:12:30.371 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T22:12:30.379 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-15T22:12:30.507 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-15T22:12:30.608 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:12:30.675 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:12:30.735 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-15T22:12:30.860 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:12:30.901 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:12:30.985 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:12:31.012 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-15T22:12:31.019 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:12:31.108 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-15T22:12:31.111 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:12:31.139 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-15T22:12:31.140 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:12:31.182 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-15T22:12:31.255 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-15T22:12:31.298 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-15T22:12:31.299 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-15T22:12:31.332 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-15T22:12:31.370 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-15T22:12:31.375 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-15T22:12:31.398 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:12:31.408 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-15T22:12:31.436 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-15T22:12:31.504 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:12:31.504 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-15T22:12:31.533 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T22:12:31.553 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-15T22:12:31.578 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T22:12:31.584 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-15T22:12:31.600 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T22:12:31.628 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-15T22:12:31.629 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T22:12:31.705 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-15T22:12:31.739 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-15T22:12:31.783 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-15T22:12:31.811 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-15T22:12:31.827 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T22:12:31.882 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-15T22:12:31.927 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-15T22:12:31.957 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T22:12:32.003 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-15T22:12:32.098 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-15T22:12:32.141 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-15T22:12:32.196 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-15T22:12:32.198 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:12:32.275 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:12:32.505 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:12:32.629 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-15T22:12:32.720 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-15T22:12:32.729 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-15T22:12:32.763 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-15T22:12:32.798 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-15T22:12:32.807 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-15T22:12:32.837 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-15T22:12:32.873 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-15T22:12:32.888 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-15T22:12:32.926 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-15T22:12:32.926 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-15T22:12:32.965 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-15T22:12:32.968 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-15T22:12:33.012 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-15T22:12:33.044 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-15T22:12:33.072 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-15T22:12:33.123 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-15T22:12:33.143 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-15T22:12:33.188 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-15T22:12:33.204 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-15T22:12:33.233 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-15T22:12:33.242 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-15T22:12:33.277 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-15T22:12:33.316 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-15T22:12:33.349 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-15T22:12:33.355 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-15T22:12:33.383 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-15T22:12:33.388 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-15T22:12:33.432 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-15T22:12:33.435 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-15T22:12:33.460 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-15T22:12:33.471 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-15T22:12:33.514 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-15T22:12:33.542 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-15T22:12:33.565 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-15T22:12:33.584 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-15T22:12:33.670 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-15T22:12:33.700 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-15T22:12:33.742 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-15T22:12:33.783 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-15T22:12:33.833 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-15T22:12:33.887 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-15T22:12:34.108 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-15T22:12:34.142 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-15T22:12:34.182 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-15T22:12:34.208 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-15T22:12:34.233 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-15T22:12:34.308 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-15T22:12:34.433 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-15T22:12:34.448 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-15T22:12:34.473 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-15T22:12:34.503 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-15T22:12:34.534 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-15T22:12:34.535 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-15T22:12:34.568 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-15T22:12:34.574 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-15T22:12:34.606 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-15T22:12:34.612 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-15T22:12:34.636 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-15T22:12:34.650 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-15T22:12:34.671 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-15T22:12:34.692 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-15T22:12:34.704 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-15T22:12:34.746 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-15T22:12:34.772 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-15T22:12:34.858 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-15T22:12:34.865 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-15T22:12:34.902 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-15T22:12:34.928 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-15T22:12:34.933 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-15T22:12:34.984 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-15T22:12:35.036 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-15T22:12:35.067 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-15T22:12:35.085 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-15T22:12:35.104 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-15T22:12:35.140 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-15T22:12:35.188 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-15T22:12:35.223 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-15T22:12:35.267 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-15T22:12:35.317 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-15T22:12:35.338 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2024-09-15T22:12:35.461 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-15T22:12:35.485 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-15T22:12:35.627 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-15T22:12:35.678 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-15T22:12:35.686 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-15T22:12:35.786 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-15T22:12:35.807 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-15T22:12:35.818 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-15T22:12:35.858 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-15T22:12:35.871 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-15T22:12:35.873 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-15T22:12:35.883 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-15T22:12:35.907 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-15T22:12:35.908 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-15T22:12:35.913 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-15T22:12:35.945 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-15T22:12:36.005 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-15T22:12:36.006 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-15T22:12:36.015 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-15T22:12:36.062 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-15T22:12:36.108 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-15T22:12:36.148 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-15T22:12:36.182 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-15T22:12:36.185 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-15T22:12:36.210 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-15T22:12:36.227 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-15T22:12:36.244 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-15T22:12:36.284 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-15T22:12:36.324 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-15T22:12:36.353 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-15T22:12:36.387 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-15T22:12:36.388 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-15T22:12:36.410 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-15T22:12:36.421 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-15T22:12:36.441 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-15T22:12:36.471 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-15T22:12:36.508 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-15T22:12:36.518 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-15T22:12:36.528 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:12:36.598 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-15T22:12:36.647 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-15T22:12:36.676 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:12:36.677 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-15T22:12:36.704 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:12:36.786 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-15T22:12:36.818 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:12:36.837 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-15T22:12:36.861 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:12:37.089 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-15T22:12:37.158 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-15T22:12:37.166 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-15T22:12:37.200 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:12:37.263 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-15T22:12:37.328 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:12:37.359 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T22:12:37.425 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T22:12:37.452 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T22:12:37.494 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T22:12:37.606 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-15T22:12:37.650 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-15T22:12:37.684 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-15T22:12:37.703 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T22:12:37.789 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-15T22:12:37.840 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-15T22:12:37.885 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-15T22:12:37.916 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T22:12:37.976 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-15T22:12:38.020 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-15T22:12:38.084 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-15T22:12:38.213 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:12:38.213 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-15T22:12:38.242 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-15T22:12:38.323 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-15T22:12:38.344 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:12:38.475 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-15T22:12:38.563 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-15T22:12:38.590 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-15T22:12:38.624 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-15T22:12:38.639 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:12:38.782 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-15T22:12:38.898 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-15T22:12:38.924 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-15T22:12:38.961 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:12:38.970 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-15T22:12:39.009 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-15T22:12:39.021 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-15T22:12:39.052 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:12:39.083 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-15T22:12:39.105 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-15T22:12:39.119 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-15T22:12:39.128 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-15T22:12:39.166 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-15T22:12:39.212 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-15T22:12:39.267 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-15T22:12:39.305 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-15T22:12:39.339 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-15T22:12:39.456 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-15T22:12:39.519 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-15T22:12:39.551 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-15T22:12:39.598 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-15T22:12:39.601 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-15T22:12:39.640 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:12:39.689 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-15T22:12:39.711 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:12:39.738 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-15T22:12:39.741 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-15T22:12:39.794 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-15T22:12:39.838 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-15T22:12:39.928 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-15T22:12:39.981 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-15T22:12:40.076 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-15T22:12:40.247 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-15T22:12:40.310 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-15T22:12:40.430 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-15T22:12:40.521 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-15T22:12:40.566 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-15T22:12:40.598 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-15T22:12:40.926 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-15T22:12:40.970 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:12:40.989 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-15T22:12:41.061 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:12:41.096 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-15T22:12:41.144 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-15T22:12:41.175 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-15T22:12:41.188 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-15T22:12:41.211 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-15T22:12:41.226 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-15T22:12:41.280 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-15T22:12:41.488 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-15T22:12:41.591 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-15T22:12:41.661 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-15T22:12:41.730 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-15T22:12:41.747 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-15T22:12:41.764 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:12:41.783 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-15T22:12:41.836 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:12:41.837 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-15T22:12:41.866 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-15T22:12:41.904 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-15T22:12:41.944 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-15T22:12:41.990 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-15T22:12:42.026 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:12:42.040 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-15T22:12:42.054 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:12:42.221 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-15T22:12:42.273 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-15T22:12:42.317 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-15T22:12:42.447 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-15T22:12:42.498 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-15T22:12:42.548 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-15T22:12:42.578 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-15T22:12:42.602 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:12:42.628 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-15T22:12:42.633 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:12:42.725 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:12:42.725 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-15T22:12:42.726 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-15T22:12:42.726 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-15T22:12:42.748 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-15T22:12:42.768 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:12:42.911 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-15T22:12:42.952 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-15T22:12:43.032 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-15T22:12:43.079 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-15T22:12:43.124 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-15T22:12:43.162 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-15T22:12:43.208 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-15T22:12:43.272 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-15T22:12:43.318 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-15T22:12:43.361 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-15T22:12:43.393 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-15T22:12:43.513 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-15T22:12:43.569 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-15T22:12:43.605 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-15T22:12:43.732 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-15T22:12:43.811 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-15T22:12:44.270 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:12:44.304 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:12:44.763 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-15T22:12:44.820 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-15T22:12:44.854 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-15T22:12:44.884 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:12:44.924 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:12:44.973 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-15T22:12:45.006 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:12:45.006 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-15T22:12:45.007 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-15T22:12:45.007 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-15T22:12:45.033 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:12:45.067 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-15T22:12:45.132 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-15T22:12:45.242 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-15T22:12:45.280 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-15T22:12:45.528 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-15T22:12:45.561 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-15T22:12:45.658 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-15T22:12:46.509 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-15T22:12:46.646 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-15T22:12:48.283 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-15T22:12:48.410 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-15T22:12:48.452 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-15T22:12:48.485 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-15T22:12:48.845 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-15T22:12:48.896 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:12:49.017 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:12:49.052 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-15T22:12:49.134 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-15T22:12:49.689 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-15T22:12:49.715 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:12:49.807 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:12:49.836 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-15T22:12:52.485 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:12:52.532 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:12:53.199 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:12:53.411 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:12:53.525 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:12:53.525 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-15T22:12:53.525 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-15T22:12:53.525 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:12:53.615 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:12:54.730 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:12:54.730 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /sys 2024-09-15T22:12:54.730 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /proc 2024-09-15T22:12:54.730 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /mnt 2024-09-15T22:12:54.731 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /var/tmp 2024-09-15T22:12:54.731 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /home 2024-09-15T22:12:54.731 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /root 2024-09-15T22:12:54.731 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /tmp 2024-09-15T22:12:54.731 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-15T22:12:54.907 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:12:54.922 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:12:54.922 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:12:54.923 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-15T22:12:54.923 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-15T22:12:56.384 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:12:56.411 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:12:56.411 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:12:56.411 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-15T22:12:56.411 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:12:56.411 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:12:56.411 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-15T22:12:56.635 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:12:56.659 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:12:56.659 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:12:56.659 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-15T22:12:56.659 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:12:56.660 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:12:56.660 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-15T22:12:57.094 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:12:57.118 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:12:57.118 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:12:57.118 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-15T22:12:57.118 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:12:57.119 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:12:57.119 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-15T22:12:57.224 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-15T22:12:57.281 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-15T22:12:57.336 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-15T22:12:57.360 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:12:57.360 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /sys 2024-09-15T22:12:57.360 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /proc 2024-09-15T22:12:57.360 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /mnt 2024-09-15T22:12:57.360 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /var/tmp 2024-09-15T22:12:57.360 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /home 2024-09-15T22:12:57.360 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /root 2024-09-15T22:12:57.360 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /tmp 2024-09-15T22:12:57.360 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-15T22:12:57.530 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-15T22:12:57.543 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:12:57.559 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:12:57.559 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:12:57.559 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-15T22:12:57.559 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-15T22:12:57.579 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-15T22:12:57.656 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-15T22:12:57.752 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-15T22:12:57.883 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-15T22:12:57.929 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-15T22:12:57.969 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-15T22:12:57.997 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-15T22:12:58.419 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:12:58.446 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:12:58.477 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-15T22:12:58.540 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-15T22:12:58.569 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:12:59.096 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:12:59.123 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:12:59.123 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:12:59.123 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-15T22:12:59.123 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:12:59.123 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:12:59.123 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-15T22:12:59.354 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:12:59.378 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:12:59.378 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:12:59.378 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-15T22:12:59.378 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:12:59.378 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:12:59.378 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-15T22:12:59.611 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:12:59.646 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:12:59.841 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:12:59.862 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:12:59.862 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:12:59.862 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-15T22:12:59.862 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:12:59.862 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:12:59.863 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-15T22:12:59.969 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-15T22:13:00.028 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-15T22:13:00.092 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-15T22:13:00.285 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-15T22:13:00.340 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-15T22:13:00.421 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-15T22:13:00.519 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-15T22:13:00.604 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:13:00.638 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:13:00.662 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-15T22:13:00.715 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-15T22:13:00.739 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:13:00.747 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-15T22:13:00.774 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-15T22:13:00.909 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-15T22:13:00.940 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:13:00.964 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:13:00.964 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:13:00.964 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-15T22:13:00.964 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:13:00.964 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:13:00.965 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-15T22:13:01.008 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:13:01.019 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:13:01.117 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-15T22:13:01.164 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-15T22:13:01.245 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:13:01.273 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:13:01.305 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-15T22:13:01.377 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-15T22:13:01.412 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:13:02.088 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-15T22:13:02.127 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:13:02.151 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:13:02.151 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:13:02.151 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-15T22:13:02.151 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:13:02.151 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:13:02.151 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-15T22:13:02.194 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:13:02.217 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:13:02.217 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:13:02.217 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-15T22:13:02.217 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-15T22:13:02.261 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:13:02.284 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:13:02.285 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:13:02.285 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-15T22:13:02.285 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:13:02.285 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:13:02.285 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-15T22:13:02.522 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:13:02.564 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:13:02.587 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:13:02.611 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:13:02.611 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:13:02.611 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-15T22:13:02.611 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:13:02.612 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:13:02.612 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-15T22:13:03.583 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:13:03.614 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:13:03.722 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:13:03.892 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-15T22:13:03.925 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:13:03.949 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:13:03.952 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:13:03.952 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-15T22:13:03.952 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:13:03.952 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:13:03.952 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-15T22:13:04.000 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:13:04.012 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:13:04.122 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-15T22:13:04.184 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-15T22:13:05.162 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-15T22:13:05.195 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:13:05.218 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:13:05.219 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:13:05.219 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-15T22:13:05.219 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:13:05.219 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:13:05.219 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-15T22:13:05.261 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:13:05.285 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:13:05.285 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:13:05.285 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-15T22:13:05.285 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-15T22:13:05.337 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:13:05.361 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:13:05.361 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:13:05.361 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-15T22:13:05.361 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:13:05.361 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:13:05.361 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-15T22:13:05.680 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:13:05.703 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:13:05.703 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:13:05.704 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-15T22:13:05.704 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:13:05.704 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:13:05.704 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-15T22:13:06.781 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:13:06.782 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /sys 2024-09-15T22:13:06.782 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /proc 2024-09-15T22:13:06.782 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /mnt 2024-09-15T22:13:06.782 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /var/tmp 2024-09-15T22:13:06.782 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /home 2024-09-15T22:13:06.782 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /root 2024-09-15T22:13:06.783 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /tmp 2024-09-15T22:13:06.783 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:13:07.014 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:13:07.050 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:13:07.050 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:13:07.050 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-15T22:13:07.050 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:13:07.132 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-15T22:13:07.174 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-15T22:13:07.214 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-15T22:13:07.247 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-15T22:13:07.274 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-15T22:13:07.452 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-15T22:13:07.496 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-15T22:13:07.526 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-15T22:13:07.556 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-15T22:13:07.602 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-15T22:13:08.181 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:13:08.217 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:13:08.237 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:13:08.719 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:13:08.778 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:13:08.778 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:13:08.778 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-15T22:13:08.778 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:13:08.778 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:13:08.778 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:13:09.044 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:13:09.066 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-15T22:13:09.095 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:13:09.095 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:13:09.095 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-15T22:13:09.095 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:13:09.095 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:13:09.095 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:13:09.182 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-15T22:13:09.229 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-15T22:13:09.309 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-15T22:13:09.342 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-15T22:13:09.367 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-15T22:13:09.394 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-15T22:13:09.394 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:13:09.478 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:13:09.478 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:13:09.562 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:13:09.587 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-15T22:13:09.592 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:13:09.592 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:13:09.603 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:13:09.654 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:13:09.654 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:13:09.654 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-15T22:13:09.654 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:13:09.654 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:13:09.654 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:13:09.772 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:13:09.773 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:13:09.787 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-15T22:13:09.856 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:13:09.873 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-15T22:13:09.920 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:13:09.946 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-15T22:13:10.191 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-15T22:13:10.249 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-15T22:13:10.338 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-15T22:13:10.447 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-15T22:13:10.541 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-15T22:13:10.591 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-15T22:13:10.625 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-15T22:13:10.632 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-15T22:13:10.664 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-15T22:13:10.681 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-15T22:13:10.691 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-15T22:13:10.721 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-15T22:13:10.746 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-15T22:13:10.884 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-15T22:13:10.938 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-15T22:13:10.968 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-15T22:13:10.998 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-15T22:13:11.044 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-15T22:13:11.323 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:13:11.363 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:13:11.396 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-15T22:13:11.525 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-15T22:13:11.560 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:13:11.648 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:13:11.691 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:13:11.712 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:13:12.631 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-15T22:13:12.721 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-15T22:13:12.764 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-15T22:13:12.860 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:13:12.872 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-15T22:13:12.904 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:13:12.907 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-15T22:13:12.932 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-15T22:13:12.958 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-15T22:13:12.958 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:13:13.043 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:13:13.043 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:13:13.135 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:13:13.160 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-15T22:13:13.165 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:13:13.166 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:13:13.353 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:13:13.353 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:13:13.446 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:13:13.513 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:13:14.055 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:13:14.087 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:13:14.232 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:13:14.462 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-15T22:13:14.489 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:13:14.541 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:13:14.541 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:13:14.541 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-15T22:13:14.541 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:13:14.541 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:13:14.541 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:13:14.598 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:13:14.624 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:13:14.736 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-15T22:13:14.809 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-15T22:13:15.692 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:13:15.692 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-15T22:13:15.692 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-15T22:13:15.692 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-15T22:13:15.692 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-15T22:13:15.692 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-15T22:13:15.692 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-15T22:13:15.692 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-15T22:13:15.692 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:13:15.693 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:13:15.693 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:13:15.693 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-15T22:13:15.693 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-15T22:13:15.693 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:13:15.693 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-15T22:13:15.693 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-15T22:13:15.693 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-15T22:13:15.693 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-15T22:13:15.693 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-15T22:13:15.693 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-15T22:13:15.693 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-15T22:13:15.694 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-15T22:13:15.694 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-15T22:13:15.694 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-15T22:13:15.694 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-15T22:13:15.694 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-15T22:13:15.694 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-15T22:13:15.694 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-15T22:13:15.694 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-15T22:13:15.694 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-15T22:13:15.706 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-15T22:13:15.706 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-15T22:13:15.707 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-15T22:13:15.707 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-15T22:13:15.707 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-15T22:13:15.707 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-15T22:13:15.707 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-15T22:13:15.707 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-15T22:13:15.707 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-15T22:13:15.707 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-15T22:13:15.707 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-15T22:13:15.707 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-15T22:13:15.707 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-15T22:13:15.707 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-15T22:13:15.708 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-15T22:13:15.708 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-15T22:13:15.708 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-15T22:13:15.708 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-15T22:13:15.708 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-15T22:13:15.708 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-15T22:13:15.708 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-15T22:13:15.708 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-15T22:13:15.708 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-15T22:13:15.708 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-15T22:13:15.708 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-15T22:13:15.709 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-15T22:13:15.709 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-15T22:13:15.709 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-15T22:13:15.709 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-15T22:13:15.709 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-15T22:13:15.709 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-15T22:13:15.709 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-15T22:13:15.709 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-15T22:13:15.709 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-15T22:13:15.709 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-15T22:13:15.709 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-15T22:13:15.709 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-15T22:13:15.709 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-15T22:13:15.710 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-15T22:13:15.710 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-15T22:13:15.710 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-15T22:13:15.710 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-15T22:13:15.710 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-15T22:13:15.710 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-15T22:13:15.710 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-15T22:13:15.710 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-15T22:13:15.710 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-15T22:13:15.710 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-15T22:13:15.710 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-15T22:13:15.710 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-15T22:13:15.711 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-15T22:13:15.711 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-15T22:13:15.711 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-15T22:13:15.711 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-15T22:13:15.711 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-15T22:13:15.711 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-15T22:13:15.711 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-15T22:13:15.711 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-15T22:13:15.711 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-15T22:13:15.711 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-15T22:13:15.711 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-15T22:13:15.712 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-15T22:13:15.712 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-15T22:13:15.712 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-15T22:13:15.712 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-15T22:13:15.712 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-15T22:13:15.712 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-15T22:13:15.712 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-15T22:13:15.712 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-15T22:13:15.712 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-15T22:13:15.712 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-15T22:13:15.712 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-15T22:13:15.712 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-15T22:13:15.712 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-15T22:13:15.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-15T22:13:15.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-15T22:13:15.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-15T22:13:15.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-15T22:13:15.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-15T22:13:15.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-15T22:13:15.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-15T22:13:15.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-15T22:13:15.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-15T22:13:15.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-15T22:13:15.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-15T22:13:15.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-15T22:13:15.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-15T22:13:15.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-15T22:13:15.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-15T22:13:15.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-15T22:13:15.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-15T22:13:15.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-15T22:13:15.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-15T22:13:15.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-15T22:13:15.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-15T22:13:15.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-15T22:13:15.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-15T22:13:15.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-15T22:13:15.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-15T22:13:15.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-15T22:13:15.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-15T22:13:15.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-15T22:13:15.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-15T22:13:15.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-15T22:13:15.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-15T22:13:15.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-15T22:13:15.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-15T22:13:15.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-15T22:13:15.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-15T22:13:15.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-15T22:13:15.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-15T22:13:15.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-15T22:13:15.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-15T22:13:15.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-15T22:13:15.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-15T22:13:15.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-15T22:13:15.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-15T22:13:15.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-15T22:13:15.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-15T22:13:15.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-15T22:13:15.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-15T22:13:15.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-15T22:13:15.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-15T22:13:15.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-15T22:13:15.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-15T22:13:15.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-15T22:13:15.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-15T22:13:15.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-15T22:13:15.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-15T22:13:15.717 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-15T22:13:15.717 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-15T22:13:15.717 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-15T22:13:15.717 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-15T22:13:15.717 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-15T22:13:15.870 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-15T22:13:15.926 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:13:15.977 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:13:15.977 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:13:15.977 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-15T22:13:15.978 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:13:15.978 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:13:15.978 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:13:16.043 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:13:16.093 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:13:16.093 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:13:16.093 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-15T22:13:16.093 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:13:16.152 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:13:16.203 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:13:16.204 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:13:16.204 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-15T22:13:16.204 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:13:16.204 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:13:16.204 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:13:16.569 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:13:16.621 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:13:16.621 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:13:16.621 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-15T22:13:16.621 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:13:16.621 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:13:16.621 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:13:18.387 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:13:18.387 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-15T22:13:18.387 INFO:teuthology.orchestra.run.smithi098.stdout:Upgraded: 2024-09-15T22:13:18.387 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-15T22:13:18.387 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-15T22:13:18.387 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-15T22:13:18.387 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-15T22:13:18.387 INFO:teuthology.orchestra.run.smithi098.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:18.388 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:18.388 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-15T22:13:18.388 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-15T22:13:18.388 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-15T22:13:18.388 INFO:teuthology.orchestra.run.smithi098.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-15T22:13:18.388 INFO:teuthology.orchestra.run.smithi098.stdout: automake-1.16.2-8.el9.noarch 2024-09-15T22:13:18.388 INFO:teuthology.orchestra.run.smithi098.stdout: bison-3.7.4-5.el9.x86_64 2024-09-15T22:13:18.388 INFO:teuthology.orchestra.run.smithi098.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-15T22:13:18.388 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:18.388 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:18.388 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:18.388 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:18.389 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:13:18.389 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:18.389 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:18.389 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:18.389 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:13:18.389 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:13:18.389 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:13:18.389 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:13:18.389 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:13:18.389 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:18.389 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:18.389 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:13:18.390 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:18.390 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:18.390 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:18.390 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:13:18.390 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:13:18.390 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:18.390 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:18.390 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:13:18.390 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-15T22:13:18.390 INFO:teuthology.orchestra.run.smithi098.stdout: flex-2.6.4-9.el9.x86_64 2024-09-15T22:13:18.390 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-15T22:13:18.390 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-15T22:13:18.391 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-15T22:13:18.391 INFO:teuthology.orchestra.run.smithi098.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-15T22:13:18.391 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-15T22:13:18.391 INFO:teuthology.orchestra.run.smithi098.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-15T22:13:18.391 INFO:teuthology.orchestra.run.smithi098.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-15T22:13:18.391 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-15T22:13:18.391 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-15T22:13:18.391 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:18.391 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:18.391 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:18.391 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-15T22:13:18.392 INFO:teuthology.orchestra.run.smithi098.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-15T22:13:18.392 INFO:teuthology.orchestra.run.smithi098.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-15T22:13:18.392 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-15T22:13:18.392 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-15T22:13:18.392 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:18.392 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:18.392 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-15T22:13:18.392 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:18.392 INFO:teuthology.orchestra.run.smithi098.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-15T22:13:18.392 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-15T22:13:18.392 INFO:teuthology.orchestra.run.smithi098.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-15T22:13:18.393 INFO:teuthology.orchestra.run.smithi098.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-15T22:13:18.393 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-15T22:13:18.393 INFO:teuthology.orchestra.run.smithi098.stdout: lua-5.4.4-4.el9.x86_64 2024-09-15T22:13:18.393 INFO:teuthology.orchestra.run.smithi098.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-15T22:13:18.393 INFO:teuthology.orchestra.run.smithi098.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-15T22:13:18.393 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-15T22:13:18.393 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-15T22:13:18.393 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-15T22:13:18.393 INFO:teuthology.orchestra.run.smithi098.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-15T22:13:18.393 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-13.16-1.el9.x86_64 2024-09-15T22:13:18.393 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-15T22:13:18.393 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-15T22:13:18.393 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-15T22:13:18.394 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-15T22:13:18.394 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-15T22:13:18.394 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-15T22:13:18.394 INFO:teuthology.orchestra.run.smithi098.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-15T22:13:18.394 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-15T22:13:18.394 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-15T22:13:18.394 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-15T22:13:18.394 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:18.394 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:18.394 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:18.394 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-15T22:13:18.394 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-15T22:13:18.395 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-15T22:13:18.395 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-15T22:13:18.395 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-15T22:13:18.395 INFO:teuthology.orchestra.run.smithi098.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-15T22:13:18.395 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-15T22:13:18.395 INFO:teuthology.orchestra.run.smithi098.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-15T22:13:18.395 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-15T22:13:18.395 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-15T22:13:18.395 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-15T22:13:18.395 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-15T22:13:18.395 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-15T22:13:18.395 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-15T22:13:18.396 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-15T22:13:18.396 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-15T22:13:18.396 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-15T22:13:18.396 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-15T22:13:18.396 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-15T22:13:18.396 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-15T22:13:18.396 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-15T22:13:18.396 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-15T22:13:18.396 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-15T22:13:18.396 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-15T22:13:18.396 INFO:teuthology.orchestra.run.smithi098.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-15T22:13:18.397 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-15T22:13:18.397 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-15T22:13:18.397 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-15T22:13:18.397 INFO:teuthology.orchestra.run.smithi098.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-15T22:13:18.397 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-15T22:13:18.397 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ply-3.11-14.el9.noarch 2024-09-15T22:13:18.397 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-15T22:13:18.397 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-15T22:13:18.397 INFO:teuthology.orchestra.run.smithi098.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-15T22:13:18.397 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-15T22:13:18.397 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-15T22:13:18.397 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-15T22:13:18.398 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-15T22:13:18.398 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-15T22:13:18.398 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-15T22:13:18.398 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:18.398 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:18.398 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-15T22:13:18.398 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-15T22:13:18.398 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-15T22:13:18.398 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:18.398 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-15T22:13:18.398 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-15T22:13:18.398 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-15T22:13:18.398 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-15T22:13:18.398 INFO:teuthology.orchestra.run.smithi098.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-15T22:13:18.398 INFO:teuthology.orchestra.run.smithi098.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-15T22:13:18.399 INFO:teuthology.orchestra.run.smithi098.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-15T22:13:18.399 INFO:teuthology.orchestra.run.smithi098.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-15T22:13:18.399 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-15T22:13:18.399 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-15T22:13:18.399 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-15T22:13:18.399 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-15T22:13:18.399 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-15T22:13:18.399 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-15T22:13:18.399 INFO:teuthology.orchestra.run.smithi098.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-15T22:13:18.399 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:18.399 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:18.399 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:18.399 INFO:teuthology.orchestra.run.smithi098.stdout: re2-1:20211101-20.el9.x86_64 2024-09-15T22:13:18.399 INFO:teuthology.orchestra.run.smithi098.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-15T22:13:18.399 INFO:teuthology.orchestra.run.smithi098.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-15T22:13:18.400 INFO:teuthology.orchestra.run.smithi098.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-15T22:13:18.400 INFO:teuthology.orchestra.run.smithi098.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-15T22:13:18.400 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-15T22:13:18.400 INFO:teuthology.orchestra.run.smithi098.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-15T22:13:18.400 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-15T22:13:18.400 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-15T22:13:18.837 DEBUG:teuthology.parallel:result is None 2024-09-15T22:13:19.113 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:13:19.113 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-15T22:13:19.113 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-15T22:13:19.113 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-15T22:13:19.113 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-15T22:13:19.113 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-15T22:13:19.113 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-15T22:13:19.113 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-15T22:13:19.113 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:13:19.113 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:13:19.113 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:13:19.113 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-15T22:13:19.114 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-15T22:13:19.114 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:13:19.114 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-15T22:13:19.114 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-15T22:13:19.114 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-15T22:13:19.114 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-15T22:13:19.114 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-15T22:13:19.114 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-15T22:13:19.114 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-15T22:13:19.114 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-15T22:13:19.114 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-15T22:13:19.114 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-15T22:13:19.114 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-15T22:13:19.114 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-15T22:13:19.126 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-15T22:13:19.126 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-15T22:13:19.126 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-15T22:13:19.126 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-15T22:13:19.126 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-15T22:13:19.126 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-15T22:13:19.127 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-15T22:13:19.127 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-15T22:13:19.127 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-15T22:13:19.127 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-15T22:13:19.127 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-15T22:13:19.127 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-15T22:13:19.127 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-15T22:13:19.127 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-15T22:13:19.127 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-15T22:13:19.127 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-15T22:13:19.127 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-15T22:13:19.127 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-15T22:13:19.127 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-15T22:13:19.127 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-15T22:13:19.127 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-15T22:13:19.128 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-15T22:13:19.128 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-15T22:13:19.128 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-15T22:13:19.128 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-15T22:13:19.128 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-15T22:13:19.128 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-15T22:13:19.128 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-15T22:13:19.128 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-15T22:13:19.128 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-15T22:13:19.128 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-15T22:13:19.128 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-15T22:13:19.128 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-15T22:13:19.128 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-15T22:13:19.128 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-15T22:13:19.129 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-15T22:13:19.129 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-15T22:13:19.129 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-15T22:13:19.129 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-15T22:13:19.129 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-15T22:13:19.129 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-15T22:13:19.129 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-15T22:13:19.129 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-15T22:13:19.129 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-15T22:13:19.129 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-15T22:13:19.129 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-15T22:13:19.129 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-15T22:13:19.129 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-15T22:13:19.129 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-15T22:13:19.129 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-15T22:13:19.130 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-15T22:13:19.130 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-15T22:13:19.130 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-15T22:13:19.130 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-15T22:13:19.130 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-15T22:13:19.130 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-15T22:13:19.130 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-15T22:13:19.130 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-15T22:13:19.130 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-15T22:13:19.130 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-15T22:13:19.130 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-15T22:13:19.130 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-15T22:13:19.130 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-15T22:13:19.130 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-15T22:13:19.130 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-15T22:13:19.130 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-15T22:13:19.131 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-15T22:13:19.131 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-15T22:13:19.131 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-15T22:13:19.131 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-15T22:13:19.131 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-15T22:13:19.131 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-15T22:13:19.131 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-15T22:13:19.131 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-15T22:13:19.131 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-15T22:13:19.131 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-15T22:13:19.131 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-15T22:13:19.131 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-15T22:13:19.131 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-15T22:13:19.131 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-15T22:13:19.131 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-15T22:13:19.132 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-15T22:13:19.132 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-15T22:13:19.132 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-15T22:13:19.132 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-15T22:13:19.132 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-15T22:13:19.132 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-15T22:13:19.132 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-15T22:13:19.132 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-15T22:13:19.132 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-15T22:13:19.132 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-15T22:13:19.132 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-15T22:13:19.132 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-15T22:13:19.132 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-15T22:13:19.132 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-15T22:13:19.133 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-15T22:13:19.133 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-15T22:13:19.133 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-15T22:13:19.133 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-15T22:13:19.133 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-15T22:13:19.133 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-15T22:13:19.133 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-15T22:13:19.133 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-15T22:13:19.133 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-15T22:13:19.133 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-15T22:13:19.133 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-15T22:13:19.133 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-15T22:13:19.133 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-15T22:13:19.133 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-15T22:13:19.133 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-15T22:13:19.134 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-15T22:13:19.134 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-15T22:13:19.134 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-15T22:13:19.134 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-15T22:13:19.134 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-15T22:13:19.134 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-15T22:13:19.134 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-15T22:13:19.134 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-15T22:13:19.134 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-15T22:13:19.134 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-15T22:13:19.134 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-15T22:13:19.134 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-15T22:13:19.134 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-15T22:13:19.134 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-15T22:13:19.135 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-15T22:13:19.135 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-15T22:13:19.135 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-15T22:13:19.135 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-15T22:13:19.135 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-15T22:13:19.135 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-15T22:13:19.135 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-15T22:13:19.135 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-15T22:13:19.135 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-15T22:13:19.135 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-15T22:13:19.135 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-15T22:13:19.135 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-15T22:13:19.135 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-15T22:13:19.135 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-15T22:13:21.823 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:13:21.823 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-15T22:13:21.823 INFO:teuthology.orchestra.run.smithi012.stdout:Upgraded: 2024-09-15T22:13:21.823 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-15T22:13:21.823 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-15T22:13:21.823 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-15T22:13:21.823 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-15T22:13:21.824 INFO:teuthology.orchestra.run.smithi012.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:21.824 INFO:teuthology.orchestra.run.smithi012.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:21.824 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-15T22:13:21.824 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-15T22:13:21.824 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2024-09-15T22:13:21.824 INFO:teuthology.orchestra.run.smithi012.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-15T22:13:21.824 INFO:teuthology.orchestra.run.smithi012.stdout: automake-1.16.2-8.el9.noarch 2024-09-15T22:13:21.824 INFO:teuthology.orchestra.run.smithi012.stdout: bison-3.7.4-5.el9.x86_64 2024-09-15T22:13:21.824 INFO:teuthology.orchestra.run.smithi012.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-15T22:13:21.824 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:21.824 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:21.824 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:21.825 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:21.825 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:13:21.825 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:21.825 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:21.825 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:21.825 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:13:21.825 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:13:21.825 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:13:21.825 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:13:21.825 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:13:21.825 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:21.825 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:21.825 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:13:21.826 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:21.826 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:21.826 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:21.826 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:13:21.826 INFO:teuthology.orchestra.run.smithi012.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:13:21.826 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:21.826 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:21.826 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:13:21.826 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-15T22:13:21.826 INFO:teuthology.orchestra.run.smithi012.stdout: flex-2.6.4-9.el9.x86_64 2024-09-15T22:13:21.826 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-15T22:13:21.826 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-15T22:13:21.827 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-15T22:13:21.827 INFO:teuthology.orchestra.run.smithi012.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-15T22:13:21.827 INFO:teuthology.orchestra.run.smithi012.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-15T22:13:21.827 INFO:teuthology.orchestra.run.smithi012.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-15T22:13:21.827 INFO:teuthology.orchestra.run.smithi012.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-15T22:13:21.827 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-15T22:13:21.827 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-15T22:13:21.827 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:21.827 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:21.827 INFO:teuthology.orchestra.run.smithi012.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:21.827 INFO:teuthology.orchestra.run.smithi012.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-15T22:13:21.827 INFO:teuthology.orchestra.run.smithi012.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-15T22:13:21.827 INFO:teuthology.orchestra.run.smithi012.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-15T22:13:21.828 INFO:teuthology.orchestra.run.smithi012.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-15T22:13:21.828 INFO:teuthology.orchestra.run.smithi012.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-15T22:13:21.828 INFO:teuthology.orchestra.run.smithi012.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:21.828 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:21.828 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-15T22:13:21.828 INFO:teuthology.orchestra.run.smithi012.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:21.828 INFO:teuthology.orchestra.run.smithi012.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-15T22:13:21.828 INFO:teuthology.orchestra.run.smithi012.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-15T22:13:21.828 INFO:teuthology.orchestra.run.smithi012.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-15T22:13:21.828 INFO:teuthology.orchestra.run.smithi012.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-15T22:13:21.828 INFO:teuthology.orchestra.run.smithi012.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-15T22:13:21.828 INFO:teuthology.orchestra.run.smithi012.stdout: lua-5.4.4-4.el9.x86_64 2024-09-15T22:13:21.828 INFO:teuthology.orchestra.run.smithi012.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-15T22:13:21.828 INFO:teuthology.orchestra.run.smithi012.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-15T22:13:21.829 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-15T22:13:21.829 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-15T22:13:21.829 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-15T22:13:21.829 INFO:teuthology.orchestra.run.smithi012.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-15T22:13:21.829 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-13.16-1.el9.x86_64 2024-09-15T22:13:21.829 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-15T22:13:21.829 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-15T22:13:21.829 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-15T22:13:21.829 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-15T22:13:21.829 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-15T22:13:21.829 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-15T22:13:21.829 INFO:teuthology.orchestra.run.smithi012.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-15T22:13:21.829 INFO:teuthology.orchestra.run.smithi012.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-15T22:13:21.830 INFO:teuthology.orchestra.run.smithi012.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-15T22:13:21.830 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-15T22:13:21.830 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:21.830 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:21.830 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:21.830 INFO:teuthology.orchestra.run.smithi012.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-15T22:13:21.830 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-15T22:13:21.830 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-15T22:13:21.830 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-15T22:13:21.830 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-15T22:13:21.830 INFO:teuthology.orchestra.run.smithi012.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-15T22:13:21.830 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-15T22:13:21.831 INFO:teuthology.orchestra.run.smithi012.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-15T22:13:21.831 INFO:teuthology.orchestra.run.smithi012.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-15T22:13:21.831 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-15T22:13:21.831 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-15T22:13:21.831 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-15T22:13:21.831 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-15T22:13:21.831 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-15T22:13:21.831 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-15T22:13:21.831 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-15T22:13:21.831 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-15T22:13:21.831 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-15T22:13:21.831 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-15T22:13:21.831 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-15T22:13:21.832 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-15T22:13:21.832 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-15T22:13:21.832 INFO:teuthology.orchestra.run.smithi012.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-15T22:13:21.832 INFO:teuthology.orchestra.run.smithi012.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-15T22:13:21.832 INFO:teuthology.orchestra.run.smithi012.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-15T22:13:21.832 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-15T22:13:21.832 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-15T22:13:21.832 INFO:teuthology.orchestra.run.smithi012.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-15T22:13:21.832 INFO:teuthology.orchestra.run.smithi012.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-15T22:13:21.832 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-15T22:13:21.832 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ply-3.11-14.el9.noarch 2024-09-15T22:13:21.832 INFO:teuthology.orchestra.run.smithi012.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-15T22:13:21.832 INFO:teuthology.orchestra.run.smithi012.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-15T22:13:21.832 INFO:teuthology.orchestra.run.smithi012.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-15T22:13:21.833 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-15T22:13:21.833 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-15T22:13:21.833 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-15T22:13:21.833 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-15T22:13:21.833 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-15T22:13:21.833 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-15T22:13:21.833 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:21.833 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:21.833 INFO:teuthology.orchestra.run.smithi012.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-15T22:13:21.833 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-15T22:13:21.833 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-15T22:13:21.833 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:21.833 INFO:teuthology.orchestra.run.smithi012.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-15T22:13:21.834 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-15T22:13:21.834 INFO:teuthology.orchestra.run.smithi012.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-15T22:13:21.834 INFO:teuthology.orchestra.run.smithi012.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-15T22:13:21.834 INFO:teuthology.orchestra.run.smithi012.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-15T22:13:21.834 INFO:teuthology.orchestra.run.smithi012.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-15T22:13:21.834 INFO:teuthology.orchestra.run.smithi012.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-15T22:13:21.834 INFO:teuthology.orchestra.run.smithi012.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-15T22:13:21.834 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-15T22:13:21.834 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-15T22:13:21.834 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-15T22:13:21.834 INFO:teuthology.orchestra.run.smithi012.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-15T22:13:21.834 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-15T22:13:21.834 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-15T22:13:21.834 INFO:teuthology.orchestra.run.smithi012.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-15T22:13:21.835 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:21.835 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:21.835 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:21.835 INFO:teuthology.orchestra.run.smithi012.stdout: re2-1:20211101-20.el9.x86_64 2024-09-15T22:13:21.835 INFO:teuthology.orchestra.run.smithi012.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-15T22:13:21.835 INFO:teuthology.orchestra.run.smithi012.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-15T22:13:21.835 INFO:teuthology.orchestra.run.smithi012.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-15T22:13:21.835 INFO:teuthology.orchestra.run.smithi012.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-15T22:13:21.835 INFO:teuthology.orchestra.run.smithi012.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-15T22:13:21.836 INFO:teuthology.orchestra.run.smithi012.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-15T22:13:21.836 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-15T22:13:21.836 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-15T22:13:21.858 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-15T22:13:21.901 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-15T22:13:21.945 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-15T22:13:21.997 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-15T22:13:22.033 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-15T22:13:22.281 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-15T22:13:22.338 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-15T22:13:22.390 DEBUG:teuthology.parallel:result is None 2024-09-15T22:13:22.393 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-15T22:13:22.424 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-15T22:13:22.468 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-15T22:13:23.275 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:13:23.324 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:13:23.367 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:13:24.745 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-15T22:13:24.880 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-15T22:13:24.936 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-15T22:13:25.053 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-15T22:13:25.090 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-15T22:13:25.132 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-15T22:13:25.177 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-15T22:13:25.177 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:13:25.293 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:13:25.293 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:13:25.402 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:13:25.426 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-15T22:13:25.442 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:13:25.442 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:13:25.696 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:13:25.696 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:13:25.814 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:13:25.891 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:13:26.101 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:13:26.101 INFO:teuthology.orchestra.run.smithi001.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-15T22:13:26.101 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:13:32.219 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-15T22:13:32.219 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-15T22:13:32.219 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-15T22:13:32.219 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-15T22:13:32.219 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-15T22:13:32.219 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-15T22:13:32.220 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-15T22:13:32.220 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:13:32.220 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:13:32.220 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:13:32.220 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-15T22:13:32.220 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-15T22:13:32.220 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:13:32.220 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-15T22:13:32.220 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-15T22:13:32.220 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-15T22:13:32.221 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-15T22:13:32.221 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-15T22:13:32.221 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-15T22:13:32.221 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-15T22:13:32.221 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-15T22:13:32.221 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-15T22:13:32.221 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-15T22:13:32.221 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-15T22:13:32.221 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-15T22:13:32.221 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-15T22:13:32.237 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-15T22:13:32.237 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-15T22:13:32.237 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-15T22:13:32.237 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-15T22:13:32.237 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-15T22:13:32.238 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-15T22:13:32.238 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-15T22:13:32.238 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-15T22:13:32.238 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-15T22:13:32.238 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-15T22:13:32.238 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-15T22:13:32.238 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-15T22:13:32.238 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-15T22:13:32.238 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-15T22:13:32.238 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-15T22:13:32.238 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-15T22:13:32.238 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-15T22:13:32.239 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-15T22:13:32.239 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-15T22:13:32.239 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-15T22:13:32.239 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-15T22:13:32.239 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-15T22:13:32.239 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-15T22:13:32.239 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-15T22:13:32.239 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-15T22:13:32.239 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-15T22:13:32.239 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-15T22:13:32.239 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-15T22:13:32.239 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-15T22:13:32.239 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-15T22:13:32.240 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-15T22:13:32.240 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-15T22:13:32.240 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-15T22:13:32.240 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-15T22:13:32.240 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-15T22:13:32.240 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-15T22:13:32.240 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-15T22:13:32.240 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-15T22:13:32.240 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-15T22:13:32.240 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-15T22:13:32.240 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-15T22:13:32.240 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-15T22:13:32.240 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-15T22:13:32.241 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-15T22:13:32.241 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-15T22:13:32.241 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-15T22:13:32.241 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-15T22:13:32.241 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-15T22:13:32.241 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-15T22:13:32.241 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-15T22:13:32.241 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-15T22:13:32.241 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-15T22:13:32.241 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-15T22:13:32.241 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-15T22:13:32.242 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-15T22:13:32.242 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-15T22:13:32.242 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-15T22:13:32.242 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-15T22:13:32.242 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-15T22:13:32.243 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-15T22:13:32.243 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-15T22:13:32.243 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-15T22:13:32.243 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-15T22:13:32.243 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-15T22:13:32.243 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-15T22:13:32.244 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-15T22:13:32.244 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-15T22:13:32.244 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-15T22:13:32.244 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-15T22:13:32.244 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-15T22:13:32.245 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-15T22:13:32.245 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-15T22:13:32.245 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-15T22:13:32.245 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-15T22:13:32.245 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-15T22:13:32.246 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-15T22:13:32.246 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-15T22:13:32.246 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-15T22:13:32.246 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-15T22:13:32.246 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-15T22:13:32.246 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-15T22:13:32.246 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-15T22:13:32.246 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-15T22:13:32.246 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-15T22:13:32.246 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-15T22:13:32.246 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-15T22:13:32.246 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-15T22:13:32.247 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-15T22:13:32.247 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-15T22:13:32.247 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-15T22:13:32.247 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-15T22:13:32.247 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-15T22:13:32.247 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-15T22:13:32.247 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-15T22:13:32.247 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-15T22:13:32.247 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-15T22:13:32.248 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-15T22:13:32.248 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-15T22:13:32.248 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-15T22:13:32.248 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-15T22:13:32.248 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-15T22:13:32.248 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-15T22:13:32.249 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-15T22:13:32.249 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-15T22:13:32.249 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-15T22:13:32.249 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-15T22:13:32.249 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-15T22:13:32.249 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-15T22:13:32.250 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-15T22:13:32.250 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-15T22:13:32.250 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-15T22:13:32.250 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-15T22:13:32.250 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-15T22:13:32.250 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-15T22:13:32.251 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-15T22:13:32.251 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-15T22:13:32.251 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-15T22:13:32.251 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-15T22:13:32.251 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-15T22:13:32.252 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-15T22:13:32.252 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-15T22:13:32.252 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-15T22:13:32.252 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-15T22:13:32.252 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-15T22:13:32.252 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-15T22:13:32.252 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-15T22:13:32.253 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-15T22:13:32.253 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-15T22:13:32.253 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-15T22:13:32.253 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-15T22:13:32.253 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-15T22:13:32.253 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-15T22:13:32.254 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-15T22:13:32.254 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-15T22:13:32.254 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-15T22:13:32.254 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-15T22:13:32.254 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-15T22:13:34.404 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:13:34.404 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:13:34.404 INFO:teuthology.orchestra.run.smithi001.stdout:Upgraded: 2024-09-15T22:13:34.404 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-15T22:13:34.404 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-15T22:13:34.405 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-15T22:13:34.405 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-15T22:13:34.405 INFO:teuthology.orchestra.run.smithi001.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:34.405 INFO:teuthology.orchestra.run.smithi001.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:34.405 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-15T22:13:34.405 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-15T22:13:34.405 INFO:teuthology.orchestra.run.smithi001.stdout:Installed: 2024-09-15T22:13:34.405 INFO:teuthology.orchestra.run.smithi001.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-15T22:13:34.405 INFO:teuthology.orchestra.run.smithi001.stdout: automake-1.16.2-8.el9.noarch 2024-09-15T22:13:34.405 INFO:teuthology.orchestra.run.smithi001.stdout: bison-3.7.4-5.el9.x86_64 2024-09-15T22:13:34.405 INFO:teuthology.orchestra.run.smithi001.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-15T22:13:34.406 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:34.406 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:34.406 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:34.406 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:34.406 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:13:34.406 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:34.406 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:34.406 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:34.406 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:13:34.406 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:13:34.406 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:13:34.406 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:13:34.406 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:13:34.407 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:34.407 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:34.407 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:13:34.407 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:34.407 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:34.407 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:34.407 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:13:34.407 INFO:teuthology.orchestra.run.smithi001.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:13:34.407 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:34.407 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:34.407 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:13:34.407 INFO:teuthology.orchestra.run.smithi001.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-15T22:13:34.407 INFO:teuthology.orchestra.run.smithi001.stdout: flex-2.6.4-9.el9.x86_64 2024-09-15T22:13:34.407 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-15T22:13:34.408 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-15T22:13:34.408 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-15T22:13:34.408 INFO:teuthology.orchestra.run.smithi001.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-15T22:13:34.408 INFO:teuthology.orchestra.run.smithi001.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-15T22:13:34.408 INFO:teuthology.orchestra.run.smithi001.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-15T22:13:34.408 INFO:teuthology.orchestra.run.smithi001.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-15T22:13:34.408 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-15T22:13:34.408 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-15T22:13:34.408 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:34.408 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:34.408 INFO:teuthology.orchestra.run.smithi001.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:34.408 INFO:teuthology.orchestra.run.smithi001.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-15T22:13:34.409 INFO:teuthology.orchestra.run.smithi001.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-15T22:13:34.409 INFO:teuthology.orchestra.run.smithi001.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-15T22:13:34.409 INFO:teuthology.orchestra.run.smithi001.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-15T22:13:34.409 INFO:teuthology.orchestra.run.smithi001.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-15T22:13:34.409 INFO:teuthology.orchestra.run.smithi001.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:34.409 INFO:teuthology.orchestra.run.smithi001.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:34.409 INFO:teuthology.orchestra.run.smithi001.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-15T22:13:34.409 INFO:teuthology.orchestra.run.smithi001.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:34.409 INFO:teuthology.orchestra.run.smithi001.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-15T22:13:34.409 INFO:teuthology.orchestra.run.smithi001.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-15T22:13:34.409 INFO:teuthology.orchestra.run.smithi001.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-15T22:13:34.409 INFO:teuthology.orchestra.run.smithi001.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-15T22:13:34.409 INFO:teuthology.orchestra.run.smithi001.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-15T22:13:34.410 INFO:teuthology.orchestra.run.smithi001.stdout: lua-5.4.4-4.el9.x86_64 2024-09-15T22:13:34.410 INFO:teuthology.orchestra.run.smithi001.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-15T22:13:34.410 INFO:teuthology.orchestra.run.smithi001.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-15T22:13:34.410 INFO:teuthology.orchestra.run.smithi001.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-15T22:13:34.410 INFO:teuthology.orchestra.run.smithi001.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-15T22:13:34.410 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-15T22:13:34.410 INFO:teuthology.orchestra.run.smithi001.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-15T22:13:34.410 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-13.16-1.el9.x86_64 2024-09-15T22:13:34.410 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-15T22:13:34.410 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-15T22:13:34.410 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-15T22:13:34.410 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-15T22:13:34.410 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-15T22:13:34.411 INFO:teuthology.orchestra.run.smithi001.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-15T22:13:34.411 INFO:teuthology.orchestra.run.smithi001.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-15T22:13:34.411 INFO:teuthology.orchestra.run.smithi001.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-15T22:13:34.411 INFO:teuthology.orchestra.run.smithi001.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-15T22:13:34.411 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-15T22:13:34.411 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:34.411 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:34.411 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:34.411 INFO:teuthology.orchestra.run.smithi001.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-15T22:13:34.411 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-15T22:13:34.411 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-15T22:13:34.411 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-15T22:13:34.411 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-15T22:13:34.412 INFO:teuthology.orchestra.run.smithi001.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-15T22:13:34.412 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-15T22:13:34.412 INFO:teuthology.orchestra.run.smithi001.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-15T22:13:34.412 INFO:teuthology.orchestra.run.smithi001.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-15T22:13:34.412 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-15T22:13:34.412 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-15T22:13:34.412 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-15T22:13:34.412 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-15T22:13:34.412 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-15T22:13:34.412 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-15T22:13:34.412 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-15T22:13:34.413 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-15T22:13:34.413 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-15T22:13:34.413 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-15T22:13:34.413 INFO:teuthology.orchestra.run.smithi001.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-15T22:13:34.413 INFO:teuthology.orchestra.run.smithi001.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-15T22:13:34.413 INFO:teuthology.orchestra.run.smithi001.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-15T22:13:34.413 INFO:teuthology.orchestra.run.smithi001.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-15T22:13:34.413 INFO:teuthology.orchestra.run.smithi001.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-15T22:13:34.413 INFO:teuthology.orchestra.run.smithi001.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-15T22:13:34.414 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-15T22:13:34.414 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-15T22:13:34.414 INFO:teuthology.orchestra.run.smithi001.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-15T22:13:34.414 INFO:teuthology.orchestra.run.smithi001.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-15T22:13:34.414 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-15T22:13:34.414 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ply-3.11-14.el9.noarch 2024-09-15T22:13:34.414 INFO:teuthology.orchestra.run.smithi001.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-15T22:13:34.414 INFO:teuthology.orchestra.run.smithi001.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-15T22:13:34.414 INFO:teuthology.orchestra.run.smithi001.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-15T22:13:34.414 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-15T22:13:34.414 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-15T22:13:34.414 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-15T22:13:34.415 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-15T22:13:34.415 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-15T22:13:34.415 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-15T22:13:34.415 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:34.415 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:34.415 INFO:teuthology.orchestra.run.smithi001.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-15T22:13:34.415 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-15T22:13:34.415 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-15T22:13:34.415 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:34.415 INFO:teuthology.orchestra.run.smithi001.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-15T22:13:34.415 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-15T22:13:34.415 INFO:teuthology.orchestra.run.smithi001.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-15T22:13:34.415 INFO:teuthology.orchestra.run.smithi001.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-15T22:13:34.415 INFO:teuthology.orchestra.run.smithi001.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-15T22:13:34.416 INFO:teuthology.orchestra.run.smithi001.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-15T22:13:34.416 INFO:teuthology.orchestra.run.smithi001.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-15T22:13:34.416 INFO:teuthology.orchestra.run.smithi001.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-15T22:13:34.416 INFO:teuthology.orchestra.run.smithi001.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-15T22:13:34.416 INFO:teuthology.orchestra.run.smithi001.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-15T22:13:34.416 INFO:teuthology.orchestra.run.smithi001.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-15T22:13:34.416 INFO:teuthology.orchestra.run.smithi001.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-15T22:13:34.416 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-15T22:13:34.416 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-15T22:13:34.416 INFO:teuthology.orchestra.run.smithi001.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-15T22:13:34.416 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:34.416 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:34.417 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:13:34.417 INFO:teuthology.orchestra.run.smithi001.stdout: re2-1:20211101-20.el9.x86_64 2024-09-15T22:13:34.417 INFO:teuthology.orchestra.run.smithi001.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-15T22:13:34.417 INFO:teuthology.orchestra.run.smithi001.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-15T22:13:34.417 INFO:teuthology.orchestra.run.smithi001.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-15T22:13:34.417 INFO:teuthology.orchestra.run.smithi001.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-15T22:13:34.417 INFO:teuthology.orchestra.run.smithi001.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-15T22:13:34.417 INFO:teuthology.orchestra.run.smithi001.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-15T22:13:34.418 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:13:34.418 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-09-15T22:13:35.040 DEBUG:teuthology.parallel:result is None 2024-09-15T22:13:35.041 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:13:35.189 DEBUG:teuthology.orchestra.run.smithi001:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-15T22:13:35.235 INFO:teuthology.orchestra.run.smithi001.stdout:19.1.1-326.g8921c8ef.el9 2024-09-15T22:13:35.236 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-15T22:13:35.236 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-15T22:13:35.238 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:13:35.377 DEBUG:teuthology.orchestra.run.smithi012:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-15T22:13:35.403 INFO:teuthology.orchestra.run.smithi012.stdout:19.1.1-326.g8921c8ef.el9 2024-09-15T22:13:35.404 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-15T22:13:35.404 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-15T22:13:35.406 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:13:35.546 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-15T22:13:35.573 INFO:teuthology.orchestra.run.smithi098.stdout:19.1.1-326.g8921c8ef.el9 2024-09-15T22:13:35.574 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-15T22:13:35.574 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-15T22:13:35.576 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-15T22:13:35.576 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T22:13:35.576 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T22:13:35.635 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-15T22:13:35.635 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T22:13:35.668 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-15T22:13:35.668 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T22:13:35.700 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-15T22:13:35.701 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T22:13:35.701 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T22:13:35.765 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T22:13:35.862 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-15T22:13:35.862 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T22:13:35.892 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T22:13:35.961 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-15T22:13:35.961 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T22:13:35.993 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T22:13:36.061 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-15T22:13:36.062 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T22:13:36.062 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T22:13:36.119 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T22:13:36.215 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-15T22:13:36.216 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T22:13:36.242 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T22:13:36.306 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-15T22:13:36.306 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T22:13:36.331 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T22:13:36.396 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-15T22:13:36.397 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T22:13:36.397 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T22:13:36.452 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T22:13:36.549 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-15T22:13:36.550 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T22:13:36.575 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T22:13:36.639 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-15T22:13:36.639 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T22:13:36.664 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T22:13:36.729 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-15T22:13:36.850 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'subvols': {'create': 2}} 2024-09-15T22:13:36.850 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:13:36.851 INFO:tasks.cephadm:Cluster fsid is c1228c44-73af-11ef-bceb-c7b262605968 2024-09-15T22:13:36.851 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-15T22:13:36.851 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.1', 'mon.b': '172.21.15.12', 'mon.c': '172.21.15.98'} 2024-09-15T22:13:36.851 INFO:tasks.cephadm:First mon is mon.a on smithi001 2024-09-15T22:13:36.852 INFO:tasks.cephadm:First mgr is x 2024-09-15T22:13:36.852 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-15T22:13:36.852 DEBUG:teuthology.orchestra.run.smithi001:> sudo hostname $(hostname -s) 2024-09-15T22:13:36.909 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname $(hostname -s) 2024-09-15T22:13:36.934 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname $(hostname -s) 2024-09-15T22:13:36.959 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-15T22:13:36.960 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:13:37.105 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56081/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-326-g8921c8ef', 'node_name': '172.21.5.31+adami01', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-326.g8921c8ef'}, 'url': 'https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-15 16:06:42.385367', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-15T22:13:37.244 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref squid, sha1 8921c8ef947807b717db041d85f0761b7914d5fc from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:13:37.246 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm 2024-09-15T22:13:37.246 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm 2024-09-15T22:13:37.246 DEBUG:teuthology.orchestra.run.smithi001:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-15T22:13:37.660 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-r--r--. 1 ubuntu ubuntu 784481 Sep 15 22:13 /home/ubuntu/cephtest/cephadm 2024-09-15T22:13:37.660 DEBUG:teuthology.orchestra.run.smithi012:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-15T22:13:38.017 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-r--r--. 1 ubuntu ubuntu 784481 Sep 15 22:13 /home/ubuntu/cephtest/cephadm 2024-09-15T22:13:38.017 DEBUG:teuthology.orchestra.run.smithi098:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-15T22:13:38.388 INFO:teuthology.orchestra.run.smithi098.stdout:-rw-r--r--. 1 ubuntu ubuntu 784481 Sep 15 22:13 /home/ubuntu/cephtest/cephadm 2024-09-15T22:13:38.388 DEBUG:teuthology.orchestra.run.smithi001:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-15T22:13:38.425 DEBUG:teuthology.orchestra.run.smithi012:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-15T22:13:38.445 DEBUG:teuthology.orchestra.run.smithi098:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-15T22:13:38.480 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc on all hosts... 2024-09-15T22:13:38.481 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc pull 2024-09-15T22:13:38.484 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc pull 2024-09-15T22:13:38.488 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc pull 2024-09-15T22:13:40.032 INFO:teuthology.orchestra.run.smithi098.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T22:13:40.045 INFO:teuthology.orchestra.run.smithi012.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T22:13:40.480 INFO:teuthology.orchestra.run.smithi001.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T22:14:10.674 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-15T22:14:10.675 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T22:14:10.675 INFO:teuthology.orchestra.run.smithi001.stdout: "image_id": "f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee", 2024-09-15T22:14:10.675 INFO:teuthology.orchestra.run.smithi001.stdout: "repo_digests": [ 2024-09-15T22:14:10.675 INFO:teuthology.orchestra.run.smithi001.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80" 2024-09-15T22:14:10.675 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-15T22:14:10.675 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-15T22:14:16.127 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-15T22:14:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T22:14:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: "image_id": "f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee", 2024-09-15T22:14:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: "repo_digests": [ 2024-09-15T22:14:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80" 2024-09-15T22:14:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-15T22:14:16.128 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-15T22:14:27.544 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-15T22:14:27.544 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T22:14:27.544 INFO:teuthology.orchestra.run.smithi012.stdout: "image_id": "f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee", 2024-09-15T22:14:27.545 INFO:teuthology.orchestra.run.smithi012.stdout: "repo_digests": [ 2024-09-15T22:14:27.545 INFO:teuthology.orchestra.run.smithi012.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80" 2024-09-15T22:14:27.545 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-15T22:14:27.545 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-15T22:14:27.569 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /etc/ceph 2024-09-15T22:14:27.635 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /etc/ceph 2024-09-15T22:14:27.662 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /etc/ceph 2024-09-15T22:14:27.695 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 777 /etc/ceph 2024-09-15T22:14:27.753 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 777 /etc/ceph 2024-09-15T22:14:27.778 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 777 /etc/ceph 2024-09-15T22:14:27.807 INFO:tasks.cephadm:Writing seed config... 2024-09-15T22:14:27.809 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-15T22:14:27.809 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-15T22:14:27.809 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-15T22:14:27.809 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-15T22:14:27.809 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-15T22:14:27.809 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-15T22:14:27.809 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-15T22:14:27.809 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-15T22:14:27.809 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-15T22:14:27.810 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-15T22:14:27.810 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-15T22:14:27.810 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-15T22:14:27.810 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-15T22:14:27.810 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-15T22:14:27.810 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-15T22:14:27.810 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-15T22:14:27.810 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-15T22:14:27.810 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-15T22:14:27.810 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-15T22:14:27.810 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-15T22:14:27.810 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-15T22:14:27.810 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-15T22:14:27.810 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-15T22:14:27.811 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-15T22:14:27.811 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-15T22:14:27.811 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-15T22:14:27.811 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-15T22:14:27.811 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-15T22:14:27.811 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-15T22:14:27.811 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-15T22:14:27.811 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-15T22:14:27.811 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-15T22:14:27.811 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-15T22:14:27.811 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-15T22:14:27.811 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-15T22:14:27.811 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-15T22:14:27.812 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-15T22:14:27.812 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-15T22:14:27.812 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-15T22:14:27.812 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-15T22:14:27.812 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-15T22:14:27.812 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-15T22:14:27.812 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-15T22:14:27.812 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-15T22:14:27.812 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-15T22:14:27.812 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-15T22:14:27.812 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-15T22:14:27.812 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-15T22:14:27.812 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-15T22:14:27.813 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T22:14:27.813 DEBUG:teuthology.orchestra.run.smithi001:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-15T22:14:27.849 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = c1228c44-73af-11ef-bceb-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-15T22:14:27.850 DEBUG:teuthology.orchestra.run.smithi001:mon.a> sudo journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mon.a.service 2024-09-15T22:14:27.894 DEBUG:teuthology.orchestra.run.smithi001:mgr.x> sudo journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mgr.x.service 2024-09-15T22:14:27.938 INFO:tasks.cephadm:Bootstrapping... 2024-09-15T22:14:27.938 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc -v bootstrap --fsid c1228c44-73af-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.1 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:14:28.203 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-09-15T22:14:28.203 INFO:teuthology.orchestra.run.smithi001.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc', '-v', 'bootstrap', '--fsid', 'c1228c44-73af-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.1', '--skip-admin-label'] 2024-09-15T22:14:28.203 INFO:teuthology.orchestra.run.smithi001.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-15T22:14:28.203 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying podman|docker is present... 2024-09-15T22:14:28.249 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stdout 5.2.2 2024-09-15T22:14:28.249 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying lvm2 is present... 2024-09-15T22:14:28.249 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying time synchronization is in place... 2024-09-15T22:14:28.263 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-15T22:14:28.263 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-15T22:14:28.275 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-15T22:14:28.275 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-15T22:14:28.289 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout enabled 2024-09-15T22:14:28.302 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout active 2024-09-15T22:14:28.302 INFO:teuthology.orchestra.run.smithi001.stdout:Unit chronyd.service is enabled and running 2024-09-15T22:14:28.302 INFO:teuthology.orchestra.run.smithi001.stdout:Repeating the final host check... 2024-09-15T22:14:28.345 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stdout 5.2.2 2024-09-15T22:14:28.345 INFO:teuthology.orchestra.run.smithi001.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-15T22:14:28.346 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl is present 2024-09-15T22:14:28.346 INFO:teuthology.orchestra.run.smithi001.stdout:lvcreate is present 2024-09-15T22:14:28.358 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-15T22:14:28.359 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-15T22:14:28.371 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-15T22:14:28.371 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-15T22:14:28.384 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout enabled 2024-09-15T22:14:28.397 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout active 2024-09-15T22:14:28.397 INFO:teuthology.orchestra.run.smithi001.stdout:Unit chronyd.service is enabled and running 2024-09-15T22:14:28.397 INFO:teuthology.orchestra.run.smithi001.stdout:Host looks OK 2024-09-15T22:14:28.397 INFO:teuthology.orchestra.run.smithi001.stdout:Cluster fsid: c1228c44-73af-11ef-bceb-c7b262605968 2024-09-15T22:14:28.397 INFO:teuthology.orchestra.run.smithi001.stdout:Acquiring lock 140021973992448 on /run/cephadm/c1228c44-73af-11ef-bceb-c7b262605968.lock 2024-09-15T22:14:28.398 INFO:teuthology.orchestra.run.smithi001.stdout:Lock 140021973992448 acquired on /run/cephadm/c1228c44-73af-11ef-bceb-c7b262605968.lock 2024-09-15T22:14:28.398 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying IP 172.21.15.1 port 3300 ... 2024-09-15T22:14:28.398 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying IP 172.21.15.1 port 6789 ... 2024-09-15T22:14:28.398 INFO:teuthology.orchestra.run.smithi001.stdout:Base mon IP(s) is [172.21.15.1:3300, 172.21.15.1:6789], mon addrv is [v2:172.21.15.1:3300,v1:172.21.15.1:6789] 2024-09-15T22:14:28.405 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.1 metric 100 2024-09-15T22:14:28.405 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.1 metric 100 2024-09-15T22:14:28.411 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-15T22:14:28.411 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-15T22:14:28.411 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1790sec hoplimit 64 pref medium 2024-09-15T22:14:28.417 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-15T22:14:28.417 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-15T22:14:28.417 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-15T22:14:28.417 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-15T22:14:28.417 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:15e8/64 scope link 2024-09-15T22:14:28.417 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-15T22:14:28.418 INFO:teuthology.orchestra.run.smithi001.stdout:Mon IP `172.21.15.1` is in CIDR network `172.21.0.0/20` 2024-09-15T22:14:28.418 INFO:teuthology.orchestra.run.smithi001.stdout:Mon IP `172.21.15.1` is in CIDR network `172.21.0.0/20` 2024-09-15T22:14:28.418 INFO:teuthology.orchestra.run.smithi001.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-15T22:14:28.419 INFO:teuthology.orchestra.run.smithi001.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-15T22:14:28.420 INFO:teuthology.orchestra.run.smithi001.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T22:14:28.928 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stdout f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee 2024-09-15T22:14:28.928 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T22:14:28.928 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Getting image source signatures 2024-09-15T22:14:28.928 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Copying blob sha256:c0574da0c3174f3dc49daa274908f97d06456bd6a3cfab87e94022c1369a83a6 2024-09-15T22:14:28.928 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-15T22:14:28.928 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Copying config sha256:f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee 2024-09-15T22:14:28.928 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-15T22:14:30.357 INFO:teuthology.orchestra.run.smithi001.stdout:ceph: stdout ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable) 2024-09-15T22:14:30.357 INFO:teuthology.orchestra.run.smithi001.stdout:Ceph version: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable) 2024-09-15T22:14:30.357 INFO:teuthology.orchestra.run.smithi001.stdout:Extracting ceph user uid/gid from container image... 2024-09-15T22:14:31.529 INFO:teuthology.orchestra.run.smithi001.stdout:stat: stdout 167 167 2024-09-15T22:14:31.529 INFO:teuthology.orchestra.run.smithi001.stdout:Creating initial keys... 2024-09-15T22:14:32.602 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph-authtool: stdout AQBHXOdmT53HNxAAEDyMMpkj4OJCmMPuU3wKQg== 2024-09-15T22:14:33.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph-authtool: stdout AQBJXOdmiY9vABAASzg0BjUXQO1bkz2u3PEu/g== 2024-09-15T22:14:34.873 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph-authtool: stdout AQBKXOdmmVY1ChAA9ibMDjhzgUFgIZKj+zHTKA== 2024-09-15T22:14:34.874 INFO:teuthology.orchestra.run.smithi001.stdout:Creating initial monmap... 2024-09-15T22:14:35.861 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-15T22:14:35.861 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-15T22:14:35.861 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to c1228c44-73af-11ef-bceb-c7b262605968 2024-09-15T22:14:35.861 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-15T22:14:35.861 INFO:teuthology.orchestra.run.smithi001.stdout:monmaptool for a [v2:172.21.15.1:3300,v1:172.21.15.1:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-15T22:14:35.861 INFO:teuthology.orchestra.run.smithi001.stdout:setting min_mon_release = quincy 2024-09-15T22:14:35.861 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: set fsid to c1228c44-73af-11ef-bceb-c7b262605968 2024-09-15T22:14:35.862 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-15T22:14:35.862 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:14:35.862 INFO:teuthology.orchestra.run.smithi001.stdout:Creating mon... 2024-09-15T22:14:36.933 INFO:teuthology.orchestra.run.smithi001.stdout:create mon.a on 2024-09-15T22:14:37.258 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-15T22:14:37.483 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-15T22:14:37.744 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-c1228c44-73af-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-c1228c44-73af-11ef-bceb-c7b262605968.target. 2024-09-15T22:14:37.745 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-c1228c44-73af-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-c1228c44-73af-11ef-bceb-c7b262605968.target. 2024-09-15T22:14:38.079 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c1228c44-73af-11ef-bceb-c7b262605968@mon.a 2024-09-15T22:14:38.079 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c1228c44-73af-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-c1228c44-73af-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-15T22:14:38.335 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c1228c44-73af-11ef-bceb-c7b262605968.target.wants/ceph-c1228c44-73af-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-c1228c44-73af-11ef-bceb-c7b262605968@.service. 2024-09-15T22:14:38.947 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:38 smithi001 podman[30450]: 2024-09-15 22:14:38.93890844 +0000 UTC m=+0.368405258 container init fcbe02a15093f92719c4fa420cc8b6d07979d1134b360357b8f7ad321f9a1c44 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731) 2024-09-15T22:14:38.947 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:38 smithi001 podman[30450]: 2024-09-15 22:14:38.945512807 +0000 UTC m=+0.375009625 container start fcbe02a15093f92719c4fa420cc8b6d07979d1134b360357b8f7ad321f9a1c44 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mon-a, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-15T22:14:39.076 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-15T22:14:39.076 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout disabled 2024-09-15T22:14:39.089 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-15T22:14:39.089 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-15T22:14:39.089 INFO:teuthology.orchestra.run.smithi001.stdout:firewalld.service is not enabled 2024-09-15T22:14:39.089 INFO:teuthology.orchestra.run.smithi001.stdout:Not possible to enable service . firewalld.service is not available 2024-09-15T22:14:39.089 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mon to start... 2024-09-15T22:14:39.089 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mon... 2024-09-15T22:14:39.225 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:39 smithi001 ceph-mon[30469]: mkfs c1228c44-73af-11ef-bceb-c7b262605968 2024-09-15T22:14:39.225 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:39 smithi001 ceph-mon[30469]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-15T22:14:39.225 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:39 smithi001 bash[30450]: fcbe02a15093f92719c4fa420cc8b6d07979d1134b360357b8f7ad321f9a1c44 2024-09-15T22:14:39.225 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:39 smithi001 systemd[1]: Started Ceph mon.a for c1228c44-73af-11ef-bceb-c7b262605968. 2024-09-15T22:14:40.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:40 smithi001 ceph-mon[30469]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-15T22:14:40.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:40 smithi001 ceph-mon[30469]: monmap epoch 1 2024-09-15T22:14:40.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:40 smithi001 ceph-mon[30469]: fsid c1228c44-73af-11ef-bceb-c7b262605968 2024-09-15T22:14:40.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:40 smithi001 ceph-mon[30469]: last_changed 2024-09-15T22:14:35.299044+0000 2024-09-15T22:14:40.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:40 smithi001 ceph-mon[30469]: created 2024-09-15T22:14:35.299044+0000 2024-09-15T22:14:40.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:40 smithi001 ceph-mon[30469]: min_mon_release 19 (squid) 2024-09-15T22:14:40.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:40 smithi001 ceph-mon[30469]: election_strategy: 1 2024-09-15T22:14:40.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:40 smithi001 ceph-mon[30469]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-15T22:14:40.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:40 smithi001 ceph-mon[30469]: fsmap 2024-09-15T22:14:40.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:40 smithi001 ceph-mon[30469]: osdmap e1: 0 total, 0 up, 0 in 2024-09-15T22:14:40.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:40 smithi001 ceph-mon[30469]: mgrmap e1: no daemons active 2024-09-15T22:14:40.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:40 smithi001 ceph-mon[30469]: from='client.? 172.21.15.1:0/2057895841' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-15T22:14:40.671 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout cluster: 2024-09-15T22:14:40.671 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout id: c1228c44-73af-11ef-bceb-c7b262605968 2024-09-15T22:14:40.671 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-15T22:14:40.672 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-15T22:14:40.672 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout services: 2024-09-15T22:14:40.672 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 1.00616s) 2024-09-15T22:14:40.672 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-15T22:14:40.672 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-15T22:14:40.672 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-15T22:14:40.672 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout data: 2024-09-15T22:14:40.672 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-15T22:14:40.672 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-15T22:14:40.672 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-15T22:14:40.672 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout pgs: 2024-09-15T22:14:40.672 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-15T22:14:40.672 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.931+0000 7fd93b200640 1 Processor -- start 2024-09-15T22:14:40.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.931+0000 7fd93b200640 1 -- start start 2024-09-15T22:14:40.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.931+0000 7fd93b200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd93c105dd0 0x7fd93c1061d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:40.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.931+0000 7fd93b200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd93c07bdd0 con 0x7fd93c105dd0 2024-09-15T22:14:40.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.932+0000 7fd939e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd93c105dd0 0x7fd93c1061d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:40.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.932+0000 7fd939e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd93c105dd0 0x7fd93c1061d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45894/0 (socket says 172.21.15.1:45894) 2024-09-15T22:14:40.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.932+0000 7fd939e00640 1 -- 172.21.15.1:0/3916335762 learned_addr learned my addr 172.21.15.1:0/3916335762 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:14:40.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.933+0000 7fd939e00640 1 -- 172.21.15.1:0/3916335762 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd93c106710 con 0x7fd93c105dd0 2024-09-15T22:14:40.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.935+0000 7fd939e00640 1 --2- 172.21.15.1:0/3916335762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd93c105dd0 0x7fd93c1061d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd92c009e80 tx=0x7fd92c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88c7f26bdadb6d6b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:40.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.935+0000 7fd939400640 1 -- 172.21.15.1:0/3916335762 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd92c036070 con 0x7fd93c105dd0 2024-09-15T22:14:40.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.936+0000 7fd939400640 1 -- 172.21.15.1:0/3916335762 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd92c031400 con 0x7fd93c105dd0 2024-09-15T22:14:40.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.936+0000 7fd939400640 1 -- 172.21.15.1:0/3916335762 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd92c031700 con 0x7fd93c105dd0 2024-09-15T22:14:40.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.936+0000 7fd93b200640 1 -- 172.21.15.1:0/3916335762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd93c105dd0 msgr2=0x7fd93c1061d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:40.674 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.936+0000 7fd93b200640 1 --2- 172.21.15.1:0/3916335762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd93c105dd0 0x7fd93c1061d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd92c009e80 tx=0x7fd92c02a7a0 comp rx=0 tx=0).stop 2024-09-15T22:14:40.674 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.936+0000 7fd93b200640 1 -- 172.21.15.1:0/3916335762 shutdown_connections 2024-09-15T22:14:40.674 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.936+0000 7fd93b200640 1 --2- 172.21.15.1:0/3916335762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd93c105dd0 0x7fd93c1061d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:40.674 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.936+0000 7fd93b200640 1 -- 172.21.15.1:0/3916335762 >> 172.21.15.1:0/3916335762 conn(0x7fd93c101bc0 msgr2=0x7fd93c103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:40.674 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.936+0000 7fd93b200640 1 -- 172.21.15.1:0/3916335762 shutdown_connections 2024-09-15T22:14:40.674 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.936+0000 7fd93b200640 1 -- 172.21.15.1:0/3916335762 wait complete. 2024-09-15T22:14:40.674 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.937+0000 7fd93b200640 1 Processor -- start 2024-09-15T22:14:40.674 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.938+0000 7fd93b200640 1 -- start start 2024-09-15T22:14:40.674 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.938+0000 7fd93b200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd93c105dd0 0x7fd93c19cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:40.674 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.938+0000 7fd93b200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd93c106cb0 con 0x7fd93c105dd0 2024-09-15T22:14:40.674 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.938+0000 7fd939e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd93c105dd0 0x7fd93c19cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:40.674 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.938+0000 7fd939e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd93c105dd0 0x7fd93c19cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45898/0 (socket says 172.21.15.1:45898) 2024-09-15T22:14:40.674 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.938+0000 7fd939e00640 1 -- 172.21.15.1:0/2057895841 learned_addr learned my addr 172.21.15.1:0/2057895841 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:14:40.675 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.939+0000 7fd939e00640 1 -- 172.21.15.1:0/2057895841 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd93c19d470 con 0x7fd93c105dd0 2024-09-15T22:14:40.675 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.939+0000 7fd939e00640 1 --2- 172.21.15.1:0/2057895841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd93c105dd0 0x7fd93c19cf30 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd92c034040 tx=0x7fd92c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:40.675 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.939+0000 7fd933400640 1 -- 172.21.15.1:0/2057895841 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd92c041070 con 0x7fd93c105dd0 2024-09-15T22:14:40.675 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.939+0000 7fd933400640 1 -- 172.21.15.1:0/2057895841 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd92c03c650 con 0x7fd93c105dd0 2024-09-15T22:14:40.675 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.939+0000 7fd93b200640 1 -- 172.21.15.1:0/2057895841 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd93c19d700 con 0x7fd93c105dd0 2024-09-15T22:14:40.675 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.939+0000 7fd933400640 1 -- 172.21.15.1:0/2057895841 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd92c036040 con 0x7fd93c105dd0 2024-09-15T22:14:40.675 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.939+0000 7fd93b200640 1 -- 172.21.15.1:0/2057895841 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd93c1a03f0 con 0x7fd93c105dd0 2024-09-15T22:14:40.675 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.940+0000 7fd933400640 1 -- 172.21.15.1:0/2057895841 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd92c044070 con 0x7fd93c105dd0 2024-09-15T22:14:40.675 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.940+0000 7fd933400640 1 -- 172.21.15.1:0/2057895841 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd92c046c10 con 0x7fd93c105dd0 2024-09-15T22:14:40.675 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.941+0000 7fd93b200640 1 -- 172.21.15.1:0/2057895841 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd93c1061d0 con 0x7fd93c105dd0 2024-09-15T22:14:40.675 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:39.944+0000 7fd933400640 1 -- 172.21.15.1:0/2057895841 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd92c03c950 con 0x7fd93c105dd0 2024-09-15T22:14:40.675 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:40.009+0000 7fd93b200640 1 -- 172.21.15.1:0/2057895841 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fd93c1a0950 con 0x7fd93c105dd0 2024-09-15T22:14:40.675 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:40.009+0000 7fd933400640 1 -- 172.21.15.1:0/2057895841 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+316 (secure 0 0 0) 0x7fd92c03cb30 con 0x7fd93c105dd0 2024-09-15T22:14:40.676 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:40.010+0000 7fd93b200640 1 -- 172.21.15.1:0/2057895841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd93c105dd0 msgr2=0x7fd93c19cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:40.676 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:40.010+0000 7fd93b200640 1 --2- 172.21.15.1:0/2057895841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd93c105dd0 0x7fd93c19cf30 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd92c034040 tx=0x7fd92c004a40 comp rx=0 tx=0).stop 2024-09-15T22:14:40.676 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:40.010+0000 7fd93b200640 1 -- 172.21.15.1:0/2057895841 shutdown_connections 2024-09-15T22:14:40.676 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:40.010+0000 7fd93b200640 1 --2- 172.21.15.1:0/2057895841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd93c105dd0 0x7fd93c19cf30 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:40.676 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:40.010+0000 7fd93b200640 1 -- 172.21.15.1:0/2057895841 >> 172.21.15.1:0/2057895841 conn(0x7fd93c101bc0 msgr2=0x7fd93c1934f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:40.676 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:40.010+0000 7fd93b200640 1 -- 172.21.15.1:0/2057895841 shutdown_connections 2024-09-15T22:14:40.676 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:40.010+0000 7fd93b200640 1 -- 172.21.15.1:0/2057895841 wait complete. 2024-09-15T22:14:40.676 INFO:teuthology.orchestra.run.smithi001.stdout:mon is available 2024-09-15T22:14:40.676 INFO:teuthology.orchestra.run.smithi001.stdout:Assimilating anything we can from ceph.conf... 2024-09-15T22:14:41.452 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:41 smithi001 ceph-mon[30469]: from='client.? 172.21.15.1:0/627321085' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-15T22:14:41.452 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:41 smithi001 ceph-mon[30469]: from='client.? 172.21.15.1:0/627321085' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-15T22:14:42.050 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-15T22:14:42.050 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [global] 2024-09-15T22:14:42.050 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout fsid = c1228c44-73af-11ef-bceb-c7b262605968 2024-09-15T22:14:42.050 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.1:3300,v1:172.21.15.1:6789] 2024-09-15T22:14:42.050 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-15T22:14:42.051 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-15T22:14:42.051 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-15T22:14:42.051 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-15T22:14:42.051 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-15T22:14:42.051 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-15T22:14:42.051 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-15T22:14:42.051 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-15T22:14:42.051 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [osd] 2024-09-15T22:14:42.051 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-15T22:14:42.051 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-15T22:14:42.051 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-15T22:14:42.051 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-15T22:14:42.051 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-15T22:14:42.052 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.309+0000 7f9456a00640 1 Processor -- start 2024-09-15T22:14:42.052 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.309+0000 7f9456a00640 1 -- start start 2024-09-15T22:14:42.052 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.310+0000 7f9456a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f945007de00 0x7f945007c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:42.052 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.310+0000 7f9456a00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f945007c830 con 0x7f945007de00 2024-09-15T22:14:42.052 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.310+0000 7f944fe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f945007de00 0x7f945007c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:42.052 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.310+0000 7f944fe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f945007de00 0x7f945007c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45906/0 (socket says 172.21.15.1:45906) 2024-09-15T22:14:42.052 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.310+0000 7f944fe00640 1 -- 172.21.15.1:0/3310013490 learned_addr learned my addr 172.21.15.1:0/3310013490 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:14:42.052 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.310+0000 7f944fe00640 1 -- 172.21.15.1:0/3310013490 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f945007c9b0 con 0x7f945007de00 2024-09-15T22:14:42.052 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.311+0000 7f944fe00640 1 --2- 172.21.15.1:0/3310013490 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f945007de00 0x7f945007c260 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9440009820 tx=0x7f944002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24428d72899f2317 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:42.052 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.312+0000 7f944ea00640 1 -- 172.21.15.1:0/3310013490 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9440037070 con 0x7f945007de00 2024-09-15T22:14:42.052 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.312+0000 7f944ea00640 1 -- 172.21.15.1:0/3310013490 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9440032440 con 0x7f945007de00 2024-09-15T22:14:42.052 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.312+0000 7f944ea00640 1 -- 172.21.15.1:0/3310013490 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9440032740 con 0x7f945007de00 2024-09-15T22:14:42.052 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.312+0000 7f9456a00640 1 -- 172.21.15.1:0/3310013490 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f945007de00 msgr2=0x7f945007c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:42.053 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.312+0000 7f9456a00640 1 --2- 172.21.15.1:0/3310013490 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f945007de00 0x7f945007c260 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9440009820 tx=0x7f944002a270 comp rx=0 tx=0).stop 2024-09-15T22:14:42.053 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.312+0000 7f9456a00640 1 -- 172.21.15.1:0/3310013490 shutdown_connections 2024-09-15T22:14:42.053 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.312+0000 7f9456a00640 1 --2- 172.21.15.1:0/3310013490 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f945007de00 0x7f945007c260 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:42.053 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.312+0000 7f9456a00640 1 -- 172.21.15.1:0/3310013490 >> 172.21.15.1:0/3310013490 conn(0x7f9450102f30 msgr2=0x7f9450105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:42.053 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.313+0000 7f9456a00640 1 -- 172.21.15.1:0/3310013490 shutdown_connections 2024-09-15T22:14:42.053 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.313+0000 7f9456a00640 1 -- 172.21.15.1:0/3310013490 wait complete. 2024-09-15T22:14:42.053 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.313+0000 7f9456a00640 1 Processor -- start 2024-09-15T22:14:42.053 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.314+0000 7f9456a00640 1 -- start start 2024-09-15T22:14:42.053 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.314+0000 7f9456a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f945007de00 0x7f945019d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:42.053 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.314+0000 7f9456a00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f945007cee0 con 0x7f945007de00 2024-09-15T22:14:42.053 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.314+0000 7f944fe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f945007de00 0x7f945019d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:42.053 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.314+0000 7f944fe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f945007de00 0x7f945019d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45914/0 (socket says 172.21.15.1:45914) 2024-09-15T22:14:42.054 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.314+0000 7f944fe00640 1 -- 172.21.15.1:0/627321085 learned_addr learned my addr 172.21.15.1:0/627321085 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:14:42.054 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.315+0000 7f944fe00640 1 -- 172.21.15.1:0/627321085 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f945019d680 con 0x7f945007de00 2024-09-15T22:14:42.054 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.315+0000 7f944fe00640 1 --2- 172.21.15.1:0/627321085 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f945007de00 0x7f945019d140 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f94400090b0 tx=0x7f94400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:42.054 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.315+0000 7f944cc00640 1 -- 172.21.15.1:0/627321085 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9440041070 con 0x7f945007de00 2024-09-15T22:14:42.054 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.315+0000 7f9456a00640 1 -- 172.21.15.1:0/627321085 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f945019d910 con 0x7f945007de00 2024-09-15T22:14:42.054 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.315+0000 7f944cc00640 1 -- 172.21.15.1:0/627321085 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f944003c7a0 con 0x7f945007de00 2024-09-15T22:14:42.054 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.315+0000 7f944cc00640 1 -- 172.21.15.1:0/627321085 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9440037040 con 0x7f945007de00 2024-09-15T22:14:42.054 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.315+0000 7f9456a00640 1 -- 172.21.15.1:0/627321085 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94501a0600 con 0x7f945007de00 2024-09-15T22:14:42.054 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.316+0000 7f944cc00640 1 -- 172.21.15.1:0/627321085 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9440044070 con 0x7f945007de00 2024-09-15T22:14:42.054 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.316+0000 7f944cc00640 1 -- 172.21.15.1:0/627321085 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f944003d3f0 con 0x7f945007de00 2024-09-15T22:14:42.054 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.317+0000 7f9456a00640 1 -- 172.21.15.1:0/627321085 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f945007c2e0 con 0x7f945007de00 2024-09-15T22:14:42.054 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.319+0000 7f944cc00640 1 -- 172.21.15.1:0/627321085 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f9440046450 con 0x7f945007de00 2024-09-15T22:14:42.054 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.382+0000 7f9456a00640 1 -- 172.21.15.1:0/627321085 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f945002d910 con 0x7f945007de00 2024-09-15T22:14:42.055 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.386+0000 7f944cc00640 1 -- 172.21.15.1:0/627321085 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+427 (secure 0 0 0) 0x7f9440046630 con 0x7f945007de00 2024-09-15T22:14:42.055 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.387+0000 7f944cc00640 1 -- 172.21.15.1:0/627321085 <== mon.0 v2:172.21.15.1:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9440056070 con 0x7f945007de00 2024-09-15T22:14:42.055 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.388+0000 7f9456a00640 1 -- 172.21.15.1:0/627321085 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f945007de00 msgr2=0x7f945019d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:42.055 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.388+0000 7f9456a00640 1 --2- 172.21.15.1:0/627321085 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f945007de00 0x7f945019d140 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f94400090b0 tx=0x7f94400046c0 comp rx=0 tx=0).stop 2024-09-15T22:14:42.055 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.388+0000 7f9456a00640 1 -- 172.21.15.1:0/627321085 shutdown_connections 2024-09-15T22:14:42.055 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.388+0000 7f9456a00640 1 --2- 172.21.15.1:0/627321085 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f945007de00 0x7f945019d140 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:42.055 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.388+0000 7f9456a00640 1 -- 172.21.15.1:0/627321085 >> 172.21.15.1:0/627321085 conn(0x7f9450102f30 msgr2=0x7f9450104000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:42.055 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.388+0000 7f9456a00640 1 -- 172.21.15.1:0/627321085 shutdown_connections 2024-09-15T22:14:42.055 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:41.388+0000 7f9456a00640 1 -- 172.21.15.1:0/627321085 wait complete. 2024-09-15T22:14:42.055 INFO:teuthology.orchestra.run.smithi001.stdout:Generating new minimal ceph.conf... 2024-09-15T22:14:42.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:42 smithi001 ceph-mon[30469]: from='client.? 172.21.15.1:0/3195804914' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:14:43.228 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.507+0000 7f03be400640 1 Processor -- start 2024-09-15T22:14:43.228 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.507+0000 7f03be400640 1 -- start start 2024-09-15T22:14:43.229 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.507+0000 7f03be400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03b81097f0 0x7f03b8109bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:43.229 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.507+0000 7f03be400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f03b810a1c0 con 0x7f03b81097f0 2024-09-15T22:14:43.229 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.508+0000 7f03bd000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03b81097f0 0x7f03b8109bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:43.229 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.508+0000 7f03bd000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03b81097f0 0x7f03b8109bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45926/0 (socket says 172.21.15.1:45926) 2024-09-15T22:14:43.229 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.508+0000 7f03bd000640 1 -- 172.21.15.1:0/3668310101 learned_addr learned my addr 172.21.15.1:0/3668310101 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:14:43.229 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.508+0000 7f03bd000640 1 -- 172.21.15.1:0/3668310101 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b810a960 con 0x7f03b81097f0 2024-09-15T22:14:43.229 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.509+0000 7f03bd000640 1 --2- 172.21.15.1:0/3668310101 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03b81097f0 0x7f03b8109bf0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f03ac009820 tx=0x7f03ac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9fcdea109087fb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:43.229 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.509+0000 7f03b7400640 1 -- 172.21.15.1:0/3668310101 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03ac037070 con 0x7f03b81097f0 2024-09-15T22:14:43.229 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.509+0000 7f03b7400640 1 -- 172.21.15.1:0/3668310101 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f03ac032900 con 0x7f03b81097f0 2024-09-15T22:14:43.230 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.509+0000 7f03b7400640 1 -- 172.21.15.1:0/3668310101 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03ac030850 con 0x7f03b81097f0 2024-09-15T22:14:43.230 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.510+0000 7f03be400640 1 -- 172.21.15.1:0/3668310101 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03b81097f0 msgr2=0x7f03b8109bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:43.230 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.510+0000 7f03be400640 1 --2- 172.21.15.1:0/3668310101 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03b81097f0 0x7f03b8109bf0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f03ac009820 tx=0x7f03ac02a270 comp rx=0 tx=0).stop 2024-09-15T22:14:43.230 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.510+0000 7f03be400640 1 -- 172.21.15.1:0/3668310101 shutdown_connections 2024-09-15T22:14:43.230 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.510+0000 7f03be400640 1 --2- 172.21.15.1:0/3668310101 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03b81097f0 0x7f03b8109bf0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:43.230 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.510+0000 7f03be400640 1 -- 172.21.15.1:0/3668310101 >> 172.21.15.1:0/3668310101 conn(0x7f03b807ce90 msgr2=0x7f03b807d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:43.230 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.510+0000 7f03be400640 1 -- 172.21.15.1:0/3668310101 shutdown_connections 2024-09-15T22:14:43.230 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.510+0000 7f03be400640 1 -- 172.21.15.1:0/3668310101 wait complete. 2024-09-15T22:14:43.230 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.511+0000 7f03be400640 1 Processor -- start 2024-09-15T22:14:43.230 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.511+0000 7f03be400640 1 -- start start 2024-09-15T22:14:43.231 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.512+0000 7f03be400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03b81097f0 0x7f03b819d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:43.231 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.512+0000 7f03be400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f03b810dd10 con 0x7f03b81097f0 2024-09-15T22:14:43.231 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.512+0000 7f03bd000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03b81097f0 0x7f03b819d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:43.231 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.512+0000 7f03bd000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03b81097f0 0x7f03b819d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45930/0 (socket says 172.21.15.1:45930) 2024-09-15T22:14:43.231 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.512+0000 7f03bd000640 1 -- 172.21.15.1:0/3195804914 learned_addr learned my addr 172.21.15.1:0/3195804914 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:14:43.231 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.512+0000 7f03bd000640 1 -- 172.21.15.1:0/3195804914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b819dd20 con 0x7f03b81097f0 2024-09-15T22:14:43.231 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.512+0000 7f03bd000640 1 --2- 172.21.15.1:0/3195804914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03b81097f0 0x7f03b819d7e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f03ac030460 tx=0x7f03ac030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:43.232 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.513+0000 7f03b5600640 1 -- 172.21.15.1:0/3195804914 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03ac042070 con 0x7f03b81097f0 2024-09-15T22:14:43.232 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.513+0000 7f03be400640 1 -- 172.21.15.1:0/3195804914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03b819dfb0 con 0x7f03b81097f0 2024-09-15T22:14:43.232 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.513+0000 7f03b5600640 1 -- 172.21.15.1:0/3195804914 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f03ac032be0 con 0x7f03b81097f0 2024-09-15T22:14:43.232 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.513+0000 7f03b5600640 1 -- 172.21.15.1:0/3195804914 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03ac037040 con 0x7f03b81097f0 2024-09-15T22:14:43.232 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.513+0000 7f03be400640 1 -- 172.21.15.1:0/3195804914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03b81a0ca0 con 0x7f03b81097f0 2024-09-15T22:14:43.232 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.513+0000 7f03b5600640 1 -- 172.21.15.1:0/3195804914 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f03ac045070 con 0x7f03b81097f0 2024-09-15T22:14:43.232 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.513+0000 7f03b5600640 1 -- 172.21.15.1:0/3195804914 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f03ac047a30 con 0x7f03b81097f0 2024-09-15T22:14:43.232 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.514+0000 7f03be400640 1 -- 172.21.15.1:0/3195804914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03b8109bf0 con 0x7f03b81097f0 2024-09-15T22:14:43.232 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.517+0000 7f03b5600640 1 -- 172.21.15.1:0/3195804914 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f03ac032d90 con 0x7f03b81097f0 2024-09-15T22:14:43.232 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.580+0000 7f03be400640 1 -- 172.21.15.1:0/3195804914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f03b81a0e70 con 0x7f03b81097f0 2024-09-15T22:14:43.232 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.581+0000 7f03b5600640 1 -- 172.21.15.1:0/3195804914 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+173 (secure 0 0 0) 0x7f03ac03da10 con 0x7f03b81097f0 2024-09-15T22:14:43.232 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.581+0000 7f03be400640 1 -- 172.21.15.1:0/3195804914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03b81097f0 msgr2=0x7f03b819d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:43.233 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.581+0000 7f03be400640 1 --2- 172.21.15.1:0/3195804914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03b81097f0 0x7f03b819d7e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f03ac030460 tx=0x7f03ac030d80 comp rx=0 tx=0).stop 2024-09-15T22:14:43.233 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.582+0000 7f03be400640 1 -- 172.21.15.1:0/3195804914 shutdown_connections 2024-09-15T22:14:43.233 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.582+0000 7f03be400640 1 --2- 172.21.15.1:0/3195804914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03b81097f0 0x7f03b819d7e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:43.233 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.582+0000 7f03be400640 1 -- 172.21.15.1:0/3195804914 >> 172.21.15.1:0/3195804914 conn(0x7f03b807ce90 msgr2=0x7f03b81074c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:43.233 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.582+0000 7f03be400640 1 -- 172.21.15.1:0/3195804914 shutdown_connections 2024-09-15T22:14:43.233 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:42.582+0000 7f03be400640 1 -- 172.21.15.1:0/3195804914 wait complete. 2024-09-15T22:14:43.233 INFO:teuthology.orchestra.run.smithi001.stdout:Restarting the monitor... 2024-09-15T22:14:43.617 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:43 smithi001 systemd[1]: Stopping Ceph mon.a for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:14:43.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:43 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mon-a[30464]: 2024-09-15T22:14:43.615+0000 7f3f9e200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:14:43.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:43 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mon-a[30464]: 2024-09-15T22:14:43.615+0000 7f3f9e200640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-15T22:14:43.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:43 smithi001 podman[30722]: 2024-09-15 22:14:43.810395003 +0000 UTC m=+0.349749518 container died fcbe02a15093f92719c4fa420cc8b6d07979d1134b360357b8f7ad321f9a1c44 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mon-a, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:14:44.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:44 smithi001 podman[30722]: 2024-09-15 22:14:44.169536903 +0000 UTC m=+0.708891417 container cleanup fcbe02a15093f92719c4fa420cc8b6d07979d1134b360357b8f7ad321f9a1c44 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mon-a, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2) 2024-09-15T22:14:44.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:44 smithi001 bash[30722]: ceph-c1228c44-73af-11ef-bceb-c7b262605968-mon-a 2024-09-15T22:14:44.635 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:44 smithi001 podman[30734]: 2024-09-15 22:14:44.378969903 +0000 UTC m=+0.558717193 container remove fcbe02a15093f92719c4fa420cc8b6d07979d1134b360357b8f7ad321f9a1c44 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-8921c8e) 2024-09-15T22:14:44.956 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:44 smithi001 systemd[1]: ceph-c1228c44-73af-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-15T22:14:44.956 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:44 smithi001 systemd[1]: Stopped Ceph mon.a for c1228c44-73af-11ef-bceb-c7b262605968. 2024-09-15T22:14:44.956 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:44 smithi001 systemd[1]: ceph-c1228c44-73af-11ef-bceb-c7b262605968@mon.a.service: Consumed 1.240s CPU time. 2024-09-15T22:14:44.956 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:44 smithi001 systemd[1]: Starting Ceph mon.a for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:14:45.216 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:44 smithi001 podman[30825]: 2024-09-15 22:14:44.954525484 +0000 UTC m=+0.106663414 container create 93496c21faa2a5b285d83b78e0f0cf306818f4919b273d82a4007d8cfe7337b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mon-a, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-15T22:14:45.216 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:44 smithi001 podman[30825]: 2024-09-15 22:14:44.874924506 +0000 UTC m=+0.027062464 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:14:45.216 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 podman[30825]: 2024-09-15 22:14:45.173519986 +0000 UTC m=+0.325657941 container init 93496c21faa2a5b285d83b78e0f0cf306818f4919b273d82a4007d8cfe7337b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-15T22:14:45.216 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 podman[30825]: 2024-09-15 22:14:45.180119976 +0000 UTC m=+0.332257908 container start 93496c21faa2a5b285d83b78e0f0cf306818f4919b273d82a4007d8cfe7337b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:14:45.216 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: set uid:gid to 167:167 (ceph:ceph) 2024-09-15T22:14:45.275 INFO:teuthology.orchestra.run.smithi001.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-15T22:14:45.565 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable), process ceph-mon, pid 2 2024-09-15T22:14:45.565 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: pidfile_write: ignore empty --pid-file 2024-09-15T22:14:45.566 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: load: jerasure load: lrc 2024-09-15T22:14:45.566 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: RocksDB version: 7.9.2 2024-09-15T22:14:45.566 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Git sha 0 2024-09-15T22:14:45.566 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Compile date 2024-09-15 15:04:35 2024-09-15T22:14:45.566 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: DB SUMMARY 2024-09-15T22:14:45.566 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: DB Session ID: 80UQHVP7AX19IURVNS6J 2024-09-15T22:14:45.566 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: CURRENT file: CURRENT 2024-09-15T22:14:45.566 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: IDENTITY file: IDENTITY 2024-09-15T22:14:45.567 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-15T22:14:45.567 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-15T22:14:45.567 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 106158 ; 2024-09-15T22:14:45.567 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.error_if_exists: 0 2024-09-15T22:14:45.567 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.create_if_missing: 0 2024-09-15T22:14:45.567 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.paranoid_checks: 1 2024-09-15T22:14:45.567 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-15T22:14:45.567 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-15T22:14:45.567 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-15T22:14:45.567 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.env: 0x55ce3809f940 2024-09-15T22:14:45.567 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.fs: PosixFileSystem 2024-09-15T22:14:45.567 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.info_log: 0x55ce440836a0 2024-09-15T22:14:45.567 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.max_file_opening_threads: 16 2024-09-15T22:14:45.568 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.statistics: (nil) 2024-09-15T22:14:45.568 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.use_fsync: 0 2024-09-15T22:14:45.568 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.max_log_file_size: 0 2024-09-15T22:14:45.568 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-15T22:14:45.568 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-15T22:14:45.568 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.keep_log_file_num: 1000 2024-09-15T22:14:45.568 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.recycle_log_file_num: 0 2024-09-15T22:14:45.568 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.allow_fallocate: 1 2024-09-15T22:14:45.568 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.allow_mmap_reads: 0 2024-09-15T22:14:45.569 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.allow_mmap_writes: 0 2024-09-15T22:14:45.569 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.use_direct_reads: 0 2024-09-15T22:14:45.569 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-15T22:14:45.569 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.create_missing_column_families: 0 2024-09-15T22:14:45.569 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.db_log_dir: 2024-09-15T22:14:45.569 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.wal_dir: 2024-09-15T22:14:45.569 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-15T22:14:45.569 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-15T22:14:45.570 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-15T22:14:45.571 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-15T22:14:45.571 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-15T22:14:45.571 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-15T22:14:45.571 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.advise_random_on_open: 1 2024-09-15T22:14:45.571 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.db_write_buffer_size: 0 2024-09-15T22:14:45.571 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.write_buffer_manager: 0x55ce44092dc0 2024-09-15T22:14:45.571 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-15T22:14:45.571 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-15T22:14:45.571 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-15T22:14:45.571 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.rate_limiter: (nil) 2024-09-15T22:14:45.571 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-15T22:14:45.571 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.wal_recovery_mode: 2 2024-09-15T22:14:45.571 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.enable_thread_tracking: 0 2024-09-15T22:14:45.572 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.enable_pipelined_write: 0 2024-09-15T22:14:45.572 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.unordered_write: 0 2024-09-15T22:14:45.572 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-15T22:14:45.572 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-15T22:14:45.572 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-15T22:14:45.572 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-15T22:14:45.572 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.row_cache: None 2024-09-15T22:14:45.572 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.wal_filter: None 2024-09-15T22:14:45.572 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-15T22:14:45.572 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.allow_ingest_behind: 0 2024-09-15T22:14:45.572 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.two_write_queues: 0 2024-09-15T22:14:45.572 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.manual_wal_flush: 0 2024-09-15T22:14:45.573 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.wal_compression: 0 2024-09-15T22:14:45.573 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.atomic_flush: 0 2024-09-15T22:14:45.573 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-15T22:14:45.573 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-15T22:14:45.573 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-15T22:14:45.573 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.log_readahead_size: 0 2024-09-15T22:14:45.573 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-15T22:14:45.573 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.best_efforts_recovery: 0 2024-09-15T22:14:45.573 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-15T22:14:45.573 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-15T22:14:45.573 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.allow_data_in_errors: 0 2024-09-15T22:14:45.573 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.db_host_id: __hostname__ 2024-09-15T22:14:45.573 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-15T22:14:45.573 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.max_background_jobs: 2 2024-09-15T22:14:45.574 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.max_background_compactions: -1 2024-09-15T22:14:45.574 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.max_subcompactions: 1 2024-09-15T22:14:45.574 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-15T22:14:45.574 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-15T22:14:45.574 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-15T22:14:45.574 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.max_total_wal_size: 0 2024-09-15T22:14:45.574 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-15T22:14:45.574 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-15T22:14:45.574 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-15T22:14:45.574 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-15T22:14:45.574 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.max_open_files: -1 2024-09-15T22:14:45.575 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.bytes_per_sync: 0 2024-09-15T22:14:45.575 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-15T22:14:45.575 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-15T22:14:45.575 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.compaction_readahead_size: 0 2024-09-15T22:14:45.575 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.max_background_flushes: -1 2024-09-15T22:14:45.575 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Compression algorithms supported: 2024-09-15T22:14:45.575 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: kZSTD supported: 0 2024-09-15T22:14:45.575 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: kXpressCompression supported: 0 2024-09-15T22:14:45.575 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: kBZip2Compression supported: 0 2024-09-15T22:14:45.575 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-15T22:14:45.575 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: kLZ4Compression supported: 1 2024-09-15T22:14:45.575 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: kZlibCompression supported: 1 2024-09-15T22:14:45.576 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: kLZ4HCCompression supported: 1 2024-09-15T22:14:45.576 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: kSnappyCompression supported: 1 2024-09-15T22:14:45.576 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-15T22:14:45.576 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-15T22:14:45.576 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-15T22:14:45.576 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-15T22:14:45.576 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-15T22:14:45.576 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.merge_operator: 2024-09-15T22:14:45.577 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.compaction_filter: None 2024-09-15T22:14:45.577 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.compaction_filter_factory: None 2024-09-15T22:14:45.577 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.sst_partitioner_factory: None 2024-09-15T22:14:45.577 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-15T22:14:45.577 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-15T22:14:45.577 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ce44083300) 2024-09-15T22:14:45.577 INFO:journalctl@ceph.mon.a.smithi001.stdout: cache_index_and_filter_blocks: 1 2024-09-15T22:14:45.577 INFO:journalctl@ceph.mon.a.smithi001.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-15T22:14:45.577 INFO:journalctl@ceph.mon.a.smithi001.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-15T22:14:45.577 INFO:journalctl@ceph.mon.a.smithi001.stdout: pin_top_level_index_and_filter: 1 2024-09-15T22:14:45.578 INFO:journalctl@ceph.mon.a.smithi001.stdout: index_type: 0 2024-09-15T22:14:45.578 INFO:journalctl@ceph.mon.a.smithi001.stdout: data_block_index_type: 0 2024-09-15T22:14:45.578 INFO:journalctl@ceph.mon.a.smithi001.stdout: index_shortening: 1 2024-09-15T22:14:45.578 INFO:journalctl@ceph.mon.a.smithi001.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-15T22:14:45.578 INFO:journalctl@ceph.mon.a.smithi001.stdout: checksum: 4 2024-09-15T22:14:45.578 INFO:journalctl@ceph.mon.a.smithi001.stdout: no_block_cache: 0 2024-09-15T22:14:45.578 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_cache: 0x55ce440771f0 2024-09-15T22:14:45.578 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_cache_name: BinnedLRUCache 2024-09-15T22:14:45.578 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_cache_options: 2024-09-15T22:14:45.578 INFO:journalctl@ceph.mon.a.smithi001.stdout: capacity : 536870912 2024-09-15T22:14:45.578 INFO:journalctl@ceph.mon.a.smithi001.stdout: num_shard_bits : 4 2024-09-15T22:14:45.578 INFO:journalctl@ceph.mon.a.smithi001.stdout: strict_capacity_limit : 0 2024-09-15T22:14:45.578 INFO:journalctl@ceph.mon.a.smithi001.stdout: high_pri_pool_ratio: 0.000 2024-09-15T22:14:45.579 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_cache_compressed: (nil) 2024-09-15T22:14:45.579 INFO:journalctl@ceph.mon.a.smithi001.stdout: persistent_cache: (nil) 2024-09-15T22:14:45.579 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_size: 4096 2024-09-15T22:14:45.579 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_size_deviation: 10 2024-09-15T22:14:45.579 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_restart_interval: 16 2024-09-15T22:14:45.579 INFO:journalctl@ceph.mon.a.smithi001.stdout: index_block_restart_interval: 1 2024-09-15T22:14:45.579 INFO:journalctl@ceph.mon.a.smithi001.stdout: metadata_block_size: 4096 2024-09-15T22:14:45.579 INFO:journalctl@ceph.mon.a.smithi001.stdout: partition_filters: 0 2024-09-15T22:14:45.579 INFO:journalctl@ceph.mon.a.smithi001.stdout: use_delta_encoding: 1 2024-09-15T22:14:45.579 INFO:journalctl@ceph.mon.a.smithi001.stdout: filter_policy: bloomfilter 2024-09-15T22:14:45.579 INFO:journalctl@ceph.mon.a.smithi001.stdout: whole_key_filtering: 1 2024-09-15T22:14:45.579 INFO:journalctl@ceph.mon.a.smithi001.stdout: verify_compression: 0 2024-09-15T22:14:45.580 INFO:journalctl@ceph.mon.a.smithi001.stdout: read_amp_bytes_per_bit: 0 2024-09-15T22:14:45.580 INFO:journalctl@ceph.mon.a.smithi001.stdout: format_version: 5 2024-09-15T22:14:45.580 INFO:journalctl@ceph.mon.a.smithi001.stdout: enable_index_compression: 1 2024-09-15T22:14:45.580 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_align: 0 2024-09-15T22:14:45.580 INFO:journalctl@ceph.mon.a.smithi001.stdout: max_auto_readahead_size: 262144 2024-09-15T22:14:45.580 INFO:journalctl@ceph.mon.a.smithi001.stdout: prepopulate_block_cache: 0 2024-09-15T22:14:45.580 INFO:journalctl@ceph.mon.a.smithi001.stdout: initial_auto_readahead_size: 8192 2024-09-15T22:14:45.580 INFO:journalctl@ceph.mon.a.smithi001.stdout: num_file_reads_for_auto_readahead: 2 2024-09-15T22:14:45.580 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.write_buffer_size: 33554432 2024-09-15T22:14:45.580 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.max_write_buffer_number: 2 2024-09-15T22:14:45.580 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.compression: NoCompression 2024-09-15T22:14:45.580 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.bottommost_compression: Disabled 2024-09-15T22:14:45.580 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.prefix_extractor: nullptr 2024-09-15T22:14:45.581 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-15T22:14:45.581 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.num_levels: 7 2024-09-15T22:14:45.581 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-15T22:14:45.581 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-15T22:14:45.581 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-15T22:14:45.581 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-15T22:14:45.581 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-15T22:14:45.581 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-15T22:14:45.581 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-15T22:14:45.581 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-15T22:14:45.581 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-15T22:14:45.581 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-15T22:14:45.581 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-15T22:14:45.582 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-15T22:14:45.582 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-15T22:14:45.582 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.compression_opts.level: 32767 2024-09-15T22:14:45.582 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.compression_opts.strategy: 0 2024-09-15T22:14:45.582 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-15T22:14:45.582 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-15T22:14:45.582 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-15T22:14:45.582 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-15T22:14:45.582 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.compression_opts.enabled: false 2024-09-15T22:14:45.582 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-15T22:14:45.582 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-15T22:14:45.583 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-15T22:14:45.583 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-15T22:14:45.583 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.target_file_size_base: 67108864 2024-09-15T22:14:45.583 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-15T22:14:45.583 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-15T22:14:45.583 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-15T22:14:45.583 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-15T22:14:45.583 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-15T22:14:45.583 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-15T22:14:45.583 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-15T22:14:45.583 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-15T22:14:45.583 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-15T22:14:45.584 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-15T22:14:45.584 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-15T22:14:45.584 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-15T22:14:45.584 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-15T22:14:45.584 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-15T22:14:45.584 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.arena_block_size: 1048576 2024-09-15T22:14:45.584 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-15T22:14:45.584 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-15T22:14:45.584 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.disable_auto_compactions: 0 2024-09-15T22:14:45.584 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-15T22:14:45.584 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-15T22:14:45.584 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-15T22:14:45.584 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-15T22:14:45.585 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-15T22:14:45.585 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-15T22:14:45.585 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-15T22:14:45.585 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-15T22:14:45.585 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-15T22:14:45.585 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-15T22:14:45.585 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-15T22:14:45.585 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.inplace_update_support: 0 2024-09-15T22:14:45.585 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-15T22:14:45.585 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-15T22:14:45.585 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-15T22:14:45.586 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-15T22:14:45.586 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.bloom_locality: 0 2024-09-15T22:14:45.586 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.max_successive_merges: 0 2024-09-15T22:14:45.586 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-15T22:14:45.586 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.paranoid_file_checks: 0 2024-09-15T22:14:45.586 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.force_consistency_checks: 1 2024-09-15T22:14:45.586 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.report_bg_io_stats: 0 2024-09-15T22:14:45.586 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.ttl: 2592000 2024-09-15T22:14:45.586 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-15T22:14:45.586 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-15T22:14:45.586 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-15T22:14:45.586 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.enable_blob_files: false 2024-09-15T22:14:45.586 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.min_blob_size: 0 2024-09-15T22:14:45.587 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.blob_file_size: 268435456 2024-09-15T22:14:45.587 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-15T22:14:45.587 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-15T22:14:45.587 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-15T22:14:45.587 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-15T22:14:45.587 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-15T22:14:45.587 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.blob_file_starting_level: 0 2024-09-15T22:14:45.587 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-15T22:14:45.587 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-15T22:14:45.587 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-15T22:14:45.587 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 0de4b39f-4e46-470c-a73b-72ff916aae0b 2024-09-15T22:14:45.588 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726438485222846, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-15T22:14:45.588 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-15T22:14:45.588 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726438485224692, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 101130, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 332, "table_properties": {"data_size": 99015, "index_size": 307, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14530, "raw_average_key_size": 49, "raw_value_size": 91163, "raw_average_value_size": 313, "num_data_blocks": 12, "num_entries": 291, "num_filter_entries": 291, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726438485, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "0de4b39f-4e46-470c-a73b-72ff916aae0b", "db_session_id": "80UQHVP7AX19IURVNS6J", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-15T22:14:45.588 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726438485224893, "job": 1, "event": "recovery_finished"} 2024-09-15T22:14:45.588 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-15T22:14:45.588 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-15T22:14:45.588 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ce440a6e00 2024-09-15T22:14:45.588 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: DB pointer 0x55ce441a2000 2024-09-15T22:14:45.588 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-15T22:14:45.588 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-15T22:14:45.588 INFO:journalctl@ceph.mon.a.smithi001.stdout: ** DB Stats ** 2024-09-15T22:14:45.588 INFO:journalctl@ceph.mon.a.smithi001.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T22:14:45.588 INFO:journalctl@ceph.mon.a.smithi001.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-15T22:14:45.589 INFO:journalctl@ceph.mon.a.smithi001.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-15T22:14:45.589 INFO:journalctl@ceph.mon.a.smithi001.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T22:14:45.589 INFO:journalctl@ceph.mon.a.smithi001.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-15T22:14:45.589 INFO:journalctl@ceph.mon.a.smithi001.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-15T22:14:45.589 INFO:journalctl@ceph.mon.a.smithi001.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T22:14:45.589 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-15T22:14:45.589 INFO:journalctl@ceph.mon.a.smithi001.stdout: ** Compaction Stats [default] ** 2024-09-15T22:14:45.589 INFO:journalctl@ceph.mon.a.smithi001.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-15T22:14:45.589 INFO:journalctl@ceph.mon.a.smithi001.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-15T22:14:45.589 INFO:journalctl@ceph.mon.a.smithi001.stdout: L0 2/0 100.62 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 81.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-15T22:14:45.589 INFO:journalctl@ceph.mon.a.smithi001.stdout: Sum 2/0 100.62 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 81.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-15T22:14:45.590 INFO:journalctl@ceph.mon.a.smithi001.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 81.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-15T22:14:45.590 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-15T22:14:45.590 INFO:journalctl@ceph.mon.a.smithi001.stdout: ** Compaction Stats [default] ** 2024-09-15T22:14:45.590 INFO:journalctl@ceph.mon.a.smithi001.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-15T22:14:45.590 INFO:journalctl@ceph.mon.a.smithi001.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-15T22:14:45.590 INFO:journalctl@ceph.mon.a.smithi001.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 81.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-15T22:14:45.590 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-15T22:14:45.592 INFO:journalctl@ceph.mon.a.smithi001.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-15T22:14:45.592 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-15T22:14:45.592 INFO:journalctl@ceph.mon.a.smithi001.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T22:14:45.592 INFO:journalctl@ceph.mon.a.smithi001.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-15T22:14:45.592 INFO:journalctl@ceph.mon.a.smithi001.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-15T22:14:45.592 INFO:journalctl@ceph.mon.a.smithi001.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-15T22:14:45.592 INFO:journalctl@ceph.mon.a.smithi001.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-15T22:14:45.592 INFO:journalctl@ceph.mon.a.smithi001.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-15T22:14:45.592 INFO:journalctl@ceph.mon.a.smithi001.stdout: Cumulative compaction: 0.00 GB write, 15.79 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T22:14:45.592 INFO:journalctl@ceph.mon.a.smithi001.stdout: Interval compaction: 0.00 GB write, 15.79 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T22:14:45.592 INFO:journalctl@ceph.mon.a.smithi001.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-15T22:14:45.592 INFO:journalctl@ceph.mon.a.smithi001.stdout: Block cache BinnedLRUCache@0x55ce440771f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-15T22:14:45.592 INFO:journalctl@ceph.mon.a.smithi001.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-15T22:14:45.593 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-15T22:14:45.593 INFO:journalctl@ceph.mon.a.smithi001.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-15T22:14:45.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: starting mon.a rank 0 at public addrs [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] at bind addrs [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid c1228c44-73af-11ef-bceb-c7b262605968 2024-09-15T22:14:45.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: mon.a@-1(???) e1 preinit fsid c1228c44-73af-11ef-bceb-c7b262605968 2024-09-15T22:14:45.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: mon.a@-1(???).mds e1 new map 2024-09-15T22:14:45.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: mon.a@-1(???).mds e1 print_map 2024-09-15T22:14:45.593 INFO:journalctl@ceph.mon.a.smithi001.stdout: e1 2024-09-15T22:14:45.593 INFO:journalctl@ceph.mon.a.smithi001.stdout: btime 2024-09-15T22:14:39:004349+0000 2024-09-15T22:14:45.593 INFO:journalctl@ceph.mon.a.smithi001.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-15T22:14:45.593 INFO:journalctl@ceph.mon.a.smithi001.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-15T22:14:45.594 INFO:journalctl@ceph.mon.a.smithi001.stdout: legacy client fscid: -1 2024-09-15T22:14:45.594 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-15T22:14:45.594 INFO:journalctl@ceph.mon.a.smithi001.stdout: No filesystems configured 2024-09-15T22:14:45.594 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-15T22:14:45.594 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:14:45.594 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:14:45.594 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:14:45.594 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-15T22:14:45.594 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 bash[30825]: 93496c21faa2a5b285d83b78e0f0cf306818f4919b273d82a4007d8cfe7337b5 2024-09-15T22:14:45.594 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 systemd[1]: Started Ceph mon.a for c1228c44-73af-11ef-bceb-c7b262605968. 2024-09-15T22:14:45.594 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-15T22:14:45.594 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: monmap epoch 1 2024-09-15T22:14:45.594 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: fsid c1228c44-73af-11ef-bceb-c7b262605968 2024-09-15T22:14:45.595 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: last_changed 2024-09-15T22:14:35.299044+0000 2024-09-15T22:14:45.595 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: created 2024-09-15T22:14:35.299044+0000 2024-09-15T22:14:45.595 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: min_mon_release 19 (squid) 2024-09-15T22:14:45.595 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: election_strategy: 1 2024-09-15T22:14:45.595 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-15T22:14:45.596 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: fsmap 2024-09-15T22:14:45.596 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: osdmap e1: 0 total, 0 up, 0 in 2024-09-15T22:14:45.596 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:45 smithi001 ceph-mon[30843]: mgrmap e1: no daemons active 2024-09-15T22:14:46.505 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.805+0000 7fca7b200640 1 Processor -- start 2024-09-15T22:14:46.505 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.805+0000 7fca7b200640 1 -- start start 2024-09-15T22:14:46.505 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.805+0000 7fca7b200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca74109930 0x7fca74109d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:46.505 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.805+0000 7fca7b200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fca7410a300 con 0x7fca74109930 2024-09-15T22:14:46.506 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.806+0000 7fca73e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca74109930 0x7fca74109d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:46.506 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.806+0000 7fca73e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca74109930 0x7fca74109d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45934/0 (socket says 172.21.15.1:45934) 2024-09-15T22:14:46.506 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.806+0000 7fca73e00640 1 -- 172.21.15.1:0/3330646729 learned_addr learned my addr 172.21.15.1:0/3330646729 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:14:46.506 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.806+0000 7fca73e00640 1 -- 172.21.15.1:0/3330646729 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca7410ab20 con 0x7fca74109930 2024-09-15T22:14:46.506 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.809+0000 7fca73e00640 1 --2- 172.21.15.1:0/3330646729 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca74109930 0x7fca74109d30 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fca64009820 tx=0x7fca6402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d5432f490a21f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:46.506 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.810+0000 7fca72a00640 1 -- 172.21.15.1:0/3330646729 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca64037070 con 0x7fca74109930 2024-09-15T22:14:46.506 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.810+0000 7fca72a00640 1 -- 172.21.15.1:0/3330646729 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fca64032900 con 0x7fca74109930 2024-09-15T22:14:46.507 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.810+0000 7fca72a00640 1 -- 172.21.15.1:0/3330646729 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca64030850 con 0x7fca74109930 2024-09-15T22:14:46.507 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.810+0000 7fca7b200640 1 -- 172.21.15.1:0/3330646729 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca74109930 msgr2=0x7fca74109d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:46.507 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.810+0000 7fca7b200640 1 --2- 172.21.15.1:0/3330646729 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca74109930 0x7fca74109d30 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fca64009820 tx=0x7fca6402a270 comp rx=0 tx=0).stop 2024-09-15T22:14:46.507 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.810+0000 7fca7b200640 1 -- 172.21.15.1:0/3330646729 shutdown_connections 2024-09-15T22:14:46.507 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.810+0000 7fca7b200640 1 --2- 172.21.15.1:0/3330646729 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca74109930 0x7fca74109d30 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:46.507 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.810+0000 7fca7b200640 1 -- 172.21.15.1:0/3330646729 >> 172.21.15.1:0/3330646729 conn(0x7fca7407cfa0 msgr2=0x7fca7407d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:46.507 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.810+0000 7fca7b200640 1 -- 172.21.15.1:0/3330646729 shutdown_connections 2024-09-15T22:14:46.507 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.811+0000 7fca7b200640 1 -- 172.21.15.1:0/3330646729 wait complete. 2024-09-15T22:14:46.507 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.811+0000 7fca7b200640 1 Processor -- start 2024-09-15T22:14:46.507 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.812+0000 7fca7b200640 1 -- start start 2024-09-15T22:14:46.507 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.812+0000 7fca7b200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca74109930 0x7fca7419d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:46.507 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.812+0000 7fca7b200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fca7410ded0 con 0x7fca74109930 2024-09-15T22:14:46.508 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.812+0000 7fca73e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca74109930 0x7fca7419d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:46.508 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.812+0000 7fca73e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca74109930 0x7fca7419d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45944/0 (socket says 172.21.15.1:45944) 2024-09-15T22:14:46.508 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.812+0000 7fca73e00640 1 -- 172.21.15.1:0/3113418974 learned_addr learned my addr 172.21.15.1:0/3113418974 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:14:46.508 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.813+0000 7fca73e00640 1 -- 172.21.15.1:0/3113418974 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca7419de80 con 0x7fca74109930 2024-09-15T22:14:46.508 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.813+0000 7fca73e00640 1 --2- 172.21.15.1:0/3113418974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca74109930 0x7fca7419d940 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fca640097f0 tx=0x7fca64030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:46.509 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.813+0000 7fca70c00640 1 -- 172.21.15.1:0/3113418974 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca64037040 con 0x7fca74109930 2024-09-15T22:14:46.509 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.813+0000 7fca70c00640 1 -- 172.21.15.1:0/3113418974 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fca64040070 con 0x7fca74109930 2024-09-15T22:14:46.509 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.813+0000 7fca70c00640 1 -- 172.21.15.1:0/3113418974 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca6403a390 con 0x7fca74109930 2024-09-15T22:14:46.509 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.813+0000 7fca7b200640 1 -- 172.21.15.1:0/3113418974 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca7419e110 con 0x7fca74109930 2024-09-15T22:14:46.509 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.813+0000 7fca7b200640 1 -- 172.21.15.1:0/3113418974 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca741a0e00 con 0x7fca74109930 2024-09-15T22:14:46.509 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.814+0000 7fca70c00640 1 -- 172.21.15.1:0/3113418974 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fca6403a5e0 con 0x7fca74109930 2024-09-15T22:14:46.509 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.814+0000 7fca70c00640 1 -- 172.21.15.1:0/3113418974 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fca64045950 con 0x7fca74109930 2024-09-15T22:14:46.509 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.815+0000 7fca7b200640 1 -- 172.21.15.1:0/3113418974 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca7410e050 con 0x7fca74109930 2024-09-15T22:14:46.509 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.818+0000 7fca70c00640 1 -- 172.21.15.1:0/3113418974 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fca64045460 con 0x7fca74109930 2024-09-15T22:14:46.510 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.881+0000 7fca7b200640 1 -- 172.21.15.1:0/3113418974 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fca741a1120 con 0x7fca74109930 2024-09-15T22:14:46.510 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.883+0000 7fca70c00640 1 -- 172.21.15.1:0/3113418974 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fca6403b430 con 0x7fca74109930 2024-09-15T22:14:46.510 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.884+0000 7fca7b200640 1 -- 172.21.15.1:0/3113418974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca74109930 msgr2=0x7fca7419d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:46.510 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.884+0000 7fca7b200640 1 --2- 172.21.15.1:0/3113418974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca74109930 0x7fca7419d940 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fca640097f0 tx=0x7fca64030d80 comp rx=0 tx=0).stop 2024-09-15T22:14:46.510 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.884+0000 7fca7b200640 1 -- 172.21.15.1:0/3113418974 shutdown_connections 2024-09-15T22:14:46.510 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.884+0000 7fca7b200640 1 --2- 172.21.15.1:0/3113418974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca74109930 0x7fca7419d940 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:46.510 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.884+0000 7fca7b200640 1 -- 172.21.15.1:0/3113418974 >> 172.21.15.1:0/3113418974 conn(0x7fca7407cfa0 msgr2=0x7fca74107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:46.510 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.884+0000 7fca7b200640 1 -- 172.21.15.1:0/3113418974 shutdown_connections 2024-09-15T22:14:46.510 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:45.884+0000 7fca7b200640 1 -- 172.21.15.1:0/3113418974 wait complete. 2024-09-15T22:14:46.510 INFO:teuthology.orchestra.run.smithi001.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-15T22:14:46.530 INFO:teuthology.orchestra.run.smithi001.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:14:46.530 INFO:teuthology.orchestra.run.smithi001.stdout:Creating mgr... 2024-09-15T22:14:46.531 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-15T22:14:46.531 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-15T22:14:46.888 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c1228c44-73af-11ef-bceb-c7b262605968@mgr.x 2024-09-15T22:14:46.888 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c1228c44-73af-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-c1228c44-73af-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-15T22:14:47.119 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c1228c44-73af-11ef-bceb-c7b262605968.target.wants/ceph-c1228c44-73af-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-c1228c44-73af-11ef-bceb-c7b262605968@.service. 2024-09-15T22:14:47.149 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:46 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/3113418974' entity='client.admin' 2024-09-15T22:14:47.461 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:47 smithi001 systemd[1]: Starting Ceph mgr.x for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:14:47.777 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:47 smithi001 podman[31051]: 2024-09-15 22:14:47.363685802 +0000 UTC m=+0.027409605 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:14:47.777 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:47 smithi001 podman[31051]: 2024-09-15 22:14:47.494381236 +0000 UTC m=+0.158105039 container create 3c111bd85901850cdda8eb5cbe879bde1ef55c9f73e45141bbe3bf4771dd40b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e) 2024-09-15T22:14:47.777 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:47 smithi001 podman[31051]: 2024-09-15 22:14:47.692484447 +0000 UTC m=+0.356208273 container init 3c111bd85901850cdda8eb5cbe879bde1ef55c9f73e45141bbe3bf4771dd40b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:14:47.777 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:47 smithi001 podman[31051]: 2024-09-15 22:14:47.698399246 +0000 UTC m=+0.362123056 container start 3c111bd85901850cdda8eb5cbe879bde1ef55c9f73e45141bbe3bf4771dd40b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-15T22:14:47.803 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-15T22:14:47.804 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout disabled 2024-09-15T22:14:47.817 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-15T22:14:47.817 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-15T22:14:47.818 INFO:teuthology.orchestra.run.smithi001.stdout:firewalld.service is not enabled 2024-09-15T22:14:47.818 INFO:teuthology.orchestra.run.smithi001.stdout:Not possible to enable service . firewalld.service is not available 2024-09-15T22:14:47.835 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-15T22:14:47.835 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout disabled 2024-09-15T22:14:47.849 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-15T22:14:47.849 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-15T22:14:47.849 INFO:teuthology.orchestra.run.smithi001.stdout:firewalld.service is not enabled 2024-09-15T22:14:47.849 INFO:teuthology.orchestra.run.smithi001.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-15T22:14:47.849 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mgr to start... 2024-09-15T22:14:47.849 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mgr... 2024-09-15T22:14:48.103 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:47 smithi001 bash[31051]: 3c111bd85901850cdda8eb5cbe879bde1ef55c9f73e45141bbe3bf4771dd40b7 2024-09-15T22:14:48.104 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:47 smithi001 systemd[1]: Started Ceph mgr.x for c1228c44-73af-11ef-bceb-c7b262605968. 2024-09-15T22:14:48.104 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:47 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:14:47.869+0000 7f7911a23040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:14:48.104 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:47 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:14:47.943+0000 7f7911a23040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:14:48.363 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:48 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:14:48.146+0000 7f7911a23040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:14:48.363 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:48 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:14:48.229+0000 7f7911a23040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:14:48.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:48 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/3684505123' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-15T22:14:48.626 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:48 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:14:48.414+0000 7f7911a23040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:14:48.626 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:48 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:14:48.598+0000 7f7911a23040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:14:49.091 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:48 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:14:48.990+0000 7f7911a23040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:14:49.092 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:49 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:14:49.064+0000 7f7911a23040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:14:49.102 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-15T22:14:49.103 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:14:49.103 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsid": "c1228c44-73af-11ef-bceb-c7b262605968", 2024-09-15T22:14:49.103 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "health": { 2024-09-15T22:14:49.103 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-15T22:14:49.103 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-15T22:14:49.103 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-15T22:14:49.103 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:14:49.103 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-15T22:14:49.103 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-15T22:14:49.104 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 0 2024-09-15T22:14:49.104 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:14:49.104 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-15T22:14:49.104 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "a" 2024-09-15T22:14:49.104 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:14:49.104 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-15T22:14:49.104 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-15T22:14:49.104 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:14:49.104 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-15T22:14:49.105 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-15T22:14:49.105 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:14:49.105 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-15T22:14:49.105 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:14:49.105 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-15T22:14:49.105 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-15T22:14:49.105 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-15T22:14:49.113 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-15T22:14:49.113 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-15T22:14:49.113 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-15T22:14:49.113 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:14:49.114 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-15T22:14:49.114 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-15T22:14:49.114 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-15T22:14:49.114 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-15T22:14:49.114 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-15T22:14:49.114 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-15T22:14:49.114 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-15T22:14:49.114 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-15T22:14:49.114 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-15T22:14:49.114 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:14:49.114 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-15T22:14:49.115 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:14:49.115 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "btime": "2024-09-15T22:14:39:004349+0000", 2024-09-15T22:14:49.115 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-15T22:14:49.115 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-15T22:14:49.115 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:14:49.115 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-15T22:14:49.115 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-15T22:14:49.115 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-15T22:14:49.115 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-15T22:14:49.115 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-15T22:14:49.115 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-15T22:14:49.116 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "restful" 2024-09-15T22:14:49.116 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:14:49.116 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T22:14:49.116 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:14:49.116 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-15T22:14:49.116 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:14:49.116 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modified": "2024-09-15T22:14:39.005096+0000", 2024-09-15T22:14:49.116 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T22:14:49.116 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:14:49.116 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-15T22:14:49.116 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:14:49.117 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.329+0000 7fd4e1e00640 1 Processor -- start 2024-09-15T22:14:49.117 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.329+0000 7fd4e1e00640 1 -- start start 2024-09-15T22:14:49.117 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.329+0000 7fd4e1e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4dc109930 0x7fd4dc109d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:49.117 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.329+0000 7fd4e1e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd4dc10a300 con 0x7fd4dc109930 2024-09-15T22:14:49.117 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.330+0000 7fd4daa00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4dc109930 0x7fd4dc109d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:49.117 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.330+0000 7fd4daa00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4dc109930 0x7fd4dc109d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57150/0 (socket says 172.21.15.1:57150) 2024-09-15T22:14:49.117 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.330+0000 7fd4daa00640 1 -- 172.21.15.1:0/40788693 learned_addr learned my addr 172.21.15.1:0/40788693 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:14:49.117 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.330+0000 7fd4daa00640 1 -- 172.21.15.1:0/40788693 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4dc10ab20 con 0x7fd4dc109930 2024-09-15T22:14:49.117 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.331+0000 7fd4daa00640 1 --2- 172.21.15.1:0/40788693 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4dc109930 0x7fd4dc109d30 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc009820 tx=0x7fd4cc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bde2a71f5f0c3d92 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:49.117 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.331+0000 7fd4d9600640 1 -- 172.21.15.1:0/40788693 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4cc037070 con 0x7fd4dc109930 2024-09-15T22:14:49.117 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.332+0000 7fd4d9600640 1 -- 172.21.15.1:0/40788693 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd4cc032900 con 0x7fd4dc109930 2024-09-15T22:14:49.118 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.332+0000 7fd4d9600640 1 -- 172.21.15.1:0/40788693 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4cc030850 con 0x7fd4dc109930 2024-09-15T22:14:49.118 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.332+0000 7fd4e1e00640 1 -- 172.21.15.1:0/40788693 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4dc109930 msgr2=0x7fd4dc109d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:49.118 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.332+0000 7fd4e1e00640 1 --2- 172.21.15.1:0/40788693 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4dc109930 0x7fd4dc109d30 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc009820 tx=0x7fd4cc02a270 comp rx=0 tx=0).stop 2024-09-15T22:14:49.118 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.332+0000 7fd4e1e00640 1 -- 172.21.15.1:0/40788693 shutdown_connections 2024-09-15T22:14:49.118 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.332+0000 7fd4e1e00640 1 --2- 172.21.15.1:0/40788693 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4dc109930 0x7fd4dc109d30 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:49.118 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.332+0000 7fd4e1e00640 1 -- 172.21.15.1:0/40788693 >> 172.21.15.1:0/40788693 conn(0x7fd4dc07cfa0 msgr2=0x7fd4dc07d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:49.118 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.332+0000 7fd4e1e00640 1 -- 172.21.15.1:0/40788693 shutdown_connections 2024-09-15T22:14:49.118 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.332+0000 7fd4e1e00640 1 -- 172.21.15.1:0/40788693 wait complete. 2024-09-15T22:14:49.118 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.334+0000 7fd4e1e00640 1 Processor -- start 2024-09-15T22:14:49.118 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.334+0000 7fd4e1e00640 1 -- start start 2024-09-15T22:14:49.118 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.334+0000 7fd4e1e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4dc109930 0x7fd4dc19d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:49.119 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.334+0000 7fd4e1e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd4dc10ded0 con 0x7fd4dc109930 2024-09-15T22:14:49.119 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.335+0000 7fd4daa00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4dc109930 0x7fd4dc19d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:49.119 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.335+0000 7fd4daa00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4dc109930 0x7fd4dc19d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57154/0 (socket says 172.21.15.1:57154) 2024-09-15T22:14:49.119 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.335+0000 7fd4daa00640 1 -- 172.21.15.1:0/3684505123 learned_addr learned my addr 172.21.15.1:0/3684505123 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:14:49.119 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.335+0000 7fd4daa00640 1 -- 172.21.15.1:0/3684505123 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4dc19de80 con 0x7fd4dc109930 2024-09-15T22:14:49.119 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.335+0000 7fd4daa00640 1 --2- 172.21.15.1:0/3684505123 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4dc109930 0x7fd4dc19d940 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc0097f0 tx=0x7fd4cc030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:49.119 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.336+0000 7fd4e0a00640 1 -- 172.21.15.1:0/3684505123 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4cc037040 con 0x7fd4dc109930 2024-09-15T22:14:49.119 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.336+0000 7fd4e0a00640 1 -- 172.21.15.1:0/3684505123 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd4cc040070 con 0x7fd4dc109930 2024-09-15T22:14:49.119 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.336+0000 7fd4e1e00640 1 -- 172.21.15.1:0/3684505123 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4dc19e110 con 0x7fd4dc109930 2024-09-15T22:14:49.119 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.336+0000 7fd4e0a00640 1 -- 172.21.15.1:0/3684505123 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4cc03a390 con 0x7fd4dc109930 2024-09-15T22:14:49.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.336+0000 7fd4e1e00640 1 -- 172.21.15.1:0/3684505123 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4dc1a0e00 con 0x7fd4dc109930 2024-09-15T22:14:49.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.336+0000 7fd4e0a00640 1 -- 172.21.15.1:0/3684505123 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd4cc03a630 con 0x7fd4dc109930 2024-09-15T22:14:49.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.336+0000 7fd4e0a00640 1 -- 172.21.15.1:0/3684505123 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd4cc0459a0 con 0x7fd4dc109930 2024-09-15T22:14:49.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.337+0000 7fd4e1e00640 1 -- 172.21.15.1:0/3684505123 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4dc109db0 con 0x7fd4dc109930 2024-09-15T22:14:49.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.339+0000 7fd4e0a00640 1 -- 172.21.15.1:0/3684505123 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd4cc045460 con 0x7fd4dc109930 2024-09-15T22:14:49.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.406+0000 7fd4e1e00640 1 -- 172.21.15.1:0/3684505123 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fd4dc1a0fd0 con 0x7fd4dc109930 2024-09-15T22:14:49.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.407+0000 7fd4e0a00640 1 -- 172.21.15.1:0/3684505123 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fd4cc03b430 con 0x7fd4dc109930 2024-09-15T22:14:49.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.408+0000 7fd4e1e00640 1 -- 172.21.15.1:0/3684505123 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4dc109930 msgr2=0x7fd4dc19d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:49.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.408+0000 7fd4e1e00640 1 --2- 172.21.15.1:0/3684505123 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4dc109930 0x7fd4dc19d940 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc0097f0 tx=0x7fd4cc030d80 comp rx=0 tx=0).stop 2024-09-15T22:14:49.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.408+0000 7fd4e1e00640 1 -- 172.21.15.1:0/3684505123 shutdown_connections 2024-09-15T22:14:49.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.408+0000 7fd4e1e00640 1 --2- 172.21.15.1:0/3684505123 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4dc109930 0x7fd4dc19d940 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:49.121 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.408+0000 7fd4e1e00640 1 -- 172.21.15.1:0/3684505123 >> 172.21.15.1:0/3684505123 conn(0x7fd4dc07cfa0 msgr2=0x7fd4dc107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:49.121 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.408+0000 7fd4e1e00640 1 -- 172.21.15.1:0/3684505123 shutdown_connections 2024-09-15T22:14:49.121 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:48.408+0000 7fd4e1e00640 1 -- 172.21.15.1:0/3684505123 wait complete. 2024-09-15T22:14:49.121 INFO:teuthology.orchestra.run.smithi001.stdout:mgr not available, waiting (1/15)... 2024-09-15T22:14:49.376 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:49 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:14:49.288+0000 7f7911a23040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:14:50.876 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:50 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:14:50.437+0000 7f7911a23040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:14:50.876 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:50 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:14:50.520+0000 7f7911a23040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:14:51.834 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:51 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/2114084315' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-15T22:14:51.835 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:51 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:14:51.508+0000 7f7911a23040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:14:51.835 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:51 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:14:51.655+0000 7f7911a23040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:14:51.835 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:51 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:14:51.832+0000 7f7911a23040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:14:52.090 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:51 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:14:51.908+0000 7f7911a23040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:14:52.091 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:52 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:14:52.088+0000 7f7911a23040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:14:52.364 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:52 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:14:52.173+0000 7f7911a23040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:14:52.364 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:52 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:14:52.247+0000 7f7911a23040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:14:52.380 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-15T22:14:52.380 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:14:52.380 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsid": "c1228c44-73af-11ef-bceb-c7b262605968", 2024-09-15T22:14:52.380 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "health": { 2024-09-15T22:14:52.380 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-15T22:14:52.380 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-15T22:14:52.380 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-15T22:14:52.380 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:14:52.380 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-15T22:14:52.380 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-15T22:14:52.380 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 0 2024-09-15T22:14:52.380 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:14:52.381 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-15T22:14:52.381 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "a" 2024-09-15T22:14:52.381 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:14:52.381 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-15T22:14:52.381 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-15T22:14:52.381 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:14:52.381 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-15T22:14:52.381 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-15T22:14:52.381 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:14:52.381 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-15T22:14:52.381 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:14:52.381 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-15T22:14:52.381 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-15T22:14:52.381 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-15T22:14:52.390 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-15T22:14:52.390 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-15T22:14:52.390 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-15T22:14:52.390 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:14:52.390 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-15T22:14:52.390 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-15T22:14:52.390 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-15T22:14:52.390 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-15T22:14:52.390 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-15T22:14:52.390 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-15T22:14:52.390 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-15T22:14:52.390 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-15T22:14:52.391 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-15T22:14:52.391 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:14:52.391 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-15T22:14:52.391 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:14:52.391 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "btime": "2024-09-15T22:14:39:004349+0000", 2024-09-15T22:14:52.391 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-15T22:14:52.391 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-15T22:14:52.391 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:14:52.391 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-15T22:14:52.391 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-15T22:14:52.391 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-15T22:14:52.391 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-15T22:14:52.391 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-15T22:14:52.391 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-15T22:14:52.391 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "restful" 2024-09-15T22:14:52.392 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:14:52.392 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T22:14:52.392 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:14:52.392 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-15T22:14:52.392 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:14:52.392 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modified": "2024-09-15T22:14:39.005096+0000", 2024-09-15T22:14:52.392 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T22:14:52.392 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:14:52.392 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-15T22:14:52.392 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:14:52.392 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.602+0000 7fd05ea00640 1 Processor -- start 2024-09-15T22:14:52.392 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.602+0000 7fd05ea00640 1 -- start start 2024-09-15T22:14:52.393 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.602+0000 7fd05ea00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd058109930 0x7fd058109d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:52.393 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.602+0000 7fd05ea00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd05810a300 con 0x7fd058109930 2024-09-15T22:14:52.393 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.602+0000 7fd057e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd058109930 0x7fd058109d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:52.393 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.602+0000 7fd057e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd058109930 0x7fd058109d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57168/0 (socket says 172.21.15.1:57168) 2024-09-15T22:14:52.393 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.602+0000 7fd057e00640 1 -- 172.21.15.1:0/3468304782 learned_addr learned my addr 172.21.15.1:0/3468304782 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:14:52.393 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.603+0000 7fd057e00640 1 -- 172.21.15.1:0/3468304782 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd05810ab20 con 0x7fd058109930 2024-09-15T22:14:52.393 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.604+0000 7fd057e00640 1 --2- 172.21.15.1:0/3468304782 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd058109930 0x7fd058109d30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd048009820 tx=0x7fd04802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e636c91714c0a3ed server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:52.393 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.604+0000 7fd056a00640 1 -- 172.21.15.1:0/3468304782 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd048037070 con 0x7fd058109930 2024-09-15T22:14:52.393 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.604+0000 7fd056a00640 1 -- 172.21.15.1:0/3468304782 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd048032900 con 0x7fd058109930 2024-09-15T22:14:52.393 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.604+0000 7fd056a00640 1 -- 172.21.15.1:0/3468304782 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd048030850 con 0x7fd058109930 2024-09-15T22:14:52.393 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.605+0000 7fd05ea00640 1 -- 172.21.15.1:0/3468304782 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd058109930 msgr2=0x7fd058109d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:52.393 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.605+0000 7fd05ea00640 1 --2- 172.21.15.1:0/3468304782 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd058109930 0x7fd058109d30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd048009820 tx=0x7fd04802a270 comp rx=0 tx=0).stop 2024-09-15T22:14:52.393 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.605+0000 7fd05ea00640 1 -- 172.21.15.1:0/3468304782 shutdown_connections 2024-09-15T22:14:52.394 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.605+0000 7fd05ea00640 1 --2- 172.21.15.1:0/3468304782 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd058109930 0x7fd058109d30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:52.394 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.605+0000 7fd05ea00640 1 -- 172.21.15.1:0/3468304782 >> 172.21.15.1:0/3468304782 conn(0x7fd05807cfa0 msgr2=0x7fd05807d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:52.394 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.605+0000 7fd05ea00640 1 -- 172.21.15.1:0/3468304782 shutdown_connections 2024-09-15T22:14:52.394 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.605+0000 7fd05ea00640 1 -- 172.21.15.1:0/3468304782 wait complete. 2024-09-15T22:14:52.394 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.606+0000 7fd05ea00640 1 Processor -- start 2024-09-15T22:14:52.394 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.606+0000 7fd05ea00640 1 -- start start 2024-09-15T22:14:52.394 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.606+0000 7fd05ea00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd058109930 0x7fd05819d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:52.394 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.606+0000 7fd05ea00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd05810ded0 con 0x7fd058109930 2024-09-15T22:14:52.394 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.607+0000 7fd057e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd058109930 0x7fd05819d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:52.394 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.607+0000 7fd057e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd058109930 0x7fd05819d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57172/0 (socket says 172.21.15.1:57172) 2024-09-15T22:14:52.394 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.607+0000 7fd057e00640 1 -- 172.21.15.1:0/2114084315 learned_addr learned my addr 172.21.15.1:0/2114084315 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:14:52.394 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.607+0000 7fd057e00640 1 -- 172.21.15.1:0/2114084315 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd05819de80 con 0x7fd058109930 2024-09-15T22:14:52.394 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.607+0000 7fd057e00640 1 --2- 172.21.15.1:0/2114084315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd058109930 0x7fd05819d940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd0480097f0 tx=0x7fd048030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:52.394 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.608+0000 7fd054c00640 1 -- 172.21.15.1:0/2114084315 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd048037040 con 0x7fd058109930 2024-09-15T22:14:52.395 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.608+0000 7fd054c00640 1 -- 172.21.15.1:0/2114084315 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd048040070 con 0x7fd058109930 2024-09-15T22:14:52.395 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.608+0000 7fd05ea00640 1 -- 172.21.15.1:0/2114084315 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd05819e110 con 0x7fd058109930 2024-09-15T22:14:52.395 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.608+0000 7fd054c00640 1 -- 172.21.15.1:0/2114084315 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd04803a390 con 0x7fd058109930 2024-09-15T22:14:52.395 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.608+0000 7fd05ea00640 1 -- 172.21.15.1:0/2114084315 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0581a0e00 con 0x7fd058109930 2024-09-15T22:14:52.395 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.608+0000 7fd054c00640 1 -- 172.21.15.1:0/2114084315 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd04803a5e0 con 0x7fd058109930 2024-09-15T22:14:52.395 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.608+0000 7fd054c00640 1 -- 172.21.15.1:0/2114084315 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd048045950 con 0x7fd058109930 2024-09-15T22:14:52.395 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.609+0000 7fd05ea00640 1 -- 172.21.15.1:0/2114084315 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd058109db0 con 0x7fd058109930 2024-09-15T22:14:52.395 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.612+0000 7fd054c00640 1 -- 172.21.15.1:0/2114084315 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd048045460 con 0x7fd058109930 2024-09-15T22:14:52.395 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.677+0000 7fd05ea00640 1 -- 172.21.15.1:0/2114084315 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fd0581a0fd0 con 0x7fd058109930 2024-09-15T22:14:52.395 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.678+0000 7fd054c00640 1 -- 172.21.15.1:0/2114084315 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fd04803b430 con 0x7fd058109930 2024-09-15T22:14:52.395 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.679+0000 7fd05ea00640 1 -- 172.21.15.1:0/2114084315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd058109930 msgr2=0x7fd05819d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:52.395 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.679+0000 7fd05ea00640 1 --2- 172.21.15.1:0/2114084315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd058109930 0x7fd05819d940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd0480097f0 tx=0x7fd048030d80 comp rx=0 tx=0).stop 2024-09-15T22:14:52.395 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.679+0000 7fd05ea00640 1 -- 172.21.15.1:0/2114084315 shutdown_connections 2024-09-15T22:14:52.395 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.679+0000 7fd05ea00640 1 --2- 172.21.15.1:0/2114084315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd058109930 0x7fd05819d940 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:52.396 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.679+0000 7fd05ea00640 1 -- 172.21.15.1:0/2114084315 >> 172.21.15.1:0/2114084315 conn(0x7fd05807cfa0 msgr2=0x7fd058107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:52.396 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.679+0000 7fd05ea00640 1 -- 172.21.15.1:0/2114084315 shutdown_connections 2024-09-15T22:14:52.396 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:51.679+0000 7fd05ea00640 1 -- 172.21.15.1:0/2114084315 wait complete. 2024-09-15T22:14:52.396 INFO:teuthology.orchestra.run.smithi001.stdout:mgr not available, waiting (2/15)... 2024-09-15T22:14:52.626 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:52 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:14:52.448+0000 7f7911a23040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:14:52.626 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:52 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:14:52.529+0000 7f7911a23040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:14:52.626 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:52 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:14:52.611+0000 7f7911a23040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:14:53.126 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:52 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:14:52.712+0000 7f7911a23040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:14:53.126 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:52 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:14:52.785+0000 7f7911a23040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:14:53.126 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:52 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:14:52.858+0000 7f7911a23040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:14:54.126 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:53 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:14:53.813+0000 7f7911a23040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:14:54.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:53 smithi001 ceph-mon[30843]: Activating manager daemon x 2024-09-15T22:14:54.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:53 smithi001 ceph-mon[30843]: mgrmap e2: x(active, starting, since 0.00396662s) 2024-09-15T22:14:54.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:53 smithi001 ceph-mon[30843]: from='mgr.14100 172.21.15.1:0/1855127556' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T22:14:54.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:53 smithi001 ceph-mon[30843]: from='mgr.14100 172.21.15.1:0/1855127556' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T22:14:54.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:53 smithi001 ceph-mon[30843]: from='mgr.14100 172.21.15.1:0/1855127556' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T22:14:54.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:53 smithi001 ceph-mon[30843]: from='mgr.14100 172.21.15.1:0/1855127556' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:14:54.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:53 smithi001 ceph-mon[30843]: from='mgr.14100 172.21.15.1:0/1855127556' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T22:14:54.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:53 smithi001 ceph-mon[30843]: Manager daemon x is now available 2024-09-15T22:14:54.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:53 smithi001 ceph-mon[30843]: from='mgr.14100 172.21.15.1:0/1855127556' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-15T22:14:54.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:53 smithi001 ceph-mon[30843]: from='mgr.14100 172.21.15.1:0/1855127556' entity='mgr.x' 2024-09-15T22:14:54.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:53 smithi001 ceph-mon[30843]: from='mgr.14100 172.21.15.1:0/1855127556' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-15T22:14:54.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:53 smithi001 ceph-mon[30843]: from='mgr.14100 172.21.15.1:0/1855127556' entity='mgr.x' 2024-09-15T22:14:54.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:53 smithi001 ceph-mon[30843]: from='mgr.14100 172.21.15.1:0/1855127556' entity='mgr.x' 2024-09-15T22:14:55.689 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-15T22:14:55.689 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:14:55.689 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsid": "c1228c44-73af-11ef-bceb-c7b262605968", 2024-09-15T22:14:55.689 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "health": { 2024-09-15T22:14:55.689 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-15T22:14:55.689 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-15T22:14:55.690 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-15T22:14:55.690 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:14:55.690 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-15T22:14:55.690 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-15T22:14:55.690 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 0 2024-09-15T22:14:55.690 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:14:55.690 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-15T22:14:55.690 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "a" 2024-09-15T22:14:55.690 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:14:55.690 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-15T22:14:55.690 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-15T22:14:55.690 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:14:55.690 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-15T22:14:55.690 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-15T22:14:55.691 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:14:55.691 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-15T22:14:55.691 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:14:55.691 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-15T22:14:55.691 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-15T22:14:55.691 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-15T22:14:55.691 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-15T22:14:55.691 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-15T22:14:55.691 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-15T22:14:55.691 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:14:55.691 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-15T22:14:55.691 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-15T22:14:55.691 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-15T22:14:55.692 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-15T22:14:55.692 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-15T22:14:55.692 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-15T22:14:55.692 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-15T22:14:55.692 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-15T22:14:55.692 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-15T22:14:55.692 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:14:55.692 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-15T22:14:55.692 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:14:55.692 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "btime": "2024-09-15T22:14:39:004349+0000", 2024-09-15T22:14:55.692 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-15T22:14:55.692 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-15T22:14:55.692 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:14:55.693 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-15T22:14:55.693 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-15T22:14:55.693 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-15T22:14:55.693 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-15T22:14:55.693 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-15T22:14:55.693 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-15T22:14:55.693 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "restful" 2024-09-15T22:14:55.693 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:14:55.693 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T22:14:55.693 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:14:55.693 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-15T22:14:55.693 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:14:55.693 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modified": "2024-09-15T22:14:39.005096+0000", 2024-09-15T22:14:55.694 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T22:14:55.694 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:14:55.694 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-15T22:14:55.694 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:14:55.694 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.842+0000 7fd8d7c00640 1 Processor -- start 2024-09-15T22:14:55.694 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.842+0000 7fd8d7c00640 1 -- start start 2024-09-15T22:14:55.694 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.842+0000 7fd8d7c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8d0109930 0x7fd8d0109d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:55.694 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.842+0000 7fd8d7c00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d010a300 con 0x7fd8d0109930 2024-09-15T22:14:55.694 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.843+0000 7fd8d5200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8d0109930 0x7fd8d0109d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:55.694 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.843+0000 7fd8d5200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8d0109930 0x7fd8d0109d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57242/0 (socket says 172.21.15.1:57242) 2024-09-15T22:14:55.694 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.843+0000 7fd8d5200640 1 -- 172.21.15.1:0/3516684243 learned_addr learned my addr 172.21.15.1:0/3516684243 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:14:55.694 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.843+0000 7fd8d5200640 1 -- 172.21.15.1:0/3516684243 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d010ab20 con 0x7fd8d0109930 2024-09-15T22:14:55.694 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.844+0000 7fd8d5200640 1 --2- 172.21.15.1:0/3516684243 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8d0109930 0x7fd8d0109d30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4009820 tx=0x7fd8c402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80d3da82260fff44 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:55.695 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.845+0000 7fd8cf400640 1 -- 172.21.15.1:0/3516684243 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8c4037070 con 0x7fd8d0109930 2024-09-15T22:14:55.695 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.845+0000 7fd8cf400640 1 -- 172.21.15.1:0/3516684243 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd8c4032900 con 0x7fd8d0109930 2024-09-15T22:14:55.695 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.845+0000 7fd8cf400640 1 -- 172.21.15.1:0/3516684243 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8c4030850 con 0x7fd8d0109930 2024-09-15T22:14:55.695 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.845+0000 7fd8d7c00640 1 -- 172.21.15.1:0/3516684243 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8d0109930 msgr2=0x7fd8d0109d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:55.695 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.845+0000 7fd8d7c00640 1 --2- 172.21.15.1:0/3516684243 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8d0109930 0x7fd8d0109d30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4009820 tx=0x7fd8c402a270 comp rx=0 tx=0).stop 2024-09-15T22:14:55.695 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.845+0000 7fd8d7c00640 1 -- 172.21.15.1:0/3516684243 shutdown_connections 2024-09-15T22:14:55.695 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.845+0000 7fd8d7c00640 1 --2- 172.21.15.1:0/3516684243 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8d0109930 0x7fd8d0109d30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:55.695 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.845+0000 7fd8d7c00640 1 -- 172.21.15.1:0/3516684243 >> 172.21.15.1:0/3516684243 conn(0x7fd8d007cfa0 msgr2=0x7fd8d007d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:55.695 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.845+0000 7fd8d7c00640 1 -- 172.21.15.1:0/3516684243 shutdown_connections 2024-09-15T22:14:55.695 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.846+0000 7fd8d7c00640 1 -- 172.21.15.1:0/3516684243 wait complete. 2024-09-15T22:14:55.695 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.846+0000 7fd8d7c00640 1 Processor -- start 2024-09-15T22:14:55.695 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.846+0000 7fd8d7c00640 1 -- start start 2024-09-15T22:14:55.696 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.847+0000 7fd8d7c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8d0109930 0x7fd8d019d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:55.696 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.847+0000 7fd8d7c00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d010ded0 con 0x7fd8d0109930 2024-09-15T22:14:55.696 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.847+0000 7fd8d5200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8d0109930 0x7fd8d019d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:55.696 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.847+0000 7fd8d5200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8d0109930 0x7fd8d019d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57248/0 (socket says 172.21.15.1:57248) 2024-09-15T22:14:55.696 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.847+0000 7fd8d5200640 1 -- 172.21.15.1:0/4201722689 learned_addr learned my addr 172.21.15.1:0/4201722689 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:14:55.696 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.847+0000 7fd8d5200640 1 -- 172.21.15.1:0/4201722689 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d019de80 con 0x7fd8d0109930 2024-09-15T22:14:55.696 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.847+0000 7fd8d5200640 1 --2- 172.21.15.1:0/4201722689 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8d0109930 0x7fd8d019d940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd8c40097f0 tx=0x7fd8c4030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:55.696 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.848+0000 7fd8cd600640 1 -- 172.21.15.1:0/4201722689 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8c4037040 con 0x7fd8d0109930 2024-09-15T22:14:55.696 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.848+0000 7fd8cd600640 1 -- 172.21.15.1:0/4201722689 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd8c4040070 con 0x7fd8d0109930 2024-09-15T22:14:55.696 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.848+0000 7fd8cd600640 1 -- 172.21.15.1:0/4201722689 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8c403a390 con 0x7fd8d0109930 2024-09-15T22:14:55.696 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.848+0000 7fd8d7c00640 1 -- 172.21.15.1:0/4201722689 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8d019e110 con 0x7fd8d0109930 2024-09-15T22:14:55.696 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.848+0000 7fd8d7c00640 1 -- 172.21.15.1:0/4201722689 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8d01a0e00 con 0x7fd8d0109930 2024-09-15T22:14:55.697 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.849+0000 7fd8d7c00640 1 -- 172.21.15.1:0/4201722689 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8d0109db0 con 0x7fd8d0109930 2024-09-15T22:14:55.697 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.849+0000 7fd8cd600640 1 -- 172.21.15.1:0/4201722689 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 3) ==== 46344+0+0 (secure 0 0 0) 0x7fd8c4032900 con 0x7fd8d0109930 2024-09-15T22:14:55.697 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.850+0000 7fd8cd600640 1 --2- 172.21.15.1:0/4201722689 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7fd8b80390a0 0x7fd8b803b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:55.697 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.850+0000 7fd8cd600640 1 -- 172.21.15.1:0/4201722689 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd8c406c150 con 0x7fd8d0109930 2024-09-15T22:14:55.697 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.850+0000 7fd8cfe00640 1 --2- 172.21.15.1:0/4201722689 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7fd8b80390a0 0x7fd8b803b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:55.697 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.850+0000 7fd8cfe00640 1 --2- 172.21.15.1:0/4201722689 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7fd8b80390a0 0x7fd8b803b560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc0098c0 tx=0x7fd8bc006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:55.697 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:54.855+0000 7fd8cd600640 1 -- 172.21.15.1:0/4201722689 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd8c4032bf0 con 0x7fd8d0109930 2024-09-15T22:14:55.697 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:55.110+0000 7fd8d7c00640 1 -- 172.21.15.1:0/4201722689 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fd8d019e590 con 0x7fd8d0109930 2024-09-15T22:14:55.697 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:55.110+0000 7fd8cd600640 1 -- 172.21.15.1:0/4201722689 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7fd8c4040cc0 con 0x7fd8d0109930 2024-09-15T22:14:55.697 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:55.112+0000 7fd8d7c00640 1 -- 172.21.15.1:0/4201722689 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7fd8b80390a0 msgr2=0x7fd8b803b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:55.698 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:55.112+0000 7fd8d7c00640 1 --2- 172.21.15.1:0/4201722689 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7fd8b80390a0 0x7fd8b803b560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc0098c0 tx=0x7fd8bc006db0 comp rx=0 tx=0).stop 2024-09-15T22:14:55.698 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:55.112+0000 7fd8d7c00640 1 -- 172.21.15.1:0/4201722689 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8d0109930 msgr2=0x7fd8d019d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:55.698 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:55.112+0000 7fd8d7c00640 1 --2- 172.21.15.1:0/4201722689 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8d0109930 0x7fd8d019d940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd8c40097f0 tx=0x7fd8c4030d80 comp rx=0 tx=0).stop 2024-09-15T22:14:55.698 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:55.113+0000 7fd8d7c00640 1 -- 172.21.15.1:0/4201722689 shutdown_connections 2024-09-15T22:14:55.698 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:55.113+0000 7fd8d7c00640 1 --2- 172.21.15.1:0/4201722689 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7fd8b80390a0 0x7fd8b803b560 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:55.698 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:55.113+0000 7fd8d7c00640 1 --2- 172.21.15.1:0/4201722689 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8d0109930 0x7fd8d019d940 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:55.698 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:55.113+0000 7fd8d7c00640 1 -- 172.21.15.1:0/4201722689 >> 172.21.15.1:0/4201722689 conn(0x7fd8d007cfa0 msgr2=0x7fd8d0107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:55.698 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:55.113+0000 7fd8d7c00640 1 -- 172.21.15.1:0/4201722689 shutdown_connections 2024-09-15T22:14:55.698 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:55.113+0000 7fd8d7c00640 1 -- 172.21.15.1:0/4201722689 wait complete. 2024-09-15T22:14:55.698 INFO:teuthology.orchestra.run.smithi001.stdout:mgr is available 2024-09-15T22:14:56.086 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:55 smithi001 ceph-mon[30843]: mgrmap e3: x(active, since 1.00847s) 2024-09-15T22:14:56.086 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:55 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/4201722689' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-15T22:14:57.060 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:56 smithi001 ceph-mon[30843]: mgrmap e4: x(active, since 2s) 2024-09-15T22:14:57.060 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:56 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/186101298' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-15T22:14:57.072 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-15T22:14:57.072 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [global] 2024-09-15T22:14:57.072 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout fsid = c1228c44-73af-11ef-bceb-c7b262605968 2024-09-15T22:14:57.073 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.1:3300,v1:172.21.15.1:6789] 2024-09-15T22:14:57.073 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-15T22:14:57.073 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-15T22:14:57.073 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-15T22:14:57.073 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-15T22:14:57.073 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-15T22:14:57.073 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-15T22:14:57.073 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-15T22:14:57.073 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-15T22:14:57.074 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [osd] 2024-09-15T22:14:57.074 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-15T22:14:57.074 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-15T22:14:57.074 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-15T22:14:57.074 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-15T22:14:57.074 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-15T22:14:57.074 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.191+0000 7ffa9ca00640 1 Processor -- start 2024-09-15T22:14:57.074 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.191+0000 7ffa9ca00640 1 -- start start 2024-09-15T22:14:57.074 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.191+0000 7ffa9ca00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa981075c0 0x7ffa981079c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:57.074 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.191+0000 7ffa9ca00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffa98107f90 con 0x7ffa981075c0 2024-09-15T22:14:57.074 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.192+0000 7ffa96800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa981075c0 0x7ffa981079c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:57.074 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.192+0000 7ffa96800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa981075c0 0x7ffa981079c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57258/0 (socket says 172.21.15.1:57258) 2024-09-15T22:14:57.075 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.192+0000 7ffa96800640 1 -- 172.21.15.1:0/230080458 learned_addr learned my addr 172.21.15.1:0/230080458 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:14:57.075 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.192+0000 7ffa96800640 1 -- 172.21.15.1:0/230080458 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa98108770 con 0x7ffa981075c0 2024-09-15T22:14:57.075 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.193+0000 7ffa96800640 1 --2- 172.21.15.1:0/230080458 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa981075c0 0x7ffa981079c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009820 tx=0x7ffa8802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d991602e4865311 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:57.075 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.193+0000 7ffa95e00640 1 -- 172.21.15.1:0/230080458 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa88037070 con 0x7ffa981075c0 2024-09-15T22:14:57.075 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.193+0000 7ffa95e00640 1 -- 172.21.15.1:0/230080458 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffa88032900 con 0x7ffa981075c0 2024-09-15T22:14:57.075 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.193+0000 7ffa95e00640 1 -- 172.21.15.1:0/230080458 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa88030850 con 0x7ffa981075c0 2024-09-15T22:14:57.075 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.194+0000 7ffa9ca00640 1 -- 172.21.15.1:0/230080458 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa981075c0 msgr2=0x7ffa981079c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:57.075 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.194+0000 7ffa9ca00640 1 --2- 172.21.15.1:0/230080458 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa981075c0 0x7ffa981079c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009820 tx=0x7ffa8802a270 comp rx=0 tx=0).stop 2024-09-15T22:14:57.075 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.194+0000 7ffa9ca00640 1 -- 172.21.15.1:0/230080458 shutdown_connections 2024-09-15T22:14:57.075 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.194+0000 7ffa9ca00640 1 --2- 172.21.15.1:0/230080458 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa981075c0 0x7ffa981079c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:57.075 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.194+0000 7ffa9ca00640 1 -- 172.21.15.1:0/230080458 >> 172.21.15.1:0/230080458 conn(0x7ffa98102d90 msgr2=0x7ffa981051b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:57.075 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.194+0000 7ffa9ca00640 1 -- 172.21.15.1:0/230080458 shutdown_connections 2024-09-15T22:14:57.075 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.194+0000 7ffa9ca00640 1 -- 172.21.15.1:0/230080458 wait complete. 2024-09-15T22:14:57.075 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.195+0000 7ffa9ca00640 1 Processor -- start 2024-09-15T22:14:57.076 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.195+0000 7ffa9ca00640 1 -- start start 2024-09-15T22:14:57.076 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.195+0000 7ffa9ca00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa981075c0 0x7ffa9819d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:57.076 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.195+0000 7ffa9ca00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffa9810bb20 con 0x7ffa981075c0 2024-09-15T22:14:57.076 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.196+0000 7ffa96800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa981075c0 0x7ffa9819d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:57.076 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.196+0000 7ffa96800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa981075c0 0x7ffa9819d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57264/0 (socket says 172.21.15.1:57264) 2024-09-15T22:14:57.076 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.196+0000 7ffa96800640 1 -- 172.21.15.1:0/186101298 learned_addr learned my addr 172.21.15.1:0/186101298 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:14:57.076 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.196+0000 7ffa96800640 1 -- 172.21.15.1:0/186101298 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa9819dd50 con 0x7ffa981075c0 2024-09-15T22:14:57.076 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.196+0000 7ffa96800640 1 --2- 172.21.15.1:0/186101298 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa981075c0 0x7ffa9819d810 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009940 tx=0x7ffa880326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:57.076 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.196+0000 7ffa8f400640 1 -- 172.21.15.1:0/186101298 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa88042070 con 0x7ffa981075c0 2024-09-15T22:14:57.076 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.196+0000 7ffa8f400640 1 -- 172.21.15.1:0/186101298 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffa88032be0 con 0x7ffa981075c0 2024-09-15T22:14:57.076 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.196+0000 7ffa9ca00640 1 -- 172.21.15.1:0/186101298 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa9819dfe0 con 0x7ffa981075c0 2024-09-15T22:14:57.076 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.197+0000 7ffa8f400640 1 -- 172.21.15.1:0/186101298 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa88037040 con 0x7ffa981075c0 2024-09-15T22:14:57.076 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.197+0000 7ffa9ca00640 1 -- 172.21.15.1:0/186101298 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa981a0cd0 con 0x7ffa981075c0 2024-09-15T22:14:57.077 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.198+0000 7ffa9ca00640 1 -- 172.21.15.1:0/186101298 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa9810bca0 con 0x7ffa981075c0 2024-09-15T22:14:57.077 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.198+0000 7ffa8f400640 1 -- 172.21.15.1:0/186101298 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7ffa88045070 con 0x7ffa981075c0 2024-09-15T22:14:57.077 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.198+0000 7ffa8f400640 1 --2- 172.21.15.1:0/186101298 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7ffa7c039160 0x7ffa7c03b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:57.077 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.198+0000 7ffa8f400640 1 -- 172.21.15.1:0/186101298 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ffa8806c190 con 0x7ffa981075c0 2024-09-15T22:14:57.077 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.199+0000 7ffa8fe00640 1 --2- 172.21.15.1:0/186101298 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7ffa7c039160 0x7ffa7c03b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:57.077 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.199+0000 7ffa8fe00640 1 --2- 172.21.15.1:0/186101298 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7ffa7c039160 0x7ffa7c03b620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffa800098c0 tx=0x7ffa80006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:57.077 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.203+0000 7ffa8f400640 1 -- 172.21.15.1:0/186101298 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffa8804b170 con 0x7ffa981075c0 2024-09-15T22:14:57.077 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.390+0000 7ffa9ca00640 1 -- 172.21.15.1:0/186101298 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7ffa98107a40 con 0x7ffa981075c0 2024-09-15T22:14:57.077 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.391+0000 7ffa8f400640 1 -- 172.21.15.1:0/186101298 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+427 (secure 0 0 0) 0x7ffa8806bbb0 con 0x7ffa981075c0 2024-09-15T22:14:57.077 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.394+0000 7ffa9ca00640 1 -- 172.21.15.1:0/186101298 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7ffa7c039160 msgr2=0x7ffa7c03b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:57.077 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.394+0000 7ffa9ca00640 1 --2- 172.21.15.1:0/186101298 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7ffa7c039160 0x7ffa7c03b620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffa800098c0 tx=0x7ffa80006db0 comp rx=0 tx=0).stop 2024-09-15T22:14:57.077 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.394+0000 7ffa9ca00640 1 -- 172.21.15.1:0/186101298 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa981075c0 msgr2=0x7ffa9819d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:57.077 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.394+0000 7ffa9ca00640 1 --2- 172.21.15.1:0/186101298 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa981075c0 0x7ffa9819d810 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009940 tx=0x7ffa880326e0 comp rx=0 tx=0).stop 2024-09-15T22:14:57.077 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.394+0000 7ffa9ca00640 1 -- 172.21.15.1:0/186101298 shutdown_connections 2024-09-15T22:14:57.078 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.394+0000 7ffa9ca00640 1 --2- 172.21.15.1:0/186101298 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7ffa7c039160 0x7ffa7c03b620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:57.078 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.394+0000 7ffa9ca00640 1 --2- 172.21.15.1:0/186101298 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa981075c0 0x7ffa9819d810 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:57.078 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.394+0000 7ffa9ca00640 1 -- 172.21.15.1:0/186101298 >> 172.21.15.1:0/186101298 conn(0x7ffa98102d90 msgr2=0x7ffa98103920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:57.078 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.394+0000 7ffa9ca00640 1 -- 172.21.15.1:0/186101298 shutdown_connections 2024-09-15T22:14:57.078 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:56.394+0000 7ffa9ca00640 1 -- 172.21.15.1:0/186101298 wait complete. 2024-09-15T22:14:57.078 INFO:teuthology.orchestra.run.smithi001.stdout:Enabling cephadm module... 2024-09-15T22:14:58.058 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:57 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/3054650230' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-15T22:14:58.058 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:57 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: ignoring --setuser ceph since I am not root 2024-09-15T22:14:58.058 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:57 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: ignoring --setgroup ceph since I am not root 2024-09-15T22:14:58.058 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:58 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:14:58.055+0000 7fb9d0c13040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:14:58.323 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:58 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:14:58.127+0000 7fb9d0c13040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:14:58.323 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:58 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:14:58.321+0000 7fb9d0c13040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:14:58.427 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.495+0000 7f1165800640 1 Processor -- start 2024-09-15T22:14:58.427 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.495+0000 7f1165800640 1 -- start start 2024-09-15T22:14:58.427 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.496+0000 7f1165800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f116007de20 0x7f116007c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:58.427 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.496+0000 7f1165800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f116007c850 con 0x7f116007de20 2024-09-15T22:14:58.427 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.496+0000 7f115ea00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f116007de20 0x7f116007c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:58.427 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.496+0000 7f115ea00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f116007de20 0x7f116007c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56264/0 (socket says 172.21.15.1:56264) 2024-09-15T22:14:58.427 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.496+0000 7f115ea00640 1 -- 172.21.15.1:0/791931235 learned_addr learned my addr 172.21.15.1:0/791931235 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:14:58.427 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.496+0000 7f115ea00640 1 -- 172.21.15.1:0/791931235 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f116007c9d0 con 0x7f116007de20 2024-09-15T22:14:58.427 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.497+0000 7f115ea00640 1 --2- 172.21.15.1:0/791931235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f116007de20 0x7f116007c280 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1150009820 tx=0x7f115002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f6dc3e96125e05 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:58.427 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.498+0000 7f115e000640 1 -- 172.21.15.1:0/791931235 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1150037070 con 0x7f116007de20 2024-09-15T22:14:58.428 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.498+0000 7f115e000640 1 -- 172.21.15.1:0/791931235 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1150032900 con 0x7f116007de20 2024-09-15T22:14:58.428 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.498+0000 7f115e000640 1 -- 172.21.15.1:0/791931235 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1150030850 con 0x7f116007de20 2024-09-15T22:14:58.428 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.498+0000 7f1165800640 1 -- 172.21.15.1:0/791931235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f116007de20 msgr2=0x7f116007c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:58.428 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.498+0000 7f1165800640 1 --2- 172.21.15.1:0/791931235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f116007de20 0x7f116007c280 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1150009820 tx=0x7f115002a270 comp rx=0 tx=0).stop 2024-09-15T22:14:58.428 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.498+0000 7f1165800640 1 -- 172.21.15.1:0/791931235 shutdown_connections 2024-09-15T22:14:58.428 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.498+0000 7f1165800640 1 --2- 172.21.15.1:0/791931235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f116007de20 0x7f116007c280 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:58.428 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.498+0000 7f1165800640 1 -- 172.21.15.1:0/791931235 >> 172.21.15.1:0/791931235 conn(0x7f1160102f30 msgr2=0x7f1160105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:58.428 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.498+0000 7f1165800640 1 -- 172.21.15.1:0/791931235 shutdown_connections 2024-09-15T22:14:58.428 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.498+0000 7f1165800640 1 -- 172.21.15.1:0/791931235 wait complete. 2024-09-15T22:14:58.428 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.499+0000 7f1165800640 1 Processor -- start 2024-09-15T22:14:58.428 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.500+0000 7f1165800640 1 -- start start 2024-09-15T22:14:58.428 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.500+0000 7f1165800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f116007de20 0x7f116019d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:58.428 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.500+0000 7f1165800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f116010dd70 con 0x7f116007de20 2024-09-15T22:14:58.429 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.500+0000 7f115ea00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f116007de20 0x7f116019d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:58.429 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.500+0000 7f115ea00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f116007de20 0x7f116019d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56278/0 (socket says 172.21.15.1:56278) 2024-09-15T22:14:58.429 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.500+0000 7f115ea00640 1 -- 172.21.15.1:0/3054650230 learned_addr learned my addr 172.21.15.1:0/3054650230 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:14:58.429 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.500+0000 7f115ea00640 1 -- 172.21.15.1:0/3054650230 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f116019de10 con 0x7f116007de20 2024-09-15T22:14:58.429 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.501+0000 7f115ea00640 1 --2- 172.21.15.1:0/3054650230 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f116007de20 0x7f116019d8d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1150032ce0 tx=0x7f1150032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:58.429 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.501+0000 7f1157400640 1 -- 172.21.15.1:0/3054650230 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1150042070 con 0x7f116007de20 2024-09-15T22:14:58.429 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.501+0000 7f1157400640 1 -- 172.21.15.1:0/3054650230 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f11500308c0 con 0x7f116007de20 2024-09-15T22:14:58.429 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.501+0000 7f1165800640 1 -- 172.21.15.1:0/3054650230 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f116019e0a0 con 0x7f116007de20 2024-09-15T22:14:58.429 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.501+0000 7f1157400640 1 -- 172.21.15.1:0/3054650230 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1150037040 con 0x7f116007de20 2024-09-15T22:14:58.429 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.501+0000 7f1165800640 1 -- 172.21.15.1:0/3054650230 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11601a0d90 con 0x7f116007de20 2024-09-15T22:14:58.429 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.502+0000 7f1157400640 1 -- 172.21.15.1:0/3054650230 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f1150045070 con 0x7f116007de20 2024-09-15T22:14:58.429 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.502+0000 7f1165800640 1 -- 172.21.15.1:0/3054650230 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f116007c300 con 0x7f116007de20 2024-09-15T22:14:58.429 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.503+0000 7f1157400640 1 --2- 172.21.15.1:0/3054650230 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7f11440391b0 0x7f114403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:58.430 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.503+0000 7f1157400640 1 -- 172.21.15.1:0/3054650230 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f115006c280 con 0x7f116007de20 2024-09-15T22:14:58.430 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.503+0000 7f1157e00640 1 --2- 172.21.15.1:0/3054650230 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7f11440391b0 0x7f114403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:58.430 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.504+0000 7f1157e00640 1 --2- 172.21.15.1:0/3054650230 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7f11440391b0 0x7f114403b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f11480098c0 tx=0x7f1148006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:58.430 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.508+0000 7f1157400640 1 -- 172.21.15.1:0/3054650230 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f115004b170 con 0x7f116007de20 2024-09-15T22:14:58.430 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.742+0000 7f1165800640 1 -- 172.21.15.1:0/3054650230 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f11601a1410 con 0x7f116007de20 2024-09-15T22:14:58.430 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.827+0000 7f1157400640 1 -- 172.21.15.1:0/3054650230 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f115006bca0 con 0x7f116007de20 2024-09-15T22:14:58.430 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.828+0000 7f1157400640 1 -- 172.21.15.1:0/3054650230 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f115003c780 con 0x7f116007de20 2024-09-15T22:14:58.430 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.830+0000 7f1165800640 1 -- 172.21.15.1:0/3054650230 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7f11440391b0 msgr2=0x7f114403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:58.430 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.830+0000 7f1165800640 1 --2- 172.21.15.1:0/3054650230 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7f11440391b0 0x7f114403b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f11480098c0 tx=0x7f1148006db0 comp rx=0 tx=0).stop 2024-09-15T22:14:58.430 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.830+0000 7f1165800640 1 -- 172.21.15.1:0/3054650230 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f116007de20 msgr2=0x7f116019d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:58.430 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.830+0000 7f1165800640 1 --2- 172.21.15.1:0/3054650230 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f116007de20 0x7f116019d8d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1150032ce0 tx=0x7f1150032d10 comp rx=0 tx=0).stop 2024-09-15T22:14:58.430 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.830+0000 7f1165800640 1 -- 172.21.15.1:0/3054650230 shutdown_connections 2024-09-15T22:14:58.430 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.830+0000 7f1165800640 1 --2- 172.21.15.1:0/3054650230 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7f11440391b0 0x7f114403b670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:58.430 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.830+0000 7f1165800640 1 --2- 172.21.15.1:0/3054650230 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f116007de20 0x7f116019d8d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:58.431 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.830+0000 7f1165800640 1 -- 172.21.15.1:0/3054650230 >> 172.21.15.1:0/3054650230 conn(0x7f1160102f30 msgr2=0x7f1160103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:58.431 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.830+0000 7f1165800640 1 -- 172.21.15.1:0/3054650230 shutdown_connections 2024-09-15T22:14:58.431 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:57.830+0000 7f1165800640 1 -- 172.21.15.1:0/3054650230 wait complete. 2024-09-15T22:14:58.594 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:58 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:14:58.404+0000 7fb9d0c13040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:14:58.594 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:58 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:14:58.592+0000 7fb9d0c13040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:14:58.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:58 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/3054650230' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-15T22:14:58.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:58 smithi001 ceph-mon[30843]: mgrmap e5: x(active, since 4s) 2024-09-15T22:14:58.876 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:58 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:14:58.772+0000 7fb9d0c13040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:14:59.241 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:59 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:14:59.164+0000 7fb9d0c13040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:14:59.626 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:59 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:14:59.238+0000 7fb9d0c13040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:14:59.626 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:14:59 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:14:59.463+0000 7fb9d0c13040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:15:00.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:14:59 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/321631055' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-15T22:15:00.059 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:15:00.059 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-15T22:15:00.059 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-15T22:15:00.059 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-15T22:15:00.059 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-15T22:15:00.059 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:15:00.059 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.080+0000 7fb8f9200640 1 Processor -- start 2024-09-15T22:15:00.059 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.080+0000 7fb8f9200640 1 -- start start 2024-09-15T22:15:00.059 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.081+0000 7fb8f9200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8f4107700 0x7fb8f4107b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:00.060 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.081+0000 7fb8f9200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f41080d0 con 0x7fb8f4107700 2024-09-15T22:15:00.060 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.081+0000 7fb8f1e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8f4107700 0x7fb8f4107b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:00.060 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.081+0000 7fb8f1e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8f4107700 0x7fb8f4107b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56308/0 (socket says 172.21.15.1:56308) 2024-09-15T22:15:00.060 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.081+0000 7fb8f1e00640 1 -- 172.21.15.1:0/4094982709 learned_addr learned my addr 172.21.15.1:0/4094982709 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:00.060 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.082+0000 7fb8f1e00640 1 -- 172.21.15.1:0/4094982709 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f4108900 con 0x7fb8f4107700 2024-09-15T22:15:00.060 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.083+0000 7fb8f1e00640 1 --2- 172.21.15.1:0/4094982709 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8f4107700 0x7fb8f4107b00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4009820 tx=0x7fb8e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8da76ea8a008930d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:00.060 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.083+0000 7fb8f0a00640 1 -- 172.21.15.1:0/4094982709 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8e4037070 con 0x7fb8f4107700 2024-09-15T22:15:00.060 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.083+0000 7fb8f0a00640 1 -- 172.21.15.1:0/4094982709 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb8e4032900 con 0x7fb8f4107700 2024-09-15T22:15:00.060 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.083+0000 7fb8f0a00640 1 -- 172.21.15.1:0/4094982709 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8e4030850 con 0x7fb8f4107700 2024-09-15T22:15:00.060 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.084+0000 7fb8f9200640 1 -- 172.21.15.1:0/4094982709 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8f4107700 msgr2=0x7fb8f4107b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:00.060 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.084+0000 7fb8f9200640 1 --2- 172.21.15.1:0/4094982709 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8f4107700 0x7fb8f4107b00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4009820 tx=0x7fb8e402a270 comp rx=0 tx=0).stop 2024-09-15T22:15:00.060 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.084+0000 7fb8f9200640 1 -- 172.21.15.1:0/4094982709 shutdown_connections 2024-09-15T22:15:00.060 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.084+0000 7fb8f9200640 1 --2- 172.21.15.1:0/4094982709 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8f4107700 0x7fb8f4107b00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:00.061 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.084+0000 7fb8f9200640 1 -- 172.21.15.1:0/4094982709 >> 172.21.15.1:0/4094982709 conn(0x7fb8f4102f30 msgr2=0x7fb8f4105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:00.061 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.084+0000 7fb8f9200640 1 -- 172.21.15.1:0/4094982709 shutdown_connections 2024-09-15T22:15:00.061 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.084+0000 7fb8f9200640 1 -- 172.21.15.1:0/4094982709 wait complete. 2024-09-15T22:15:00.061 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.085+0000 7fb8f9200640 1 Processor -- start 2024-09-15T22:15:00.061 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.085+0000 7fb8f9200640 1 -- start start 2024-09-15T22:15:00.061 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.086+0000 7fb8f9200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8f4107700 0x7fb8f419b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:00.061 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.086+0000 7fb8f9200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f410bcb0 con 0x7fb8f4107700 2024-09-15T22:15:00.061 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.086+0000 7fb8f1e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8f4107700 0x7fb8f419b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:00.061 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.086+0000 7fb8f1e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8f4107700 0x7fb8f419b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56320/0 (socket says 172.21.15.1:56320) 2024-09-15T22:15:00.061 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.086+0000 7fb8f1e00640 1 -- 172.21.15.1:0/321631055 learned_addr learned my addr 172.21.15.1:0/321631055 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:00.061 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.086+0000 7fb8f1e00640 1 -- 172.21.15.1:0/321631055 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f419bc30 con 0x7fb8f4107700 2024-09-15T22:15:00.061 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.087+0000 7fb8f1e00640 1 --2- 172.21.15.1:0/321631055 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8f4107700 0x7fb8f419b6f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb8e40097f0 tx=0x7fb8e4030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:00.062 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.087+0000 7fb8eaa00640 1 -- 172.21.15.1:0/321631055 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8e4037040 con 0x7fb8f4107700 2024-09-15T22:15:00.062 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.087+0000 7fb8eaa00640 1 -- 172.21.15.1:0/321631055 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb8e4040070 con 0x7fb8f4107700 2024-09-15T22:15:00.062 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.087+0000 7fb8f9200640 1 -- 172.21.15.1:0/321631055 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8f419bec0 con 0x7fb8f4107700 2024-09-15T22:15:00.062 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.087+0000 7fb8eaa00640 1 -- 172.21.15.1:0/321631055 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8e403a390 con 0x7fb8f4107700 2024-09-15T22:15:00.062 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.087+0000 7fb8f9200640 1 -- 172.21.15.1:0/321631055 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8f419ebb0 con 0x7fb8f4107700 2024-09-15T22:15:00.062 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.088+0000 7fb8eaa00640 1 -- 172.21.15.1:0/321631055 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7fb8e4032900 con 0x7fb8f4107700 2024-09-15T22:15:00.062 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.088+0000 7fb8f9200640 1 -- 172.21.15.1:0/321631055 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8f4107b80 con 0x7fb8f4107700 2024-09-15T22:15:00.062 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.089+0000 7fb8eaa00640 1 --2- 172.21.15.1:0/321631055 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7fb8d8039200 0x7fb8d803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:00.062 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.089+0000 7fb8eaa00640 1 -- 172.21.15.1:0/321631055 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb8e406c3b0 con 0x7fb8f4107700 2024-09-15T22:15:00.062 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.089+0000 7fb8f1400640 1 -- 172.21.15.1:0/321631055 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7fb8d8039200 msgr2=0x7fb8d803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/215291238 2024-09-15T22:15:00.062 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.089+0000 7fb8f1400640 1 --2- 172.21.15.1:0/321631055 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7fb8d8039200 0x7fb8d803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:15:00.062 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.094+0000 7fb8eaa00640 1 -- 172.21.15.1:0/321631055 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb8e4042310 con 0x7fb8f4107700 2024-09-15T22:15:00.063 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.290+0000 7fb8f1400640 1 -- 172.21.15.1:0/321631055 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7fb8d8039200 msgr2=0x7fb8d803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/215291238 2024-09-15T22:15:00.063 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.290+0000 7fb8f1400640 1 --2- 172.21.15.1:0/321631055 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7fb8d8039200 0x7fb8d803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T22:15:00.063 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.326+0000 7fb8f9200640 1 -- 172.21.15.1:0/321631055 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fb8f419f280 con 0x7fb8f4107700 2024-09-15T22:15:00.063 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.326+0000 7fb8eaa00640 1 -- 172.21.15.1:0/321631055 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7fb8e40371e0 con 0x7fb8f4107700 2024-09-15T22:15:00.063 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.329+0000 7fb8f9200640 1 -- 172.21.15.1:0/321631055 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7fb8d8039200 msgr2=0x7fb8d803b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:15:00.063 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.329+0000 7fb8f9200640 1 --2- 172.21.15.1:0/321631055 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7fb8d8039200 0x7fb8d803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:00.063 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.329+0000 7fb8f9200640 1 -- 172.21.15.1:0/321631055 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8f4107700 msgr2=0x7fb8f419b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:00.063 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.329+0000 7fb8f9200640 1 --2- 172.21.15.1:0/321631055 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8f4107700 0x7fb8f419b6f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb8e40097f0 tx=0x7fb8e4030d80 comp rx=0 tx=0).stop 2024-09-15T22:15:00.063 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.329+0000 7fb8f9200640 1 -- 172.21.15.1:0/321631055 shutdown_connections 2024-09-15T22:15:00.064 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.329+0000 7fb8f9200640 1 --2- 172.21.15.1:0/321631055 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7fb8d8039200 0x7fb8d803b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:00.064 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.329+0000 7fb8f9200640 1 --2- 172.21.15.1:0/321631055 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8f4107700 0x7fb8f419b6f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:00.064 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.329+0000 7fb8f9200640 1 -- 172.21.15.1:0/321631055 >> 172.21.15.1:0/321631055 conn(0x7fb8f4102f30 msgr2=0x7fb8f4103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:00.064 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.329+0000 7fb8f9200640 1 -- 172.21.15.1:0/321631055 shutdown_connections 2024-09-15T22:15:00.064 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:14:59.329+0000 7fb8f9200640 1 -- 172.21.15.1:0/321631055 wait complete. 2024-09-15T22:15:00.064 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for the mgr to restart... 2024-09-15T22:15:00.064 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mgr epoch 5... 2024-09-15T22:15:00.876 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:00 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:00.623+0000 7fb9d0c13040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:15:00.876 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:00 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:00.707+0000 7fb9d0c13040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:15:01.972 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:01 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:01.656+0000 7fb9d0c13040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:15:01.972 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:01 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:01.798+0000 7fb9d0c13040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:15:01.972 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:01 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:01.969+0000 7fb9d0c13040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:15:02.226 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:02 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:02.044+0000 7fb9d0c13040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:15:02.226 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:02 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:02.223+0000 7fb9d0c13040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:15:02.573 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:02 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:02.308+0000 7fb9d0c13040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:15:02.573 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:02 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:02.383+0000 7fb9d0c13040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:15:02.573 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:02 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:02.571+0000 7fb9d0c13040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:15:02.836 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:02 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:02.651+0000 7fb9d0c13040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:15:02.836 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:02 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:02.733+0000 7fb9d0c13040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:15:02.836 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:02 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:02.833+0000 7fb9d0c13040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:15:03.126 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:02 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:02.907+0000 7fb9d0c13040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:15:03.126 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:02 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:02.980+0000 7fb9d0c13040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:15:04.376 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:03 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:03.934+0000 7fb9d0c13040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:15:04.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:03 smithi001 ceph-mon[30843]: Active manager daemon x restarted 2024-09-15T22:15:04.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:03 smithi001 ceph-mon[30843]: Activating manager daemon x 2024-09-15T22:15:04.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:03 smithi001 ceph-mon[30843]: osdmap e2: 0 total, 0 up, 0 in 2024-09-15T22:15:04.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:03 smithi001 ceph-mon[30843]: mgrmap e6: x(active, starting, since 0.00427425s) 2024-09-15T22:15:04.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:03 smithi001 ceph-mon[30843]: from='mgr.14118 172.21.15.1:0/1750299612' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:15:04.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:03 smithi001 ceph-mon[30843]: from='mgr.14118 172.21.15.1:0/1750299612' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T22:15:04.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:03 smithi001 ceph-mon[30843]: from='mgr.14118 172.21.15.1:0/1750299612' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T22:15:04.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:03 smithi001 ceph-mon[30843]: from='mgr.14118 172.21.15.1:0/1750299612' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T22:15:04.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:03 smithi001 ceph-mon[30843]: from='mgr.14118 172.21.15.1:0/1750299612' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T22:15:04.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:03 smithi001 ceph-mon[30843]: Manager daemon x is now available 2024-09-15T22:15:04.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:03 smithi001 ceph-mon[30843]: from='mgr.14118 172.21.15.1:0/1750299612' entity='mgr.x' 2024-09-15T22:15:04.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:03 smithi001 ceph-mon[30843]: from='mgr.14118 172.21.15.1:0/1750299612' entity='mgr.x' 2024-09-15T22:15:04.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:03 smithi001 ceph-mon[30843]: from='mgr.14118 172.21.15.1:0/1750299612' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:15:04.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:03 smithi001 ceph-mon[30843]: from='mgr.14118 172.21.15.1:0/1750299612' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:15:05.307 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:04 smithi001 ceph-mon[30843]: Found migration_current of "None". Setting to last migration. 2024-09-15T22:15:05.307 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:04 smithi001 ceph-mon[30843]: from='mgr.14118 172.21.15.1:0/1750299612' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-15T22:15:05.307 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:04 smithi001 ceph-mon[30843]: from='mgr.14118 172.21.15.1:0/1750299612' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-15T22:15:05.307 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:04 smithi001 ceph-mon[30843]: from='mgr.14118 172.21.15.1:0/1750299612' entity='mgr.x' 2024-09-15T22:15:05.307 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:04 smithi001 ceph-mon[30843]: from='mgr.14118 172.21.15.1:0/1750299612' entity='mgr.x' 2024-09-15T22:15:05.307 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:04 smithi001 ceph-mon[30843]: mgrmap e7: x(active, since 1.0073s) 2024-09-15T22:15:05.576 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:15:05.576 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-15T22:15:05.576 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-15T22:15:05.576 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:15:05.576 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.582+0000 7fdb79600640 1 Processor -- start 2024-09-15T22:15:05.576 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.582+0000 7fdb79600640 1 -- start start 2024-09-15T22:15:05.576 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.583+0000 7fdb79600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb74109990 0x7fdb74109d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:05.576 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.583+0000 7fdb79600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7410a360 con 0x7fdb74109990 2024-09-15T22:15:05.576 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.583+0000 7fdb72a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb74109990 0x7fdb74109d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:05.576 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.583+0000 7fdb72a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb74109990 0x7fdb74109d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56324/0 (socket says 172.21.15.1:56324) 2024-09-15T22:15:05.576 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.583+0000 7fdb72a00640 1 -- 172.21.15.1:0/266706410 learned_addr learned my addr 172.21.15.1:0/266706410 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:05.576 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.583+0000 7fdb72a00640 1 -- 172.21.15.1:0/266706410 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7410ab40 con 0x7fdb74109990 2024-09-15T22:15:05.577 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.584+0000 7fdb72a00640 1 --2- 172.21.15.1:0/266706410 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb74109990 0x7fdb74109d90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdb64009820 tx=0x7fdb6402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e3fc3a0bf8b04c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:05.577 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.585+0000 7fdb71600640 1 -- 172.21.15.1:0/266706410 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb64037070 con 0x7fdb74109990 2024-09-15T22:15:05.577 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.585+0000 7fdb71600640 1 -- 172.21.15.1:0/266706410 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdb64032900 con 0x7fdb74109990 2024-09-15T22:15:05.577 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.585+0000 7fdb71600640 1 -- 172.21.15.1:0/266706410 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb64030850 con 0x7fdb74109990 2024-09-15T22:15:05.577 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.585+0000 7fdb79600640 1 -- 172.21.15.1:0/266706410 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb74109990 msgr2=0x7fdb74109d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:05.577 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.585+0000 7fdb79600640 1 --2- 172.21.15.1:0/266706410 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb74109990 0x7fdb74109d90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdb64009820 tx=0x7fdb6402a270 comp rx=0 tx=0).stop 2024-09-15T22:15:05.577 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.585+0000 7fdb79600640 1 -- 172.21.15.1:0/266706410 shutdown_connections 2024-09-15T22:15:05.577 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.585+0000 7fdb79600640 1 --2- 172.21.15.1:0/266706410 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb74109990 0x7fdb74109d90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:05.577 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.585+0000 7fdb79600640 1 -- 172.21.15.1:0/266706410 >> 172.21.15.1:0/266706410 conn(0x7fdb7407cfd0 msgr2=0x7fdb7407d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:05.577 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.586+0000 7fdb79600640 1 -- 172.21.15.1:0/266706410 shutdown_connections 2024-09-15T22:15:05.577 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.586+0000 7fdb79600640 1 -- 172.21.15.1:0/266706410 wait complete. 2024-09-15T22:15:05.577 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.586+0000 7fdb79600640 1 Processor -- start 2024-09-15T22:15:05.578 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.587+0000 7fdb79600640 1 -- start start 2024-09-15T22:15:05.578 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.587+0000 7fdb79600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb74109990 0x7fdb7419d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:05.578 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.587+0000 7fdb79600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7410def0 con 0x7fdb74109990 2024-09-15T22:15:05.578 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.587+0000 7fdb72a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb74109990 0x7fdb7419d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:05.578 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.587+0000 7fdb72a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb74109990 0x7fdb7419d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56326/0 (socket says 172.21.15.1:56326) 2024-09-15T22:15:05.578 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.587+0000 7fdb72a00640 1 -- 172.21.15.1:0/2799196424 learned_addr learned my addr 172.21.15.1:0/2799196424 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:05.578 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.587+0000 7fdb72a00640 1 -- 172.21.15.1:0/2799196424 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7419def0 con 0x7fdb74109990 2024-09-15T22:15:05.578 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.588+0000 7fdb72a00640 1 --2- 172.21.15.1:0/2799196424 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb74109990 0x7fdb7419d9b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdb640097f0 tx=0x7fdb64030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:05.578 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.588+0000 7fdb6b400640 1 -- 172.21.15.1:0/2799196424 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb64042070 con 0x7fdb74109990 2024-09-15T22:15:05.578 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.588+0000 7fdb6b400640 1 -- 172.21.15.1:0/2799196424 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdb64032ca0 con 0x7fdb74109990 2024-09-15T22:15:05.578 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.588+0000 7fdb6b400640 1 -- 172.21.15.1:0/2799196424 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb64037040 con 0x7fdb74109990 2024-09-15T22:15:05.578 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.588+0000 7fdb79600640 1 -- 172.21.15.1:0/2799196424 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb7419e180 con 0x7fdb74109990 2024-09-15T22:15:05.578 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.588+0000 7fdb79600640 1 -- 172.21.15.1:0/2799196424 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb741a0e70 con 0x7fdb74109990 2024-09-15T22:15:05.579 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.589+0000 7fdb6b400640 1 -- 172.21.15.1:0/2799196424 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7fdb64045070 con 0x7fdb74109990 2024-09-15T22:15:05.579 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.590+0000 7fdb6b400640 1 --2- 172.21.15.1:0/2799196424 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7fdb58039200 0x7fdb5803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:05.579 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.590+0000 7fdb6b400640 1 -- 172.21.15.1:0/2799196424 --> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fdb5803bdd0 con 0x7fdb58039200 2024-09-15T22:15:05.579 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.590+0000 7fdb6b400640 1 -- 172.21.15.1:0/2799196424 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdb6406c0a0 con 0x7fdb74109990 2024-09-15T22:15:05.579 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.590+0000 7fdb72000640 1 -- 172.21.15.1:0/2799196424 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7fdb58039200 msgr2=0x7fdb5803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/215291238 2024-09-15T22:15:05.579 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.590+0000 7fdb72000640 1 --2- 172.21.15.1:0/2799196424 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7fdb58039200 0x7fdb5803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:15:05.579 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.791+0000 7fdb72000640 1 -- 172.21.15.1:0/2799196424 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7fdb58039200 msgr2=0x7fdb5803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/215291238 2024-09-15T22:15:05.579 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:00.791+0000 7fdb72000640 1 --2- 172.21.15.1:0/2799196424 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7fdb58039200 0x7fdb5803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T22:15:05.579 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:01.192+0000 7fdb72000640 1 -- 172.21.15.1:0/2799196424 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7fdb58039200 msgr2=0x7fdb5803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/215291238 2024-09-15T22:15:05.579 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:01.192+0000 7fdb72000640 1 --2- 172.21.15.1:0/2799196424 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7fdb58039200 0x7fdb5803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-15T22:15:05.579 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:01.993+0000 7fdb72000640 1 -- 172.21.15.1:0/2799196424 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7fdb58039200 msgr2=0x7fdb5803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/215291238 2024-09-15T22:15:05.579 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:01.993+0000 7fdb72000640 1 --2- 172.21.15.1:0/2799196424 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7fdb58039200 0x7fdb5803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-15T22:15:05.579 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:03.594+0000 7fdb72000640 1 -- 172.21.15.1:0/2799196424 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7fdb58039200 msgr2=0x7fdb5803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/215291238 2024-09-15T22:15:05.579 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:03.594+0000 7fdb72000640 1 --2- 172.21.15.1:0/2799196424 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7fdb58039200 0x7fdb5803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-15T22:15:05.580 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:03.939+0000 7fdb6b400640 1 -- 172.21.15.1:0/2799196424 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7fdb6403d430 con 0x7fdb74109990 2024-09-15T22:15:05.580 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:03.939+0000 7fdb6b400640 1 -- 172.21.15.1:0/2799196424 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7fdb58039200 msgr2=0x7fdb5803b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:15:05.580 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:03.939+0000 7fdb6b400640 1 --2- 172.21.15.1:0/2799196424 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7fdb58039200 0x7fdb5803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:05.580 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:04.941+0000 7fdb6b400640 1 -- 172.21.15.1:0/2799196424 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7fdb6406de10 con 0x7fdb74109990 2024-09-15T22:15:05.580 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:04.941+0000 7fdb6b400640 1 --2- 172.21.15.1:0/2799196424 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fdb5803cb30 0x7fdb5803ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:05.580 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:04.941+0000 7fdb6b400640 1 -- 172.21.15.1:0/2799196424 --> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fdb6402eec0 con 0x7fdb5803cb30 2024-09-15T22:15:05.580 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:04.941+0000 7fdb72000640 1 --2- 172.21.15.1:0/2799196424 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fdb5803cb30 0x7fdb5803ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:05.580 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:04.943+0000 7fdb72000640 1 --2- 172.21.15.1:0/2799196424 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fdb5803cb30 0x7fdb5803ef20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fdb60003980 tx=0x7fdb600092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:05.580 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:04.944+0000 7fdb6b400640 1 -- 172.21.15.1:0/2799196424 <== mgr.14118 v2:172.21.15.1:6800/3145051160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fdb6402eec0 con 0x7fdb5803cb30 2024-09-15T22:15:05.580 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:04.951+0000 7fdb79600640 1 -- 172.21.15.1:0/2799196424 --> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fdb7410e070 con 0x7fdb5803cb30 2024-09-15T22:15:05.580 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:04.952+0000 7fdb6b400640 1 -- 172.21.15.1:0/2799196424 <== mgr.14118 v2:172.21.15.1:6800/3145051160 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fdb7410e070 con 0x7fdb5803cb30 2024-09-15T22:15:05.580 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:04.952+0000 7fdb79600640 1 -- 172.21.15.1:0/2799196424 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fdb5803cb30 msgr2=0x7fdb5803ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:05.580 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:04.952+0000 7fdb79600640 1 --2- 172.21.15.1:0/2799196424 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fdb5803cb30 0x7fdb5803ef20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fdb60003980 tx=0x7fdb600092b0 comp rx=0 tx=0).stop 2024-09-15T22:15:05.580 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:04.952+0000 7fdb79600640 1 -- 172.21.15.1:0/2799196424 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb74109990 msgr2=0x7fdb7419d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:05.581 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:04.952+0000 7fdb79600640 1 --2- 172.21.15.1:0/2799196424 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb74109990 0x7fdb7419d9b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdb640097f0 tx=0x7fdb64030ec0 comp rx=0 tx=0).stop 2024-09-15T22:15:05.581 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:04.952+0000 7fdb79600640 1 -- 172.21.15.1:0/2799196424 shutdown_connections 2024-09-15T22:15:05.581 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:04.952+0000 7fdb79600640 1 --2- 172.21.15.1:0/2799196424 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fdb5803cb30 0x7fdb5803ef20 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:05.581 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:04.952+0000 7fdb79600640 1 --2- 172.21.15.1:0/2799196424 >> [v2:172.21.15.1:6800/215291238,v1:172.21.15.1:6801/215291238] conn(0x7fdb58039200 0x7fdb5803b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:05.581 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:04.952+0000 7fdb79600640 1 --2- 172.21.15.1:0/2799196424 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb74109990 0x7fdb7419d9b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:05.581 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:04.952+0000 7fdb79600640 1 -- 172.21.15.1:0/2799196424 >> 172.21.15.1:0/2799196424 conn(0x7fdb7407cfd0 msgr2=0x7fdb74107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:05.581 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:04.952+0000 7fdb79600640 1 -- 172.21.15.1:0/2799196424 shutdown_connections 2024-09-15T22:15:05.581 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:04.952+0000 7fdb79600640 1 -- 172.21.15.1:0/2799196424 wait complete. 2024-09-15T22:15:05.581 INFO:teuthology.orchestra.run.smithi001.stdout:mgr epoch 5 is available 2024-09-15T22:15:05.581 INFO:teuthology.orchestra.run.smithi001.stdout:Setting orchestrator backend to cephadm... 2024-09-15T22:15:06.088 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:05 smithi001 ceph-mon[30843]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-15T22:15:06.088 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:05 smithi001 ceph-mon[30843]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-15T22:15:06.089 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:05 smithi001 ceph-mon[30843]: [15/Sep/2024:22:15:05] ENGINE Bus STARTING 2024-09-15T22:15:06.089 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:05 smithi001 ceph-mon[30843]: [15/Sep/2024:22:15:05] ENGINE Serving on https://172.21.15.1:7150 2024-09-15T22:15:06.089 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:05 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:05.935+0000 7fb930200640 -1 log_channel(cephadm) log [ERR] : [15/Sep/2024:22:15:05] ENGINE Error in HTTPServer.serve 2024-09-15T22:15:06.089 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:05 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: Traceback (most recent call last): 2024-09-15T22:15:06.089 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:05 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T22:15:06.089 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:05 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: self._connections.run(self.expiration_interval) 2024-09-15T22:15:06.089 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:05 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T22:15:06.090 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:05 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: self._run(expiration_interval) 2024-09-15T22:15:06.090 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:05 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T22:15:06.090 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:05 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T22:15:06.090 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:05 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T22:15:06.090 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:05 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T22:15:06.090 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:05 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T22:15:06.090 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:05 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: s = self.context.wrap_socket( 2024-09-15T22:15:06.090 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:05 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T22:15:06.090 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:05 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: return self.sslsocket_class._create( 2024-09-15T22:15:06.090 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:05 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T22:15:06.090 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:05 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: self.do_handshake() 2024-09-15T22:15:06.090 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:05 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T22:15:06.090 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:05 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: self._sslobj.do_handshake() 2024-09-15T22:15:06.091 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:05 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T22:15:06.091 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:05 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:06.909 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.082+0000 7fd67aa00640 1 Processor -- start 2024-09-15T22:15:06.910 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.082+0000 7fd67aa00640 1 -- start start 2024-09-15T22:15:06.910 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.082+0000 7fd67aa00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd674107700 0x7fd674107b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:06.910 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.082+0000 7fd67aa00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd6741080d0 con 0x7fd674107700 2024-09-15T22:15:06.910 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.082+0000 7fd673e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd674107700 0x7fd674107b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:06.910 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.083+0000 7fd673e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd674107700 0x7fd674107b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56398/0 (socket says 172.21.15.1:56398) 2024-09-15T22:15:06.910 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.083+0000 7fd673e00640 1 -- 172.21.15.1:0/2344519832 learned_addr learned my addr 172.21.15.1:0/2344519832 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:06.910 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.083+0000 7fd673e00640 1 -- 172.21.15.1:0/2344519832 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd674108900 con 0x7fd674107700 2024-09-15T22:15:06.910 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.084+0000 7fd673e00640 1 --2- 172.21.15.1:0/2344519832 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd674107700 0x7fd674107b00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd664009820 tx=0x7fd66402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4de5accd8bd27267 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:06.910 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.084+0000 7fd672a00640 1 -- 172.21.15.1:0/2344519832 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd664037070 con 0x7fd674107700 2024-09-15T22:15:06.910 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.084+0000 7fd672a00640 1 -- 172.21.15.1:0/2344519832 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd664032900 con 0x7fd674107700 2024-09-15T22:15:06.910 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.084+0000 7fd672a00640 1 -- 172.21.15.1:0/2344519832 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd664030850 con 0x7fd674107700 2024-09-15T22:15:06.910 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.085+0000 7fd67aa00640 1 -- 172.21.15.1:0/2344519832 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd674107700 msgr2=0x7fd674107b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:06.911 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.085+0000 7fd67aa00640 1 --2- 172.21.15.1:0/2344519832 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd674107700 0x7fd674107b00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd664009820 tx=0x7fd66402a270 comp rx=0 tx=0).stop 2024-09-15T22:15:06.911 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.085+0000 7fd67aa00640 1 -- 172.21.15.1:0/2344519832 shutdown_connections 2024-09-15T22:15:06.911 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.085+0000 7fd67aa00640 1 --2- 172.21.15.1:0/2344519832 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd674107700 0x7fd674107b00 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:06.911 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.085+0000 7fd67aa00640 1 -- 172.21.15.1:0/2344519832 >> 172.21.15.1:0/2344519832 conn(0x7fd674102f30 msgr2=0x7fd674105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:06.911 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.085+0000 7fd67aa00640 1 -- 172.21.15.1:0/2344519832 shutdown_connections 2024-09-15T22:15:06.911 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.085+0000 7fd67aa00640 1 -- 172.21.15.1:0/2344519832 wait complete. 2024-09-15T22:15:06.911 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.086+0000 7fd67aa00640 1 Processor -- start 2024-09-15T22:15:06.911 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.086+0000 7fd67aa00640 1 -- start start 2024-09-15T22:15:06.911 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.087+0000 7fd67aa00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd674107700 0x7fd67407daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:06.911 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.087+0000 7fd67aa00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd67410bcb0 con 0x7fd674107700 2024-09-15T22:15:06.911 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.087+0000 7fd673e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd674107700 0x7fd67407daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:06.911 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.087+0000 7fd673e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd674107700 0x7fd67407daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56408/0 (socket says 172.21.15.1:56408) 2024-09-15T22:15:06.911 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.087+0000 7fd673e00640 1 -- 172.21.15.1:0/3687069102 learned_addr learned my addr 172.21.15.1:0/3687069102 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:06.911 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.087+0000 7fd673e00640 1 -- 172.21.15.1:0/3687069102 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd67407e030 con 0x7fd674107700 2024-09-15T22:15:06.912 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.088+0000 7fd673e00640 1 --2- 172.21.15.1:0/3687069102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd674107700 0x7fd67407daf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd6640097f0 tx=0x7fd664030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:06.912 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.088+0000 7fd670c00640 1 -- 172.21.15.1:0/3687069102 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd664037040 con 0x7fd674107700 2024-09-15T22:15:06.912 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.088+0000 7fd670c00640 1 -- 172.21.15.1:0/3687069102 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd664040070 con 0x7fd674107700 2024-09-15T22:15:06.912 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.088+0000 7fd670c00640 1 -- 172.21.15.1:0/3687069102 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd66403a390 con 0x7fd674107700 2024-09-15T22:15:06.912 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.088+0000 7fd67aa00640 1 -- 172.21.15.1:0/3687069102 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd67407c220 con 0x7fd674107700 2024-09-15T22:15:06.912 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.088+0000 7fd67aa00640 1 -- 172.21.15.1:0/3687069102 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd67407c700 con 0x7fd674107700 2024-09-15T22:15:06.912 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.089+0000 7fd670c00640 1 -- 172.21.15.1:0/3687069102 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fd66403b430 con 0x7fd674107700 2024-09-15T22:15:06.913 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.089+0000 7fd67aa00640 1 -- 172.21.15.1:0/3687069102 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd674107b80 con 0x7fd674107700 2024-09-15T22:15:06.913 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.090+0000 7fd670c00640 1 --2- 172.21.15.1:0/3687069102 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fd658039200 0x7fd65803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:06.913 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.090+0000 7fd670c00640 1 -- 172.21.15.1:0/3687069102 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd66406c7d0 con 0x7fd674107700 2024-09-15T22:15:06.913 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.090+0000 7fd673400640 1 --2- 172.21.15.1:0/3687069102 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fd658039200 0x7fd65803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:06.914 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.091+0000 7fd673400640 1 --2- 172.21.15.1:0/3687069102 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fd658039200 0x7fd65803b6c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd6600098c0 tx=0x7fd660006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:06.914 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.095+0000 7fd670c00640 1 -- 172.21.15.1:0/3687069102 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd66406c120 con 0x7fd674107700 2024-09-15T22:15:06.914 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.295+0000 7fd67aa00640 1 -- 172.21.15.1:0/3687069102 --> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fd674104190 con 0x7fd658039200 2024-09-15T22:15:06.914 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.301+0000 7fd670c00640 1 -- 172.21.15.1:0/3687069102 <== mgr.14118 v2:172.21.15.1:6800/3145051160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd674104190 con 0x7fd658039200 2024-09-15T22:15:06.914 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.303+0000 7fd67aa00640 1 -- 172.21.15.1:0/3687069102 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fd658039200 msgr2=0x7fd65803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:06.914 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.303+0000 7fd67aa00640 1 --2- 172.21.15.1:0/3687069102 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fd658039200 0x7fd65803b6c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd6600098c0 tx=0x7fd660006db0 comp rx=0 tx=0).stop 2024-09-15T22:15:06.914 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.303+0000 7fd67aa00640 1 -- 172.21.15.1:0/3687069102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd674107700 msgr2=0x7fd67407daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:06.914 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.303+0000 7fd67aa00640 1 --2- 172.21.15.1:0/3687069102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd674107700 0x7fd67407daf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd6640097f0 tx=0x7fd664030d80 comp rx=0 tx=0).stop 2024-09-15T22:15:06.914 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.303+0000 7fd67aa00640 1 -- 172.21.15.1:0/3687069102 shutdown_connections 2024-09-15T22:15:06.914 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.303+0000 7fd67aa00640 1 --2- 172.21.15.1:0/3687069102 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fd658039200 0x7fd65803b6c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:06.914 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.303+0000 7fd67aa00640 1 --2- 172.21.15.1:0/3687069102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd674107700 0x7fd67407daf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:06.914 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.303+0000 7fd67aa00640 1 -- 172.21.15.1:0/3687069102 >> 172.21.15.1:0/3687069102 conn(0x7fd674102f30 msgr2=0x7fd674103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:06.914 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.304+0000 7fd67aa00640 1 -- 172.21.15.1:0/3687069102 shutdown_connections 2024-09-15T22:15:06.915 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:06.304+0000 7fd67aa00640 1 -- 172.21.15.1:0/3687069102 wait complete. 2024-09-15T22:15:07.172 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:06 smithi001 ceph-mon[30843]: [15/Sep/2024:22:15:05] ENGINE Error in HTTPServer.serve 2024-09-15T22:15:07.173 INFO:journalctl@ceph.mon.a.smithi001.stdout: Traceback (most recent call last): 2024-09-15T22:15:07.173 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T22:15:07.173 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._connections.run(self.expiration_interval) 2024-09-15T22:15:07.173 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T22:15:07.173 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._run(expiration_interval) 2024-09-15T22:15:07.173 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T22:15:07.173 INFO:journalctl@ceph.mon.a.smithi001.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T22:15:07.173 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T22:15:07.174 INFO:journalctl@ceph.mon.a.smithi001.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T22:15:07.174 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T22:15:07.174 INFO:journalctl@ceph.mon.a.smithi001.stdout: s = self.context.wrap_socket( 2024-09-15T22:15:07.174 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T22:15:07.174 INFO:journalctl@ceph.mon.a.smithi001.stdout: return self.sslsocket_class._create( 2024-09-15T22:15:07.174 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T22:15:07.174 INFO:journalctl@ceph.mon.a.smithi001.stdout: self.do_handshake() 2024-09-15T22:15:07.174 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T22:15:07.175 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._sslobj.do_handshake() 2024-09-15T22:15:07.175 INFO:journalctl@ceph.mon.a.smithi001.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T22:15:07.175 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:06 smithi001 ceph-mon[30843]: mgrmap e8: x(active, since 2s) 2024-09-15T22:15:07.175 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:06 smithi001 ceph-mon[30843]: [15/Sep/2024:22:15:06] ENGINE Serving on http://172.21.15.1:8765 2024-09-15T22:15:07.175 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:06 smithi001 ceph-mon[30843]: [15/Sep/2024:22:15:06] ENGINE Bus STARTED 2024-09-15T22:15:07.175 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:06 smithi001 ceph-mon[30843]: from='mgr.14118 172.21.15.1:0/1750299612' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:15:07.175 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:06 smithi001 ceph-mon[30843]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:15:07.175 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:06 smithi001 ceph-mon[30843]: from='mgr.14118 172.21.15.1:0/1750299612' entity='mgr.x' 2024-09-15T22:15:07.175 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:06 smithi001 ceph-mon[30843]: from='mgr.14118 172.21.15.1:0/1750299612' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:15:08.266 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:07 smithi001 ceph-mon[30843]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:15:08.278 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-15T22:15:08.278 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.411+0000 7fd56b200640 1 Processor -- start 2024-09-15T22:15:08.278 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.411+0000 7fd56b200640 1 -- start start 2024-09-15T22:15:08.278 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.411+0000 7fd56b200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd56c109840 0x7fd56c109c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:08.278 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.411+0000 7fd56b200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd56c10a210 con 0x7fd56c109840 2024-09-15T22:15:08.278 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.412+0000 7fd569e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd56c109840 0x7fd56c109c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:08.278 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.412+0000 7fd569e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd56c109840 0x7fd56c109c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49418/0 (socket says 172.21.15.1:49418) 2024-09-15T22:15:08.279 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.412+0000 7fd569e00640 1 -- 172.21.15.1:0/1244369901 learned_addr learned my addr 172.21.15.1:0/1244369901 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:08.279 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.412+0000 7fd569e00640 1 -- 172.21.15.1:0/1244369901 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd56c10a950 con 0x7fd56c109840 2024-09-15T22:15:08.279 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.413+0000 7fd569e00640 1 --2- 172.21.15.1:0/1244369901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd56c109840 0x7fd56c109c40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd55c009820 tx=0x7fd55c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b977b7e5e22749 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:08.279 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.413+0000 7fd568a00640 1 -- 172.21.15.1:0/1244369901 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd55c037070 con 0x7fd56c109840 2024-09-15T22:15:08.279 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.413+0000 7fd568a00640 1 -- 172.21.15.1:0/1244369901 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd55c032900 con 0x7fd56c109840 2024-09-15T22:15:08.279 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.413+0000 7fd568a00640 1 -- 172.21.15.1:0/1244369901 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd55c030850 con 0x7fd56c109840 2024-09-15T22:15:08.279 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.414+0000 7fd56b200640 1 -- 172.21.15.1:0/1244369901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd56c109840 msgr2=0x7fd56c109c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:08.279 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.414+0000 7fd56b200640 1 --2- 172.21.15.1:0/1244369901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd56c109840 0x7fd56c109c40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd55c009820 tx=0x7fd55c02a270 comp rx=0 tx=0).stop 2024-09-15T22:15:08.279 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.414+0000 7fd56b200640 1 -- 172.21.15.1:0/1244369901 shutdown_connections 2024-09-15T22:15:08.279 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.414+0000 7fd56b200640 1 --2- 172.21.15.1:0/1244369901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd56c109840 0x7fd56c109c40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:08.279 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.414+0000 7fd56b200640 1 -- 172.21.15.1:0/1244369901 >> 172.21.15.1:0/1244369901 conn(0x7fd56c07cd90 msgr2=0x7fd56c07d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:08.279 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.414+0000 7fd56b200640 1 -- 172.21.15.1:0/1244369901 shutdown_connections 2024-09-15T22:15:08.279 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.414+0000 7fd56b200640 1 -- 172.21.15.1:0/1244369901 wait complete. 2024-09-15T22:15:08.280 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.415+0000 7fd56b200640 1 Processor -- start 2024-09-15T22:15:08.280 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.415+0000 7fd56b200640 1 -- start start 2024-09-15T22:15:08.280 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.415+0000 7fd56b200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd56c109840 0x7fd56c19d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:08.280 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.415+0000 7fd56b200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd56c10dd00 con 0x7fd56c109840 2024-09-15T22:15:08.280 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.416+0000 7fd569e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd56c109840 0x7fd56c19d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:08.280 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.416+0000 7fd569e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd56c109840 0x7fd56c19d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49424/0 (socket says 172.21.15.1:49424) 2024-09-15T22:15:08.280 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.416+0000 7fd569e00640 1 -- 172.21.15.1:0/3619947354 learned_addr learned my addr 172.21.15.1:0/3619947354 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:08.280 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.416+0000 7fd569e00640 1 -- 172.21.15.1:0/3619947354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd56c19dd20 con 0x7fd56c109840 2024-09-15T22:15:08.280 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.416+0000 7fd569e00640 1 --2- 172.21.15.1:0/3619947354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd56c109840 0x7fd56c19d7e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd55c009940 tx=0x7fd55c0326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:08.280 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.416+0000 7fd562a00640 1 -- 172.21.15.1:0/3619947354 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd55c042070 con 0x7fd56c109840 2024-09-15T22:15:08.280 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.416+0000 7fd562a00640 1 -- 172.21.15.1:0/3619947354 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd55c032be0 con 0x7fd56c109840 2024-09-15T22:15:08.280 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.416+0000 7fd562a00640 1 -- 172.21.15.1:0/3619947354 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd55c037040 con 0x7fd56c109840 2024-09-15T22:15:08.280 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.416+0000 7fd56b200640 1 -- 172.21.15.1:0/3619947354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd56c19dfb0 con 0x7fd56c109840 2024-09-15T22:15:08.280 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.417+0000 7fd56b200640 1 -- 172.21.15.1:0/3619947354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd56c1a0ca0 con 0x7fd56c109840 2024-09-15T22:15:08.281 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.418+0000 7fd562a00640 1 -- 172.21.15.1:0/3619947354 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fd55c045070 con 0x7fd56c109840 2024-09-15T22:15:08.281 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.418+0000 7fd56b200640 1 -- 172.21.15.1:0/3619947354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd56c10de80 con 0x7fd56c109840 2024-09-15T22:15:08.281 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.418+0000 7fd562a00640 1 --2- 172.21.15.1:0/3619947354 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fd550039200 0x7fd55003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:08.281 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.418+0000 7fd562a00640 1 -- 172.21.15.1:0/3619947354 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd55c06c270 con 0x7fd56c109840 2024-09-15T22:15:08.281 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.419+0000 7fd569400640 1 --2- 172.21.15.1:0/3619947354 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fd550039200 0x7fd55003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:08.281 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.419+0000 7fd569400640 1 --2- 172.21.15.1:0/3619947354 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fd550039200 0x7fd55003b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd5580098c0 tx=0x7fd558006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:08.281 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.424+0000 7fd562a00640 1 -- 172.21.15.1:0/3619947354 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd55c04b170 con 0x7fd56c109840 2024-09-15T22:15:08.281 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.610+0000 7fd56b200640 1 -- 172.21.15.1:0/3619947354 --> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fd56c107cd0 con 0x7fd550039200 2024-09-15T22:15:08.281 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.611+0000 7fd562a00640 1 -- 172.21.15.1:0/3619947354 <== mgr.14118 v2:172.21.15.1:6800/3145051160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fd56c107cd0 con 0x7fd550039200 2024-09-15T22:15:08.281 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.613+0000 7fd56b200640 1 -- 172.21.15.1:0/3619947354 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fd550039200 msgr2=0x7fd55003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:08.281 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.613+0000 7fd56b200640 1 --2- 172.21.15.1:0/3619947354 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fd550039200 0x7fd55003b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd5580098c0 tx=0x7fd558006db0 comp rx=0 tx=0).stop 2024-09-15T22:15:08.281 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.613+0000 7fd56b200640 1 -- 172.21.15.1:0/3619947354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd56c109840 msgr2=0x7fd56c19d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:08.281 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.613+0000 7fd56b200640 1 --2- 172.21.15.1:0/3619947354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd56c109840 0x7fd56c19d7e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd55c009940 tx=0x7fd55c0326e0 comp rx=0 tx=0).stop 2024-09-15T22:15:08.282 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.613+0000 7fd56b200640 1 -- 172.21.15.1:0/3619947354 shutdown_connections 2024-09-15T22:15:08.282 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.613+0000 7fd56b200640 1 --2- 172.21.15.1:0/3619947354 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fd550039200 0x7fd55003b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:08.282 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.613+0000 7fd56b200640 1 --2- 172.21.15.1:0/3619947354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd56c109840 0x7fd56c19d7e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:08.282 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.613+0000 7fd56b200640 1 -- 172.21.15.1:0/3619947354 >> 172.21.15.1:0/3619947354 conn(0x7fd56c07cd90 msgr2=0x7fd56c1075c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:08.282 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.613+0000 7fd56b200640 1 -- 172.21.15.1:0/3619947354 shutdown_connections 2024-09-15T22:15:08.282 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:07.613+0000 7fd56b200640 1 -- 172.21.15.1:0/3619947354 wait complete. 2024-09-15T22:15:08.282 INFO:teuthology.orchestra.run.smithi001.stdout:Generating ssh key... 2024-09-15T22:15:09.626 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:09 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: Generating public/private rsa key pair. 2024-09-15T22:15:09.627 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:09 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: Your identification has been saved in /tmp/tmp1v5w3b0e/key 2024-09-15T22:15:09.627 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:09 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: Your public key has been saved in /tmp/tmp1v5w3b0e/key.pub 2024-09-15T22:15:09.627 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:09 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: The key fingerprint is: 2024-09-15T22:15:09.627 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:09 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: SHA256:YS+474qmXYRQrD/VELtfKzrL6nWU7TaoiO4/v5JfyTA ceph-c1228c44-73af-11ef-bceb-c7b262605968 2024-09-15T22:15:09.627 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:09 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: The key's randomart image is: 2024-09-15T22:15:09.627 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:09 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: +---[RSA 3072]----+ 2024-09-15T22:15:09.627 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:09 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: | .. .. | 2024-09-15T22:15:09.627 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:09 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: | .. .. | 2024-09-15T22:15:09.627 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:09 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: | .. .oo | 2024-09-15T22:15:09.627 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:09 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: | .. ..+.= | 2024-09-15T22:15:09.627 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:09 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: | ...E S + | 2024-09-15T22:15:09.627 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:09 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: | o. B * . | 2024-09-15T22:15:09.627 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:09 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: | o+ O = | 2024-09-15T22:15:09.627 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:09 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: | o=*.* o . | 2024-09-15T22:15:09.628 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:09 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: | o==B*X*o | 2024-09-15T22:15:09.628 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:09 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: +----[SHA256]-----+ 2024-09-15T22:15:10.041 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.741+0000 7f5e2e800640 1 Processor -- start 2024-09-15T22:15:10.042 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.741+0000 7f5e2e800640 1 -- start start 2024-09-15T22:15:10.042 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.742+0000 7f5e2e800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e28107700 0x7f5e28107b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:10.042 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.742+0000 7f5e2e800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5e281080d0 con 0x7f5e28107700 2024-09-15T22:15:10.042 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.742+0000 7f5e27400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e28107700 0x7f5e28107b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:10.042 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.742+0000 7f5e27400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e28107700 0x7f5e28107b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49426/0 (socket says 172.21.15.1:49426) 2024-09-15T22:15:10.042 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.742+0000 7f5e27400640 1 -- 172.21.15.1:0/1876920320 learned_addr learned my addr 172.21.15.1:0/1876920320 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:10.042 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.742+0000 7f5e27400640 1 -- 172.21.15.1:0/1876920320 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e28108900 con 0x7f5e28107700 2024-09-15T22:15:10.042 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.743+0000 7f5e27400640 1 --2- 172.21.15.1:0/1876920320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e28107700 0x7f5e28107b00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5e18009820 tx=0x7f5e1802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8e827a0bf6c8ef server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:10.042 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.743+0000 7f5e26a00640 1 -- 172.21.15.1:0/1876920320 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e18037070 con 0x7f5e28107700 2024-09-15T22:15:10.042 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.743+0000 7f5e26a00640 1 -- 172.21.15.1:0/1876920320 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5e18032900 con 0x7f5e28107700 2024-09-15T22:15:10.042 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.744+0000 7f5e26a00640 1 -- 172.21.15.1:0/1876920320 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e18030850 con 0x7f5e28107700 2024-09-15T22:15:10.042 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.744+0000 7f5e2e800640 1 -- 172.21.15.1:0/1876920320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e28107700 msgr2=0x7f5e28107b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:10.043 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.744+0000 7f5e2e800640 1 --2- 172.21.15.1:0/1876920320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e28107700 0x7f5e28107b00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5e18009820 tx=0x7f5e1802a270 comp rx=0 tx=0).stop 2024-09-15T22:15:10.043 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.744+0000 7f5e2e800640 1 -- 172.21.15.1:0/1876920320 shutdown_connections 2024-09-15T22:15:10.043 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.744+0000 7f5e2e800640 1 --2- 172.21.15.1:0/1876920320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e28107700 0x7f5e28107b00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:10.043 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.744+0000 7f5e2e800640 1 -- 172.21.15.1:0/1876920320 >> 172.21.15.1:0/1876920320 conn(0x7f5e28102f30 msgr2=0x7f5e28105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:10.043 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.744+0000 7f5e2e800640 1 -- 172.21.15.1:0/1876920320 shutdown_connections 2024-09-15T22:15:10.043 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.744+0000 7f5e2e800640 1 -- 172.21.15.1:0/1876920320 wait complete. 2024-09-15T22:15:10.043 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.745+0000 7f5e2e800640 1 Processor -- start 2024-09-15T22:15:10.043 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.745+0000 7f5e2e800640 1 -- start start 2024-09-15T22:15:10.043 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.746+0000 7f5e2e800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e28107700 0x7f5e2819b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:10.043 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.746+0000 7f5e2e800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2810bcb0 con 0x7f5e28107700 2024-09-15T22:15:10.043 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.746+0000 7f5e27400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e28107700 0x7f5e2819b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:10.043 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.746+0000 7f5e27400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e28107700 0x7f5e2819b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49438/0 (socket says 172.21.15.1:49438) 2024-09-15T22:15:10.043 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.746+0000 7f5e27400640 1 -- 172.21.15.1:0/3852424679 learned_addr learned my addr 172.21.15.1:0/3852424679 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:10.044 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.746+0000 7f5e27400640 1 -- 172.21.15.1:0/3852424679 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e2819bc30 con 0x7f5e28107700 2024-09-15T22:15:10.044 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.747+0000 7f5e27400640 1 --2- 172.21.15.1:0/3852424679 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e28107700 0x7f5e2819b6f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5e18009940 tx=0x7f5e18032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:10.044 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.747+0000 7f5e24c00640 1 -- 172.21.15.1:0/3852424679 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e18042070 con 0x7f5e28107700 2024-09-15T22:15:10.044 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.747+0000 7f5e24c00640 1 -- 172.21.15.1:0/3852424679 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5e180308c0 con 0x7f5e28107700 2024-09-15T22:15:10.044 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.747+0000 7f5e2e800640 1 -- 172.21.15.1:0/3852424679 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e2819bec0 con 0x7f5e28107700 2024-09-15T22:15:10.044 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.747+0000 7f5e24c00640 1 -- 172.21.15.1:0/3852424679 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e18037040 con 0x7f5e28107700 2024-09-15T22:15:10.044 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.747+0000 7f5e2e800640 1 -- 172.21.15.1:0/3852424679 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e2819ebb0 con 0x7f5e28107700 2024-09-15T22:15:10.044 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.748+0000 7f5e24c00640 1 -- 172.21.15.1:0/3852424679 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f5e18045070 con 0x7f5e28107700 2024-09-15T22:15:10.044 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.748+0000 7f5e2e800640 1 -- 172.21.15.1:0/3852424679 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e2810be30 con 0x7f5e28107700 2024-09-15T22:15:10.044 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.748+0000 7f5e24c00640 1 --2- 172.21.15.1:0/3852424679 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f5e0c0391b0 0x7f5e0c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:10.044 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.748+0000 7f5e24c00640 1 -- 172.21.15.1:0/3852424679 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5e1806c3e0 con 0x7f5e28107700 2024-09-15T22:15:10.044 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.749+0000 7f5e1ea00640 1 --2- 172.21.15.1:0/3852424679 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f5e0c0391b0 0x7f5e0c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:10.044 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.749+0000 7f5e1ea00640 1 --2- 172.21.15.1:0/3852424679 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f5e0c0391b0 0x7f5e0c03b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5e100098c0 tx=0x7f5e10006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:10.045 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.753+0000 7f5e24c00640 1 -- 172.21.15.1:0/3852424679 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5e1806bd30 con 0x7f5e28107700 2024-09-15T22:15:10.045 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:08.940+0000 7f5e2e800640 1 -- 172.21.15.1:0/3852424679 --> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f5e28104160 con 0x7f5e0c0391b0 2024-09-15T22:15:10.045 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:09.377+0000 7f5e24c00640 1 -- 172.21.15.1:0/3852424679 <== mgr.14118 v2:172.21.15.1:6800/3145051160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5e28104160 con 0x7f5e0c0391b0 2024-09-15T22:15:10.045 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:09.379+0000 7f5e2e800640 1 -- 172.21.15.1:0/3852424679 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f5e0c0391b0 msgr2=0x7f5e0c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:10.045 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:09.379+0000 7f5e2e800640 1 --2- 172.21.15.1:0/3852424679 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f5e0c0391b0 0x7f5e0c03b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5e100098c0 tx=0x7f5e10006db0 comp rx=0 tx=0).stop 2024-09-15T22:15:10.045 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:09.379+0000 7f5e2e800640 1 -- 172.21.15.1:0/3852424679 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e28107700 msgr2=0x7f5e2819b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:10.045 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:09.379+0000 7f5e2e800640 1 --2- 172.21.15.1:0/3852424679 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e28107700 0x7f5e2819b6f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5e18009940 tx=0x7f5e18032ce0 comp rx=0 tx=0).stop 2024-09-15T22:15:10.045 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:09.379+0000 7f5e2e800640 1 -- 172.21.15.1:0/3852424679 shutdown_connections 2024-09-15T22:15:10.045 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:09.379+0000 7f5e2e800640 1 --2- 172.21.15.1:0/3852424679 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f5e0c0391b0 0x7f5e0c03b670 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:10.045 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:09.379+0000 7f5e2e800640 1 --2- 172.21.15.1:0/3852424679 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e28107700 0x7f5e2819b6f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:10.045 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:09.379+0000 7f5e2e800640 1 -- 172.21.15.1:0/3852424679 >> 172.21.15.1:0/3852424679 conn(0x7f5e28102f30 msgr2=0x7f5e28103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:10.045 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:09.379+0000 7f5e2e800640 1 -- 172.21.15.1:0/3852424679 shutdown_connections 2024-09-15T22:15:10.045 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:09.379+0000 7f5e2e800640 1 -- 172.21.15.1:0/3852424679 wait complete. 2024-09-15T22:15:10.568 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:10 smithi001 ceph-mon[30843]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:15:10.568 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:10 smithi001 ceph-mon[30843]: Generating ssh key... 2024-09-15T22:15:10.568 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:10 smithi001 ceph-mon[30843]: from='mgr.14118 172.21.15.1:0/1750299612' entity='mgr.x' 2024-09-15T22:15:10.568 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:10 smithi001 ceph-mon[30843]: from='mgr.14118 172.21.15.1:0/1750299612' entity='mgr.x' 2024-09-15T22:15:11.362 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9kM2NUXB6mcIaPfEKQwKY5McabOHDqG+JUXGaXVhFfzuZEWJvFy9VVqNPkO3Hi/bRXjbGMW5XoNSDqgh3E+2jrme5G05fQUAmQSwhfBw3N7ntUDLd+D63Y6hB+vgMHUC+mrPS2qdJNEQshI7gUwxPoQ7Ky50VSlXVSxL21cyyEd6nnHhQmK5n0L5+kuZFa0eKFwVZh+7fK29AUrpuuiNJKUIh+EmrfmtH5eTMhnR/sGRw+Q/JrZq5VqF3DrMi1BeKP1DD7buPtteW7f8OgRIrGJV35GXAOkLG7yxew8gW0+vFZYGlDq3aM/Fy5C/ZjTCWSaznqtSxidQjBJ0Q4XogHUCSWEN69mYc6kWDGCAgRox29VszmsjPfQhYouMJUCIAvFQGLR6INOyYChQ22dcXGa9q7Mcl2hbv5TtbVMTfWzz+NYRKXCX4/fF/9a0rWJ2gFuGUA62i6qcpFXtY7YOWjzGqRom0kXk99tQHfFYYg7X6L51R/qGioo6HI6waeUU= ceph-c1228c44-73af-11ef-bceb-c7b262605968 2024-09-15T22:15:11.368 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.565+0000 7f57ee800640 1 Processor -- start 2024-09-15T22:15:11.368 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.566+0000 7f57ee800640 1 -- start start 2024-09-15T22:15:11.368 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.566+0000 7f57ee800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57e8109930 0x7f57e8109d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:11.368 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.566+0000 7f57ee800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f57e810a300 con 0x7f57e8109930 2024-09-15T22:15:11.368 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.566+0000 7f57e7400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57e8109930 0x7f57e8109d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:11.368 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.567+0000 7f57e7400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57e8109930 0x7f57e8109d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49454/0 (socket says 172.21.15.1:49454) 2024-09-15T22:15:11.368 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.567+0000 7f57e7400640 1 -- 172.21.15.1:0/793012146 learned_addr learned my addr 172.21.15.1:0/793012146 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:11.368 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.567+0000 7f57e7400640 1 -- 172.21.15.1:0/793012146 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57e810ab20 con 0x7f57e8109930 2024-09-15T22:15:11.368 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.568+0000 7f57e7400640 1 --2- 172.21.15.1:0/793012146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57e8109930 0x7f57e8109d30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f57d8009820 tx=0x7f57d802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28e695d451537888 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:11.368 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.568+0000 7f57e6a00640 1 -- 172.21.15.1:0/793012146 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57d8037070 con 0x7f57e8109930 2024-09-15T22:15:11.369 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.568+0000 7f57e6a00640 1 -- 172.21.15.1:0/793012146 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f57d8032900 con 0x7f57e8109930 2024-09-15T22:15:11.369 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.568+0000 7f57e6a00640 1 -- 172.21.15.1:0/793012146 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57d8030850 con 0x7f57e8109930 2024-09-15T22:15:11.369 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.569+0000 7f57ee800640 1 -- 172.21.15.1:0/793012146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57e8109930 msgr2=0x7f57e8109d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:11.369 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.569+0000 7f57ee800640 1 --2- 172.21.15.1:0/793012146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57e8109930 0x7f57e8109d30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f57d8009820 tx=0x7f57d802a270 comp rx=0 tx=0).stop 2024-09-15T22:15:11.369 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.569+0000 7f57ee800640 1 -- 172.21.15.1:0/793012146 shutdown_connections 2024-09-15T22:15:11.369 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.569+0000 7f57ee800640 1 --2- 172.21.15.1:0/793012146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57e8109930 0x7f57e8109d30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:11.369 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.569+0000 7f57ee800640 1 -- 172.21.15.1:0/793012146 >> 172.21.15.1:0/793012146 conn(0x7f57e807cfa0 msgr2=0x7f57e807d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:11.369 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.569+0000 7f57ee800640 1 -- 172.21.15.1:0/793012146 shutdown_connections 2024-09-15T22:15:11.369 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.569+0000 7f57ee800640 1 -- 172.21.15.1:0/793012146 wait complete. 2024-09-15T22:15:11.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.571+0000 7f57ee800640 1 Processor -- start 2024-09-15T22:15:11.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.571+0000 7f57ee800640 1 -- start start 2024-09-15T22:15:11.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.571+0000 7f57ee800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57e8109930 0x7f57e819d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:11.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.571+0000 7f57ee800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f57e810ded0 con 0x7f57e8109930 2024-09-15T22:15:11.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.571+0000 7f57e7400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57e8109930 0x7f57e819d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:11.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.571+0000 7f57e7400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57e8109930 0x7f57e819d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49466/0 (socket says 172.21.15.1:49466) 2024-09-15T22:15:11.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.571+0000 7f57e7400640 1 -- 172.21.15.1:0/558422074 learned_addr learned my addr 172.21.15.1:0/558422074 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:11.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.572+0000 7f57e7400640 1 -- 172.21.15.1:0/558422074 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57e819de80 con 0x7f57e8109930 2024-09-15T22:15:11.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.572+0000 7f57e7400640 1 --2- 172.21.15.1:0/558422074 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57e8109930 0x7f57e819d940 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f57d80097f0 tx=0x7f57d8030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:11.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.572+0000 7f57e4c00640 1 -- 172.21.15.1:0/558422074 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57d8037040 con 0x7f57e8109930 2024-09-15T22:15:11.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.572+0000 7f57e4c00640 1 -- 172.21.15.1:0/558422074 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f57d8040070 con 0x7f57e8109930 2024-09-15T22:15:11.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.572+0000 7f57e4c00640 1 -- 172.21.15.1:0/558422074 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57d803a390 con 0x7f57e8109930 2024-09-15T22:15:11.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.572+0000 7f57ee800640 1 -- 172.21.15.1:0/558422074 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57e819e110 con 0x7f57e8109930 2024-09-15T22:15:11.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.573+0000 7f57ee800640 1 -- 172.21.15.1:0/558422074 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57e81a0e00 con 0x7f57e8109930 2024-09-15T22:15:11.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.574+0000 7f57ee800640 1 -- 172.21.15.1:0/558422074 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57e8109db0 con 0x7f57e8109930 2024-09-15T22:15:11.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.574+0000 7f57e4c00640 1 -- 172.21.15.1:0/558422074 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f57d803b430 con 0x7f57e8109930 2024-09-15T22:15:11.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.574+0000 7f57e4c00640 1 --2- 172.21.15.1:0/558422074 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f57cc039200 0x7f57cc03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:11.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.575+0000 7f57e4c00640 1 -- 172.21.15.1:0/558422074 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f57d806c7d0 con 0x7f57e8109930 2024-09-15T22:15:11.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.575+0000 7f57dfe00640 1 --2- 172.21.15.1:0/558422074 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f57cc039200 0x7f57cc03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:11.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.576+0000 7f57dfe00640 1 --2- 172.21.15.1:0/558422074 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f57cc039200 0x7f57cc03b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f57d00098c0 tx=0x7f57d0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:11.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.579+0000 7f57e4c00640 1 -- 172.21.15.1:0/558422074 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f57d806c120 con 0x7f57e8109930 2024-09-15T22:15:11.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.764+0000 7f57ee800640 1 -- 172.21.15.1:0/558422074 --> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f57e8107c50 con 0x7f57cc039200 2024-09-15T22:15:11.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.764+0000 7f57e4c00640 1 -- 172.21.15.1:0/558422074 <== mgr.14118 v2:172.21.15.1:6800/3145051160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f57e8107c50 con 0x7f57cc039200 2024-09-15T22:15:11.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.767+0000 7f57ee800640 1 -- 172.21.15.1:0/558422074 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f57cc039200 msgr2=0x7f57cc03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:11.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.767+0000 7f57ee800640 1 --2- 172.21.15.1:0/558422074 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f57cc039200 0x7f57cc03b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f57d00098c0 tx=0x7f57d0006db0 comp rx=0 tx=0).stop 2024-09-15T22:15:11.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.767+0000 7f57ee800640 1 -- 172.21.15.1:0/558422074 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57e8109930 msgr2=0x7f57e819d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:11.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.767+0000 7f57ee800640 1 --2- 172.21.15.1:0/558422074 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57e8109930 0x7f57e819d940 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f57d80097f0 tx=0x7f57d8030d80 comp rx=0 tx=0).stop 2024-09-15T22:15:11.372 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.767+0000 7f57ee800640 1 -- 172.21.15.1:0/558422074 shutdown_connections 2024-09-15T22:15:11.372 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.767+0000 7f57ee800640 1 --2- 172.21.15.1:0/558422074 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f57cc039200 0x7f57cc03b6c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:11.372 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.767+0000 7f57ee800640 1 --2- 172.21.15.1:0/558422074 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57e8109930 0x7f57e819d940 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:11.372 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.767+0000 7f57ee800640 1 -- 172.21.15.1:0/558422074 >> 172.21.15.1:0/558422074 conn(0x7f57e807cfa0 msgr2=0x7f57e8107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:11.372 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.767+0000 7f57ee800640 1 -- 172.21.15.1:0/558422074 shutdown_connections 2024-09-15T22:15:11.372 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:10.767+0000 7f57ee800640 1 -- 172.21.15.1:0/558422074 wait complete. 2024-09-15T22:15:11.372 INFO:teuthology.orchestra.run.smithi001.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-15T22:15:11.372 INFO:teuthology.orchestra.run.smithi001.stdout:Adding key to root@localhost authorized_keys... 2024-09-15T22:15:11.374 INFO:teuthology.orchestra.run.smithi001.stdout:Adding host smithi001... 2024-09-15T22:15:11.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:11 smithi001 ceph-mon[30843]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:15:13.264 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:12 smithi001 ceph-mon[30843]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi001", "addr": "172.21.15.1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:15:14.357 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:13 smithi001 ceph-mon[30843]: Deploying cephadm binary to smithi001 2024-09-15T22:15:17.441 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout Added host 'smithi001' with addr '172.21.15.1' 2024-09-15T22:15:17.441 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.866+0000 7fe3cb200640 1 Processor -- start 2024-09-15T22:15:17.441 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.866+0000 7fe3cb200640 1 -- start start 2024-09-15T22:15:17.441 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.867+0000 7fe3cb200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3c4109930 0x7fe3c4109d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:17.441 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.867+0000 7fe3cb200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c410a300 con 0x7fe3c4109930 2024-09-15T22:15:17.441 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.867+0000 7fe3c3e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3c4109930 0x7fe3c4109d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:17.441 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.867+0000 7fe3c3e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3c4109930 0x7fe3c4109d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49478/0 (socket says 172.21.15.1:49478) 2024-09-15T22:15:17.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.867+0000 7fe3c3e00640 1 -- 172.21.15.1:0/607203137 learned_addr learned my addr 172.21.15.1:0/607203137 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:17.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.867+0000 7fe3c3e00640 1 -- 172.21.15.1:0/607203137 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3c410ab20 con 0x7fe3c4109930 2024-09-15T22:15:17.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.868+0000 7fe3c3e00640 1 --2- 172.21.15.1:0/607203137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3c4109930 0x7fe3c4109d30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4009820 tx=0x7fe3b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf06829f8cefbe server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:17.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.869+0000 7fe3c3400640 1 -- 172.21.15.1:0/607203137 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3b4037070 con 0x7fe3c4109930 2024-09-15T22:15:17.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.869+0000 7fe3c3400640 1 -- 172.21.15.1:0/607203137 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe3b4032900 con 0x7fe3c4109930 2024-09-15T22:15:17.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.869+0000 7fe3c3400640 1 -- 172.21.15.1:0/607203137 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3b4030850 con 0x7fe3c4109930 2024-09-15T22:15:17.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.869+0000 7fe3cb200640 1 -- 172.21.15.1:0/607203137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3c4109930 msgr2=0x7fe3c4109d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:17.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.869+0000 7fe3cb200640 1 --2- 172.21.15.1:0/607203137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3c4109930 0x7fe3c4109d30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4009820 tx=0x7fe3b402a270 comp rx=0 tx=0).stop 2024-09-15T22:15:17.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.869+0000 7fe3cb200640 1 -- 172.21.15.1:0/607203137 shutdown_connections 2024-09-15T22:15:17.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.869+0000 7fe3cb200640 1 --2- 172.21.15.1:0/607203137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3c4109930 0x7fe3c4109d30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:17.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.869+0000 7fe3cb200640 1 -- 172.21.15.1:0/607203137 >> 172.21.15.1:0/607203137 conn(0x7fe3c407cfa0 msgr2=0x7fe3c407d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:17.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.869+0000 7fe3cb200640 1 -- 172.21.15.1:0/607203137 shutdown_connections 2024-09-15T22:15:17.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.870+0000 7fe3cb200640 1 -- 172.21.15.1:0/607203137 wait complete. 2024-09-15T22:15:17.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.870+0000 7fe3cb200640 1 Processor -- start 2024-09-15T22:15:17.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.870+0000 7fe3cb200640 1 -- start start 2024-09-15T22:15:17.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.871+0000 7fe3cb200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3c4109930 0x7fe3c419d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:17.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.871+0000 7fe3cb200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c410ded0 con 0x7fe3c4109930 2024-09-15T22:15:17.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.871+0000 7fe3c3e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3c4109930 0x7fe3c419d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:17.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.871+0000 7fe3c3e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3c4109930 0x7fe3c419d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49492/0 (socket says 172.21.15.1:49492) 2024-09-15T22:15:17.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.871+0000 7fe3c3e00640 1 -- 172.21.15.1:0/3134272273 learned_addr learned my addr 172.21.15.1:0/3134272273 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:17.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.871+0000 7fe3c3e00640 1 -- 172.21.15.1:0/3134272273 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3c419de80 con 0x7fe3c4109930 2024-09-15T22:15:17.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.872+0000 7fe3c3e00640 1 --2- 172.21.15.1:0/3134272273 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3c4109930 0x7fe3c419d940 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe3b40097f0 tx=0x7fe3b4030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:17.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.872+0000 7fe3c1600640 1 -- 172.21.15.1:0/3134272273 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3b4037040 con 0x7fe3c4109930 2024-09-15T22:15:17.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.872+0000 7fe3c1600640 1 -- 172.21.15.1:0/3134272273 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe3b4040070 con 0x7fe3c4109930 2024-09-15T22:15:17.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.872+0000 7fe3cb200640 1 -- 172.21.15.1:0/3134272273 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3c419e110 con 0x7fe3c4109930 2024-09-15T22:15:17.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.872+0000 7fe3c1600640 1 -- 172.21.15.1:0/3134272273 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3b403a390 con 0x7fe3c4109930 2024-09-15T22:15:17.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.872+0000 7fe3cb200640 1 -- 172.21.15.1:0/3134272273 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3c41a0e00 con 0x7fe3c4109930 2024-09-15T22:15:17.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.873+0000 7fe3c1600640 1 -- 172.21.15.1:0/3134272273 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fe3b403b430 con 0x7fe3c4109930 2024-09-15T22:15:17.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.873+0000 7fe3cb200640 1 -- 172.21.15.1:0/3134272273 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3c4109db0 con 0x7fe3c4109930 2024-09-15T22:15:17.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.874+0000 7fe3c1600640 1 --2- 172.21.15.1:0/3134272273 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fe3a8039200 0x7fe3a803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:17.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.874+0000 7fe3c1600640 1 -- 172.21.15.1:0/3134272273 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe3b406c710 con 0x7fe3c4109930 2024-09-15T22:15:17.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.874+0000 7fe3bb400640 1 --2- 172.21.15.1:0/3134272273 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fe3a8039200 0x7fe3a803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:17.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.874+0000 7fe3bb400640 1 --2- 172.21.15.1:0/3134272273 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fe3a8039200 0x7fe3a803b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac0098c0 tx=0x7fe3ac006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:17.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:11.878+0000 7fe3c1600640 1 -- 172.21.15.1:0/3134272273 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe3b4032900 con 0x7fe3c4109930 2024-09-15T22:15:17.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:12.068+0000 7fe3cb200640 1 -- 172.21.15.1:0/3134272273 --> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi001", "addr": "172.21.15.1", "target": ["mon-mgr", ""]}) -- 0x7fe3c4107c50 con 0x7fe3a8039200 2024-09-15T22:15:17.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:16.586+0000 7fe3c1600640 1 -- 172.21.15.1:0/3134272273 <== mgr.14118 v2:172.21.15.1:6800/3145051160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7fe3c4107c50 con 0x7fe3a8039200 2024-09-15T22:15:17.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:16.588+0000 7fe3cb200640 1 -- 172.21.15.1:0/3134272273 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fe3a8039200 msgr2=0x7fe3a803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:17.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:16.588+0000 7fe3cb200640 1 --2- 172.21.15.1:0/3134272273 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fe3a8039200 0x7fe3a803b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac0098c0 tx=0x7fe3ac006db0 comp rx=0 tx=0).stop 2024-09-15T22:15:17.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:16.588+0000 7fe3cb200640 1 -- 172.21.15.1:0/3134272273 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3c4109930 msgr2=0x7fe3c419d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:17.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:16.588+0000 7fe3cb200640 1 --2- 172.21.15.1:0/3134272273 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3c4109930 0x7fe3c419d940 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe3b40097f0 tx=0x7fe3b4030d80 comp rx=0 tx=0).stop 2024-09-15T22:15:17.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:16.589+0000 7fe3cb200640 1 -- 172.21.15.1:0/3134272273 shutdown_connections 2024-09-15T22:15:17.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:16.589+0000 7fe3cb200640 1 --2- 172.21.15.1:0/3134272273 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fe3a8039200 0x7fe3a803b6c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:17.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:16.589+0000 7fe3cb200640 1 --2- 172.21.15.1:0/3134272273 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3c4109930 0x7fe3c419d940 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:17.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:16.589+0000 7fe3cb200640 1 -- 172.21.15.1:0/3134272273 >> 172.21.15.1:0/3134272273 conn(0x7fe3c407cfa0 msgr2=0x7fe3c4107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:17.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:16.589+0000 7fe3cb200640 1 -- 172.21.15.1:0/3134272273 shutdown_connections 2024-09-15T22:15:17.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:16.589+0000 7fe3cb200640 1 -- 172.21.15.1:0/3134272273 wait complete. 2024-09-15T22:15:17.445 INFO:teuthology.orchestra.run.smithi001.stdout:Deploying unmanaged mon service... 2024-09-15T22:15:17.719 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:17 smithi001 ceph-mon[30843]: from='mgr.14118 172.21.15.1:0/1750299612' entity='mgr.x' 2024-09-15T22:15:17.719 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:17 smithi001 ceph-mon[30843]: Added host smithi001 2024-09-15T22:15:17.720 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:17 smithi001 ceph-mon[30843]: from='mgr.14118 172.21.15.1:0/1750299612' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:15:19.067 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-15T22:15:19.067 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.961+0000 7f56be200640 1 Processor -- start 2024-09-15T22:15:19.067 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.962+0000 7f56be200640 1 -- start start 2024-09-15T22:15:19.067 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.962+0000 7f56be200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56b807de20 0x7f56b807c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:19.067 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.962+0000 7f56be200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f56b807c850 con 0x7f56b807de20 2024-09-15T22:15:19.067 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.962+0000 7f56b7400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56b807de20 0x7f56b807c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:19.068 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.963+0000 7f56b7400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56b807de20 0x7f56b807c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46280/0 (socket says 172.21.15.1:46280) 2024-09-15T22:15:19.068 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.963+0000 7f56b7400640 1 -- 172.21.15.1:0/3170032681 learned_addr learned my addr 172.21.15.1:0/3170032681 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:19.068 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.963+0000 7f56b7400640 1 -- 172.21.15.1:0/3170032681 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b807c9d0 con 0x7f56b807de20 2024-09-15T22:15:19.068 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.964+0000 7f56b7400640 1 --2- 172.21.15.1:0/3170032681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56b807de20 0x7f56b807c280 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f56a8009820 tx=0x7f56a802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e425092ee66b2f18 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:19.068 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.964+0000 7f56b6a00640 1 -- 172.21.15.1:0/3170032681 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56a8037070 con 0x7f56b807de20 2024-09-15T22:15:19.068 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.964+0000 7f56b6a00640 1 -- 172.21.15.1:0/3170032681 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f56a8032900 con 0x7f56b807de20 2024-09-15T22:15:19.068 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.964+0000 7f56b6a00640 1 -- 172.21.15.1:0/3170032681 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56a8030850 con 0x7f56b807de20 2024-09-15T22:15:19.068 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.965+0000 7f56be200640 1 -- 172.21.15.1:0/3170032681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56b807de20 msgr2=0x7f56b807c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:19.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.965+0000 7f56be200640 1 --2- 172.21.15.1:0/3170032681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56b807de20 0x7f56b807c280 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f56a8009820 tx=0x7f56a802a270 comp rx=0 tx=0).stop 2024-09-15T22:15:19.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.965+0000 7f56be200640 1 -- 172.21.15.1:0/3170032681 shutdown_connections 2024-09-15T22:15:19.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.965+0000 7f56be200640 1 --2- 172.21.15.1:0/3170032681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56b807de20 0x7f56b807c280 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:19.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.965+0000 7f56be200640 1 -- 172.21.15.1:0/3170032681 >> 172.21.15.1:0/3170032681 conn(0x7f56b8102f30 msgr2=0x7f56b8105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:19.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.965+0000 7f56be200640 1 -- 172.21.15.1:0/3170032681 shutdown_connections 2024-09-15T22:15:19.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.965+0000 7f56be200640 1 -- 172.21.15.1:0/3170032681 wait complete. 2024-09-15T22:15:19.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.966+0000 7f56be200640 1 Processor -- start 2024-09-15T22:15:19.070 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.966+0000 7f56be200640 1 -- start start 2024-09-15T22:15:19.070 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.967+0000 7f56be200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56b807de20 0x7f56b819d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:19.070 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.967+0000 7f56be200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f56b810dd70 con 0x7f56b807de20 2024-09-15T22:15:19.070 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.967+0000 7f56b7400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56b807de20 0x7f56b819d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:19.070 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.967+0000 7f56b7400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56b807de20 0x7f56b819d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46284/0 (socket says 172.21.15.1:46284) 2024-09-15T22:15:19.070 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.967+0000 7f56b7400640 1 -- 172.21.15.1:0/2734538456 learned_addr learned my addr 172.21.15.1:0/2734538456 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:19.071 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.967+0000 7f56b7400640 1 -- 172.21.15.1:0/2734538456 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b819de10 con 0x7f56b807de20 2024-09-15T22:15:19.071 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.968+0000 7f56b7400640 1 --2- 172.21.15.1:0/2734538456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56b807de20 0x7f56b819d8d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f56a80097f0 tx=0x7f56a8030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:19.071 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.968+0000 7f56b4c00640 1 -- 172.21.15.1:0/2734538456 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56a8037040 con 0x7f56b807de20 2024-09-15T22:15:19.072 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.968+0000 7f56b4c00640 1 -- 172.21.15.1:0/2734538456 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f56a8040070 con 0x7f56b807de20 2024-09-15T22:15:19.072 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.968+0000 7f56b4c00640 1 -- 172.21.15.1:0/2734538456 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56a803a390 con 0x7f56b807de20 2024-09-15T22:15:19.072 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.968+0000 7f56be200640 1 -- 172.21.15.1:0/2734538456 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56b819e0a0 con 0x7f56b807de20 2024-09-15T22:15:19.072 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.968+0000 7f56be200640 1 -- 172.21.15.1:0/2734538456 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56b81a0d90 con 0x7f56b807de20 2024-09-15T22:15:19.072 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.969+0000 7f56b4c00640 1 -- 172.21.15.1:0/2734538456 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f56a803b430 con 0x7f56b807de20 2024-09-15T22:15:19.072 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.969+0000 7f56be200640 1 -- 172.21.15.1:0/2734538456 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56b807c300 con 0x7f56b807de20 2024-09-15T22:15:19.073 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.970+0000 7f56b4c00640 1 --2- 172.21.15.1:0/2734538456 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f569c039200 0x7f569c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:19.073 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.970+0000 7f56b4c00640 1 -- 172.21.15.1:0/2734538456 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f56a806c7f0 con 0x7f56b807de20 2024-09-15T22:15:19.073 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.970+0000 7f56afe00640 1 --2- 172.21.15.1:0/2734538456 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f569c039200 0x7f569c03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:19.073 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.971+0000 7f56afe00640 1 --2- 172.21.15.1:0/2734538456 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f569c039200 0x7f569c03b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f56a00098c0 tx=0x7f56a0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:19.074 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:17.975+0000 7f56b4c00640 1 -- 172.21.15.1:0/2734538456 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f56a80371e0 con 0x7f56b807de20 2024-09-15T22:15:19.074 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:18.173+0000 7f56be200640 1 -- 172.21.15.1:0/2734538456 --> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f56b8104190 con 0x7f569c039200 2024-09-15T22:15:19.074 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:18.178+0000 7f56b4c00640 1 -- 172.21.15.1:0/2734538456 <== mgr.14118 v2:172.21.15.1:6800/3145051160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f56b8104190 con 0x7f569c039200 2024-09-15T22:15:19.074 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:18.180+0000 7f56be200640 1 -- 172.21.15.1:0/2734538456 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f569c039200 msgr2=0x7f569c03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:19.074 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:18.180+0000 7f56be200640 1 --2- 172.21.15.1:0/2734538456 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f569c039200 0x7f569c03b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f56a00098c0 tx=0x7f56a0006db0 comp rx=0 tx=0).stop 2024-09-15T22:15:19.074 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:18.180+0000 7f56be200640 1 -- 172.21.15.1:0/2734538456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56b807de20 msgr2=0x7f56b819d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:19.075 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:18.180+0000 7f56be200640 1 --2- 172.21.15.1:0/2734538456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56b807de20 0x7f56b819d8d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f56a80097f0 tx=0x7f56a8030d80 comp rx=0 tx=0).stop 2024-09-15T22:15:19.075 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:18.180+0000 7f56be200640 1 -- 172.21.15.1:0/2734538456 shutdown_connections 2024-09-15T22:15:19.075 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:18.181+0000 7f56be200640 1 --2- 172.21.15.1:0/2734538456 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f569c039200 0x7f569c03b6c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:19.075 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:18.181+0000 7f56be200640 1 --2- 172.21.15.1:0/2734538456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56b807de20 0x7f56b819d8d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:19.075 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:18.181+0000 7f56be200640 1 -- 172.21.15.1:0/2734538456 >> 172.21.15.1:0/2734538456 conn(0x7f56b8102f30 msgr2=0x7f56b8103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:19.075 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:18.181+0000 7f56be200640 1 -- 172.21.15.1:0/2734538456 shutdown_connections 2024-09-15T22:15:19.076 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:18.181+0000 7f56be200640 1 -- 172.21.15.1:0/2734538456 wait complete. 2024-09-15T22:15:19.076 INFO:teuthology.orchestra.run.smithi001.stdout:Deploying unmanaged mgr service... 2024-09-15T22:15:19.351 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:19 smithi001 ceph-mon[30843]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:15:19.351 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:19 smithi001 ceph-mon[30843]: Saving service mon spec with placement count:5 2024-09-15T22:15:19.351 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:19 smithi001 ceph-mon[30843]: from='mgr.14118 172.21.15.1:0/1750299612' entity='mgr.x' 2024-09-15T22:15:21.225 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-15T22:15:21.225 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.149+0000 7f9a3d800640 1 Processor -- start 2024-09-15T22:15:21.225 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.149+0000 7f9a3d800640 1 -- start start 2024-09-15T22:15:21.225 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.149+0000 7f9a3d800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a38109910 0x7f9a38109d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:21.225 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.149+0000 7f9a3d800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3810a2e0 con 0x7f9a38109910 2024-09-15T22:15:21.225 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.149+0000 7f9a36a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a38109910 0x7f9a38109d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:21.225 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.150+0000 7f9a36a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a38109910 0x7f9a38109d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46290/0 (socket says 172.21.15.1:46290) 2024-09-15T22:15:21.225 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.150+0000 7f9a36a00640 1 -- 172.21.15.1:0/868617910 learned_addr learned my addr 172.21.15.1:0/868617910 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:21.226 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.150+0000 7f9a36a00640 1 -- 172.21.15.1:0/868617910 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a3810ab10 con 0x7f9a38109910 2024-09-15T22:15:21.226 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.151+0000 7f9a36a00640 1 --2- 172.21.15.1:0/868617910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a38109910 0x7f9a38109d10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9a28009820 tx=0x7f9a2802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5177aa3648b2716b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:21.226 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.151+0000 7f9a36000640 1 -- 172.21.15.1:0/868617910 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a28037070 con 0x7f9a38109910 2024-09-15T22:15:21.226 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.151+0000 7f9a36000640 1 -- 172.21.15.1:0/868617910 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9a28032900 con 0x7f9a38109910 2024-09-15T22:15:21.226 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.151+0000 7f9a36000640 1 -- 172.21.15.1:0/868617910 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a28030850 con 0x7f9a38109910 2024-09-15T22:15:21.226 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.152+0000 7f9a3d800640 1 -- 172.21.15.1:0/868617910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a38109910 msgr2=0x7f9a38109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:21.226 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.152+0000 7f9a3d800640 1 --2- 172.21.15.1:0/868617910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a38109910 0x7f9a38109d10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9a28009820 tx=0x7f9a2802a270 comp rx=0 tx=0).stop 2024-09-15T22:15:21.226 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.152+0000 7f9a3d800640 1 -- 172.21.15.1:0/868617910 shutdown_connections 2024-09-15T22:15:21.226 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.152+0000 7f9a3d800640 1 --2- 172.21.15.1:0/868617910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a38109910 0x7f9a38109d10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:21.226 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.152+0000 7f9a3d800640 1 -- 172.21.15.1:0/868617910 >> 172.21.15.1:0/868617910 conn(0x7f9a3807cf50 msgr2=0x7f9a3807d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:21.226 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.152+0000 7f9a3d800640 1 -- 172.21.15.1:0/868617910 shutdown_connections 2024-09-15T22:15:21.226 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.152+0000 7f9a3d800640 1 -- 172.21.15.1:0/868617910 wait complete. 2024-09-15T22:15:21.226 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.153+0000 7f9a3d800640 1 Processor -- start 2024-09-15T22:15:21.227 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.153+0000 7f9a3d800640 1 -- start start 2024-09-15T22:15:21.227 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.153+0000 7f9a3d800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a38109910 0x7f9a3819d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:21.227 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.153+0000 7f9a3d800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3810dec0 con 0x7f9a38109910 2024-09-15T22:15:21.227 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.153+0000 7f9a36a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a38109910 0x7f9a3819d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:21.227 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.153+0000 7f9a36a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a38109910 0x7f9a3819d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46302/0 (socket says 172.21.15.1:46302) 2024-09-15T22:15:21.227 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.153+0000 7f9a36a00640 1 -- 172.21.15.1:0/2563823081 learned_addr learned my addr 172.21.15.1:0/2563823081 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:21.227 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.154+0000 7f9a36a00640 1 -- 172.21.15.1:0/2563823081 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a3819de50 con 0x7f9a38109910 2024-09-15T22:15:21.227 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.154+0000 7f9a36a00640 1 --2- 172.21.15.1:0/2563823081 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a38109910 0x7f9a3819d910 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9a28009940 tx=0x7f9a28032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:21.227 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.154+0000 7f9a2fe00640 1 -- 172.21.15.1:0/2563823081 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a28042070 con 0x7f9a38109910 2024-09-15T22:15:21.227 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.154+0000 7f9a2fe00640 1 -- 172.21.15.1:0/2563823081 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9a280308c0 con 0x7f9a38109910 2024-09-15T22:15:21.227 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.154+0000 7f9a2fe00640 1 -- 172.21.15.1:0/2563823081 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a28037040 con 0x7f9a38109910 2024-09-15T22:15:21.227 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.154+0000 7f9a3d800640 1 -- 172.21.15.1:0/2563823081 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a3819e0e0 con 0x7f9a38109910 2024-09-15T22:15:21.227 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.155+0000 7f9a3d800640 1 -- 172.21.15.1:0/2563823081 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a381a0dd0 con 0x7f9a38109910 2024-09-15T22:15:21.228 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.155+0000 7f9a2fe00640 1 -- 172.21.15.1:0/2563823081 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f9a28045070 con 0x7f9a38109910 2024-09-15T22:15:21.228 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.156+0000 7f9a3d800640 1 -- 172.21.15.1:0/2563823081 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a3810e040 con 0x7f9a38109910 2024-09-15T22:15:21.228 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.156+0000 7f9a2fe00640 1 --2- 172.21.15.1:0/2563823081 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f9a1c039200 0x7f9a1c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:21.228 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.156+0000 7f9a2fe00640 1 -- 172.21.15.1:0/2563823081 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f9a2806c3e0 con 0x7f9a38109910 2024-09-15T22:15:21.228 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.156+0000 7f9a2e000640 1 --2- 172.21.15.1:0/2563823081 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f9a1c039200 0x7f9a1c03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:21.228 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.157+0000 7f9a2e000640 1 --2- 172.21.15.1:0/2563823081 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f9a1c039200 0x7f9a1c03b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9a200098c0 tx=0x7f9a20006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:21.228 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.161+0000 7f9a2fe00640 1 -- 172.21.15.1:0/2563823081 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9a2804b170 con 0x7f9a38109910 2024-09-15T22:15:21.228 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.361+0000 7f9a3d800640 1 -- 172.21.15.1:0/2563823081 --> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f9a38107c60 con 0x7f9a1c039200 2024-09-15T22:15:21.228 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.367+0000 7f9a2fe00640 1 -- 172.21.15.1:0/2563823081 <== mgr.14118 v2:172.21.15.1:6800/3145051160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f9a38107c60 con 0x7f9a1c039200 2024-09-15T22:15:21.228 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.369+0000 7f9a3d800640 1 -- 172.21.15.1:0/2563823081 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f9a1c039200 msgr2=0x7f9a1c03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:21.228 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.369+0000 7f9a3d800640 1 --2- 172.21.15.1:0/2563823081 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f9a1c039200 0x7f9a1c03b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9a200098c0 tx=0x7f9a20006db0 comp rx=0 tx=0).stop 2024-09-15T22:15:21.228 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.369+0000 7f9a3d800640 1 -- 172.21.15.1:0/2563823081 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a38109910 msgr2=0x7f9a3819d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:21.228 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.369+0000 7f9a3d800640 1 --2- 172.21.15.1:0/2563823081 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a38109910 0x7f9a3819d910 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9a28009940 tx=0x7f9a28032ce0 comp rx=0 tx=0).stop 2024-09-15T22:15:21.229 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.370+0000 7f9a3d800640 1 -- 172.21.15.1:0/2563823081 shutdown_connections 2024-09-15T22:15:21.229 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.370+0000 7f9a3d800640 1 --2- 172.21.15.1:0/2563823081 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f9a1c039200 0x7f9a1c03b6c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:21.229 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.370+0000 7f9a3d800640 1 --2- 172.21.15.1:0/2563823081 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a38109910 0x7f9a3819d910 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:21.229 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.370+0000 7f9a3d800640 1 -- 172.21.15.1:0/2563823081 >> 172.21.15.1:0/2563823081 conn(0x7f9a3807cf50 msgr2=0x7f9a38107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:21.229 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.370+0000 7f9a3d800640 1 -- 172.21.15.1:0/2563823081 shutdown_connections 2024-09-15T22:15:21.229 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:20.370+0000 7f9a3d800640 1 -- 172.21.15.1:0/2563823081 wait complete. 2024-09-15T22:15:21.532 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:21 smithi001 ceph-mon[30843]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:15:21.532 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:21 smithi001 ceph-mon[30843]: Saving service mgr spec with placement count:2 2024-09-15T22:15:21.532 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:21 smithi001 ceph-mon[30843]: from='mgr.14118 172.21.15.1:0/1750299612' entity='mgr.x' 2024-09-15T22:15:21.532 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:21 smithi001 ceph-mon[30843]: from='mgr.14118 172.21.15.1:0/1750299612' entity='mgr.x' 2024-09-15T22:15:21.533 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:21 smithi001 ceph-mon[30843]: from='mgr.14118 172.21.15.1:0/1750299612' entity='mgr.x' 2024-09-15T22:15:22.597 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.758+0000 7fb0ea400640 1 Processor -- start 2024-09-15T22:15:22.597 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.758+0000 7fb0ea400640 1 -- start start 2024-09-15T22:15:22.598 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.759+0000 7fb0ea400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0e407de20 0x7fb0e407c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:22.598 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.759+0000 7fb0ea400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e407c850 con 0x7fb0e407de20 2024-09-15T22:15:22.598 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.759+0000 7fb0e3400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0e407de20 0x7fb0e407c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:22.598 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.759+0000 7fb0e3400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0e407de20 0x7fb0e407c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46316/0 (socket says 172.21.15.1:46316) 2024-09-15T22:15:22.598 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.759+0000 7fb0e3400640 1 -- 172.21.15.1:0/19078434 learned_addr learned my addr 172.21.15.1:0/19078434 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:22.598 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.759+0000 7fb0e3400640 1 -- 172.21.15.1:0/19078434 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0e407c9d0 con 0x7fb0e407de20 2024-09-15T22:15:22.598 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.760+0000 7fb0e3400640 1 --2- 172.21.15.1:0/19078434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0e407de20 0x7fb0e407c280 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4009820 tx=0x7fb0d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa46973dd7cf2dc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:22.598 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.761+0000 7fb0e2000640 1 -- 172.21.15.1:0/19078434 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0d4037070 con 0x7fb0e407de20 2024-09-15T22:15:22.598 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.761+0000 7fb0e2000640 1 -- 172.21.15.1:0/19078434 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0d4032920 con 0x7fb0e407de20 2024-09-15T22:15:22.598 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.761+0000 7fb0e2000640 1 -- 172.21.15.1:0/19078434 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0d4030810 con 0x7fb0e407de20 2024-09-15T22:15:22.598 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.761+0000 7fb0ea400640 1 -- 172.21.15.1:0/19078434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0e407de20 msgr2=0x7fb0e407c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:22.598 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.761+0000 7fb0ea400640 1 --2- 172.21.15.1:0/19078434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0e407de20 0x7fb0e407c280 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4009820 tx=0x7fb0d402a270 comp rx=0 tx=0).stop 2024-09-15T22:15:22.598 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.761+0000 7fb0ea400640 1 -- 172.21.15.1:0/19078434 shutdown_connections 2024-09-15T22:15:22.599 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.761+0000 7fb0ea400640 1 --2- 172.21.15.1:0/19078434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0e407de20 0x7fb0e407c280 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:22.599 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.761+0000 7fb0ea400640 1 -- 172.21.15.1:0/19078434 >> 172.21.15.1:0/19078434 conn(0x7fb0e4102f30 msgr2=0x7fb0e4105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:22.599 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.761+0000 7fb0ea400640 1 -- 172.21.15.1:0/19078434 shutdown_connections 2024-09-15T22:15:22.599 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.761+0000 7fb0ea400640 1 -- 172.21.15.1:0/19078434 wait complete. 2024-09-15T22:15:22.599 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.762+0000 7fb0ea400640 1 Processor -- start 2024-09-15T22:15:22.599 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.763+0000 7fb0ea400640 1 -- start start 2024-09-15T22:15:22.599 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.763+0000 7fb0ea400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0e407de20 0x7fb0e419d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:22.599 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.763+0000 7fb0ea400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e410ddd0 con 0x7fb0e407de20 2024-09-15T22:15:22.599 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.763+0000 7fb0e3400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0e407de20 0x7fb0e419d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:22.599 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.763+0000 7fb0e3400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0e407de20 0x7fb0e419d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46324/0 (socket says 172.21.15.1:46324) 2024-09-15T22:15:22.599 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.763+0000 7fb0e3400640 1 -- 172.21.15.1:0/3106716263 learned_addr learned my addr 172.21.15.1:0/3106716263 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:22.599 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.764+0000 7fb0e3400640 1 -- 172.21.15.1:0/3106716263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0e419de20 con 0x7fb0e407de20 2024-09-15T22:15:22.599 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.764+0000 7fb0e3400640 1 --2- 172.21.15.1:0/3106716263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0e407de20 0x7fb0e419d8e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4030380 tx=0x7fb0d4032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:22.600 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.764+0000 7fb0dbe00640 1 -- 172.21.15.1:0/3106716263 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0d4037040 con 0x7fb0e407de20 2024-09-15T22:15:22.600 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.764+0000 7fb0dbe00640 1 -- 172.21.15.1:0/3106716263 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0d4040070 con 0x7fb0e407de20 2024-09-15T22:15:22.600 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.764+0000 7fb0dbe00640 1 -- 172.21.15.1:0/3106716263 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0d403a7b0 con 0x7fb0e407de20 2024-09-15T22:15:22.600 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.764+0000 7fb0ea400640 1 -- 172.21.15.1:0/3106716263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0e419e0b0 con 0x7fb0e407de20 2024-09-15T22:15:22.600 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.764+0000 7fb0ea400640 1 -- 172.21.15.1:0/3106716263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0e41a0da0 con 0x7fb0e407de20 2024-09-15T22:15:22.600 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.765+0000 7fb0dbe00640 1 -- 172.21.15.1:0/3106716263 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fb0d403bc00 con 0x7fb0e407de20 2024-09-15T22:15:22.600 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.766+0000 7fb0ea400640 1 -- 172.21.15.1:0/3106716263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0e407c300 con 0x7fb0e407de20 2024-09-15T22:15:22.600 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.766+0000 7fb0dbe00640 1 --2- 172.21.15.1:0/3106716263 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fb0c80391b0 0x7fb0c803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:22.600 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.766+0000 7fb0dbe00640 1 -- 172.21.15.1:0/3106716263 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb0d406c980 con 0x7fb0e407de20 2024-09-15T22:15:22.600 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.766+0000 7fb0e2a00640 1 --2- 172.21.15.1:0/3106716263 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fb0c80391b0 0x7fb0c803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:22.600 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.767+0000 7fb0e2a00640 1 --2- 172.21.15.1:0/3106716263 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fb0c80391b0 0x7fb0c803b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb0d00098c0 tx=0x7fb0d0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:22.600 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.771+0000 7fb0dbe00640 1 -- 172.21.15.1:0/3106716263 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb0d406c2d0 con 0x7fb0e407de20 2024-09-15T22:15:22.601 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.969+0000 7fb0ea400640 1 -- 172.21.15.1:0/3106716263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fb0e41a1390 con 0x7fb0e407de20 2024-09-15T22:15:22.601 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.972+0000 7fb0dbe00640 1 -- 172.21.15.1:0/3106716263 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fb0d403b7a0 con 0x7fb0e407de20 2024-09-15T22:15:22.601 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.975+0000 7fb0ea400640 1 -- 172.21.15.1:0/3106716263 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fb0c80391b0 msgr2=0x7fb0c803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:22.601 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.975+0000 7fb0ea400640 1 --2- 172.21.15.1:0/3106716263 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fb0c80391b0 0x7fb0c803b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb0d00098c0 tx=0x7fb0d0006db0 comp rx=0 tx=0).stop 2024-09-15T22:15:22.601 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.975+0000 7fb0ea400640 1 -- 172.21.15.1:0/3106716263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0e407de20 msgr2=0x7fb0e419d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:22.601 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.975+0000 7fb0ea400640 1 --2- 172.21.15.1:0/3106716263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0e407de20 0x7fb0e419d8e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4030380 tx=0x7fb0d4032670 comp rx=0 tx=0).stop 2024-09-15T22:15:22.601 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.975+0000 7fb0ea400640 1 -- 172.21.15.1:0/3106716263 shutdown_connections 2024-09-15T22:15:22.601 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.975+0000 7fb0ea400640 1 --2- 172.21.15.1:0/3106716263 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fb0c80391b0 0x7fb0c803b670 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:22.601 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.975+0000 7fb0ea400640 1 --2- 172.21.15.1:0/3106716263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0e407de20 0x7fb0e419d8e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:22.601 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.975+0000 7fb0ea400640 1 -- 172.21.15.1:0/3106716263 >> 172.21.15.1:0/3106716263 conn(0x7fb0e4102f30 msgr2=0x7fb0e4103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:22.602 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.975+0000 7fb0ea400640 1 -- 172.21.15.1:0/3106716263 shutdown_connections 2024-09-15T22:15:22.602 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:21.975+0000 7fb0ea400640 1 -- 172.21.15.1:0/3106716263 wait complete. 2024-09-15T22:15:23.097 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:22 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/3106716263' entity='client.admin' 2024-09-15T22:15:24.321 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.086+0000 7fcb5b600640 1 Processor -- start 2024-09-15T22:15:24.321 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.087+0000 7fcb5b600640 1 -- start start 2024-09-15T22:15:24.321 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.087+0000 7fcb5b600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb54107700 0x7fcb54107b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:24.321 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.087+0000 7fcb5b600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcb541080d0 con 0x7fcb54107700 2024-09-15T22:15:24.321 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.087+0000 7fcb58c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb54107700 0x7fcb54107b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:24.321 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.087+0000 7fcb58c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb54107700 0x7fcb54107b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46336/0 (socket says 172.21.15.1:46336) 2024-09-15T22:15:24.321 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.087+0000 7fcb58c00640 1 -- 172.21.15.1:0/3752339301 learned_addr learned my addr 172.21.15.1:0/3752339301 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:24.322 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.088+0000 7fcb58c00640 1 -- 172.21.15.1:0/3752339301 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb54108900 con 0x7fcb54107700 2024-09-15T22:15:24.322 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.089+0000 7fcb58c00640 1 --2- 172.21.15.1:0/3752339301 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb54107700 0x7fcb54107b00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcb44009820 tx=0x7fcb4402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b913edeeb286df1f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:24.322 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.089+0000 7fcb53e00640 1 -- 172.21.15.1:0/3752339301 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb44037070 con 0x7fcb54107700 2024-09-15T22:15:24.322 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.089+0000 7fcb53e00640 1 -- 172.21.15.1:0/3752339301 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb44032920 con 0x7fcb54107700 2024-09-15T22:15:24.322 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.089+0000 7fcb53e00640 1 -- 172.21.15.1:0/3752339301 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb44030810 con 0x7fcb54107700 2024-09-15T22:15:24.322 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.089+0000 7fcb5b600640 1 -- 172.21.15.1:0/3752339301 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb54107700 msgr2=0x7fcb54107b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:24.322 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.089+0000 7fcb5b600640 1 --2- 172.21.15.1:0/3752339301 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb54107700 0x7fcb54107b00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcb44009820 tx=0x7fcb4402a270 comp rx=0 tx=0).stop 2024-09-15T22:15:24.322 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.090+0000 7fcb5b600640 1 -- 172.21.15.1:0/3752339301 shutdown_connections 2024-09-15T22:15:24.322 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.090+0000 7fcb5b600640 1 --2- 172.21.15.1:0/3752339301 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb54107700 0x7fcb54107b00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:24.322 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.090+0000 7fcb5b600640 1 -- 172.21.15.1:0/3752339301 >> 172.21.15.1:0/3752339301 conn(0x7fcb54102f30 msgr2=0x7fcb54105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:24.322 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.090+0000 7fcb5b600640 1 -- 172.21.15.1:0/3752339301 shutdown_connections 2024-09-15T22:15:24.322 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.090+0000 7fcb5b600640 1 -- 172.21.15.1:0/3752339301 wait complete. 2024-09-15T22:15:24.322 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.091+0000 7fcb5b600640 1 Processor -- start 2024-09-15T22:15:24.322 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.091+0000 7fcb5b600640 1 -- start start 2024-09-15T22:15:24.323 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.091+0000 7fcb5b600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb54107700 0x7fcb5419d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:24.323 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.091+0000 7fcb5b600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5410bcb0 con 0x7fcb54107700 2024-09-15T22:15:24.323 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.091+0000 7fcb58c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb54107700 0x7fcb5419d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:24.323 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.091+0000 7fcb58c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb54107700 0x7fcb5419d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46352/0 (socket says 172.21.15.1:46352) 2024-09-15T22:15:24.323 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.091+0000 7fcb58c00640 1 -- 172.21.15.1:0/3209993018 learned_addr learned my addr 172.21.15.1:0/3209993018 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:24.323 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.092+0000 7fcb58c00640 1 -- 172.21.15.1:0/3209993018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb5419df00 con 0x7fcb54107700 2024-09-15T22:15:24.323 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.092+0000 7fcb58c00640 1 --2- 172.21.15.1:0/3209993018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb54107700 0x7fcb5419d9c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcb440097f0 tx=0x7fcb440327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:24.323 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.092+0000 7fcb52000640 1 -- 172.21.15.1:0/3209993018 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb44037040 con 0x7fcb54107700 2024-09-15T22:15:24.323 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.092+0000 7fcb52000640 1 -- 172.21.15.1:0/3209993018 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb44030cc0 con 0x7fcb54107700 2024-09-15T22:15:24.323 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.092+0000 7fcb52000640 1 -- 172.21.15.1:0/3209993018 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb4403a640 con 0x7fcb54107700 2024-09-15T22:15:24.324 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.092+0000 7fcb5b600640 1 -- 172.21.15.1:0/3209993018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb5419e190 con 0x7fcb54107700 2024-09-15T22:15:24.324 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.092+0000 7fcb5b600640 1 -- 172.21.15.1:0/3209993018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb541a0e80 con 0x7fcb54107700 2024-09-15T22:15:24.324 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.093+0000 7fcb52000640 1 -- 172.21.15.1:0/3209993018 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fcb4403b3f0 con 0x7fcb54107700 2024-09-15T22:15:24.324 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.093+0000 7fcb5b600640 1 -- 172.21.15.1:0/3209993018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb5410be30 con 0x7fcb54107700 2024-09-15T22:15:24.324 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.094+0000 7fcb52000640 1 --2- 172.21.15.1:0/3209993018 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fcb38039200 0x7fcb3803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:24.324 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.094+0000 7fcb52000640 1 -- 172.21.15.1:0/3209993018 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fcb4406c860 con 0x7fcb54107700 2024-09-15T22:15:24.324 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.094+0000 7fcb4be00640 1 --2- 172.21.15.1:0/3209993018 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fcb38039200 0x7fcb3803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:24.324 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.095+0000 7fcb4be00640 1 --2- 172.21.15.1:0/3209993018 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fcb38039200 0x7fcb3803b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c0098c0 tx=0x7fcb3c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:24.324 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.099+0000 7fcb52000640 1 -- 172.21.15.1:0/3209993018 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcb44042e10 con 0x7fcb54107700 2024-09-15T22:15:24.324 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.288+0000 7fcb5b600640 1 -- 172.21.15.1:0/3209993018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fcb541a1050 con 0x7fcb54107700 2024-09-15T22:15:24.324 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.290+0000 7fcb52000640 1 -- 172.21.15.1:0/3209993018 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fcb440328c0 con 0x7fcb54107700 2024-09-15T22:15:24.324 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.293+0000 7fcb5b600640 1 -- 172.21.15.1:0/3209993018 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fcb38039200 msgr2=0x7fcb3803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:24.324 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.293+0000 7fcb5b600640 1 --2- 172.21.15.1:0/3209993018 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fcb38039200 0x7fcb3803b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c0098c0 tx=0x7fcb3c006db0 comp rx=0 tx=0).stop 2024-09-15T22:15:24.325 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.293+0000 7fcb5b600640 1 -- 172.21.15.1:0/3209993018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb54107700 msgr2=0x7fcb5419d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:24.325 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.293+0000 7fcb5b600640 1 --2- 172.21.15.1:0/3209993018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb54107700 0x7fcb5419d9c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcb440097f0 tx=0x7fcb440327b0 comp rx=0 tx=0).stop 2024-09-15T22:15:24.325 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.293+0000 7fcb5b600640 1 -- 172.21.15.1:0/3209993018 shutdown_connections 2024-09-15T22:15:24.325 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.293+0000 7fcb5b600640 1 --2- 172.21.15.1:0/3209993018 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7fcb38039200 0x7fcb3803b6c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:24.325 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.293+0000 7fcb5b600640 1 --2- 172.21.15.1:0/3209993018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb54107700 0x7fcb5419d9c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:24.325 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.293+0000 7fcb5b600640 1 -- 172.21.15.1:0/3209993018 >> 172.21.15.1:0/3209993018 conn(0x7fcb54102f30 msgr2=0x7fcb54103a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:24.325 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.293+0000 7fcb5b600640 1 -- 172.21.15.1:0/3209993018 shutdown_connections 2024-09-15T22:15:24.325 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:23.293+0000 7fcb5b600640 1 -- 172.21.15.1:0/3209993018 wait complete. 2024-09-15T22:15:24.325 INFO:teuthology.orchestra.run.smithi001.stdout:Enabling the dashboard module... 2024-09-15T22:15:24.558 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:24 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/3209993018' entity='client.admin' 2024-09-15T22:15:24.558 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:24 smithi001 ceph-mon[30843]: from='mgr.14118 172.21.15.1:0/1750299612' entity='mgr.x' 2024-09-15T22:15:25.558 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:25 smithi001 ceph-mon[30843]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:15:25.558 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:25 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/2882256268' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-15T22:15:25.558 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:25 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: ignoring --setuser ceph since I am not root 2024-09-15T22:15:25.558 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:25 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: ignoring --setgroup ceph since I am not root 2024-09-15T22:15:25.558 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:25 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:25.555+0000 7f80cc42f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:15:25.820 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:25 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:25.635+0000 7f80cc42f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:15:26.098 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:25 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:25.830+0000 7f80cc42f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:15:26.098 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:25 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:25.917+0000 7f80cc42f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:15:26.098 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:26 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:26.096+0000 7f80cc42f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:15:26.165 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.809+0000 7f369fe00640 1 Processor -- start 2024-09-15T22:15:26.165 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.809+0000 7f369fe00640 1 -- start start 2024-09-15T22:15:26.165 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.809+0000 7f369fe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36a007ddb0 0x7f36a007c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:26.165 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.809+0000 7f369fe00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f36a007c7a0 con 0x7f36a007ddb0 2024-09-15T22:15:26.165 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.810+0000 7f369ea00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36a007ddb0 0x7f36a007c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:26.165 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.810+0000 7f369ea00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36a007ddb0 0x7f36a007c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46354/0 (socket says 172.21.15.1:46354) 2024-09-15T22:15:26.166 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.810+0000 7f369ea00640 1 -- 172.21.15.1:0/148378378 learned_addr learned my addr 172.21.15.1:0/148378378 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:26.166 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.810+0000 7f369ea00640 1 -- 172.21.15.1:0/148378378 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a007c920 con 0x7f36a007ddb0 2024-09-15T22:15:26.166 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.811+0000 7f369ea00640 1 --2- 172.21.15.1:0/148378378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36a007ddb0 0x7f36a007c260 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3690009820 tx=0x7f369002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d40b44530f41ca9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:26.166 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.812+0000 7f369d600640 1 -- 172.21.15.1:0/148378378 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3690037070 con 0x7f36a007ddb0 2024-09-15T22:15:26.166 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.812+0000 7f369d600640 1 -- 172.21.15.1:0/148378378 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3690032920 con 0x7f36a007ddb0 2024-09-15T22:15:26.166 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.812+0000 7f369d600640 1 -- 172.21.15.1:0/148378378 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3690030810 con 0x7f36a007ddb0 2024-09-15T22:15:26.166 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.812+0000 7f369fe00640 1 -- 172.21.15.1:0/148378378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36a007ddb0 msgr2=0x7f36a007c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:26.166 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.812+0000 7f369fe00640 1 --2- 172.21.15.1:0/148378378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36a007ddb0 0x7f36a007c260 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3690009820 tx=0x7f369002a270 comp rx=0 tx=0).stop 2024-09-15T22:15:26.166 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.813+0000 7f369fe00640 1 -- 172.21.15.1:0/148378378 shutdown_connections 2024-09-15T22:15:26.166 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.813+0000 7f369fe00640 1 --2- 172.21.15.1:0/148378378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36a007ddb0 0x7f36a007c260 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:26.166 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.813+0000 7f369fe00640 1 -- 172.21.15.1:0/148378378 >> 172.21.15.1:0/148378378 conn(0x7f36a0102d30 msgr2=0x7f36a01051b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:26.166 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.813+0000 7f369fe00640 1 -- 172.21.15.1:0/148378378 shutdown_connections 2024-09-15T22:15:26.167 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.813+0000 7f369fe00640 1 -- 172.21.15.1:0/148378378 wait complete. 2024-09-15T22:15:26.167 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.814+0000 7f369fe00640 1 Processor -- start 2024-09-15T22:15:26.167 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.814+0000 7f369fe00640 1 -- start start 2024-09-15T22:15:26.167 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.814+0000 7f369fe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36a007ddb0 0x7f36a019d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:26.167 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.814+0000 7f369fe00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f36a010dba0 con 0x7f36a007ddb0 2024-09-15T22:15:26.167 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.814+0000 7f369ea00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36a007ddb0 0x7f36a019d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:26.167 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.814+0000 7f369ea00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36a007ddb0 0x7f36a019d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46362/0 (socket says 172.21.15.1:46362) 2024-09-15T22:15:26.167 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.814+0000 7f369ea00640 1 -- 172.21.15.1:0/2882256268 learned_addr learned my addr 172.21.15.1:0/2882256268 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:26.167 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.815+0000 7f369ea00640 1 -- 172.21.15.1:0/2882256268 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a019dd00 con 0x7f36a007ddb0 2024-09-15T22:15:26.168 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.815+0000 7f369ea00640 1 --2- 172.21.15.1:0/2882256268 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36a007ddb0 0x7f36a019d7c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f36900097f0 tx=0x7f36900327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:26.168 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.815+0000 7f3697400640 1 -- 172.21.15.1:0/2882256268 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3690037040 con 0x7f36a007ddb0 2024-09-15T22:15:26.168 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.815+0000 7f3697400640 1 -- 172.21.15.1:0/2882256268 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3690030c40 con 0x7f36a007ddb0 2024-09-15T22:15:26.168 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.815+0000 7f3697400640 1 -- 172.21.15.1:0/2882256268 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f369003a5d0 con 0x7f36a007ddb0 2024-09-15T22:15:26.169 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.816+0000 7f369fe00640 1 -- 172.21.15.1:0/2882256268 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36a019df90 con 0x7f36a007ddb0 2024-09-15T22:15:26.169 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.816+0000 7f369fe00640 1 -- 172.21.15.1:0/2882256268 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36a01a0c80 con 0x7f36a007ddb0 2024-09-15T22:15:26.169 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.817+0000 7f3697400640 1 -- 172.21.15.1:0/2882256268 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f369003b3f0 con 0x7f36a007ddb0 2024-09-15T22:15:26.169 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.817+0000 7f369fe00640 1 -- 172.21.15.1:0/2882256268 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36a007c2e0 con 0x7f36a007ddb0 2024-09-15T22:15:26.169 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.817+0000 7f3697400640 1 --2- 172.21.15.1:0/2882256268 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f3684039200 0x7f368403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:26.169 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.817+0000 7f3697400640 1 -- 172.21.15.1:0/2882256268 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f369006c7e0 con 0x7f36a007ddb0 2024-09-15T22:15:26.169 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.818+0000 7f369e000640 1 --2- 172.21.15.1:0/2882256268 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f3684039200 0x7f368403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:26.169 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.818+0000 7f369e000640 1 --2- 172.21.15.1:0/2882256268 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f3684039200 0x7f368403b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f368c0098c0 tx=0x7f368c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:26.169 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:24.822+0000 7f3697400640 1 -- 172.21.15.1:0/2882256268 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f369006c130 con 0x7f36a007ddb0 2024-09-15T22:15:26.169 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:25.055+0000 7f369fe00640 1 -- 172.21.15.1:0/2882256268 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f36a01a0e50 con 0x7f36a007ddb0 2024-09-15T22:15:26.169 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:25.290+0000 7f3697400640 1 -- 172.21.15.1:0/2882256268 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f369003b6e0 con 0x7f36a007ddb0 2024-09-15T22:15:26.169 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:25.292+0000 7f3697400640 1 -- 172.21.15.1:0/2882256268 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f369003a7c0 con 0x7f36a007ddb0 2024-09-15T22:15:26.170 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:25.294+0000 7f369fe00640 1 -- 172.21.15.1:0/2882256268 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f3684039200 msgr2=0x7f368403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:26.170 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:25.294+0000 7f369fe00640 1 --2- 172.21.15.1:0/2882256268 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f3684039200 0x7f368403b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f368c0098c0 tx=0x7f368c006db0 comp rx=0 tx=0).stop 2024-09-15T22:15:26.170 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:25.294+0000 7f369fe00640 1 -- 172.21.15.1:0/2882256268 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36a007ddb0 msgr2=0x7f36a019d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:26.170 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:25.294+0000 7f369fe00640 1 --2- 172.21.15.1:0/2882256268 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36a007ddb0 0x7f36a019d7c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f36900097f0 tx=0x7f36900327b0 comp rx=0 tx=0).stop 2024-09-15T22:15:26.170 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:25.294+0000 7f369fe00640 1 -- 172.21.15.1:0/2882256268 shutdown_connections 2024-09-15T22:15:26.170 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:25.294+0000 7f369fe00640 1 --2- 172.21.15.1:0/2882256268 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f3684039200 0x7f368403b6c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:26.170 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:25.294+0000 7f369fe00640 1 --2- 172.21.15.1:0/2882256268 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36a007ddb0 0x7f36a019d7c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:26.170 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:25.294+0000 7f369fe00640 1 -- 172.21.15.1:0/2882256268 >> 172.21.15.1:0/2882256268 conn(0x7f36a0102d30 msgr2=0x7f36a01039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:26.170 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:25.294+0000 7f369fe00640 1 -- 172.21.15.1:0/2882256268 shutdown_connections 2024-09-15T22:15:26.170 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:25.295+0000 7f369fe00640 1 -- 172.21.15.1:0/2882256268 wait complete. 2024-09-15T22:15:26.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:26 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/2882256268' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-15T22:15:26.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:26 smithi001 ceph-mon[30843]: mgrmap e9: x(active, since 21s) 2024-09-15T22:15:26.376 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:26 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:26.273+0000 7f80cc42f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:15:26.704 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:26 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:26.665+0000 7f80cc42f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:15:26.967 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:26 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:26.742+0000 7f80cc42f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:15:26.967 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:26 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:26.965+0000 7f80cc42f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:15:27.557 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:27 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/531473168' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-15T22:15:27.571 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:15:27.572 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-15T22:15:27.572 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-15T22:15:27.572 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-15T22:15:27.572 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-15T22:15:27.572 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:15:27.572 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.662+0000 7f5f2ae00640 1 Processor -- start 2024-09-15T22:15:27.572 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.662+0000 7f5f2ae00640 1 -- start start 2024-09-15T22:15:27.572 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.663+0000 7f5f2ae00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f24109930 0x7f5f24109d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:27.572 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.663+0000 7f5f2ae00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2410a300 con 0x7f5f24109930 2024-09-15T22:15:27.572 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.663+0000 7f5f23e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f24109930 0x7f5f24109d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:27.572 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.663+0000 7f5f23e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f24109930 0x7f5f24109d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46394/0 (socket says 172.21.15.1:46394) 2024-09-15T22:15:27.572 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.663+0000 7f5f23e00640 1 -- 172.21.15.1:0/122262249 learned_addr learned my addr 172.21.15.1:0/122262249 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:27.573 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.663+0000 7f5f23e00640 1 -- 172.21.15.1:0/122262249 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f2410ab20 con 0x7f5f24109930 2024-09-15T22:15:27.573 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.664+0000 7f5f23e00640 1 --2- 172.21.15.1:0/122262249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f24109930 0x7f5f24109d30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5f14009820 tx=0x7f5f1402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef785c46d006c94c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:27.573 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.665+0000 7f5f22a00640 1 -- 172.21.15.1:0/122262249 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f14037070 con 0x7f5f24109930 2024-09-15T22:15:27.573 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.665+0000 7f5f22a00640 1 -- 172.21.15.1:0/122262249 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f14032920 con 0x7f5f24109930 2024-09-15T22:15:27.573 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.665+0000 7f5f22a00640 1 -- 172.21.15.1:0/122262249 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f14030810 con 0x7f5f24109930 2024-09-15T22:15:27.573 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.666+0000 7f5f2ae00640 1 -- 172.21.15.1:0/122262249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f24109930 msgr2=0x7f5f24109d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:27.573 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.666+0000 7f5f2ae00640 1 --2- 172.21.15.1:0/122262249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f24109930 0x7f5f24109d30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5f14009820 tx=0x7f5f1402a270 comp rx=0 tx=0).stop 2024-09-15T22:15:27.573 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.666+0000 7f5f2ae00640 1 -- 172.21.15.1:0/122262249 shutdown_connections 2024-09-15T22:15:27.573 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.666+0000 7f5f2ae00640 1 --2- 172.21.15.1:0/122262249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f24109930 0x7f5f24109d30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:27.573 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.666+0000 7f5f2ae00640 1 -- 172.21.15.1:0/122262249 >> 172.21.15.1:0/122262249 conn(0x7f5f2407cfa0 msgr2=0x7f5f2407d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:27.573 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.666+0000 7f5f2ae00640 1 -- 172.21.15.1:0/122262249 shutdown_connections 2024-09-15T22:15:27.573 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.666+0000 7f5f2ae00640 1 -- 172.21.15.1:0/122262249 wait complete. 2024-09-15T22:15:27.573 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.667+0000 7f5f2ae00640 1 Processor -- start 2024-09-15T22:15:27.574 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.667+0000 7f5f2ae00640 1 -- start start 2024-09-15T22:15:27.574 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.668+0000 7f5f2ae00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f24109930 0x7f5f2419d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:27.574 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.668+0000 7f5f2ae00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2410ded0 con 0x7f5f24109930 2024-09-15T22:15:27.574 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.668+0000 7f5f23e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f24109930 0x7f5f2419d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:27.574 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.668+0000 7f5f23e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f24109930 0x7f5f2419d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46410/0 (socket says 172.21.15.1:46410) 2024-09-15T22:15:27.574 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.668+0000 7f5f23e00640 1 -- 172.21.15.1:0/531473168 learned_addr learned my addr 172.21.15.1:0/531473168 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:27.574 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.668+0000 7f5f23e00640 1 -- 172.21.15.1:0/531473168 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f2419de90 con 0x7f5f24109930 2024-09-15T22:15:27.574 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.669+0000 7f5f23e00640 1 --2- 172.21.15.1:0/531473168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f24109930 0x7f5f2419d950 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5f14030560 tx=0x7f5f14032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:27.574 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.669+0000 7f5f20c00640 1 -- 172.21.15.1:0/531473168 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f14037040 con 0x7f5f24109930 2024-09-15T22:15:27.574 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.669+0000 7f5f20c00640 1 -- 172.21.15.1:0/531473168 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f14040070 con 0x7f5f24109930 2024-09-15T22:15:27.574 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.669+0000 7f5f2ae00640 1 -- 172.21.15.1:0/531473168 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f2419e120 con 0x7f5f24109930 2024-09-15T22:15:27.574 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.669+0000 7f5f20c00640 1 -- 172.21.15.1:0/531473168 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f1403a740 con 0x7f5f24109930 2024-09-15T22:15:27.574 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.669+0000 7f5f2ae00640 1 -- 172.21.15.1:0/531473168 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f241a0e10 con 0x7f5f24109930 2024-09-15T22:15:27.574 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.671+0000 7f5f20c00640 1 -- 172.21.15.1:0/531473168 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f5f1403a9b0 con 0x7f5f24109930 2024-09-15T22:15:27.575 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.671+0000 7f5f2ae00640 1 -- 172.21.15.1:0/531473168 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f2410e050 con 0x7f5f24109930 2024-09-15T22:15:27.575 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.671+0000 7f5f20c00640 1 --2- 172.21.15.1:0/531473168 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f5f08039200 0x7f5f0803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:27.575 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.671+0000 7f5f20c00640 1 -- 172.21.15.1:0/531473168 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5f1406cb60 con 0x7f5f24109930 2024-09-15T22:15:27.575 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.671+0000 7f5f23400640 1 -- 172.21.15.1:0/531473168 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f5f08039200 msgr2=0x7f5f0803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/3145051160 2024-09-15T22:15:27.575 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.671+0000 7f5f23400640 1 --2- 172.21.15.1:0/531473168 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f5f08039200 0x7f5f0803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:15:27.575 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.676+0000 7f5f20c00640 1 -- 172.21.15.1:0/531473168 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5f1403adf0 con 0x7f5f24109930 2024-09-15T22:15:27.575 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.872+0000 7f5f23400640 1 -- 172.21.15.1:0/531473168 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f5f08039200 msgr2=0x7f5f0803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/3145051160 2024-09-15T22:15:27.575 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.872+0000 7f5f23400640 1 --2- 172.21.15.1:0/531473168 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f5f08039200 0x7f5f0803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T22:15:27.575 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.910+0000 7f5f2ae00640 1 -- 172.21.15.1:0/531473168 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f5f241a0fe0 con 0x7f5f24109930 2024-09-15T22:15:27.575 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.911+0000 7f5f20c00640 1 -- 172.21.15.1:0/531473168 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f5f1406c4b0 con 0x7f5f24109930 2024-09-15T22:15:27.575 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.913+0000 7f5f2ae00640 1 -- 172.21.15.1:0/531473168 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f5f08039200 msgr2=0x7f5f0803b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:15:27.575 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.913+0000 7f5f2ae00640 1 --2- 172.21.15.1:0/531473168 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f5f08039200 0x7f5f0803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:27.576 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.913+0000 7f5f2ae00640 1 -- 172.21.15.1:0/531473168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f24109930 msgr2=0x7f5f2419d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:27.576 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.913+0000 7f5f2ae00640 1 --2- 172.21.15.1:0/531473168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f24109930 0x7f5f2419d950 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5f14030560 tx=0x7f5f14032670 comp rx=0 tx=0).stop 2024-09-15T22:15:27.576 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.913+0000 7f5f2ae00640 1 -- 172.21.15.1:0/531473168 shutdown_connections 2024-09-15T22:15:27.576 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.913+0000 7f5f2ae00640 1 --2- 172.21.15.1:0/531473168 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f5f08039200 0x7f5f0803b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:27.576 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.913+0000 7f5f2ae00640 1 --2- 172.21.15.1:0/531473168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f24109930 0x7f5f2419d950 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:27.576 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.913+0000 7f5f2ae00640 1 -- 172.21.15.1:0/531473168 >> 172.21.15.1:0/531473168 conn(0x7f5f2407cfa0 msgr2=0x7f5f24107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:27.576 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.913+0000 7f5f2ae00640 1 -- 172.21.15.1:0/531473168 shutdown_connections 2024-09-15T22:15:27.576 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:26.913+0000 7f5f2ae00640 1 -- 172.21.15.1:0/531473168 wait complete. 2024-09-15T22:15:27.576 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for the mgr to restart... 2024-09-15T22:15:27.576 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mgr epoch 9... 2024-09-15T22:15:28.376 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:28 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:28.130+0000 7f80cc42f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:15:28.376 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:28 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:28.213+0000 7f80cc42f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:15:29.474 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:29 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:29.161+0000 7f80cc42f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:15:29.475 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:29 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:29.303+0000 7f80cc42f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:15:29.475 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:29 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:29.472+0000 7f80cc42f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:15:29.727 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:29 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:29.547+0000 7f80cc42f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:15:29.728 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:29 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:29.725+0000 7f80cc42f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:15:30.073 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:29 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:29.809+0000 7f80cc42f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:15:30.073 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:29 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:29.883+0000 7f80cc42f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:15:30.073 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:30 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:30.070+0000 7f80cc42f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:15:30.335 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:30 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:30.150+0000 7f80cc42f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:15:30.336 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:30 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:30.232+0000 7f80cc42f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:15:30.336 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:30 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:30.333+0000 7f80cc42f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:15:30.626 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:30 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:30.406+0000 7f80cc42f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:15:30.626 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:30 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:30.479+0000 7f80cc42f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:15:31.708 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:31 smithi001 ceph-mon[30843]: Active manager daemon x restarted 2024-09-15T22:15:31.708 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:31 smithi001 ceph-mon[30843]: Activating manager daemon x 2024-09-15T22:15:31.708 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:31 smithi001 ceph-mon[30843]: osdmap e3: 0 total, 0 up, 0 in 2024-09-15T22:15:31.709 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:31 smithi001 ceph-mon[30843]: mgrmap e10: x(active, starting, since 0.00427413s) 2024-09-15T22:15:31.709 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:31 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:15:31.709 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:31 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T22:15:31.709 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:31 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T22:15:31.709 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:31 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T22:15:31.709 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:31 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T22:15:31.709 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:31 smithi001 ceph-mon[30843]: Manager daemon x is now available 2024-09-15T22:15:31.709 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:31 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:15:31.709 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:31 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:31.430+0000 7f80cc42f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:15:32.762 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:32 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-15T22:15:32.762 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:32 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-15T22:15:32.762 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:32 smithi001 ceph-mon[30843]: mgrmap e11: x(active, since 1.00778s) 2024-09-15T22:15:33.725 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:33 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:33.611+0000 7f8022a00640 -1 log_channel(cephadm) log [ERR] : [15/Sep/2024:22:15:33] ENGINE Error in HTTPServer.serve 2024-09-15T22:15:33.725 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:33 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: Traceback (most recent call last): 2024-09-15T22:15:33.725 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:33 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T22:15:33.725 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:33 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: self._connections.run(self.expiration_interval) 2024-09-15T22:15:33.726 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:33 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T22:15:33.726 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:33 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: self._run(expiration_interval) 2024-09-15T22:15:33.726 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:33 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T22:15:33.726 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:33 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T22:15:33.726 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:33 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T22:15:33.726 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:33 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T22:15:33.726 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:33 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T22:15:33.726 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:33 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: s = self.context.wrap_socket( 2024-09-15T22:15:33.726 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:33 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T22:15:33.726 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:33 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: return self.sslsocket_class._create( 2024-09-15T22:15:33.726 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:33 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T22:15:33.726 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:33 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: self.do_handshake() 2024-09-15T22:15:33.726 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:33 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T22:15:33.727 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:33 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: self._sslobj.do_handshake() 2024-09-15T22:15:33.727 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:33 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T22:15:33.727 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:15:33 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:15:33.736 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:15:33.736 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-15T22:15:33.736 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-15T22:15:33.736 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:15:33.736 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.069+0000 7f2a1b800640 1 Processor -- start 2024-09-15T22:15:33.736 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.069+0000 7f2a1b800640 1 -- start start 2024-09-15T22:15:33.736 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.070+0000 7f2a1b800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a14109990 0x7f2a14109d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:33.736 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.070+0000 7f2a1b800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1410a360 con 0x7f2a14109990 2024-09-15T22:15:33.736 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.070+0000 7f2a18e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a14109990 0x7f2a14109d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:33.736 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.070+0000 7f2a18e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a14109990 0x7f2a14109d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56494/0 (socket says 172.21.15.1:56494) 2024-09-15T22:15:33.736 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.070+0000 7f2a18e00640 1 -- 172.21.15.1:0/2455291942 learned_addr learned my addr 172.21.15.1:0/2455291942 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:33.737 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.071+0000 7f2a18e00640 1 -- 172.21.15.1:0/2455291942 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a1410ab40 con 0x7f2a14109990 2024-09-15T22:15:33.737 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.071+0000 7f2a18e00640 1 --2- 172.21.15.1:0/2455291942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a14109990 0x7f2a14109d90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2a08009820 tx=0x7f2a0802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf073bf46bc84350 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:33.737 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.072+0000 7f2a13400640 1 -- 172.21.15.1:0/2455291942 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a08037070 con 0x7f2a14109990 2024-09-15T22:15:33.737 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.072+0000 7f2a13400640 1 -- 172.21.15.1:0/2455291942 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a08032920 con 0x7f2a14109990 2024-09-15T22:15:33.737 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.072+0000 7f2a13400640 1 -- 172.21.15.1:0/2455291942 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a08030810 con 0x7f2a14109990 2024-09-15T22:15:33.737 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.073+0000 7f2a1b800640 1 -- 172.21.15.1:0/2455291942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a14109990 msgr2=0x7f2a14109d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:33.737 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.073+0000 7f2a1b800640 1 --2- 172.21.15.1:0/2455291942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a14109990 0x7f2a14109d90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2a08009820 tx=0x7f2a0802a270 comp rx=0 tx=0).stop 2024-09-15T22:15:33.737 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.073+0000 7f2a1b800640 1 -- 172.21.15.1:0/2455291942 shutdown_connections 2024-09-15T22:15:33.737 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.073+0000 7f2a1b800640 1 --2- 172.21.15.1:0/2455291942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a14109990 0x7f2a14109d90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:33.737 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.073+0000 7f2a1b800640 1 -- 172.21.15.1:0/2455291942 >> 172.21.15.1:0/2455291942 conn(0x7f2a1407cfd0 msgr2=0x7f2a1407d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:33.737 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.073+0000 7f2a1b800640 1 -- 172.21.15.1:0/2455291942 shutdown_connections 2024-09-15T22:15:33.737 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.073+0000 7f2a1b800640 1 -- 172.21.15.1:0/2455291942 wait complete. 2024-09-15T22:15:33.737 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.074+0000 7f2a1b800640 1 Processor -- start 2024-09-15T22:15:33.738 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.074+0000 7f2a1b800640 1 -- start start 2024-09-15T22:15:33.738 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.075+0000 7f2a1b800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a14109990 0x7f2a1419d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:33.738 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.075+0000 7f2a1b800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1410def0 con 0x7f2a14109990 2024-09-15T22:15:33.738 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.075+0000 7f2a18e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a14109990 0x7f2a1419d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:33.738 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.075+0000 7f2a18e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a14109990 0x7f2a1419d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56508/0 (socket says 172.21.15.1:56508) 2024-09-15T22:15:33.738 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.075+0000 7f2a18e00640 1 -- 172.21.15.1:0/1301633427 learned_addr learned my addr 172.21.15.1:0/1301633427 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:33.738 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.075+0000 7f2a18e00640 1 -- 172.21.15.1:0/1301633427 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a1419df10 con 0x7f2a14109990 2024-09-15T22:15:33.738 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.076+0000 7f2a18e00640 1 --2- 172.21.15.1:0/1301633427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a14109990 0x7f2a1419d9d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2a080097f0 tx=0x7f2a080327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:33.738 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.076+0000 7f2a11600640 1 -- 172.21.15.1:0/1301633427 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a08037040 con 0x7f2a14109990 2024-09-15T22:15:33.738 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.076+0000 7f2a11600640 1 -- 172.21.15.1:0/1301633427 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a08030c40 con 0x7f2a14109990 2024-09-15T22:15:33.738 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.076+0000 7f2a11600640 1 -- 172.21.15.1:0/1301633427 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a0803a5b0 con 0x7f2a14109990 2024-09-15T22:15:33.738 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.076+0000 7f2a1b800640 1 -- 172.21.15.1:0/1301633427 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a1419e1a0 con 0x7f2a14109990 2024-09-15T22:15:33.738 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.076+0000 7f2a1b800640 1 -- 172.21.15.1:0/1301633427 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a141a0e90 con 0x7f2a14109990 2024-09-15T22:15:33.738 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.077+0000 7f2a11600640 1 -- 172.21.15.1:0/1301633427 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f2a0803b3f0 con 0x7f2a14109990 2024-09-15T22:15:33.739 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.078+0000 7f2a11600640 1 --2- 172.21.15.1:0/1301633427 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f29fc039260 0x7f29fc03b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:33.739 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.078+0000 7f2a11600640 1 -- 172.21.15.1:0/1301633427 --> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f29fc03be30 con 0x7f29fc039260 2024-09-15T22:15:33.739 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.078+0000 7f2a11600640 1 -- 172.21.15.1:0/1301633427 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2a0806c790 con 0x7f2a14109990 2024-09-15T22:15:33.739 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.078+0000 7f2a13e00640 1 -- 172.21.15.1:0/1301633427 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f29fc039260 msgr2=0x7f29fc03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/3145051160 2024-09-15T22:15:33.739 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.078+0000 7f2a13e00640 1 --2- 172.21.15.1:0/1301633427 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f29fc039260 0x7f29fc03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:15:33.739 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.279+0000 7f2a13e00640 1 -- 172.21.15.1:0/1301633427 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f29fc039260 msgr2=0x7f29fc03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/3145051160 2024-09-15T22:15:33.739 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.279+0000 7f2a13e00640 1 --2- 172.21.15.1:0/1301633427 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f29fc039260 0x7f29fc03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T22:15:33.739 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.680+0000 7f2a13e00640 1 -- 172.21.15.1:0/1301633427 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f29fc039260 msgr2=0x7f29fc03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/3145051160 2024-09-15T22:15:33.739 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:28.680+0000 7f2a13e00640 1 --2- 172.21.15.1:0/1301633427 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f29fc039260 0x7f29fc03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-15T22:15:33.739 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:29.481+0000 7f2a13e00640 1 -- 172.21.15.1:0/1301633427 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f29fc039260 msgr2=0x7f29fc03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/3145051160 2024-09-15T22:15:33.739 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:29.481+0000 7f2a13e00640 1 --2- 172.21.15.1:0/1301633427 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f29fc039260 0x7f29fc03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-15T22:15:33.739 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:31.082+0000 7f2a13e00640 1 -- 172.21.15.1:0/1301633427 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f29fc039260 msgr2=0x7f29fc03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/3145051160 2024-09-15T22:15:33.739 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:31.082+0000 7f2a13e00640 1 --2- 172.21.15.1:0/1301633427 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f29fc039260 0x7f29fc03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-15T22:15:33.740 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:31.435+0000 7f2a11600640 1 -- 172.21.15.1:0/1301633427 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7f2a08041d30 con 0x7f2a14109990 2024-09-15T22:15:33.740 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:31.435+0000 7f2a11600640 1 -- 172.21.15.1:0/1301633427 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f29fc039260 msgr2=0x7f29fc03b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:15:33.740 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:31.435+0000 7f2a11600640 1 --2- 172.21.15.1:0/1301633427 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f29fc039260 0x7f29fc03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:33.740 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:32.437+0000 7f2a11600640 1 -- 172.21.15.1:0/1301633427 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f2a0806e050 con 0x7f2a14109990 2024-09-15T22:15:33.740 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:32.437+0000 7f2a11600640 1 --2- 172.21.15.1:0/1301633427 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f29fc03cd20 0x7f29fc03f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:33.740 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:32.437+0000 7f2a11600640 1 -- 172.21.15.1:0/1301633427 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f29fc03be30 con 0x7f29fc03cd20 2024-09-15T22:15:33.740 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:32.438+0000 7f2a13e00640 1 --2- 172.21.15.1:0/1301633427 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f29fc03cd20 0x7f29fc03f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:33.740 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:32.439+0000 7f2a13e00640 1 --2- 172.21.15.1:0/1301633427 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f29fc03cd20 0x7f29fc03f110 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2a00003980 tx=0x7f2a000092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:33.740 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:32.440+0000 7f2a11600640 1 -- 172.21.15.1:0/1301633427 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f29fc03be30 con 0x7f29fc03cd20 2024-09-15T22:15:33.740 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:32.448+0000 7f2a1b800640 1 -- 172.21.15.1:0/1301633427 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f2a1410e070 con 0x7f29fc03cd20 2024-09-15T22:15:33.740 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:32.448+0000 7f2a11600640 1 -- 172.21.15.1:0/1301633427 <== mgr.14150 v2:172.21.15.1:6800/3816767836 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f2a1410e070 con 0x7f29fc03cd20 2024-09-15T22:15:33.740 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:32.449+0000 7f2a1b800640 1 -- 172.21.15.1:0/1301633427 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f29fc03cd20 msgr2=0x7f29fc03f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:33.740 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:32.449+0000 7f2a1b800640 1 --2- 172.21.15.1:0/1301633427 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f29fc03cd20 0x7f29fc03f110 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2a00003980 tx=0x7f2a000092b0 comp rx=0 tx=0).stop 2024-09-15T22:15:33.741 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:32.449+0000 7f2a1b800640 1 -- 172.21.15.1:0/1301633427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a14109990 msgr2=0x7f2a1419d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:33.741 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:32.449+0000 7f2a1b800640 1 --2- 172.21.15.1:0/1301633427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a14109990 0x7f2a1419d9d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2a080097f0 tx=0x7f2a080327b0 comp rx=0 tx=0).stop 2024-09-15T22:15:33.741 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:32.449+0000 7f2a1b800640 1 -- 172.21.15.1:0/1301633427 shutdown_connections 2024-09-15T22:15:33.741 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:32.449+0000 7f2a1b800640 1 --2- 172.21.15.1:0/1301633427 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f29fc03cd20 0x7f29fc03f110 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:33.741 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:32.449+0000 7f2a1b800640 1 --2- 172.21.15.1:0/1301633427 >> [v2:172.21.15.1:6800/3145051160,v1:172.21.15.1:6801/3145051160] conn(0x7f29fc039260 0x7f29fc03b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:33.741 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:32.449+0000 7f2a1b800640 1 --2- 172.21.15.1:0/1301633427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a14109990 0x7f2a1419d9d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:33.741 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:32.449+0000 7f2a1b800640 1 -- 172.21.15.1:0/1301633427 >> 172.21.15.1:0/1301633427 conn(0x7f2a1407cfd0 msgr2=0x7f2a14107570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:33.741 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:32.449+0000 7f2a1b800640 1 -- 172.21.15.1:0/1301633427 shutdown_connections 2024-09-15T22:15:33.741 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:32.449+0000 7f2a1b800640 1 -- 172.21.15.1:0/1301633427 wait complete. 2024-09-15T22:15:33.741 INFO:teuthology.orchestra.run.smithi001.stdout:mgr epoch 9 is available 2024-09-15T22:15:33.741 INFO:teuthology.orchestra.run.smithi001.stdout:Generating a dashboard self-signed certificate... 2024-09-15T22:15:34.253 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:34 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:15:34.253 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:34 smithi001 ceph-mon[30843]: [15/Sep/2024:22:15:33] ENGINE Bus STARTING 2024-09-15T22:15:35.111 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-15T22:15:35.111 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.236+0000 7fa1aca00640 1 Processor -- start 2024-09-15T22:15:35.111 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.237+0000 7fa1aca00640 1 -- start start 2024-09-15T22:15:35.111 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.237+0000 7fa1aca00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1a8109930 0x7fa1a8109d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:35.111 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.237+0000 7fa1aca00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a810a300 con 0x7fa1a8109930 2024-09-15T22:15:35.111 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.237+0000 7fa1a5e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1a8109930 0x7fa1a8109d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:35.111 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.238+0000 7fa1a5e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1a8109930 0x7fa1a8109d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56562/0 (socket says 172.21.15.1:56562) 2024-09-15T22:15:35.111 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.238+0000 7fa1a5e00640 1 -- 172.21.15.1:0/1535502321 learned_addr learned my addr 172.21.15.1:0/1535502321 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:35.111 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.238+0000 7fa1a5e00640 1 -- 172.21.15.1:0/1535502321 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1a810ab20 con 0x7fa1a8109930 2024-09-15T22:15:35.112 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.239+0000 7fa1a5e00640 1 --2- 172.21.15.1:0/1535502321 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1a8109930 0x7fa1a8109d30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa198009820 tx=0x7fa19802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb9a0b128e347878 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:35.112 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.239+0000 7fa1a4a00640 1 -- 172.21.15.1:0/1535502321 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa198037070 con 0x7fa1a8109930 2024-09-15T22:15:35.112 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.239+0000 7fa1a4a00640 1 -- 172.21.15.1:0/1535502321 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa198032920 con 0x7fa1a8109930 2024-09-15T22:15:35.112 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.239+0000 7fa1a4a00640 1 -- 172.21.15.1:0/1535502321 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa198030810 con 0x7fa1a8109930 2024-09-15T22:15:35.112 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.240+0000 7fa1aca00640 1 -- 172.21.15.1:0/1535502321 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1a8109930 msgr2=0x7fa1a8109d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:35.112 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.240+0000 7fa1aca00640 1 --2- 172.21.15.1:0/1535502321 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1a8109930 0x7fa1a8109d30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa198009820 tx=0x7fa19802a270 comp rx=0 tx=0).stop 2024-09-15T22:15:35.112 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.240+0000 7fa1aca00640 1 -- 172.21.15.1:0/1535502321 shutdown_connections 2024-09-15T22:15:35.112 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.240+0000 7fa1aca00640 1 --2- 172.21.15.1:0/1535502321 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1a8109930 0x7fa1a8109d30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:35.112 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.240+0000 7fa1aca00640 1 -- 172.21.15.1:0/1535502321 >> 172.21.15.1:0/1535502321 conn(0x7fa1a807cfa0 msgr2=0x7fa1a807d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:35.112 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.240+0000 7fa1aca00640 1 -- 172.21.15.1:0/1535502321 shutdown_connections 2024-09-15T22:15:35.112 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.240+0000 7fa1aca00640 1 -- 172.21.15.1:0/1535502321 wait complete. 2024-09-15T22:15:35.112 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.241+0000 7fa1aca00640 1 Processor -- start 2024-09-15T22:15:35.113 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.241+0000 7fa1aca00640 1 -- start start 2024-09-15T22:15:35.113 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.241+0000 7fa1aca00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1a8109930 0x7fa1a819d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:35.113 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.241+0000 7fa1aca00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a810ded0 con 0x7fa1a8109930 2024-09-15T22:15:35.113 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.242+0000 7fa1a5e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1a8109930 0x7fa1a819d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:35.113 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.242+0000 7fa1a5e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1a8109930 0x7fa1a819d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56578/0 (socket says 172.21.15.1:56578) 2024-09-15T22:15:35.113 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.242+0000 7fa1a5e00640 1 -- 172.21.15.1:0/884659808 learned_addr learned my addr 172.21.15.1:0/884659808 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:35.113 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.242+0000 7fa1a5e00640 1 -- 172.21.15.1:0/884659808 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1a819de90 con 0x7fa1a8109930 2024-09-15T22:15:35.113 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.242+0000 7fa1a5e00640 1 --2- 172.21.15.1:0/884659808 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1a8109930 0x7fa1a819d950 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa1980097f0 tx=0x7fa1980327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:35.113 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.243+0000 7fa19ea00640 1 -- 172.21.15.1:0/884659808 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa198037040 con 0x7fa1a8109930 2024-09-15T22:15:35.113 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.243+0000 7fa19ea00640 1 -- 172.21.15.1:0/884659808 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa198030cc0 con 0x7fa1a8109930 2024-09-15T22:15:35.113 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.243+0000 7fa19ea00640 1 -- 172.21.15.1:0/884659808 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa19803a640 con 0x7fa1a8109930 2024-09-15T22:15:35.113 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.243+0000 7fa1aca00640 1 -- 172.21.15.1:0/884659808 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1a819e120 con 0x7fa1a8109930 2024-09-15T22:15:35.113 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.243+0000 7fa1aca00640 1 -- 172.21.15.1:0/884659808 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1a81a0e10 con 0x7fa1a8109930 2024-09-15T22:15:35.113 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.244+0000 7fa1aca00640 1 -- 172.21.15.1:0/884659808 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1a810e050 con 0x7fa1a8109930 2024-09-15T22:15:35.114 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.244+0000 7fa19ea00640 1 -- 172.21.15.1:0/884659808 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fa19803b3f0 con 0x7fa1a8109930 2024-09-15T22:15:35.114 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.245+0000 7fa19ea00640 1 --2- 172.21.15.1:0/884659808 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa18c039260 0x7fa18c03b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:35.114 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.245+0000 7fa19ea00640 1 -- 172.21.15.1:0/884659808 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa19806c8d0 con 0x7fa1a8109930 2024-09-15T22:15:35.114 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.245+0000 7fa1a5400640 1 --2- 172.21.15.1:0/884659808 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa18c039260 0x7fa18c03b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:35.114 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.246+0000 7fa1a5400640 1 --2- 172.21.15.1:0/884659808 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa18c039260 0x7fa18c03b720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa1940098c0 tx=0x7fa194006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:35.114 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.250+0000 7fa19ea00640 1 -- 172.21.15.1:0/884659808 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa1980328c0 con 0x7fa1a8109930 2024-09-15T22:15:35.114 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.442+0000 7fa1aca00640 1 -- 172.21.15.1:0/884659808 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fa1a8107c70 con 0x7fa18c039260 2024-09-15T22:15:35.114 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.506+0000 7fa19ea00640 1 -- 172.21.15.1:0/884659808 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fa1a8107c70 con 0x7fa18c039260 2024-09-15T22:15:35.114 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.509+0000 7fa1aca00640 1 -- 172.21.15.1:0/884659808 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa18c039260 msgr2=0x7fa18c03b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:35.114 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.509+0000 7fa1aca00640 1 --2- 172.21.15.1:0/884659808 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa18c039260 0x7fa18c03b720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa1940098c0 tx=0x7fa194006db0 comp rx=0 tx=0).stop 2024-09-15T22:15:35.114 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.509+0000 7fa1aca00640 1 -- 172.21.15.1:0/884659808 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1a8109930 msgr2=0x7fa1a819d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:35.114 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.509+0000 7fa1aca00640 1 --2- 172.21.15.1:0/884659808 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1a8109930 0x7fa1a819d950 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa1980097f0 tx=0x7fa1980327b0 comp rx=0 tx=0).stop 2024-09-15T22:15:35.114 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.509+0000 7fa1aca00640 1 -- 172.21.15.1:0/884659808 shutdown_connections 2024-09-15T22:15:35.114 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.509+0000 7fa1aca00640 1 --2- 172.21.15.1:0/884659808 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa18c039260 0x7fa18c03b720 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:35.115 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.509+0000 7fa1aca00640 1 --2- 172.21.15.1:0/884659808 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1a8109930 0x7fa1a819d950 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:35.115 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.509+0000 7fa1aca00640 1 -- 172.21.15.1:0/884659808 >> 172.21.15.1:0/884659808 conn(0x7fa1a807cfa0 msgr2=0x7fa1a8107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:35.115 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.509+0000 7fa1aca00640 1 -- 172.21.15.1:0/884659808 shutdown_connections 2024-09-15T22:15:35.115 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:34.509+0000 7fa1aca00640 1 -- 172.21.15.1:0/884659808 wait complete. 2024-09-15T22:15:35.115 INFO:teuthology.orchestra.run.smithi001.stdout:Creating initial admin user... 2024-09-15T22:15:35.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:35 smithi001 ceph-mon[30843]: [15/Sep/2024:22:15:33] ENGINE Serving on http://172.21.15.1:8765 2024-09-15T22:15:35.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:35 smithi001 ceph-mon[30843]: [15/Sep/2024:22:15:33] ENGINE Serving on https://172.21.15.1:7150 2024-09-15T22:15:35.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:35 smithi001 ceph-mon[30843]: [15/Sep/2024:22:15:33] ENGINE Bus STARTED 2024-09-15T22:15:35.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:35 smithi001 ceph-mon[30843]: [15/Sep/2024:22:15:33] ENGINE Error in HTTPServer.serve 2024-09-15T22:15:35.377 INFO:journalctl@ceph.mon.a.smithi001.stdout: Traceback (most recent call last): 2024-09-15T22:15:35.377 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T22:15:35.377 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._connections.run(self.expiration_interval) 2024-09-15T22:15:35.377 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T22:15:35.377 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._run(expiration_interval) 2024-09-15T22:15:35.377 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T22:15:35.377 INFO:journalctl@ceph.mon.a.smithi001.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T22:15:35.377 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T22:15:35.377 INFO:journalctl@ceph.mon.a.smithi001.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T22:15:35.377 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T22:15:35.377 INFO:journalctl@ceph.mon.a.smithi001.stdout: s = self.context.wrap_socket( 2024-09-15T22:15:35.378 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T22:15:35.378 INFO:journalctl@ceph.mon.a.smithi001.stdout: return self.sslsocket_class._create( 2024-09-15T22:15:35.378 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T22:15:35.378 INFO:journalctl@ceph.mon.a.smithi001.stdout: self.do_handshake() 2024-09-15T22:15:35.378 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T22:15:35.378 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._sslobj.do_handshake() 2024-09-15T22:15:35.378 INFO:journalctl@ceph.mon.a.smithi001.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T22:15:35.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:35 smithi001 ceph-mon[30843]: mgrmap e12: x(active, since 2s) 2024-09-15T22:15:35.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:35 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:15:35.379 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:35 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:15:35.379 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:35 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:15:36.162 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:36 smithi001 ceph-mon[30843]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:15:36.162 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:36 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:15:37.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:37 smithi001 ceph-mon[30843]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:15:37.522 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$uu4jj1Gb6M1yC30MTmgzyOzlSxqAYdtofL1QT3XidwEGUl/csRSFq", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726438536, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-15T22:15:37.522 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.630+0000 7fc686800640 1 Processor -- start 2024-09-15T22:15:37.522 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.631+0000 7fc686800640 1 -- start start 2024-09-15T22:15:37.522 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.631+0000 7fc686800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc680109930 0x7fc680109d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:37.523 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.631+0000 7fc686800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc68010a300 con 0x7fc680109930 2024-09-15T22:15:37.523 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.631+0000 7fc67f400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc680109930 0x7fc680109d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:37.523 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.631+0000 7fc67f400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc680109930 0x7fc680109d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56582/0 (socket says 172.21.15.1:56582) 2024-09-15T22:15:37.523 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.631+0000 7fc67f400640 1 -- 172.21.15.1:0/2207789063 learned_addr learned my addr 172.21.15.1:0/2207789063 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:37.523 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.632+0000 7fc67f400640 1 -- 172.21.15.1:0/2207789063 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc68010ab30 con 0x7fc680109930 2024-09-15T22:15:37.523 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.633+0000 7fc67f400640 1 --2- 172.21.15.1:0/2207789063 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc680109930 0x7fc680109d30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc670009820 tx=0x7fc67002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cafd9e7875734f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:37.523 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.633+0000 7fc67e000640 1 -- 172.21.15.1:0/2207789063 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc670037070 con 0x7fc680109930 2024-09-15T22:15:37.523 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.633+0000 7fc67e000640 1 -- 172.21.15.1:0/2207789063 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc670032920 con 0x7fc680109930 2024-09-15T22:15:37.523 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.633+0000 7fc67e000640 1 -- 172.21.15.1:0/2207789063 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc670030810 con 0x7fc680109930 2024-09-15T22:15:37.523 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.634+0000 7fc686800640 1 -- 172.21.15.1:0/2207789063 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc680109930 msgr2=0x7fc680109d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:37.523 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.634+0000 7fc686800640 1 --2- 172.21.15.1:0/2207789063 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc680109930 0x7fc680109d30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc670009820 tx=0x7fc67002a270 comp rx=0 tx=0).stop 2024-09-15T22:15:37.523 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.634+0000 7fc686800640 1 -- 172.21.15.1:0/2207789063 shutdown_connections 2024-09-15T22:15:37.523 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.634+0000 7fc686800640 1 --2- 172.21.15.1:0/2207789063 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc680109930 0x7fc680109d30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:37.523 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.634+0000 7fc686800640 1 -- 172.21.15.1:0/2207789063 >> 172.21.15.1:0/2207789063 conn(0x7fc68007cff0 msgr2=0x7fc68007d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:37.524 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.634+0000 7fc686800640 1 -- 172.21.15.1:0/2207789063 shutdown_connections 2024-09-15T22:15:37.524 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.634+0000 7fc686800640 1 -- 172.21.15.1:0/2207789063 wait complete. 2024-09-15T22:15:37.524 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.635+0000 7fc686800640 1 Processor -- start 2024-09-15T22:15:37.524 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.635+0000 7fc686800640 1 -- start start 2024-09-15T22:15:37.524 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.636+0000 7fc686800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc680109930 0x7fc68019d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:37.524 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.636+0000 7fc686800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc68010dee0 con 0x7fc680109930 2024-09-15T22:15:37.524 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.636+0000 7fc67f400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc680109930 0x7fc68019d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:37.524 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.636+0000 7fc67f400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc680109930 0x7fc68019d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56596/0 (socket says 172.21.15.1:56596) 2024-09-15T22:15:37.524 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.636+0000 7fc67f400640 1 -- 172.21.15.1:0/42884282 learned_addr learned my addr 172.21.15.1:0/42884282 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:37.524 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.636+0000 7fc67f400640 1 -- 172.21.15.1:0/42884282 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc68019de90 con 0x7fc680109930 2024-09-15T22:15:37.524 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.637+0000 7fc67f400640 1 --2- 172.21.15.1:0/42884282 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc680109930 0x7fc68019d950 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc670030560 tx=0x7fc670032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:37.524 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.637+0000 7fc677e00640 1 -- 172.21.15.1:0/42884282 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc670037040 con 0x7fc680109930 2024-09-15T22:15:37.524 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.637+0000 7fc677e00640 1 -- 172.21.15.1:0/42884282 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc670040070 con 0x7fc680109930 2024-09-15T22:15:37.524 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.637+0000 7fc677e00640 1 -- 172.21.15.1:0/42884282 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc67003a740 con 0x7fc680109930 2024-09-15T22:15:37.525 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.637+0000 7fc686800640 1 -- 172.21.15.1:0/42884282 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc68019e120 con 0x7fc680109930 2024-09-15T22:15:37.525 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.637+0000 7fc686800640 1 -- 172.21.15.1:0/42884282 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6801a0e10 con 0x7fc680109930 2024-09-15T22:15:37.525 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.638+0000 7fc686800640 1 -- 172.21.15.1:0/42884282 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc68010e060 con 0x7fc680109930 2024-09-15T22:15:37.525 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.639+0000 7fc677e00640 1 -- 172.21.15.1:0/42884282 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fc67003bb90 con 0x7fc680109930 2024-09-15T22:15:37.525 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.639+0000 7fc677e00640 1 --2- 172.21.15.1:0/42884282 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc664039260 0x7fc66403b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:37.525 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.639+0000 7fc677e00640 1 -- 172.21.15.1:0/42884282 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc67006ca10 con 0x7fc680109930 2024-09-15T22:15:37.525 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.640+0000 7fc67ea00640 1 --2- 172.21.15.1:0/42884282 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc664039260 0x7fc66403b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:37.525 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.640+0000 7fc67ea00640 1 --2- 172.21.15.1:0/42884282 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc664039260 0x7fc66403b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc66c0098c0 tx=0x7fc66c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:37.525 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.645+0000 7fc677e00640 1 -- 172.21.15.1:0/42884282 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc67004a200 con 0x7fc680109930 2024-09-15T22:15:37.525 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:35.847+0000 7fc686800640 1 -- 172.21.15.1:0/42884282 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fc6801a10a0 con 0x7fc664039260 2024-09-15T22:15:37.525 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:36.099+0000 7fc677e00640 1 -- 172.21.15.1:0/42884282 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fc6801a10a0 con 0x7fc664039260 2024-09-15T22:15:37.525 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:36.101+0000 7fc686800640 1 -- 172.21.15.1:0/42884282 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc664039260 msgr2=0x7fc66403b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:37.525 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:36.101+0000 7fc686800640 1 --2- 172.21.15.1:0/42884282 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc664039260 0x7fc66403b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc66c0098c0 tx=0x7fc66c006db0 comp rx=0 tx=0).stop 2024-09-15T22:15:37.526 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:36.101+0000 7fc686800640 1 -- 172.21.15.1:0/42884282 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc680109930 msgr2=0x7fc68019d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:37.526 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:36.101+0000 7fc686800640 1 --2- 172.21.15.1:0/42884282 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc680109930 0x7fc68019d950 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc670030560 tx=0x7fc670032670 comp rx=0 tx=0).stop 2024-09-15T22:15:37.526 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:36.101+0000 7fc686800640 1 -- 172.21.15.1:0/42884282 shutdown_connections 2024-09-15T22:15:37.526 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:36.101+0000 7fc686800640 1 --2- 172.21.15.1:0/42884282 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc664039260 0x7fc66403b720 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:37.526 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:36.101+0000 7fc686800640 1 --2- 172.21.15.1:0/42884282 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc680109930 0x7fc68019d950 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:37.526 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:36.101+0000 7fc686800640 1 -- 172.21.15.1:0/42884282 >> 172.21.15.1:0/42884282 conn(0x7fc68007cff0 msgr2=0x7fc680107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:37.526 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:36.102+0000 7fc686800640 1 -- 172.21.15.1:0/42884282 shutdown_connections 2024-09-15T22:15:37.526 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:36.102+0000 7fc686800640 1 -- 172.21.15.1:0/42884282 wait complete. 2024-09-15T22:15:37.526 INFO:teuthology.orchestra.run.smithi001.stdout:Fetching dashboard port number... 2024-09-15T22:15:38.922 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 8443 2024-09-15T22:15:38.927 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.004+0000 7fba8b400640 1 Processor -- start 2024-09-15T22:15:38.928 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.004+0000 7fba8b400640 1 -- start start 2024-09-15T22:15:38.928 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.005+0000 7fba8b400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba8407de20 0x7fba8407c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:38.928 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.005+0000 7fba8b400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fba8407c850 con 0x7fba8407de20 2024-09-15T22:15:38.928 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.005+0000 7fba88a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba8407de20 0x7fba8407c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:38.928 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.005+0000 7fba88a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba8407de20 0x7fba8407c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57160/0 (socket says 172.21.15.1:57160) 2024-09-15T22:15:38.928 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.005+0000 7fba88a00640 1 -- 172.21.15.1:0/2224168906 learned_addr learned my addr 172.21.15.1:0/2224168906 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:38.928 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.006+0000 7fba88a00640 1 -- 172.21.15.1:0/2224168906 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba8407c9d0 con 0x7fba8407de20 2024-09-15T22:15:38.928 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.007+0000 7fba88a00640 1 --2- 172.21.15.1:0/2224168906 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba8407de20 0x7fba8407c280 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fba78009820 tx=0x7fba7802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55741fef9fea27fb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:38.928 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.007+0000 7fba83400640 1 -- 172.21.15.1:0/2224168906 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba78037070 con 0x7fba8407de20 2024-09-15T22:15:38.928 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.007+0000 7fba83400640 1 -- 172.21.15.1:0/2224168906 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba78032920 con 0x7fba8407de20 2024-09-15T22:15:38.928 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.007+0000 7fba83400640 1 -- 172.21.15.1:0/2224168906 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba78030810 con 0x7fba8407de20 2024-09-15T22:15:38.929 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.007+0000 7fba8b400640 1 -- 172.21.15.1:0/2224168906 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba8407de20 msgr2=0x7fba8407c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:38.929 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.007+0000 7fba8b400640 1 --2- 172.21.15.1:0/2224168906 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba8407de20 0x7fba8407c280 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fba78009820 tx=0x7fba7802a270 comp rx=0 tx=0).stop 2024-09-15T22:15:38.929 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.008+0000 7fba8b400640 1 -- 172.21.15.1:0/2224168906 shutdown_connections 2024-09-15T22:15:38.929 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.008+0000 7fba8b400640 1 --2- 172.21.15.1:0/2224168906 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba8407de20 0x7fba8407c280 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:38.929 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.008+0000 7fba8b400640 1 -- 172.21.15.1:0/2224168906 >> 172.21.15.1:0/2224168906 conn(0x7fba84102f30 msgr2=0x7fba84105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:38.929 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.008+0000 7fba8b400640 1 -- 172.21.15.1:0/2224168906 shutdown_connections 2024-09-15T22:15:38.929 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.008+0000 7fba8b400640 1 -- 172.21.15.1:0/2224168906 wait complete. 2024-09-15T22:15:38.929 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.009+0000 7fba8b400640 1 Processor -- start 2024-09-15T22:15:38.929 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.009+0000 7fba8b400640 1 -- start start 2024-09-15T22:15:38.929 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.009+0000 7fba8b400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba8407de20 0x7fba8419d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:38.929 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.009+0000 7fba8b400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fba8410ddd0 con 0x7fba8407de20 2024-09-15T22:15:38.929 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.009+0000 7fba88a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba8407de20 0x7fba8419d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:38.929 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.009+0000 7fba88a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba8407de20 0x7fba8419d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57176/0 (socket says 172.21.15.1:57176) 2024-09-15T22:15:38.930 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.009+0000 7fba88a00640 1 -- 172.21.15.1:0/1170523163 learned_addr learned my addr 172.21.15.1:0/1170523163 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:38.930 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.010+0000 7fba88a00640 1 -- 172.21.15.1:0/1170523163 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba8419de20 con 0x7fba8407de20 2024-09-15T22:15:38.930 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.010+0000 7fba88a00640 1 --2- 172.21.15.1:0/1170523163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba8407de20 0x7fba8419d8e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fba780097f0 tx=0x7fba780327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:38.930 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.010+0000 7fba81600640 1 -- 172.21.15.1:0/1170523163 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba78037040 con 0x7fba8407de20 2024-09-15T22:15:38.930 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.010+0000 7fba81600640 1 -- 172.21.15.1:0/1170523163 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba78030cc0 con 0x7fba8407de20 2024-09-15T22:15:38.930 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.010+0000 7fba8b400640 1 -- 172.21.15.1:0/1170523163 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba8419e0b0 con 0x7fba8407de20 2024-09-15T22:15:38.930 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.010+0000 7fba81600640 1 -- 172.21.15.1:0/1170523163 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba7803a6b0 con 0x7fba8407de20 2024-09-15T22:15:38.930 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.010+0000 7fba8b400640 1 -- 172.21.15.1:0/1170523163 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba841a0da0 con 0x7fba8407de20 2024-09-15T22:15:38.930 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.011+0000 7fba81600640 1 -- 172.21.15.1:0/1170523163 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fba7803b3f0 con 0x7fba8407de20 2024-09-15T22:15:38.930 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.011+0000 7fba8b400640 1 -- 172.21.15.1:0/1170523163 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba8407c300 con 0x7fba8407de20 2024-09-15T22:15:38.930 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.012+0000 7fba81600640 1 --2- 172.21.15.1:0/1170523163 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fba6c039200 0x7fba6c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:38.930 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.012+0000 7fba81600640 1 -- 172.21.15.1:0/1170523163 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fba7806c9e0 con 0x7fba8407de20 2024-09-15T22:15:38.930 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.012+0000 7fba83e00640 1 --2- 172.21.15.1:0/1170523163 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fba6c039200 0x7fba6c03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:38.931 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.013+0000 7fba83e00640 1 --2- 172.21.15.1:0/1170523163 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fba6c039200 0x7fba6c03b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fba700098c0 tx=0x7fba70006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:38.931 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.017+0000 7fba81600640 1 -- 172.21.15.1:0/1170523163 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fba78042dc0 con 0x7fba8407de20 2024-09-15T22:15:38.931 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.124+0000 7fba81600640 1 -- 172.21.15.1:0/1170523163 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fba7803baf0 con 0x7fba8407de20 2024-09-15T22:15:38.932 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.203+0000 7fba8b400640 1 -- 172.21.15.1:0/1170523163 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7fba841a1390 con 0x7fba8407de20 2024-09-15T22:15:38.932 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.203+0000 7fba81600640 1 -- 172.21.15.1:0/1170523163 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7fba780313a0 con 0x7fba8407de20 2024-09-15T22:15:38.932 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.206+0000 7fba8b400640 1 -- 172.21.15.1:0/1170523163 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fba6c039200 msgr2=0x7fba6c03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:38.932 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.206+0000 7fba8b400640 1 --2- 172.21.15.1:0/1170523163 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fba6c039200 0x7fba6c03b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fba700098c0 tx=0x7fba70006db0 comp rx=0 tx=0).stop 2024-09-15T22:15:38.932 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.206+0000 7fba8b400640 1 -- 172.21.15.1:0/1170523163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba8407de20 msgr2=0x7fba8419d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:38.932 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.206+0000 7fba8b400640 1 --2- 172.21.15.1:0/1170523163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba8407de20 0x7fba8419d8e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fba780097f0 tx=0x7fba780327b0 comp rx=0 tx=0).stop 2024-09-15T22:15:38.932 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.206+0000 7fba8b400640 1 -- 172.21.15.1:0/1170523163 shutdown_connections 2024-09-15T22:15:38.932 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.206+0000 7fba8b400640 1 --2- 172.21.15.1:0/1170523163 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fba6c039200 0x7fba6c03b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:38.932 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.206+0000 7fba8b400640 1 --2- 172.21.15.1:0/1170523163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba8407de20 0x7fba8419d8e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:38.932 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.206+0000 7fba8b400640 1 -- 172.21.15.1:0/1170523163 >> 172.21.15.1:0/1170523163 conn(0x7fba84102f30 msgr2=0x7fba84103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:38.932 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.206+0000 7fba8b400640 1 -- 172.21.15.1:0/1170523163 shutdown_connections 2024-09-15T22:15:38.933 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:38.206+0000 7fba8b400640 1 -- 172.21.15.1:0/1170523163 wait complete. 2024-09-15T22:15:38.944 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-15T22:15:38.944 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout disabled 2024-09-15T22:15:38.958 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-15T22:15:38.958 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-15T22:15:38.958 INFO:teuthology.orchestra.run.smithi001.stdout:firewalld.service is not enabled 2024-09-15T22:15:38.958 INFO:teuthology.orchestra.run.smithi001.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-15T22:15:38.960 INFO:teuthology.orchestra.run.smithi001.stdout:Ceph Dashboard is now available at: 2024-09-15T22:15:38.960 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:15:38.960 INFO:teuthology.orchestra.run.smithi001.stdout: URL: https://smithi001.front.sepia.ceph.com:8443/ 2024-09-15T22:15:38.960 INFO:teuthology.orchestra.run.smithi001.stdout: User: admin 2024-09-15T22:15:38.960 INFO:teuthology.orchestra.run.smithi001.stdout: Password: 60h85tlgpu 2024-09-15T22:15:38.960 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:15:38.961 INFO:teuthology.orchestra.run.smithi001.stdout:Saving cluster configuration to /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/config directory 2024-09-15T22:15:39.242 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:39 smithi001 ceph-mon[30843]: mgrmap e13: x(active, since 6s) 2024-09-15T22:15:39.242 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:39 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/1170523163' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-15T22:15:40.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.502+0000 7f4180600640 1 Processor -- start 2024-09-15T22:15:40.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.502+0000 7f4180600640 1 -- start start 2024-09-15T22:15:40.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.502+0000 7f4180600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4178109930 0x7f4178109d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:40.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.503+0000 7f4180600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f417810a300 con 0x7f4178109930 2024-09-15T22:15:40.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.503+0000 7f417dc00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4178109930 0x7f4178109d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:40.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.503+0000 7f417dc00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4178109930 0x7f4178109d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57178/0 (socket says 172.21.15.1:57178) 2024-09-15T22:15:40.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.503+0000 7f417dc00640 1 -- 172.21.15.1:0/2801363291 learned_addr learned my addr 172.21.15.1:0/2801363291 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:40.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.504+0000 7f417dc00640 1 -- 172.21.15.1:0/2801363291 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f417810ab20 con 0x7f4178109930 2024-09-15T22:15:40.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.505+0000 7f417dc00640 1 --2- 172.21.15.1:0/2801363291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4178109930 0x7f4178109d30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f416c009820 tx=0x7f416c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50cbc1581ed744e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:40.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.505+0000 7f4177e00640 1 -- 172.21.15.1:0/2801363291 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f416c037070 con 0x7f4178109930 2024-09-15T22:15:40.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.505+0000 7f4177e00640 1 -- 172.21.15.1:0/2801363291 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f416c032920 con 0x7f4178109930 2024-09-15T22:15:40.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.505+0000 7f4177e00640 1 -- 172.21.15.1:0/2801363291 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f416c030810 con 0x7f4178109930 2024-09-15T22:15:40.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.506+0000 7f4180600640 1 -- 172.21.15.1:0/2801363291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4178109930 msgr2=0x7f4178109d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:40.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.506+0000 7f4180600640 1 --2- 172.21.15.1:0/2801363291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4178109930 0x7f4178109d30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f416c009820 tx=0x7f416c02a270 comp rx=0 tx=0).stop 2024-09-15T22:15:40.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.506+0000 7f4180600640 1 -- 172.21.15.1:0/2801363291 shutdown_connections 2024-09-15T22:15:40.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.506+0000 7f4180600640 1 --2- 172.21.15.1:0/2801363291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4178109930 0x7f4178109d30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:40.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.506+0000 7f4180600640 1 -- 172.21.15.1:0/2801363291 >> 172.21.15.1:0/2801363291 conn(0x7f417807cfa0 msgr2=0x7f417807d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:40.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.506+0000 7f4180600640 1 -- 172.21.15.1:0/2801363291 shutdown_connections 2024-09-15T22:15:40.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.506+0000 7f4180600640 1 -- 172.21.15.1:0/2801363291 wait complete. 2024-09-15T22:15:40.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.508+0000 7f4180600640 1 Processor -- start 2024-09-15T22:15:40.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.508+0000 7f4180600640 1 -- start start 2024-09-15T22:15:40.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.508+0000 7f4180600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4178109930 0x7f417819d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:40.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.508+0000 7f4180600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f417810ded0 con 0x7f4178109930 2024-09-15T22:15:40.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.509+0000 7f417dc00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4178109930 0x7f417819d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:40.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.509+0000 7f417dc00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4178109930 0x7f417819d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57192/0 (socket says 172.21.15.1:57192) 2024-09-15T22:15:40.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.509+0000 7f417dc00640 1 -- 172.21.15.1:0/4277161380 learned_addr learned my addr 172.21.15.1:0/4277161380 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:40.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.509+0000 7f417dc00640 1 -- 172.21.15.1:0/4277161380 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f417819de90 con 0x7f4178109930 2024-09-15T22:15:40.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.509+0000 7f417dc00640 1 --2- 172.21.15.1:0/4277161380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4178109930 0x7f417819d950 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f416c0097f0 tx=0x7f416c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:40.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.509+0000 7f4176000640 1 -- 172.21.15.1:0/4277161380 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f416c037040 con 0x7f4178109930 2024-09-15T22:15:40.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.510+0000 7f4176000640 1 -- 172.21.15.1:0/4277161380 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f416c030cc0 con 0x7f4178109930 2024-09-15T22:15:40.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.510+0000 7f4180600640 1 -- 172.21.15.1:0/4277161380 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f417819e120 con 0x7f4178109930 2024-09-15T22:15:40.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.510+0000 7f4180600640 1 -- 172.21.15.1:0/4277161380 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41781a0e10 con 0x7f4178109930 2024-09-15T22:15:40.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.510+0000 7f4176000640 1 -- 172.21.15.1:0/4277161380 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f416c03a640 con 0x7f4178109930 2024-09-15T22:15:40.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.511+0000 7f4180600640 1 -- 172.21.15.1:0/4277161380 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f417810e050 con 0x7f4178109930 2024-09-15T22:15:40.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.511+0000 7f4176000640 1 -- 172.21.15.1:0/4277161380 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f416c03b3f0 con 0x7f4178109930 2024-09-15T22:15:40.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.512+0000 7f4176000640 1 --2- 172.21.15.1:0/4277161380 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f4160039300 0x7f416003b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:40.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.512+0000 7f4176000640 1 -- 172.21.15.1:0/4277161380 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f416c06c9c0 con 0x7f4178109930 2024-09-15T22:15:40.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.512+0000 7f417d200640 1 --2- 172.21.15.1:0/4277161380 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f4160039300 0x7f416003b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:40.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.513+0000 7f417d200640 1 --2- 172.21.15.1:0/4277161380 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f4160039300 0x7f416003b7c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f41640098c0 tx=0x7f4164006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:40.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.517+0000 7f4176000640 1 -- 172.21.15.1:0/4277161380 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f416c0313a0 con 0x7f4178109930 2024-09-15T22:15:40.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.795+0000 7f4180600640 1 -- 172.21.15.1:0/4277161380 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f41781a0fe0 con 0x7f4178109930 2024-09-15T22:15:40.446 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.797+0000 7f4176000640 1 -- 172.21.15.1:0/4277161380 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v27)=0 set mgr/dashboard/cluster/status v27) ==== 153+0+0 (secure 0 0 0) 0x7f416c038250 con 0x7f4178109930 2024-09-15T22:15:40.446 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-15T22:15:40.446 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.800+0000 7f4180600640 1 -- 172.21.15.1:0/4277161380 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f4160039300 msgr2=0x7f416003b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:40.446 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.800+0000 7f4180600640 1 --2- 172.21.15.1:0/4277161380 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f4160039300 0x7f416003b7c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f41640098c0 tx=0x7f4164006db0 comp rx=0 tx=0).stop 2024-09-15T22:15:40.446 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.800+0000 7f4180600640 1 -- 172.21.15.1:0/4277161380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4178109930 msgr2=0x7f417819d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:40.446 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.800+0000 7f4180600640 1 --2- 172.21.15.1:0/4277161380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4178109930 0x7f417819d950 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f416c0097f0 tx=0x7f416c0327b0 comp rx=0 tx=0).stop 2024-09-15T22:15:40.446 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.800+0000 7f4180600640 1 -- 172.21.15.1:0/4277161380 shutdown_connections 2024-09-15T22:15:40.446 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.800+0000 7f4180600640 1 --2- 172.21.15.1:0/4277161380 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f4160039300 0x7f416003b7c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:40.446 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.800+0000 7f4180600640 1 --2- 172.21.15.1:0/4277161380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4178109930 0x7f417819d950 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:40.446 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.800+0000 7f4180600640 1 -- 172.21.15.1:0/4277161380 >> 172.21.15.1:0/4277161380 conn(0x7f417807cfa0 msgr2=0x7f4178107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:40.446 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.800+0000 7f4180600640 1 -- 172.21.15.1:0/4277161380 shutdown_connections 2024-09-15T22:15:40.446 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-15T22:15:39.800+0000 7f4180600640 1 -- 172.21.15.1:0/4277161380 wait complete. 2024-09-15T22:15:40.446 INFO:teuthology.orchestra.run.smithi001.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-15T22:15:40.446 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:15:40.447 INFO:teuthology.orchestra.run.smithi001.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:15:40.447 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:15:40.447 INFO:teuthology.orchestra.run.smithi001.stdout:Or, if you are only running a single cluster on this host: 2024-09-15T22:15:40.447 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:15:40.447 INFO:teuthology.orchestra.run.smithi001.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-15T22:15:40.447 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:15:40.447 INFO:teuthology.orchestra.run.smithi001.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-15T22:15:40.447 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:15:40.447 INFO:teuthology.orchestra.run.smithi001.stdout: ceph telemetry on 2024-09-15T22:15:40.447 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:15:40.447 INFO:teuthology.orchestra.run.smithi001.stdout:For more information see: 2024-09-15T22:15:40.447 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:15:40.447 INFO:teuthology.orchestra.run.smithi001.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-15T22:15:40.447 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:15:40.447 INFO:teuthology.orchestra.run.smithi001.stdout:Bootstrap complete. 2024-09-15T22:15:40.499 INFO:tasks.cephadm:Fetching config... 2024-09-15T22:15:40.499 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T22:15:40.500 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-15T22:15:40.536 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-15T22:15:40.536 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T22:15:40.537 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-15T22:15:40.612 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-15T22:15:40.613 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T22:15:40.613 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-15T22:15:40.710 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-15T22:15:40.710 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T22:15:40.711 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-15T22:15:40.786 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-15T22:15:40.786 DEBUG:teuthology.orchestra.run.smithi001:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9kM2NUXB6mcIaPfEKQwKY5McabOHDqG+JUXGaXVhFfzuZEWJvFy9VVqNPkO3Hi/bRXjbGMW5XoNSDqgh3E+2jrme5G05fQUAmQSwhfBw3N7ntUDLd+D63Y6hB+vgMHUC+mrPS2qdJNEQshI7gUwxPoQ7Ky50VSlXVSxL21cyyEd6nnHhQmK5n0L5+kuZFa0eKFwVZh+7fK29AUrpuuiNJKUIh+EmrfmtH5eTMhnR/sGRw+Q/JrZq5VqF3DrMi1BeKP1DD7buPtteW7f8OgRIrGJV35GXAOkLG7yxew8gW0+vFZYGlDq3aM/Fy5C/ZjTCWSaznqtSxidQjBJ0Q4XogHUCSWEN69mYc6kWDGCAgRox29VszmsjPfQhYouMJUCIAvFQGLR6INOyYChQ22dcXGa9q7Mcl2hbv5TtbVMTfWzz+NYRKXCX4/fF/9a0rWJ2gFuGUA62i6qcpFXtY7YOWjzGqRom0kXk99tQHfFYYg7X6L51R/qGioo6HI6waeUU= ceph-c1228c44-73af-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-15T22:15:40.906 INFO:teuthology.orchestra.run.smithi001.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9kM2NUXB6mcIaPfEKQwKY5McabOHDqG+JUXGaXVhFfzuZEWJvFy9VVqNPkO3Hi/bRXjbGMW5XoNSDqgh3E+2jrme5G05fQUAmQSwhfBw3N7ntUDLd+D63Y6hB+vgMHUC+mrPS2qdJNEQshI7gUwxPoQ7Ky50VSlXVSxL21cyyEd6nnHhQmK5n0L5+kuZFa0eKFwVZh+7fK29AUrpuuiNJKUIh+EmrfmtH5eTMhnR/sGRw+Q/JrZq5VqF3DrMi1BeKP1DD7buPtteW7f8OgRIrGJV35GXAOkLG7yxew8gW0+vFZYGlDq3aM/Fy5C/ZjTCWSaznqtSxidQjBJ0Q4XogHUCSWEN69mYc6kWDGCAgRox29VszmsjPfQhYouMJUCIAvFQGLR6INOyYChQ22dcXGa9q7Mcl2hbv5TtbVMTfWzz+NYRKXCX4/fF/9a0rWJ2gFuGUA62i6qcpFXtY7YOWjzGqRom0kXk99tQHfFYYg7X6L51R/qGioo6HI6waeUU= ceph-c1228c44-73af-11ef-bceb-c7b262605968 2024-09-15T22:15:40.932 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9kM2NUXB6mcIaPfEKQwKY5McabOHDqG+JUXGaXVhFfzuZEWJvFy9VVqNPkO3Hi/bRXjbGMW5XoNSDqgh3E+2jrme5G05fQUAmQSwhfBw3N7ntUDLd+D63Y6hB+vgMHUC+mrPS2qdJNEQshI7gUwxPoQ7Ky50VSlXVSxL21cyyEd6nnHhQmK5n0L5+kuZFa0eKFwVZh+7fK29AUrpuuiNJKUIh+EmrfmtH5eTMhnR/sGRw+Q/JrZq5VqF3DrMi1BeKP1DD7buPtteW7f8OgRIrGJV35GXAOkLG7yxew8gW0+vFZYGlDq3aM/Fy5C/ZjTCWSaznqtSxidQjBJ0Q4XogHUCSWEN69mYc6kWDGCAgRox29VszmsjPfQhYouMJUCIAvFQGLR6INOyYChQ22dcXGa9q7Mcl2hbv5TtbVMTfWzz+NYRKXCX4/fF/9a0rWJ2gFuGUA62i6qcpFXtY7YOWjzGqRom0kXk99tQHfFYYg7X6L51R/qGioo6HI6waeUU= ceph-c1228c44-73af-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-15T22:15:40.973 INFO:teuthology.orchestra.run.smithi012.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9kM2NUXB6mcIaPfEKQwKY5McabOHDqG+JUXGaXVhFfzuZEWJvFy9VVqNPkO3Hi/bRXjbGMW5XoNSDqgh3E+2jrme5G05fQUAmQSwhfBw3N7ntUDLd+D63Y6hB+vgMHUC+mrPS2qdJNEQshI7gUwxPoQ7Ky50VSlXVSxL21cyyEd6nnHhQmK5n0L5+kuZFa0eKFwVZh+7fK29AUrpuuiNJKUIh+EmrfmtH5eTMhnR/sGRw+Q/JrZq5VqF3DrMi1BeKP1DD7buPtteW7f8OgRIrGJV35GXAOkLG7yxew8gW0+vFZYGlDq3aM/Fy5C/ZjTCWSaznqtSxidQjBJ0Q4XogHUCSWEN69mYc6kWDGCAgRox29VszmsjPfQhYouMJUCIAvFQGLR6INOyYChQ22dcXGa9q7Mcl2hbv5TtbVMTfWzz+NYRKXCX4/fF/9a0rWJ2gFuGUA62i6qcpFXtY7YOWjzGqRom0kXk99tQHfFYYg7X6L51R/qGioo6HI6waeUU= ceph-c1228c44-73af-11ef-bceb-c7b262605968 2024-09-15T22:15:40.985 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9kM2NUXB6mcIaPfEKQwKY5McabOHDqG+JUXGaXVhFfzuZEWJvFy9VVqNPkO3Hi/bRXjbGMW5XoNSDqgh3E+2jrme5G05fQUAmQSwhfBw3N7ntUDLd+D63Y6hB+vgMHUC+mrPS2qdJNEQshI7gUwxPoQ7Ky50VSlXVSxL21cyyEd6nnHhQmK5n0L5+kuZFa0eKFwVZh+7fK29AUrpuuiNJKUIh+EmrfmtH5eTMhnR/sGRw+Q/JrZq5VqF3DrMi1BeKP1DD7buPtteW7f8OgRIrGJV35GXAOkLG7yxew8gW0+vFZYGlDq3aM/Fy5C/ZjTCWSaznqtSxidQjBJ0Q4XogHUCSWEN69mYc6kWDGCAgRox29VszmsjPfQhYouMJUCIAvFQGLR6INOyYChQ22dcXGa9q7Mcl2hbv5TtbVMTfWzz+NYRKXCX4/fF/9a0rWJ2gFuGUA62i6qcpFXtY7YOWjzGqRom0kXk99tQHfFYYg7X6L51R/qGioo6HI6waeUU= ceph-c1228c44-73af-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-15T22:15:40.986 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:40 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/4277161380' entity='client.admin' 2024-09-15T22:15:41.026 INFO:teuthology.orchestra.run.smithi098.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9kM2NUXB6mcIaPfEKQwKY5McabOHDqG+JUXGaXVhFfzuZEWJvFy9VVqNPkO3Hi/bRXjbGMW5XoNSDqgh3E+2jrme5G05fQUAmQSwhfBw3N7ntUDLd+D63Y6hB+vgMHUC+mrPS2qdJNEQshI7gUwxPoQ7Ky50VSlXVSxL21cyyEd6nnHhQmK5n0L5+kuZFa0eKFwVZh+7fK29AUrpuuiNJKUIh+EmrfmtH5eTMhnR/sGRw+Q/JrZq5VqF3DrMi1BeKP1DD7buPtteW7f8OgRIrGJV35GXAOkLG7yxew8gW0+vFZYGlDq3aM/Fy5C/ZjTCWSaznqtSxidQjBJ0Q4XogHUCSWEN69mYc6kWDGCAgRox29VszmsjPfQhYouMJUCIAvFQGLR6INOyYChQ22dcXGa9q7Mcl2hbv5TtbVMTfWzz+NYRKXCX4/fF/9a0rWJ2gFuGUA62i6qcpFXtY7YOWjzGqRom0kXk99tQHfFYYg7X6L51R/qGioo6HI6waeUU= ceph-c1228c44-73af-11ef-bceb-c7b262605968 2024-09-15T22:15:41.039 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-15T22:15:41.406 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:41.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:41.939+0000 7f947e000640 1 -- 172.21.15.1:0/4291068893 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94781037f0 msgr2=0x7f9478103bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:41.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:41.939+0000 7f947e000640 1 --2- 172.21.15.1:0/4291068893 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94781037f0 0x7f9478103bf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9468009880 tx=0x7f946802a5d0 comp rx=0 tx=0).stop 2024-09-15T22:15:41.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:41.939+0000 7f947e000640 1 -- 172.21.15.1:0/4291068893 shutdown_connections 2024-09-15T22:15:41.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:41.939+0000 7f947e000640 1 --2- 172.21.15.1:0/4291068893 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94781037f0 0x7f9478103bf0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:41.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:41.939+0000 7f947e000640 1 -- 172.21.15.1:0/4291068893 >> 172.21.15.1:0/4291068893 conn(0x7f94780fefc0 msgr2=0x7f9478101400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:41.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:41.939+0000 7f947e000640 1 -- 172.21.15.1:0/4291068893 shutdown_connections 2024-09-15T22:15:41.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:41.939+0000 7f947e000640 1 -- 172.21.15.1:0/4291068893 wait complete. 2024-09-15T22:15:41.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:41.940+0000 7f947e000640 1 Processor -- start 2024-09-15T22:15:41.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:41.941+0000 7f947e000640 1 -- start start 2024-09-15T22:15:41.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:41.941+0000 7f947e000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94781037f0 0x7f9478198f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:41.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:41.941+0000 7f947e000640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9478109900 con 0x7f94781037f0 2024-09-15T22:15:41.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:41.941+0000 7f9477400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94781037f0 0x7f9478198f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:41.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:41.941+0000 7f9477400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94781037f0 0x7f9478198f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57202/0 (socket says 172.21.15.1:57202) 2024-09-15T22:15:41.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:41.941+0000 7f9477400640 1 -- 172.21.15.1:0/2458205244 learned_addr learned my addr 172.21.15.1:0/2458205244 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:41.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:41.942+0000 7f9477400640 1 -- 172.21.15.1:0/2458205244 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9478199470 con 0x7f94781037f0 2024-09-15T22:15:41.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:41.942+0000 7f9477400640 1 --2- 172.21.15.1:0/2458205244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94781037f0 0x7f9478198f30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9468004f60 tx=0x7f94680048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:41.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:41.942+0000 7f946fe00640 1 -- 172.21.15.1:0/2458205244 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f946803f070 con 0x7f94781037f0 2024-09-15T22:15:41.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:41.942+0000 7f946fe00640 1 -- 172.21.15.1:0/2458205244 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9468004cc0 con 0x7f94781037f0 2024-09-15T22:15:41.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:41.942+0000 7f946fe00640 1 -- 172.21.15.1:0/2458205244 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9468035030 con 0x7f94781037f0 2024-09-15T22:15:41.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:41.942+0000 7f947e000640 1 -- 172.21.15.1:0/2458205244 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9478199700 con 0x7f94781037f0 2024-09-15T22:15:41.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:41.943+0000 7f947e000640 1 -- 172.21.15.1:0/2458205244 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f947819c3f0 con 0x7f94781037f0 2024-09-15T22:15:41.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:41.944+0000 7f946fe00640 1 -- 172.21.15.1:0/2458205244 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f9468042070 con 0x7f94781037f0 2024-09-15T22:15:41.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:41.944+0000 7f947e000640 1 -- 172.21.15.1:0/2458205244 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f947810a080 con 0x7f94781037f0 2024-09-15T22:15:41.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:41.944+0000 7f946fe00640 1 --2- 172.21.15.1:0/2458205244 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f945c039300 0x7f945c03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:41.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:41.944+0000 7f946fe00640 1 -- 172.21.15.1:0/2458205244 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f946806d0c0 con 0x7f94781037f0 2024-09-15T22:15:41.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:41.944+0000 7f9476a00640 1 --2- 172.21.15.1:0/2458205244 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f945c039300 0x7f945c03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:41.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:41.945+0000 7f9476a00640 1 --2- 172.21.15.1:0/2458205244 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f945c039300 0x7f945c03b7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f94640098c0 tx=0x7f9464006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:41.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:41.950+0000 7f946fe00640 1 -- 172.21.15.1:0/2458205244 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9468040260 con 0x7f94781037f0 2024-09-15T22:15:42.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:42.151+0000 7f947e000640 1 -- 172.21.15.1:0/2458205244 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f947802d830 con 0x7f94781037f0 2024-09-15T22:15:42.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:42.153+0000 7f946fe00640 1 -- 172.21.15.1:0/2458205244 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f9468003dd0 con 0x7f94781037f0 2024-09-15T22:15:42.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:42.156+0000 7f947e000640 1 -- 172.21.15.1:0/2458205244 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f945c039300 msgr2=0x7f945c03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:42.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:42.156+0000 7f947e000640 1 --2- 172.21.15.1:0/2458205244 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f945c039300 0x7f945c03b7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f94640098c0 tx=0x7f9464006db0 comp rx=0 tx=0).stop 2024-09-15T22:15:42.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:42.156+0000 7f947e000640 1 -- 172.21.15.1:0/2458205244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94781037f0 msgr2=0x7f9478198f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:42.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:42.156+0000 7f947e000640 1 --2- 172.21.15.1:0/2458205244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94781037f0 0x7f9478198f30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9468004f60 tx=0x7f94680048f0 comp rx=0 tx=0).stop 2024-09-15T22:15:42.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:42.156+0000 7f947e000640 1 -- 172.21.15.1:0/2458205244 shutdown_connections 2024-09-15T22:15:42.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:42.156+0000 7f947e000640 1 --2- 172.21.15.1:0/2458205244 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f945c039300 0x7f945c03b7c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:42.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:42.156+0000 7f947e000640 1 --2- 172.21.15.1:0/2458205244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94781037f0 0x7f9478198f30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:42.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:42.156+0000 7f947e000640 1 -- 172.21.15.1:0/2458205244 >> 172.21.15.1:0/2458205244 conn(0x7f94780fefc0 msgr2=0x7f94780ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:42.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:42.156+0000 7f947e000640 1 -- 172.21.15.1:0/2458205244 shutdown_connections 2024-09-15T22:15:42.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:42.156+0000 7f947e000640 1 -- 172.21.15.1:0/2458205244 wait complete. 2024-09-15T22:15:43.318 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:43 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/2458205244' entity='client.admin' 2024-09-15T22:15:43.319 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:43 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:15:43.319 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:43 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:15:43.319 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:43 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi001", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:15:43.319 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:43 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:15:43.319 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:43 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:15:43.319 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:43 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:15:43.355 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-15T22:15:43.355 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-15T22:15:43.718 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:44.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.216+0000 7fe4c5800640 1 -- 172.21.15.1:0/4287907114 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4c0076220 msgr2=0x7fe4c0074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:44.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.216+0000 7fe4c5800640 1 --2- 172.21.15.1:0/4287907114 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4c0076220 0x7fe4c0074680 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0009880 tx=0x7fe4b002a5d0 comp rx=0 tx=0).stop 2024-09-15T22:15:44.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.216+0000 7fe4c5800640 1 -- 172.21.15.1:0/4287907114 shutdown_connections 2024-09-15T22:15:44.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.216+0000 7fe4c5800640 1 --2- 172.21.15.1:0/4287907114 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4c0076220 0x7fe4c0074680 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:44.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.216+0000 7fe4c5800640 1 -- 172.21.15.1:0/4287907114 >> 172.21.15.1:0/4287907114 conn(0x7fe4c00fcbd0 msgr2=0x7fe4c00feff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:44.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.216+0000 7fe4c5800640 1 -- 172.21.15.1:0/4287907114 shutdown_connections 2024-09-15T22:15:44.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.216+0000 7fe4c5800640 1 -- 172.21.15.1:0/4287907114 wait complete. 2024-09-15T22:15:44.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.217+0000 7fe4c5800640 1 Processor -- start 2024-09-15T22:15:44.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.217+0000 7fe4c5800640 1 -- start start 2024-09-15T22:15:44.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.218+0000 7fe4c5800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4c0076220 0x7fe4c019d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:44.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.218+0000 7fe4c5800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c010db60 con 0x7fe4c0076220 2024-09-15T22:15:44.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.218+0000 7fe4bfe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4c0076220 0x7fe4c019d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:44.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.218+0000 7fe4bfe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4c0076220 0x7fe4c019d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57216/0 (socket says 172.21.15.1:57216) 2024-09-15T22:15:44.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.218+0000 7fe4bfe00640 1 -- 172.21.15.1:0/3318566065 learned_addr learned my addr 172.21.15.1:0/3318566065 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:44.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.218+0000 7fe4bfe00640 1 -- 172.21.15.1:0/3318566065 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c019d710 con 0x7fe4c0076220 2024-09-15T22:15:44.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.218+0000 7fe4bfe00640 1 --2- 172.21.15.1:0/3318566065 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4c0076220 0x7fe4c019d1d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0004f60 tx=0x7fe4b00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:44.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.219+0000 7fe4bcc00640 1 -- 172.21.15.1:0/3318566065 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4b003f070 con 0x7fe4c0076220 2024-09-15T22:15:44.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.219+0000 7fe4bcc00640 1 -- 172.21.15.1:0/3318566065 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4b0004d40 con 0x7fe4c0076220 2024-09-15T22:15:44.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.219+0000 7fe4c5800640 1 -- 172.21.15.1:0/3318566065 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4c019d9a0 con 0x7fe4c0076220 2024-09-15T22:15:44.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.219+0000 7fe4bcc00640 1 -- 172.21.15.1:0/3318566065 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4b0035030 con 0x7fe4c0076220 2024-09-15T22:15:44.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.219+0000 7fe4c5800640 1 -- 172.21.15.1:0/3318566065 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4c01a0690 con 0x7fe4c0076220 2024-09-15T22:15:44.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.220+0000 7fe4bcc00640 1 -- 172.21.15.1:0/3318566065 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fe4b0042070 con 0x7fe4c0076220 2024-09-15T22:15:44.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.220+0000 7fe4c5800640 1 -- 172.21.15.1:0/3318566065 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4c010e2a0 con 0x7fe4c0076220 2024-09-15T22:15:44.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.220+0000 7fe4bcc00640 1 --2- 172.21.15.1:0/3318566065 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe4a4039300 0x7fe4a403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:44.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.220+0000 7fe4bcc00640 1 -- 172.21.15.1:0/3318566065 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe4b006d060 con 0x7fe4c0076220 2024-09-15T22:15:44.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.220+0000 7fe4bf400640 1 --2- 172.21.15.1:0/3318566065 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe4a4039300 0x7fe4a403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:44.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.221+0000 7fe4bf400640 1 --2- 172.21.15.1:0/3318566065 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe4a4039300 0x7fe4a403b7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac0098c0 tx=0x7fe4ac006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:44.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.225+0000 7fe4bcc00640 1 -- 172.21.15.1:0/3318566065 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe4b0039350 con 0x7fe4c0076220 2024-09-15T22:15:44.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.416+0000 7fe4c5800640 1 -- 172.21.15.1:0/3318566065 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fe4c002d830 con 0x7fe4a4039300 2024-09-15T22:15:44.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.420+0000 7fe4bcc00640 1 -- 172.21.15.1:0/3318566065 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe4c002d830 con 0x7fe4a4039300 2024-09-15T22:15:44.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.423+0000 7fe4c5800640 1 -- 172.21.15.1:0/3318566065 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe4a4039300 msgr2=0x7fe4a403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:44.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.423+0000 7fe4c5800640 1 --2- 172.21.15.1:0/3318566065 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe4a4039300 0x7fe4a403b7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac0098c0 tx=0x7fe4ac006db0 comp rx=0 tx=0).stop 2024-09-15T22:15:44.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.423+0000 7fe4c5800640 1 -- 172.21.15.1:0/3318566065 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4c0076220 msgr2=0x7fe4c019d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:44.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.423+0000 7fe4c5800640 1 --2- 172.21.15.1:0/3318566065 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4c0076220 0x7fe4c019d1d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0004f60 tx=0x7fe4b00048f0 comp rx=0 tx=0).stop 2024-09-15T22:15:44.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.423+0000 7fe4c5800640 1 -- 172.21.15.1:0/3318566065 shutdown_connections 2024-09-15T22:15:44.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.423+0000 7fe4c5800640 1 --2- 172.21.15.1:0/3318566065 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe4a4039300 0x7fe4a403b7c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:44.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.423+0000 7fe4c5800640 1 --2- 172.21.15.1:0/3318566065 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4c0076220 0x7fe4c019d1d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:44.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.423+0000 7fe4c5800640 1 -- 172.21.15.1:0/3318566065 >> 172.21.15.1:0/3318566065 conn(0x7fe4c00fcbd0 msgr2=0x7fe4c00fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:44.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.423+0000 7fe4c5800640 1 -- 172.21.15.1:0/3318566065 shutdown_connections 2024-09-15T22:15:44.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:44.423+0000 7fe4c5800640 1 -- 172.21.15.1:0/3318566065 wait complete. 2024-09-15T22:15:45.225 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi012 2024-09-15T22:15:45.225 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-15T22:15:45.225 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/etc/ceph/ceph.conf 2024-09-15T22:15:45.244 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-15T22:15:45.244 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:15:45.302 INFO:tasks.cephadm:Adding host smithi012 to orchestrator... 2024-09-15T22:15:45.303 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph orch host add smithi012 2024-09-15T22:15:45.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:45 smithi001 ceph-mon[30843]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:15:45.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:45 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:15:45.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:45 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:15:45.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:45 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:15:45.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:45 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:15:45.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:45 smithi001 ceph-mon[30843]: Updating smithi001:/etc/ceph/ceph.conf 2024-09-15T22:15:45.686 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:46.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:46.444+0000 7f17d9800640 1 -- 172.21.15.1:0/553563495 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17d4109780 msgr2=0x7f17d4109b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:46.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:46.444+0000 7f17d9800640 1 --2- 172.21.15.1:0/553563495 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17d4109780 0x7f17d4109b60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f17c4009880 tx=0x7f17c402a5d0 comp rx=0 tx=0).stop 2024-09-15T22:15:46.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:46.444+0000 7f17d9800640 1 -- 172.21.15.1:0/553563495 shutdown_connections 2024-09-15T22:15:46.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:46.444+0000 7f17d9800640 1 --2- 172.21.15.1:0/553563495 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17d4109780 0x7f17d4109b60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:46.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:46.444+0000 7f17d9800640 1 -- 172.21.15.1:0/553563495 >> 172.21.15.1:0/553563495 conn(0x7f17d40ff480 msgr2=0x7f17d41018a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:46.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:46.444+0000 7f17d9800640 1 -- 172.21.15.1:0/553563495 shutdown_connections 2024-09-15T22:15:46.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:46.444+0000 7f17d9800640 1 -- 172.21.15.1:0/553563495 wait complete. 2024-09-15T22:15:46.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:46.445+0000 7f17d9800640 1 Processor -- start 2024-09-15T22:15:46.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:46.445+0000 7f17d9800640 1 -- start start 2024-09-15T22:15:46.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:46.445+0000 7f17d9800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17d4109780 0x7f17d4199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:46.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:46.445+0000 7f17d9800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f17d410de40 con 0x7f17d4109780 2024-09-15T22:15:46.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:46.446+0000 7f17d2a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17d4109780 0x7f17d4199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:46.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:46.446+0000 7f17d2a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17d4109780 0x7f17d4199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57226/0 (socket says 172.21.15.1:57226) 2024-09-15T22:15:46.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:46.446+0000 7f17d2a00640 1 -- 172.21.15.1:0/3186163560 learned_addr learned my addr 172.21.15.1:0/3186163560 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:46.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:46.446+0000 7f17d2a00640 1 -- 172.21.15.1:0/3186163560 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17d4199860 con 0x7f17d4109780 2024-09-15T22:15:46.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:46.446+0000 7f17d2a00640 1 --2- 172.21.15.1:0/3186163560 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17d4109780 0x7f17d4199320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f17c4009230 tx=0x7f17c4003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:46.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:46.447+0000 7f17cb400640 1 -- 172.21.15.1:0/3186163560 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17c403f070 con 0x7f17d4109780 2024-09-15T22:15:46.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:46.447+0000 7f17cb400640 1 -- 172.21.15.1:0/3186163560 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17c403bd40 con 0x7f17d4109780 2024-09-15T22:15:46.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:46.447+0000 7f17d9800640 1 -- 172.21.15.1:0/3186163560 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17d4199b50 con 0x7f17d4109780 2024-09-15T22:15:46.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:46.447+0000 7f17cb400640 1 -- 172.21.15.1:0/3186163560 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17c4035030 con 0x7f17d4109780 2024-09-15T22:15:46.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:46.447+0000 7f17d9800640 1 -- 172.21.15.1:0/3186163560 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17d419dbf0 con 0x7f17d4109780 2024-09-15T22:15:46.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:46.448+0000 7f17d9800640 1 -- 172.21.15.1:0/3186163560 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17d4104ec0 con 0x7f17d4109780 2024-09-15T22:15:46.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:46.448+0000 7f17cb400640 1 -- 172.21.15.1:0/3186163560 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f17c4042070 con 0x7f17d4109780 2024-09-15T22:15:46.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:46.449+0000 7f17cb400640 1 --2- 172.21.15.1:0/3186163560 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f17b80392a0 0x7f17b803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:46.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:46.449+0000 7f17cb400640 1 -- 172.21.15.1:0/3186163560 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f17c406cb40 con 0x7f17d4109780 2024-09-15T22:15:46.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:46.449+0000 7f17d2000640 1 --2- 172.21.15.1:0/3186163560 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f17b80392a0 0x7f17b803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:46.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:46.449+0000 7f17d2000640 1 --2- 172.21.15.1:0/3186163560 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f17b80392a0 0x7f17b803b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f17c00098c0 tx=0x7f17c0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:46.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:46.454+0000 7f17cb400640 1 -- 172.21.15.1:0/3186163560 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f17c4044e10 con 0x7f17d4109780 2024-09-15T22:15:46.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:46 smithi001 ceph-mon[30843]: Updating smithi001:/var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:15:46.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:46 smithi001 ceph-mon[30843]: Updating smithi001:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:15:46.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:46 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:15:46.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:46 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:15:46.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:46 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:15:46.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:46.646+0000 7f17d9800640 1 -- 172.21.15.1:0/3186163560 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi012", "target": ["mon-mgr", ""]}) -- 0x7f17d419a680 con 0x7f17b80392a0 2024-09-15T22:15:47.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:47 smithi001 ceph-mon[30843]: Updating smithi001:/var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:15:48.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:48 smithi001 ceph-mon[30843]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi012", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:15:49.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:49 smithi001 ceph-mon[30843]: Deploying cephadm binary to smithi012 2024-09-15T22:15:50.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:50.524+0000 7f17cb400640 1 -- 172.21.15.1:0/3186163560 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f17d419a680 con 0x7f17b80392a0 2024-09-15T22:15:50.526 INFO:teuthology.orchestra.run.smithi001.stdout:Added host 'smithi012' with addr '172.21.15.12' 2024-09-15T22:15:50.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:50.527+0000 7f17d9800640 1 -- 172.21.15.1:0/3186163560 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f17b80392a0 msgr2=0x7f17b803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:50.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:50.527+0000 7f17d9800640 1 --2- 172.21.15.1:0/3186163560 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f17b80392a0 0x7f17b803b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f17c00098c0 tx=0x7f17c0006db0 comp rx=0 tx=0).stop 2024-09-15T22:15:50.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:50.527+0000 7f17d9800640 1 -- 172.21.15.1:0/3186163560 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17d4109780 msgr2=0x7f17d4199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:50.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:50.527+0000 7f17d9800640 1 --2- 172.21.15.1:0/3186163560 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17d4109780 0x7f17d4199320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f17c4009230 tx=0x7f17c4003d80 comp rx=0 tx=0).stop 2024-09-15T22:15:50.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:50.527+0000 7f17d9800640 1 -- 172.21.15.1:0/3186163560 shutdown_connections 2024-09-15T22:15:50.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:50.527+0000 7f17d9800640 1 --2- 172.21.15.1:0/3186163560 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f17b80392a0 0x7f17b803b760 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:50.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:50.527+0000 7f17d9800640 1 --2- 172.21.15.1:0/3186163560 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17d4109780 0x7f17d4199320 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:50.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:50.527+0000 7f17d9800640 1 -- 172.21.15.1:0/3186163560 >> 172.21.15.1:0/3186163560 conn(0x7f17d40ff480 msgr2=0x7f17d4100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:50.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:50.527+0000 7f17d9800640 1 -- 172.21.15.1:0/3186163560 shutdown_connections 2024-09-15T22:15:50.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:50.527+0000 7f17d9800640 1 -- 172.21.15.1:0/3186163560 wait complete. 2024-09-15T22:15:51.164 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-15T22:15:51.532 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:51.786 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:51 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:15:51.786 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:51 smithi001 ceph-mon[30843]: Added host smithi012 2024-09-15T22:15:51.786 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:51 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:15:51.786 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:51 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:15:51.786 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:51 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:15:52.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.003+0000 7fb6ed400640 1 -- 172.21.15.1:0/1362956795 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6e8107640 msgr2=0x7fb6e8107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:52.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.003+0000 7fb6ed400640 1 --2- 172.21.15.1:0/1362956795 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6e8107640 0x7fb6e8107a20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8009880 tx=0x7fb6d802a5d0 comp rx=0 tx=0).stop 2024-09-15T22:15:52.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.003+0000 7fb6ed400640 1 -- 172.21.15.1:0/1362956795 shutdown_connections 2024-09-15T22:15:52.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.003+0000 7fb6ed400640 1 --2- 172.21.15.1:0/1362956795 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6e8107640 0x7fb6e8107a20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:52.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.003+0000 7fb6ed400640 1 -- 172.21.15.1:0/1362956795 >> 172.21.15.1:0/1362956795 conn(0x7fb6e80fd230 msgr2=0x7fb6e80ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:52.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.003+0000 7fb6ed400640 1 -- 172.21.15.1:0/1362956795 shutdown_connections 2024-09-15T22:15:52.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.003+0000 7fb6ed400640 1 -- 172.21.15.1:0/1362956795 wait complete. 2024-09-15T22:15:52.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.004+0000 7fb6ed400640 1 Processor -- start 2024-09-15T22:15:52.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.004+0000 7fb6ed400640 1 -- start start 2024-09-15T22:15:52.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.004+0000 7fb6ed400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6e8107640 0x7fb6e80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:52.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.004+0000 7fb6ed400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e810bc70 con 0x7fb6e8107640 2024-09-15T22:15:52.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.005+0000 7fb6e6800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6e8107640 0x7fb6e80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:52.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.005+0000 7fb6e6800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6e8107640 0x7fb6e80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44638/0 (socket says 172.21.15.1:44638) 2024-09-15T22:15:52.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.005+0000 7fb6e6800640 1 -- 172.21.15.1:0/3581641164 learned_addr learned my addr 172.21.15.1:0/3581641164 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:52.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.005+0000 7fb6e6800640 1 -- 172.21.15.1:0/3581641164 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6e80763e0 con 0x7fb6e8107640 2024-09-15T22:15:52.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.005+0000 7fb6e6800640 1 --2- 172.21.15.1:0/3581641164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6e8107640 0x7fb6e80744f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8009230 tx=0x7fb6d8003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:52.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.005+0000 7fb6df400640 1 -- 172.21.15.1:0/3581641164 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6d803f070 con 0x7fb6e8107640 2024-09-15T22:15:52.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.006+0000 7fb6ed400640 1 -- 172.21.15.1:0/3581641164 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6e8074a30 con 0x7fb6e8107640 2024-09-15T22:15:52.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.006+0000 7fb6df400640 1 -- 172.21.15.1:0/3581641164 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6d803bc80 con 0x7fb6e8107640 2024-09-15T22:15:52.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.006+0000 7fb6df400640 1 -- 172.21.15.1:0/3581641164 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6d8035030 con 0x7fb6e8107640 2024-09-15T22:15:52.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.006+0000 7fb6ed400640 1 -- 172.21.15.1:0/3581641164 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6e8074ef0 con 0x7fb6e8107640 2024-09-15T22:15:52.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.007+0000 7fb6df400640 1 -- 172.21.15.1:0/3581641164 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fb6d8042070 con 0x7fb6e8107640 2024-09-15T22:15:52.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.007+0000 7fb6ed400640 1 -- 172.21.15.1:0/3581641164 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6e8102cb0 con 0x7fb6e8107640 2024-09-15T22:15:52.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.007+0000 7fb6df400640 1 --2- 172.21.15.1:0/3581641164 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb6cc039300 0x7fb6cc03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:52.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.007+0000 7fb6df400640 1 -- 172.21.15.1:0/3581641164 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb6d806d070 con 0x7fb6e8107640 2024-09-15T22:15:52.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.007+0000 7fb6e5e00640 1 --2- 172.21.15.1:0/3581641164 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb6cc039300 0x7fb6cc03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:52.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.008+0000 7fb6e5e00640 1 --2- 172.21.15.1:0/3581641164 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb6cc039300 0x7fb6cc03b7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb6d40098c0 tx=0x7fb6d4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:52.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.012+0000 7fb6df400640 1 -- 172.21.15.1:0/3581641164 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb6d80372d0 con 0x7fb6e8107640 2024-09-15T22:15:52.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.203+0000 7fb6ed400640 1 -- 172.21.15.1:0/3581641164 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb6e8075a90 con 0x7fb6cc039300 2024-09-15T22:15:52.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.204+0000 7fb6df400640 1 -- 172.21.15.1:0/3581641164 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+158 (secure 0 0 0) 0x7fb6e8075a90 con 0x7fb6cc039300 2024-09-15T22:15:52.205 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:15:52.206 INFO:teuthology.orchestra.run.smithi001.stdout:[{"addr": "172.21.15.1", "hostname": "smithi001", "labels": [], "status": ""}, {"addr": "172.21.15.12", "hostname": "smithi012", "labels": [], "status": ""}] 2024-09-15T22:15:52.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.207+0000 7fb6ed400640 1 -- 172.21.15.1:0/3581641164 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb6cc039300 msgr2=0x7fb6cc03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:52.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.207+0000 7fb6ed400640 1 --2- 172.21.15.1:0/3581641164 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb6cc039300 0x7fb6cc03b7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb6d40098c0 tx=0x7fb6d4006db0 comp rx=0 tx=0).stop 2024-09-15T22:15:52.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.207+0000 7fb6ed400640 1 -- 172.21.15.1:0/3581641164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6e8107640 msgr2=0x7fb6e80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:52.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.207+0000 7fb6ed400640 1 --2- 172.21.15.1:0/3581641164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6e8107640 0x7fb6e80744f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8009230 tx=0x7fb6d8003d40 comp rx=0 tx=0).stop 2024-09-15T22:15:52.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.207+0000 7fb6ed400640 1 -- 172.21.15.1:0/3581641164 shutdown_connections 2024-09-15T22:15:52.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.207+0000 7fb6ed400640 1 --2- 172.21.15.1:0/3581641164 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb6cc039300 0x7fb6cc03b7c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:52.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.207+0000 7fb6ed400640 1 --2- 172.21.15.1:0/3581641164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6e8107640 0x7fb6e80744f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:52.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.207+0000 7fb6ed400640 1 -- 172.21.15.1:0/3581641164 >> 172.21.15.1:0/3581641164 conn(0x7fb6e80fd230 msgr2=0x7fb6e80feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:52.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.207+0000 7fb6ed400640 1 -- 172.21.15.1:0/3581641164 shutdown_connections 2024-09-15T22:15:52.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:52.207+0000 7fb6ed400640 1 -- 172.21.15.1:0/3581641164 wait complete. 2024-09-15T22:15:52.847 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi098 2024-09-15T22:15:52.847 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-15T22:15:52.847 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/etc/ceph/ceph.conf 2024-09-15T22:15:52.867 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-15T22:15:52.867 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:15:52.928 INFO:tasks.cephadm:Adding host smithi098 to orchestrator... 2024-09-15T22:15:52.928 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph orch host add smithi098 2024-09-15T22:15:53.290 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:53.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:52 smithi001 ceph-mon[30843]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:15:53.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:52 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:15:53.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:52 smithi001 ceph-mon[30843]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:15:53.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:53.769+0000 7fb643200640 1 -- 172.21.15.1:0/343678137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb644101610 msgr2=0x7fb6441019f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:53.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:53.769+0000 7fb643200640 1 --2- 172.21.15.1:0/343678137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb644101610 0x7fb6441019f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb634009880 tx=0x7fb63402a5d0 comp rx=0 tx=0).stop 2024-09-15T22:15:53.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:53.769+0000 7fb643200640 1 -- 172.21.15.1:0/343678137 shutdown_connections 2024-09-15T22:15:53.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:53.769+0000 7fb643200640 1 --2- 172.21.15.1:0/343678137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb644101610 0x7fb6441019f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:53.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:53.769+0000 7fb643200640 1 -- 172.21.15.1:0/343678137 >> 172.21.15.1:0/343678137 conn(0x7fb6440fd0b0 msgr2=0x7fb6440ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:53.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:53.769+0000 7fb643200640 1 -- 172.21.15.1:0/343678137 shutdown_connections 2024-09-15T22:15:53.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:53.769+0000 7fb643200640 1 -- 172.21.15.1:0/343678137 wait complete. 2024-09-15T22:15:53.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:53.770+0000 7fb643200640 1 Processor -- start 2024-09-15T22:15:53.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:53.770+0000 7fb643200640 1 -- start start 2024-09-15T22:15:53.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:53.770+0000 7fb643200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb644101610 0x7fb644199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:53.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:53.770+0000 7fb643200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb64410ba60 con 0x7fb644101610 2024-09-15T22:15:53.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:53.771+0000 7fb641e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb644101610 0x7fb644199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:53.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:53.771+0000 7fb641e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb644101610 0x7fb644199170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44658/0 (socket says 172.21.15.1:44658) 2024-09-15T22:15:53.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:53.771+0000 7fb641e00640 1 -- 172.21.15.1:0/4044185346 learned_addr learned my addr 172.21.15.1:0/4044185346 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:53.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:53.771+0000 7fb641e00640 1 -- 172.21.15.1:0/4044185346 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6441996b0 con 0x7fb644101610 2024-09-15T22:15:53.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:53.771+0000 7fb641e00640 1 --2- 172.21.15.1:0/4044185346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb644101610 0x7fb644199170 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb634009230 tx=0x7fb634003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:53.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:53.772+0000 7fb63aa00640 1 -- 172.21.15.1:0/4044185346 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb63403f070 con 0x7fb644101610 2024-09-15T22:15:53.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:53.772+0000 7fb63aa00640 1 -- 172.21.15.1:0/4044185346 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb63403bd40 con 0x7fb644101610 2024-09-15T22:15:53.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:53.772+0000 7fb63aa00640 1 -- 172.21.15.1:0/4044185346 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb634035030 con 0x7fb644101610 2024-09-15T22:15:53.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:53.772+0000 7fb643200640 1 -- 172.21.15.1:0/4044185346 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6441999a0 con 0x7fb644101610 2024-09-15T22:15:53.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:53.772+0000 7fb643200640 1 -- 172.21.15.1:0/4044185346 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb64419da40 con 0x7fb644101610 2024-09-15T22:15:53.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:53.773+0000 7fb643200640 1 -- 172.21.15.1:0/4044185346 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb644102af0 con 0x7fb644101610 2024-09-15T22:15:53.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:53.774+0000 7fb63aa00640 1 -- 172.21.15.1:0/4044185346 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fb634042070 con 0x7fb644101610 2024-09-15T22:15:53.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:53.774+0000 7fb63aa00640 1 --2- 172.21.15.1:0/4044185346 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb628039300 0x7fb62803b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:53.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:53.774+0000 7fb63aa00640 1 -- 172.21.15.1:0/4044185346 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb63406cbb0 con 0x7fb644101610 2024-09-15T22:15:53.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:53.774+0000 7fb63be00640 1 --2- 172.21.15.1:0/4044185346 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb628039300 0x7fb62803b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:53.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:53.775+0000 7fb63be00640 1 --2- 172.21.15.1:0/4044185346 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb628039300 0x7fb62803b7c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb62c0098c0 tx=0x7fb62c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:53.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:53.779+0000 7fb63aa00640 1 -- 172.21.15.1:0/4044185346 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb634044e10 con 0x7fb644101610 2024-09-15T22:15:53.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:53.968+0000 7fb643200640 1 -- 172.21.15.1:0/4044185346 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi098", "target": ["mon-mgr", ""]}) -- 0x7fb64419a4d0 con 0x7fb628039300 2024-09-15T22:15:55.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:54 smithi001 ceph-mon[30843]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:15:55.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:54 smithi001 ceph-mon[30843]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi098", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:15:55.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:54 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:15:55.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:54 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:15:55.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:54 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:15:55.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:54 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:15:55.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:54 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi012", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:15:55.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:54 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:15:55.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:54 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:15:56.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:55 smithi001 ceph-mon[30843]: Updating smithi012:/etc/ceph/ceph.conf 2024-09-15T22:15:56.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:55 smithi001 ceph-mon[30843]: Updating smithi012:/var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:15:56.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:55 smithi001 ceph-mon[30843]: Updating smithi012:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:15:56.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:55 smithi001 ceph-mon[30843]: Deploying cephadm binary to smithi098 2024-09-15T22:15:56.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:55 smithi001 ceph-mon[30843]: Updating smithi012:/var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:15:56.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:55 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:15:56.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:55 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:15:56.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:55 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:15:57.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:56 smithi001 ceph-mon[30843]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:15:57.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:57.847+0000 7fb63aa00640 1 -- 172.21.15.1:0/4044185346 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fb64419a4d0 con 0x7fb628039300 2024-09-15T22:15:57.848 INFO:teuthology.orchestra.run.smithi001.stdout:Added host 'smithi098' with addr '172.21.15.98' 2024-09-15T22:15:57.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:57.849+0000 7fb643200640 1 -- 172.21.15.1:0/4044185346 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb628039300 msgr2=0x7fb62803b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:57.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:57.849+0000 7fb643200640 1 --2- 172.21.15.1:0/4044185346 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb628039300 0x7fb62803b7c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb62c0098c0 tx=0x7fb62c006db0 comp rx=0 tx=0).stop 2024-09-15T22:15:57.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:57.849+0000 7fb643200640 1 -- 172.21.15.1:0/4044185346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb644101610 msgr2=0x7fb644199170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:57.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:57.849+0000 7fb643200640 1 --2- 172.21.15.1:0/4044185346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb644101610 0x7fb644199170 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb634009230 tx=0x7fb634003d80 comp rx=0 tx=0).stop 2024-09-15T22:15:57.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:57.850+0000 7fb643200640 1 -- 172.21.15.1:0/4044185346 shutdown_connections 2024-09-15T22:15:57.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:57.850+0000 7fb643200640 1 --2- 172.21.15.1:0/4044185346 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb628039300 0x7fb62803b7c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:57.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:57.850+0000 7fb643200640 1 --2- 172.21.15.1:0/4044185346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb644101610 0x7fb644199170 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:57.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:57.850+0000 7fb643200640 1 -- 172.21.15.1:0/4044185346 >> 172.21.15.1:0/4044185346 conn(0x7fb6440fd0b0 msgr2=0x7fb644075f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:57.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:57.850+0000 7fb643200640 1 -- 172.21.15.1:0/4044185346 shutdown_connections 2024-09-15T22:15:57.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:57.850+0000 7fb643200640 1 -- 172.21.15.1:0/4044185346 wait complete. 2024-09-15T22:15:58.546 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-15T22:15:58.911 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:59.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:58 smithi001 ceph-mon[30843]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:15:59.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:58 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:15:59.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:58 smithi001 ceph-mon[30843]: Added host smithi098 2024-09-15T22:15:59.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:58 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:15:59.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:58 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:15:59.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:15:58 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:15:59.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.406+0000 7f2e6c600640 1 -- 172.21.15.1:0/3841288219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e64107640 msgr2=0x7f2e64107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:59.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.406+0000 7f2e6c600640 1 --2- 172.21.15.1:0/3841288219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e64107640 0x7f2e64107a20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2e58009880 tx=0x7f2e5802a5d0 comp rx=0 tx=0).stop 2024-09-15T22:15:59.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.406+0000 7f2e6c600640 1 -- 172.21.15.1:0/3841288219 shutdown_connections 2024-09-15T22:15:59.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.406+0000 7f2e6c600640 1 --2- 172.21.15.1:0/3841288219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e64107640 0x7f2e64107a20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:59.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.406+0000 7f2e6c600640 1 -- 172.21.15.1:0/3841288219 >> 172.21.15.1:0/3841288219 conn(0x7f2e640fd230 msgr2=0x7f2e640ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:59.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.406+0000 7f2e6c600640 1 -- 172.21.15.1:0/3841288219 shutdown_connections 2024-09-15T22:15:59.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.406+0000 7f2e6c600640 1 -- 172.21.15.1:0/3841288219 wait complete. 2024-09-15T22:15:59.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.407+0000 7f2e6c600640 1 Processor -- start 2024-09-15T22:15:59.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.408+0000 7f2e6c600640 1 -- start start 2024-09-15T22:15:59.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.408+0000 7f2e6c600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e64107640 0x7f2e64199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:59.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.408+0000 7f2e6c600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6410bc70 con 0x7f2e64107640 2024-09-15T22:15:59.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.408+0000 7f2e69c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e64107640 0x7f2e64199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:59.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.408+0000 7f2e69c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e64107640 0x7f2e64199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51128/0 (socket says 172.21.15.1:51128) 2024-09-15T22:15:59.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.408+0000 7f2e69c00640 1 -- 172.21.15.1:0/3828975898 learned_addr learned my addr 172.21.15.1:0/3828975898 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:15:59.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.409+0000 7f2e69c00640 1 -- 172.21.15.1:0/3828975898 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e64199840 con 0x7f2e64107640 2024-09-15T22:15:59.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.409+0000 7f2e69c00640 1 --2- 172.21.15.1:0/3828975898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e64107640 0x7f2e64199300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2e58009230 tx=0x7f2e58003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:59.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.409+0000 7f2e62000640 1 -- 172.21.15.1:0/3828975898 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e5803f070 con 0x7f2e64107640 2024-09-15T22:15:59.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.409+0000 7f2e62000640 1 -- 172.21.15.1:0/3828975898 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e5803bd40 con 0x7f2e64107640 2024-09-15T22:15:59.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.409+0000 7f2e6c600640 1 -- 172.21.15.1:0/3828975898 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e64199ad0 con 0x7f2e64107640 2024-09-15T22:15:59.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.409+0000 7f2e62000640 1 -- 172.21.15.1:0/3828975898 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e58035030 con 0x7f2e64107640 2024-09-15T22:15:59.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.409+0000 7f2e6c600640 1 -- 172.21.15.1:0/3828975898 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e6419dbd0 con 0x7f2e64107640 2024-09-15T22:15:59.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.410+0000 7f2e6c600640 1 -- 172.21.15.1:0/3828975898 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e64102cb0 con 0x7f2e64107640 2024-09-15T22:15:59.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.411+0000 7f2e62000640 1 -- 172.21.15.1:0/3828975898 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f2e58042070 con 0x7f2e64107640 2024-09-15T22:15:59.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.411+0000 7f2e62000640 1 --2- 172.21.15.1:0/3828975898 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2e4c0392a0 0x7f2e4c03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:59.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.411+0000 7f2e62000640 1 -- 172.21.15.1:0/3828975898 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2e5806cff0 con 0x7f2e64107640 2024-09-15T22:15:59.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.412+0000 7f2e69200640 1 --2- 172.21.15.1:0/3828975898 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2e4c0392a0 0x7f2e4c03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:59.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.412+0000 7f2e69200640 1 --2- 172.21.15.1:0/3828975898 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2e4c0392a0 0x7f2e4c03b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2e500098c0 tx=0x7f2e50006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:59.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.417+0000 7f2e62000640 1 -- 172.21.15.1:0/3828975898 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2e58030d60 con 0x7f2e64107640 2024-09-15T22:15:59.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.608+0000 7f2e6c600640 1 -- 172.21.15.1:0/3828975898 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2e6419a660 con 0x7f2e4c0392a0 2024-09-15T22:15:59.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.610+0000 7f2e62000640 1 -- 172.21.15.1:0/3828975898 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+237 (secure 0 0 0) 0x7f2e6419a660 con 0x7f2e4c0392a0 2024-09-15T22:15:59.611 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:15:59.611 INFO:teuthology.orchestra.run.smithi001.stdout:[{"addr": "172.21.15.1", "hostname": "smithi001", "labels": [], "status": ""}, {"addr": "172.21.15.12", "hostname": "smithi012", "labels": [], "status": ""}, {"addr": "172.21.15.98", "hostname": "smithi098", "labels": [], "status": ""}] 2024-09-15T22:15:59.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.612+0000 7f2e6c600640 1 -- 172.21.15.1:0/3828975898 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2e4c0392a0 msgr2=0x7f2e4c03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:59.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.612+0000 7f2e6c600640 1 --2- 172.21.15.1:0/3828975898 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2e4c0392a0 0x7f2e4c03b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2e500098c0 tx=0x7f2e50006db0 comp rx=0 tx=0).stop 2024-09-15T22:15:59.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.612+0000 7f2e6c600640 1 -- 172.21.15.1:0/3828975898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e64107640 msgr2=0x7f2e64199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:59.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.612+0000 7f2e6c600640 1 --2- 172.21.15.1:0/3828975898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e64107640 0x7f2e64199300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2e58009230 tx=0x7f2e58003d80 comp rx=0 tx=0).stop 2024-09-15T22:15:59.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.612+0000 7f2e6c600640 1 -- 172.21.15.1:0/3828975898 shutdown_connections 2024-09-15T22:15:59.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.612+0000 7f2e6c600640 1 --2- 172.21.15.1:0/3828975898 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2e4c0392a0 0x7f2e4c03b760 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:59.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.612+0000 7f2e6c600640 1 --2- 172.21.15.1:0/3828975898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e64107640 0x7f2e64199300 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:59.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.612+0000 7f2e6c600640 1 -- 172.21.15.1:0/3828975898 >> 172.21.15.1:0/3828975898 conn(0x7f2e640fd230 msgr2=0x7f2e640fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:59.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.612+0000 7f2e6c600640 1 -- 172.21.15.1:0/3828975898 shutdown_connections 2024-09-15T22:15:59.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:15:59.612+0000 7f2e6c600640 1 -- 172.21.15.1:0/3828975898 wait complete. 2024-09-15T22:16:00.213 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-15T22:16:00.214 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-15T22:16:00.576 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:00.628 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:00 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:01.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:01.071+0000 7f3484200640 1 -- 172.21.15.1:0/1603579958 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f347c107660 msgr2=0x7f347c107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:01.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:01.071+0000 7f3484200640 1 --2- 172.21.15.1:0/1603579958 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f347c107660 0x7f347c107a40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3470009880 tx=0x7f347002a5d0 comp rx=0 tx=0).stop 2024-09-15T22:16:01.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:01.071+0000 7f3484200640 1 -- 172.21.15.1:0/1603579958 shutdown_connections 2024-09-15T22:16:01.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:01.071+0000 7f3484200640 1 --2- 172.21.15.1:0/1603579958 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f347c107660 0x7f347c107a40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:01.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:01.071+0000 7f3484200640 1 -- 172.21.15.1:0/1603579958 >> 172.21.15.1:0/1603579958 conn(0x7f347c0fd290 msgr2=0x7f347c0ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:01.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:01.071+0000 7f3484200640 1 -- 172.21.15.1:0/1603579958 shutdown_connections 2024-09-15T22:16:01.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:01.071+0000 7f3484200640 1 -- 172.21.15.1:0/1603579958 wait complete. 2024-09-15T22:16:01.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:01.072+0000 7f3484200640 1 Processor -- start 2024-09-15T22:16:01.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:01.072+0000 7f3484200640 1 -- start start 2024-09-15T22:16:01.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:01.072+0000 7f3484200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f347c107660 0x7f347c199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:01.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:01.073+0000 7f3484200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f347c10bc90 con 0x7f347c107660 2024-09-15T22:16:01.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:01.073+0000 7f3481800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f347c107660 0x7f347c199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:01.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:01.073+0000 7f3481800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f347c107660 0x7f347c199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51136/0 (socket says 172.21.15.1:51136) 2024-09-15T22:16:01.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:01.073+0000 7f3481800640 1 -- 172.21.15.1:0/2421605381 learned_addr learned my addr 172.21.15.1:0/2421605381 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:16:01.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:01.073+0000 7f3481800640 1 -- 172.21.15.1:0/2421605381 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f347c199860 con 0x7f347c107660 2024-09-15T22:16:01.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:01.073+0000 7f3481800640 1 --2- 172.21.15.1:0/2421605381 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f347c107660 0x7f347c199320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3470009230 tx=0x7f3470003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:01.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:01.074+0000 7f347a000640 1 -- 172.21.15.1:0/2421605381 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f347003f070 con 0x7f347c107660 2024-09-15T22:16:01.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:01.074+0000 7f347a000640 1 -- 172.21.15.1:0/2421605381 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f347003bd40 con 0x7f347c107660 2024-09-15T22:16:01.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:01.074+0000 7f3484200640 1 -- 172.21.15.1:0/2421605381 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f347c199af0 con 0x7f347c107660 2024-09-15T22:16:01.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:01.074+0000 7f347a000640 1 -- 172.21.15.1:0/2421605381 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3470035030 con 0x7f347c107660 2024-09-15T22:16:01.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:01.074+0000 7f3484200640 1 -- 172.21.15.1:0/2421605381 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f347c19dbf0 con 0x7f347c107660 2024-09-15T22:16:01.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:01.075+0000 7f347a000640 1 -- 172.21.15.1:0/2421605381 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f3470042070 con 0x7f347c107660 2024-09-15T22:16:01.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:01.075+0000 7f3484200640 1 -- 172.21.15.1:0/2421605381 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f347c102cd0 con 0x7f347c107660 2024-09-15T22:16:01.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:01.075+0000 7f347a000640 1 --2- 172.21.15.1:0/2421605381 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f34640392a0 0x7f346403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:01.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:01.076+0000 7f347a000640 1 -- 172.21.15.1:0/2421605381 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f347006d010 con 0x7f347c107660 2024-09-15T22:16:01.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:01.076+0000 7f3480e00640 1 --2- 172.21.15.1:0/2421605381 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f34640392a0 0x7f346403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:01.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:01.076+0000 7f3480e00640 1 --2- 172.21.15.1:0/2421605381 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f34640392a0 0x7f346403b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f34680098c0 tx=0x7f3468006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:01.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:01.081+0000 7f347a000640 1 -- 172.21.15.1:0/2421605381 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3470030d60 con 0x7f347c107660 2024-09-15T22:16:01.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:01.271+0000 7f3484200640 1 -- 172.21.15.1:0/2421605381 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f347c107ac0 con 0x7f347c107660 2024-09-15T22:16:01.273 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:01 smithi001 ceph-mon[30843]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:01.273 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:01 smithi001 ceph-mon[30843]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:16:02.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:02.201+0000 7f347a000640 1 -- 172.21.15.1:0/2421605381 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f347003b860 con 0x7f347c107660 2024-09-15T22:16:02.203 INFO:teuthology.orchestra.run.smithi001.stderr:adjusted tunables profile to default 2024-09-15T22:16:02.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:02.204+0000 7f3484200640 1 -- 172.21.15.1:0/2421605381 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f34640392a0 msgr2=0x7f346403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:02.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:02.204+0000 7f3484200640 1 --2- 172.21.15.1:0/2421605381 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f34640392a0 0x7f346403b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f34680098c0 tx=0x7f3468006db0 comp rx=0 tx=0).stop 2024-09-15T22:16:02.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:02.204+0000 7f3484200640 1 -- 172.21.15.1:0/2421605381 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f347c107660 msgr2=0x7f347c199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:02.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:02.204+0000 7f3484200640 1 --2- 172.21.15.1:0/2421605381 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f347c107660 0x7f347c199320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3470009230 tx=0x7f3470003d80 comp rx=0 tx=0).stop 2024-09-15T22:16:02.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:02.205+0000 7f3484200640 1 -- 172.21.15.1:0/2421605381 shutdown_connections 2024-09-15T22:16:02.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:02.205+0000 7f3484200640 1 --2- 172.21.15.1:0/2421605381 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f34640392a0 0x7f346403b760 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:02.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:02.205+0000 7f3484200640 1 --2- 172.21.15.1:0/2421605381 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f347c107660 0x7f347c199320 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:02.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:02.205+0000 7f3484200640 1 -- 172.21.15.1:0/2421605381 >> 172.21.15.1:0/2421605381 conn(0x7f347c0fd290 msgr2=0x7f347c075e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:02.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:02.205+0000 7f3484200640 1 -- 172.21.15.1:0/2421605381 shutdown_connections 2024-09-15T22:16:02.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:02.205+0000 7f3484200640 1 -- 172.21.15.1:0/2421605381 wait complete. 2024-09-15T22:16:02.514 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:02 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/2421605381' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-15T22:16:02.514 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:02 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:02.514 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:02 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:02.514 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:02 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:02.514 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:02 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:02.514 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:02 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi098", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:02.514 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:02 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:02.514 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:02 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:02.918 INFO:tasks.cephadm:Adding mon.a on smithi001 2024-09-15T22:16:02.919 INFO:tasks.cephadm:Adding mon.b on smithi012 2024-09-15T22:16:02.919 INFO:tasks.cephadm:Adding mon.c on smithi098 2024-09-15T22:16:02.919 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi001:172.21.15.1=a;smithi012:172.21.15.12=b;smithi098:172.21.15.98=c' 2024-09-15T22:16:03.165 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:16:03.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.579+0000 7f22a7b5a640 1 -- 172.21.15.98:0/457166970 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22a0102750 msgr2=0x7f22a0102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:03.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.579+0000 7f22a7b5a640 1 --2- 172.21.15.98:0/457166970 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22a0102750 0x7f22a0102b30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f229c009880 tx=0x7f229c02a670 comp rx=0 tx=0).stop 2024-09-15T22:16:03.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.579+0000 7f22a7b5a640 1 -- 172.21.15.98:0/457166970 shutdown_connections 2024-09-15T22:16:03.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.579+0000 7f22a7b5a640 1 --2- 172.21.15.98:0/457166970 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22a0102750 0x7f22a0102b30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:03.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.579+0000 7f22a7b5a640 1 -- 172.21.15.98:0/457166970 >> 172.21.15.98:0/457166970 conn(0x7f22a00fc1b0 msgr2=0x7f22a00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:03.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.579+0000 7f22a7b5a640 1 -- 172.21.15.98:0/457166970 shutdown_connections 2024-09-15T22:16:03.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.579+0000 7f22a7b5a640 1 -- 172.21.15.98:0/457166970 wait complete. 2024-09-15T22:16:03.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.580+0000 7f22a7b5a640 1 Processor -- start 2024-09-15T22:16:03.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.580+0000 7f22a7b5a640 1 -- start start 2024-09-15T22:16:03.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.580+0000 7f22a7b5a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22a0102750 0x7f22a01003b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:03.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.580+0000 7f22a7b5a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f22a010bcc0 con 0x7f22a0102750 2024-09-15T22:16:03.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.581+0000 7f22a58f6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22a0102750 0x7f22a01003b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:03.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.581+0000 7f22a58f6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22a0102750 0x7f22a01003b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.98:36514/0 (socket says 172.21.15.98:36514) 2024-09-15T22:16:03.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.581+0000 7f22a58f6640 1 -- 172.21.15.98:0/2999951171 learned_addr learned my addr 172.21.15.98:0/2999951171 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-15T22:16:03.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.581+0000 7f22a58f6640 1 -- 172.21.15.98:0/2999951171 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a0101ff0 con 0x7f22a0102750 2024-09-15T22:16:03.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.582+0000 7f22a58f6640 1 --2- 172.21.15.98:0/2999951171 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22a0102750 0x7f22a01003b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f229c009230 tx=0x7f229c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:03.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.582+0000 7f2296ffd640 1 -- 172.21.15.98:0/2999951171 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f229c03f070 con 0x7f22a0102750 2024-09-15T22:16:03.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.582+0000 7f2296ffd640 1 -- 172.21.15.98:0/2999951171 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f229c03bc80 con 0x7f22a0102750 2024-09-15T22:16:03.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.582+0000 7f22a7b5a640 1 -- 172.21.15.98:0/2999951171 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22a0102280 con 0x7f22a0102750 2024-09-15T22:16:03.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.582+0000 7f2296ffd640 1 -- 172.21.15.98:0/2999951171 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f229c035030 con 0x7f22a0102750 2024-09-15T22:16:03.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.582+0000 7f22a7b5a640 1 -- 172.21.15.98:0/2999951171 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22a0100ac0 con 0x7f22a0102750 2024-09-15T22:16:03.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.583+0000 7f2296ffd640 1 -- 172.21.15.98:0/2999951171 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f229c042070 con 0x7f22a0102750 2024-09-15T22:16:03.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.583+0000 7f22a7b5a640 1 -- 172.21.15.98:0/2999951171 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22a006a7b0 con 0x7f22a0102750 2024-09-15T22:16:03.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.583+0000 7f2296ffd640 1 --2- 172.21.15.98:0/2999951171 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f228c039300 0x7f228c03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:03.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.583+0000 7f2296ffd640 1 -- 172.21.15.98:0/2999951171 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f229c06cfe0 con 0x7f22a0102750 2024-09-15T22:16:03.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.583+0000 7f22a50f5640 1 --2- 172.21.15.98:0/2999951171 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f228c039300 0x7f228c03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:03.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.584+0000 7f22a50f5640 1 --2- 172.21.15.98:0/2999951171 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f228c039300 0x7f228c03b7c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f22900098c0 tx=0x7f2290006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:03.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.588+0000 7f2296ffd640 1 -- 172.21.15.98:0/2999951171 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f229c0314c0 con 0x7f22a0102750 2024-09-15T22:16:03.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:03 smithi001 ceph-mon[30843]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:03.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:03 smithi001 ceph-mon[30843]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-15T22:16:03.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:03 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/2421605381' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-15T22:16:03.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:03 smithi001 ceph-mon[30843]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:16:03.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:03 smithi001 ceph-mon[30843]: Updating smithi098:/var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:16:03.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:03 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:03.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:03 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:03.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:03 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:03.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.772+0000 7f22a7b5a640 1 -- 172.21.15.98:0/2999951171 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi001:172.21.15.1=a;smithi012:172.21.15.12=b;smithi098:172.21.15.98=c", "target": ["mon-mgr", ""]}) -- 0x7f22a01018e0 con 0x7f228c039300 2024-09-15T22:16:03.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.778+0000 7f2296ffd640 1 -- 172.21.15.98:0/2999951171 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f22a01018e0 con 0x7f228c039300 2024-09-15T22:16:03.780 INFO:teuthology.orchestra.run.smithi098.stdout:Scheduled mon update... 2024-09-15T22:16:03.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.780+0000 7f22a7b5a640 1 -- 172.21.15.98:0/2999951171 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f228c039300 msgr2=0x7f228c03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:03.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.780+0000 7f22a7b5a640 1 --2- 172.21.15.98:0/2999951171 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f228c039300 0x7f228c03b7c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f22900098c0 tx=0x7f2290006db0 comp rx=0 tx=0).stop 2024-09-15T22:16:03.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.780+0000 7f22a7b5a640 1 -- 172.21.15.98:0/2999951171 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22a0102750 msgr2=0x7f22a01003b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:03.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.780+0000 7f22a7b5a640 1 --2- 172.21.15.98:0/2999951171 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22a0102750 0x7f22a01003b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f229c009230 tx=0x7f229c003d40 comp rx=0 tx=0).stop 2024-09-15T22:16:03.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.780+0000 7f22a7b5a640 1 -- 172.21.15.98:0/2999951171 shutdown_connections 2024-09-15T22:16:03.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.780+0000 7f22a7b5a640 1 --2- 172.21.15.98:0/2999951171 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f228c039300 0x7f228c03b7c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:03.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.780+0000 7f22a7b5a640 1 --2- 172.21.15.98:0/2999951171 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22a0102750 0x7f22a01003b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:03.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.780+0000 7f22a7b5a640 1 -- 172.21.15.98:0/2999951171 >> 172.21.15.98:0/2999951171 conn(0x7f22a00fc1b0 msgr2=0x7f22a0105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:03.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.780+0000 7f22a7b5a640 1 -- 172.21.15.98:0/2999951171 shutdown_connections 2024-09-15T22:16:03.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:03.780+0000 7f22a7b5a640 1 -- 172.21.15.98:0/2999951171 wait complete. 2024-09-15T22:16:04.392 DEBUG:teuthology.orchestra.run.smithi012:mon.b> sudo journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mon.b.service 2024-09-15T22:16:04.396 DEBUG:teuthology.orchestra.run.smithi098:mon.c> sudo journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mon.c.service 2024-09-15T22:16:04.398 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-15T22:16:04.398 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-15T22:16:04.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:04 smithi001 ceph-mon[30843]: Updating smithi098:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:16:04.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:04 smithi001 ceph-mon[30843]: Updating smithi098:/var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:16:04.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:04 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:04.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:04 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:04.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:04 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:04.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:04 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:04.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:04 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:04.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:04 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:16:04.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:04 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:05.446 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:16:05.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:05 smithi001 ceph-mon[30843]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:05.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:05 smithi001 ceph-mon[30843]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi001:172.21.15.1=a;smithi012:172.21.15.12=b;smithi098:172.21.15.98=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:16:05.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:05 smithi001 ceph-mon[30843]: Saving service mon spec with placement smithi001:172.21.15.1=a;smithi012:172.21.15.12=b;smithi098:172.21.15.98=c;count:3 2024-09-15T22:16:05.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:05 smithi001 ceph-mon[30843]: Deploying daemon mon.c on smithi098 2024-09-15T22:16:06.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.486+0000 7ff4d2d11640 1 -- 172.21.15.98:0/1029702105 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4cc107660 msgr2=0x7ff4cc107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:06.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.486+0000 7ff4d2d11640 1 --2- 172.21.15.98:0/1029702105 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4cc107660 0x7ff4cc107a40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0009880 tx=0x7ff4c002a5d0 comp rx=0 tx=0).stop 2024-09-15T22:16:06.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.486+0000 7ff4d2d11640 1 -- 172.21.15.98:0/1029702105 shutdown_connections 2024-09-15T22:16:06.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.486+0000 7ff4d2d11640 1 --2- 172.21.15.98:0/1029702105 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4cc107660 0x7ff4cc107a40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:06.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.486+0000 7ff4d2d11640 1 -- 172.21.15.98:0/1029702105 >> 172.21.15.98:0/1029702105 conn(0x7ff4cc0fd290 msgr2=0x7ff4cc0ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:06.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.486+0000 7ff4d2d11640 1 -- 172.21.15.98:0/1029702105 shutdown_connections 2024-09-15T22:16:06.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.486+0000 7ff4d2d11640 1 -- 172.21.15.98:0/1029702105 wait complete. 2024-09-15T22:16:06.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.486+0000 7ff4d2d11640 1 Processor -- start 2024-09-15T22:16:06.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.486+0000 7ff4d2d11640 1 -- start start 2024-09-15T22:16:06.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.487+0000 7ff4d2d11640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4cc107660 0x7ff4cc197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:06.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.487+0000 7ff4d2d11640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff4cc10bc90 con 0x7ff4cc107660 2024-09-15T22:16:06.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.487+0000 7ff4d0aad640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4cc107660 0x7ff4cc197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:06.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.487+0000 7ff4d0aad640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4cc107660 0x7ff4cc197130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.98:36534/0 (socket says 172.21.15.98:36534) 2024-09-15T22:16:06.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.487+0000 7ff4d0aad640 1 -- 172.21.15.98:0/2127210862 learned_addr learned my addr 172.21.15.98:0/2127210862 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-15T22:16:06.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.487+0000 7ff4d0aad640 1 -- 172.21.15.98:0/2127210862 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4cc197670 con 0x7ff4cc107660 2024-09-15T22:16:06.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.488+0000 7ff4d0aad640 1 --2- 172.21.15.98:0/2127210862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4cc107660 0x7ff4cc197130 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0009230 tx=0x7ff4c0003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:06.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.488+0000 7ff4c9ffb640 1 -- 172.21.15.98:0/2127210862 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4c003f070 con 0x7ff4cc107660 2024-09-15T22:16:06.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.488+0000 7ff4d2d11640 1 -- 172.21.15.98:0/2127210862 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4cc197900 con 0x7ff4cc107660 2024-09-15T22:16:06.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.488+0000 7ff4c9ffb640 1 -- 172.21.15.98:0/2127210862 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4c003bc80 con 0x7ff4cc107660 2024-09-15T22:16:06.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.488+0000 7ff4c9ffb640 1 -- 172.21.15.98:0/2127210862 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4c0035030 con 0x7ff4cc107660 2024-09-15T22:16:06.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.488+0000 7ff4d2d11640 1 -- 172.21.15.98:0/2127210862 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4cc19ba00 con 0x7ff4cc107660 2024-09-15T22:16:06.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.489+0000 7ff4c9ffb640 1 -- 172.21.15.98:0/2127210862 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7ff4c0042070 con 0x7ff4cc107660 2024-09-15T22:16:06.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.489+0000 7ff4d2d11640 1 -- 172.21.15.98:0/2127210862 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4cc102cd0 con 0x7ff4cc107660 2024-09-15T22:16:06.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.489+0000 7ff4c9ffb640 1 --2- 172.21.15.98:0/2127210862 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ff4bc0392a0 0x7ff4bc03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:06.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.489+0000 7ff4c9ffb640 1 -- 172.21.15.98:0/2127210862 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff4c006d0b0 con 0x7ff4cc107660 2024-09-15T22:16:06.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.490+0000 7ff4cbfff640 1 --2- 172.21.15.98:0/2127210862 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ff4bc0392a0 0x7ff4bc03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:06.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.490+0000 7ff4cbfff640 1 --2- 172.21.15.98:0/2127210862 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ff4bc0392a0 0x7ff4bc03b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff4b80098c0 tx=0x7ff4b8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:06.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.495+0000 7ff4c9ffb640 1 -- 172.21.15.98:0/2127210862 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff4c0031e20 con 0x7ff4cc107660 2024-09-15T22:16:06.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.730+0000 7ff4d2d11640 1 -- 172.21.15.98:0/2127210862 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7ff4cc198490 con 0x7ff4cc107660 2024-09-15T22:16:06.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.730+0000 7ff4c9ffb640 1 -- 172.21.15.98:0/2127210862 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+741 (secure 0 0 0) 0x7ff4c0031570 con 0x7ff4cc107660 2024-09-15T22:16:06.732 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-15T22:16:06.733 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":1,"fsid":"c1228c44-73af-11ef-bceb-c7b262605968","modified":"2024-09-15T22:14:35.299044Z","created":"2024-09-15T22:14:35.299044Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:3300","nonce":0},{"type":"v1","addr":"172.21.15.1:6789","nonce":0}]},"addr":"172.21.15.1:6789/0","public_addr":"172.21.15.1:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-15T22:16:06.733 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 1 2024-09-15T22:16:06.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.733+0000 7ff4d2d11640 1 -- 172.21.15.98:0/2127210862 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ff4bc0392a0 msgr2=0x7ff4bc03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:06.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.733+0000 7ff4d2d11640 1 --2- 172.21.15.98:0/2127210862 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ff4bc0392a0 0x7ff4bc03b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff4b80098c0 tx=0x7ff4b8006db0 comp rx=0 tx=0).stop 2024-09-15T22:16:06.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.733+0000 7ff4d2d11640 1 -- 172.21.15.98:0/2127210862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4cc107660 msgr2=0x7ff4cc197130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:06.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.733+0000 7ff4d2d11640 1 --2- 172.21.15.98:0/2127210862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4cc107660 0x7ff4cc197130 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0009230 tx=0x7ff4c0003d40 comp rx=0 tx=0).stop 2024-09-15T22:16:06.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.733+0000 7ff4d2d11640 1 -- 172.21.15.98:0/2127210862 shutdown_connections 2024-09-15T22:16:06.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.733+0000 7ff4d2d11640 1 --2- 172.21.15.98:0/2127210862 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ff4bc0392a0 0x7ff4bc03b760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:06.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.733+0000 7ff4d2d11640 1 --2- 172.21.15.98:0/2127210862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4cc107660 0x7ff4cc197130 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:06.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.733+0000 7ff4d2d11640 1 -- 172.21.15.98:0/2127210862 >> 172.21.15.98:0/2127210862 conn(0x7ff4cc0fd290 msgr2=0x7ff4cc0feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:06.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.733+0000 7ff4d2d11640 1 -- 172.21.15.98:0/2127210862 shutdown_connections 2024-09-15T22:16:06.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:06.733+0000 7ff4d2d11640 1 -- 172.21.15.98:0/2127210862 wait complete. 2024-09-15T22:16:07.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:07 smithi001 ceph-mon[30843]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:07.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:07 smithi001 ceph-mon[30843]: from='client.? 172.21.15.98:0/2127210862' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:16:08.768 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-15T22:16:08.769 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-15T22:16:08.793 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:08 smithi098 systemd[1]: Started Ceph mon.c for c1228c44-73af-11ef-bceb-c7b262605968. 2024-09-15T22:16:09.025 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:16:13.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.832+0000 7fc4ad932640 1 -- 172.21.15.98:0/4165149564 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc490003530 msgr2=0x7fc4900059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:13.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.832+0000 7fc4ad932640 1 --2- 172.21.15.98:0/4165149564 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc490003530 0x7fc4900059c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc4a81016e0 tx=0x7fc49802c490 comp rx=0 tx=0).stop 2024-09-15T22:16:13.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.832+0000 7fc4ad932640 1 -- 172.21.15.98:0/4165149564 shutdown_connections 2024-09-15T22:16:13.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.832+0000 7fc4ad932640 1 --2- 172.21.15.98:0/4165149564 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc490003530 0x7fc4900059c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:13.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.832+0000 7fc4ad932640 1 -- 172.21.15.98:0/4165149564 >> 172.21.15.98:0/4165149564 conn(0x7fc4a80fc2c0 msgr2=0x7fc4a80fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:13.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.832+0000 7fc4ad932640 1 -- 172.21.15.98:0/4165149564 shutdown_connections 2024-09-15T22:16:13.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.832+0000 7fc4ad932640 1 -- 172.21.15.98:0/4165149564 wait complete. 2024-09-15T22:16:13.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.833+0000 7fc4ad932640 1 Processor -- start 2024-09-15T22:16:13.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.833+0000 7fc4ad932640 1 -- start start 2024-09-15T22:16:13.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.833+0000 7fc4ad932640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc490003530 0x7fc4a81972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:13.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.833+0000 7fc4ad932640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4a81977f0 0x7fc4a819bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:13.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.833+0000 7fc4ad932640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a81086b0 con 0x7fc490003530 2024-09-15T22:16:13.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.833+0000 7fc4ad932640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a8108530 con 0x7fc4a81977f0 2024-09-15T22:16:13.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.834+0000 7fc4a67fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4a81977f0 0x7fc4a819bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:13.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.834+0000 7fc4a67fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4a81977f0 0x7fc4a819bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56412/0 (socket says 172.21.15.98:56412) 2024-09-15T22:16:13.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.834+0000 7fc4a67fc640 1 -- 172.21.15.98:0/2163557388 learned_addr learned my addr 172.21.15.98:0/2163557388 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-15T22:16:13.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.834+0000 7fc4a67fc640 1 -- 172.21.15.98:0/2163557388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4a81977f0 msgr2=0x7fc4a819bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-15T22:16:13.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.834+0000 7fc4a67fc640 1 -- 172.21.15.98:0/2163557388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4a81977f0 msgr2=0x7fc4a819bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-15T22:16:13.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.834+0000 7fc4a67fc640 1 --2- 172.21.15.98:0/2163557388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4a81977f0 0x7fc4a819bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:16:13.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.834+0000 7fc4a6ffd640 1 --2- 172.21.15.98:0/2163557388 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc490003530 0x7fc4a81972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:13.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.834+0000 7fc4a67fc640 1 --2- 172.21.15.98:0/2163557388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4a81977f0 0x7fc4a819bb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:16:13.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.834+0000 7fc4a6ffd640 1 -- 172.21.15.98:0/2163557388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4a81977f0 msgr2=0x7fc4a819bb80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:16:13.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.834+0000 7fc4a6ffd640 1 --2- 172.21.15.98:0/2163557388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4a81977f0 0x7fc4a819bb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:13.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.834+0000 7fc4a6ffd640 1 -- 172.21.15.98:0/2163557388 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4a8197e10 con 0x7fc490003530 2024-09-15T22:16:13.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.834+0000 7fc4a6ffd640 1 --2- 172.21.15.98:0/2163557388 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc490003530 0x7fc4a81972b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc498005f30 tx=0x7fc498033680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:13.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.835+0000 7fc4ac930640 1 -- 172.21.15.98:0/2163557388 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fc498038040 con 0x7fc490003530 2024-09-15T22:16:13.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.835+0000 7fc4ad932640 1 -- 172.21.15.98:0/2163557388 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4a819c0c0 con 0x7fc490003530 2024-09-15T22:16:13.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.835+0000 7fc4ac930640 1 -- 172.21.15.98:0/2163557388 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc498032e00 con 0x7fc490003530 2024-09-15T22:16:13.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.835+0000 7fc4ac930640 1 -- 172.21.15.98:0/2163557388 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fc498004a00 con 0x7fc490003530 2024-09-15T22:16:13.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.835+0000 7fc4ad932640 1 -- 172.21.15.98:0/2163557388 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4a819c680 con 0x7fc490003530 2024-09-15T22:16:13.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.836+0000 7fc4ac930640 1 -- 172.21.15.98:0/2163557388 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fc498043020 con 0x7fc490003530 2024-09-15T22:16:13.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.836+0000 7fc4ad932640 1 -- 172.21.15.98:0/2163557388 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4a8101ce0 con 0x7fc490003530 2024-09-15T22:16:13.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.836+0000 7fc4ac930640 1 --2- 172.21.15.98:0/2163557388 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc494039090 0x7fc49403b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:13.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.836+0000 7fc4ac930640 1 -- 172.21.15.98:0/2163557388 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc49806e590 con 0x7fc490003530 2024-09-15T22:16:13.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.837+0000 7fc4a67fc640 1 --2- 172.21.15.98:0/2163557388 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc494039090 0x7fc49403b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:13.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.837+0000 7fc4a67fc640 1 --2- 172.21.15.98:0/2163557388 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc494039090 0x7fc49403b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc49c009100 tx=0x7fc49c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:13.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:13.841+0000 7fc4ac930640 1 -- 172.21.15.98:0/2163557388 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc49804a020 con 0x7fc490003530 2024-09-15T22:16:14.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:13 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:16:14.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:13 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:16:14.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:13 smithi098 ceph-mon[35514]: mon.a calling monitor election 2024-09-15T22:16:14.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:13 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:16:14.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:13 smithi098 ceph-mon[35514]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:14.062 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:13 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:16:14.062 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:13 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:16:14.062 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:13 smithi098 ceph-mon[35514]: mon.c calling monitor election 2024-09-15T22:16:14.062 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:13 smithi098 ceph-mon[35514]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:14.062 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:13 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:16:14.062 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:13 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:16:14.062 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:13 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:16:14.062 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:13 smithi098 ceph-mon[35514]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T22:16:14.062 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:13 smithi098 ceph-mon[35514]: monmap epoch 2 2024-09-15T22:16:14.062 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:13 smithi098 ceph-mon[35514]: fsid c1228c44-73af-11ef-bceb-c7b262605968 2024-09-15T22:16:14.062 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:13 smithi098 ceph-mon[35514]: last_changed 2024-09-15T22:16:08.652756+0000 2024-09-15T22:16:14.062 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:13 smithi098 ceph-mon[35514]: created 2024-09-15T22:14:35.299044+0000 2024-09-15T22:16:14.063 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:13 smithi098 ceph-mon[35514]: min_mon_release 19 (squid) 2024-09-15T22:16:14.063 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:13 smithi098 ceph-mon[35514]: election_strategy: 1 2024-09-15T22:16:14.063 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:13 smithi098 ceph-mon[35514]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-15T22:16:14.063 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:13 smithi098 ceph-mon[35514]: 1: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.c 2024-09-15T22:16:14.063 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:13 smithi098 ceph-mon[35514]: fsmap 2024-09-15T22:16:14.063 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:13 smithi098 ceph-mon[35514]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:16:14.063 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:13 smithi098 ceph-mon[35514]: mgrmap e13: x(active, since 42s) 2024-09-15T22:16:14.063 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:13 smithi098 ceph-mon[35514]: overall HEALTH_OK 2024-09-15T22:16:14.063 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:13 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:14.063 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:13 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:14.063 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:13 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:14.063 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:13 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:16:14.063 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:13 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:14.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:14.074+0000 7fc4ad932640 1 -- 172.21.15.98:0/2163557388 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fc4a819c930 con 0x7fc490003530 2024-09-15T22:16:14.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:14.075+0000 7fc4ac930640 1 -- 172.21.15.98:0/2163557388 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1007 (secure 0 0 0) 0x7fc498039250 con 0x7fc490003530 2024-09-15T22:16:14.077 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-15T22:16:14.078 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":2,"fsid":"c1228c44-73af-11ef-bceb-c7b262605968","modified":"2024-09-15T22:16:08.652756Z","created":"2024-09-15T22:14:35.299044Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:3300","nonce":0},{"type":"v1","addr":"172.21.15.1:6789","nonce":0}]},"addr":"172.21.15.1:6789/0","public_addr":"172.21.15.1:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:3300","nonce":0},{"type":"v1","addr":"172.21.15.98:6789","nonce":0}]},"addr":"172.21.15.98:6789/0","public_addr":"172.21.15.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-15T22:16:14.078 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 2 2024-09-15T22:16:14.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:14.078+0000 7fc4ad932640 1 -- 172.21.15.98:0/2163557388 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc494039090 msgr2=0x7fc49403b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:14.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:14.078+0000 7fc4ad932640 1 --2- 172.21.15.98:0/2163557388 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc494039090 0x7fc49403b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc49c009100 tx=0x7fc49c008040 comp rx=0 tx=0).stop 2024-09-15T22:16:14.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:14.078+0000 7fc4ad932640 1 -- 172.21.15.98:0/2163557388 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc490003530 msgr2=0x7fc4a81972b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:14.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:14.078+0000 7fc4ad932640 1 --2- 172.21.15.98:0/2163557388 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc490003530 0x7fc4a81972b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc498005f30 tx=0x7fc498033680 comp rx=0 tx=0).stop 2024-09-15T22:16:14.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:14.078+0000 7fc4ad932640 1 -- 172.21.15.98:0/2163557388 shutdown_connections 2024-09-15T22:16:14.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:14.078+0000 7fc4ad932640 1 --2- 172.21.15.98:0/2163557388 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc494039090 0x7fc49403b550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:14.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:14.078+0000 7fc4ad932640 1 --2- 172.21.15.98:0/2163557388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4a81977f0 0x7fc4a819bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:14.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:14.078+0000 7fc4ad932640 1 --2- 172.21.15.98:0/2163557388 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc490003530 0x7fc4a81972b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:14.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:14.078+0000 7fc4ad932640 1 -- 172.21.15.98:0/2163557388 >> 172.21.15.98:0/2163557388 conn(0x7fc4a80fc2c0 msgr2=0x7fc4a806a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:14.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:14.079+0000 7fc4ad932640 1 -- 172.21.15.98:0/2163557388 shutdown_connections 2024-09-15T22:16:14.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:14.079+0000 7fc4ad932640 1 -- 172.21.15.98:0/2163557388 wait complete. 2024-09-15T22:16:14.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:13 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:16:14.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:13 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:16:14.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:13 smithi001 ceph-mon[30843]: mon.a calling monitor election 2024-09-15T22:16:14.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:13 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:16:14.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:13 smithi001 ceph-mon[30843]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:14.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:13 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:16:14.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:13 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:16:14.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:13 smithi001 ceph-mon[30843]: mon.c calling monitor election 2024-09-15T22:16:14.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:13 smithi001 ceph-mon[30843]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:14.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:13 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:16:14.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:13 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:16:14.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:13 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:16:14.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:13 smithi001 ceph-mon[30843]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T22:16:14.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:13 smithi001 ceph-mon[30843]: monmap epoch 2 2024-09-15T22:16:14.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:13 smithi001 ceph-mon[30843]: fsid c1228c44-73af-11ef-bceb-c7b262605968 2024-09-15T22:16:14.128 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:13 smithi001 ceph-mon[30843]: last_changed 2024-09-15T22:16:08.652756+0000 2024-09-15T22:16:14.128 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:13 smithi001 ceph-mon[30843]: created 2024-09-15T22:14:35.299044+0000 2024-09-15T22:16:14.128 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:13 smithi001 ceph-mon[30843]: min_mon_release 19 (squid) 2024-09-15T22:16:14.128 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:13 smithi001 ceph-mon[30843]: election_strategy: 1 2024-09-15T22:16:14.128 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:13 smithi001 ceph-mon[30843]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-15T22:16:14.128 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:13 smithi001 ceph-mon[30843]: 1: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.c 2024-09-15T22:16:14.128 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:13 smithi001 ceph-mon[30843]: fsmap 2024-09-15T22:16:14.128 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:13 smithi001 ceph-mon[30843]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:16:14.128 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:13 smithi001 ceph-mon[30843]: mgrmap e13: x(active, since 42s) 2024-09-15T22:16:14.128 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:13 smithi001 ceph-mon[30843]: overall HEALTH_OK 2024-09-15T22:16:14.128 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:13 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:14.128 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:13 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:14.128 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:13 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:14.128 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:13 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:16:14.128 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:13 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:14.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:14 smithi001 ceph-mon[30843]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:14.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:14 smithi001 ceph-mon[30843]: Deploying daemon mon.b on smithi012 2024-09-15T22:16:14.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:14 smithi001 ceph-mon[30843]: from='client.? 172.21.15.98:0/2163557388' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:16:14.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:14 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:16:15.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:14 smithi098 ceph-mon[35514]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:15.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:14 smithi098 ceph-mon[35514]: Deploying daemon mon.b on smithi012 2024-09-15T22:16:15.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:14 smithi098 ceph-mon[35514]: from='client.? 172.21.15.98:0/2163557388' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:16:15.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:14 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:16:15.714 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-15T22:16:15.714 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-15T22:16:15.876 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:16:15 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:16:15.652+0000 7f8069e00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-15T22:16:15.962 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:16:16.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.332+0000 7f2025ebb640 1 -- 172.21.15.98:0/1294446990 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2020107680 msgr2=0x7f2020107a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:16.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.332+0000 7f2025ebb640 1 --2- 172.21.15.98:0/1294446990 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2020107680 0x7f2020107a60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2010009880 tx=0x7f201002a5d0 comp rx=0 tx=0).stop 2024-09-15T22:16:16.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.332+0000 7f2025ebb640 1 -- 172.21.15.98:0/1294446990 shutdown_connections 2024-09-15T22:16:16.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.332+0000 7f2025ebb640 1 --2- 172.21.15.98:0/1294446990 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2020107680 0x7f2020107a60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:16.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.332+0000 7f2025ebb640 1 -- 172.21.15.98:0/1294446990 >> 172.21.15.98:0/1294446990 conn(0x7f20200fd380 msgr2=0x7f20200ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:16.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.333+0000 7f2025ebb640 1 -- 172.21.15.98:0/1294446990 shutdown_connections 2024-09-15T22:16:16.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.333+0000 7f2025ebb640 1 -- 172.21.15.98:0/1294446990 wait complete. 2024-09-15T22:16:16.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.333+0000 7f2025ebb640 1 Processor -- start 2024-09-15T22:16:16.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.333+0000 7f2025ebb640 1 -- start start 2024-09-15T22:16:16.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.334+0000 7f2025ebb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2020107680 0x7f20200744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:16.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.334+0000 7f2025ebb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2020074a30 0x7f2020074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:16.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.334+0000 7f2025ebb640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f202010bd40 con 0x7f2020107680 2024-09-15T22:16:16.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.334+0000 7f2025ebb640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f202010bbc0 con 0x7f2020074a30 2024-09-15T22:16:16.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.334+0000 7f2016ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2020074a30 0x7f2020074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:16.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.334+0000 7f2016ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2020074a30 0x7f2020074e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56422/0 (socket says 172.21.15.98:56422) 2024-09-15T22:16:16.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.334+0000 7f2016ffd640 1 -- 172.21.15.98:0/3075476432 learned_addr learned my addr 172.21.15.98:0/3075476432 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-15T22:16:16.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.334+0000 7f2016ffd640 1 -- 172.21.15.98:0/3075476432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2020074a30 msgr2=0x7f2020074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-15T22:16:16.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.334+0000 7f2016ffd640 1 -- 172.21.15.98:0/3075476432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2020074a30 msgr2=0x7f2020074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-15T22:16:16.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.334+0000 7f2016ffd640 1 --2- 172.21.15.98:0/3075476432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2020074a30 0x7f2020074e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:16:16.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.334+0000 7f201f7fe640 1 --2- 172.21.15.98:0/3075476432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2020107680 0x7f20200744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:16.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.334+0000 7f2016ffd640 1 --2- 172.21.15.98:0/3075476432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2020074a30 0x7f2020074e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:16:16.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.334+0000 7f201f7fe640 1 -- 172.21.15.98:0/3075476432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2020074a30 msgr2=0x7f2020074e90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:16:16.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.334+0000 7f201f7fe640 1 --2- 172.21.15.98:0/3075476432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2020074a30 0x7f2020074e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:16.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.334+0000 7f201f7fe640 1 -- 172.21.15.98:0/3075476432 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20200763e0 con 0x7f2020107680 2024-09-15T22:16:16.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.335+0000 7f201f7fe640 1 --2- 172.21.15.98:0/3075476432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2020107680 0x7f20200744f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2010000c00 tx=0x7f2010032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:16.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.335+0000 7f201d7fa640 1 -- 172.21.15.98:0/3075476432 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f2010035070 con 0x7f2020107680 2024-09-15T22:16:16.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.335+0000 7f2025ebb640 1 -- 172.21.15.98:0/3075476432 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20201a3650 con 0x7f2020107680 2024-09-15T22:16:16.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.335+0000 7f201d7fa640 1 -- 172.21.15.98:0/3075476432 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2010032e40 con 0x7f2020107680 2024-09-15T22:16:16.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.335+0000 7f201d7fa640 1 -- 172.21.15.98:0/3075476432 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f201003bc30 con 0x7f2020107680 2024-09-15T22:16:16.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.335+0000 7f2025ebb640 1 -- 172.21.15.98:0/3075476432 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20201a3be0 con 0x7f2020107680 2024-09-15T22:16:16.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.336+0000 7f201d7fa640 1 -- 172.21.15.98:0/3075476432 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f2010042030 con 0x7f2020107680 2024-09-15T22:16:16.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.336+0000 7f2025ebb640 1 -- 172.21.15.98:0/3075476432 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2020102dc0 con 0x7f2020107680 2024-09-15T22:16:16.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.336+0000 7f201d7fa640 1 --2- 172.21.15.98:0/3075476432 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f200c039090 0x7f200c03b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:16.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.336+0000 7f201d7fa640 1 -- 172.21.15.98:0/3075476432 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2010040070 con 0x7f2020107680 2024-09-15T22:16:16.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.337+0000 7f2016ffd640 1 --2- 172.21.15.98:0/3075476432 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f200c039090 0x7f200c03b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:16.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.337+0000 7f2016ffd640 1 --2- 172.21.15.98:0/3075476432 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f200c039090 0x7f200c03b550 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2008009100 tx=0x7f2008008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:16.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.342+0000 7f201d7fa640 1 -- 172.21.15.98:0/3075476432 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2010003b80 con 0x7f2020107680 2024-09-15T22:16:16.576 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.574+0000 7f2025ebb640 1 -- 172.21.15.98:0/3075476432 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f2020107ae0 con 0x7f2020107680 2024-09-15T22:16:16.577 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.575+0000 7f201d7fa640 1 -- 172.21.15.98:0/3075476432 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1007 (secure 0 0 0) 0x7f201004a260 con 0x7f2020107680 2024-09-15T22:16:16.577 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-15T22:16:16.578 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":2,"fsid":"c1228c44-73af-11ef-bceb-c7b262605968","modified":"2024-09-15T22:16:08.652756Z","created":"2024-09-15T22:14:35.299044Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:3300","nonce":0},{"type":"v1","addr":"172.21.15.1:6789","nonce":0}]},"addr":"172.21.15.1:6789/0","public_addr":"172.21.15.1:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:3300","nonce":0},{"type":"v1","addr":"172.21.15.98:6789","nonce":0}]},"addr":"172.21.15.98:6789/0","public_addr":"172.21.15.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-15T22:16:16.578 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 2 2024-09-15T22:16:16.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.577+0000 7f2025ebb640 1 -- 172.21.15.98:0/3075476432 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f200c039090 msgr2=0x7f200c03b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:16.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.577+0000 7f2025ebb640 1 --2- 172.21.15.98:0/3075476432 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f200c039090 0x7f200c03b550 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2008009100 tx=0x7f2008008040 comp rx=0 tx=0).stop 2024-09-15T22:16:16.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.577+0000 7f2025ebb640 1 -- 172.21.15.98:0/3075476432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2020107680 msgr2=0x7f20200744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:16.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.577+0000 7f2025ebb640 1 --2- 172.21.15.98:0/3075476432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2020107680 0x7f20200744f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2010000c00 tx=0x7f2010032c50 comp rx=0 tx=0).stop 2024-09-15T22:16:16.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.578+0000 7f2025ebb640 1 -- 172.21.15.98:0/3075476432 shutdown_connections 2024-09-15T22:16:16.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.578+0000 7f2025ebb640 1 --2- 172.21.15.98:0/3075476432 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f200c039090 0x7f200c03b550 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:16.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.578+0000 7f2025ebb640 1 --2- 172.21.15.98:0/3075476432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2020074a30 0x7f2020074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:16.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.578+0000 7f2025ebb640 1 --2- 172.21.15.98:0/3075476432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2020107680 0x7f20200744f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:16.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.578+0000 7f2025ebb640 1 -- 172.21.15.98:0/3075476432 >> 172.21.15.98:0/3075476432 conn(0x7f20200fd380 msgr2=0x7f20200fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:16.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.578+0000 7f2025ebb640 1 -- 172.21.15.98:0/3075476432 shutdown_connections 2024-09-15T22:16:16.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:16.578+0000 7f2025ebb640 1 -- 172.21.15.98:0/3075476432 wait complete. 2024-09-15T22:16:16.942 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:16 smithi098 ceph-mon[35514]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:16.942 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:16 smithi098 ceph-mon[35514]: from='client.? 172.21.15.98:0/3075476432' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:16:17.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:16 smithi001 ceph-mon[30843]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:17.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:16 smithi001 ceph-mon[30843]: from='client.? 172.21.15.98:0/3075476432' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:16:17.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:17 smithi012 systemd[1]: Started Ceph mon.b for c1228c44-73af-11ef-bceb-c7b262605968. 2024-09-15T22:16:18.254 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-15T22:16:18.255 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-15T22:16:18.506 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:16:22.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.518+0000 7f2084a65640 1 -- 172.21.15.98:0/4188166489 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2068003530 msgr2=0x7f20680059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:22.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.518+0000 7f2084a65640 1 --2- 172.21.15.98:0/4188166489 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2068003530 0x7f20680059c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f20801016e0 tx=0x7f207402c3f0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.518+0000 7f2084a65640 1 -- 172.21.15.98:0/4188166489 shutdown_connections 2024-09-15T22:16:22.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.518+0000 7f2084a65640 1 --2- 172.21.15.98:0/4188166489 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2068003530 0x7f20680059c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.518+0000 7f2084a65640 1 -- 172.21.15.98:0/4188166489 >> 172.21.15.98:0/4188166489 conn(0x7f20800fc2c0 msgr2=0x7f20800fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:22.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.518+0000 7f2084a65640 1 -- 172.21.15.98:0/4188166489 shutdown_connections 2024-09-15T22:16:22.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.518+0000 7f2084a65640 1 -- 172.21.15.98:0/4188166489 wait complete. 2024-09-15T22:16:22.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.519+0000 7f2084a65640 1 Processor -- start 2024-09-15T22:16:22.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.519+0000 7f2084a65640 1 -- start start 2024-09-15T22:16:22.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.519+0000 7f2084a65640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2068003530 0x7f2080195140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:22.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.519+0000 7f2084a65640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2080195680 0x7f2080199a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:22.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.519+0000 7f2084a65640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2080199f50 0x7f208019a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:22.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.519+0000 7f2084a65640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f20801075e0 con 0x7f2068003530 2024-09-15T22:16:22.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.519+0000 7f2084a65640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2080107460 con 0x7f2080195680 2024-09-15T22:16:22.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.519+0000 7f2084a65640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2080107760 con 0x7f2080199f50 2024-09-15T22:16:22.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.519+0000 7f207ed9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2080199f50 0x7f208019a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:22.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.519+0000 7f207e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2068003530 0x7f2080195140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:22.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.519+0000 7f207ed9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2080199f50 0x7f208019a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48406/0 (socket says 172.21.15.98:48406) 2024-09-15T22:16:22.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.519+0000 7f207ed9d640 1 -- 172.21.15.98:0/2181043548 learned_addr learned my addr 172.21.15.98:0/2181043548 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-15T22:16:22.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.519+0000 7f207dd9b640 1 --2- 172.21.15.98:0/2181043548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2080195680 0x7f2080199a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:22.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.520+0000 7f207ed9d640 1 -- 172.21.15.98:0/2181043548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2080199f50 msgr2=0x7f208019a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-15T22:16:22.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.520+0000 7f207ed9d640 1 -- 172.21.15.98:0/2181043548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2080199f50 msgr2=0x7f208019a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-15T22:16:22.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.520+0000 7f207ed9d640 1 --2- 172.21.15.98:0/2181043548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2080199f50 0x7f208019a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:16:22.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.520+0000 7f207ed9d640 1 --2- 172.21.15.98:0/2181043548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2080199f50 0x7f208019a400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:16:22.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.520+0000 7f207dd9b640 1 -- 172.21.15.98:0/2181043548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2080195680 msgr2=0x7f2080199a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-15T22:16:22.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.520+0000 7f207dd9b640 1 -- 172.21.15.98:0/2181043548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2080195680 msgr2=0x7f2080199a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-15T22:16:22.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.520+0000 7f207dd9b640 1 --2- 172.21.15.98:0/2181043548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2080195680 0x7f2080199a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:16:22.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.520+0000 7f207dd9b640 1 --2- 172.21.15.98:0/2181043548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2080195680 0x7f2080199a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:16:22.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.520+0000 7f207e59c640 1 -- 172.21.15.98:0/2181043548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2080199f50 msgr2=0x7f208019a400 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:16:22.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.520+0000 7f207e59c640 1 --2- 172.21.15.98:0/2181043548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2080199f50 0x7f208019a400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.520+0000 7f207e59c640 1 -- 172.21.15.98:0/2181043548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2080195680 msgr2=0x7f2080199a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:16:22.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.520+0000 7f207e59c640 1 --2- 172.21.15.98:0/2181043548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2080195680 0x7f2080199a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.520+0000 7f207e59c640 1 -- 172.21.15.98:0/2181043548 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20801a1cc0 con 0x7f2068003530 2024-09-15T22:16:22.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.520+0000 7f207e59c640 1 --2- 172.21.15.98:0/2181043548 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2068003530 0x7f2080195140 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2074005f10 tx=0x7f20740048d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:22.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.520+0000 7f206f7fe640 1 -- 172.21.15.98:0/2181043548 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2074012450 con 0x7f2068003530 2024-09-15T22:16:22.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.520+0000 7f206f7fe640 1 -- 172.21.15.98:0/2181043548 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2074042070 con 0x7f2068003530 2024-09-15T22:16:22.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.520+0000 7f2084a65640 1 -- 172.21.15.98:0/2181043548 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20801a1e90 con 0x7f2068003530 2024-09-15T22:16:22.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.521+0000 7f206f7fe640 1 -- 172.21.15.98:0/2181043548 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207403d8f0 con 0x7f2068003530 2024-09-15T22:16:22.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.521+0000 7f2084a65640 1 -- 172.21.15.98:0/2181043548 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20801a2340 con 0x7f2068003530 2024-09-15T22:16:22.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.522+0000 7f206f7fe640 1 -- 172.21.15.98:0/2181043548 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f207403da90 con 0x7f2068003530 2024-09-15T22:16:22.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.522+0000 7f2084a65640 1 -- 172.21.15.98:0/2181043548 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20801086c0 con 0x7f2068003530 2024-09-15T22:16:22.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.522+0000 7f206f7fe640 1 --2- 172.21.15.98:0/2181043548 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f206003b940 0x7f206003de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:22.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.522+0000 7f206f7fe640 1 -- 172.21.15.98:0/2181043548 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f207406e830 con 0x7f2068003530 2024-09-15T22:16:22.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.522+0000 7f207dd9b640 1 --2- 172.21.15.98:0/2181043548 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f206003b940 0x7f206003de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:22.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.523+0000 7f207dd9b640 1 --2- 172.21.15.98:0/2181043548 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f206003b940 0x7f206003de00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2070006fd0 tx=0x7f2070008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:22.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.528+0000 7f206f7fe640 1 -- 172.21.15.98:0/2181043548 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f20740126a0 con 0x7f2068003530 2024-09-15T22:16:22.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.768+0000 7f2084a65640 1 -- 172.21.15.98:0/2181043548 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f208018ed20 con 0x7f2068003530 2024-09-15T22:16:22.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.769+0000 7f206f7fe640 1 -- 172.21.15.98:0/2181043548 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1271 (secure 0 0 0) 0x7f2074047460 con 0x7f2068003530 2024-09-15T22:16:22.771 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-15T22:16:22.772 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":3,"fsid":"c1228c44-73af-11ef-bceb-c7b262605968","modified":"2024-09-15T22:16:17.420955Z","created":"2024-09-15T22:14:35.299044Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:3300","nonce":0},{"type":"v1","addr":"172.21.15.1:6789","nonce":0}]},"addr":"172.21.15.1:6789/0","public_addr":"172.21.15.1:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:3300","nonce":0},{"type":"v1","addr":"172.21.15.98:6789","nonce":0}]},"addr":"172.21.15.98:6789/0","public_addr":"172.21.15.98:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:3300","nonce":0},{"type":"v1","addr":"172.21.15.12:6789","nonce":0}]},"addr":"172.21.15.12:6789/0","public_addr":"172.21.15.12:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-15T22:16:22.772 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 3 2024-09-15T22:16:22.773 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:22 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:16:22.773 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:22 smithi098 ceph-mon[35514]: mon.c calling monitor election 2024-09-15T22:16:22.773 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:22 smithi098 ceph-mon[35514]: mon.a calling monitor election 2024-09-15T22:16:22.773 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:22 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:16:22.773 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:22 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:16:22.773 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:22 smithi098 ceph-mon[35514]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:22.773 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:22 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:16:22.773 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:22 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:16:22.773 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:22 smithi098 ceph-mon[35514]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:22.774 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:22 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:16:22.774 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:22 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:16:22.774 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:22 smithi098 ceph-mon[35514]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:22.774 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:22 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:16:22.774 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:22 smithi098 ceph-mon[35514]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T22:16:22.774 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:22 smithi098 ceph-mon[35514]: monmap epoch 3 2024-09-15T22:16:22.774 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:22 smithi098 ceph-mon[35514]: fsid c1228c44-73af-11ef-bceb-c7b262605968 2024-09-15T22:16:22.774 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:22 smithi098 ceph-mon[35514]: last_changed 2024-09-15T22:16:17.420955+0000 2024-09-15T22:16:22.774 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:22 smithi098 ceph-mon[35514]: created 2024-09-15T22:14:35.299044+0000 2024-09-15T22:16:22.774 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:22 smithi098 ceph-mon[35514]: min_mon_release 19 (squid) 2024-09-15T22:16:22.774 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:22 smithi098 ceph-mon[35514]: election_strategy: 1 2024-09-15T22:16:22.774 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:22 smithi098 ceph-mon[35514]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-15T22:16:22.774 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:22 smithi098 ceph-mon[35514]: 1: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.c 2024-09-15T22:16:22.774 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:22 smithi098 ceph-mon[35514]: 2: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.b 2024-09-15T22:16:22.774 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:22 smithi098 ceph-mon[35514]: fsmap 2024-09-15T22:16:22.775 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:22 smithi098 ceph-mon[35514]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:16:22.775 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:22 smithi098 ceph-mon[35514]: mgrmap e13: x(active, since 50s) 2024-09-15T22:16:22.775 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:22 smithi098 ceph-mon[35514]: overall HEALTH_OK 2024-09-15T22:16:22.775 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:22 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:22.775 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:22 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:22.775 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:22 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:22.775 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:22 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:22.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.771+0000 7f2084a65640 1 -- 172.21.15.98:0/2181043548 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f206003b940 msgr2=0x7f206003de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:22.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.771+0000 7f2084a65640 1 --2- 172.21.15.98:0/2181043548 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f206003b940 0x7f206003de00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2070006fd0 tx=0x7f2070008040 comp rx=0 tx=0).stop 2024-09-15T22:16:22.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.771+0000 7f2084a65640 1 -- 172.21.15.98:0/2181043548 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2068003530 msgr2=0x7f2080195140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:22.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.771+0000 7f2084a65640 1 --2- 172.21.15.98:0/2181043548 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2068003530 0x7f2080195140 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2074005f10 tx=0x7f20740048d0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.771+0000 7f2084a65640 1 -- 172.21.15.98:0/2181043548 shutdown_connections 2024-09-15T22:16:22.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.771+0000 7f2084a65640 1 --2- 172.21.15.98:0/2181043548 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f206003b940 0x7f206003de00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.771+0000 7f2084a65640 1 --2- 172.21.15.98:0/2181043548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2080199f50 0x7f208019a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.771+0000 7f2084a65640 1 --2- 172.21.15.98:0/2181043548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2080195680 0x7f2080199a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.771+0000 7f2084a65640 1 --2- 172.21.15.98:0/2181043548 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2068003530 0x7f2080195140 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.771+0000 7f2084a65640 1 -- 172.21.15.98:0/2181043548 >> 172.21.15.98:0/2181043548 conn(0x7f20800fc2c0 msgr2=0x7f20800fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:22.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.771+0000 7f2084a65640 1 -- 172.21.15.98:0/2181043548 shutdown_connections 2024-09-15T22:16:22.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:22.771+0000 7f2084a65640 1 -- 172.21.15.98:0/2181043548 wait complete. 2024-09-15T22:16:22.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:22 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:16:22.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:22 smithi001 ceph-mon[30843]: mon.c calling monitor election 2024-09-15T22:16:22.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:22 smithi001 ceph-mon[30843]: mon.a calling monitor election 2024-09-15T22:16:22.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:22 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:16:22.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:22 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:16:22.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:22 smithi001 ceph-mon[30843]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:22.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:22 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:16:22.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:22 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:16:22.878 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:22 smithi001 ceph-mon[30843]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:22.878 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:22 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:16:22.878 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:22 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:16:22.878 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:22 smithi001 ceph-mon[30843]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:22.878 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:22 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:16:22.878 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:22 smithi001 ceph-mon[30843]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T22:16:22.878 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:22 smithi001 ceph-mon[30843]: monmap epoch 3 2024-09-15T22:16:22.878 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:22 smithi001 ceph-mon[30843]: fsid c1228c44-73af-11ef-bceb-c7b262605968 2024-09-15T22:16:22.878 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:22 smithi001 ceph-mon[30843]: last_changed 2024-09-15T22:16:17.420955+0000 2024-09-15T22:16:22.878 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:22 smithi001 ceph-mon[30843]: created 2024-09-15T22:14:35.299044+0000 2024-09-15T22:16:22.878 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:22 smithi001 ceph-mon[30843]: min_mon_release 19 (squid) 2024-09-15T22:16:22.878 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:22 smithi001 ceph-mon[30843]: election_strategy: 1 2024-09-15T22:16:22.878 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:22 smithi001 ceph-mon[30843]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-15T22:16:22.879 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:22 smithi001 ceph-mon[30843]: 1: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.c 2024-09-15T22:16:22.879 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:22 smithi001 ceph-mon[30843]: 2: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.b 2024-09-15T22:16:22.879 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:22 smithi001 ceph-mon[30843]: fsmap 2024-09-15T22:16:22.879 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:22 smithi001 ceph-mon[30843]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:16:22.879 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:22 smithi001 ceph-mon[30843]: mgrmap e13: x(active, since 50s) 2024-09-15T22:16:22.879 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:22 smithi001 ceph-mon[30843]: overall HEALTH_OK 2024-09-15T22:16:22.879 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:22 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:22.879 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:22 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:22.879 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:22 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:22.879 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:22 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:23.345 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-15T22:16:23.345 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-15T22:16:23.667 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:23 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:23.667 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:23 smithi098 ceph-mon[35514]: from='client.? 172.21.15.98:0/2181043548' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:16:23.667 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:23 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:16:23.725 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:23.864 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:23 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:23.864 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:23 smithi001 ceph-mon[30843]: from='client.? 172.21.15.98:0/2181043548' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:16:23.864 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:23 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:16:24.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.416+0000 7fc2b7e00640 1 -- 172.21.15.1:0/178539728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc2b0109770 msgr2=0x7fc2b0109b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:24.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.416+0000 7fc2b7e00640 1 --2- 172.21.15.1:0/178539728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc2b0109770 0x7fc2b0109b50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4009880 tx=0x7fc2a402a5d0 comp rx=0 tx=0).stop 2024-09-15T22:16:24.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.416+0000 7fc2b7e00640 1 -- 172.21.15.1:0/178539728 shutdown_connections 2024-09-15T22:16:24.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.416+0000 7fc2b7e00640 1 --2- 172.21.15.1:0/178539728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc2b0109770 0x7fc2b0109b50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:24.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.416+0000 7fc2b7e00640 1 -- 172.21.15.1:0/178539728 >> 172.21.15.1:0/178539728 conn(0x7fc2b00ff450 msgr2=0x7fc2b0101870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:24.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.416+0000 7fc2b7e00640 1 -- 172.21.15.1:0/178539728 shutdown_connections 2024-09-15T22:16:24.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.416+0000 7fc2b7e00640 1 -- 172.21.15.1:0/178539728 wait complete. 2024-09-15T22:16:24.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.417+0000 7fc2b7e00640 1 Processor -- start 2024-09-15T22:16:24.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.418+0000 7fc2b7e00640 1 -- start start 2024-09-15T22:16:24.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.418+0000 7fc2b7e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc2b0109770 0x7fc2b0199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:24.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.418+0000 7fc2b7e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2b0199ad0 0x7fc2b019de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:24.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.418+0000 7fc2b7e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2b019e3a0 0x7fc2b019e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:24.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.418+0000 7fc2b7e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b010de30 con 0x7fc2b0109770 2024-09-15T22:16:24.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.418+0000 7fc2b7e00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b010dcb0 con 0x7fc2b0199ad0 2024-09-15T22:16:24.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.418+0000 7fc2b7e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b010dfb0 con 0x7fc2b019e3a0 2024-09-15T22:16:24.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.419+0000 7fc2b5400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc2b0109770 0x7fc2b0199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:24.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.419+0000 7fc2b5e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2b019e3a0 0x7fc2b019e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:24.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.419+0000 7fc2b5e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2b019e3a0 0x7fc2b019e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:54816/0 (socket says 172.21.15.1:54816) 2024-09-15T22:16:24.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.419+0000 7fc2b5e00640 1 -- 172.21.15.1:0/405537151 learned_addr learned my addr 172.21.15.1:0/405537151 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:16:24.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.419+0000 7fc2b4a00640 1 --2- 172.21.15.1:0/405537151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2b0199ad0 0x7fc2b019de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:24.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.419+0000 7fc2b4a00640 1 -- 172.21.15.1:0/405537151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2b0199ad0 msgr2=0x7fc2b019de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-15T22:16:24.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.419+0000 7fc2b4a00640 1 -- 172.21.15.1:0/405537151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2b0199ad0 msgr2=0x7fc2b019de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-15T22:16:24.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.419+0000 7fc2b4a00640 1 --2- 172.21.15.1:0/405537151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2b0199ad0 0x7fc2b019de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:16:24.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.419+0000 7fc2b4a00640 1 --2- 172.21.15.1:0/405537151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2b0199ad0 0x7fc2b019de60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:16:24.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.419+0000 7fc2b5e00640 1 -- 172.21.15.1:0/405537151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2b0199ad0 msgr2=0x7fc2b019de60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:16:24.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.419+0000 7fc2b5e00640 1 --2- 172.21.15.1:0/405537151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2b0199ad0 0x7fc2b019de60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:24.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.419+0000 7fc2b5e00640 1 -- 172.21.15.1:0/405537151 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc2b0109770 msgr2=0x7fc2b0199590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:24.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.419+0000 7fc2b5e00640 1 --2- 172.21.15.1:0/405537151 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc2b0109770 0x7fc2b0199590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:24.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.419+0000 7fc2b5e00640 1 -- 172.21.15.1:0/405537151 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2b01a6110 con 0x7fc2b019e3a0 2024-09-15T22:16:24.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.419+0000 7fc2b5e00640 1 --2- 172.21.15.1:0/405537151 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2b019e3a0 0x7fc2b019e850 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc2a800ba50 tx=0x7fc2a800bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:24.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.420+0000 7fc2ae000640 1 -- 172.21.15.1:0/405537151 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a8019070 con 0x7fc2b019e3a0 2024-09-15T22:16:24.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.420+0000 7fc2ae000640 1 -- 172.21.15.1:0/405537151 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2a800cbe0 con 0x7fc2b019e3a0 2024-09-15T22:16:24.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.420+0000 7fc2ae000640 1 -- 172.21.15.1:0/405537151 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a8007750 con 0x7fc2b019e3a0 2024-09-15T22:16:24.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.420+0000 7fc2b7e00640 1 -- 172.21.15.1:0/405537151 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2b01a6340 con 0x7fc2b019e3a0 2024-09-15T22:16:24.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.420+0000 7fc2b7e00640 1 -- 172.21.15.1:0/405537151 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2b01a6800 con 0x7fc2b019e3a0 2024-09-15T22:16:24.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.422+0000 7fc2b7e00640 1 -- 172.21.15.1:0/405537151 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2b0109bd0 con 0x7fc2b019e3a0 2024-09-15T22:16:24.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.422+0000 7fc2ae000640 1 -- 172.21.15.1:0/405537151 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fc2a801c070 con 0x7fc2b019e3a0 2024-09-15T22:16:24.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.422+0000 7fc2ae000640 1 --2- 172.21.15.1:0/405537151 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc298039730 0x7fc29803bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:24.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.422+0000 7fc2ae000640 1 -- 172.21.15.1:0/405537151 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc2a804be00 con 0x7fc2b019e3a0 2024-09-15T22:16:24.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.423+0000 7fc2b5400640 1 --2- 172.21.15.1:0/405537151 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc298039730 0x7fc29803bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:24.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.424+0000 7fc2b5400640 1 --2- 172.21.15.1:0/405537151 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc298039730 0x7fc29803bbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4000c00 tx=0x7fc2a4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:24.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.428+0000 7fc2ae000640 1 -- 172.21.15.1:0/405537151 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc2a804b670 con 0x7fc2b019e3a0 2024-09-15T22:16:24.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.658+0000 7fc2b7e00640 1 -- 172.21.15.1:0/405537151 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fc2b01a6c30 con 0x7fc2b019e3a0 2024-09-15T22:16:24.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.658+0000 7fc2ae000640 1 -- 172.21.15.1:0/405537151 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+269 (secure 0 0 0) 0x7fc2a800cd90 con 0x7fc2b019e3a0 2024-09-15T22:16:24.661 INFO:teuthology.orchestra.run.smithi001.stdout:# minimal ceph.conf for c1228c44-73af-11ef-bceb-c7b262605968 2024-09-15T22:16:24.661 INFO:teuthology.orchestra.run.smithi001.stdout:[global] 2024-09-15T22:16:24.661 INFO:teuthology.orchestra.run.smithi001.stdout: fsid = c1228c44-73af-11ef-bceb-c7b262605968 2024-09-15T22:16:24.661 INFO:teuthology.orchestra.run.smithi001.stdout: mon_host = [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-15T22:16:24.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.661+0000 7fc2b7e00640 1 -- 172.21.15.1:0/405537151 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc298039730 msgr2=0x7fc29803bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:24.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.661+0000 7fc2b7e00640 1 --2- 172.21.15.1:0/405537151 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc298039730 0x7fc29803bbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4000c00 tx=0x7fc2a4005a20 comp rx=0 tx=0).stop 2024-09-15T22:16:24.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.661+0000 7fc2b7e00640 1 -- 172.21.15.1:0/405537151 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2b019e3a0 msgr2=0x7fc2b019e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:24.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.661+0000 7fc2b7e00640 1 --2- 172.21.15.1:0/405537151 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2b019e3a0 0x7fc2b019e850 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc2a800ba50 tx=0x7fc2a800bf10 comp rx=0 tx=0).stop 2024-09-15T22:16:24.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.661+0000 7fc2b7e00640 1 -- 172.21.15.1:0/405537151 shutdown_connections 2024-09-15T22:16:24.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.661+0000 7fc2b7e00640 1 --2- 172.21.15.1:0/405537151 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc298039730 0x7fc29803bbf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:24.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.661+0000 7fc2b7e00640 1 --2- 172.21.15.1:0/405537151 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2b019e3a0 0x7fc2b019e850 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:24.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.661+0000 7fc2b7e00640 1 --2- 172.21.15.1:0/405537151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2b0199ad0 0x7fc2b019de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:24.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.661+0000 7fc2b7e00640 1 --2- 172.21.15.1:0/405537151 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc2b0109770 0x7fc2b0199590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:24.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.661+0000 7fc2b7e00640 1 -- 172.21.15.1:0/405537151 >> 172.21.15.1:0/405537151 conn(0x7fc2b00ff450 msgr2=0x7fc2b0107280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:24.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.661+0000 7fc2b7e00640 1 -- 172.21.15.1:0/405537151 shutdown_connections 2024-09-15T22:16:24.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:24.662+0000 7fc2b7e00640 1 -- 172.21.15.1:0/405537151 wait complete. 2024-09-15T22:16:24.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:16:24.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:24 smithi012 ceph-mon[34883]: mon.c calling monitor election 2024-09-15T22:16:24.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:24 smithi012 ceph-mon[34883]: mon.a calling monitor election 2024-09-15T22:16:24.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:16:24.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:16:24.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:24 smithi012 ceph-mon[34883]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:24.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:16:24.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:16:24.747 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:24 smithi012 ceph-mon[34883]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:24.747 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:16:24.747 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:16:24.747 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:24 smithi012 ceph-mon[34883]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:24.747 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:16:24.747 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:24 smithi012 ceph-mon[34883]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T22:16:24.747 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:24 smithi012 ceph-mon[34883]: monmap epoch 3 2024-09-15T22:16:24.747 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:24 smithi012 ceph-mon[34883]: fsid c1228c44-73af-11ef-bceb-c7b262605968 2024-09-15T22:16:24.747 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:24 smithi012 ceph-mon[34883]: last_changed 2024-09-15T22:16:17.420955+0000 2024-09-15T22:16:24.747 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:24 smithi012 ceph-mon[34883]: created 2024-09-15T22:14:35.299044+0000 2024-09-15T22:16:24.747 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:24 smithi012 ceph-mon[34883]: min_mon_release 19 (squid) 2024-09-15T22:16:24.747 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:24 smithi012 ceph-mon[34883]: election_strategy: 1 2024-09-15T22:16:24.748 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:24 smithi012 ceph-mon[34883]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-15T22:16:24.748 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:24 smithi012 ceph-mon[34883]: 1: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.c 2024-09-15T22:16:24.748 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:24 smithi012 ceph-mon[34883]: 2: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.b 2024-09-15T22:16:24.748 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:24 smithi012 ceph-mon[34883]: fsmap 2024-09-15T22:16:24.748 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:24 smithi012 ceph-mon[34883]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:16:24.748 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:24 smithi012 ceph-mon[34883]: mgrmap e13: x(active, since 50s) 2024-09-15T22:16:24.748 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:24 smithi012 ceph-mon[34883]: overall HEALTH_OK 2024-09-15T22:16:24.748 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:24.748 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:24.748 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:24.748 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:24.748 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:24.748 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:24 smithi012 ceph-mon[34883]: from='client.? 172.21.15.98:0/2181043548' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:16:24.749 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:16:25.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:25 smithi012 ceph-mon[34883]: mon.b calling monitor election 2024-09-15T22:16:25.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:25 smithi012 ceph-mon[34883]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:25.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:25 smithi012 ceph-mon[34883]: Updating smithi001:/etc/ceph/ceph.conf 2024-09-15T22:16:25.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:25 smithi012 ceph-mon[34883]: Updating smithi012:/etc/ceph/ceph.conf 2024-09-15T22:16:25.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:25 smithi012 ceph-mon[34883]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-15T22:16:25.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:25 smithi012 ceph-mon[34883]: Updating smithi098:/var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:16:25.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:25 smithi012 ceph-mon[34883]: Updating smithi012:/var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:16:25.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:25 smithi012 ceph-mon[34883]: mon.b calling monitor election 2024-09-15T22:16:25.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:25 smithi012 ceph-mon[34883]: mon.c calling monitor election 2024-09-15T22:16:25.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:25 smithi012 ceph-mon[34883]: mon.a calling monitor election 2024-09-15T22:16:25.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:25 smithi012 ceph-mon[34883]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-15T22:16:25.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:25 smithi012 ceph-mon[34883]: monmap epoch 3 2024-09-15T22:16:25.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:25 smithi012 ceph-mon[34883]: fsid c1228c44-73af-11ef-bceb-c7b262605968 2024-09-15T22:16:25.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:25 smithi012 ceph-mon[34883]: last_changed 2024-09-15T22:16:17.420955+0000 2024-09-15T22:16:25.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:25 smithi012 ceph-mon[34883]: created 2024-09-15T22:14:35.299044+0000 2024-09-15T22:16:25.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:25 smithi012 ceph-mon[34883]: min_mon_release 19 (squid) 2024-09-15T22:16:25.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:25 smithi012 ceph-mon[34883]: election_strategy: 1 2024-09-15T22:16:25.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:25 smithi012 ceph-mon[34883]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-15T22:16:25.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:25 smithi012 ceph-mon[34883]: 1: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.c 2024-09-15T22:16:25.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:25 smithi012 ceph-mon[34883]: 2: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.b 2024-09-15T22:16:25.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:25 smithi012 ceph-mon[34883]: fsmap 2024-09-15T22:16:25.248 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:25 smithi012 ceph-mon[34883]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:16:25.248 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:25 smithi012 ceph-mon[34883]: mgrmap e13: x(active, since 53s) 2024-09-15T22:16:25.248 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:25 smithi012 ceph-mon[34883]: overall HEALTH_OK 2024-09-15T22:16:25.248 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:25 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:25.248 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:25 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:25.248 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:25 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:25.248 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:25 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:25.248 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:25 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/405537151' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:25.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:25 smithi098 ceph-mon[35514]: mon.b calling monitor election 2024-09-15T22:16:25.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:25 smithi098 ceph-mon[35514]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:25.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:25 smithi098 ceph-mon[35514]: Updating smithi001:/etc/ceph/ceph.conf 2024-09-15T22:16:25.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:25 smithi098 ceph-mon[35514]: Updating smithi012:/etc/ceph/ceph.conf 2024-09-15T22:16:25.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:25 smithi098 ceph-mon[35514]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-15T22:16:25.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:25 smithi098 ceph-mon[35514]: Updating smithi098:/var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:16:25.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:25 smithi098 ceph-mon[35514]: Updating smithi012:/var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:16:25.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:25 smithi098 ceph-mon[35514]: mon.b calling monitor election 2024-09-15T22:16:25.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:25 smithi098 ceph-mon[35514]: mon.c calling monitor election 2024-09-15T22:16:25.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:25 smithi098 ceph-mon[35514]: mon.a calling monitor election 2024-09-15T22:16:25.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:25 smithi098 ceph-mon[35514]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-15T22:16:25.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:25 smithi098 ceph-mon[35514]: monmap epoch 3 2024-09-15T22:16:25.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:25 smithi098 ceph-mon[35514]: fsid c1228c44-73af-11ef-bceb-c7b262605968 2024-09-15T22:16:25.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:25 smithi098 ceph-mon[35514]: last_changed 2024-09-15T22:16:17.420955+0000 2024-09-15T22:16:25.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:25 smithi098 ceph-mon[35514]: created 2024-09-15T22:14:35.299044+0000 2024-09-15T22:16:25.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:25 smithi098 ceph-mon[35514]: min_mon_release 19 (squid) 2024-09-15T22:16:25.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:25 smithi098 ceph-mon[35514]: election_strategy: 1 2024-09-15T22:16:25.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:25 smithi098 ceph-mon[35514]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-15T22:16:25.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:25 smithi098 ceph-mon[35514]: 1: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.c 2024-09-15T22:16:25.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:25 smithi098 ceph-mon[35514]: 2: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.b 2024-09-15T22:16:25.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:25 smithi098 ceph-mon[35514]: fsmap 2024-09-15T22:16:25.313 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:25 smithi098 ceph-mon[35514]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:16:25.313 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:25 smithi098 ceph-mon[35514]: mgrmap e13: x(active, since 53s) 2024-09-15T22:16:25.313 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:25 smithi098 ceph-mon[35514]: overall HEALTH_OK 2024-09-15T22:16:25.313 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:25 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:25.313 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:25 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:25.313 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:25 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:25.313 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:25 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:25.313 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:25 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/405537151' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:25.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:25 smithi001 ceph-mon[30843]: mon.b calling monitor election 2024-09-15T22:16:25.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:25 smithi001 ceph-mon[30843]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:25.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:25 smithi001 ceph-mon[30843]: Updating smithi001:/etc/ceph/ceph.conf 2024-09-15T22:16:25.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:25 smithi001 ceph-mon[30843]: Updating smithi012:/etc/ceph/ceph.conf 2024-09-15T22:16:25.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:25 smithi001 ceph-mon[30843]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-15T22:16:25.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:25 smithi001 ceph-mon[30843]: Updating smithi098:/var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:16:25.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:25 smithi001 ceph-mon[30843]: Updating smithi012:/var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:16:25.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:25 smithi001 ceph-mon[30843]: mon.b calling monitor election 2024-09-15T22:16:25.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:25 smithi001 ceph-mon[30843]: mon.c calling monitor election 2024-09-15T22:16:25.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:25 smithi001 ceph-mon[30843]: mon.a calling monitor election 2024-09-15T22:16:25.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:25 smithi001 ceph-mon[30843]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-15T22:16:25.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:25 smithi001 ceph-mon[30843]: monmap epoch 3 2024-09-15T22:16:25.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:25 smithi001 ceph-mon[30843]: fsid c1228c44-73af-11ef-bceb-c7b262605968 2024-09-15T22:16:25.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:25 smithi001 ceph-mon[30843]: last_changed 2024-09-15T22:16:17.420955+0000 2024-09-15T22:16:25.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:25 smithi001 ceph-mon[30843]: created 2024-09-15T22:14:35.299044+0000 2024-09-15T22:16:25.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:25 smithi001 ceph-mon[30843]: min_mon_release 19 (squid) 2024-09-15T22:16:25.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:25 smithi001 ceph-mon[30843]: election_strategy: 1 2024-09-15T22:16:25.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:25 smithi001 ceph-mon[30843]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-15T22:16:25.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:25 smithi001 ceph-mon[30843]: 1: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.c 2024-09-15T22:16:25.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:25 smithi001 ceph-mon[30843]: 2: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.b 2024-09-15T22:16:25.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:25 smithi001 ceph-mon[30843]: fsmap 2024-09-15T22:16:25.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:25 smithi001 ceph-mon[30843]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:16:25.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:25 smithi001 ceph-mon[30843]: mgrmap e13: x(active, since 53s) 2024-09-15T22:16:25.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:25 smithi001 ceph-mon[30843]: overall HEALTH_OK 2024-09-15T22:16:25.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:25 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:25.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:25 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:25.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:25 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:25.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:25 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:25.379 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:25 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/405537151' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:25.439 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-15T22:16:25.439 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T22:16:25.439 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/ceph/ceph.conf 2024-09-15T22:16:25.497 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T22:16:25.498 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:16:25.599 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-15T22:16:25.599 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/ceph/ceph.conf 2024-09-15T22:16:25.626 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-15T22:16:25.626 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:16:25.691 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-15T22:16:25.691 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.conf 2024-09-15T22:16:25.723 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-15T22:16:25.723 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:16:25.792 INFO:tasks.cephadm:Adding mgr.x on smithi001 2024-09-15T22:16:25.792 INFO:tasks.cephadm:Adding mgr.y on smithi012 2024-09-15T22:16:25.792 INFO:tasks.cephadm:Adding mgr.z on smithi098 2024-09-15T22:16:25.792 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi001=x;smithi012=y;smithi098=z' 2024-09-15T22:16:26.083 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:16:26.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:26 smithi098 ceph-mon[35514]: Updating smithi001:/var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:16:26.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:26 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:26.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:26 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:26.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:26 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:26.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:26 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:26.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:26 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:26.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:26 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:26.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:26 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:26.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:26 smithi098 ceph-mon[35514]: Reconfiguring mon.a (unknown last config time)... 2024-09-15T22:16:26.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:26 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:16:26.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:26 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:16:26.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:26 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:26.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:26 smithi098 ceph-mon[35514]: Reconfiguring daemon mon.a on smithi001 2024-09-15T22:16:26.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:26 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:16:26.340 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:26 smithi001 ceph-mon[30843]: Updating smithi001:/var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:16:26.340 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:26 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:26.340 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:26 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:26.340 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:26 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:26.340 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:26 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:26.340 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:26 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:26.340 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:26 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:26.340 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:26 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:26.340 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:26 smithi001 ceph-mon[30843]: Reconfiguring mon.a (unknown last config time)... 2024-09-15T22:16:26.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:26 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:16:26.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:26 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:16:26.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:26 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:26.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:26 smithi001 ceph-mon[30843]: Reconfiguring daemon mon.a on smithi001 2024-09-15T22:16:26.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:26 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:16:26.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:26 smithi012 ceph-mon[34883]: Updating smithi001:/var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:16:26.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:26 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:26.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:26 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:26.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:26 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:26.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:26 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:26.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:26 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:26.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:26 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:26.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:26 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:26.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:26 smithi012 ceph-mon[34883]: Reconfiguring mon.a (unknown last config time)... 2024-09-15T22:16:26.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:26 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:16:26.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:26 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:16:26.497 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:26 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:26.497 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:26 smithi012 ceph-mon[34883]: Reconfiguring daemon mon.a on smithi001 2024-09-15T22:16:26.497 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:26 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:16:26.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.487+0000 7f2d9cb70640 1 -- 172.21.15.98:0/3512584207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d98101700 msgr2=0x7f2d98101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:26.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.487+0000 7f2d9cb70640 1 --2- 172.21.15.98:0/3512584207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d98101700 0x7f2d98101b00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2d88009c20 tx=0x7f2d8802aa90 comp rx=0 tx=0).stop 2024-09-15T22:16:26.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.487+0000 7f2d9cb70640 1 -- 172.21.15.98:0/3512584207 shutdown_connections 2024-09-15T22:16:26.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.487+0000 7f2d9cb70640 1 --2- 172.21.15.98:0/3512584207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d98101700 0x7f2d98101b00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.487+0000 7f2d9cb70640 1 -- 172.21.15.98:0/3512584207 >> 172.21.15.98:0/3512584207 conn(0x7f2d980fceb0 msgr2=0x7f2d980ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:26.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.487+0000 7f2d9cb70640 1 -- 172.21.15.98:0/3512584207 shutdown_connections 2024-09-15T22:16:26.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.487+0000 7f2d9cb70640 1 -- 172.21.15.98:0/3512584207 wait complete. 2024-09-15T22:16:26.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.488+0000 7f2d9cb70640 1 Processor -- start 2024-09-15T22:16:26.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.488+0000 7f2d9cb70640 1 -- start start 2024-09-15T22:16:26.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.488+0000 7f2d9cb70640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d98101700 0x7f2d98197010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:26.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.488+0000 7f2d9cb70640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d98197550 0x7f2d9819c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:26.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.488+0000 7f2d9cb70640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d981979d0 0x7f2d9819eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:26.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.488+0000 7f2d9cb70640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2d98107810 con 0x7f2d98101700 2024-09-15T22:16:26.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.488+0000 7f2d9cb70640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2d98107690 con 0x7f2d98197550 2024-09-15T22:16:26.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.488+0000 7f2d9cb70640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2d98107990 con 0x7f2d981979d0 2024-09-15T22:16:26.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.488+0000 7f2d96d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d981979d0 0x7f2d9819eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:26.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.488+0000 7f2d96d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d981979d0 0x7f2d9819eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48418/0 (socket says 172.21.15.98:48418) 2024-09-15T22:16:26.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.488+0000 7f2d96d9d640 1 -- 172.21.15.98:0/3861704401 learned_addr learned my addr 172.21.15.98:0/3861704401 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-15T22:16:26.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.488+0000 7f2d9659c640 1 --2- 172.21.15.98:0/3861704401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d98101700 0x7f2d98197010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:26.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.488+0000 7f2d95d9b640 1 --2- 172.21.15.98:0/3861704401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d98197550 0x7f2d9819c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:26.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.489+0000 7f2d96d9d640 1 -- 172.21.15.98:0/3861704401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d98197550 msgr2=0x7f2d9819c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:26.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.489+0000 7f2d96d9d640 1 --2- 172.21.15.98:0/3861704401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d98197550 0x7f2d9819c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.489+0000 7f2d96d9d640 1 -- 172.21.15.98:0/3861704401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d98101700 msgr2=0x7f2d98197010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:26.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.489+0000 7f2d96d9d640 1 --2- 172.21.15.98:0/3861704401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d98101700 0x7f2d98197010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.489+0000 7f2d96d9d640 1 -- 172.21.15.98:0/3861704401 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d9819f3a0 con 0x7f2d981979d0 2024-09-15T22:16:26.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.489+0000 7f2d9659c640 1 --2- 172.21.15.98:0/3861704401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d98101700 0x7f2d98197010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:16:26.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.489+0000 7f2d96d9d640 1 --2- 172.21.15.98:0/3861704401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d981979d0 0x7f2d9819eae0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2d9000b450 tx=0x7f2d9000b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:26.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.489+0000 7f2d877fe640 1 -- 172.21.15.98:0/3861704401 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d90015020 con 0x7f2d981979d0 2024-09-15T22:16:26.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.489+0000 7f2d9cb70640 1 -- 172.21.15.98:0/3861704401 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d9819f690 con 0x7f2d981979d0 2024-09-15T22:16:26.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.489+0000 7f2d877fe640 1 -- 172.21.15.98:0/3861704401 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d90011d70 con 0x7f2d981979d0 2024-09-15T22:16:26.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.489+0000 7f2d877fe640 1 -- 172.21.15.98:0/3861704401 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d9000f340 con 0x7f2d981979d0 2024-09-15T22:16:26.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.489+0000 7f2d9cb70640 1 -- 172.21.15.98:0/3861704401 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d9819fc50 con 0x7f2d981979d0 2024-09-15T22:16:26.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.490+0000 7f2d877fe640 1 -- 172.21.15.98:0/3861704401 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f2d90018020 con 0x7f2d981979d0 2024-09-15T22:16:26.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.490+0000 7f2d877fe640 1 --2- 172.21.15.98:0/3861704401 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2d80039730 0x7f2d8003bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:26.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.490+0000 7f2d877fe640 1 -- 172.21.15.98:0/3861704401 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2d9004d170 con 0x7f2d981979d0 2024-09-15T22:16:26.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.490+0000 7f2d9659c640 1 --2- 172.21.15.98:0/3861704401 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2d80039730 0x7f2d8003bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:26.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.490+0000 7f2d9cb70640 1 -- 172.21.15.98:0/3861704401 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d981905d0 con 0x7f2d981979d0 2024-09-15T22:16:26.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.491+0000 7f2d9659c640 1 --2- 172.21.15.98:0/3861704401 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2d80039730 0x7f2d8003bbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2d88000f80 tx=0x7f2d8803a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:26.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.495+0000 7f2d877fe640 1 -- 172.21.15.98:0/3861704401 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2d9001f020 con 0x7f2d981979d0 2024-09-15T22:16:26.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.673+0000 7f2d9cb70640 1 -- 172.21.15.98:0/3861704401 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi001=x;smithi012=y;smithi098=z", "target": ["mon-mgr", ""]}) -- 0x7f2d98062630 con 0x7f2d80039730 2024-09-15T22:16:26.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.679+0000 7f2d877fe640 1 -- 172.21.15.98:0/3861704401 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f2d98062630 con 0x7f2d80039730 2024-09-15T22:16:26.681 INFO:teuthology.orchestra.run.smithi098.stdout:Scheduled mgr update... 2024-09-15T22:16:26.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.681+0000 7f2d9cb70640 1 -- 172.21.15.98:0/3861704401 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2d80039730 msgr2=0x7f2d8003bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:26.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.681+0000 7f2d9cb70640 1 --2- 172.21.15.98:0/3861704401 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2d80039730 0x7f2d8003bbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2d88000f80 tx=0x7f2d8803a040 comp rx=0 tx=0).stop 2024-09-15T22:16:26.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.681+0000 7f2d9cb70640 1 -- 172.21.15.98:0/3861704401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d981979d0 msgr2=0x7f2d9819eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:26.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.681+0000 7f2d9cb70640 1 --2- 172.21.15.98:0/3861704401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d981979d0 0x7f2d9819eae0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2d9000b450 tx=0x7f2d9000b910 comp rx=0 tx=0).stop 2024-09-15T22:16:26.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.681+0000 7f2d9cb70640 1 -- 172.21.15.98:0/3861704401 shutdown_connections 2024-09-15T22:16:26.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.681+0000 7f2d9cb70640 1 --2- 172.21.15.98:0/3861704401 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2d80039730 0x7f2d8003bbf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.681+0000 7f2d9cb70640 1 --2- 172.21.15.98:0/3861704401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d981979d0 0x7f2d9819eae0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.681+0000 7f2d9cb70640 1 --2- 172.21.15.98:0/3861704401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d98197550 0x7f2d9819c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.681+0000 7f2d9cb70640 1 --2- 172.21.15.98:0/3861704401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d98101700 0x7f2d98197010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.681+0000 7f2d9cb70640 1 -- 172.21.15.98:0/3861704401 >> 172.21.15.98:0/3861704401 conn(0x7f2d980fceb0 msgr2=0x7f2d980fd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:26.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.681+0000 7f2d9cb70640 1 -- 172.21.15.98:0/3861704401 shutdown_connections 2024-09-15T22:16:26.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:16:26.681+0000 7f2d9cb70640 1 -- 172.21.15.98:0/3861704401 wait complete. 2024-09-15T22:16:27.262 DEBUG:teuthology.orchestra.run.smithi012:mgr.y> sudo journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mgr.y.service 2024-09-15T22:16:27.265 DEBUG:teuthology.orchestra.run.smithi098:mgr.z> sudo journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mgr.z.service 2024-09-15T22:16:27.268 INFO:tasks.cephadm:Deploying OSDs... 2024-09-15T22:16:27.268 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T22:16:27.268 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T22:16:27.304 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T22:16:27.304 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_1 2024-09-15T22:16:27.379 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T22:16:27.379 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:16:27.379 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-09-15T22:16:27.379 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:16:27.379 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:16:27.380 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-09-15 22:15:41.716306946 +0000 2024-09-15T22:16:27.380 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-09-15 22:11:23.011190652 +0000 2024-09-15T22:16:27.380 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-09-15 22:11:23.011190652 +0000 2024-09-15T22:16:27.380 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-09-15 22:11:23.011190652 +0000 2024-09-15T22:16:27.380 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T22:16:27.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:27 smithi012 ceph-mon[34883]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:27.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:27 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:27.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:27 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:27.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:27 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:27.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:27 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:27.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:27 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:16:27.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:27 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:16:27.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:27 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:27.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:27 smithi001 ceph-mon[30843]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:27.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:27 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:27.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:27 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:27.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:27 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:27.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:27 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:27.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:27 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:16:27.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:27 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:16:27.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:27 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:27.504 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-09-15T22:16:27.505 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-09-15T22:16:27.505 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000187899 s, 2.7 MB/s 2024-09-15T22:16:27.507 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T22:16:27.544 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_2 2024-09-15T22:16:27.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:27 smithi098 ceph-mon[35514]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:27.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:27 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:27.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:27 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:27.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:27 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:27.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:27 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:27.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:27 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:16:27.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:27 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:16:27.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:27 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:27.620 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T22:16:27.620 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:16:27.620 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-09-15T22:16:27.620 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:16:27.620 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:16:27.621 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-09-15 22:15:41.760306417 +0000 2024-09-15T22:16:27.621 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-09-15 22:11:23.475184914 +0000 2024-09-15T22:16:27.621 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-09-15 22:11:23.475184914 +0000 2024-09-15T22:16:27.621 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-09-15 22:11:23.475184914 +0000 2024-09-15T22:16:27.621 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T22:16:27.718 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-09-15T22:16:27.718 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-09-15T22:16:27.718 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000203979 s, 2.5 MB/s 2024-09-15T22:16:27.720 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T22:16:27.757 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_3 2024-09-15T22:16:27.833 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T22:16:27.833 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:16:27.833 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-09-15T22:16:27.833 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:16:27.833 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:16:27.834 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-09-15 22:15:41.804305888 +0000 2024-09-15T22:16:27.834 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-09-15 22:11:23.929179301 +0000 2024-09-15T22:16:27.834 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-09-15 22:11:23.929179301 +0000 2024-09-15T22:16:27.834 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-09-15 22:11:23.929179301 +0000 2024-09-15T22:16:27.834 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T22:16:27.927 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-09-15T22:16:27.927 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-09-15T22:16:27.928 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000175188 s, 2.9 MB/s 2024-09-15T22:16:27.930 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T22:16:27.967 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_4 2024-09-15T22:16:28.043 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T22:16:28.043 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:16:28.044 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-09-15T22:16:28.044 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:16:28.044 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:16:28.044 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-09-15 22:15:41.852305311 +0000 2024-09-15T22:16:28.044 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-09-15 22:11:24.398173502 +0000 2024-09-15T22:16:28.044 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-09-15 22:11:24.398173502 +0000 2024-09-15T22:16:28.044 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-09-15 22:11:24.398173502 +0000 2024-09-15T22:16:28.044 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T22:16:28.137 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-09-15T22:16:28.137 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-09-15T22:16:28.137 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000175889 s, 2.9 MB/s 2024-09-15T22:16:28.140 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T22:16:28.176 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-15T22:16:28.176 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T22:16:28.195 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T22:16:28.196 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_1 2024-09-15T22:16:28.254 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T22:16:28.254 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:16:28.254 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-15T22:16:28.254 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:16:28.254 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:16:28.254 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-15 22:16:16.798487954 +0000 2024-09-15T22:16:28.254 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-15 22:10:40.379219180 +0000 2024-09-15T22:16:28.254 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-15 22:10:40.379219180 +0000 2024-09-15T22:16:28.254 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-09-15 22:10:40.379219180 +0000 2024-09-15T22:16:28.255 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T22:16:28.321 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-15T22:16:28.321 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-15T22:16:28.321 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000281002 s, 1.8 MB/s 2024-09-15T22:16:28.322 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T22:16:28.381 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_2 2024-09-15T22:16:28.440 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T22:16:28.440 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:16:28.440 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-15T22:16:28.440 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:16:28.440 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:16:28.440 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-15 22:16:16.798487954 +0000 2024-09-15T22:16:28.440 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-15 22:10:40.717216084 +0000 2024-09-15T22:16:28.440 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-15 22:10:40.717216084 +0000 2024-09-15T22:16:28.440 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-09-15 22:10:40.717216084 +0000 2024-09-15T22:16:28.441 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T22:16:28.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:28 smithi012 ceph-mon[34883]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi001=x;smithi012=y;smithi098=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:16:28.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:28 smithi012 ceph-mon[34883]: Saving service mgr spec with placement smithi001=x;smithi012=y;smithi098=z;count:3 2024-09-15T22:16:28.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:28 smithi012 ceph-mon[34883]: Reconfiguring mgr.x (unknown last config time)... 2024-09-15T22:16:28.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:28 smithi012 ceph-mon[34883]: Reconfiguring daemon mgr.x on smithi001 2024-09-15T22:16:28.504 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-15T22:16:28.505 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-15T22:16:28.505 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000203314 s, 2.5 MB/s 2024-09-15T22:16:28.506 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T22:16:28.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:28 smithi098 ceph-mon[35514]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi001=x;smithi012=y;smithi098=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:16:28.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:28 smithi098 ceph-mon[35514]: Saving service mgr spec with placement smithi001=x;smithi012=y;smithi098=z;count:3 2024-09-15T22:16:28.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:28 smithi098 ceph-mon[35514]: Reconfiguring mgr.x (unknown last config time)... 2024-09-15T22:16:28.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:28 smithi098 ceph-mon[35514]: Reconfiguring daemon mgr.x on smithi001 2024-09-15T22:16:28.564 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_3 2024-09-15T22:16:28.621 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T22:16:28.621 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:16:28.621 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-15T22:16:28.621 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:16:28.621 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:16:28.621 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-15 22:16:16.799487945 +0000 2024-09-15T22:16:28.622 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-15 22:10:41.077212785 +0000 2024-09-15T22:16:28.622 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-15 22:10:41.077212785 +0000 2024-09-15T22:16:28.622 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-09-15 22:10:41.077212785 +0000 2024-09-15T22:16:28.622 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T22:16:28.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:28 smithi001 ceph-mon[30843]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi001=x;smithi012=y;smithi098=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:16:28.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:28 smithi001 ceph-mon[30843]: Saving service mgr spec with placement smithi001=x;smithi012=y;smithi098=z;count:3 2024-09-15T22:16:28.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:28 smithi001 ceph-mon[30843]: Reconfiguring mgr.x (unknown last config time)... 2024-09-15T22:16:28.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:28 smithi001 ceph-mon[30843]: Reconfiguring daemon mgr.x on smithi001 2024-09-15T22:16:28.686 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-15T22:16:28.686 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-15T22:16:28.686 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000214769 s, 2.4 MB/s 2024-09-15T22:16:28.687 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T22:16:28.743 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_4 2024-09-15T22:16:28.798 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T22:16:28.799 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:16:28.799 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-15T22:16:28.799 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:16:28.799 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:16:28.799 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-15 22:16:16.799487945 +0000 2024-09-15T22:16:28.799 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-15 22:10:41.406209771 +0000 2024-09-15T22:16:28.799 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-15 22:10:41.406209771 +0000 2024-09-15T22:16:28.799 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-09-15 22:10:41.406209771 +0000 2024-09-15T22:16:28.799 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T22:16:28.862 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-15T22:16:28.862 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-15T22:16:28.862 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000209345 s, 2.4 MB/s 2024-09-15T22:16:28.864 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T22:16:28.920 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-15T22:16:28.921 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T22:16:28.940 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T22:16:28.940 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_1 2024-09-15T22:16:28.999 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T22:16:29.000 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:16:29.000 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-15T22:16:29.000 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:16:29.000 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:16:29.000 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-15 22:16:08.006725241 +0000 2024-09-15T22:16:29.000 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-15 22:10:37.989271304 +0000 2024-09-15T22:16:29.000 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-15 22:10:37.989271304 +0000 2024-09-15T22:16:29.000 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-15 22:10:37.989271304 +0000 2024-09-15T22:16:29.000 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T22:16:29.068 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-15T22:16:29.068 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-15T22:16:29.068 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000239684 s, 2.1 MB/s 2024-09-15T22:16:29.069 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T22:16:29.129 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_2 2024-09-15T22:16:29.186 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T22:16:29.187 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:16:29.187 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-15T22:16:29.187 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:16:29.187 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:16:29.187 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-15 22:16:08.006725241 +0000 2024-09-15T22:16:29.187 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-15 22:10:38.325267040 +0000 2024-09-15T22:16:29.187 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-15 22:10:38.325267040 +0000 2024-09-15T22:16:29.187 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-15 22:10:38.325267040 +0000 2024-09-15T22:16:29.187 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T22:16:29.253 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-15T22:16:29.253 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-15T22:16:29.253 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000230426 s, 2.2 MB/s 2024-09-15T22:16:29.255 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T22:16:29.313 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_3 2024-09-15T22:16:29.370 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T22:16:29.371 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:16:29.371 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-15T22:16:29.371 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:16:29.371 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:16:29.371 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-15 22:16:08.006725241 +0000 2024-09-15T22:16:29.371 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-15 22:10:38.647262953 +0000 2024-09-15T22:16:29.371 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-15 22:10:38.647262953 +0000 2024-09-15T22:16:29.371 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-15 22:10:38.647262953 +0000 2024-09-15T22:16:29.371 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T22:16:29.437 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-15T22:16:29.440 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-15T22:16:29.440 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000382198 s, 1.3 MB/s 2024-09-15T22:16:29.442 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T22:16:29.499 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_4 2024-09-15T22:16:29.556 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T22:16:29.556 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:16:29.556 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-15T22:16:29.556 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:16:29.556 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:16:29.556 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-15 22:16:08.007725229 +0000 2024-09-15T22:16:29.556 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-15 22:10:38.980258727 +0000 2024-09-15T22:16:29.556 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-15 22:10:38.980258727 +0000 2024-09-15T22:16:29.556 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-15 22:10:38.980258727 +0000 2024-09-15T22:16:29.556 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T22:16:29.620 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-15T22:16:29.620 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-15T22:16:29.621 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000175954 s, 2.9 MB/s 2024-09-15T22:16:29.622 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T22:16:29.678 INFO:tasks.cephadm:Deploying osd.0 on smithi001 with /dev/vg_nvme/lv_4... 2024-09-15T22:16:29.679 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-15T22:16:29.735 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:29 smithi001 ceph-mon[30843]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:29.735 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:29 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:29.735 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:29 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:29.735 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:29 smithi001 ceph-mon[30843]: Reconfiguring mon.b (monmap changed)... 2024-09-15T22:16:29.735 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:29 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:16:29.735 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:29 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:16:29.735 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:29 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:29.735 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:29 smithi001 ceph-mon[30843]: Reconfiguring daemon mon.b on smithi012 2024-09-15T22:16:29.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:29 smithi012 ceph-mon[34883]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:29.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:29 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:29.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:29 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:29.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:29 smithi012 ceph-mon[34883]: Reconfiguring mon.b (monmap changed)... 2024-09-15T22:16:29.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:29 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:16:29.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:29 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:16:29.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:29 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:29.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:29 smithi012 ceph-mon[34883]: Reconfiguring daemon mon.b on smithi012 2024-09-15T22:16:29.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:29 smithi098 ceph-mon[35514]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:29.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:29 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:29.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:29 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:29.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:29 smithi098 ceph-mon[35514]: Reconfiguring mon.b (monmap changed)... 2024-09-15T22:16:29.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:29 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:16:29.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:29 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:16:29.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:29 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:29.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:29 smithi098 ceph-mon[35514]: Reconfiguring daemon mon.b on smithi012 2024-09-15T22:16:30.055 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:30.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:30 smithi001 ceph-mon[30843]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:30.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:30 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:30.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:30 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:30.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:30 smithi001 ceph-mon[30843]: Reconfiguring mon.c (monmap changed)... 2024-09-15T22:16:30.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:30 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:16:30.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:30 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:16:30.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:30 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:30.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:30 smithi001 ceph-mon[30843]: Reconfiguring daemon mon.c on smithi098 2024-09-15T22:16:30.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:30 smithi012 ceph-mon[34883]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:30.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:30 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:30.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:30 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:30.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:30 smithi012 ceph-mon[34883]: Reconfiguring mon.c (monmap changed)... 2024-09-15T22:16:30.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:30 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:16:30.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:30 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:16:30.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:30 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:30.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:30 smithi012 ceph-mon[34883]: Reconfiguring daemon mon.c on smithi098 2024-09-15T22:16:31.025 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:30 smithi098 ceph-mon[35514]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:31.025 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:30 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:31.025 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:30 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:31.025 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:30 smithi098 ceph-mon[35514]: Reconfiguring mon.c (monmap changed)... 2024-09-15T22:16:31.025 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:30 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:16:31.025 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:30 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:16:31.025 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:30 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:31.025 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:30 smithi098 ceph-mon[35514]: Reconfiguring daemon mon.c on smithi098 2024-09-15T22:16:32.331 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:32 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:32.332 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:32 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:32.332 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:32 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:32.332 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:32 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:32.332 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:32 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:32.332 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:32 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:32.332 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:32 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:16:32.332 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:32 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T22:16:32.332 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:32 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:16:32.332 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:32 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:32.332 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:32 smithi098 ceph-mon[35514]: Deploying daemon mgr.z on smithi098 2024-09-15T22:16:32.362 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:32 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:32.362 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:32 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:32.362 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:32 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:32.362 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:32 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:32.362 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:32 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:32.363 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:32 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:32.363 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:32 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:16:32.363 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:32 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T22:16:32.363 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:32 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:16:32.363 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:32 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:32.363 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:32 smithi001 ceph-mon[30843]: Deploying daemon mgr.z on smithi098 2024-09-15T22:16:32.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:32 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:32.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:32 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:32.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:32 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:32.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:32 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:32.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:32 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:32.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:32 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:32.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:32 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:16:32.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:32 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T22:16:32.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:32 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:16:32.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:32 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:32.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:32 smithi012 ceph-mon[34883]: Deploying daemon mgr.z on smithi098 2024-09-15T22:16:32.980 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:16:32 smithi098 systemd[1]: Starting Ceph mgr.z for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:16:33.112 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:16:33.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:33 smithi001 ceph-mon[30843]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:33.143 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi001:vg_nvme/lv_4 2024-09-15T22:16:33.294 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:33 smithi098 ceph-mon[35514]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:33.295 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:16:32 smithi098 podman[37312]: 2024-09-15 22:16:32.880788609 +0000 UTC m=+0.015528621 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:16:33.295 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:16:32 smithi098 podman[37312]: 2024-09-15 22:16:32.982490439 +0000 UTC m=+0.117230450 container create a9d1b7bf2db14913712645a4df33da3039e955a6a8b396896bd3384bc3a9cc36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-z, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:16:33.295 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:16:33 smithi098 podman[37312]: 2024-09-15 22:16:33.193565906 +0000 UTC m=+0.328305914 container init a9d1b7bf2db14913712645a4df33da3039e955a6a8b396896bd3384bc3a9cc36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-z, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-15T22:16:33.295 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:16:33 smithi098 podman[37312]: 2024-09-15 22:16:33.196260088 +0000 UTC m=+0.331000105 container start a9d1b7bf2db14913712645a4df33da3039e955a6a8b396896bd3384bc3a9cc36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-z, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-15T22:16:33.295 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:16:33 smithi098 ceph-mgr[37331]: -- 172.21.15.98:0/3696473728 <== mon.1 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5617609bf0e0 con 0x56176099c800 2024-09-15T22:16:33.295 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:16:33 smithi098 bash[37312]: a9d1b7bf2db14913712645a4df33da3039e955a6a8b396896bd3384bc3a9cc36 2024-09-15T22:16:33.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:33 smithi012 ceph-mon[34883]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:33.512 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:33.561 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:16:33 smithi098 systemd[1]: Started Ceph mgr.z for c1228c44-73af-11ef-bceb-c7b262605968. 2024-09-15T22:16:33.561 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:16:33 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-z[37327]: 2024-09-15T22:16:33.315+0000 7f2b7e51a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:16:33.561 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:16:33 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-z[37327]: 2024-09-15T22:16:33.376+0000 7f2b7e51a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:16:33.561 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:16:33 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-z[37327]: 2024-09-15T22:16:33.524+0000 7f2b7e51a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:16:33.875 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:16:33 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-z[37327]: 2024-09-15T22:16:33.590+0000 7f2b7e51a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:16:33.875 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:16:33 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-z[37327]: 2024-09-15T22:16:33.735+0000 7f2b7e51a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:16:33.875 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:16:33 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-z[37327]: 2024-09-15T22:16:33.873+0000 7f2b7e51a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:16:34.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.031+0000 7f8fc7200640 1 -- 172.21.15.1:0/528727231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fc8103c50 msgr2=0x7f8fc8104050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:34.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.031+0000 7f8fc7200640 1 --2- 172.21.15.1:0/528727231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fc8103c50 0x7f8fc8104050 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8009900 tx=0x7f8fb802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:16:34.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.031+0000 7f8fc7200640 1 -- 172.21.15.1:0/528727231 shutdown_connections 2024-09-15T22:16:34.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.031+0000 7f8fc7200640 1 --2- 172.21.15.1:0/528727231 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fc8105810 0x7f8fc810c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:34.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.031+0000 7f8fc7200640 1 --2- 172.21.15.1:0/528727231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fc8104e50 0x7f8fc81052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:34.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.031+0000 7f8fc7200640 1 --2- 172.21.15.1:0/528727231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fc8103c50 0x7f8fc8104050 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:34.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.031+0000 7f8fc7200640 1 -- 172.21.15.1:0/528727231 >> 172.21.15.1:0/528727231 conn(0x7f8fc80ff3e0 msgr2=0x7f8fc8101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:34.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.031+0000 7f8fc7200640 1 -- 172.21.15.1:0/528727231 shutdown_connections 2024-09-15T22:16:34.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.031+0000 7f8fc7200640 1 -- 172.21.15.1:0/528727231 wait complete. 2024-09-15T22:16:34.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.032+0000 7f8fc7200640 1 Processor -- start 2024-09-15T22:16:34.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.033+0000 7f8fc7200640 1 -- start start 2024-09-15T22:16:34.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.033+0000 7f8fc7200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fc8103c50 0x7f8fc8199f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:34.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.033+0000 7f8fc7200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fc8104e50 0x7f8fc819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:34.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.033+0000 7f8fc7200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fc8105810 0x7f8fc81a14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:34.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.033+0000 7f8fc7200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc810f8b0 con 0x7f8fc8104e50 2024-09-15T22:16:34.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.033+0000 7f8fc7200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc810f730 con 0x7f8fc8105810 2024-09-15T22:16:34.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.033+0000 7f8fc7200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc810fa30 con 0x7f8fc8103c50 2024-09-15T22:16:34.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.033+0000 7f8fc5e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fc8103c50 0x7f8fc8199f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:34.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.033+0000 7f8fc5e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fc8103c50 0x7f8fc8199f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:55136/0 (socket says 172.21.15.1:55136) 2024-09-15T22:16:34.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.033+0000 7f8fc6800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fc8105810 0x7f8fc81a14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:34.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.033+0000 7f8fc5e00640 1 -- 172.21.15.1:0/428231491 learned_addr learned my addr 172.21.15.1:0/428231491 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:16:34.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.033+0000 7f8fc5400640 1 --2- 172.21.15.1:0/428231491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fc8104e50 0x7f8fc819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:34.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.034+0000 7f8fc5e00640 1 -- 172.21.15.1:0/428231491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fc8105810 msgr2=0x7f8fc81a14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:34.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.034+0000 7f8fc5e00640 1 --2- 172.21.15.1:0/428231491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fc8105810 0x7f8fc81a14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:34.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.034+0000 7f8fc5e00640 1 -- 172.21.15.1:0/428231491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fc8104e50 msgr2=0x7f8fc819a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:34.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.034+0000 7f8fc5e00640 1 --2- 172.21.15.1:0/428231491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fc8104e50 0x7f8fc819a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:34.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.034+0000 7f8fc5e00640 1 -- 172.21.15.1:0/428231491 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc81a1b60 con 0x7f8fc8103c50 2024-09-15T22:16:34.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.034+0000 7f8fc5e00640 1 --2- 172.21.15.1:0/428231491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fc8103c50 0x7f8fc8199f30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8031610 tx=0x7f8fb8004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:34.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.034+0000 7f8fbea00640 1 -- 172.21.15.1:0/428231491 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb803f030 con 0x7f8fc8103c50 2024-09-15T22:16:34.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.034+0000 7f8fbea00640 1 -- 172.21.15.1:0/428231491 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8fb8003ad0 con 0x7f8fc8103c50 2024-09-15T22:16:34.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.034+0000 7f8fbea00640 1 -- 172.21.15.1:0/428231491 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb8035070 con 0x7f8fc8103c50 2024-09-15T22:16:34.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.034+0000 7f8fc7200640 1 -- 172.21.15.1:0/428231491 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fc81a1df0 con 0x7f8fc8103c50 2024-09-15T22:16:34.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.035+0000 7f8fc7200640 1 -- 172.21.15.1:0/428231491 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fc81a21c0 con 0x7f8fc8103c50 2024-09-15T22:16:34.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.035+0000 7f8fc7200640 1 -- 172.21.15.1:0/428231491 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fc810b050 con 0x7f8fc8103c50 2024-09-15T22:16:34.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.036+0000 7f8fbea00640 1 -- 172.21.15.1:0/428231491 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f8fb8042030 con 0x7f8fc8103c50 2024-09-15T22:16:34.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.036+0000 7f8fbea00640 1 --2- 172.21.15.1:0/428231491 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f8fac039500 0x7f8fac03b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:34.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.036+0000 7f8fbea00640 1 -- 172.21.15.1:0/428231491 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8fb806cb80 con 0x7f8fc8103c50 2024-09-15T22:16:34.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.036+0000 7f8fc5400640 1 --2- 172.21.15.1:0/428231491 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f8fac039500 0x7f8fac03b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:34.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.037+0000 7f8fc5400640 1 --2- 172.21.15.1:0/428231491 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f8fac039500 0x7f8fac03b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8fc819b450 tx=0x7f8fb4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:34.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.041+0000 7f8fbea00640 1 -- 172.21.15.1:0/428231491 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8fb8073080 con 0x7f8fc8103c50 2024-09-15T22:16:34.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:34.234+0000 7f8fc7200640 1 -- 172.21.15.1:0/428231491 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f8fc8062630 con 0x7f8fac039500 2024-09-15T22:16:34.561 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:16:34 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-z[37327]: 2024-09-15T22:16:34.185+0000 7f2b7e51a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:16:34.561 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:16:34 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-z[37327]: 2024-09-15T22:16:34.246+0000 7f2b7e51a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:16:34.561 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:16:34 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-z[37327]: 2024-09-15T22:16:34.433+0000 7f2b7e51a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:16:34.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:34 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:34.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:34 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:34.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:34 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:34.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:34 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:16:34.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:34 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T22:16:34.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:34 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:16:34.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:34 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:34.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:34 smithi098 ceph-mon[35514]: Deploying daemon mgr.y on smithi012 2024-09-15T22:16:34.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:34 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:16:34.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:34 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:16:34.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:34 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:34.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:34 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:34.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:34 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:34.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:34 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:34.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:34 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:16:34.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:34 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T22:16:34.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:34 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:16:34.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:34 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:34.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:34 smithi001 ceph-mon[30843]: Deploying daemon mgr.y on smithi012 2024-09-15T22:16:34.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:34 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:16:34.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:34 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:16:34.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:34 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:34.660 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:34 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:34.660 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:34 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:34.660 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:34 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:34.660 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:34 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:16:34.660 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:34 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T22:16:34.660 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:34 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:16:34.660 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:34 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:34.660 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:34 smithi012 ceph-mon[34883]: Deploying daemon mgr.y on smithi012 2024-09-15T22:16:34.660 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:34 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:16:34.661 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:34 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:16:34.661 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:34 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:35.246 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:16:35 smithi012 systemd[1]: Starting Ceph mgr.y for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:16:35.567 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:35 smithi012 ceph-mon[34883]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:35.567 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:35 smithi012 ceph-mon[34883]: from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:16:35.567 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:16:35 smithi012 podman[36237]: 2024-09-15 22:16:35.213156854 +0000 UTC m=+0.015425738 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:16:35.567 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:16:35 smithi012 podman[36237]: 2024-09-15 22:16:35.344347372 +0000 UTC m=+0.146616286 container create 6f9a44e75bf685e5a74cbc839057c965a73fdcf6440119c1e3f774a0edbf0873 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-y, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, ceph=True) 2024-09-15T22:16:35.567 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:16:35 smithi012 podman[36237]: 2024-09-15 22:16:35.538291199 +0000 UTC m=+0.340560071 container init 6f9a44e75bf685e5a74cbc839057c965a73fdcf6440119c1e3f774a0edbf0873 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-15T22:16:35.567 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:16:35 smithi012 podman[36237]: 2024-09-15 22:16:35.541756105 +0000 UTC m=+0.344024977 container start 6f9a44e75bf685e5a74cbc839057c965a73fdcf6440119c1e3f774a0edbf0873 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e) 2024-09-15T22:16:35.616 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:35 smithi098 ceph-mon[35514]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:35.616 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:35 smithi098 ceph-mon[35514]: from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:16:35.617 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:16:35 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-z[37327]: 2024-09-15T22:16:35.355+0000 7f2b7e51a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:16:35.617 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:16:35 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-z[37327]: 2024-09-15T22:16:35.425+0000 7f2b7e51a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:16:35.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:35 smithi001 ceph-mon[30843]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:35.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:35 smithi001 ceph-mon[30843]: from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:16:35.891 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:16:35 smithi012 ceph-mgr[36256]: -- 172.21.15.12:0/3466915352 <== mon.2 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55eaa26650e0 con 0x55eaa2642800 2024-09-15T22:16:35.891 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:16:35 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-15T22:16:35.662+0000 7f8fbb947040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:16:35.891 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:16:35 smithi012 bash[36237]: 6f9a44e75bf685e5a74cbc839057c965a73fdcf6440119c1e3f774a0edbf0873 2024-09-15T22:16:35.891 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:16:35 smithi012 systemd[1]: Started Ceph mgr.y for c1228c44-73af-11ef-bceb-c7b262605968. 2024-09-15T22:16:35.891 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:16:35 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-15T22:16:35.732+0000 7f8fbb947040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:16:35.891 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:16:35 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-15T22:16:35.889+0000 7f8fbb947040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:16:36.246 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:16:35 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-15T22:16:35.958+0000 7f8fbb947040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:16:36.246 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:16:36 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-15T22:16:36.114+0000 7f8fbb947040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:16:36.465 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:16:36 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-z[37327]: 2024-09-15T22:16:36.170+0000 7f2b7e51a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:16:36.465 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:16:36 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-z[37327]: 2024-09-15T22:16:36.317+0000 7f2b7e51a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:16:36.465 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:16:36 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-z[37327]: 2024-09-15T22:16:36.462+0000 7f2b7e51a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:16:36.585 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:16:36 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-15T22:16:36.274+0000 7f8fbb947040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:16:36.749 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:16:36 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-z[37327]: 2024-09-15T22:16:36.524+0000 7f2b7e51a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:16:36.749 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:16:36 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-z[37327]: 2024-09-15T22:16:36.679+0000 7f2b7e51a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:16:36.875 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:36 smithi012 ceph-mon[34883]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:36.875 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:36 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:36.876 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:36 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:36.876 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:36 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:36.876 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:36 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:36.876 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:36 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:36.876 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:36 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:36.876 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:16:36 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-15T22:16:36.612+0000 7f8fbb947040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:16:36.876 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:16:36 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-15T22:16:36.676+0000 7f8fbb947040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:16:36.876 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:16:36 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-15T22:16:36.873+0000 7f8fbb947040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:16:37.022 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:36 smithi001 ceph-mon[30843]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:37.022 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:36 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:37.022 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:36 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:37.022 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:36 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:37.022 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:36 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:37.022 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:36 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:37.022 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:36 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:37.046 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:16:36 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-z[37327]: 2024-09-15T22:16:36.750+0000 7f2b7e51a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:16:37.046 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:16:36 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-z[37327]: 2024-09-15T22:16:36.811+0000 7f2b7e51a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:16:37.046 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:16:36 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-z[37327]: 2024-09-15T22:16:36.972+0000 7f2b7e51a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:16:37.046 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:16:37 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-z[37327]: 2024-09-15T22:16:37.044+0000 7f2b7e51a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:16:37.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:36 smithi098 ceph-mon[35514]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:37.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:36 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:37.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:36 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:37.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:36 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:37.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:36 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:37.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:36 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:37.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:36 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:37.311 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:16:37 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-z[37327]: 2024-09-15T22:16:37.110+0000 7f2b7e51a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:16:37.311 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:16:37 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-z[37327]: 2024-09-15T22:16:37.196+0000 7f2b7e51a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:16:37.311 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:16:37 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-z[37327]: 2024-09-15T22:16:37.256+0000 7f2b7e51a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:16:37.810 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:16:37 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-z[37327]: 2024-09-15T22:16:37.315+0000 7f2b7e51a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:16:38.246 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:16:37 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-15T22:16:37.804+0000 7f8fbb947040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:16:38.246 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:16:37 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-15T22:16:37.873+0000 7f8fbb947040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:16:38.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:37 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:38.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:37 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:38.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:37 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:38.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:37 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:38.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:37 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:38.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:37 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:38.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:37 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:38.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:37 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:38.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:37 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:38.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:37 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:38.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:37 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:38.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:37 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/562140589' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "28228d47-bbb7-4103-a4fb-3e126769f8bd"}]: dispatch 2024-09-15T22:16:38.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:37 smithi012 ceph-mon[34883]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "28228d47-bbb7-4103-a4fb-3e126769f8bd"}]: dispatch 2024-09-15T22:16:38.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:37 smithi012 ceph-mon[34883]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "28228d47-bbb7-4103-a4fb-3e126769f8bd"}]': finished 2024-09-15T22:16:38.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:37 smithi012 ceph-mon[34883]: osdmap e5: 1 total, 0 up, 1 in 2024-09-15T22:16:38.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:37 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:16:38.311 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:16:38 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-z[37327]: 2024-09-15T22:16:38.099+0000 7f2b7e51a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:16:38.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:37 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:38.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:37 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:38.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:37 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:38.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:37 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:38.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:37 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:38.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:37 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:38.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:37 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:38.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:37 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:38.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:37 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:38.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:37 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:38.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:37 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:38.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:37 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/562140589' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "28228d47-bbb7-4103-a4fb-3e126769f8bd"}]: dispatch 2024-09-15T22:16:38.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:37 smithi098 ceph-mon[35514]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "28228d47-bbb7-4103-a4fb-3e126769f8bd"}]: dispatch 2024-09-15T22:16:38.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:37 smithi098 ceph-mon[35514]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "28228d47-bbb7-4103-a4fb-3e126769f8bd"}]': finished 2024-09-15T22:16:38.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:37 smithi098 ceph-mon[35514]: osdmap e5: 1 total, 0 up, 1 in 2024-09-15T22:16:38.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:37 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:16:38.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:37 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:38.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:37 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:38.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:37 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:38.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:37 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:38.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:37 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:38.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:37 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:38.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:37 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:38.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:37 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:38.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:37 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:38.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:37 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:38.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:37 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:38.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:37 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/562140589' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "28228d47-bbb7-4103-a4fb-3e126769f8bd"}]: dispatch 2024-09-15T22:16:38.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:37 smithi001 ceph-mon[30843]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "28228d47-bbb7-4103-a4fb-3e126769f8bd"}]: dispatch 2024-09-15T22:16:38.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:37 smithi001 ceph-mon[30843]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "28228d47-bbb7-4103-a4fb-3e126769f8bd"}]': finished 2024-09-15T22:16:38.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:37 smithi001 ceph-mon[30843]: osdmap e5: 1 total, 0 up, 1 in 2024-09-15T22:16:38.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:37 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:16:38.888 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:16:38 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-15T22:16:38.619+0000 7f8fbb947040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:16:38.888 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:16:38 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-15T22:16:38.738+0000 7f8fbb947040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:16:38.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:38.939+0000 7f8fbea00640 1 -- 172.21.15.1:0/428231491 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 14) ==== 92407+0+0 (secure 0 0 0) 0x7f8fb803b460 con 0x7f8fc8103c50 2024-09-15T22:16:39.177 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:38 smithi012 ceph-mon[34883]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:39.177 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:38 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/3829827041' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:16:39.177 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:38 smithi012 ceph-mon[34883]: Standby manager daemon z started 2024-09-15T22:16:39.177 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:38 smithi012 ceph-mon[34883]: from='mgr.? 172.21.15.98:0/303290112' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-15T22:16:39.177 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:38 smithi012 ceph-mon[34883]: from='mgr.? 172.21.15.98:0/303290112' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:16:39.177 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:38 smithi012 ceph-mon[34883]: from='mgr.? 172.21.15.98:0/303290112' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-15T22:16:39.177 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:38 smithi012 ceph-mon[34883]: from='mgr.? 172.21.15.98:0/303290112' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:16:39.177 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:16:38 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-15T22:16:38.886+0000 7f8fbb947040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:16:39.177 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:16:38 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-15T22:16:38.950+0000 7f8fbb947040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:16:39.178 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:16:39 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-15T22:16:39.104+0000 7f8fbb947040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:16:39.178 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:16:39 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-15T22:16:39.174+0000 7f8fbb947040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:16:39.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:38 smithi098 ceph-mon[35514]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:39.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:38 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/3829827041' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:16:39.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:38 smithi098 ceph-mon[35514]: Standby manager daemon z started 2024-09-15T22:16:39.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:38 smithi098 ceph-mon[35514]: from='mgr.? 172.21.15.98:0/303290112' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-15T22:16:39.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:38 smithi098 ceph-mon[35514]: from='mgr.? 172.21.15.98:0/303290112' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:16:39.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:38 smithi098 ceph-mon[35514]: from='mgr.? 172.21.15.98:0/303290112' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-15T22:16:39.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:38 smithi098 ceph-mon[35514]: from='mgr.? 172.21.15.98:0/303290112' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:16:39.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:38 smithi001 ceph-mon[30843]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:39.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:38 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/3829827041' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:16:39.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:38 smithi001 ceph-mon[30843]: Standby manager daemon z started 2024-09-15T22:16:39.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:38 smithi001 ceph-mon[30843]: from='mgr.? 172.21.15.98:0/303290112' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-15T22:16:39.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:38 smithi001 ceph-mon[30843]: from='mgr.? 172.21.15.98:0/303290112' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:16:39.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:38 smithi001 ceph-mon[30843]: from='mgr.? 172.21.15.98:0/303290112' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-15T22:16:39.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:38 smithi001 ceph-mon[30843]: from='mgr.? 172.21.15.98:0/303290112' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:16:39.469 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:16:39 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-15T22:16:39.237+0000 7f8fbb947040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:16:39.469 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:16:39 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-15T22:16:39.400+0000 7f8fbb947040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:16:39.469 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:16:39 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-15T22:16:39.467+0000 7f8fbb947040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:16:39.745 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:16:39 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-15T22:16:39.536+0000 7f8fbb947040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:16:39.746 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:16:39 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-15T22:16:39.622+0000 7f8fbb947040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:16:39.746 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:16:39 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-15T22:16:39.683+0000 7f8fbb947040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:16:40.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:39 smithi012 ceph-mon[34883]: mgrmap e14: x(active, since 67s), standbys: z 2024-09-15T22:16:40.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:39 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-15T22:16:40.246 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:16:39 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-15T22:16:39.744+0000 7f8fbb947040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:16:40.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:39 smithi098 ceph-mon[35514]: mgrmap e14: x(active, since 67s), standbys: z 2024-09-15T22:16:40.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:39 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-15T22:16:40.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:39 smithi001 ceph-mon[30843]: mgrmap e14: x(active, since 67s), standbys: z 2024-09-15T22:16:40.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:39 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-15T22:16:40.950 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:16:40 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-15T22:16:40.566+0000 7f8fbb947040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:16:40.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:40.959+0000 7f8fbea00640 1 -- 172.21.15.1:0/428231491 <== mon.1 v2:172.21.15.98:3300/0 8 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7f8fb803c030 con 0x7f8fc8103c50 2024-09-15T22:16:41.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:40 smithi012 ceph-mon[34883]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:41.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:40 smithi012 ceph-mon[34883]: Standby manager daemon y started 2024-09-15T22:16:41.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:40 smithi012 ceph-mon[34883]: from='mgr.? 172.21.15.12:0/2704129650' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-15T22:16:41.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:40 smithi012 ceph-mon[34883]: from='mgr.? 172.21.15.12:0/2704129650' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:16:41.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:40 smithi012 ceph-mon[34883]: from='mgr.? 172.21.15.12:0/2704129650' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-15T22:16:41.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:40 smithi012 ceph-mon[34883]: from='mgr.? 172.21.15.12:0/2704129650' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:16:41.313 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:40 smithi098 ceph-mon[35514]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:41.313 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:40 smithi098 ceph-mon[35514]: Standby manager daemon y started 2024-09-15T22:16:41.313 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:40 smithi098 ceph-mon[35514]: from='mgr.? 172.21.15.12:0/2704129650' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-15T22:16:41.313 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:40 smithi098 ceph-mon[35514]: from='mgr.? 172.21.15.12:0/2704129650' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:16:41.313 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:40 smithi098 ceph-mon[35514]: from='mgr.? 172.21.15.12:0/2704129650' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-15T22:16:41.313 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:40 smithi098 ceph-mon[35514]: from='mgr.? 172.21.15.12:0/2704129650' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:16:41.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:40 smithi001 ceph-mon[30843]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:41.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:40 smithi001 ceph-mon[30843]: Standby manager daemon y started 2024-09-15T22:16:41.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:40 smithi001 ceph-mon[30843]: from='mgr.? 172.21.15.12:0/2704129650' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-15T22:16:41.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:40 smithi001 ceph-mon[30843]: from='mgr.? 172.21.15.12:0/2704129650' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:16:41.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:40 smithi001 ceph-mon[30843]: from='mgr.? 172.21.15.12:0/2704129650' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-15T22:16:41.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:40 smithi001 ceph-mon[30843]: from='mgr.? 172.21.15.12:0/2704129650' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:16:42.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:41 smithi012 ceph-mon[34883]: mgrmap e15: x(active, since 69s), standbys: z, y 2024-09-15T22:16:42.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:41 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T22:16:42.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:41 smithi098 ceph-mon[35514]: mgrmap e15: x(active, since 69s), standbys: z, y 2024-09-15T22:16:42.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:41 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T22:16:42.367 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:41 smithi001 ceph-mon[30843]: mgrmap e15: x(active, since 69s), standbys: z, y 2024-09-15T22:16:42.367 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:41 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T22:16:43.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:42 smithi001 ceph-mon[30843]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:43.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:42 smithi012 ceph-mon[34883]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:43.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:42 smithi098 ceph-mon[35514]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:45.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:44 smithi001 ceph-mon[30843]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:45.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:44 smithi012 ceph-mon[34883]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:45.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:44 smithi098 ceph-mon[35514]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:47.236 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:46 smithi001 ceph-mon[30843]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:47.237 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:46 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-15T22:16:47.237 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:46 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:47.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:46 smithi012 ceph-mon[34883]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:47.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:46 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-15T22:16:47.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:46 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:47.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:46 smithi098 ceph-mon[35514]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:47.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:46 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-15T22:16:47.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:46 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:48.241 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:47 smithi001 ceph-mon[30843]: Deploying daemon osd.0 on smithi001 2024-09-15T22:16:48.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:47 smithi012 ceph-mon[34883]: Deploying daemon osd.0 on smithi001 2024-09-15T22:16:48.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:47 smithi098 ceph-mon[35514]: Deploying daemon osd.0 on smithi001 2024-09-15T22:16:49.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:48 smithi012 ceph-mon[34883]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:49.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:48 smithi098 ceph-mon[35514]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:49.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:48 smithi001 ceph-mon[30843]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:51.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:50 smithi012 ceph-mon[34883]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:51.278 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:50 smithi001 ceph-mon[30843]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:51.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:50 smithi098 ceph-mon[35514]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:53.117 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:52 smithi001 ceph-mon[30843]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:53.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:52 smithi012 ceph-mon[34883]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:53.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:52 smithi098 ceph-mon[35514]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:55.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:54 smithi012 ceph-mon[34883]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:55.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:54 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:55.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:54 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:55.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:54 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:55.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:54 smithi098 ceph-mon[35514]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:55.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:54 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:55.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:54 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:55.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:54 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:55.370 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:54 smithi001 ceph-mon[30843]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:55.370 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:54 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:55.371 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:54 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:55.371 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:54 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:57.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:56 smithi012 ceph-mon[34883]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:57.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:56 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:57.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:56 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:57.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:56 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:57.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:56 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:57.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:56 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:57.265 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:56 smithi001 ceph-mon[30843]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:57.266 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:56 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:57.266 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:56 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:57.266 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:56 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:57.266 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:56 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:57.266 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:56 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:57.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:56 smithi098 ceph-mon[35514]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:57.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:56 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:57.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:56 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:57.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:56 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:57.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:56 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:57.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:56 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:16:59.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:58 smithi012 ceph-mon[34883]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:59.260 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:58 smithi001 ceph-mon[30843]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:59.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:58 smithi098 ceph-mon[35514]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:16:59.312 INFO:teuthology.orchestra.run.smithi001.stdout:Created osd(s) 0 on host 'smithi001' 2024-09-15T22:16:59.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:59.308+0000 7f8fbea00640 1 -- 172.21.15.1:0/428231491 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8fc8062630 con 0x7f8fac039500 2024-09-15T22:16:59.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:59.310+0000 7f8fc7200640 1 -- 172.21.15.1:0/428231491 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f8fac039500 msgr2=0x7f8fac03b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:59.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:59.310+0000 7f8fc7200640 1 --2- 172.21.15.1:0/428231491 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f8fac039500 0x7f8fac03b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8fc819b450 tx=0x7f8fb4005f90 comp rx=0 tx=0).stop 2024-09-15T22:16:59.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:59.310+0000 7f8fc7200640 1 -- 172.21.15.1:0/428231491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fc8103c50 msgr2=0x7f8fc8199f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:59.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:59.310+0000 7f8fc7200640 1 --2- 172.21.15.1:0/428231491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fc8103c50 0x7f8fc8199f30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8031610 tx=0x7f8fb8004270 comp rx=0 tx=0).stop 2024-09-15T22:16:59.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:59.310+0000 7f8fc7200640 1 -- 172.21.15.1:0/428231491 shutdown_connections 2024-09-15T22:16:59.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:59.310+0000 7f8fc7200640 1 --2- 172.21.15.1:0/428231491 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f8fac039500 0x7f8fac03b9c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:59.310+0000 7f8fc7200640 1 --2- 172.21.15.1:0/428231491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fc8105810 0x7f8fc81a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:59.310+0000 7f8fc7200640 1 --2- 172.21.15.1:0/428231491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fc8104e50 0x7f8fc819a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:59.310+0000 7f8fc7200640 1 --2- 172.21.15.1:0/428231491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fc8103c50 0x7f8fc8199f30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:59.310+0000 7f8fc7200640 1 -- 172.21.15.1:0/428231491 >> 172.21.15.1:0/428231491 conn(0x7f8fc80ff3e0 msgr2=0x7f8fc8108220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:59.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:59.310+0000 7f8fc7200640 1 -- 172.21.15.1:0/428231491 shutdown_connections 2024-09-15T22:16:59.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:16:59.310+0000 7f8fc7200640 1 -- 172.21.15.1:0/428231491 wait complete. 2024-09-15T22:16:59.999 DEBUG:teuthology.orchestra.run.smithi001:osd.0> sudo journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.0.service 2024-09-15T22:17:00.003 INFO:tasks.cephadm:Deploying osd.1 on smithi012 with /dev/vg_nvme/lv_4... 2024-09-15T22:17:00.003 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-15T22:17:00.240 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:59 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:17:00.240 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:59 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:00.240 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:16:59 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:00.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:59 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:17:00.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:59 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:00.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:16:59 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:00.262 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:17:00.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:59 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:17:00.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:59 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:00.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:16:59 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:01.246 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 15 22:17:00 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-0[42251]: 2024-09-15T22:17:00.952+0000 7ffa48411640 -1 osd.0 0 log_to_monitors true 2024-09-15T22:17:01.513 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:01 smithi001 ceph-mon[30843]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:17:01.514 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:01 smithi001 ceph-mon[30843]: from='osd.0 [v2:172.21.15.1:6802/3588868833,v1:172.21.15.1:6803/3588868833]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-15T22:17:01.625 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:01 smithi012 ceph-mon[34883]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:17:01.625 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:01 smithi012 ceph-mon[34883]: from='osd.0 [v2:172.21.15.1:6802/3588868833,v1:172.21.15.1:6803/3588868833]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-15T22:17:01.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:01 smithi098 ceph-mon[35514]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:17:01.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:01 smithi098 ceph-mon[35514]: from='osd.0 [v2:172.21.15.1:6802/3588868833,v1:172.21.15.1:6803/3588868833]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-15T22:17:02.616 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:02 smithi012 ceph-mon[34883]: from='osd.0 [v2:172.21.15.1:6802/3588868833,v1:172.21.15.1:6803/3588868833]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-15T22:17:02.616 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:02 smithi012 ceph-mon[34883]: osdmap e6: 1 total, 0 up, 1 in 2024-09-15T22:17:02.616 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:02 smithi012 ceph-mon[34883]: from='osd.0 [v2:172.21.15.1:6802/3588868833,v1:172.21.15.1:6803/3588868833]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-15T22:17:02.617 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:02 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:17:02.617 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:02 smithi012 ceph-mon[34883]: from='osd.0 [v2:172.21.15.1:6802/3588868833,v1:172.21.15.1:6803/3588868833]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-15T22:17:02.617 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:02 smithi012 ceph-mon[34883]: osdmap e7: 1 total, 0 up, 1 in 2024-09-15T22:17:02.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:02 smithi001 ceph-mon[30843]: from='osd.0 [v2:172.21.15.1:6802/3588868833,v1:172.21.15.1:6803/3588868833]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-15T22:17:02.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:02 smithi001 ceph-mon[30843]: osdmap e6: 1 total, 0 up, 1 in 2024-09-15T22:17:02.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:02 smithi001 ceph-mon[30843]: from='osd.0 [v2:172.21.15.1:6802/3588868833,v1:172.21.15.1:6803/3588868833]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-15T22:17:02.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:02 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:17:02.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:02 smithi001 ceph-mon[30843]: from='osd.0 [v2:172.21.15.1:6802/3588868833,v1:172.21.15.1:6803/3588868833]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-15T22:17:02.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:02 smithi001 ceph-mon[30843]: osdmap e7: 1 total, 0 up, 1 in 2024-09-15T22:17:02.627 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 15 22:17:02 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-0[42251]: 2024-09-15T22:17:02.331+0000 7ffa42600640 -1 osd.0 0 waiting for initial osdmap 2024-09-15T22:17:02.627 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 15 22:17:02 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-0[42251]: 2024-09-15T22:17:02.335+0000 7ffa3e000640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:17:02.740 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-15T22:17:02.765 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi012:vg_nvme/lv_4 2024-09-15T22:17:02.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:02 smithi098 ceph-mon[35514]: from='osd.0 [v2:172.21.15.1:6802/3588868833,v1:172.21.15.1:6803/3588868833]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-15T22:17:02.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:02 smithi098 ceph-mon[35514]: osdmap e6: 1 total, 0 up, 1 in 2024-09-15T22:17:02.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:02 smithi098 ceph-mon[35514]: from='osd.0 [v2:172.21.15.1:6802/3588868833,v1:172.21.15.1:6803/3588868833]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-15T22:17:02.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:02 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:17:02.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:02 smithi098 ceph-mon[35514]: from='osd.0 [v2:172.21.15.1:6802/3588868833,v1:172.21.15.1:6803/3588868833]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-15T22:17:02.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:02 smithi098 ceph-mon[35514]: osdmap e7: 1 total, 0 up, 1 in 2024-09-15T22:17:03.025 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:17:03.361 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:03 smithi001 ceph-mon[30843]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:17:03.362 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:03 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:17:03.362 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:03 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:17:03.409 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:03 smithi012 ceph-mon[34883]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:17:03.409 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:03 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:17:03.409 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:03 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:17:03.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.498+0000 7fd703ae3640 1 -- 172.21.15.12:0/757438443 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6fc0fff10 msgr2=0x7fd6fc100310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:03.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.498+0000 7fd703ae3640 1 --2- 172.21.15.12:0/757438443 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6fc0fff10 0x7fd6fc100310 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8009900 tx=0x7fd6f802a410 comp rx=0 tx=0).stop 2024-09-15T22:17:03.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.498+0000 7fd703ae3640 1 -- 172.21.15.12:0/757438443 shutdown_connections 2024-09-15T22:17:03.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.498+0000 7fd703ae3640 1 --2- 172.21.15.12:0/757438443 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6fc1038b0 0x7fd6fc10a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:03.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.498+0000 7fd703ae3640 1 --2- 172.21.15.12:0/757438443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6fc102ef0 0x7fd6fc103370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:03.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.498+0000 7fd703ae3640 1 --2- 172.21.15.12:0/757438443 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6fc0fff10 0x7fd6fc100310 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:03.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.498+0000 7fd703ae3640 1 -- 172.21.15.12:0/757438443 >> 172.21.15.12:0/757438443 conn(0x7fd6fc0fba80 msgr2=0x7fd6fc0fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:03.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.498+0000 7fd703ae3640 1 -- 172.21.15.12:0/757438443 shutdown_connections 2024-09-15T22:17:03.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.498+0000 7fd703ae3640 1 -- 172.21.15.12:0/757438443 wait complete. 2024-09-15T22:17:03.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.499+0000 7fd703ae3640 1 Processor -- start 2024-09-15T22:17:03.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.499+0000 7fd703ae3640 1 -- start start 2024-09-15T22:17:03.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.499+0000 7fd703ae3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6fc0fff10 0x7fd6fc197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:03.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.499+0000 7fd703ae3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6fc102ef0 0x7fd6fc198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:03.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.499+0000 7fd703ae3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6fc1038b0 0x7fd6fc19f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:03.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.499+0000 7fd703ae3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd6fc10d8d0 con 0x7fd6fc102ef0 2024-09-15T22:17:03.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.499+0000 7fd703ae3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd6fc10d750 con 0x7fd6fc0fff10 2024-09-15T22:17:03.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.499+0000 7fd703ae3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd6fc10da50 con 0x7fd6fc1038b0 2024-09-15T22:17:03.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.499+0000 7fd70187f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6fc0fff10 0x7fd6fc197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:03.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.499+0000 7fd70187f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6fc0fff10 0x7fd6fc197f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54758/0 (socket says 172.21.15.12:54758) 2024-09-15T22:17:03.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.499+0000 7fd70187f640 1 -- 172.21.15.12:0/3482810134 learned_addr learned my addr 172.21.15.12:0/3482810134 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-15T22:17:03.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.499+0000 7fd70107e640 1 --2- 172.21.15.12:0/3482810134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6fc102ef0 0x7fd6fc198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:03.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.499+0000 7fd702080640 1 --2- 172.21.15.12:0/3482810134 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6fc1038b0 0x7fd6fc19f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:03.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.499+0000 7fd70187f640 1 -- 172.21.15.12:0/3482810134 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6fc1038b0 msgr2=0x7fd6fc19f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:03.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.499+0000 7fd70187f640 1 --2- 172.21.15.12:0/3482810134 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6fc1038b0 0x7fd6fc19f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:03.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.499+0000 7fd70187f640 1 -- 172.21.15.12:0/3482810134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6fc102ef0 msgr2=0x7fd6fc198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:03.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.499+0000 7fd70187f640 1 --2- 172.21.15.12:0/3482810134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6fc102ef0 0x7fd6fc198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:03.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.499+0000 7fd70187f640 1 -- 172.21.15.12:0/3482810134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6fc19fb50 con 0x7fd6fc0fff10 2024-09-15T22:17:03.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.499+0000 7fd70107e640 1 --2- 172.21.15.12:0/3482810134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6fc102ef0 0x7fd6fc198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:17:03.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.500+0000 7fd70187f640 1 --2- 172.21.15.12:0/3482810134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6fc0fff10 0x7fd6fc197f20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80315a0 tx=0x7fd6f8032c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:03.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.500+0000 7fd6f2ffd640 1 -- 172.21.15.12:0/3482810134 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f803f030 con 0x7fd6fc0fff10 2024-09-15T22:17:03.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.500+0000 7fd6f2ffd640 1 -- 172.21.15.12:0/3482810134 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6f8003ce0 con 0x7fd6fc0fff10 2024-09-15T22:17:03.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.500+0000 7fd6f2ffd640 1 -- 172.21.15.12:0/3482810134 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8035070 con 0x7fd6fc0fff10 2024-09-15T22:17:03.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.500+0000 7fd703ae3640 1 -- 172.21.15.12:0/3482810134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6fc19fde0 con 0x7fd6fc0fff10 2024-09-15T22:17:03.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.500+0000 7fd703ae3640 1 -- 172.21.15.12:0/3482810134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6fc1a01b0 con 0x7fd6fc0fff10 2024-09-15T22:17:03.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.501+0000 7fd703ae3640 1 -- 172.21.15.12:0/3482810134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6e00052c0 con 0x7fd6fc0fff10 2024-09-15T22:17:03.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.502+0000 7fd6f2ffd640 1 -- 172.21.15.12:0/3482810134 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7fd6f8042030 con 0x7fd6fc0fff10 2024-09-15T22:17:03.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.503+0000 7fd6f2ffd640 1 --2- 172.21.15.12:0/3482810134 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fd6e80a3260 0x7fd6e80a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:03.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.503+0000 7fd6f2ffd640 1 -- 172.21.15.12:0/3482810134 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1767+0+0 (secure 0 0 0) 0x7fd6f80ee160 con 0x7fd6fc0fff10 2024-09-15T22:17:03.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.503+0000 7fd70107e640 1 --2- 172.21.15.12:0/3482810134 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fd6e80a3260 0x7fd6e80a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:03.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.503+0000 7fd70107e640 1 --2- 172.21.15.12:0/3482810134 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fd6e80a3260 0x7fd6e80a5720 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc199440 tx=0x7fd6ec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:03.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.508+0000 7fd6f2ffd640 1 -- 172.21.15.12:0/3482810134 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd6f80bc8f0 con 0x7fd6fc0fff10 2024-09-15T22:17:03.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:03.696+0000 7fd703ae3640 1 -- 172.21.15.12:0/3482810134 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fd6e0000bf0 con 0x7fd6e80a3260 2024-09-15T22:17:03.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:03 smithi098 ceph-mon[35514]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:17:03.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:03 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:17:03.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:03 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:17:04.376 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:04 smithi012 ceph-mon[34883]: purged_snaps scrub starts 2024-09-15T22:17:04.377 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:04 smithi012 ceph-mon[34883]: purged_snaps scrub ok 2024-09-15T22:17:04.377 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:04 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:17:04.377 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:04 smithi012 ceph-mon[34883]: osd.0 [v2:172.21.15.1:6802/3588868833,v1:172.21.15.1:6803/3588868833] boot 2024-09-15T22:17:04.377 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:04 smithi012 ceph-mon[34883]: osdmap e8: 1 total, 1 up, 1 in 2024-09-15T22:17:04.377 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:04 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:17:04.377 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:04 smithi012 ceph-mon[34883]: Detected new or changed devices on smithi001 2024-09-15T22:17:04.377 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:04 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:04.377 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:04 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:04.377 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:04 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:17:04.377 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:04 smithi012 ceph-mon[34883]: Adjusting osd_memory_target on smithi001 to 17094M 2024-09-15T22:17:04.377 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:04 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:04.378 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:04 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:17:04.378 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:04 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:17:04.378 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:04 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:04.378 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:04 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:17:04.378 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:04 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:17:04.378 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:04 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:17:04.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:04 smithi001 ceph-mon[30843]: purged_snaps scrub starts 2024-09-15T22:17:04.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:04 smithi001 ceph-mon[30843]: purged_snaps scrub ok 2024-09-15T22:17:04.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:04 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:17:04.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:04 smithi001 ceph-mon[30843]: osd.0 [v2:172.21.15.1:6802/3588868833,v1:172.21.15.1:6803/3588868833] boot 2024-09-15T22:17:04.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:04 smithi001 ceph-mon[30843]: osdmap e8: 1 total, 1 up, 1 in 2024-09-15T22:17:04.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:04 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:17:04.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:04 smithi001 ceph-mon[30843]: Detected new or changed devices on smithi001 2024-09-15T22:17:04.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:04 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:04.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:04 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:04.628 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:04 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:17:04.628 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:04 smithi001 ceph-mon[30843]: Adjusting osd_memory_target on smithi001 to 17094M 2024-09-15T22:17:04.628 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:04 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:04.628 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:04 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:17:04.628 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:04 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:17:04.628 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:04 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:04.628 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:04 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:17:04.628 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:04 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:17:04.628 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:04 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:17:04.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:04 smithi098 ceph-mon[35514]: purged_snaps scrub starts 2024-09-15T22:17:04.813 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:04 smithi098 ceph-mon[35514]: purged_snaps scrub ok 2024-09-15T22:17:04.813 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:04 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:17:04.813 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:04 smithi098 ceph-mon[35514]: osd.0 [v2:172.21.15.1:6802/3588868833,v1:172.21.15.1:6803/3588868833] boot 2024-09-15T22:17:04.813 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:04 smithi098 ceph-mon[35514]: osdmap e8: 1 total, 1 up, 1 in 2024-09-15T22:17:04.813 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:04 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:17:04.813 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:04 smithi098 ceph-mon[35514]: Detected new or changed devices on smithi001 2024-09-15T22:17:04.813 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:04 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:04.813 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:04 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:04.813 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:04 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:17:04.813 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:04 smithi098 ceph-mon[35514]: Adjusting osd_memory_target on smithi001 to 17094M 2024-09-15T22:17:04.813 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:04 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:04.813 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:04 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:17:04.813 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:04 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:17:04.814 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:04 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:04.814 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:04 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:17:04.814 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:04 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:17:04.814 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:04 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:17:05.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:05 smithi012 ceph-mon[34883]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:17:05.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:05 smithi012 ceph-mon[34883]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:17:05.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:05 smithi012 ceph-mon[34883]: osdmap e9: 1 total, 1 up, 1 in 2024-09-15T22:17:05.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:05 smithi098 ceph-mon[35514]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:17:05.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:05 smithi098 ceph-mon[35514]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:17:05.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:05 smithi098 ceph-mon[35514]: osdmap e9: 1 total, 1 up, 1 in 2024-09-15T22:17:05.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:05 smithi001 ceph-mon[30843]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:17:05.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:05 smithi001 ceph-mon[30843]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:17:05.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:05 smithi001 ceph-mon[30843]: osdmap e9: 1 total, 1 up, 1 in 2024-09-15T22:17:06.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:06 smithi012 ceph-mon[34883]: from='client.? 172.21.15.12:0/657060058' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d90dd2c1-2047-4491-8730-30793a354aa4"}]: dispatch 2024-09-15T22:17:06.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:06 smithi012 ceph-mon[34883]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d90dd2c1-2047-4491-8730-30793a354aa4"}]: dispatch 2024-09-15T22:17:06.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:06 smithi012 ceph-mon[34883]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d90dd2c1-2047-4491-8730-30793a354aa4"}]': finished 2024-09-15T22:17:06.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:06 smithi012 ceph-mon[34883]: osdmap e10: 2 total, 1 up, 2 in 2024-09-15T22:17:06.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:06 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:17:06.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:06 smithi098 ceph-mon[35514]: from='client.? 172.21.15.12:0/657060058' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d90dd2c1-2047-4491-8730-30793a354aa4"}]: dispatch 2024-09-15T22:17:06.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:06 smithi098 ceph-mon[35514]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d90dd2c1-2047-4491-8730-30793a354aa4"}]: dispatch 2024-09-15T22:17:06.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:06 smithi098 ceph-mon[35514]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d90dd2c1-2047-4491-8730-30793a354aa4"}]': finished 2024-09-15T22:17:06.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:06 smithi098 ceph-mon[35514]: osdmap e10: 2 total, 1 up, 2 in 2024-09-15T22:17:06.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:06 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:17:06.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:06 smithi001 ceph-mon[30843]: from='client.? 172.21.15.12:0/657060058' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d90dd2c1-2047-4491-8730-30793a354aa4"}]: dispatch 2024-09-15T22:17:06.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:06 smithi001 ceph-mon[30843]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d90dd2c1-2047-4491-8730-30793a354aa4"}]: dispatch 2024-09-15T22:17:06.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:06 smithi001 ceph-mon[30843]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d90dd2c1-2047-4491-8730-30793a354aa4"}]': finished 2024-09-15T22:17:06.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:06 smithi001 ceph-mon[30843]: osdmap e10: 2 total, 1 up, 2 in 2024-09-15T22:17:06.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:06 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:17:07.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:07 smithi012 ceph-mon[34883]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:07.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:07 smithi012 ceph-mon[34883]: from='client.? 172.21.15.12:0/4000953647' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:17:07.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:07 smithi098 ceph-mon[35514]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:07.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:07 smithi098 ceph-mon[35514]: from='client.? 172.21.15.12:0/4000953647' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:17:07.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:07 smithi001 ceph-mon[30843]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:07.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:07 smithi001 ceph-mon[30843]: from='client.? 172.21.15.12:0/4000953647' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:17:09.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:09 smithi012 ceph-mon[34883]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:09.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:09 smithi098 ceph-mon[35514]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:09.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:09 smithi001 ceph-mon[30843]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:11.663 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:11 smithi012 ceph-mon[34883]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:11.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:11 smithi098 ceph-mon[35514]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:11.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:11 smithi001 ceph-mon[30843]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:13.544 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:13 smithi012 ceph-mon[34883]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:13.813 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:13 smithi098 ceph-mon[35514]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:13.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:13 smithi001 ceph-mon[30843]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:15.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:15 smithi012 ceph-mon[34883]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:15.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:15 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-15T22:17:15.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:15 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:17:15.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:15 smithi001 ceph-mon[30843]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:15.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:15 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-15T22:17:15.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:15 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:17:15.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:15 smithi098 ceph-mon[35514]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:15.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:15 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-15T22:17:15.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:15 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:17:16.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:16 smithi001 ceph-mon[30843]: Deploying daemon osd.1 on smithi012 2024-09-15T22:17:16.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:16 smithi012 ceph-mon[34883]: Deploying daemon osd.1 on smithi012 2024-09-15T22:17:16.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:16 smithi098 ceph-mon[35514]: Deploying daemon osd.1 on smithi012 2024-09-15T22:17:17.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:17 smithi012 ceph-mon[34883]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:17.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:17 smithi098 ceph-mon[35514]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:17.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:17 smithi001 ceph-mon[30843]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:19.712 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:19 smithi012 ceph-mon[34883]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:19.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:19 smithi098 ceph-mon[35514]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:19.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:19 smithi001 ceph-mon[30843]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:21.713 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:21 smithi012 ceph-mon[34883]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:21.713 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:21 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:17:21.713 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:21 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:21.713 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:21 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:21.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:21 smithi098 ceph-mon[35514]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:21.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:21 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:17:21.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:21 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:21.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:21 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:21.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:21 smithi001 ceph-mon[30843]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:21.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:21 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:17:21.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:21 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:21.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:21 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:22.651 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:22 smithi012 ceph-mon[34883]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:22.814 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:22 smithi098 ceph-mon[35514]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:22.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:22 smithi001 ceph-mon[30843]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:24.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:24.572+0000 7fd6f2ffd640 1 -- 172.21.15.12:0/3482810134 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd6e0000bf0 con 0x7fd6e80a3260 2024-09-15T22:17:24.575 INFO:teuthology.orchestra.run.smithi012.stdout:Created osd(s) 1 on host 'smithi012' 2024-09-15T22:17:24.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:24.575+0000 7fd703ae3640 1 -- 172.21.15.12:0/3482810134 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fd6e80a3260 msgr2=0x7fd6e80a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:24.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:24.575+0000 7fd703ae3640 1 --2- 172.21.15.12:0/3482810134 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fd6e80a3260 0x7fd6e80a5720 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc199440 tx=0x7fd6ec005f90 comp rx=0 tx=0).stop 2024-09-15T22:17:24.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:24.575+0000 7fd703ae3640 1 -- 172.21.15.12:0/3482810134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6fc0fff10 msgr2=0x7fd6fc197f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:24.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:24.575+0000 7fd703ae3640 1 --2- 172.21.15.12:0/3482810134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6fc0fff10 0x7fd6fc197f20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80315a0 tx=0x7fd6f8032c70 comp rx=0 tx=0).stop 2024-09-15T22:17:24.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:24.575+0000 7fd703ae3640 1 -- 172.21.15.12:0/3482810134 shutdown_connections 2024-09-15T22:17:24.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:24.575+0000 7fd703ae3640 1 --2- 172.21.15.12:0/3482810134 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fd6e80a3260 0x7fd6e80a5720 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:24.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:24.575+0000 7fd703ae3640 1 --2- 172.21.15.12:0/3482810134 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6fc1038b0 0x7fd6fc19f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:24.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:24.575+0000 7fd703ae3640 1 --2- 172.21.15.12:0/3482810134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6fc102ef0 0x7fd6fc198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:24.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:24.575+0000 7fd703ae3640 1 --2- 172.21.15.12:0/3482810134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6fc0fff10 0x7fd6fc197f20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:24.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:24.575+0000 7fd703ae3640 1 -- 172.21.15.12:0/3482810134 >> 172.21.15.12:0/3482810134 conn(0x7fd6fc0fba80 msgr2=0x7fd6fc106290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:24.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:24.575+0000 7fd703ae3640 1 -- 172.21.15.12:0/3482810134 shutdown_connections 2024-09-15T22:17:24.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:17:24.575+0000 7fd703ae3640 1 -- 172.21.15.12:0/3482810134 wait complete. 2024-09-15T22:17:24.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:24 smithi001 ceph-mon[30843]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:24.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:24.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:24.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:17:24.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:17:24.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:24.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:17:24.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:24.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:24.878 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:24 smithi012 ceph-mon[34883]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:24.878 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:24.878 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:24.878 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:17:24.878 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:17:24.879 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:24.879 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:17:24.879 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:24.879 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:25.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:24 smithi098 ceph-mon[35514]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:25.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:25.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:25.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:17:25.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:17:25.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:25.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:17:25.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:25.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:25.188 DEBUG:teuthology.orchestra.run.smithi012:osd.1> sudo journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.1.service 2024-09-15T22:17:25.190 INFO:tasks.cephadm:Deploying osd.2 on smithi098 with /dev/vg_nvme/lv_4... 2024-09-15T22:17:25.190 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-15T22:17:25.441 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:17:26.633 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:26 smithi012 ceph-mon[34883]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:26.857 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:26 smithi098 ceph-mon[35514]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:26.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:26 smithi001 ceph-mon[30843]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:27.615 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 15 22:17:27 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-1[39380]: 2024-09-15T22:17:27.285+0000 7f14043e0640 -1 osd.1 0 log_to_monitors true 2024-09-15T22:17:27.761 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:27 smithi098 ceph-mon[35514]: from='osd.1 [v2:172.21.15.12:6800/3951165354,v1:172.21.15.12:6801/3951165354]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T22:17:27.761 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:27 smithi098 ceph-mon[35514]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T22:17:27.764 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-15T22:17:27.791 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi098:vg_nvme/lv_4 2024-09-15T22:17:27.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:27 smithi001 ceph-mon[30843]: from='osd.1 [v2:172.21.15.12:6800/3951165354,v1:172.21.15.12:6801/3951165354]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T22:17:27.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:27 smithi001 ceph-mon[30843]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T22:17:27.982 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:27 smithi012 ceph-mon[34883]: from='osd.1 [v2:172.21.15.12:6800/3951165354,v1:172.21.15.12:6801/3951165354]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T22:17:27.982 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:27 smithi012 ceph-mon[34883]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T22:17:28.040 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:17:28.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.438+0000 7f164c3d2640 1 -- 172.21.15.98:0/4242180022 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1644101bf0 msgr2=0x7f1644101ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:28.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.438+0000 7f164c3d2640 1 --2- 172.21.15.98:0/4242180022 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1644101bf0 0x7f1644101ff0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1634009900 tx=0x7f163402a410 comp rx=0 tx=0).stop 2024-09-15T22:17:28.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.439+0000 7f164c3d2640 1 -- 172.21.15.98:0/4242180022 shutdown_connections 2024-09-15T22:17:28.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.439+0000 7f164c3d2640 1 --2- 172.21.15.98:0/4242180022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16441037b0 0x7f164410a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:28.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.439+0000 7f164c3d2640 1 --2- 172.21.15.98:0/4242180022 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1644102df0 0x7f1644103270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:28.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.439+0000 7f164c3d2640 1 --2- 172.21.15.98:0/4242180022 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1644101bf0 0x7f1644101ff0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:28.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.439+0000 7f164c3d2640 1 -- 172.21.15.98:0/4242180022 >> 172.21.15.98:0/4242180022 conn(0x7f16440fd3c0 msgr2=0x7f16440ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:28.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.439+0000 7f164c3d2640 1 -- 172.21.15.98:0/4242180022 shutdown_connections 2024-09-15T22:17:28.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.439+0000 7f164c3d2640 1 -- 172.21.15.98:0/4242180022 wait complete. 2024-09-15T22:17:28.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.439+0000 7f164c3d2640 1 Processor -- start 2024-09-15T22:17:28.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.439+0000 7f164c3d2640 1 -- start start 2024-09-15T22:17:28.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.439+0000 7f164c3d2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1644101bf0 0x7f1644075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:28.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.439+0000 7f164c3d2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1644102df0 0x7f16440745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:28.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.439+0000 7f164c3d2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16441037b0 0x7f1644074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:28.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.439+0000 7f164c3d2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f164410d8a0 con 0x7f16441037b0 2024-09-15T22:17:28.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.439+0000 7f164c3d2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f164410d720 con 0x7f1644101bf0 2024-09-15T22:17:28.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.439+0000 7f164c3d2640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f164410da20 con 0x7f1644102df0 2024-09-15T22:17:28.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.440+0000 7f164996d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1644102df0 0x7f16440745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:28.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.440+0000 7f164996d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1644102df0 0x7f16440745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48446/0 (socket says 172.21.15.98:48446) 2024-09-15T22:17:28.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.440+0000 7f164996d640 1 -- 172.21.15.98:0/666196363 learned_addr learned my addr 172.21.15.98:0/666196363 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-15T22:17:28.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.440+0000 7f164a16e640 1 --2- 172.21.15.98:0/666196363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1644101bf0 0x7f1644075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:28.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.440+0000 7f164a96f640 1 --2- 172.21.15.98:0/666196363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16441037b0 0x7f1644074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:28.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.440+0000 7f164996d640 1 -- 172.21.15.98:0/666196363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1644101bf0 msgr2=0x7f1644075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:28.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.440+0000 7f164996d640 1 --2- 172.21.15.98:0/666196363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1644101bf0 0x7f1644075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:28.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.440+0000 7f164996d640 1 -- 172.21.15.98:0/666196363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16441037b0 msgr2=0x7f1644074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:28.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.440+0000 7f164996d640 1 --2- 172.21.15.98:0/666196363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16441037b0 0x7f1644074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:28.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.440+0000 7f164996d640 1 -- 172.21.15.98:0/666196363 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16440753e0 con 0x7f1644102df0 2024-09-15T22:17:28.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.440+0000 7f164996d640 1 --2- 172.21.15.98:0/666196363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1644102df0 0x7f16440745e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f164000c890 tx=0x7f164000cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:28.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.440+0000 7f163b7fe640 1 -- 172.21.15.98:0/666196363 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1640004220 con 0x7f1644102df0 2024-09-15T22:17:28.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.440+0000 7f163b7fe640 1 -- 172.21.15.98:0/666196363 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16400043c0 con 0x7f1644102df0 2024-09-15T22:17:28.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.440+0000 7f164c3d2640 1 -- 172.21.15.98:0/666196363 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16441a1ff0 con 0x7f1644102df0 2024-09-15T22:17:28.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.440+0000 7f163b7fe640 1 -- 172.21.15.98:0/666196363 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16400049e0 con 0x7f1644102df0 2024-09-15T22:17:28.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.440+0000 7f164c3d2640 1 -- 172.21.15.98:0/666196363 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16441a24f0 con 0x7f1644102df0 2024-09-15T22:17:28.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.442+0000 7f164c3d2640 1 -- 172.21.15.98:0/666196363 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1644108f40 con 0x7f1644102df0 2024-09-15T22:17:28.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.443+0000 7f163b7fe640 1 -- 172.21.15.98:0/666196363 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7f16400079b0 con 0x7f1644102df0 2024-09-15T22:17:28.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.443+0000 7f163b7fe640 1 --2- 172.21.15.98:0/666196363 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f16300a3230 0x7f16300a56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:28.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.443+0000 7f163b7fe640 1 -- 172.21.15.98:0/666196363 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 1903+0+0 (secure 0 0 0) 0x7f16400cde00 con 0x7f1644102df0 2024-09-15T22:17:28.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.443+0000 7f164a16e640 1 --2- 172.21.15.98:0/666196363 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f16300a3230 0x7f16300a56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:28.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.444+0000 7f164a16e640 1 --2- 172.21.15.98:0/666196363 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f16300a3230 0x7f16300a56f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f163402aa00 tx=0x7f16340315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:28.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.448+0000 7f163b7fe640 1 -- 172.21.15.98:0/666196363 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1640014030 con 0x7f1644102df0 2024-09-15T22:17:28.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:28.639+0000 7f164c3d2640 1 -- 172.21.15.98:0/666196363 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f1644062630 con 0x7f16300a3230 2024-09-15T22:17:28.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:28 smithi098 ceph-mon[35514]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:28.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:28 smithi098 ceph-mon[35514]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-15T22:17:28.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:28 smithi098 ceph-mon[35514]: from='osd.1 [v2:172.21.15.12:6800/3951165354,v1:172.21.15.12:6801/3951165354]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-15T22:17:28.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:28 smithi098 ceph-mon[35514]: osdmap e11: 2 total, 1 up, 2 in 2024-09-15T22:17:28.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:28 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:17:28.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:28 smithi098 ceph-mon[35514]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-15T22:17:28.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:28 smithi098 ceph-mon[35514]: Detected new or changed devices on smithi012 2024-09-15T22:17:28.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:28 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:28.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:28 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:28.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:28 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:17:28.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:28 smithi098 ceph-mon[35514]: Adjusting osd_memory_target on smithi012 to 17092M 2024-09-15T22:17:28.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:28 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:28.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:28 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:17:28.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:28 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:17:28.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:28 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:28.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:28 smithi001 ceph-mon[30843]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:28.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:28 smithi001 ceph-mon[30843]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-15T22:17:28.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:28 smithi001 ceph-mon[30843]: from='osd.1 [v2:172.21.15.12:6800/3951165354,v1:172.21.15.12:6801/3951165354]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-15T22:17:28.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:28 smithi001 ceph-mon[30843]: osdmap e11: 2 total, 1 up, 2 in 2024-09-15T22:17:28.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:28 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:17:28.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:28 smithi001 ceph-mon[30843]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-15T22:17:28.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:28 smithi001 ceph-mon[30843]: Detected new or changed devices on smithi012 2024-09-15T22:17:28.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:28 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:28.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:28 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:28.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:28 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:17:28.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:28 smithi001 ceph-mon[30843]: Adjusting osd_memory_target on smithi012 to 17092M 2024-09-15T22:17:28.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:28 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:28.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:28 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:17:28.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:28 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:17:28.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:28 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:28.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:28 smithi012 ceph-mon[34883]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:28.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:28 smithi012 ceph-mon[34883]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-15T22:17:28.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:28 smithi012 ceph-mon[34883]: from='osd.1 [v2:172.21.15.12:6800/3951165354,v1:172.21.15.12:6801/3951165354]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-15T22:17:28.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:28 smithi012 ceph-mon[34883]: osdmap e11: 2 total, 1 up, 2 in 2024-09-15T22:17:28.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:28 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:17:28.997 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:28 smithi012 ceph-mon[34883]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-15T22:17:28.997 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:28 smithi012 ceph-mon[34883]: Detected new or changed devices on smithi012 2024-09-15T22:17:28.997 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:28 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:28.997 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:28 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:28.997 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:28 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:17:28.997 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:28 smithi012 ceph-mon[34883]: Adjusting osd_memory_target on smithi012 to 17092M 2024-09-15T22:17:28.997 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:28 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:28.997 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:28 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:17:28.997 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:28 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:17:28.997 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:28 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:29.745 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 15 22:17:29 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-1[39380]: 2024-09-15T22:17:29.476+0000 7f13ffb40640 -1 osd.1 0 waiting for initial osdmap 2024-09-15T22:17:29.746 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 15 22:17:29 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-1[39380]: 2024-09-15T22:17:29.485+0000 7f13f8172640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:17:29.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:29 smithi012 ceph-mon[34883]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-15T22:17:29.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:29 smithi012 ceph-mon[34883]: osdmap e12: 2 total, 1 up, 2 in 2024-09-15T22:17:29.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:29 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:17:29.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:29 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:17:29.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:29 smithi012 ceph-mon[34883]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:17:29.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:29 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:17:29.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:29 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:17:29.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:29 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:17:29.747 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:29 smithi012 ceph-mon[34883]: from='osd.1 ' entity='osd.1' 2024-09-15T22:17:29.996 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:29 smithi098 ceph-mon[35514]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-15T22:17:29.996 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:29 smithi098 ceph-mon[35514]: osdmap e12: 2 total, 1 up, 2 in 2024-09-15T22:17:29.996 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:29 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:17:29.997 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:29 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:17:29.997 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:29 smithi098 ceph-mon[35514]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:17:29.997 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:29 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:17:29.997 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:29 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:17:29.997 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:29 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:17:29.997 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:29 smithi098 ceph-mon[35514]: from='osd.1 ' entity='osd.1' 2024-09-15T22:17:30.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:29 smithi001 ceph-mon[30843]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-15T22:17:30.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:29 smithi001 ceph-mon[30843]: osdmap e12: 2 total, 1 up, 2 in 2024-09-15T22:17:30.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:29 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:17:30.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:29 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:17:30.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:29 smithi001 ceph-mon[30843]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:17:30.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:29 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:17:30.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:29 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:17:30.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:29 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:17:30.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:29 smithi001 ceph-mon[30843]: from='osd.1 ' entity='osd.1' 2024-09-15T22:17:30.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:30 smithi012 ceph-mon[34883]: purged_snaps scrub starts 2024-09-15T22:17:30.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:30 smithi012 ceph-mon[34883]: purged_snaps scrub ok 2024-09-15T22:17:30.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:30 smithi012 ceph-mon[34883]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:30.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:30 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:17:30.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:30 smithi012 ceph-mon[34883]: osd.1 [v2:172.21.15.12:6800/3951165354,v1:172.21.15.12:6801/3951165354] boot 2024-09-15T22:17:30.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:30 smithi012 ceph-mon[34883]: osdmap e13: 2 total, 2 up, 2 in 2024-09-15T22:17:30.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:30 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:17:31.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:30 smithi098 ceph-mon[35514]: purged_snaps scrub starts 2024-09-15T22:17:31.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:30 smithi098 ceph-mon[35514]: purged_snaps scrub ok 2024-09-15T22:17:31.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:30 smithi098 ceph-mon[35514]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:31.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:30 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:17:31.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:30 smithi098 ceph-mon[35514]: osd.1 [v2:172.21.15.12:6800/3951165354,v1:172.21.15.12:6801/3951165354] boot 2024-09-15T22:17:31.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:30 smithi098 ceph-mon[35514]: osdmap e13: 2 total, 2 up, 2 in 2024-09-15T22:17:31.062 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:30 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:17:31.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:30 smithi001 ceph-mon[30843]: purged_snaps scrub starts 2024-09-15T22:17:31.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:30 smithi001 ceph-mon[30843]: purged_snaps scrub ok 2024-09-15T22:17:31.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:30 smithi001 ceph-mon[30843]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:17:31.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:30 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:17:31.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:30 smithi001 ceph-mon[30843]: osd.1 [v2:172.21.15.12:6800/3951165354,v1:172.21.15.12:6801/3951165354] boot 2024-09-15T22:17:31.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:30 smithi001 ceph-mon[30843]: osdmap e13: 2 total, 2 up, 2 in 2024-09-15T22:17:31.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:30 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:17:31.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:31 smithi098 ceph-mon[35514]: from='client.? 172.21.15.98:0/3800088743' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "22e38f44-88d3-4461-a57e-6dc4857ec48f"}]: dispatch 2024-09-15T22:17:31.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:31 smithi098 ceph-mon[35514]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "22e38f44-88d3-4461-a57e-6dc4857ec48f"}]: dispatch 2024-09-15T22:17:31.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:31 smithi098 ceph-mon[35514]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "22e38f44-88d3-4461-a57e-6dc4857ec48f"}]': finished 2024-09-15T22:17:31.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:31 smithi098 ceph-mon[35514]: osdmap e14: 3 total, 2 up, 3 in 2024-09-15T22:17:31.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:31 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:17:31.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:31 smithi098 ceph-mon[35514]: from='client.? 172.21.15.98:0/2836930223' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:17:31.997 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:31 smithi012 ceph-mon[34883]: from='client.? 172.21.15.98:0/3800088743' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "22e38f44-88d3-4461-a57e-6dc4857ec48f"}]: dispatch 2024-09-15T22:17:31.997 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:31 smithi012 ceph-mon[34883]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "22e38f44-88d3-4461-a57e-6dc4857ec48f"}]: dispatch 2024-09-15T22:17:31.997 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:31 smithi012 ceph-mon[34883]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "22e38f44-88d3-4461-a57e-6dc4857ec48f"}]': finished 2024-09-15T22:17:31.997 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:31 smithi012 ceph-mon[34883]: osdmap e14: 3 total, 2 up, 3 in 2024-09-15T22:17:31.997 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:31 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:17:31.997 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:31 smithi012 ceph-mon[34883]: from='client.? 172.21.15.98:0/2836930223' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:17:32.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:31 smithi001 ceph-mon[30843]: from='client.? 172.21.15.98:0/3800088743' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "22e38f44-88d3-4461-a57e-6dc4857ec48f"}]: dispatch 2024-09-15T22:17:32.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:31 smithi001 ceph-mon[30843]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "22e38f44-88d3-4461-a57e-6dc4857ec48f"}]: dispatch 2024-09-15T22:17:32.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:31 smithi001 ceph-mon[30843]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "22e38f44-88d3-4461-a57e-6dc4857ec48f"}]': finished 2024-09-15T22:17:32.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:31 smithi001 ceph-mon[30843]: osdmap e14: 3 total, 2 up, 3 in 2024-09-15T22:17:32.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:31 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:17:32.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:31 smithi001 ceph-mon[30843]: from='client.? 172.21.15.98:0/2836930223' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:17:33.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:33 smithi098 ceph-mon[35514]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:33.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:33 smithi098 ceph-mon[35514]: osdmap e15: 3 total, 2 up, 3 in 2024-09-15T22:17:33.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:33 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:17:33.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:33 smithi001 ceph-mon[30843]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:33.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:33 smithi001 ceph-mon[30843]: osdmap e15: 3 total, 2 up, 3 in 2024-09-15T22:17:33.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:33 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:17:33.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:33 smithi012 ceph-mon[34883]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:33.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:33 smithi012 ceph-mon[34883]: osdmap e15: 3 total, 2 up, 3 in 2024-09-15T22:17:33.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:33 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:17:35.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:35 smithi098 ceph-mon[35514]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:35.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:35 smithi001 ceph-mon[30843]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:35.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:35 smithi012 ceph-mon[34883]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:37.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:37 smithi098 ceph-mon[35514]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:37.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:37 smithi001 ceph-mon[30843]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:37.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:37 smithi012 ceph-mon[34883]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:39.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:39 smithi098 ceph-mon[35514]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:39.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:39 smithi001 ceph-mon[30843]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:39.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:39 smithi012 ceph-mon[34883]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:40.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:40 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-15T22:17:40.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:40 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:17:40.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:40 smithi098 ceph-mon[35514]: Deploying daemon osd.2 on smithi098 2024-09-15T22:17:40.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:40 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-15T22:17:40.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:40 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:17:40.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:40 smithi001 ceph-mon[30843]: Deploying daemon osd.2 on smithi098 2024-09-15T22:17:40.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:40 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-15T22:17:40.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:40 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:17:40.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:40 smithi012 ceph-mon[34883]: Deploying daemon osd.2 on smithi098 2024-09-15T22:17:41.217 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:41 smithi098 ceph-mon[35514]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:41.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:41 smithi001 ceph-mon[30843]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:41.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:41 smithi012 ceph-mon[34883]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:43.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:43 smithi098 ceph-mon[35514]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:43.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:43 smithi001 ceph-mon[30843]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:43.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:43 smithi012 ceph-mon[34883]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:45.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:45 smithi098 ceph-mon[35514]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:45.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:45 smithi001 ceph-mon[30843]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:45.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:45 smithi012 ceph-mon[34883]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:46.310 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:46 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:17:46.310 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:46 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:46.310 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:46 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:46.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:46 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:17:46.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:46 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:46.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:46 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:46.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:46 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:17:46.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:46 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:46.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:46 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:47.198 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:47 smithi098 ceph-mon[35514]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:47.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:47 smithi001 ceph-mon[30843]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:47.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:47 smithi012 ceph-mon[34883]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:49.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:48 smithi012 ceph-mon[34883]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:49.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:48 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:49.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:48 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:49.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:48 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:17:49.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:48 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:17:49.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:48 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:49.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:48 smithi098 ceph-mon[35514]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:49.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:48 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:49.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:48 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:49.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:48 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:17:49.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:48 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:17:49.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:48 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:49.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:48 smithi001 ceph-mon[30843]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:49.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:48 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:49.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:48 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:49.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:48 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:17:49.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:48 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:17:49.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:48 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:49.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:49.674+0000 7f163b7fe640 1 -- 172.21.15.98:0/666196363 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1644062630 con 0x7f16300a3230 2024-09-15T22:17:49.677 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 2 on host 'smithi098' 2024-09-15T22:17:49.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:49.677+0000 7f164c3d2640 1 -- 172.21.15.98:0/666196363 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f16300a3230 msgr2=0x7f16300a56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:49.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:49.677+0000 7f164c3d2640 1 --2- 172.21.15.98:0/666196363 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f16300a3230 0x7f16300a56f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f163402aa00 tx=0x7f16340315b0 comp rx=0 tx=0).stop 2024-09-15T22:17:49.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:49.677+0000 7f164c3d2640 1 -- 172.21.15.98:0/666196363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1644102df0 msgr2=0x7f16440745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:49.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:49.677+0000 7f164c3d2640 1 --2- 172.21.15.98:0/666196363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1644102df0 0x7f16440745e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f164000c890 tx=0x7f164000cd50 comp rx=0 tx=0).stop 2024-09-15T22:17:49.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:49.677+0000 7f164c3d2640 1 -- 172.21.15.98:0/666196363 shutdown_connections 2024-09-15T22:17:49.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:49.677+0000 7f164c3d2640 1 --2- 172.21.15.98:0/666196363 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f16300a3230 0x7f16300a56f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:49.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:49.677+0000 7f164c3d2640 1 --2- 172.21.15.98:0/666196363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16441037b0 0x7f1644074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:49.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:49.677+0000 7f164c3d2640 1 --2- 172.21.15.98:0/666196363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1644102df0 0x7f16440745e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:49.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:49.677+0000 7f164c3d2640 1 --2- 172.21.15.98:0/666196363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1644101bf0 0x7f1644075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:49.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:49.677+0000 7f164c3d2640 1 -- 172.21.15.98:0/666196363 >> 172.21.15.98:0/666196363 conn(0x7f16440fd3c0 msgr2=0x7f1644106110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:49.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:49.677+0000 7f164c3d2640 1 -- 172.21.15.98:0/666196363 shutdown_connections 2024-09-15T22:17:49.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:17:49.677+0000 7f164c3d2640 1 -- 172.21.15.98:0/666196363 wait complete. 2024-09-15T22:17:50.271 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:49 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:17:50.271 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:49 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:50.271 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:49 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:50.298 DEBUG:teuthology.orchestra.run.smithi098:osd.2> sudo journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.2.service 2024-09-15T22:17:50.300 INFO:tasks.cephadm:Deploying osd.3 on smithi001 with /dev/vg_nvme/lv_3... 2024-09-15T22:17:50.300 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-15T22:17:50.355 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:49 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:17:50.355 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:49 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:50.356 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:49 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:50.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:49 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:17:50.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:49 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:50.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:49 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:50.678 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:17:51.105 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:50 smithi001 ceph-mon[30843]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:51.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:50 smithi098 ceph-mon[35514]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:51.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:50 smithi012 ceph-mon[34883]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:51.999 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 15 22:17:51 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-2[40519]: 2024-09-15T22:17:51.855+0000 7f3491fda640 -1 osd.2 0 log_to_monitors true 2024-09-15T22:17:52.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:51 smithi001 ceph-mon[30843]: from='osd.2 [v2:172.21.15.98:6800/1633982971,v1:172.21.15.98:6801/1633982971]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T22:17:52.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:51 smithi001 ceph-mon[30843]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T22:17:52.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:51 smithi098 ceph-mon[35514]: from='osd.2 [v2:172.21.15.98:6800/1633982971,v1:172.21.15.98:6801/1633982971]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T22:17:52.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:51 smithi098 ceph-mon[35514]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T22:17:52.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:51 smithi012 ceph-mon[34883]: from='osd.2 [v2:172.21.15.98:6800/1633982971,v1:172.21.15.98:6801/1633982971]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T22:17:52.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:51 smithi012 ceph-mon[34883]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T22:17:53.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:53 smithi001 ceph-mon[30843]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:53.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:53 smithi001 ceph-mon[30843]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-15T22:17:53.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:53 smithi001 ceph-mon[30843]: osdmap e16: 3 total, 2 up, 3 in 2024-09-15T22:17:53.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:53 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:17:53.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:53 smithi001 ceph-mon[30843]: from='osd.2 [v2:172.21.15.98:6800/1633982971,v1:172.21.15.98:6801/1633982971]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-15T22:17:53.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:53 smithi001 ceph-mon[30843]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-15T22:17:53.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:53 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:53.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:53 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:53.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:53 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:17:53.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:53 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:53.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:53 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:17:53.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:53 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:17:53.311 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 15 22:17:53 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-2[40519]: 2024-09-15T22:17:53.012+0000 7f348d73a640 -1 osd.2 0 waiting for initial osdmap 2024-09-15T22:17:53.311 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 15 22:17:53 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-2[40519]: 2024-09-15T22:17:53.016+0000 7f3489d74640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:17:53.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:53 smithi098 ceph-mon[35514]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:53.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:53 smithi098 ceph-mon[35514]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-15T22:17:53.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:53 smithi098 ceph-mon[35514]: osdmap e16: 3 total, 2 up, 3 in 2024-09-15T22:17:53.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:53 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:17:53.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:53 smithi098 ceph-mon[35514]: from='osd.2 [v2:172.21.15.98:6800/1633982971,v1:172.21.15.98:6801/1633982971]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-15T22:17:53.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:53 smithi098 ceph-mon[35514]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-15T22:17:53.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:53 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:53.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:53 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:53.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:53 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:17:53.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:53 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:53.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:53 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:17:53.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:53 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:17:53.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:53 smithi012 ceph-mon[34883]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:53.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:53 smithi012 ceph-mon[34883]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-15T22:17:53.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:53 smithi012 ceph-mon[34883]: osdmap e16: 3 total, 2 up, 3 in 2024-09-15T22:17:53.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:53 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:17:53.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:53 smithi012 ceph-mon[34883]: from='osd.2 [v2:172.21.15.98:6800/1633982971,v1:172.21.15.98:6801/1633982971]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-15T22:17:53.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:53 smithi012 ceph-mon[34883]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-15T22:17:53.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:53 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:53.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:53 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:53.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:53 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:17:53.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:53 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:53.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:53 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:17:53.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:53 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:17:53.841 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:17:53.874 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi001:vg_nvme/lv_3 2024-09-15T22:17:54.250 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:17:54.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:54 smithi098 ceph-mon[35514]: Detected new or changed devices on smithi098 2024-09-15T22:17:54.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:54 smithi098 ceph-mon[35514]: Adjusting osd_memory_target on smithi098 to 17088M 2024-09-15T22:17:54.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:54 smithi098 ceph-mon[35514]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-15T22:17:54.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:54 smithi098 ceph-mon[35514]: osdmap e17: 3 total, 2 up, 3 in 2024-09-15T22:17:54.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:54 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:17:54.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:54 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:17:54.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:54 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:54.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:54 smithi001 ceph-mon[30843]: Detected new or changed devices on smithi098 2024-09-15T22:17:54.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:54 smithi001 ceph-mon[30843]: Adjusting osd_memory_target on smithi098 to 17088M 2024-09-15T22:17:54.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:54 smithi001 ceph-mon[30843]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-15T22:17:54.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:54 smithi001 ceph-mon[30843]: osdmap e17: 3 total, 2 up, 3 in 2024-09-15T22:17:54.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:54 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:17:54.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:54 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:17:54.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:54 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:54.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:54 smithi012 ceph-mon[34883]: Detected new or changed devices on smithi098 2024-09-15T22:17:54.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:54 smithi012 ceph-mon[34883]: Adjusting osd_memory_target on smithi098 to 17088M 2024-09-15T22:17:54.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:54 smithi012 ceph-mon[34883]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-15T22:17:54.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:54 smithi012 ceph-mon[34883]: osdmap e17: 3 total, 2 up, 3 in 2024-09-15T22:17:54.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:54 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:17:54.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:54 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:17:54.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:54 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:54.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.806+0000 7fd7ade00640 1 -- 172.21.15.1:0/1764918996 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7a8074c50 msgr2=0x7fd7a80750b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:54.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.806+0000 7fd7ade00640 1 --2- 172.21.15.1:0/1764918996 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7a8074c50 0x7fd7a80750b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd790009900 tx=0x7fd79002a410 comp rx=0 tx=0).stop 2024-09-15T22:17:54.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.807+0000 7fd7ade00640 1 -- 172.21.15.1:0/1764918996 shutdown_connections 2024-09-15T22:17:54.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.807+0000 7fd7ade00640 1 --2- 172.21.15.1:0/1764918996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7a810e1e0 0x7fd7a81105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.807+0000 7fd7ade00640 1 --2- 172.21.15.1:0/1764918996 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7a8074c50 0x7fd7a80750b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.807+0000 7fd7ade00640 1 --2- 172.21.15.1:0/1764918996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7a8076220 0x7fd7a8074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.807+0000 7fd7ade00640 1 -- 172.21.15.1:0/1764918996 >> 172.21.15.1:0/1764918996 conn(0x7fd7a80fd390 msgr2=0x7fd7a80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:54.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.807+0000 7fd7ade00640 1 -- 172.21.15.1:0/1764918996 shutdown_connections 2024-09-15T22:17:54.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.807+0000 7fd7ade00640 1 -- 172.21.15.1:0/1764918996 wait complete. 2024-09-15T22:17:54.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.808+0000 7fd7ade00640 1 Processor -- start 2024-09-15T22:17:54.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.808+0000 7fd7ade00640 1 -- start start 2024-09-15T22:17:54.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.808+0000 7fd7ade00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7a8074c50 0x7fd7a819e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:54.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.808+0000 7fd7ade00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7a8076220 0x7fd7a819ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:54.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.808+0000 7fd7ade00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7a810e1e0 0x7fd7a81a5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:54.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.808+0000 7fd7ade00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a8113ef0 con 0x7fd7a8076220 2024-09-15T22:17:54.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.808+0000 7fd7ade00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a8113d70 con 0x7fd7a810e1e0 2024-09-15T22:17:54.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.808+0000 7fd7ade00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a8114070 con 0x7fd7a8074c50 2024-09-15T22:17:54.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.808+0000 7fd7a6a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7a8074c50 0x7fd7a819e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:54.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.808+0000 7fd79fe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7a8076220 0x7fd7a819ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:54.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.808+0000 7fd7a6a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7a8074c50 0x7fd7a819e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:36782/0 (socket says 172.21.15.1:36782) 2024-09-15T22:17:54.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.808+0000 7fd7a6a00640 1 -- 172.21.15.1:0/2907475091 learned_addr learned my addr 172.21.15.1:0/2907475091 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:17:54.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.808+0000 7fd7a7400640 1 --2- 172.21.15.1:0/2907475091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7a810e1e0 0x7fd7a81a5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:54.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.809+0000 7fd7a7400640 1 -- 172.21.15.1:0/2907475091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7a8074c50 msgr2=0x7fd7a819e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:54.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.809+0000 7fd7a7400640 1 --2- 172.21.15.1:0/2907475091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7a8074c50 0x7fd7a819e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.809+0000 7fd7a7400640 1 -- 172.21.15.1:0/2907475091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7a8076220 msgr2=0x7fd7a819ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:54.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.809+0000 7fd7a7400640 1 --2- 172.21.15.1:0/2907475091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7a8076220 0x7fd7a819ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.809+0000 7fd7a7400640 1 -- 172.21.15.1:0/2907475091 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a81a6150 con 0x7fd7a810e1e0 2024-09-15T22:17:54.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.809+0000 7fd7a7400640 1 --2- 172.21.15.1:0/2907475091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7a810e1e0 0x7fd7a81a5ae0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0009fd0 tx=0x7fd7a000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:54.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.809+0000 7fd7aca00640 1 -- 172.21.15.1:0/2907475091 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a000ce20 con 0x7fd7a810e1e0 2024-09-15T22:17:54.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.809+0000 7fd7ade00640 1 -- 172.21.15.1:0/2907475091 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7a81a6440 con 0x7fd7a810e1e0 2024-09-15T22:17:54.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.810+0000 7fd7aca00640 1 -- 172.21.15.1:0/2907475091 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7a0005020 con 0x7fd7a810e1e0 2024-09-15T22:17:54.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.810+0000 7fd7aca00640 1 -- 172.21.15.1:0/2907475091 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0010720 con 0x7fd7a810e1e0 2024-09-15T22:17:54.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.810+0000 7fd7ade00640 1 -- 172.21.15.1:0/2907475091 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7a81a6950 con 0x7fd7a810e1e0 2024-09-15T22:17:54.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.811+0000 7fd7ade00640 1 -- 172.21.15.1:0/2907475091 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7a81043b0 con 0x7fd7a810e1e0 2024-09-15T22:17:54.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.813+0000 7fd7aca00640 1 -- 172.21.15.1:0/2907475091 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7fd7a0005540 con 0x7fd7a810e1e0 2024-09-15T22:17:54.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.814+0000 7fd7aca00640 1 --2- 172.21.15.1:0/2907475091 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fd78c0a31e0 0x7fd78c0a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:54.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.814+0000 7fd7aca00640 1 -- 172.21.15.1:0/2907475091 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2851+0+0 (secure 0 0 0) 0x7fd7a00cea00 con 0x7fd7a810e1e0 2024-09-15T22:17:54.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.814+0000 7fd7a6a00640 1 --2- 172.21.15.1:0/2907475091 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fd78c0a31e0 0x7fd78c0a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:54.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.815+0000 7fd7a6a00640 1 --2- 172.21.15.1:0/2907475091 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fd78c0a31e0 0x7fd78c0a56a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd79800bc80 tx=0x7fd79800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:54.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:54.819+0000 7fd7aca00640 1 -- 172.21.15.1:0/2907475091 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd7a009ccb0 con 0x7fd7a810e1e0 2024-09-15T22:17:55.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:55.018+0000 7fd7ade00640 1 -- 172.21.15.1:0/2907475091 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fd7a8062630 con 0x7fd78c0a31e0 2024-09-15T22:17:55.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:55 smithi098 ceph-mon[35514]: purged_snaps scrub starts 2024-09-15T22:17:55.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:55 smithi098 ceph-mon[35514]: purged_snaps scrub ok 2024-09-15T22:17:55.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:55 smithi098 ceph-mon[35514]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:55.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:55 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:17:55.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:55 smithi098 ceph-mon[35514]: osd.2 [v2:172.21.15.98:6800/1633982971,v1:172.21.15.98:6801/1633982971] boot 2024-09-15T22:17:55.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:55 smithi098 ceph-mon[35514]: osdmap e18: 3 total, 3 up, 3 in 2024-09-15T22:17:55.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:55 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:17:55.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:55 smithi001 ceph-mon[30843]: purged_snaps scrub starts 2024-09-15T22:17:55.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:55 smithi001 ceph-mon[30843]: purged_snaps scrub ok 2024-09-15T22:17:55.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:55 smithi001 ceph-mon[30843]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:55.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:55 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:17:55.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:55 smithi001 ceph-mon[30843]: osd.2 [v2:172.21.15.98:6800/1633982971,v1:172.21.15.98:6801/1633982971] boot 2024-09-15T22:17:55.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:55 smithi001 ceph-mon[30843]: osdmap e18: 3 total, 3 up, 3 in 2024-09-15T22:17:55.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:55 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:17:55.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:55 smithi012 ceph-mon[34883]: purged_snaps scrub starts 2024-09-15T22:17:55.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:55 smithi012 ceph-mon[34883]: purged_snaps scrub ok 2024-09-15T22:17:55.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:55 smithi012 ceph-mon[34883]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:17:55.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:55 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:17:55.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:55 smithi012 ceph-mon[34883]: osd.2 [v2:172.21.15.98:6800/1633982971,v1:172.21.15.98:6801/1633982971] boot 2024-09-15T22:17:55.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:55 smithi012 ceph-mon[34883]: osdmap e18: 3 total, 3 up, 3 in 2024-09-15T22:17:55.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:55 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:17:56.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:56 smithi001 ceph-mon[30843]: from='client.24185 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:17:56.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:56 smithi001 ceph-mon[30843]: osdmap e19: 3 total, 3 up, 3 in 2024-09-15T22:17:56.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:56 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:17:56.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:56 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:17:56.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:56 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:17:56.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:56 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:17:56.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:56 smithi012 ceph-mon[34883]: from='client.24185 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:17:56.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:56 smithi012 ceph-mon[34883]: osdmap e19: 3 total, 3 up, 3 in 2024-09-15T22:17:56.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:56 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:17:56.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:56 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:17:56.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:56 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:17:56.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:56 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:17:56.560 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:56 smithi098 ceph-mon[35514]: from='client.24185 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:17:56.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:56 smithi098 ceph-mon[35514]: osdmap e19: 3 total, 3 up, 3 in 2024-09-15T22:17:56.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:56 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:17:56.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:56 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:17:56.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:56 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:17:56.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:56 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:17:57.294 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:57 smithi001 ceph-mon[30843]: pgmap v81: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:17:57.294 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:57 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-15T22:17:57.295 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:57 smithi001 ceph-mon[30843]: osdmap e20: 3 total, 3 up, 3 in 2024-09-15T22:17:57.295 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:57 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:17:57.409 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:57 smithi098 ceph-mon[35514]: pgmap v81: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:17:57.409 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:57 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-15T22:17:57.409 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:57 smithi098 ceph-mon[35514]: osdmap e20: 3 total, 3 up, 3 in 2024-09-15T22:17:57.409 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:57 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:17:57.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:57 smithi012 ceph-mon[34883]: pgmap v81: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:17:57.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:57 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-15T22:17:57.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:57 smithi012 ceph-mon[34883]: osdmap e20: 3 total, 3 up, 3 in 2024-09-15T22:17:57.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:57 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:17:58.126 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 15 22:17:57 smithi001 sudo[46666]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T22:17:58.127 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 15 22:17:57 smithi001 sudo[46666]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:17:58.127 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 15 22:17:57 smithi001 sudo[46666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:17:58.127 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 15 22:17:57 smithi001 sudo[46666]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:17:58.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:17:58.135+0000 7fd7aca00640 1 -- 172.21.15.1:0/2907475091 <== mon.2 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fd7a0098c20 con 0x7fd7a810e1e0 2024-09-15T22:17:58.418 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:58 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-15T22:17:58.418 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:58 smithi001 ceph-mon[30843]: osdmap e21: 3 total, 3 up, 3 in 2024-09-15T22:17:58.418 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 15 22:17:58 smithi001 sudo[46699]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T22:17:58.418 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 15 22:17:58 smithi001 sudo[46699]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:17:58.418 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 15 22:17:58 smithi001 sudo[46699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:17:58.418 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 15 22:17:58 smithi001 sudo[46699]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:17:58.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:58 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-15T22:17:58.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:58 smithi012 ceph-mon[34883]: osdmap e21: 3 total, 3 up, 3 in 2024-09-15T22:17:58.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:58 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-15T22:17:58.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:58 smithi098 ceph-mon[35514]: osdmap e21: 3 total, 3 up, 3 in 2024-09-15T22:17:58.899 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 15 22:17:58 smithi012 sudo[43271]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T22:17:58.899 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 15 22:17:58 smithi012 sudo[43271]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:17:58.900 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 15 22:17:58 smithi012 sudo[43271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:17:58.900 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 15 22:17:58 smithi012 sudo[43271]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:17:59.246 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 15 22:17:58 smithi012 sudo[43274]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T22:17:59.246 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 15 22:17:58 smithi012 sudo[43274]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:17:59.246 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 15 22:17:58 smithi012 sudo[43274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:17:59.246 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 15 22:17:58 smithi012 sudo[43274]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:17:59.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:59 smithi012 ceph-mon[34883]: pgmap v84: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:17:59.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:59 smithi012 ceph-mon[34883]: osdmap e22: 3 total, 3 up, 3 in 2024-09-15T22:17:59.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:59 smithi012 ceph-mon[34883]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-15T22:17:59.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:59 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/2948849143' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd9d6e97-af81-442a-ac0d-543e440a8d7f"}]: dispatch 2024-09-15T22:17:59.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:59 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/2948849143' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dd9d6e97-af81-442a-ac0d-543e440a8d7f"}]': finished 2024-09-15T22:17:59.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:59 smithi012 ceph-mon[34883]: osdmap e23: 4 total, 3 up, 4 in 2024-09-15T22:17:59.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:59 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:17:59.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:59 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:59.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:59 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/2691329922' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:17:59.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:17:59 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:59.424 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 15 22:17:59 smithi098 sudo[44169]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T22:17:59.424 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 15 22:17:59 smithi098 sudo[44169]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:17:59.424 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 15 22:17:59 smithi098 sudo[44169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:17:59.424 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 15 22:17:59 smithi098 sudo[44169]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:17:59.424 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:59 smithi098 ceph-mon[35514]: pgmap v84: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:17:59.424 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:59 smithi098 ceph-mon[35514]: osdmap e22: 3 total, 3 up, 3 in 2024-09-15T22:17:59.424 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:59 smithi098 ceph-mon[35514]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-15T22:17:59.425 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:59 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/2948849143' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd9d6e97-af81-442a-ac0d-543e440a8d7f"}]: dispatch 2024-09-15T22:17:59.425 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:59 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/2948849143' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dd9d6e97-af81-442a-ac0d-543e440a8d7f"}]': finished 2024-09-15T22:17:59.425 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:59 smithi098 ceph-mon[35514]: osdmap e23: 4 total, 3 up, 4 in 2024-09-15T22:17:59.425 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:59 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:17:59.425 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:59 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:59.425 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:59 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/2691329922' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:17:59.425 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:17:59 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:59.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:59 smithi001 ceph-mon[30843]: pgmap v84: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:17:59.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:59 smithi001 ceph-mon[30843]: osdmap e22: 3 total, 3 up, 3 in 2024-09-15T22:17:59.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:59 smithi001 ceph-mon[30843]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-15T22:17:59.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:59 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/2948849143' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd9d6e97-af81-442a-ac0d-543e440a8d7f"}]: dispatch 2024-09-15T22:17:59.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:59 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/2948849143' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dd9d6e97-af81-442a-ac0d-543e440a8d7f"}]': finished 2024-09-15T22:17:59.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:59 smithi001 ceph-mon[30843]: osdmap e23: 4 total, 3 up, 4 in 2024-09-15T22:17:59.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:59 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:17:59.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:59 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:59.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:59 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/2691329922' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:17:59.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:59 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:17:59.811 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 15 22:17:59 smithi098 sudo[44172]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T22:17:59.811 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 15 22:17:59 smithi098 sudo[44172]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:17:59.811 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 15 22:17:59 smithi098 sudo[44172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:17:59.811 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 15 22:17:59 smithi098 sudo[44172]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:18:00.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:59 smithi001 sudo[46839]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T22:18:00.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:59 smithi001 sudo[46839]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:18:00.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:17:59 smithi001 sudo[46839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:18:00.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:00 smithi001 sudo[46839]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:18:00.834 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:00 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:00.834 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:00 smithi098 ceph-mon[35514]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:18:00.834 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:00 smithi098 sudo[44175]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T22:18:00.834 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:00 smithi098 sudo[44175]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:18:00.834 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:00 smithi098 sudo[44175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:18:00.834 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:00 smithi098 sudo[44175]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:18:00.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:00 smithi001 sudo[47161]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T22:18:00.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:00 smithi001 sudo[47161]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:18:00.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:00 smithi001 sudo[47161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:18:00.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:00 smithi001 sudo[47161]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:18:00.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:00 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:00.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:00 smithi001 ceph-mon[30843]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:18:00.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:00 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:00.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:00 smithi012 ceph-mon[34883]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:18:01.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:01 smithi098 sudo[44178]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T22:18:01.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:01 smithi098 sudo[44178]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:18:01.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:01 smithi098 sudo[44178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:18:01.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:01 smithi098 sudo[44178]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:18:01.602 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:01 smithi012 sudo[43277]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T22:18:01.602 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:01 smithi012 sudo[43277]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:18:01.602 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:01 smithi012 sudo[43277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:18:01.602 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:01 smithi012 sudo[43277]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:18:01.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:01 smithi001 ceph-mon[30843]: pgmap v87: 1 pgs: 1 unknown; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:18:01.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:01 smithi001 ceph-mon[30843]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:18:01.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:01 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:18:01.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:01 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:18:01.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:01 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:18:01.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:01 smithi001 ceph-mon[30843]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:18:01.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:01 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:18:01.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:01 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:18:01.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:01 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:18:01.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:01 smithi001 ceph-mon[30843]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:18:01.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:01 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:18:01.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:01 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:18:01.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:01 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:18:01.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:01 smithi012 sudo[43280]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T22:18:01.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:01 smithi012 sudo[43280]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:18:01.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:01 smithi012 sudo[43280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:18:01.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:01 smithi012 sudo[43280]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:18:01.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:01 smithi012 ceph-mon[34883]: pgmap v87: 1 pgs: 1 unknown; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:18:01.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:01 smithi012 ceph-mon[34883]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:18:01.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:01 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:18:01.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:01 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:18:01.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:01 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:18:01.997 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:01 smithi012 ceph-mon[34883]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:18:01.997 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:01 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:18:01.997 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:01 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:18:01.997 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:01 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:18:01.997 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:01 smithi012 ceph-mon[34883]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:18:01.997 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:01 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:18:01.997 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:01 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:18:01.997 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:01 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:18:02.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:01 smithi098 ceph-mon[35514]: pgmap v87: 1 pgs: 1 unknown; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:18:02.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:01 smithi098 ceph-mon[35514]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:18:02.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:01 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:18:02.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:01 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:18:02.062 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:01 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:18:02.062 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:01 smithi098 ceph-mon[35514]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:18:02.062 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:01 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:18:02.062 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:01 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:18:02.062 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:01 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:18:02.062 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:01 smithi098 ceph-mon[35514]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:18:02.062 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:01 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:18:02.063 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:01 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:18:02.063 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:01 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:18:02.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:02 smithi001 ceph-mon[30843]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:18:02.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:02 smithi001 ceph-mon[30843]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:18:02.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:02 smithi001 ceph-mon[30843]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:18:02.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:02 smithi012 ceph-mon[34883]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:18:02.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:02 smithi012 ceph-mon[34883]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:18:02.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:02 smithi012 ceph-mon[34883]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:18:03.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:02 smithi098 ceph-mon[35514]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:18:03.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:02 smithi098 ceph-mon[35514]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:18:03.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:02 smithi098 ceph-mon[35514]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:18:04.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:04 smithi001 ceph-mon[30843]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:18:04.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:04 smithi012 ceph-mon[34883]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:18:05.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:04 smithi098 ceph-mon[35514]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:18:06.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:06 smithi001 ceph-mon[30843]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:18:06.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:06 smithi012 ceph-mon[34883]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:18:07.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:06 smithi098 ceph-mon[35514]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:18:07.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:07 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-15T22:18:07.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:07 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:18:07.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:07 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-15T22:18:07.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:07 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:18:08.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:07 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-15T22:18:08.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:07 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:18:08.822 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:08 smithi001 ceph-mon[30843]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-15T22:18:08.822 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:08 smithi001 ceph-mon[30843]: Deploying daemon osd.3 on smithi001 2024-09-15T22:18:08.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:08 smithi012 ceph-mon[34883]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-15T22:18:08.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:08 smithi012 ceph-mon[34883]: Deploying daemon osd.3 on smithi001 2024-09-15T22:18:09.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:08 smithi098 ceph-mon[35514]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-15T22:18:09.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:08 smithi098 ceph-mon[35514]: Deploying daemon osd.3 on smithi001 2024-09-15T22:18:10.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:10 smithi001 ceph-mon[30843]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-15T22:18:10.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:10 smithi012 ceph-mon[34883]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-15T22:18:11.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:10 smithi098 ceph-mon[35514]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-15T22:18:12.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:12 smithi012 ceph-mon[34883]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-15T22:18:13.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:12 smithi098 ceph-mon[35514]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-15T22:18:13.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:12 smithi001 ceph-mon[30843]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-15T22:18:14.819 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:14 smithi001 ceph-mon[30843]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-15T22:18:14.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:14 smithi012 ceph-mon[34883]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-15T22:18:15.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:14 smithi098 ceph-mon[35514]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-15T22:18:15.897 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:15 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:18:15.897 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:15 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:15.897 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:15 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:15.916 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:15 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:18:15.916 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:15 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:15.916 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:15 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:15.962 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:15 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:18:15.962 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:15 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:15.962 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:15 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:17.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:17 smithi098 ceph-mon[35514]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-15T22:18:17.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:17 smithi001 ceph-mon[30843]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-15T22:18:17.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:17 smithi012 ceph-mon[34883]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-15T22:18:19.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:18 smithi012 ceph-mon[34883]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-15T22:18:19.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:18 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:19.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:18 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:19.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:18 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:18:19.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:18 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:18:19.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:18 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:19.306 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:18 smithi001 ceph-mon[30843]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-15T22:18:19.306 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:18 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:19.306 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:18 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:19.307 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:18 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:18:19.307 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:18 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:18:19.307 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:18 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:19.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:18 smithi098 ceph-mon[35514]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-15T22:18:19.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:18 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:19.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:18 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:19.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:18 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:18:19.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:18 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:18:19.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:18 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:19.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:18:19.879+0000 7fd7aca00640 1 -- 172.21.15.1:0/2907475091 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd7a8062630 con 0x7fd78c0a31e0 2024-09-15T22:18:19.882 INFO:teuthology.orchestra.run.smithi001.stdout:Created osd(s) 3 on host 'smithi001' 2024-09-15T22:18:19.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:18:19.882+0000 7fd7ade00640 1 -- 172.21.15.1:0/2907475091 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fd78c0a31e0 msgr2=0x7fd78c0a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:19.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:18:19.882+0000 7fd7ade00640 1 --2- 172.21.15.1:0/2907475091 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fd78c0a31e0 0x7fd78c0a56a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd79800bc80 tx=0x7fd79800b410 comp rx=0 tx=0).stop 2024-09-15T22:18:19.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:18:19.882+0000 7fd7ade00640 1 -- 172.21.15.1:0/2907475091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7a810e1e0 msgr2=0x7fd7a81a5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:19.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:18:19.882+0000 7fd7ade00640 1 --2- 172.21.15.1:0/2907475091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7a810e1e0 0x7fd7a81a5ae0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0009fd0 tx=0x7fd7a000ef10 comp rx=0 tx=0).stop 2024-09-15T22:18:19.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:18:19.882+0000 7fd7ade00640 1 -- 172.21.15.1:0/2907475091 shutdown_connections 2024-09-15T22:18:19.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:18:19.882+0000 7fd7ade00640 1 --2- 172.21.15.1:0/2907475091 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fd78c0a31e0 0x7fd78c0a56a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:19.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:18:19.882+0000 7fd7ade00640 1 --2- 172.21.15.1:0/2907475091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7a810e1e0 0x7fd7a81a5ae0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:19.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:18:19.882+0000 7fd7ade00640 1 --2- 172.21.15.1:0/2907475091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7a8076220 0x7fd7a819ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:19.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:18:19.882+0000 7fd7ade00640 1 --2- 172.21.15.1:0/2907475091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7a8074c50 0x7fd7a819e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:19.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:18:19.882+0000 7fd7ade00640 1 -- 172.21.15.1:0/2907475091 >> 172.21.15.1:0/2907475091 conn(0x7fd7a80fd390 msgr2=0x7fd7a8101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:19.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:18:19.882+0000 7fd7ade00640 1 -- 172.21.15.1:0/2907475091 shutdown_connections 2024-09-15T22:18:19.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:18:19.882+0000 7fd7ade00640 1 -- 172.21.15.1:0/2907475091 wait complete. 2024-09-15T22:18:20.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:19 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:18:20.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:19 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:20.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:19 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:20.250 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:19 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:18:20.251 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:19 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:20.251 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:19 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:20.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:19 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:18:20.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:19 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:20.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:19 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:20.656 DEBUG:teuthology.orchestra.run.smithi001:osd.3> sudo journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.3.service 2024-09-15T22:18:20.660 INFO:tasks.cephadm:Deploying osd.4 on smithi012 with /dev/vg_nvme/lv_3... 2024-09-15T22:18:20.661 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-15T22:18:20.921 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:18:20.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:20 smithi012 ceph-mon[34883]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:18:21.151 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:20 smithi001 ceph-mon[30843]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:18:21.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:20 smithi098 ceph-mon[35514]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:18:21.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:21 smithi012 ceph-mon[34883]: from='osd.3 [v2:172.21.15.1:6810/3706738461,v1:172.21.15.1:6811/3706738461]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-15T22:18:22.071 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:21 smithi001 ceph-mon[30843]: from='osd.3 [v2:172.21.15.1:6810/3706738461,v1:172.21.15.1:6811/3706738461]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-15T22:18:22.071 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 15 22:18:21 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-3[48779]: 2024-09-15T22:18:21.709+0000 7f0c1f411640 -1 osd.3 0 log_to_monitors true 2024-09-15T22:18:22.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:21 smithi098 ceph-mon[35514]: from='osd.3 [v2:172.21.15.1:6810/3706738461,v1:172.21.15.1:6811/3706738461]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-15T22:18:23.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:22 smithi001 ceph-mon[30843]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:18:23.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:22 smithi001 ceph-mon[30843]: from='osd.3 [v2:172.21.15.1:6810/3706738461,v1:172.21.15.1:6811/3706738461]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-15T22:18:23.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:22 smithi001 ceph-mon[30843]: osdmap e24: 4 total, 3 up, 4 in 2024-09-15T22:18:23.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:22 smithi001 ceph-mon[30843]: from='osd.3 [v2:172.21.15.1:6810/3706738461,v1:172.21.15.1:6811/3706738461]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-15T22:18:23.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:22 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:18:23.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:22 smithi012 ceph-mon[34883]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:18:23.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:22 smithi012 ceph-mon[34883]: from='osd.3 [v2:172.21.15.1:6810/3706738461,v1:172.21.15.1:6811/3706738461]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-15T22:18:23.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:22 smithi012 ceph-mon[34883]: osdmap e24: 4 total, 3 up, 4 in 2024-09-15T22:18:23.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:22 smithi012 ceph-mon[34883]: from='osd.3 [v2:172.21.15.1:6810/3706738461,v1:172.21.15.1:6811/3706738461]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-15T22:18:23.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:22 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:18:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-15T22:18:23.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:22 smithi098 ceph-mon[35514]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:18:23.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:22 smithi098 ceph-mon[35514]: from='osd.3 [v2:172.21.15.1:6810/3706738461,v1:172.21.15.1:6811/3706738461]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-15T22:18:23.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:22 smithi098 ceph-mon[35514]: osdmap e24: 4 total, 3 up, 4 in 2024-09-15T22:18:23.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:22 smithi098 ceph-mon[35514]: from='osd.3 [v2:172.21.15.1:6810/3706738461,v1:172.21.15.1:6811/3706738461]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-15T22:18:23.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:22 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:18:23.317 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi012:vg_nvme/lv_3 2024-09-15T22:18:23.571 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:18:24.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.027+0000 7fe4c0d02640 1 -- 172.21.15.12:0/4013772500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4bc102e00 msgr2=0x7fe4bc103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:24.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.027+0000 7fe4c0d02640 1 --2- 172.21.15.12:0/4013772500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4bc102e00 0x7fe4bc103280 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac009900 tx=0x7fe4ac02a410 comp rx=0 tx=0).stop 2024-09-15T22:18:24.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.027+0000 7fe4c0d02640 1 -- 172.21.15.12:0/4013772500 shutdown_connections 2024-09-15T22:18:24.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.027+0000 7fe4c0d02640 1 --2- 172.21.15.12:0/4013772500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4bc1037c0 0x7fe4bc10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:24.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.027+0000 7fe4c0d02640 1 --2- 172.21.15.12:0/4013772500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4bc102e00 0x7fe4bc103280 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:24.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.027+0000 7fe4c0d02640 1 --2- 172.21.15.12:0/4013772500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4bc101c00 0x7fe4bc102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:24.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.027+0000 7fe4c0d02640 1 -- 172.21.15.12:0/4013772500 >> 172.21.15.12:0/4013772500 conn(0x7fe4bc0fd390 msgr2=0x7fe4bc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:24.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.027+0000 7fe4c0d02640 1 -- 172.21.15.12:0/4013772500 shutdown_connections 2024-09-15T22:18:24.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.027+0000 7fe4c0d02640 1 -- 172.21.15.12:0/4013772500 wait complete. 2024-09-15T22:18:24.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.028+0000 7fe4c0d02640 1 Processor -- start 2024-09-15T22:18:24.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.028+0000 7fe4c0d02640 1 -- start start 2024-09-15T22:18:24.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.028+0000 7fe4c0d02640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4bc101c00 0x7fe4bc19a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:24.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.028+0000 7fe4c0d02640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4bc102e00 0x7fe4bc19a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:24.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.028+0000 7fe4c0d02640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4bc1037c0 0x7fe4bc1a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:24.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.028+0000 7fe4c0d02640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe4bc10d8e0 con 0x7fe4bc102e00 2024-09-15T22:18:24.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.028+0000 7fe4c0d02640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe4bc10d760 con 0x7fe4bc101c00 2024-09-15T22:18:24.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.028+0000 7fe4c0d02640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe4bc10da60 con 0x7fe4bc1037c0 2024-09-15T22:18:24.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.028+0000 7fe4ba59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4bc101c00 0x7fe4bc19a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:24.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.028+0000 7fe4ba59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4bc101c00 0x7fe4bc19a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34740/0 (socket says 172.21.15.12:34740) 2024-09-15T22:18:24.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.028+0000 7fe4ba59c640 1 -- 172.21.15.12:0/2126822396 learned_addr learned my addr 172.21.15.12:0/2126822396 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-15T22:18:24.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.028+0000 7fe4b9d9b640 1 --2- 172.21.15.12:0/2126822396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4bc102e00 0x7fe4bc19a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:24.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.029+0000 7fe4ba59c640 1 -- 172.21.15.12:0/2126822396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4bc1037c0 msgr2=0x7fe4bc1a1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:24.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.029+0000 7fe4ba59c640 1 --2- 172.21.15.12:0/2126822396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4bc1037c0 0x7fe4bc1a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:24.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.029+0000 7fe4ba59c640 1 -- 172.21.15.12:0/2126822396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4bc102e00 msgr2=0x7fe4bc19a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:24.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.029+0000 7fe4ba59c640 1 --2- 172.21.15.12:0/2126822396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4bc102e00 0x7fe4bc19a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:24.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.029+0000 7fe4ba59c640 1 -- 172.21.15.12:0/2126822396 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4bc1a1d90 con 0x7fe4bc101c00 2024-09-15T22:18:24.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.029+0000 7fe4b9d9b640 1 --2- 172.21.15.12:0/2126822396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4bc102e00 0x7fe4bc19a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:18:24.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.029+0000 7fe4ba59c640 1 --2- 172.21.15.12:0/2126822396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4bc101c00 0x7fe4bc19a160 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe4a400d770 tx=0x7fe4a400dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:24.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.029+0000 7fe4b37fe640 1 -- 172.21.15.12:0/2126822396 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a4017070 con 0x7fe4bc101c00 2024-09-15T22:18:24.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.029+0000 7fe4c0d02640 1 -- 172.21.15.12:0/2126822396 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4bc1a2080 con 0x7fe4bc101c00 2024-09-15T22:18:24.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.029+0000 7fe4b37fe640 1 -- 172.21.15.12:0/2126822396 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4a4009c30 con 0x7fe4bc101c00 2024-09-15T22:18:24.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.029+0000 7fe4b37fe640 1 -- 172.21.15.12:0/2126822396 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a4003dd0 con 0x7fe4bc101c00 2024-09-15T22:18:24.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.029+0000 7fe4c0d02640 1 -- 172.21.15.12:0/2126822396 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4bc1a2660 con 0x7fe4bc101c00 2024-09-15T22:18:24.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.030+0000 7fe4c0d02640 1 -- 172.21.15.12:0/2126822396 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4bc1a2860 con 0x7fe4bc101c00 2024-09-15T22:18:24.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.031+0000 7fe4b37fe640 1 -- 172.21.15.12:0/2126822396 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fe4a4003f70 con 0x7fe4bc101c00 2024-09-15T22:18:24.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.032+0000 7fe4b37fe640 1 --2- 172.21.15.12:0/2126822396 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe4a80a3270 0x7fe4a80a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:24.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.032+0000 7fe4b37fe640 1 -- 172.21.15.12:0/2126822396 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3702+0+0 (secure 0 0 0) 0x7fe4a40ce130 con 0x7fe4bc101c00 2024-09-15T22:18:24.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.032+0000 7fe4b9d9b640 1 --2- 172.21.15.12:0/2126822396 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe4a80a3270 0x7fe4a80a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:24.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.033+0000 7fe4b9d9b640 1 --2- 172.21.15.12:0/2126822396 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe4a80a3270 0x7fe4a80a5730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac000c00 tx=0x7fe4ac0095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:24.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.037+0000 7fe4b37fe640 1 -- 172.21.15.12:0/2126822396 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe4a409c050 con 0x7fe4bc101c00 2024-09-15T22:18:24.061 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:23 smithi001 ceph-mon[30843]: from='osd.3 [v2:172.21.15.1:6810/3706738461,v1:172.21.15.1:6811/3706738461]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-15T22:18:24.061 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:23 smithi001 ceph-mon[30843]: osdmap e25: 4 total, 3 up, 4 in 2024-09-15T22:18:24.062 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:23 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:18:24.062 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:23 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:18:24.062 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:23 smithi001 ceph-mon[30843]: from='osd.3 [v2:172.21.15.1:6810/3706738461,v1:172.21.15.1:6811/3706738461]' entity='osd.3' 2024-09-15T22:18:24.062 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 15 22:18:23 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-3[48779]: 2024-09-15T22:18:23.794+0000 7f0c19600640 -1 osd.3 0 waiting for initial osdmap 2024-09-15T22:18:24.062 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 15 22:18:23 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-3[48779]: 2024-09-15T22:18:23.813+0000 7f0c10000640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:18:24.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:24.220+0000 7fe4c0d02640 1 -- 172.21.15.12:0/2126822396 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fe4bc109d10 con 0x7fe4a80a3270 2024-09-15T22:18:24.223 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:23 smithi012 ceph-mon[34883]: from='osd.3 [v2:172.21.15.1:6810/3706738461,v1:172.21.15.1:6811/3706738461]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-15T22:18:24.223 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:23 smithi012 ceph-mon[34883]: osdmap e25: 4 total, 3 up, 4 in 2024-09-15T22:18:24.223 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:23 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:18:24.223 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:23 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:18:24.223 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:23 smithi012 ceph-mon[34883]: from='osd.3 [v2:172.21.15.1:6810/3706738461,v1:172.21.15.1:6811/3706738461]' entity='osd.3' 2024-09-15T22:18:24.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:23 smithi098 ceph-mon[35514]: from='osd.3 [v2:172.21.15.1:6810/3706738461,v1:172.21.15.1:6811/3706738461]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-15T22:18:24.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:23 smithi098 ceph-mon[35514]: osdmap e25: 4 total, 3 up, 4 in 2024-09-15T22:18:24.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:23 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:18:24.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:23 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:18:24.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:23 smithi098 ceph-mon[35514]: from='osd.3 [v2:172.21.15.1:6810/3706738461,v1:172.21.15.1:6811/3706738461]' entity='osd.3' 2024-09-15T22:18:25.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:24 smithi012 ceph-mon[34883]: purged_snaps scrub starts 2024-09-15T22:18:25.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:24 smithi012 ceph-mon[34883]: purged_snaps scrub ok 2024-09-15T22:18:25.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:24 smithi012 ceph-mon[34883]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:18:25.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:24 smithi012 ceph-mon[34883]: osd.3 [v2:172.21.15.1:6810/3706738461,v1:172.21.15.1:6811/3706738461] boot 2024-09-15T22:18:25.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:24 smithi012 ceph-mon[34883]: osdmap e26: 4 total, 4 up, 4 in 2024-09-15T22:18:25.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:18:25.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:24 smithi012 ceph-mon[34883]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:18:25.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:18:25.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:18:25.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:18:25.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:24 smithi012 ceph-mon[34883]: Detected new or changed devices on smithi001 2024-09-15T22:18:25.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:25.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:25.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:18:25.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:18:25.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:24 smithi012 ceph-mon[34883]: Adjusting osd_memory_target on smithi001 to 8547M 2024-09-15T22:18:25.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:25.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:18:25.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:18:25.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:25.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:24 smithi012 ceph-mon[34883]: osdmap e27: 4 total, 4 up, 4 in 2024-09-15T22:18:25.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:24 smithi098 ceph-mon[35514]: purged_snaps scrub starts 2024-09-15T22:18:25.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:24 smithi098 ceph-mon[35514]: purged_snaps scrub ok 2024-09-15T22:18:25.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:24 smithi098 ceph-mon[35514]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:18:25.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:24 smithi098 ceph-mon[35514]: osd.3 [v2:172.21.15.1:6810/3706738461,v1:172.21.15.1:6811/3706738461] boot 2024-09-15T22:18:25.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:24 smithi098 ceph-mon[35514]: osdmap e26: 4 total, 4 up, 4 in 2024-09-15T22:18:25.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:18:25.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:24 smithi098 ceph-mon[35514]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:18:25.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:18:25.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:18:25.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:18:25.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:24 smithi098 ceph-mon[35514]: Detected new or changed devices on smithi001 2024-09-15T22:18:25.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:25.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:25.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:18:25.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:18:25.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:24 smithi098 ceph-mon[35514]: Adjusting osd_memory_target on smithi001 to 8547M 2024-09-15T22:18:25.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:25.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:18:25.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:18:25.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:25.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:24 smithi098 ceph-mon[35514]: osdmap e27: 4 total, 4 up, 4 in 2024-09-15T22:18:25.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:24 smithi001 ceph-mon[30843]: purged_snaps scrub starts 2024-09-15T22:18:25.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:24 smithi001 ceph-mon[30843]: purged_snaps scrub ok 2024-09-15T22:18:25.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:24 smithi001 ceph-mon[30843]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:18:25.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:24 smithi001 ceph-mon[30843]: osd.3 [v2:172.21.15.1:6810/3706738461,v1:172.21.15.1:6811/3706738461] boot 2024-09-15T22:18:25.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:24 smithi001 ceph-mon[30843]: osdmap e26: 4 total, 4 up, 4 in 2024-09-15T22:18:25.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:18:25.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:24 smithi001 ceph-mon[30843]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:18:25.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:18:25.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:18:25.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:18:25.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:24 smithi001 ceph-mon[30843]: Detected new or changed devices on smithi001 2024-09-15T22:18:25.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:25.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:25.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:18:25.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:18:25.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:24 smithi001 ceph-mon[30843]: Adjusting osd_memory_target on smithi001 to 8547M 2024-09-15T22:18:25.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:25.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:18:25.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:18:25.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:25.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:24 smithi001 ceph-mon[30843]: osdmap e27: 4 total, 4 up, 4 in 2024-09-15T22:18:27.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:26 smithi098 ceph-mon[35514]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 521 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:18:27.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:26 smithi098 ceph-mon[35514]: osdmap e28: 4 total, 4 up, 4 in 2024-09-15T22:18:27.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:26 smithi098 ceph-mon[35514]: from='client.? 172.21.15.12:0/578352305' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "50116baa-dd99-4dbb-a7a1-2268f04052f4"}]: dispatch 2024-09-15T22:18:27.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:26 smithi098 ceph-mon[35514]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "50116baa-dd99-4dbb-a7a1-2268f04052f4"}]: dispatch 2024-09-15T22:18:27.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:26 smithi098 ceph-mon[35514]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "50116baa-dd99-4dbb-a7a1-2268f04052f4"}]': finished 2024-09-15T22:18:27.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:26 smithi098 ceph-mon[35514]: osdmap e29: 5 total, 4 up, 5 in 2024-09-15T22:18:27.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:26 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:18:27.131 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:26 smithi012 ceph-mon[34883]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 521 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:18:27.131 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:26 smithi012 ceph-mon[34883]: osdmap e28: 4 total, 4 up, 4 in 2024-09-15T22:18:27.131 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:26 smithi012 ceph-mon[34883]: from='client.? 172.21.15.12:0/578352305' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "50116baa-dd99-4dbb-a7a1-2268f04052f4"}]: dispatch 2024-09-15T22:18:27.131 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:26 smithi012 ceph-mon[34883]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "50116baa-dd99-4dbb-a7a1-2268f04052f4"}]: dispatch 2024-09-15T22:18:27.131 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:26 smithi012 ceph-mon[34883]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "50116baa-dd99-4dbb-a7a1-2268f04052f4"}]': finished 2024-09-15T22:18:27.132 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:26 smithi012 ceph-mon[34883]: osdmap e29: 5 total, 4 up, 5 in 2024-09-15T22:18:27.132 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:26 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:18:27.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:26 smithi001 ceph-mon[30843]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 521 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:18:27.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:26 smithi001 ceph-mon[30843]: osdmap e28: 4 total, 4 up, 4 in 2024-09-15T22:18:27.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:26 smithi001 ceph-mon[30843]: from='client.? 172.21.15.12:0/578352305' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "50116baa-dd99-4dbb-a7a1-2268f04052f4"}]: dispatch 2024-09-15T22:18:27.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:26 smithi001 ceph-mon[30843]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "50116baa-dd99-4dbb-a7a1-2268f04052f4"}]: dispatch 2024-09-15T22:18:27.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:26 smithi001 ceph-mon[30843]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "50116baa-dd99-4dbb-a7a1-2268f04052f4"}]': finished 2024-09-15T22:18:27.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:26 smithi001 ceph-mon[30843]: osdmap e29: 5 total, 4 up, 5 in 2024-09-15T22:18:27.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:26 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:18:28.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:27 smithi012 ceph-mon[34883]: from='client.? 172.21.15.12:0/2298073591' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:18:28.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:27 smithi012 ceph-mon[34883]: osdmap e30: 5 total, 4 up, 5 in 2024-09-15T22:18:28.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:27 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:18:28.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:27 smithi098 ceph-mon[35514]: from='client.? 172.21.15.12:0/2298073591' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:18:28.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:27 smithi098 ceph-mon[35514]: osdmap e30: 5 total, 4 up, 5 in 2024-09-15T22:18:28.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:27 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:18:28.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:27 smithi001 ceph-mon[30843]: from='client.? 172.21.15.12:0/2298073591' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:18:28.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:27 smithi001 ceph-mon[30843]: osdmap e30: 5 total, 4 up, 5 in 2024-09-15T22:18:28.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:27 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:18:29.202 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:28 smithi012 ceph-mon[34883]: pgmap v107: 1 pgs: 1 remapped+peering; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:18:29.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:28 smithi098 ceph-mon[35514]: pgmap v107: 1 pgs: 1 remapped+peering; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:18:29.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:28 smithi001 ceph-mon[30843]: pgmap v107: 1 pgs: 1 remapped+peering; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:18:31.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:30 smithi012 ceph-mon[34883]: pgmap v109: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:18:31.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:30 smithi098 ceph-mon[35514]: pgmap v109: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:18:31.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:30 smithi001 ceph-mon[30843]: pgmap v109: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:18:33.237 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:32 smithi012 ceph-mon[34883]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T22:18:33.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:32 smithi098 ceph-mon[35514]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T22:18:33.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:32 smithi001 ceph-mon[30843]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T22:18:35.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:34 smithi012 ceph-mon[34883]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-15T22:18:35.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:34 smithi098 ceph-mon[35514]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-15T22:18:35.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:34 smithi001 ceph-mon[30843]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-15T22:18:36.080 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:35 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-15T22:18:36.080 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:35 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:18:36.080 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:35 smithi012 ceph-mon[34883]: Deploying daemon osd.4 on smithi012 2024-09-15T22:18:36.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:35 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-15T22:18:36.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:35 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:18:36.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:35 smithi098 ceph-mon[35514]: Deploying daemon osd.4 on smithi012 2024-09-15T22:18:36.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:35 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-15T22:18:36.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:35 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:18:36.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:35 smithi001 ceph-mon[30843]: Deploying daemon osd.4 on smithi012 2024-09-15T22:18:36.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:36 smithi012 ceph-mon[34883]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-15T22:18:37.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:36 smithi098 ceph-mon[35514]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-15T22:18:37.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:36 smithi001 ceph-mon[30843]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-15T22:18:38.970 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:38 smithi012 ceph-mon[34883]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T22:18:39.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:38 smithi098 ceph-mon[35514]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T22:18:39.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:38 smithi001 ceph-mon[30843]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T22:18:41.216 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:40 smithi012 ceph-mon[34883]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:18:41.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:40 smithi098 ceph-mon[35514]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:18:41.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:40 smithi001 ceph-mon[30843]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:18:42.162 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:41 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:18:42.162 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:41 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:42.162 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:41 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:42.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:41 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:18:42.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:41 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:42.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:41 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:42.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:41 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:18:42.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:41 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:42.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:41 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:43.695 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:43 smithi012 ceph-mon[34883]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:18:43.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:43 smithi098 ceph-mon[35514]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:18:43.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:43 smithi001 ceph-mon[30843]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:18:45.207 INFO:teuthology.orchestra.run.smithi012.stdout:Created osd(s) 4 on host 'smithi012' 2024-09-15T22:18:45.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:45.205+0000 7fe4b37fe640 1 -- 172.21.15.12:0/2126822396 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe4bc109d10 con 0x7fe4a80a3270 2024-09-15T22:18:45.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:45.207+0000 7fe4c0d02640 1 -- 172.21.15.12:0/2126822396 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe4a80a3270 msgr2=0x7fe4a80a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:45.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:45.207+0000 7fe4c0d02640 1 --2- 172.21.15.12:0/2126822396 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe4a80a3270 0x7fe4a80a5730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac000c00 tx=0x7fe4ac0095f0 comp rx=0 tx=0).stop 2024-09-15T22:18:45.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:45.207+0000 7fe4c0d02640 1 -- 172.21.15.12:0/2126822396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4bc101c00 msgr2=0x7fe4bc19a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:45.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:45.207+0000 7fe4c0d02640 1 --2- 172.21.15.12:0/2126822396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4bc101c00 0x7fe4bc19a160 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe4a400d770 tx=0x7fe4a400dc30 comp rx=0 tx=0).stop 2024-09-15T22:18:45.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:45.208+0000 7fe4c0d02640 1 -- 172.21.15.12:0/2126822396 shutdown_connections 2024-09-15T22:18:45.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:45.208+0000 7fe4c0d02640 1 --2- 172.21.15.12:0/2126822396 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe4a80a3270 0x7fe4a80a5730 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:45.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:45.208+0000 7fe4c0d02640 1 --2- 172.21.15.12:0/2126822396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4bc1037c0 0x7fe4bc1a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:45.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:45.208+0000 7fe4c0d02640 1 --2- 172.21.15.12:0/2126822396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4bc102e00 0x7fe4bc19a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:45.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:45.208+0000 7fe4c0d02640 1 --2- 172.21.15.12:0/2126822396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4bc101c00 0x7fe4bc19a160 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:45.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:45.208+0000 7fe4c0d02640 1 -- 172.21.15.12:0/2126822396 >> 172.21.15.12:0/2126822396 conn(0x7fe4bc0fd390 msgr2=0x7fe4bc1085f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:45.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:45.208+0000 7fe4c0d02640 1 -- 172.21.15.12:0/2126822396 shutdown_connections 2024-09-15T22:18:45.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:18:45.208+0000 7fe4c0d02640 1 -- 172.21.15.12:0/2126822396 wait complete. 2024-09-15T22:18:45.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:45 smithi098 ceph-mon[35514]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:18:45.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:45 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:45.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:45 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:45.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:45 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:18:45.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:45 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:18:45.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:45 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:45.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:45 smithi001 ceph-mon[30843]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:18:45.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:45 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:45.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:45 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:45.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:45 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:18:45.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:45 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:18:45.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:45 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:45.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:45 smithi012 ceph-mon[34883]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:18:45.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:45 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:45.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:45 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:45.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:45 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:18:45.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:45 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:18:45.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:45 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:45.905 DEBUG:teuthology.orchestra.run.smithi012:osd.4> sudo journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.4.service 2024-09-15T22:18:45.907 INFO:tasks.cephadm:Deploying osd.5 on smithi098 with /dev/vg_nvme/lv_3... 2024-09-15T22:18:45.908 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-15T22:18:46.148 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:46 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:18:46.148 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:46 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:46.148 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:46 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:46.163 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:18:46.284 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:46 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:18:46.284 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:46 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:46.284 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:46 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:46.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:46 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:18:46.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:46 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:46.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:46 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:47.360 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:47 smithi012 ceph-mon[34883]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:18:47.375 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:47 smithi098 ceph-mon[35514]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:18:47.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:47 smithi001 ceph-mon[30843]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:18:47.628 INFO:journalctl@ceph.osd.4.smithi012.stdout:Sep 15 22:18:47 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-4[46037]: 2024-09-15T22:18:47.414+0000 7f5701ba2640 -1 osd.4 0 log_to_monitors true 2024-09-15T22:18:48.364 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-15T22:18:48.389 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi098:vg_nvme/lv_3 2024-09-15T22:18:48.423 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:48 smithi012 ceph-mon[34883]: from='osd.4 [v2:172.21.15.12:6808/4057902964,v1:172.21.15.12:6809/4057902964]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T22:18:48.424 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:48 smithi012 ceph-mon[34883]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T22:18:48.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:48 smithi098 ceph-mon[35514]: from='osd.4 [v2:172.21.15.12:6808/4057902964,v1:172.21.15.12:6809/4057902964]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T22:18:48.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:48 smithi098 ceph-mon[35514]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T22:18:48.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:48 smithi001 ceph-mon[30843]: from='osd.4 [v2:172.21.15.12:6808/4057902964,v1:172.21.15.12:6809/4057902964]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T22:18:48.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:48 smithi001 ceph-mon[30843]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T22:18:48.637 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:18:49.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.049+0000 7f6368888640 1 -- 172.21.15.98:0/1325236014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63641026c0 msgr2=0x7f6364108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:49.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.049+0000 7f6368888640 1 --2- 172.21.15.98:0/1325236014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63641026c0 0x7f6364108f50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f635c009ca0 tx=0x7f635c02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:18:49.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.049+0000 7f6368888640 1 -- 172.21.15.98:0/1325236014 shutdown_connections 2024-09-15T22:18:49.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.049+0000 7f6368888640 1 --2- 172.21.15.98:0/1325236014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63641026c0 0x7f6364108f50 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:49.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.049+0000 7f6368888640 1 --2- 172.21.15.98:0/1325236014 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6364101d00 0x7f6364102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:49.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.049+0000 7f6368888640 1 --2- 172.21.15.98:0/1325236014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6364100b00 0x7f6364100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:49.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.049+0000 7f6368888640 1 -- 172.21.15.98:0/1325236014 >> 172.21.15.98:0/1325236014 conn(0x7f63640fc270 msgr2=0x7f63640fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:49.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.049+0000 7f6368888640 1 -- 172.21.15.98:0/1325236014 shutdown_connections 2024-09-15T22:18:49.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.049+0000 7f6368888640 1 -- 172.21.15.98:0/1325236014 wait complete. 2024-09-15T22:18:49.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.049+0000 7f6368888640 1 Processor -- start 2024-09-15T22:18:49.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.050+0000 7f6368888640 1 -- start start 2024-09-15T22:18:49.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.050+0000 7f6368888640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6364100b00 0x7f636406b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:49.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.050+0000 7f6368888640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6364101d00 0x7f636419cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:49.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.050+0000 7f6368888640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63641026c0 0x7f636419f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:49.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.050+0000 7f6368888640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f636410c760 con 0x7f6364101d00 2024-09-15T22:18:49.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.050+0000 7f6368888640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f636410c5e0 con 0x7f6364100b00 2024-09-15T22:18:49.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.050+0000 7f6368888640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f636410c8e0 con 0x7f63641026c0 2024-09-15T22:18:49.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.050+0000 7f6362d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63641026c0 0x7f636419f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:49.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.050+0000 7f6362d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63641026c0 0x7f636419f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41674/0 (socket says 172.21.15.98:41674) 2024-09-15T22:18:49.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.050+0000 7f636259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6364100b00 0x7f636406b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:49.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.050+0000 7f6362d9d640 1 -- 172.21.15.98:0/3933590737 learned_addr learned my addr 172.21.15.98:0/3933590737 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-15T22:18:49.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.050+0000 7f6362d9d640 1 -- 172.21.15.98:0/3933590737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6364100b00 msgr2=0x7f636406b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:49.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.050+0000 7f6362d9d640 1 --2- 172.21.15.98:0/3933590737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6364100b00 0x7f636406b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:49.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.050+0000 7f6362d9d640 1 -- 172.21.15.98:0/3933590737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6364101d00 msgr2=0x7f636419cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:49.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.050+0000 7f6362d9d640 1 --2- 172.21.15.98:0/3933590737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6364101d00 0x7f636419cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:49.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.050+0000 7f6362d9d640 1 -- 172.21.15.98:0/3933590737 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f636419fb10 con 0x7f63641026c0 2024-09-15T22:18:49.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.050+0000 7f6362d9d640 1 --2- 172.21.15.98:0/3933590737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63641026c0 0x7f636419f200 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f635c031ee0 tx=0x7f635c031f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:49.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.050+0000 7f63537fe640 1 -- 172.21.15.98:0/3933590737 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f635c003c30 con 0x7f63641026c0 2024-09-15T22:18:49.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.051+0000 7f63537fe640 1 -- 172.21.15.98:0/3933590737 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f635c003dd0 con 0x7f63641026c0 2024-09-15T22:18:49.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.051+0000 7f6368888640 1 -- 172.21.15.98:0/3933590737 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f636419fd40 con 0x7f63641026c0 2024-09-15T22:18:49.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.051+0000 7f63537fe640 1 -- 172.21.15.98:0/3933590737 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f635c02fc10 con 0x7f63641026c0 2024-09-15T22:18:49.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.051+0000 7f6368888640 1 -- 172.21.15.98:0/3933590737 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63641a02d0 con 0x7f63641026c0 2024-09-15T22:18:49.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.052+0000 7f6368888640 1 -- 172.21.15.98:0/3933590737 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6364107ef0 con 0x7f63641026c0 2024-09-15T22:18:49.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.053+0000 7f63537fe640 1 -- 172.21.15.98:0/3933590737 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f635c0305c0 con 0x7f63641026c0 2024-09-15T22:18:49.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.053+0000 7f63537fe640 1 --2- 172.21.15.98:0/3933590737 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f634c0a32c0 0x7f634c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:49.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.054+0000 7f63537fe640 1 -- 172.21.15.98:0/3933590737 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 3805+0+0 (secure 0 0 0) 0x7f635c0efa00 con 0x7f63641026c0 2024-09-15T22:18:49.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.054+0000 7f636259c640 1 --2- 172.21.15.98:0/3933590737 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f634c0a32c0 0x7f634c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:49.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.054+0000 7f636259c640 1 --2- 172.21.15.98:0/3933590737 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f634c0a32c0 0x7f634c0a5780 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6364101b60 tx=0x7f635400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:49.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.058+0000 7f63537fe640 1 -- 172.21.15.98:0/3933590737 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f635c0046c0 con 0x7f63641026c0 2024-09-15T22:18:49.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:18:49.239+0000 7f6368888640 1 -- 172.21.15.98:0/3933590737 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f6364062630 con 0x7f634c0a32c0 2024-09-15T22:18:49.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:49 smithi012 ceph-mon[34883]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:18:49.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:49 smithi012 ceph-mon[34883]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-15T22:18:49.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:49 smithi012 ceph-mon[34883]: from='osd.4 [v2:172.21.15.12:6808/4057902964,v1:172.21.15.12:6809/4057902964]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-15T22:18:49.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:49 smithi012 ceph-mon[34883]: osdmap e31: 5 total, 4 up, 5 in 2024-09-15T22:18:49.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:49 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:18:49.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:49 smithi012 ceph-mon[34883]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-15T22:18:49.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:49 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:49.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:49 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:49.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:49 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:18:49.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:49 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:18:49.497 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:49 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:49.497 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:49 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:18:49.497 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:49 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:18:49.497 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:49 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:49.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:49 smithi098 ceph-mon[35514]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:18:49.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:49 smithi098 ceph-mon[35514]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-15T22:18:49.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:49 smithi098 ceph-mon[35514]: from='osd.4 [v2:172.21.15.12:6808/4057902964,v1:172.21.15.12:6809/4057902964]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-15T22:18:49.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:49 smithi098 ceph-mon[35514]: osdmap e31: 5 total, 4 up, 5 in 2024-09-15T22:18:49.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:49 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:18:49.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:49 smithi098 ceph-mon[35514]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-15T22:18:49.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:49 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:49.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:49 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:49.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:49 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:18:49.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:49 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:18:49.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:49 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:49.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:49 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:18:49.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:49 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:18:49.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:49 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:49.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:49 smithi001 ceph-mon[30843]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:18:49.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:49 smithi001 ceph-mon[30843]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-15T22:18:49.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:49 smithi001 ceph-mon[30843]: from='osd.4 [v2:172.21.15.12:6808/4057902964,v1:172.21.15.12:6809/4057902964]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-15T22:18:49.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:49 smithi001 ceph-mon[30843]: osdmap e31: 5 total, 4 up, 5 in 2024-09-15T22:18:49.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:49 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:18:49.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:49 smithi001 ceph-mon[30843]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-15T22:18:49.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:49 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:49.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:49 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:49.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:49 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:18:49.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:49 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:18:49.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:49 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:49.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:49 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:18:49.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:49 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:18:49.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:49 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:18:50.495 INFO:journalctl@ceph.osd.4.smithi012.stdout:Sep 15 22:18:50 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-4[46037]: 2024-09-15T22:18:50.022+0000 7f56fd302640 -1 osd.4 0 waiting for initial osdmap 2024-09-15T22:18:50.496 INFO:journalctl@ceph.osd.4.smithi012.stdout:Sep 15 22:18:50 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-4[46037]: 2024-09-15T22:18:50.031+0000 7f56f5934640 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:18:50.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:50 smithi012 ceph-mon[34883]: Detected new or changed devices on smithi012 2024-09-15T22:18:50.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:50 smithi012 ceph-mon[34883]: Adjusting osd_memory_target on smithi012 to 8546M 2024-09-15T22:18:50.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:50 smithi012 ceph-mon[34883]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-15T22:18:50.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:50 smithi012 ceph-mon[34883]: osdmap e32: 5 total, 4 up, 5 in 2024-09-15T22:18:50.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:50 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:18:50.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:50 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:18:50.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:50 smithi012 ceph-mon[34883]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:18:50.497 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:50 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:18:50.497 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:50 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:18:50.497 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:50 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:18:50.497 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:50 smithi012 ceph-mon[34883]: from='osd.4 ' entity='osd.4' 2024-09-15T22:18:50.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:50 smithi098 ceph-mon[35514]: Detected new or changed devices on smithi012 2024-09-15T22:18:50.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:50 smithi098 ceph-mon[35514]: Adjusting osd_memory_target on smithi012 to 8546M 2024-09-15T22:18:50.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:50 smithi098 ceph-mon[35514]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-15T22:18:50.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:50 smithi098 ceph-mon[35514]: osdmap e32: 5 total, 4 up, 5 in 2024-09-15T22:18:50.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:50 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:18:50.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:50 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:18:50.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:50 smithi098 ceph-mon[35514]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:18:50.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:50 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:18:50.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:50 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:18:50.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:50 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:18:50.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:50 smithi098 ceph-mon[35514]: from='osd.4 ' entity='osd.4' 2024-09-15T22:18:50.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:50 smithi001 ceph-mon[30843]: Detected new or changed devices on smithi012 2024-09-15T22:18:50.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:50 smithi001 ceph-mon[30843]: Adjusting osd_memory_target on smithi012 to 8546M 2024-09-15T22:18:50.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:50 smithi001 ceph-mon[30843]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-15T22:18:50.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:50 smithi001 ceph-mon[30843]: osdmap e32: 5 total, 4 up, 5 in 2024-09-15T22:18:50.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:50 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:18:50.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:50 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:18:50.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:50 smithi001 ceph-mon[30843]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:18:50.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:50 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:18:50.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:50 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:18:50.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:50 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:18:50.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:50 smithi001 ceph-mon[30843]: from='osd.4 ' entity='osd.4' 2024-09-15T22:18:51.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:51 smithi012 ceph-mon[34883]: purged_snaps scrub starts 2024-09-15T22:18:51.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:51 smithi012 ceph-mon[34883]: purged_snaps scrub ok 2024-09-15T22:18:51.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:51 smithi012 ceph-mon[34883]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:18:51.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:51 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:18:51.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:51 smithi012 ceph-mon[34883]: osd.4 [v2:172.21.15.12:6808/4057902964,v1:172.21.15.12:6809/4057902964] boot 2024-09-15T22:18:51.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:51 smithi012 ceph-mon[34883]: osdmap e33: 5 total, 5 up, 5 in 2024-09-15T22:18:51.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:51 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:18:51.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:51 smithi098 ceph-mon[35514]: purged_snaps scrub starts 2024-09-15T22:18:51.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:51 smithi098 ceph-mon[35514]: purged_snaps scrub ok 2024-09-15T22:18:51.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:51 smithi098 ceph-mon[35514]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:18:51.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:51 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:18:51.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:51 smithi098 ceph-mon[35514]: osd.4 [v2:172.21.15.12:6808/4057902964,v1:172.21.15.12:6809/4057902964] boot 2024-09-15T22:18:51.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:51 smithi098 ceph-mon[35514]: osdmap e33: 5 total, 5 up, 5 in 2024-09-15T22:18:51.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:51 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:18:51.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:51 smithi001 ceph-mon[30843]: purged_snaps scrub starts 2024-09-15T22:18:51.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:51 smithi001 ceph-mon[30843]: purged_snaps scrub ok 2024-09-15T22:18:51.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:51 smithi001 ceph-mon[30843]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:18:51.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:51 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:18:51.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:51 smithi001 ceph-mon[30843]: osd.4 [v2:172.21.15.12:6808/4057902964,v1:172.21.15.12:6809/4057902964] boot 2024-09-15T22:18:51.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:51 smithi001 ceph-mon[30843]: osdmap e33: 5 total, 5 up, 5 in 2024-09-15T22:18:51.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:51 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:18:52.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:52 smithi012 ceph-mon[34883]: from='client.? 172.21.15.98:0/2919115375' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56ab0694-2f21-46c4-a086-44f72c271c56"}]: dispatch 2024-09-15T22:18:52.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:52 smithi012 ceph-mon[34883]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56ab0694-2f21-46c4-a086-44f72c271c56"}]: dispatch 2024-09-15T22:18:52.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:52 smithi012 ceph-mon[34883]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56ab0694-2f21-46c4-a086-44f72c271c56"}]': finished 2024-09-15T22:18:52.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:52 smithi012 ceph-mon[34883]: osdmap e34: 6 total, 5 up, 6 in 2024-09-15T22:18:52.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:52 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:18:52.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:52 smithi012 ceph-mon[34883]: from='client.? 172.21.15.98:0/855551320' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:18:52.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:52 smithi098 ceph-mon[35514]: from='client.? 172.21.15.98:0/2919115375' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56ab0694-2f21-46c4-a086-44f72c271c56"}]: dispatch 2024-09-15T22:18:52.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:52 smithi098 ceph-mon[35514]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56ab0694-2f21-46c4-a086-44f72c271c56"}]: dispatch 2024-09-15T22:18:52.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:52 smithi098 ceph-mon[35514]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56ab0694-2f21-46c4-a086-44f72c271c56"}]': finished 2024-09-15T22:18:52.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:52 smithi098 ceph-mon[35514]: osdmap e34: 6 total, 5 up, 6 in 2024-09-15T22:18:52.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:52 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:18:52.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:52 smithi098 ceph-mon[35514]: from='client.? 172.21.15.98:0/855551320' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:18:52.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:52 smithi001 ceph-mon[30843]: from='client.? 172.21.15.98:0/2919115375' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56ab0694-2f21-46c4-a086-44f72c271c56"}]: dispatch 2024-09-15T22:18:52.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:52 smithi001 ceph-mon[30843]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56ab0694-2f21-46c4-a086-44f72c271c56"}]: dispatch 2024-09-15T22:18:52.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:52 smithi001 ceph-mon[30843]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56ab0694-2f21-46c4-a086-44f72c271c56"}]': finished 2024-09-15T22:18:52.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:52 smithi001 ceph-mon[30843]: osdmap e34: 6 total, 5 up, 6 in 2024-09-15T22:18:52.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:52 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:18:52.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:52 smithi001 ceph-mon[30843]: from='client.? 172.21.15.98:0/855551320' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:18:53.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:53 smithi012 ceph-mon[34883]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:18:53.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:53 smithi012 ceph-mon[34883]: osdmap e35: 6 total, 5 up, 6 in 2024-09-15T22:18:53.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:53 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:18:53.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:53 smithi098 ceph-mon[35514]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:18:53.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:53 smithi098 ceph-mon[35514]: osdmap e35: 6 total, 5 up, 6 in 2024-09-15T22:18:53.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:53 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:18:53.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:53 smithi001 ceph-mon[30843]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:18:53.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:53 smithi001 ceph-mon[30843]: osdmap e35: 6 total, 5 up, 6 in 2024-09-15T22:18:53.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:53 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:18:55.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:55 smithi001 ceph-mon[30843]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:18:55.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:55 smithi012 ceph-mon[34883]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:18:55.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:55 smithi098 ceph-mon[35514]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:18:57.463 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:57 smithi098 ceph-mon[35514]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:18:57.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:57 smithi012 ceph-mon[34883]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:18:57.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:57 smithi001 ceph-mon[30843]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:18:59.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:18:59 smithi012 ceph-mon[34883]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:18:59.560 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:18:59 smithi098 ceph-mon[35514]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:18:59.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:18:59 smithi001 ceph-mon[30843]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:19:00.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:00 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-15T22:19:00.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:00 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:19:00.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:00 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-15T22:19:00.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:00 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:19:00.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:00 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-15T22:19:00.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:00 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:19:01.508 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:01 smithi098 ceph-mon[35514]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:19:01.508 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:01 smithi098 ceph-mon[35514]: Deploying daemon osd.5 on smithi098 2024-09-15T22:19:01.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:01 smithi001 ceph-mon[30843]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:19:01.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:01 smithi001 ceph-mon[30843]: Deploying daemon osd.5 on smithi098 2024-09-15T22:19:01.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:01 smithi012 ceph-mon[34883]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:19:01.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:01 smithi012 ceph-mon[34883]: Deploying daemon osd.5 on smithi098 2024-09-15T22:19:03.468 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:03 smithi098 ceph-mon[35514]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:19:03.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:03 smithi001 ceph-mon[30843]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:19:03.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:03 smithi012 ceph-mon[34883]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:19:05.423 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:05 smithi098 ceph-mon[35514]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:19:05.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:05 smithi001 ceph-mon[30843]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:19:05.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:05 smithi012 ceph-mon[34883]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:19:06.520 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:06 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:19:06.520 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:06 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:06.520 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:06 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:06.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:06 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:19:06.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:06 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:06.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:06 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:06.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:06 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:19:06.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:06 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:06.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:06 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:07.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:07 smithi098 ceph-mon[35514]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:19:07.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:07 smithi001 ceph-mon[30843]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:19:07.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:07 smithi012 ceph-mon[34883]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:19:09.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:09 smithi098 ceph-mon[35514]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:19:09.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:09 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:09.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:09 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:09.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:09 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:19:09.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:09 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:19:09.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:09 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:09.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:09 smithi001 ceph-mon[30843]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:19:09.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:09 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:09.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:09 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:09.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:09 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:19:09.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:09 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:19:09.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:09 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:09.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:09 smithi012 ceph-mon[34883]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:19:09.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:09 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:09.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:09 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:09.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:09 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:19:09.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:09 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:19:09.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:09 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:09.967 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 5 on host 'smithi098' 2024-09-15T22:19:09.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:19:09.965+0000 7f63537fe640 1 -- 172.21.15.98:0/3933590737 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6364062630 con 0x7f634c0a32c0 2024-09-15T22:19:09.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:19:09.968+0000 7f6368888640 1 -- 172.21.15.98:0/3933590737 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f634c0a32c0 msgr2=0x7f634c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:09.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:19:09.968+0000 7f6368888640 1 --2- 172.21.15.98:0/3933590737 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f634c0a32c0 0x7f634c0a5780 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6364101b60 tx=0x7f635400b390 comp rx=0 tx=0).stop 2024-09-15T22:19:09.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:19:09.968+0000 7f6368888640 1 -- 172.21.15.98:0/3933590737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63641026c0 msgr2=0x7f636419f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:09.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:19:09.968+0000 7f6368888640 1 --2- 172.21.15.98:0/3933590737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63641026c0 0x7f636419f200 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f635c031ee0 tx=0x7f635c031f10 comp rx=0 tx=0).stop 2024-09-15T22:19:09.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:19:09.968+0000 7f6368888640 1 -- 172.21.15.98:0/3933590737 shutdown_connections 2024-09-15T22:19:09.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:19:09.968+0000 7f6368888640 1 --2- 172.21.15.98:0/3933590737 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f634c0a32c0 0x7f634c0a5780 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:09.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:19:09.968+0000 7f6368888640 1 --2- 172.21.15.98:0/3933590737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63641026c0 0x7f636419f200 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:09.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:19:09.968+0000 7f6368888640 1 --2- 172.21.15.98:0/3933590737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6364101d00 0x7f636419cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:09.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:19:09.968+0000 7f6368888640 1 --2- 172.21.15.98:0/3933590737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6364100b00 0x7f636406b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:09.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:19:09.968+0000 7f6368888640 1 -- 172.21.15.98:0/3933590737 >> 172.21.15.98:0/3933590737 conn(0x7f63640fc270 msgr2=0x7f63641050c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:09.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:19:09.968+0000 7f6368888640 1 -- 172.21.15.98:0/3933590737 shutdown_connections 2024-09-15T22:19:09.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:19:09.968+0000 7f6368888640 1 -- 172.21.15.98:0/3933590737 wait complete. 2024-09-15T22:19:10.530 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:10 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:19:10.530 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:10 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:10.530 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:10 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:10.557 DEBUG:teuthology.orchestra.run.smithi098:osd.5> sudo journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.5.service 2024-09-15T22:19:10.560 INFO:tasks.cephadm:Deploying osd.6 on smithi001 with /dev/vg_nvme/lv_2... 2024-09-15T22:19:10.560 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-15T22:19:10.614 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:10 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:19:10.615 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:10 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:10.615 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:10 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:10.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:10 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:19:10.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:10 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:10.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:10 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:10.940 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:19:11.364 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:11 smithi001 ceph-mon[30843]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:19:11.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:11 smithi098 ceph-mon[35514]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:19:11.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:11 smithi012 ceph-mon[34883]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:19:12.561 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:19:12 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:19:12.292+0000 7f459f3b3640 -1 osd.5 0 log_to_monitors true 2024-09-15T22:19:13.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:13 smithi001 ceph-mon[30843]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:19:13.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:13 smithi001 ceph-mon[30843]: from='osd.5 [v2:172.21.15.98:6808/4043567619,v1:172.21.15.98:6809/4043567619]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T22:19:13.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:13 smithi001 ceph-mon[30843]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T22:19:13.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:13 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:13.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:13 smithi098 ceph-mon[35514]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:19:13.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:13 smithi098 ceph-mon[35514]: from='osd.5 [v2:172.21.15.98:6808/4043567619,v1:172.21.15.98:6809/4043567619]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T22:19:13.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:13 smithi098 ceph-mon[35514]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T22:19:13.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:13 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:13.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:13 smithi012 ceph-mon[34883]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:19:13.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:13 smithi012 ceph-mon[34883]: from='osd.5 [v2:172.21.15.98:6808/4043567619,v1:172.21.15.98:6809/4043567619]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T22:19:13.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:13 smithi012 ceph-mon[34883]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T22:19:13.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:13 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:13.956 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:19:13.990 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi001:vg_nvme/lv_2 2024-09-15T22:19:14.377 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:19:14.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:14 smithi001 ceph-mon[30843]: Detected new or changed devices on smithi098 2024-09-15T22:19:14.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:14 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:14.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:14 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:14.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:14 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:14.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:14 smithi001 ceph-mon[30843]: Adjusting osd_memory_target on smithi098 to 8544M 2024-09-15T22:19:14.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:14 smithi001 ceph-mon[30843]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-15T22:19:14.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:14 smithi001 ceph-mon[30843]: osdmap e36: 6 total, 5 up, 6 in 2024-09-15T22:19:14.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:14 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:19:14.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:14 smithi001 ceph-mon[30843]: from='osd.5 [v2:172.21.15.98:6808/4043567619,v1:172.21.15.98:6809/4043567619]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-15T22:19:14.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:14 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:14.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:14 smithi001 ceph-mon[30843]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-15T22:19:14.535 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:14 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:19:14.535 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:14 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:19:14.535 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:14 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:14.561 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:19:14 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:19:14.306+0000 7f459ab13640 -1 osd.5 0 waiting for initial osdmap 2024-09-15T22:19:14.561 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:19:14 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:19:14.317+0000 7f459714d640 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:19:14.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:14 smithi098 ceph-mon[35514]: Detected new or changed devices on smithi098 2024-09-15T22:19:14.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:14 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:14.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:14 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:14.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:14 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:14.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:14 smithi098 ceph-mon[35514]: Adjusting osd_memory_target on smithi098 to 8544M 2024-09-15T22:19:14.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:14 smithi098 ceph-mon[35514]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-15T22:19:14.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:14 smithi098 ceph-mon[35514]: osdmap e36: 6 total, 5 up, 6 in 2024-09-15T22:19:14.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:14 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:19:14.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:14 smithi098 ceph-mon[35514]: from='osd.5 [v2:172.21.15.98:6808/4043567619,v1:172.21.15.98:6809/4043567619]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-15T22:19:14.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:14 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:14.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:14 smithi098 ceph-mon[35514]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-15T22:19:14.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:14 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:19:14.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:14 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:19:14.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:14 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:14.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:14 smithi012 ceph-mon[34883]: Detected new or changed devices on smithi098 2024-09-15T22:19:14.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:14 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:14.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:14 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:14.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:14 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:14.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:14 smithi012 ceph-mon[34883]: Adjusting osd_memory_target on smithi098 to 8544M 2024-09-15T22:19:14.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:14 smithi012 ceph-mon[34883]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-15T22:19:14.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:14 smithi012 ceph-mon[34883]: osdmap e36: 6 total, 5 up, 6 in 2024-09-15T22:19:14.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:14 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:19:14.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:14 smithi012 ceph-mon[34883]: from='osd.5 [v2:172.21.15.98:6808/4043567619,v1:172.21.15.98:6809/4043567619]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-15T22:19:14.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:14 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:14.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:14 smithi012 ceph-mon[34883]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-15T22:19:14.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:14 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:19:14.747 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:14 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:19:14.747 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:14 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:14.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.875+0000 7fcf3ee00640 1 -- 172.21.15.1:0/335108196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf38076220 msgr2=0x7fcf38074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:14.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.875+0000 7fcf3ee00640 1 --2- 172.21.15.1:0/335108196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf38076220 0x7fcf38074680 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcf28009900 tx=0x7fcf2802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.876+0000 7fcf3ee00640 1 -- 172.21.15.1:0/335108196 shutdown_connections 2024-09-15T22:19:14.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.876+0000 7fcf3ee00640 1 --2- 172.21.15.1:0/335108196 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf3810e1e0 0x7fcf381105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.876+0000 7fcf3ee00640 1 --2- 172.21.15.1:0/335108196 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf38074c50 0x7fcf380750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.876+0000 7fcf3ee00640 1 --2- 172.21.15.1:0/335108196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf38076220 0x7fcf38074680 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.876+0000 7fcf3ee00640 1 -- 172.21.15.1:0/335108196 >> 172.21.15.1:0/335108196 conn(0x7fcf380fd390 msgr2=0x7fcf380ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:14.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.876+0000 7fcf3ee00640 1 -- 172.21.15.1:0/335108196 shutdown_connections 2024-09-15T22:19:14.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.876+0000 7fcf3ee00640 1 -- 172.21.15.1:0/335108196 wait complete. 2024-09-15T22:19:14.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.877+0000 7fcf3ee00640 1 Processor -- start 2024-09-15T22:19:14.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.877+0000 7fcf3ee00640 1 -- start start 2024-09-15T22:19:14.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.877+0000 7fcf3ee00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf38074c50 0x7fcf3819e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:14.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.877+0000 7fcf3ee00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf38076220 0x7fcf3819ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:14.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.877+0000 7fcf3ee00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf3810e1e0 0x7fcf381a5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:14.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.877+0000 7fcf3ee00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcf38113ef0 con 0x7fcf38076220 2024-09-15T22:19:14.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.877+0000 7fcf3ee00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcf38113d70 con 0x7fcf3810e1e0 2024-09-15T22:19:14.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.877+0000 7fcf3ee00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcf38114070 con 0x7fcf38074c50 2024-09-15T22:19:14.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.877+0000 7fcf37400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf38076220 0x7fcf3819ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:14.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.877+0000 7fcf37400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf38076220 0x7fcf3819ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37534/0 (socket says 172.21.15.1:37534) 2024-09-15T22:19:14.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.877+0000 7fcf37400640 1 -- 172.21.15.1:0/4074991315 learned_addr learned my addr 172.21.15.1:0/4074991315 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:19:14.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.877+0000 7fcf3ce00640 1 --2- 172.21.15.1:0/4074991315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf3810e1e0 0x7fcf381a5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:14.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.878+0000 7fcf37e00640 1 --2- 172.21.15.1:0/4074991315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf38074c50 0x7fcf3819e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:14.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.878+0000 7fcf37400640 1 -- 172.21.15.1:0/4074991315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf38074c50 msgr2=0x7fcf3819e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:14.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.878+0000 7fcf37400640 1 --2- 172.21.15.1:0/4074991315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf38074c50 0x7fcf3819e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.878+0000 7fcf37400640 1 -- 172.21.15.1:0/4074991315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf3810e1e0 msgr2=0x7fcf381a5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:14.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.878+0000 7fcf37400640 1 --2- 172.21.15.1:0/4074991315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf3810e1e0 0x7fcf381a5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.878+0000 7fcf37400640 1 -- 172.21.15.1:0/4074991315 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf381a6160 con 0x7fcf38076220 2024-09-15T22:19:14.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.878+0000 7fcf3ce00640 1 --2- 172.21.15.1:0/4074991315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf3810e1e0 0x7fcf381a5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:19:14.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.878+0000 7fcf37400640 1 --2- 172.21.15.1:0/4074991315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf38076220 0x7fcf3819ea70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcf2400e9f0 tx=0x7fcf2400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:14.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.879+0000 7fcf34c00640 1 -- 172.21.15.1:0/4074991315 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf2400cd80 con 0x7fcf38076220 2024-09-15T22:19:14.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.879+0000 7fcf3ee00640 1 -- 172.21.15.1:0/4074991315 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf381a6450 con 0x7fcf38076220 2024-09-15T22:19:14.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.879+0000 7fcf34c00640 1 -- 172.21.15.1:0/4074991315 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf24005500 con 0x7fcf38076220 2024-09-15T22:19:14.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.879+0000 7fcf34c00640 1 -- 172.21.15.1:0/4074991315 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf24010690 con 0x7fcf38076220 2024-09-15T22:19:14.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.879+0000 7fcf3ee00640 1 -- 172.21.15.1:0/4074991315 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf381a6940 con 0x7fcf38076220 2024-09-15T22:19:14.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.880+0000 7fcf3ee00640 1 -- 172.21.15.1:0/4074991315 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf38103b80 con 0x7fcf38076220 2024-09-15T22:19:14.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.882+0000 7fcf34c00640 1 -- 172.21.15.1:0/4074991315 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fcf240046c0 con 0x7fcf38076220 2024-09-15T22:19:14.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.884+0000 7fcf34c00640 1 --2- 172.21.15.1:0/4074991315 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fcf1c0a3270 0x7fcf1c0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:14.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.884+0000 7fcf34c00640 1 -- 172.21.15.1:0/4074991315 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4253+0+0 (secure 0 0 0) 0x7fcf240cef80 con 0x7fcf38076220 2024-09-15T22:19:14.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.884+0000 7fcf37e00640 1 --2- 172.21.15.1:0/4074991315 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fcf1c0a3270 0x7fcf1c0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:14.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.885+0000 7fcf37e00640 1 --2- 172.21.15.1:0/4074991315 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fcf1c0a3270 0x7fcf1c0a5730 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcf2802a9e0 tx=0x7fcf280315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:14.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:14.887+0000 7fcf34c00640 1 -- 172.21.15.1:0/4074991315 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcf240541b0 con 0x7fcf38076220 2024-09-15T22:19:15.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:15.081+0000 7fcf3ee00640 1 -- 172.21.15.1:0/4074991315 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fcf38062630 con 0x7fcf1c0a3270 2024-09-15T22:19:15.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:15 smithi001 ceph-mon[30843]: purged_snaps scrub starts 2024-09-15T22:19:15.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:15 smithi001 ceph-mon[30843]: purged_snaps scrub ok 2024-09-15T22:19:15.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:15 smithi001 ceph-mon[30843]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:19:15.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:15 smithi001 ceph-mon[30843]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-15T22:19:15.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:15 smithi001 ceph-mon[30843]: osdmap e37: 6 total, 5 up, 6 in 2024-09-15T22:19:15.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:15 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:19:15.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:15 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:19:15.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:15 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:19:15.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:15 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:19:15.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:15 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:19:15.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:15 smithi098 ceph-mon[35514]: purged_snaps scrub starts 2024-09-15T22:19:15.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:15 smithi098 ceph-mon[35514]: purged_snaps scrub ok 2024-09-15T22:19:15.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:15 smithi098 ceph-mon[35514]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:19:15.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:15 smithi098 ceph-mon[35514]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-15T22:19:15.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:15 smithi098 ceph-mon[35514]: osdmap e37: 6 total, 5 up, 6 in 2024-09-15T22:19:15.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:15 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:19:15.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:15 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:19:15.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:15 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:19:15.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:15 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:19:15.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:15 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:19:15.647 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:15 smithi012 ceph-mon[34883]: purged_snaps scrub starts 2024-09-15T22:19:15.647 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:15 smithi012 ceph-mon[34883]: purged_snaps scrub ok 2024-09-15T22:19:15.647 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:15 smithi012 ceph-mon[34883]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:19:15.647 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:15 smithi012 ceph-mon[34883]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-15T22:19:15.647 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:15 smithi012 ceph-mon[34883]: osdmap e37: 6 total, 5 up, 6 in 2024-09-15T22:19:15.647 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:15 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:19:15.647 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:15 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:19:15.648 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:15 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:19:15.648 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:15 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:19:15.648 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:15 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:19:16.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:16 smithi001 ceph-mon[30843]: from='client.14325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:19:16.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:16 smithi001 ceph-mon[30843]: osd.5 [v2:172.21.15.98:6808/4043567619,v1:172.21.15.98:6809/4043567619] boot 2024-09-15T22:19:16.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:16 smithi001 ceph-mon[30843]: osdmap e38: 6 total, 6 up, 6 in 2024-09-15T22:19:16.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:16 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:19:16.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:16 smithi001 ceph-mon[30843]: osdmap e39: 6 total, 6 up, 6 in 2024-09-15T22:19:16.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:16 smithi098 ceph-mon[35514]: from='client.14325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:19:16.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:16 smithi098 ceph-mon[35514]: osd.5 [v2:172.21.15.98:6808/4043567619,v1:172.21.15.98:6809/4043567619] boot 2024-09-15T22:19:16.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:16 smithi098 ceph-mon[35514]: osdmap e38: 6 total, 6 up, 6 in 2024-09-15T22:19:16.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:16 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:19:16.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:16 smithi098 ceph-mon[35514]: osdmap e39: 6 total, 6 up, 6 in 2024-09-15T22:19:16.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:16 smithi012 ceph-mon[34883]: from='client.14325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:19:16.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:16 smithi012 ceph-mon[34883]: osd.5 [v2:172.21.15.98:6808/4043567619,v1:172.21.15.98:6809/4043567619] boot 2024-09-15T22:19:16.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:16 smithi012 ceph-mon[34883]: osdmap e38: 6 total, 6 up, 6 in 2024-09-15T22:19:16.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:16 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:19:16.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:16 smithi012 ceph-mon[34883]: osdmap e39: 6 total, 6 up, 6 in 2024-09-15T22:19:17.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:17 smithi098 ceph-mon[35514]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:19:17.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:17 smithi098 ceph-mon[35514]: osdmap e40: 6 total, 6 up, 6 in 2024-09-15T22:19:17.579 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:17 smithi001 ceph-mon[30843]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:19:17.580 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:17 smithi001 ceph-mon[30843]: osdmap e40: 6 total, 6 up, 6 in 2024-09-15T22:19:17.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:17 smithi012 ceph-mon[34883]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:19:17.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:17 smithi012 ceph-mon[34883]: osdmap e40: 6 total, 6 up, 6 in 2024-09-15T22:19:18.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:18 smithi001 ceph-mon[30843]: pgmap v143: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:19:18.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:18 smithi001 ceph-mon[30843]: osdmap e41: 6 total, 6 up, 6 in 2024-09-15T22:19:18.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:18 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/938730648' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5ca0d114-4894-428e-bcd3-2ebd24d10a86"}]: dispatch 2024-09-15T22:19:18.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:18 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/938730648' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5ca0d114-4894-428e-bcd3-2ebd24d10a86"}]': finished 2024-09-15T22:19:18.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:18 smithi001 ceph-mon[30843]: osdmap e42: 7 total, 6 up, 7 in 2024-09-15T22:19:18.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:18 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:19:18.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:18 smithi012 ceph-mon[34883]: pgmap v143: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:19:18.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:18 smithi012 ceph-mon[34883]: osdmap e41: 6 total, 6 up, 6 in 2024-09-15T22:19:18.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:18 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/938730648' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5ca0d114-4894-428e-bcd3-2ebd24d10a86"}]: dispatch 2024-09-15T22:19:18.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:18 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/938730648' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5ca0d114-4894-428e-bcd3-2ebd24d10a86"}]': finished 2024-09-15T22:19:18.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:18 smithi012 ceph-mon[34883]: osdmap e42: 7 total, 6 up, 7 in 2024-09-15T22:19:18.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:18 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:19:19.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:18 smithi098 ceph-mon[35514]: pgmap v143: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:19:19.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:18 smithi098 ceph-mon[35514]: osdmap e41: 6 total, 6 up, 6 in 2024-09-15T22:19:19.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:18 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/938730648' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5ca0d114-4894-428e-bcd3-2ebd24d10a86"}]: dispatch 2024-09-15T22:19:19.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:18 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/938730648' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5ca0d114-4894-428e-bcd3-2ebd24d10a86"}]': finished 2024-09-15T22:19:19.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:18 smithi098 ceph-mon[35514]: osdmap e42: 7 total, 6 up, 7 in 2024-09-15T22:19:19.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:18 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:19:19.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:19 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/1559565383' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:19:19.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:19 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/1559565383' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:19:20.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:19 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/1559565383' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:19:20.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:20 smithi001 ceph-mon[30843]: pgmap v146: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:19:20.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:20 smithi012 ceph-mon[34883]: pgmap v146: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:19:21.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:20 smithi098 ceph-mon[35514]: pgmap v146: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:19:22.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:22 smithi001 ceph-mon[30843]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-15T22:19:22.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:22 smithi012 ceph-mon[34883]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-15T22:19:23.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:22 smithi098 ceph-mon[35514]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-15T22:19:24.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:24 smithi001 ceph-mon[30843]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-15T22:19:24.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:24 smithi012 ceph-mon[34883]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-15T22:19:25.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:24 smithi098 ceph-mon[35514]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-15T22:19:26.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:26 smithi012 ceph-mon[34883]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T22:19:26.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:26 smithi001 ceph-mon[30843]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T22:19:27.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:26 smithi098 ceph-mon[35514]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T22:19:27.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:27 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-15T22:19:27.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:27 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:19:27.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:27 smithi001 ceph-mon[30843]: Deploying daemon osd.6 on smithi001 2024-09-15T22:19:27.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:27 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-15T22:19:27.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:27 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:19:27.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:27 smithi012 ceph-mon[34883]: Deploying daemon osd.6 on smithi001 2024-09-15T22:19:28.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:27 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-15T22:19:28.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:27 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:19:28.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:27 smithi098 ceph-mon[35514]: Deploying daemon osd.6 on smithi001 2024-09-15T22:19:28.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:28 smithi001 ceph-mon[30843]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T22:19:28.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:28 smithi012 ceph-mon[34883]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T22:19:29.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:28 smithi098 ceph-mon[35514]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T22:19:30.864 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:30 smithi001 ceph-mon[30843]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-15T22:19:30.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:30 smithi012 ceph-mon[34883]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-15T22:19:31.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:30 smithi098 ceph-mon[35514]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-15T22:19:32.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:32 smithi001 ceph-mon[30843]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:19:32.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:32 smithi012 ceph-mon[34883]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:19:33.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:32 smithi098 ceph-mon[35514]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:19:34.756 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:34 smithi001 ceph-mon[30843]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:19:34.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:34 smithi012 ceph-mon[34883]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:19:35.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:34 smithi098 ceph-mon[35514]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:19:35.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:35 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:19:35.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:35 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:35.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:35 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:35.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:35 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:19:35.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:35 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:35.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:35 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:36.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:35 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:19:36.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:35 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:36.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:35 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:37.194 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:36 smithi001 ceph-mon[30843]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:19:37.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:36 smithi012 ceph-mon[34883]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:19:37.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:36 smithi098 ceph-mon[35514]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:19:39.628 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:39 smithi001 ceph-mon[30843]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:19:39.628 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:39 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:39.628 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:39 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:39.628 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:39 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:19:39.628 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:39 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:19:39.628 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:39 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:39.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:39 smithi012 ceph-mon[34883]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:19:39.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:39 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:39.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:39 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:39.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:39 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:19:39.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:39 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:19:39.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:39 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:39.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:39.793+0000 7fcf34c00640 1 -- 172.21.15.1:0/4074991315 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcf38062630 con 0x7fcf1c0a3270 2024-09-15T22:19:39.796 INFO:teuthology.orchestra.run.smithi001.stdout:Created osd(s) 6 on host 'smithi001' 2024-09-15T22:19:39.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:39.796+0000 7fcf3ee00640 1 -- 172.21.15.1:0/4074991315 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fcf1c0a3270 msgr2=0x7fcf1c0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:39.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:39.796+0000 7fcf3ee00640 1 --2- 172.21.15.1:0/4074991315 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fcf1c0a3270 0x7fcf1c0a5730 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcf2802a9e0 tx=0x7fcf280315b0 comp rx=0 tx=0).stop 2024-09-15T22:19:39.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:39.796+0000 7fcf3ee00640 1 -- 172.21.15.1:0/4074991315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf38076220 msgr2=0x7fcf3819ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:39.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:39.796+0000 7fcf3ee00640 1 --2- 172.21.15.1:0/4074991315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf38076220 0x7fcf3819ea70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcf2400e9f0 tx=0x7fcf2400edf0 comp rx=0 tx=0).stop 2024-09-15T22:19:39.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:39.796+0000 7fcf3ee00640 1 -- 172.21.15.1:0/4074991315 shutdown_connections 2024-09-15T22:19:39.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:39.796+0000 7fcf3ee00640 1 --2- 172.21.15.1:0/4074991315 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fcf1c0a3270 0x7fcf1c0a5730 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:39.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:39.796+0000 7fcf3ee00640 1 --2- 172.21.15.1:0/4074991315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf3810e1e0 0x7fcf381a5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:39.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:39.796+0000 7fcf3ee00640 1 --2- 172.21.15.1:0/4074991315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf38076220 0x7fcf3819ea70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:39.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:39.796+0000 7fcf3ee00640 1 --2- 172.21.15.1:0/4074991315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf38074c50 0x7fcf3819e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:39.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:39.796+0000 7fcf3ee00640 1 -- 172.21.15.1:0/4074991315 >> 172.21.15.1:0/4074991315 conn(0x7fcf380fd390 msgr2=0x7fcf380ff780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:39.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:39.796+0000 7fcf3ee00640 1 -- 172.21.15.1:0/4074991315 shutdown_connections 2024-09-15T22:19:39.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:19:39.796+0000 7fcf3ee00640 1 -- 172.21.15.1:0/4074991315 wait complete. 2024-09-15T22:19:39.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:39 smithi098 ceph-mon[35514]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:19:39.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:39 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:39.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:39 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:39.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:39 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:19:39.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:39 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:19:39.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:39 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:40.596 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:40 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:19:40.596 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:40 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:40.596 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:40 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:40.634 DEBUG:teuthology.orchestra.run.smithi001:osd.6> sudo journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.6.service 2024-09-15T22:19:40.639 INFO:tasks.cephadm:Deploying osd.7 on smithi012 with /dev/vg_nvme/lv_2... 2024-09-15T22:19:40.639 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-15T22:19:40.666 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:40 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:19:40.666 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:40 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:40.666 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:40 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:40.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:40 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:19:40.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:40 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:40.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:40 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:40.898 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:19:41.623 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:41 smithi001 ceph-mon[30843]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:19:41.623 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:19:41 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:19:41.357+0000 7f2a44435640 -1 osd.6 0 log_to_monitors true 2024-09-15T22:19:41.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:41 smithi012 ceph-mon[34883]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:19:41.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:41 smithi098 ceph-mon[35514]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:19:42.547 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:42 smithi001 ceph-mon[30843]: from='osd.6 [v2:172.21.15.1:6818/2236861161,v1:172.21.15.1:6819/2236861161]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-15T22:19:42.547 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:42 smithi001 ceph-mon[30843]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-15T22:19:42.714 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:42 smithi012 ceph-mon[34883]: from='osd.6 [v2:172.21.15.1:6818/2236861161,v1:172.21.15.1:6819/2236861161]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-15T22:19:42.714 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:42 smithi012 ceph-mon[34883]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-15T22:19:42.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:42 smithi098 ceph-mon[35514]: from='osd.6 [v2:172.21.15.1:6818/2236861161,v1:172.21.15.1:6819/2236861161]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-15T22:19:42.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:42 smithi098 ceph-mon[35514]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-15T22:19:43.380 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:43 smithi012 ceph-mon[34883]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:19:43.380 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:43 smithi012 ceph-mon[34883]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-15T22:19:43.380 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:43 smithi012 ceph-mon[34883]: osdmap e43: 7 total, 6 up, 7 in 2024-09-15T22:19:43.380 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:43 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:19:43.381 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:43 smithi012 ceph-mon[34883]: from='osd.6 [v2:172.21.15.1:6818/2236861161,v1:172.21.15.1:6819/2236861161]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-15T22:19:43.381 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:43 smithi012 ceph-mon[34883]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-15T22:19:43.383 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-15T22:19:43.410 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi012:vg_nvme/lv_2 2024-09-15T22:19:43.626 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:19:43 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:19:43.377+0000 7f2a3e200640 -1 osd.6 0 waiting for initial osdmap 2024-09-15T22:19:43.626 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:19:43 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:19:43.392+0000 7f2a39c00640 -1 osd.6 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:19:43.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:43 smithi001 ceph-mon[30843]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:19:43.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:43 smithi001 ceph-mon[30843]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-15T22:19:43.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:43 smithi001 ceph-mon[30843]: osdmap e43: 7 total, 6 up, 7 in 2024-09-15T22:19:43.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:43 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:19:43.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:43 smithi001 ceph-mon[30843]: from='osd.6 [v2:172.21.15.1:6818/2236861161,v1:172.21.15.1:6819/2236861161]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-15T22:19:43.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:43 smithi001 ceph-mon[30843]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-15T22:19:43.703 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:19:43.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:43 smithi098 ceph-mon[35514]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:19:43.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:43 smithi098 ceph-mon[35514]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-15T22:19:43.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:43 smithi098 ceph-mon[35514]: osdmap e43: 7 total, 6 up, 7 in 2024-09-15T22:19:43.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:43 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:19:43.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:43 smithi098 ceph-mon[35514]: from='osd.6 [v2:172.21.15.1:6818/2236861161,v1:172.21.15.1:6819/2236861161]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-15T22:19:43.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:43 smithi098 ceph-mon[35514]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-15T22:19:44.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.185+0000 7f5a3e449640 1 -- 172.21.15.12:0/3659321293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a381037c0 msgr2=0x7f5a3810a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:44.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.185+0000 7f5a3e449640 1 --2- 172.21.15.12:0/3659321293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a381037c0 0x7f5a3810a050 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5a30009ca0 tx=0x7f5a3002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:19:44.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.185+0000 7f5a3e449640 1 -- 172.21.15.12:0/3659321293 shutdown_connections 2024-09-15T22:19:44.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.185+0000 7f5a3e449640 1 --2- 172.21.15.12:0/3659321293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a381037c0 0x7f5a3810a050 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:44.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.185+0000 7f5a3e449640 1 --2- 172.21.15.12:0/3659321293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a38102e00 0x7f5a38103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:44.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.185+0000 7f5a3e449640 1 --2- 172.21.15.12:0/3659321293 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a38101c00 0x7f5a38102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:44.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.185+0000 7f5a3e449640 1 -- 172.21.15.12:0/3659321293 >> 172.21.15.12:0/3659321293 conn(0x7f5a380fd3b0 msgr2=0x7f5a380ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:44.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.185+0000 7f5a3e449640 1 -- 172.21.15.12:0/3659321293 shutdown_connections 2024-09-15T22:19:44.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.185+0000 7f5a3e449640 1 -- 172.21.15.12:0/3659321293 wait complete. 2024-09-15T22:19:44.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.185+0000 7f5a3e449640 1 Processor -- start 2024-09-15T22:19:44.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.185+0000 7f5a3e449640 1 -- start start 2024-09-15T22:19:44.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.186+0000 7f5a3e449640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a38101c00 0x7f5a38197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:44.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.186+0000 7f5a3e449640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a38102e00 0x7f5a38198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:44.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.186+0000 7f5a3e449640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a381037c0 0x7f5a3819f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:44.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.186+0000 7f5a3e449640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3810d900 con 0x7f5a38101c00 2024-09-15T22:19:44.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.186+0000 7f5a3e449640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3810d780 con 0x7f5a381037c0 2024-09-15T22:19:44.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.186+0000 7f5a3e449640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3810da80 con 0x7f5a38102e00 2024-09-15T22:19:44.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.186+0000 7f5a3c9e6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a381037c0 0x7f5a3819f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:44.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.186+0000 7f5a3c9e6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a381037c0 0x7f5a3819f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48732/0 (socket says 172.21.15.12:48732) 2024-09-15T22:19:44.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.186+0000 7f5a3c9e6640 1 -- 172.21.15.12:0/2841493107 learned_addr learned my addr 172.21.15.12:0/2841493107 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-15T22:19:44.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.186+0000 7f5a37fff640 1 --2- 172.21.15.12:0/2841493107 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a38101c00 0x7f5a38197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:44.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.186+0000 7f5a377fe640 1 --2- 172.21.15.12:0/2841493107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a38102e00 0x7f5a38198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:44.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.186+0000 7f5a3c9e6640 1 -- 172.21.15.12:0/2841493107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a38102e00 msgr2=0x7f5a38198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:44.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.186+0000 7f5a3c9e6640 1 --2- 172.21.15.12:0/2841493107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a38102e00 0x7f5a38198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:44.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.186+0000 7f5a3c9e6640 1 -- 172.21.15.12:0/2841493107 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a38101c00 msgr2=0x7f5a38197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:44.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.186+0000 7f5a3c9e6640 1 --2- 172.21.15.12:0/2841493107 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a38101c00 0x7f5a38197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:44.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.186+0000 7f5a3c9e6640 1 -- 172.21.15.12:0/2841493107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a3819fb50 con 0x7f5a381037c0 2024-09-15T22:19:44.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.186+0000 7f5a3c9e6640 1 --2- 172.21.15.12:0/2841493107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a381037c0 0x7f5a3819f4e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5a30005e30 tx=0x7f5a30031ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:44.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.187+0000 7f5a357fa640 1 -- 172.21.15.12:0/2841493107 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a30003b70 con 0x7f5a381037c0 2024-09-15T22:19:44.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.187+0000 7f5a3e449640 1 -- 172.21.15.12:0/2841493107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a3819fde0 con 0x7f5a381037c0 2024-09-15T22:19:44.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.187+0000 7f5a357fa640 1 -- 172.21.15.12:0/2841493107 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a30003d10 con 0x7f5a381037c0 2024-09-15T22:19:44.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.187+0000 7f5a357fa640 1 -- 172.21.15.12:0/2841493107 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a3002fd30 con 0x7f5a381037c0 2024-09-15T22:19:44.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.187+0000 7f5a3e449640 1 -- 172.21.15.12:0/2841493107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a381a0310 con 0x7f5a381037c0 2024-09-15T22:19:44.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.188+0000 7f5a3e449640 1 -- 172.21.15.12:0/2841493107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a38108f80 con 0x7f5a381037c0 2024-09-15T22:19:44.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.189+0000 7f5a357fa640 1 -- 172.21.15.12:0/2841493107 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f5a30004050 con 0x7f5a381037c0 2024-09-15T22:19:44.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.190+0000 7f5a357fa640 1 --2- 172.21.15.12:0/2841493107 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f5a200a3270 0x7f5a200a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:44.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.190+0000 7f5a357fa640 1 -- 172.21.15.12:0/2841493107 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4685+0+0 (secure 0 0 0) 0x7f5a300efe90 con 0x7f5a381037c0 2024-09-15T22:19:44.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.190+0000 7f5a37fff640 1 --2- 172.21.15.12:0/2841493107 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f5a200a3270 0x7f5a200a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:44.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.191+0000 7f5a37fff640 1 --2- 172.21.15.12:0/2841493107 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f5a200a3270 0x7f5a200a5730 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5a28005fd0 tx=0x7f5a2800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:44.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.193+0000 7f5a357fa640 1 -- 172.21.15.12:0/2841493107 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5a300bdb90 con 0x7f5a381037c0 2024-09-15T22:19:44.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:19:44.389+0000 7f5a3e449640 1 -- 172.21.15.12:0/2841493107 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f5a38062630 con 0x7f5a200a3270 2024-09-15T22:19:44.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:44 smithi001 ceph-mon[30843]: purged_snaps scrub starts 2024-09-15T22:19:44.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:44 smithi001 ceph-mon[30843]: purged_snaps scrub ok 2024-09-15T22:19:44.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:44 smithi001 ceph-mon[30843]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-15T22:19:44.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:44 smithi001 ceph-mon[30843]: osdmap e44: 7 total, 6 up, 7 in 2024-09-15T22:19:44.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:44 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:19:44.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:44 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:19:44.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:44 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:44.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:44 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:44.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:44 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:44.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:44 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:44.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:44 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:44.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:44 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:44.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:44 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:19:44.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:44 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:19:44.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:44 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:44.692 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:44 smithi012 ceph-mon[34883]: purged_snaps scrub starts 2024-09-15T22:19:44.692 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:44 smithi012 ceph-mon[34883]: purged_snaps scrub ok 2024-09-15T22:19:44.692 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:44 smithi012 ceph-mon[34883]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-15T22:19:44.692 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:44 smithi012 ceph-mon[34883]: osdmap e44: 7 total, 6 up, 7 in 2024-09-15T22:19:44.692 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:44 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:19:44.692 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:44 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:19:44.692 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:44 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:44.692 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:44 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:44.692 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:44 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:44.692 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:44 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:44.692 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:44 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:44.692 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:44 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:44.693 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:44 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:19:44.693 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:44 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:19:44.693 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:44 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:44.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:44 smithi098 ceph-mon[35514]: purged_snaps scrub starts 2024-09-15T22:19:44.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:44 smithi098 ceph-mon[35514]: purged_snaps scrub ok 2024-09-15T22:19:44.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:44 smithi098 ceph-mon[35514]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-15T22:19:44.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:44 smithi098 ceph-mon[35514]: osdmap e44: 7 total, 6 up, 7 in 2024-09-15T22:19:44.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:44 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:19:44.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:44 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:19:44.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:44 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:44.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:44 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:44.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:44 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:44.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:44 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:44.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:44 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:44.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:44 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:44.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:44 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:19:44.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:44 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:19:44.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:44 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:19:45.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:45 smithi001 ceph-mon[30843]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:19:45.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:45 smithi001 ceph-mon[30843]: Detected new or changed devices on smithi001 2024-09-15T22:19:45.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:45 smithi001 ceph-mon[30843]: Adjusting osd_memory_target on smithi001 to 5698M 2024-09-15T22:19:45.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:45 smithi001 ceph-mon[30843]: osd.6 [v2:172.21.15.1:6818/2236861161,v1:172.21.15.1:6819/2236861161] boot 2024-09-15T22:19:45.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:45 smithi001 ceph-mon[30843]: osdmap e45: 7 total, 7 up, 7 in 2024-09-15T22:19:45.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:45 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:19:45.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:45 smithi001 ceph-mon[30843]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:19:45.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:45 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:19:45.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:45 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:19:45.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:45 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:19:45.712 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:45 smithi098 ceph-mon[35514]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:19:45.712 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:45 smithi098 ceph-mon[35514]: Detected new or changed devices on smithi001 2024-09-15T22:19:45.712 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:45 smithi098 ceph-mon[35514]: Adjusting osd_memory_target on smithi001 to 5698M 2024-09-15T22:19:45.713 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:45 smithi098 ceph-mon[35514]: osd.6 [v2:172.21.15.1:6818/2236861161,v1:172.21.15.1:6819/2236861161] boot 2024-09-15T22:19:45.713 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:45 smithi098 ceph-mon[35514]: osdmap e45: 7 total, 7 up, 7 in 2024-09-15T22:19:45.713 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:45 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:19:45.713 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:45 smithi098 ceph-mon[35514]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:19:45.713 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:45 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:19:45.713 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:45 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:19:45.713 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:45 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:19:45.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:45 smithi012 ceph-mon[34883]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:19:45.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:45 smithi012 ceph-mon[34883]: Detected new or changed devices on smithi001 2024-09-15T22:19:45.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:45 smithi012 ceph-mon[34883]: Adjusting osd_memory_target on smithi001 to 5698M 2024-09-15T22:19:45.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:45 smithi012 ceph-mon[34883]: osd.6 [v2:172.21.15.1:6818/2236861161,v1:172.21.15.1:6819/2236861161] boot 2024-09-15T22:19:45.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:45 smithi012 ceph-mon[34883]: osdmap e45: 7 total, 7 up, 7 in 2024-09-15T22:19:45.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:45 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:19:45.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:45 smithi012 ceph-mon[34883]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:19:45.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:45 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:19:45.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:45 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:19:45.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:45 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:19:47.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:47 smithi012 ceph-mon[34883]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:19:47.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:47 smithi012 ceph-mon[34883]: osdmap e46: 7 total, 7 up, 7 in 2024-09-15T22:19:47.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:47 smithi012 ceph-mon[34883]: from='client.? 172.21.15.12:0/2279977756' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db99cc6e-1717-4958-bf11-65aca94476b5"}]: dispatch 2024-09-15T22:19:47.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:47 smithi012 ceph-mon[34883]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db99cc6e-1717-4958-bf11-65aca94476b5"}]: dispatch 2024-09-15T22:19:47.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:47 smithi012 ceph-mon[34883]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "db99cc6e-1717-4958-bf11-65aca94476b5"}]': finished 2024-09-15T22:19:47.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:47 smithi012 ceph-mon[34883]: osdmap e47: 8 total, 7 up, 8 in 2024-09-15T22:19:47.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:47 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:19:47.747 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:47 smithi012 ceph-mon[34883]: from='client.? 172.21.15.12:0/2528791200' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:19:47.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:47 smithi098 ceph-mon[35514]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:19:47.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:47 smithi098 ceph-mon[35514]: osdmap e46: 7 total, 7 up, 7 in 2024-09-15T22:19:47.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:47 smithi098 ceph-mon[35514]: from='client.? 172.21.15.12:0/2279977756' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db99cc6e-1717-4958-bf11-65aca94476b5"}]: dispatch 2024-09-15T22:19:47.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:47 smithi098 ceph-mon[35514]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db99cc6e-1717-4958-bf11-65aca94476b5"}]: dispatch 2024-09-15T22:19:47.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:47 smithi098 ceph-mon[35514]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "db99cc6e-1717-4958-bf11-65aca94476b5"}]': finished 2024-09-15T22:19:47.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:47 smithi098 ceph-mon[35514]: osdmap e47: 8 total, 7 up, 8 in 2024-09-15T22:19:47.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:47 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:19:47.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:47 smithi098 ceph-mon[35514]: from='client.? 172.21.15.12:0/2528791200' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:19:47.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:47 smithi001 ceph-mon[30843]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:19:47.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:47 smithi001 ceph-mon[30843]: osdmap e46: 7 total, 7 up, 7 in 2024-09-15T22:19:47.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:47 smithi001 ceph-mon[30843]: from='client.? 172.21.15.12:0/2279977756' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db99cc6e-1717-4958-bf11-65aca94476b5"}]: dispatch 2024-09-15T22:19:47.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:47 smithi001 ceph-mon[30843]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db99cc6e-1717-4958-bf11-65aca94476b5"}]: dispatch 2024-09-15T22:19:47.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:47 smithi001 ceph-mon[30843]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "db99cc6e-1717-4958-bf11-65aca94476b5"}]': finished 2024-09-15T22:19:47.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:47 smithi001 ceph-mon[30843]: osdmap e47: 8 total, 7 up, 8 in 2024-09-15T22:19:47.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:47 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:19:47.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:47 smithi001 ceph-mon[30843]: from='client.? 172.21.15.12:0/2528791200' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:19:49.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:49 smithi012 ceph-mon[34883]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:19:49.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:49 smithi098 ceph-mon[35514]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:19:49.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:49 smithi001 ceph-mon[30843]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:19:51.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:51 smithi012 ceph-mon[34883]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:19:51.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:51 smithi098 ceph-mon[35514]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:19:51.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:51 smithi001 ceph-mon[30843]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:19:53.727 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:53 smithi012 ceph-mon[34883]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:19:53.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:53 smithi098 ceph-mon[35514]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:19:53.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:53 smithi001 ceph-mon[30843]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:19:55.652 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:55 smithi012 ceph-mon[34883]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:19:55.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:55 smithi098 ceph-mon[35514]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:19:55.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:55 smithi001 ceph-mon[30843]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:19:56.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:56 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-15T22:19:56.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:56 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:19:56.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:56 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-15T22:19:56.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:56 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:19:56.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:56 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-15T22:19:56.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:56 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:19:57.656 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:57 smithi012 ceph-mon[34883]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:19:57.656 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:57 smithi012 ceph-mon[34883]: Deploying daemon osd.7 on smithi012 2024-09-15T22:19:57.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:57 smithi098 ceph-mon[35514]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:19:57.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:57 smithi098 ceph-mon[35514]: Deploying daemon osd.7 on smithi012 2024-09-15T22:19:57.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:57 smithi001 ceph-mon[30843]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:19:57.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:57 smithi001 ceph-mon[30843]: Deploying daemon osd.7 on smithi012 2024-09-15T22:19:59.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:19:59 smithi012 ceph-mon[34883]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:19:59.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:19:59 smithi098 ceph-mon[35514]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:19:59.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:19:59 smithi001 ceph-mon[30843]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:20:00.681 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:00 smithi012 ceph-mon[34883]: overall HEALTH_OK 2024-09-15T22:20:00.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:00 smithi098 ceph-mon[35514]: overall HEALTH_OK 2024-09-15T22:20:00.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:00 smithi001 ceph-mon[30843]: overall HEALTH_OK 2024-09-15T22:20:01.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:01 smithi012 ceph-mon[34883]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:20:01.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:01 smithi098 ceph-mon[35514]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:20:01.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:01 smithi001 ceph-mon[30843]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:20:02.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:02 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:20:02.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:02 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:02.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:02 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:02.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:02 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:20:02.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:02 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:02.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:02 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:02.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:02 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:20:02.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:02 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:02.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:02 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:03.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:03 smithi012 ceph-mon[34883]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:20:03.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:03 smithi098 ceph-mon[35514]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:20:03.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:03 smithi001 ceph-mon[30843]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:20:04.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:20:04.957+0000 7f5a357fa640 1 -- 172.21.15.12:0/2841493107 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5a38062630 con 0x7f5a200a3270 2024-09-15T22:20:04.959 INFO:teuthology.orchestra.run.smithi012.stdout:Created osd(s) 7 on host 'smithi012' 2024-09-15T22:20:04.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:20:04.959+0000 7f5a3e449640 1 -- 172.21.15.12:0/2841493107 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f5a200a3270 msgr2=0x7f5a200a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:04.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:20:04.959+0000 7f5a3e449640 1 --2- 172.21.15.12:0/2841493107 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f5a200a3270 0x7f5a200a5730 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5a28005fd0 tx=0x7f5a2800b390 comp rx=0 tx=0).stop 2024-09-15T22:20:04.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:20:04.959+0000 7f5a3e449640 1 -- 172.21.15.12:0/2841493107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a381037c0 msgr2=0x7f5a3819f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:04.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:20:04.959+0000 7f5a3e449640 1 --2- 172.21.15.12:0/2841493107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a381037c0 0x7f5a3819f4e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5a30005e30 tx=0x7f5a30031ee0 comp rx=0 tx=0).stop 2024-09-15T22:20:04.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:20:04.959+0000 7f5a3e449640 1 -- 172.21.15.12:0/2841493107 shutdown_connections 2024-09-15T22:20:04.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:20:04.959+0000 7f5a3e449640 1 --2- 172.21.15.12:0/2841493107 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f5a200a3270 0x7f5a200a5730 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:04.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:20:04.959+0000 7f5a3e449640 1 --2- 172.21.15.12:0/2841493107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a381037c0 0x7f5a3819f4e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:04.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:20:04.959+0000 7f5a3e449640 1 --2- 172.21.15.12:0/2841493107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a38102e00 0x7f5a38198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:04.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:20:04.959+0000 7f5a3e449640 1 --2- 172.21.15.12:0/2841493107 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a38101c00 0x7f5a38197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:04.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:20:04.959+0000 7f5a3e449640 1 -- 172.21.15.12:0/2841493107 >> 172.21.15.12:0/2841493107 conn(0x7f5a380fd3b0 msgr2=0x7f5a38106150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:04.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:20:04.959+0000 7f5a3e449640 1 -- 172.21.15.12:0/2841493107 shutdown_connections 2024-09-15T22:20:04.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:20:04.959+0000 7f5a3e449640 1 -- 172.21.15.12:0/2841493107 wait complete. 2024-09-15T22:20:05.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:05 smithi012 ceph-mon[34883]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:20:05.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:05 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:05.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:05 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:05.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:05 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:20:05.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:05 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:20:05.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:05 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:05.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:05 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:20:05.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:05 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:05.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:05 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:05.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:05 smithi001 ceph-mon[30843]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:20:05.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:05 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:05.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:05 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:05.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:05 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:20:05.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:05 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:20:05.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:05 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:05.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:05 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:20:05.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:05 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:05.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:05 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:05.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:05 smithi098 ceph-mon[35514]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:20:05.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:05 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:05.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:05 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:05.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:05 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:20:05.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:05 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:20:05.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:05 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:05.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:05 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:20:05.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:05 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:05.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:05 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:05.600 DEBUG:teuthology.orchestra.run.smithi012:osd.7> sudo journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.7.service 2024-09-15T22:20:05.602 INFO:tasks.cephadm:Deploying osd.8 on smithi098 with /dev/vg_nvme/lv_2... 2024-09-15T22:20:05.602 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-15T22:20:05.859 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:20:07.146 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:07 smithi098 ceph-mon[35514]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:20:07.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:07 smithi012 ceph-mon[34883]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:20:07.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:07 smithi001 ceph-mon[30843]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:20:07.975 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:20:07 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:20:07.813+0000 7f863856e640 -1 osd.7 0 log_to_monitors true 2024-09-15T22:20:08.117 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-15T22:20:08.144 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi098:vg_nvme/lv_2 2024-09-15T22:20:08.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:08 smithi012 ceph-mon[34883]: from='osd.7 [v2:172.21.15.12:6816/133202448,v1:172.21.15.12:6817/133202448]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T22:20:08.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:08 smithi012 ceph-mon[34883]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T22:20:08.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:08 smithi098 ceph-mon[35514]: from='osd.7 [v2:172.21.15.12:6816/133202448,v1:172.21.15.12:6817/133202448]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T22:20:08.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:08 smithi098 ceph-mon[35514]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T22:20:08.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:08 smithi001 ceph-mon[30843]: from='osd.7 [v2:172.21.15.12:6816/133202448,v1:172.21.15.12:6817/133202448]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T22:20:08.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:08 smithi001 ceph-mon[30843]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T22:20:08.399 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:20:08.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.842+0000 7f4195836640 1 -- 172.21.15.98:0/2342595227 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4190101cd0 msgr2=0x7f4190102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:08.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.842+0000 7f4195836640 1 --2- 172.21.15.98:0/2342595227 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4190101cd0 0x7f4190102150 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4184009900 tx=0x7f418402a410 comp rx=0 tx=0).stop 2024-09-15T22:20:08.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.843+0000 7f4195836640 1 -- 172.21.15.98:0/2342595227 shutdown_connections 2024-09-15T22:20:08.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.843+0000 7f4195836640 1 --2- 172.21.15.98:0/2342595227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4190102690 0x7f4190108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:08.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.843+0000 7f4195836640 1 --2- 172.21.15.98:0/2342595227 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4190101cd0 0x7f4190102150 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:08.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.843+0000 7f4195836640 1 --2- 172.21.15.98:0/2342595227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4190100ad0 0x7f4190100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:08.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.843+0000 7f4195836640 1 -- 172.21.15.98:0/2342595227 >> 172.21.15.98:0/2342595227 conn(0x7f41900fc280 msgr2=0x7f41900fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:08.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.843+0000 7f4195836640 1 -- 172.21.15.98:0/2342595227 shutdown_connections 2024-09-15T22:20:08.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.843+0000 7f4195836640 1 -- 172.21.15.98:0/2342595227 wait complete. 2024-09-15T22:20:08.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.843+0000 7f4195836640 1 Processor -- start 2024-09-15T22:20:08.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.844+0000 7f4195836640 1 -- start start 2024-09-15T22:20:08.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.844+0000 7f4195836640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4190100ad0 0x7f4190196e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:08.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.844+0000 7f4195836640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4190101cd0 0x7f41901973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:08.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.844+0000 7f4195836640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4190102690 0x7f419019e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:08.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.844+0000 7f4195836640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f419010c800 con 0x7f4190100ad0 2024-09-15T22:20:08.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.844+0000 7f4195836640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f419010c680 con 0x7f4190101cd0 2024-09-15T22:20:08.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.844+0000 7f4195836640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f419010c980 con 0x7f4190102690 2024-09-15T22:20:08.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.844+0000 7f418f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4190102690 0x7f419019e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:08.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.844+0000 7f418f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4190102690 0x7f419019e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36470/0 (socket says 172.21.15.98:36470) 2024-09-15T22:20:08.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.844+0000 7f418f7fe640 1 -- 172.21.15.98:0/4157103504 learned_addr learned my addr 172.21.15.98:0/4157103504 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-15T22:20:08.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.844+0000 7f418e7fc640 1 --2- 172.21.15.98:0/4157103504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4190101cd0 0x7f41901973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:08.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.844+0000 7f418effd640 1 --2- 172.21.15.98:0/4157103504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4190100ad0 0x7f4190196e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:08.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.844+0000 7f418f7fe640 1 -- 172.21.15.98:0/4157103504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4190101cd0 msgr2=0x7f41901973c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:08.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.844+0000 7f418f7fe640 1 --2- 172.21.15.98:0/4157103504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4190101cd0 0x7f41901973c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:08.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.844+0000 7f418f7fe640 1 -- 172.21.15.98:0/4157103504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4190100ad0 msgr2=0x7f4190196e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:08.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.844+0000 7f418f7fe640 1 --2- 172.21.15.98:0/4157103504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4190100ad0 0x7f4190196e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:08.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.844+0000 7f418f7fe640 1 -- 172.21.15.98:0/4157103504 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4190069f70 con 0x7f4190102690 2024-09-15T22:20:08.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.844+0000 7f418effd640 1 --2- 172.21.15.98:0/4157103504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4190100ad0 0x7f4190196e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:20:08.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.845+0000 7f418f7fe640 1 --2- 172.21.15.98:0/4157103504 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4190102690 0x7f419019e440 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f418800eaa0 tx=0x7f418800ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:08.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.845+0000 7f4194834640 1 -- 172.21.15.98:0/4157103504 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f418800cdb0 con 0x7f4190102690 2024-09-15T22:20:08.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.845+0000 7f4194834640 1 -- 172.21.15.98:0/4157103504 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4188005020 con 0x7f4190102690 2024-09-15T22:20:08.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.845+0000 7f4195836640 1 -- 172.21.15.98:0/4157103504 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f419006a260 con 0x7f4190102690 2024-09-15T22:20:08.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.845+0000 7f4194834640 1 -- 172.21.15.98:0/4157103504 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41880116b0 con 0x7f4190102690 2024-09-15T22:20:08.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.845+0000 7f4195836640 1 -- 172.21.15.98:0/4157103504 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f419006a840 con 0x7f4190102690 2024-09-15T22:20:08.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.846+0000 7f4195836640 1 -- 172.21.15.98:0/4157103504 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4190107ea0 con 0x7f4190102690 2024-09-15T22:20:08.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.848+0000 7f4194834640 1 -- 172.21.15.98:0/4157103504 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f4188005560 con 0x7f4190102690 2024-09-15T22:20:08.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.848+0000 7f4194834640 1 --2- 172.21.15.98:0/4157103504 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f41780a32f0 0x7f41780a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:08.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.849+0000 7f4194834640 1 -- 172.21.15.98:0/4157103504 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5101+0+0 (secure 0 0 0) 0x7f41880cf290 con 0x7f4190102690 2024-09-15T22:20:08.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.849+0000 7f418effd640 1 --2- 172.21.15.98:0/4157103504 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f41780a32f0 0x7f41780a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:08.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.850+0000 7f418effd640 1 --2- 172.21.15.98:0/4157103504 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f41780a32f0 0x7f41780a57b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4180006fd0 tx=0x7f4180008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:08.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:08.852+0000 7f4194834640 1 -- 172.21.15.98:0/4157103504 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4188016030 con 0x7f4190102690 2024-09-15T22:20:09.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:09.033+0000 7f4195836640 1 -- 172.21.15.98:0/4157103504 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f419002d830 con 0x7f41780a32f0 2024-09-15T22:20:09.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:09 smithi098 ceph-mon[35514]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:20:09.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:09 smithi098 ceph-mon[35514]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-15T22:20:09.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:09 smithi098 ceph-mon[35514]: osdmap e48: 8 total, 7 up, 8 in 2024-09-15T22:20:09.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:09 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:20:09.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:09 smithi098 ceph-mon[35514]: from='osd.7 [v2:172.21.15.12:6816/133202448,v1:172.21.15.12:6817/133202448]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-15T22:20:09.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:09 smithi098 ceph-mon[35514]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-15T22:20:09.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:09 smithi098 ceph-mon[35514]: Detected new or changed devices on smithi012 2024-09-15T22:20:09.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:09 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:09.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:09 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:09.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:09 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:20:09.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:09 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:20:09.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:09 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:20:09.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:09 smithi098 ceph-mon[35514]: Adjusting osd_memory_target on smithi012 to 5697M 2024-09-15T22:20:09.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:09 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:09.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:09 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:20:09.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:09 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:20:09.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:09 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:09.313 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:09 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:20:09.313 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:09 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:20:09.313 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:09 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:20:09.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:09 smithi001 ceph-mon[30843]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:20:09.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:09 smithi001 ceph-mon[30843]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-15T22:20:09.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:09 smithi001 ceph-mon[30843]: osdmap e48: 8 total, 7 up, 8 in 2024-09-15T22:20:09.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:09 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:20:09.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:09 smithi001 ceph-mon[30843]: from='osd.7 [v2:172.21.15.12:6816/133202448,v1:172.21.15.12:6817/133202448]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-15T22:20:09.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:09 smithi001 ceph-mon[30843]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-15T22:20:09.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:09 smithi001 ceph-mon[30843]: Detected new or changed devices on smithi012 2024-09-15T22:20:09.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:09 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:09.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:09 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:09.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:09 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:20:09.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:09 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:20:09.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:09 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:20:09.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:09 smithi001 ceph-mon[30843]: Adjusting osd_memory_target on smithi012 to 5697M 2024-09-15T22:20:09.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:09 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:09.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:09 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:20:09.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:09 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:20:09.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:09 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:09.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:09 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:20:09.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:09 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:20:09.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:09 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:20:09.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:09 smithi012 ceph-mon[34883]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:20:09.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:09 smithi012 ceph-mon[34883]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-15T22:20:09.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:09 smithi012 ceph-mon[34883]: osdmap e48: 8 total, 7 up, 8 in 2024-09-15T22:20:09.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:09 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:20:09.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:09 smithi012 ceph-mon[34883]: from='osd.7 [v2:172.21.15.12:6816/133202448,v1:172.21.15.12:6817/133202448]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-15T22:20:09.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:09 smithi012 ceph-mon[34883]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-15T22:20:09.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:09 smithi012 ceph-mon[34883]: Detected new or changed devices on smithi012 2024-09-15T22:20:09.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:09 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:09.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:09 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:09.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:09 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:20:09.497 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:09 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:20:09.497 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:09 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:20:09.497 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:09 smithi012 ceph-mon[34883]: Adjusting osd_memory_target on smithi012 to 5697M 2024-09-15T22:20:09.497 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:09 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:09.497 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:09 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:20:09.497 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:09 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:20:09.497 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:09 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:09.497 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:09 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:20:09.497 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:09 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:20:09.497 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:09 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:20:10.245 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:20:09 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:20:09.900+0000 7f8633cce640 -1 osd.7 0 waiting for initial osdmap 2024-09-15T22:20:10.246 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:20:09 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:20:09.913+0000 7f862c300640 -1 osd.7 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:20:10.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:10 smithi012 ceph-mon[34883]: from='client.24322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:20:10.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:10 smithi012 ceph-mon[34883]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-15T22:20:10.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:10 smithi012 ceph-mon[34883]: osdmap e49: 8 total, 7 up, 8 in 2024-09-15T22:20:10.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:10 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:20:10.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:10 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:20:10.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:10 smithi012 ceph-mon[34883]: from='osd.7 ' entity='osd.7' 2024-09-15T22:20:10.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:10 smithi012 ceph-mon[34883]: osd.7 [v2:172.21.15.12:6816/133202448,v1:172.21.15.12:6817/133202448] boot 2024-09-15T22:20:10.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:10 smithi001 ceph-mon[30843]: from='client.24322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:20:10.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:10 smithi001 ceph-mon[30843]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-15T22:20:10.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:10 smithi001 ceph-mon[30843]: osdmap e49: 8 total, 7 up, 8 in 2024-09-15T22:20:10.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:10 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:20:10.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:10 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:20:10.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:10 smithi001 ceph-mon[30843]: from='osd.7 ' entity='osd.7' 2024-09-15T22:20:10.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:10 smithi001 ceph-mon[30843]: osd.7 [v2:172.21.15.12:6816/133202448,v1:172.21.15.12:6817/133202448] boot 2024-09-15T22:20:10.425 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:10 smithi098 ceph-mon[35514]: from='client.24322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:20:10.425 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:10 smithi098 ceph-mon[35514]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-15T22:20:10.425 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:10 smithi098 ceph-mon[35514]: osdmap e49: 8 total, 7 up, 8 in 2024-09-15T22:20:10.425 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:10 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:20:10.425 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:10 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:20:10.425 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:10 smithi098 ceph-mon[35514]: from='osd.7 ' entity='osd.7' 2024-09-15T22:20:10.425 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:10 smithi098 ceph-mon[35514]: osd.7 [v2:172.21.15.12:6816/133202448,v1:172.21.15.12:6817/133202448] boot 2024-09-15T22:20:11.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:11 smithi001 ceph-mon[30843]: purged_snaps scrub starts 2024-09-15T22:20:11.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:11 smithi001 ceph-mon[30843]: purged_snaps scrub ok 2024-09-15T22:20:11.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:11 smithi001 ceph-mon[30843]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:20:11.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:11 smithi001 ceph-mon[30843]: osdmap e50: 8 total, 8 up, 8 in 2024-09-15T22:20:11.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:11 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:20:11.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:11 smithi001 ceph-mon[30843]: osdmap e51: 8 total, 8 up, 8 in 2024-09-15T22:20:11.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:11 smithi012 ceph-mon[34883]: purged_snaps scrub starts 2024-09-15T22:20:11.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:11 smithi012 ceph-mon[34883]: purged_snaps scrub ok 2024-09-15T22:20:11.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:11 smithi012 ceph-mon[34883]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:20:11.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:11 smithi012 ceph-mon[34883]: osdmap e50: 8 total, 8 up, 8 in 2024-09-15T22:20:11.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:11 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:20:11.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:11 smithi012 ceph-mon[34883]: osdmap e51: 8 total, 8 up, 8 in 2024-09-15T22:20:11.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:11 smithi098 ceph-mon[35514]: purged_snaps scrub starts 2024-09-15T22:20:11.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:11 smithi098 ceph-mon[35514]: purged_snaps scrub ok 2024-09-15T22:20:11.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:11 smithi098 ceph-mon[35514]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:20:11.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:11 smithi098 ceph-mon[35514]: osdmap e50: 8 total, 8 up, 8 in 2024-09-15T22:20:11.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:11 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:20:11.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:11 smithi098 ceph-mon[35514]: osdmap e51: 8 total, 8 up, 8 in 2024-09-15T22:20:12.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:12 smithi098 ceph-mon[35514]: from='client.? 172.21.15.98:0/2372383830' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d3b6574-49f7-47f6-b36b-4da14ca290f2"}]: dispatch 2024-09-15T22:20:12.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:12 smithi098 ceph-mon[35514]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d3b6574-49f7-47f6-b36b-4da14ca290f2"}]: dispatch 2024-09-15T22:20:12.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:12 smithi098 ceph-mon[35514]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4d3b6574-49f7-47f6-b36b-4da14ca290f2"}]': finished 2024-09-15T22:20:12.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:12 smithi098 ceph-mon[35514]: osdmap e52: 9 total, 8 up, 9 in 2024-09-15T22:20:12.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:12 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:20:12.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:12 smithi098 ceph-mon[35514]: from='client.? 172.21.15.98:0/795501656' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:20:12.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:12 smithi012 ceph-mon[34883]: from='client.? 172.21.15.98:0/2372383830' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d3b6574-49f7-47f6-b36b-4da14ca290f2"}]: dispatch 2024-09-15T22:20:12.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:12 smithi012 ceph-mon[34883]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d3b6574-49f7-47f6-b36b-4da14ca290f2"}]: dispatch 2024-09-15T22:20:12.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:12 smithi012 ceph-mon[34883]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4d3b6574-49f7-47f6-b36b-4da14ca290f2"}]': finished 2024-09-15T22:20:12.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:12 smithi012 ceph-mon[34883]: osdmap e52: 9 total, 8 up, 9 in 2024-09-15T22:20:12.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:12 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:20:12.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:12 smithi012 ceph-mon[34883]: from='client.? 172.21.15.98:0/795501656' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:20:12.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:12 smithi001 ceph-mon[30843]: from='client.? 172.21.15.98:0/2372383830' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d3b6574-49f7-47f6-b36b-4da14ca290f2"}]: dispatch 2024-09-15T22:20:12.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:12 smithi001 ceph-mon[30843]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d3b6574-49f7-47f6-b36b-4da14ca290f2"}]: dispatch 2024-09-15T22:20:12.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:12 smithi001 ceph-mon[30843]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4d3b6574-49f7-47f6-b36b-4da14ca290f2"}]': finished 2024-09-15T22:20:12.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:12 smithi001 ceph-mon[30843]: osdmap e52: 9 total, 8 up, 9 in 2024-09-15T22:20:12.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:12 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:20:12.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:12 smithi001 ceph-mon[30843]: from='client.? 172.21.15.98:0/795501656' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:20:13.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:13 smithi012 ceph-mon[34883]: pgmap v182: 1 pgs: 1 remapped; 577 KiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:13.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:13 smithi012 ceph-mon[34883]: osdmap e53: 9 total, 8 up, 9 in 2024-09-15T22:20:13.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:13 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:20:13.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:13 smithi098 ceph-mon[35514]: pgmap v182: 1 pgs: 1 remapped; 577 KiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:13.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:13 smithi098 ceph-mon[35514]: osdmap e53: 9 total, 8 up, 9 in 2024-09-15T22:20:13.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:13 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:20:13.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:13 smithi001 ceph-mon[30843]: pgmap v182: 1 pgs: 1 remapped; 577 KiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:13.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:13 smithi001 ceph-mon[30843]: osdmap e53: 9 total, 8 up, 9 in 2024-09-15T22:20:13.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:13 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:20:14.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:14 smithi098 ceph-mon[35514]: pgmap v184: 1 pgs: 1 remapped; 577 KiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:14.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:14 smithi098 ceph-mon[35514]: osdmap e54: 9 total, 8 up, 9 in 2024-09-15T22:20:14.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:14 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:20:14.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:14 smithi001 ceph-mon[30843]: pgmap v184: 1 pgs: 1 remapped; 577 KiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:14.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:14 smithi001 ceph-mon[30843]: osdmap e54: 9 total, 8 up, 9 in 2024-09-15T22:20:14.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:14 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:20:14.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:14 smithi012 ceph-mon[34883]: pgmap v184: 1 pgs: 1 remapped; 577 KiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:14.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:14 smithi012 ceph-mon[34883]: osdmap e54: 9 total, 8 up, 9 in 2024-09-15T22:20:14.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:14 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:20:16.797 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:16 smithi098 ceph-mon[35514]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:16.798 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:16 smithi012 ceph-mon[34883]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:16.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:16 smithi001 ceph-mon[30843]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:18.761 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:18 smithi098 ceph-mon[35514]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:18.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:18 smithi001 ceph-mon[30843]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:18.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:18 smithi012 ceph-mon[34883]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:20.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:20 smithi098 ceph-mon[35514]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:20.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:20 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-15T22:20:20.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:20 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:20:20.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:20 smithi098 ceph-mon[35514]: Deploying daemon osd.8 on smithi098 2024-09-15T22:20:20.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:20 smithi001 ceph-mon[30843]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:20.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:20 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-15T22:20:20.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:20 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:20:20.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:20 smithi001 ceph-mon[30843]: Deploying daemon osd.8 on smithi098 2024-09-15T22:20:20.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:20 smithi012 ceph-mon[34883]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:20.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:20 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-15T22:20:20.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:20 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:20:20.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:20 smithi012 ceph-mon[34883]: Deploying daemon osd.8 on smithi098 2024-09-15T22:20:22.761 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:22 smithi098 ceph-mon[35514]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:22.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:22 smithi001 ceph-mon[30843]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:22.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:22 smithi012 ceph-mon[34883]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:24.670 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:24 smithi098 ceph-mon[35514]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:24.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:24 smithi001 ceph-mon[30843]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:24.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:24 smithi012 ceph-mon[34883]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:26.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:26 smithi098 ceph-mon[35514]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:26.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:26 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:20:26.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:26 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:26.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:26 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:26.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:26 smithi001 ceph-mon[30843]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:26.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:26 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:20:26.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:26 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:26.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:26 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:26.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:26 smithi012 ceph-mon[34883]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:26.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:26 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:20:26.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:26 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:26.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:26 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:29.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:29.060+0000 7f4194834640 1 -- 172.21.15.98:0/4157103504 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f419002d830 con 0x7f41780a32f0 2024-09-15T22:20:29.062 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 8 on host 'smithi098' 2024-09-15T22:20:29.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:29.062+0000 7f4195836640 1 -- 172.21.15.98:0/4157103504 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f41780a32f0 msgr2=0x7f41780a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:29.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:29.062+0000 7f4195836640 1 --2- 172.21.15.98:0/4157103504 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f41780a32f0 0x7f41780a57b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4180006fd0 tx=0x7f4180008040 comp rx=0 tx=0).stop 2024-09-15T22:20:29.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:29.063+0000 7f4195836640 1 -- 172.21.15.98:0/4157103504 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4190102690 msgr2=0x7f419019e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:29.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:29.063+0000 7f4195836640 1 --2- 172.21.15.98:0/4157103504 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4190102690 0x7f419019e440 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f418800eaa0 tx=0x7f418800ef60 comp rx=0 tx=0).stop 2024-09-15T22:20:29.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:29.063+0000 7f4195836640 1 -- 172.21.15.98:0/4157103504 shutdown_connections 2024-09-15T22:20:29.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:29.063+0000 7f4195836640 1 --2- 172.21.15.98:0/4157103504 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f41780a32f0 0x7f41780a57b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:29.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:29.063+0000 7f4195836640 1 --2- 172.21.15.98:0/4157103504 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4190102690 0x7f419019e440 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:29.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:29.063+0000 7f4195836640 1 --2- 172.21.15.98:0/4157103504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4190101cd0 0x7f41901973c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:29.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:29.063+0000 7f4195836640 1 --2- 172.21.15.98:0/4157103504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4190100ad0 0x7f4190196e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:29.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:29.063+0000 7f4195836640 1 -- 172.21.15.98:0/4157103504 >> 172.21.15.98:0/4157103504 conn(0x7f41900fc280 msgr2=0x7f4190105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:29.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:29.063+0000 7f4195836640 1 -- 172.21.15.98:0/4157103504 shutdown_connections 2024-09-15T22:20:29.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:20:29.063+0000 7f4195836640 1 -- 172.21.15.98:0/4157103504 wait complete. 2024-09-15T22:20:29.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:29 smithi098 ceph-mon[35514]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:29.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:29 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:29.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:29 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:29.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:29 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:20:29.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:29 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:20:29.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:29 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:29.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:29 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:20:29.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:29 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:29.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:29 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:29.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:29 smithi001 ceph-mon[30843]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:29.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:29 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:29.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:29 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:29.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:29 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:20:29.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:29 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:20:29.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:29 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:29.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:29 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:20:29.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:29 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:29.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:29 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:29.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:29 smithi012 ceph-mon[34883]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:29.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:29 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:29.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:29 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:29.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:29 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:20:29.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:29 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:20:29.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:29 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:29.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:29 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:20:29.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:29 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:29.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:29 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:29.648 DEBUG:teuthology.orchestra.run.smithi098:osd.8> sudo journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.8.service 2024-09-15T22:20:29.650 INFO:tasks.cephadm:Deploying osd.9 on smithi001 with /dev/vg_nvme/lv_1... 2024-09-15T22:20:29.651 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-15T22:20:30.032 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:20:31.222 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:31 smithi098 ceph-mon[35514]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:31.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:31 smithi001 ceph-mon[30843]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:31.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:31 smithi012 ceph-mon[34883]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:32.026 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:20:31 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:20:31.615+0000 7f163b4bf640 -1 osd.8 0 log_to_monitors true 2024-09-15T22:20:32.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:32 smithi098 ceph-mon[35514]: from='osd.8 [v2:172.21.15.98:6816/3701478409,v1:172.21.15.98:6817/3701478409]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T22:20:32.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:32 smithi098 ceph-mon[35514]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T22:20:32.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:32 smithi001 ceph-mon[30843]: from='osd.8 [v2:172.21.15.98:6816/3701478409,v1:172.21.15.98:6817/3701478409]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T22:20:32.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:32 smithi001 ceph-mon[30843]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T22:20:32.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:32 smithi012 ceph-mon[34883]: from='osd.8 [v2:172.21.15.98:6816/3701478409,v1:172.21.15.98:6817/3701478409]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T22:20:32.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:32 smithi012 ceph-mon[34883]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T22:20:33.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:33 smithi001 ceph-mon[30843]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:33.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:33 smithi001 ceph-mon[30843]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-15T22:20:33.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:33 smithi001 ceph-mon[30843]: from='osd.8 [v2:172.21.15.98:6816/3701478409,v1:172.21.15.98:6817/3701478409]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-15T22:20:33.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:33 smithi001 ceph-mon[30843]: osdmap e55: 9 total, 8 up, 9 in 2024-09-15T22:20:33.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:33 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:20:33.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:33 smithi001 ceph-mon[30843]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-15T22:20:33.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:33 smithi001 ceph-mon[30843]: Detected new or changed devices on smithi098 2024-09-15T22:20:33.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:33 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:33.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:33 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:33.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:33 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:20:33.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:33 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:20:33.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:33 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:20:33.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:33 smithi001 ceph-mon[30843]: Adjusting osd_memory_target on smithi098 to 5696M 2024-09-15T22:20:33.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:33 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:33.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:33 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:20:33.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:33 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:20:33.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:33 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:33.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:33 smithi012 ceph-mon[34883]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:33.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:33 smithi012 ceph-mon[34883]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-15T22:20:33.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:33 smithi012 ceph-mon[34883]: from='osd.8 [v2:172.21.15.98:6816/3701478409,v1:172.21.15.98:6817/3701478409]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-15T22:20:33.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:33 smithi012 ceph-mon[34883]: osdmap e55: 9 total, 8 up, 9 in 2024-09-15T22:20:33.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:33 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:20:33.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:33 smithi012 ceph-mon[34883]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-15T22:20:33.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:33 smithi012 ceph-mon[34883]: Detected new or changed devices on smithi098 2024-09-15T22:20:33.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:33 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:33.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:33 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:33.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:33 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:20:33.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:33 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:20:33.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:33 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:20:33.497 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:33 smithi012 ceph-mon[34883]: Adjusting osd_memory_target on smithi098 to 5696M 2024-09-15T22:20:33.497 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:33 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:33.497 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:33 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:20:33.497 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:33 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:20:33.497 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:33 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:33.499 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:20:33.532 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi001:vg_nvme/lv_1 2024-09-15T22:20:33.561 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:20:33 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:20:33.088+0000 7f1636c1f640 -1 osd.8 0 waiting for initial osdmap 2024-09-15T22:20:33.561 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:20:33 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:20:33.101+0000 7f1633259640 -1 osd.8 56 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:20:33.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:33 smithi098 ceph-mon[35514]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:33.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:33 smithi098 ceph-mon[35514]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-15T22:20:33.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:33 smithi098 ceph-mon[35514]: from='osd.8 [v2:172.21.15.98:6816/3701478409,v1:172.21.15.98:6817/3701478409]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-15T22:20:33.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:33 smithi098 ceph-mon[35514]: osdmap e55: 9 total, 8 up, 9 in 2024-09-15T22:20:33.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:33 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:20:33.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:33 smithi098 ceph-mon[35514]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-15T22:20:33.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:33 smithi098 ceph-mon[35514]: Detected new or changed devices on smithi098 2024-09-15T22:20:33.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:33 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:33.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:33 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:33.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:33 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:20:33.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:33 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:20:33.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:33 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:20:33.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:33 smithi098 ceph-mon[35514]: Adjusting osd_memory_target on smithi098 to 5696M 2024-09-15T22:20:33.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:33 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:33.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:33 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:20:33.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:33 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:20:33.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:33 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:33.916 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:20:34.345 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:34 smithi001 ceph-mon[30843]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-15T22:20:34.345 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:34 smithi001 ceph-mon[30843]: osdmap e56: 9 total, 8 up, 9 in 2024-09-15T22:20:34.345 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:34 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:20:34.345 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:34 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:20:34.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.460+0000 7ffb05200640 1 -- 172.21.15.1:0/3213254882 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb001037c0 msgr2=0x7ffb0010a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:34.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.460+0000 7ffb05200640 1 --2- 172.21.15.1:0/3213254882 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb001037c0 0x7ffb0010a050 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8009ca0 tx=0x7ffaf802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.460+0000 7ffb05200640 1 -- 172.21.15.1:0/3213254882 shutdown_connections 2024-09-15T22:20:34.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.460+0000 7ffb05200640 1 --2- 172.21.15.1:0/3213254882 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb001037c0 0x7ffb0010a050 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.460+0000 7ffb05200640 1 --2- 172.21.15.1:0/3213254882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb00102e00 0x7ffb00103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.460+0000 7ffb05200640 1 --2- 172.21.15.1:0/3213254882 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb00101c00 0x7ffb00102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.460+0000 7ffb05200640 1 -- 172.21.15.1:0/3213254882 >> 172.21.15.1:0/3213254882 conn(0x7ffb000fd390 msgr2=0x7ffb000ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:34.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.460+0000 7ffb05200640 1 -- 172.21.15.1:0/3213254882 shutdown_connections 2024-09-15T22:20:34.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.460+0000 7ffb05200640 1 -- 172.21.15.1:0/3213254882 wait complete. 2024-09-15T22:20:34.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.461+0000 7ffb05200640 1 Processor -- start 2024-09-15T22:20:34.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.461+0000 7ffb05200640 1 -- start start 2024-09-15T22:20:34.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.462+0000 7ffb05200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb00101c00 0x7ffb00197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:34.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.462+0000 7ffb05200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb00102e00 0x7ffb001983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:34.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.462+0000 7ffb05200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb001037c0 0x7ffb0019f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:34.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.462+0000 7ffb05200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0010d8d0 con 0x7ffb00102e00 2024-09-15T22:20:34.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.462+0000 7ffb05200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0010d750 con 0x7ffb00101c00 2024-09-15T22:20:34.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.462+0000 7ffb05200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0010da50 con 0x7ffb001037c0 2024-09-15T22:20:34.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.462+0000 7ffaf5400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb00102e00 0x7ffb001983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:34.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.462+0000 7ffaf5400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb00102e00 0x7ffb001983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37772/0 (socket says 172.21.15.1:37772) 2024-09-15T22:20:34.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.462+0000 7ffaf5400640 1 -- 172.21.15.1:0/2698599730 learned_addr learned my addr 172.21.15.1:0/2698599730 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:20:34.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.462+0000 7ffafde00640 1 --2- 172.21.15.1:0/2698599730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb00101c00 0x7ffb00197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:34.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.462+0000 7ffafe800640 1 --2- 172.21.15.1:0/2698599730 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb001037c0 0x7ffb0019f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:34.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.462+0000 7ffaf5400640 1 -- 172.21.15.1:0/2698599730 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb001037c0 msgr2=0x7ffb0019f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:34.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.462+0000 7ffaf5400640 1 --2- 172.21.15.1:0/2698599730 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb001037c0 0x7ffb0019f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.462+0000 7ffaf5400640 1 -- 172.21.15.1:0/2698599730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb00101c00 msgr2=0x7ffb00197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:34.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.462+0000 7ffaf5400640 1 --2- 172.21.15.1:0/2698599730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb00101c00 0x7ffb00197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.463+0000 7ffaf5400640 1 -- 172.21.15.1:0/2698599730 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb0019fad0 con 0x7ffb00102e00 2024-09-15T22:20:34.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.463+0000 7ffafde00640 1 --2- 172.21.15.1:0/2698599730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb00101c00 0x7ffb00197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:20:34.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.463+0000 7ffaf5400640 1 --2- 172.21.15.1:0/2698599730 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb00102e00 0x7ffb001983e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffae800d950 tx=0x7ffae800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:34.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.463+0000 7ffaf7400640 1 -- 172.21.15.1:0/2698599730 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae8017030 con 0x7ffb00102e00 2024-09-15T22:20:34.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.463+0000 7ffaf7400640 1 -- 172.21.15.1:0/2698599730 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffae8004020 con 0x7ffb00102e00 2024-09-15T22:20:34.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.463+0000 7ffb05200640 1 -- 172.21.15.1:0/2698599730 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb0019fdc0 con 0x7ffb00102e00 2024-09-15T22:20:34.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.463+0000 7ffaf7400640 1 -- 172.21.15.1:0/2698599730 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae80047a0 con 0x7ffb00102e00 2024-09-15T22:20:34.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.463+0000 7ffb05200640 1 -- 172.21.15.1:0/2698599730 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb001a0280 con 0x7ffb00102e00 2024-09-15T22:20:34.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.464+0000 7ffb05200640 1 -- 172.21.15.1:0/2698599730 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb00108fb0 con 0x7ffb00102e00 2024-09-15T22:20:34.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.466+0000 7ffaf7400640 1 -- 172.21.15.1:0/2698599730 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7ffae80041d0 con 0x7ffb00102e00 2024-09-15T22:20:34.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.468+0000 7ffaf7400640 1 --2- 172.21.15.1:0/2698599730 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ffae40a32f0 0x7ffae40a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:34.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.468+0000 7ffaf7400640 1 -- 172.21.15.1:0/2698599730 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5862+0+0 (secure 0 0 0) 0x7ffae80cf050 con 0x7ffb00102e00 2024-09-15T22:20:34.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.468+0000 7ffafde00640 1 --2- 172.21.15.1:0/2698599730 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ffae40a32f0 0x7ffae40a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:34.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.468+0000 7ffafde00640 1 --2- 172.21.15.1:0/2698599730 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ffae40a32f0 0x7ffae40a57b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ffb00102c60 tx=0x7ffaf0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:34.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.470+0000 7ffaf7400640 1 -- 172.21.15.1:0/2698599730 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffae809c6e0 con 0x7ffb00102e00 2024-09-15T22:20:34.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:34 smithi012 ceph-mon[34883]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-15T22:20:34.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:34 smithi012 ceph-mon[34883]: osdmap e56: 9 total, 8 up, 9 in 2024-09-15T22:20:34.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:34 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:20:34.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:34 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:20:34.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:34 smithi098 ceph-mon[35514]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-15T22:20:34.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:34 smithi098 ceph-mon[35514]: osdmap e56: 9 total, 8 up, 9 in 2024-09-15T22:20:34.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:34 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:20:34.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:34 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:20:34.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:34.670+0000 7ffb05200640 1 -- 172.21.15.1:0/2698599730 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7ffb00062630 con 0x7ffae40a32f0 2024-09-15T22:20:35.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:35 smithi001 ceph-mon[30843]: purged_snaps scrub starts 2024-09-15T22:20:35.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:35 smithi001 ceph-mon[30843]: purged_snaps scrub ok 2024-09-15T22:20:35.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:35 smithi001 ceph-mon[30843]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:35.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:35 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:20:35.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:35 smithi001 ceph-mon[30843]: osd.8 [v2:172.21.15.98:6816/3701478409,v1:172.21.15.98:6817/3701478409] boot 2024-09-15T22:20:35.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:35 smithi001 ceph-mon[30843]: osdmap e57: 9 total, 9 up, 9 in 2024-09-15T22:20:35.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:35 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:20:35.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:35 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:20:35.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:35 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:20:35.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:35 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:20:35.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:35 smithi012 ceph-mon[34883]: purged_snaps scrub starts 2024-09-15T22:20:35.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:35 smithi012 ceph-mon[34883]: purged_snaps scrub ok 2024-09-15T22:20:35.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:35 smithi012 ceph-mon[34883]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:35.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:35 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:20:35.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:35 smithi012 ceph-mon[34883]: osd.8 [v2:172.21.15.98:6816/3701478409,v1:172.21.15.98:6817/3701478409] boot 2024-09-15T22:20:35.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:35 smithi012 ceph-mon[34883]: osdmap e57: 9 total, 9 up, 9 in 2024-09-15T22:20:35.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:35 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:20:35.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:35 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:20:35.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:35 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:20:35.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:35 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:20:35.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:35 smithi098 ceph-mon[35514]: purged_snaps scrub starts 2024-09-15T22:20:35.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:35 smithi098 ceph-mon[35514]: purged_snaps scrub ok 2024-09-15T22:20:35.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:35 smithi098 ceph-mon[35514]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:20:35.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:35 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:20:35.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:35 smithi098 ceph-mon[35514]: osd.8 [v2:172.21.15.98:6816/3701478409,v1:172.21.15.98:6817/3701478409] boot 2024-09-15T22:20:35.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:35 smithi098 ceph-mon[35514]: osdmap e57: 9 total, 9 up, 9 in 2024-09-15T22:20:35.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:35 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:20:35.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:35 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:20:35.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:35 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:20:35.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:35 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:20:36.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:36 smithi001 ceph-mon[30843]: from='client.14379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:20:36.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:36 smithi001 ceph-mon[30843]: osdmap e58: 9 total, 9 up, 9 in 2024-09-15T22:20:36.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:36 smithi012 ceph-mon[34883]: from='client.14379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:20:36.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:36 smithi012 ceph-mon[34883]: osdmap e58: 9 total, 9 up, 9 in 2024-09-15T22:20:36.560 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:36 smithi098 ceph-mon[35514]: from='client.14379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:20:36.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:36 smithi098 ceph-mon[35514]: osdmap e58: 9 total, 9 up, 9 in 2024-09-15T22:20:37.358 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:37 smithi001 ceph-mon[30843]: pgmap v200: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:20:37.358 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:37 smithi001 ceph-mon[30843]: osdmap e59: 9 total, 9 up, 9 in 2024-09-15T22:20:37.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:37 smithi012 ceph-mon[34883]: pgmap v200: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:20:37.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:37 smithi012 ceph-mon[34883]: osdmap e59: 9 total, 9 up, 9 in 2024-09-15T22:20:37.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:37 smithi098 ceph-mon[35514]: pgmap v200: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:20:37.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:37 smithi098 ceph-mon[35514]: osdmap e59: 9 total, 9 up, 9 in 2024-09-15T22:20:38.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:38 smithi001 ceph-mon[30843]: osdmap e60: 9 total, 9 up, 9 in 2024-09-15T22:20:38.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:38 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/10851638' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7dd2fe25-1b75-48e5-86c7-c7a3ab85053f"}]: dispatch 2024-09-15T22:20:38.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:38 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/10851638' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7dd2fe25-1b75-48e5-86c7-c7a3ab85053f"}]': finished 2024-09-15T22:20:38.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:38 smithi001 ceph-mon[30843]: osdmap e61: 10 total, 9 up, 10 in 2024-09-15T22:20:38.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:38 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:20:38.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:38 smithi012 ceph-mon[34883]: osdmap e60: 9 total, 9 up, 9 in 2024-09-15T22:20:38.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:38 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/10851638' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7dd2fe25-1b75-48e5-86c7-c7a3ab85053f"}]: dispatch 2024-09-15T22:20:38.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:38 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/10851638' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7dd2fe25-1b75-48e5-86c7-c7a3ab85053f"}]': finished 2024-09-15T22:20:38.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:38 smithi012 ceph-mon[34883]: osdmap e61: 10 total, 9 up, 10 in 2024-09-15T22:20:38.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:38 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:20:38.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:38 smithi098 ceph-mon[35514]: osdmap e60: 9 total, 9 up, 9 in 2024-09-15T22:20:38.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:38 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/10851638' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7dd2fe25-1b75-48e5-86c7-c7a3ab85053f"}]: dispatch 2024-09-15T22:20:38.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:38 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/10851638' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7dd2fe25-1b75-48e5-86c7-c7a3ab85053f"}]': finished 2024-09-15T22:20:38.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:38 smithi098 ceph-mon[35514]: osdmap e61: 10 total, 9 up, 10 in 2024-09-15T22:20:38.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:38 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:20:39.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:39 smithi001 ceph-mon[30843]: pgmap v203: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:20:39.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:39 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/2299954258' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:20:39.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:39 smithi012 ceph-mon[34883]: pgmap v203: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:20:39.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:39 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/2299954258' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:20:39.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:39 smithi098 ceph-mon[35514]: pgmap v203: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:20:39.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:39 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/2299954258' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:20:41.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:41 smithi001 ceph-mon[30843]: pgmap v205: 1 pgs: 1 remapped+peering; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:20:41.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:41 smithi012 ceph-mon[34883]: pgmap v205: 1 pgs: 1 remapped+peering; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:20:41.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:41 smithi098 ceph-mon[35514]: pgmap v205: 1 pgs: 1 remapped+peering; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:20:43.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:43 smithi001 ceph-mon[30843]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T22:20:43.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:43 smithi012 ceph-mon[34883]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T22:20:43.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:43 smithi098 ceph-mon[35514]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T22:20:45.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:45 smithi001 ceph-mon[30843]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-15T22:20:45.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:45 smithi012 ceph-mon[34883]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-15T22:20:45.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:45 smithi098 ceph-mon[35514]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-15T22:20:47.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:47 smithi012 ceph-mon[34883]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-15T22:20:47.508 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:47 smithi001 ceph-mon[30843]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-15T22:20:47.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:47 smithi098 ceph-mon[35514]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-15T22:20:48.413 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:48 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-15T22:20:48.413 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:48 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:20:48.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:48 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-15T22:20:48.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:48 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:20:48.560 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:48 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-15T22:20:48.560 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:48 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:20:49.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:49 smithi001 ceph-mon[30843]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T22:20:49.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:49 smithi001 ceph-mon[30843]: Deploying daemon osd.9 on smithi001 2024-09-15T22:20:49.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:49 smithi012 ceph-mon[34883]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T22:20:49.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:49 smithi012 ceph-mon[34883]: Deploying daemon osd.9 on smithi001 2024-09-15T22:20:49.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:49 smithi098 ceph-mon[35514]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T22:20:49.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:49 smithi098 ceph-mon[35514]: Deploying daemon osd.9 on smithi001 2024-09-15T22:20:51.190 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:51 smithi001 ceph-mon[30843]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-15T22:20:51.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:51 smithi012 ceph-mon[34883]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-15T22:20:51.560 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:51 smithi098 ceph-mon[35514]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-15T22:20:53.479 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:53 smithi001 ceph-mon[30843]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:20:53.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:53 smithi012 ceph-mon[34883]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:20:53.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:53 smithi098 ceph-mon[35514]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:20:55.421 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:55 smithi001 ceph-mon[30843]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:20:55.421 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:55 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:20:55.421 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:55 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:55.421 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:55 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:55.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:55 smithi012 ceph-mon[34883]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:20:55.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:55 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:20:55.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:55 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:55.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:55 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:55.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:55 smithi098 ceph-mon[35514]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:20:55.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:55 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:20:55.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:55 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:55.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:55 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:57.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:57 smithi001 ceph-mon[30843]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:20:57.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:57 smithi012 ceph-mon[34883]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:20:57.560 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:57 smithi098 ceph-mon[35514]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:20:58.925 INFO:teuthology.orchestra.run.smithi001.stdout:Created osd(s) 9 on host 'smithi001' 2024-09-15T22:20:58.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:58.923+0000 7ffaf7400640 1 -- 172.21.15.1:0/2698599730 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ffb00062630 con 0x7ffae40a32f0 2024-09-15T22:20:58.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:58.926+0000 7ffb05200640 1 -- 172.21.15.1:0/2698599730 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ffae40a32f0 msgr2=0x7ffae40a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:58.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:58.926+0000 7ffb05200640 1 --2- 172.21.15.1:0/2698599730 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ffae40a32f0 0x7ffae40a57b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ffb00102c60 tx=0x7ffaf0005f90 comp rx=0 tx=0).stop 2024-09-15T22:20:58.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:58.926+0000 7ffb05200640 1 -- 172.21.15.1:0/2698599730 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb00102e00 msgr2=0x7ffb001983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:58.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:58.926+0000 7ffb05200640 1 --2- 172.21.15.1:0/2698599730 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb00102e00 0x7ffb001983e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffae800d950 tx=0x7ffae800de10 comp rx=0 tx=0).stop 2024-09-15T22:20:58.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:58.926+0000 7ffb05200640 1 -- 172.21.15.1:0/2698599730 shutdown_connections 2024-09-15T22:20:58.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:58.926+0000 7ffb05200640 1 --2- 172.21.15.1:0/2698599730 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ffae40a32f0 0x7ffae40a57b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:58.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:58.926+0000 7ffb05200640 1 --2- 172.21.15.1:0/2698599730 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb001037c0 0x7ffb0019f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:58.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:58.926+0000 7ffb05200640 1 --2- 172.21.15.1:0/2698599730 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb00102e00 0x7ffb001983e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:58.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:58.926+0000 7ffb05200640 1 --2- 172.21.15.1:0/2698599730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb00101c00 0x7ffb00197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:58.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:58.926+0000 7ffb05200640 1 -- 172.21.15.1:0/2698599730 >> 172.21.15.1:0/2698599730 conn(0x7ffb000fd390 msgr2=0x7ffb00106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:58.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:58.926+0000 7ffb05200640 1 -- 172.21.15.1:0/2698599730 shutdown_connections 2024-09-15T22:20:58.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:20:58.926+0000 7ffb05200640 1 -- 172.21.15.1:0/2698599730 wait complete. 2024-09-15T22:20:59.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:58 smithi098 ceph-mon[35514]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:20:59.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:58 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:59.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:58 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:59.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:58 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:20:59.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:58 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:20:59.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:58 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:59.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:58 smithi001 ceph-mon[30843]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:20:59.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:58 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:59.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:58 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:59.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:58 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:20:59.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:58 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:20:59.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:58 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:59.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:58 smithi012 ceph-mon[34883]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:20:59.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:58 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:59.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:58 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:59.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:58 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:20:59.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:58 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:20:59.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:58 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:59.745 DEBUG:teuthology.orchestra.run.smithi001:osd.9> sudo journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.9.service 2024-09-15T22:20:59.749 INFO:tasks.cephadm:Deploying osd.10 on smithi012 with /dev/vg_nvme/lv_1... 2024-09-15T22:20:59.749 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-15T22:20:59.970 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:59 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:20:59.971 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:59 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:20:59.971 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:20:59 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:00.013 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:21:00.134 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:59 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:21:00.134 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:59 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:00.134 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:20:59 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:00.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:59 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:21:00.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:59 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:00.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:20:59 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:01.056 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:00 smithi001 ceph-mon[30843]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:21:01.202 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:00 smithi012 ceph-mon[34883]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:21:01.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:00 smithi098 ceph-mon[35514]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:21:01.324 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:21:01 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:21:01.257+0000 7f0ec3c41640 -1 osd.9 0 log_to_monitors true 2024-09-15T22:21:02.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:01 smithi012 ceph-mon[34883]: from='osd.9 [v2:172.21.15.1:6826/2580755002,v1:172.21.15.1:6827/2580755002]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-15T22:21:02.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:01 smithi098 ceph-mon[35514]: from='osd.9 [v2:172.21.15.1:6826/2580755002,v1:172.21.15.1:6827/2580755002]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-15T22:21:02.375 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:01 smithi001 ceph-mon[30843]: from='osd.9 [v2:172.21.15.1:6826/2580755002,v1:172.21.15.1:6827/2580755002]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-15T22:21:02.512 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-15T22:21:02.542 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi012:vg_nvme/lv_1 2024-09-15T22:21:02.801 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:21:02.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:02 smithi001 ceph-mon[30843]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:21:02.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:02 smithi001 ceph-mon[30843]: from='osd.9 [v2:172.21.15.1:6826/2580755002,v1:172.21.15.1:6827/2580755002]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-15T22:21:02.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:02 smithi001 ceph-mon[30843]: osdmap e62: 10 total, 9 up, 10 in 2024-09-15T22:21:02.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:02 smithi001 ceph-mon[30843]: from='osd.9 [v2:172.21.15.1:6826/2580755002,v1:172.21.15.1:6827/2580755002]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-15T22:21:02.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:02 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:21:03.146 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:02 smithi012 ceph-mon[34883]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:21:03.146 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:02 smithi012 ceph-mon[34883]: from='osd.9 [v2:172.21.15.1:6826/2580755002,v1:172.21.15.1:6827/2580755002]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-15T22:21:03.146 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:02 smithi012 ceph-mon[34883]: osdmap e62: 10 total, 9 up, 10 in 2024-09-15T22:21:03.146 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:02 smithi012 ceph-mon[34883]: from='osd.9 [v2:172.21.15.1:6826/2580755002,v1:172.21.15.1:6827/2580755002]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-15T22:21:03.146 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:02 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:21:03.210 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:21:02 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:21:02.950+0000 7f0ebda00640 -1 osd.9 0 waiting for initial osdmap 2024-09-15T22:21:03.210 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:21:02 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:21:02.970+0000 7f0eb9400640 -1 osd.9 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:21:03.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.229+0000 7f62aa782640 1 -- 172.21.15.12:0/818003057 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62a4101cd0 msgr2=0x7f62a4102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:03.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.229+0000 7f62aa782640 1 --2- 172.21.15.12:0/818003057 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62a4101cd0 0x7f62a4102150 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6298009900 tx=0x7f629802a410 comp rx=0 tx=0).stop 2024-09-15T22:21:03.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.229+0000 7f62aa782640 1 -- 172.21.15.12:0/818003057 shutdown_connections 2024-09-15T22:21:03.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.229+0000 7f62aa782640 1 --2- 172.21.15.12:0/818003057 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62a4102690 0x7f62a4108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:03.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.229+0000 7f62aa782640 1 --2- 172.21.15.12:0/818003057 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62a4101cd0 0x7f62a4102150 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:03.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.229+0000 7f62aa782640 1 --2- 172.21.15.12:0/818003057 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62a4100ad0 0x7f62a4100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:03.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.229+0000 7f62aa782640 1 -- 172.21.15.12:0/818003057 >> 172.21.15.12:0/818003057 conn(0x7f62a40fc280 msgr2=0x7f62a40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:03.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.229+0000 7f62aa782640 1 -- 172.21.15.12:0/818003057 shutdown_connections 2024-09-15T22:21:03.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.229+0000 7f62aa782640 1 -- 172.21.15.12:0/818003057 wait complete. 2024-09-15T22:21:03.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.230+0000 7f62aa782640 1 Processor -- start 2024-09-15T22:21:03.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.230+0000 7f62aa782640 1 -- start start 2024-09-15T22:21:03.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.230+0000 7f62aa782640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62a4100ad0 0x7f62a4104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:03.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.231+0000 7f62aa782640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62a4101cd0 0x7f62a41030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:03.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.231+0000 7f62aa782640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62a4102690 0x7f62a41035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:03.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.231+0000 7f62aa782640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f62a410c750 con 0x7f62a4102690 2024-09-15T22:21:03.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.231+0000 7f62aa782640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f62a410c5d0 con 0x7f62a4101cd0 2024-09-15T22:21:03.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.231+0000 7f62aa782640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f62a410c8d0 con 0x7f62a4100ad0 2024-09-15T22:21:03.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.231+0000 7f62a37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62a4101cd0 0x7f62a41030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:03.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.231+0000 7f62a37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62a4101cd0 0x7f62a41030b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40010/0 (socket says 172.21.15.12:40010) 2024-09-15T22:21:03.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.231+0000 7f62a37fe640 1 -- 172.21.15.12:0/1423739825 learned_addr learned my addr 172.21.15.12:0/1423739825 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-15T22:21:03.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.231+0000 7f62a3fff640 1 --2- 172.21.15.12:0/1423739825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62a4100ad0 0x7f62a4104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:03.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.231+0000 7f62a8d1f640 1 --2- 172.21.15.12:0/1423739825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62a4102690 0x7f62a41035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:03.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.231+0000 7f62a37fe640 1 -- 172.21.15.12:0/1423739825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62a4100ad0 msgr2=0x7f62a4104a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:03.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.231+0000 7f62a37fe640 1 --2- 172.21.15.12:0/1423739825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62a4100ad0 0x7f62a4104a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:03.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.231+0000 7f62a37fe640 1 -- 172.21.15.12:0/1423739825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62a4102690 msgr2=0x7f62a41035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:03.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.231+0000 7f62a37fe640 1 --2- 172.21.15.12:0/1423739825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62a4102690 0x7f62a41035f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:03.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.231+0000 7f62a37fe640 1 -- 172.21.15.12:0/1423739825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62a4103eb0 con 0x7f62a4101cd0 2024-09-15T22:21:03.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.231+0000 7f62a37fe640 1 --2- 172.21.15.12:0/1423739825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62a4101cd0 0x7f62a41030b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6298009230 tx=0x7f6298031b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:03.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.231+0000 7f62a17fa640 1 -- 172.21.15.12:0/1423739825 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f629803f030 con 0x7f62a4101cd0 2024-09-15T22:21:03.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.232+0000 7f62aa782640 1 -- 172.21.15.12:0/1423739825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62a41a2030 con 0x7f62a4101cd0 2024-09-15T22:21:03.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.232+0000 7f62a17fa640 1 -- 172.21.15.12:0/1423739825 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6298003ad0 con 0x7f62a4101cd0 2024-09-15T22:21:03.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.232+0000 7f62a17fa640 1 -- 172.21.15.12:0/1423739825 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6298035070 con 0x7f62a4101cd0 2024-09-15T22:21:03.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.232+0000 7f62aa782640 1 -- 172.21.15.12:0/1423739825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62a41a24e0 con 0x7f62a4101cd0 2024-09-15T22:21:03.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.233+0000 7f62aa782640 1 -- 172.21.15.12:0/1423739825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62a41a2710 con 0x7f62a4101cd0 2024-09-15T22:21:03.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.235+0000 7f62a17fa640 1 -- 172.21.15.12:0/1423739825 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f6298042030 con 0x7f62a4101cd0 2024-09-15T22:21:03.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.235+0000 7f62a17fa640 1 --2- 172.21.15.12:0/1423739825 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f628c0a3240 0x7f628c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:03.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.236+0000 7f62a17fa640 1 -- 172.21.15.12:0/1423739825 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5981+0+0 (secure 0 0 0) 0x7f62980ef4d0 con 0x7f62a4101cd0 2024-09-15T22:21:03.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.236+0000 7f62a3fff640 1 --2- 172.21.15.12:0/1423739825 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f628c0a3240 0x7f628c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:03.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.236+0000 7f62a3fff640 1 --2- 172.21.15.12:0/1423739825 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f628c0a3240 0x7f628c0a5700 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f62a4101b30 tx=0x7f6294005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:03.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.240+0000 7f62a17fa640 1 -- 172.21.15.12:0/1423739825 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f62980bc4c0 con 0x7f62a4101cd0 2024-09-15T22:21:03.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:02 smithi098 ceph-mon[35514]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:21:03.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:02 smithi098 ceph-mon[35514]: from='osd.9 [v2:172.21.15.1:6826/2580755002,v1:172.21.15.1:6827/2580755002]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-15T22:21:03.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:02 smithi098 ceph-mon[35514]: osdmap e62: 10 total, 9 up, 10 in 2024-09-15T22:21:03.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:02 smithi098 ceph-mon[35514]: from='osd.9 [v2:172.21.15.1:6826/2580755002,v1:172.21.15.1:6827/2580755002]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-15T22:21:03.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:02 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:21:03.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:03.425+0000 7f62aa782640 1 -- 172.21.15.12:0/1423739825 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f62a406a6d0 con 0x7f628c0a3240 2024-09-15T22:21:04.132 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:03 smithi012 ceph-mon[34883]: from='osd.9 [v2:172.21.15.1:6826/2580755002,v1:172.21.15.1:6827/2580755002]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-15T22:21:04.132 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:03 smithi012 ceph-mon[34883]: osdmap e63: 10 total, 9 up, 10 in 2024-09-15T22:21:04.132 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:03 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:21:04.132 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:03 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:21:04.133 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:03 smithi012 ceph-mon[34883]: from='client.24353 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:21:04.133 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:03 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:21:04.133 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:03 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:21:04.133 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:03 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:21:04.133 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:03 smithi012 ceph-mon[34883]: Detected new or changed devices on smithi001 2024-09-15T22:21:04.133 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:03 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:04.133 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:03 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:04.133 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:03 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:04.133 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:03 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:04.133 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:03 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:04.133 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:03 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:04.133 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:03 smithi012 ceph-mon[34883]: Adjusting osd_memory_target on smithi001 to 4273M 2024-09-15T22:21:04.133 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:03 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:04.133 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:03 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:21:04.134 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:03 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:21:04.134 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:03 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:04.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:03 smithi098 ceph-mon[35514]: from='osd.9 [v2:172.21.15.1:6826/2580755002,v1:172.21.15.1:6827/2580755002]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-15T22:21:04.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:03 smithi098 ceph-mon[35514]: osdmap e63: 10 total, 9 up, 10 in 2024-09-15T22:21:04.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:03 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:21:04.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:03 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:21:04.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:03 smithi098 ceph-mon[35514]: from='client.24353 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:21:04.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:03 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:21:04.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:03 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:21:04.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:03 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:21:04.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:03 smithi098 ceph-mon[35514]: Detected new or changed devices on smithi001 2024-09-15T22:21:04.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:03 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:04.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:03 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:04.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:03 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:04.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:03 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:04.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:03 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:04.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:03 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:04.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:03 smithi098 ceph-mon[35514]: Adjusting osd_memory_target on smithi001 to 4273M 2024-09-15T22:21:04.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:03 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:04.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:03 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:21:04.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:03 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:21:04.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:03 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:04.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:03 smithi001 ceph-mon[30843]: from='osd.9 [v2:172.21.15.1:6826/2580755002,v1:172.21.15.1:6827/2580755002]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-15T22:21:04.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:03 smithi001 ceph-mon[30843]: osdmap e63: 10 total, 9 up, 10 in 2024-09-15T22:21:04.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:03 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:21:04.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:03 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:21:04.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:03 smithi001 ceph-mon[30843]: from='client.24353 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:21:04.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:03 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:21:04.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:03 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:21:04.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:03 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:21:04.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:03 smithi001 ceph-mon[30843]: Detected new or changed devices on smithi001 2024-09-15T22:21:04.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:03 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:04.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:03 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:04.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:03 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:04.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:03 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:04.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:03 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:04.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:03 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:04.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:03 smithi001 ceph-mon[30843]: Adjusting osd_memory_target on smithi001 to 4273M 2024-09-15T22:21:04.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:03 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:04.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:03 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:21:04.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:03 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:21:04.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:03 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:05.180 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:04 smithi012 ceph-mon[34883]: purged_snaps scrub starts 2024-09-15T22:21:05.180 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:04 smithi012 ceph-mon[34883]: purged_snaps scrub ok 2024-09-15T22:21:05.180 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:04 smithi012 ceph-mon[34883]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:21:05.180 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:04 smithi012 ceph-mon[34883]: osd.9 [v2:172.21.15.1:6826/2580755002,v1:172.21.15.1:6827/2580755002] boot 2024-09-15T22:21:05.180 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:04 smithi012 ceph-mon[34883]: osdmap e64: 10 total, 10 up, 10 in 2024-09-15T22:21:05.180 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:04 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:21:05.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:04 smithi098 ceph-mon[35514]: purged_snaps scrub starts 2024-09-15T22:21:05.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:04 smithi098 ceph-mon[35514]: purged_snaps scrub ok 2024-09-15T22:21:05.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:04 smithi098 ceph-mon[35514]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:21:05.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:04 smithi098 ceph-mon[35514]: osd.9 [v2:172.21.15.1:6826/2580755002,v1:172.21.15.1:6827/2580755002] boot 2024-09-15T22:21:05.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:04 smithi098 ceph-mon[35514]: osdmap e64: 10 total, 10 up, 10 in 2024-09-15T22:21:05.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:04 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:21:05.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:04 smithi001 ceph-mon[30843]: purged_snaps scrub starts 2024-09-15T22:21:05.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:04 smithi001 ceph-mon[30843]: purged_snaps scrub ok 2024-09-15T22:21:05.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:04 smithi001 ceph-mon[30843]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:21:05.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:04 smithi001 ceph-mon[30843]: osd.9 [v2:172.21.15.1:6826/2580755002,v1:172.21.15.1:6827/2580755002] boot 2024-09-15T22:21:05.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:04 smithi001 ceph-mon[30843]: osdmap e64: 10 total, 10 up, 10 in 2024-09-15T22:21:05.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:04 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:21:06.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:05 smithi012 ceph-mon[34883]: osdmap e65: 10 total, 10 up, 10 in 2024-09-15T22:21:06.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:05 smithi012 ceph-mon[34883]: from='client.? 172.21.15.12:0/954190320' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fcad11dc-0a1b-44a2-ac32-74100e317255"}]: dispatch 2024-09-15T22:21:06.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:05 smithi012 ceph-mon[34883]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fcad11dc-0a1b-44a2-ac32-74100e317255"}]: dispatch 2024-09-15T22:21:06.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:05 smithi012 ceph-mon[34883]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fcad11dc-0a1b-44a2-ac32-74100e317255"}]': finished 2024-09-15T22:21:06.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:05 smithi012 ceph-mon[34883]: osdmap e66: 11 total, 10 up, 11 in 2024-09-15T22:21:06.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:05 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:21:06.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:05 smithi098 ceph-mon[35514]: osdmap e65: 10 total, 10 up, 10 in 2024-09-15T22:21:06.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:05 smithi098 ceph-mon[35514]: from='client.? 172.21.15.12:0/954190320' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fcad11dc-0a1b-44a2-ac32-74100e317255"}]: dispatch 2024-09-15T22:21:06.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:05 smithi098 ceph-mon[35514]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fcad11dc-0a1b-44a2-ac32-74100e317255"}]: dispatch 2024-09-15T22:21:06.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:05 smithi098 ceph-mon[35514]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fcad11dc-0a1b-44a2-ac32-74100e317255"}]': finished 2024-09-15T22:21:06.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:05 smithi098 ceph-mon[35514]: osdmap e66: 11 total, 10 up, 11 in 2024-09-15T22:21:06.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:05 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:21:06.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:05 smithi001 ceph-mon[30843]: osdmap e65: 10 total, 10 up, 10 in 2024-09-15T22:21:06.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:05 smithi001 ceph-mon[30843]: from='client.? 172.21.15.12:0/954190320' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fcad11dc-0a1b-44a2-ac32-74100e317255"}]: dispatch 2024-09-15T22:21:06.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:05 smithi001 ceph-mon[30843]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fcad11dc-0a1b-44a2-ac32-74100e317255"}]: dispatch 2024-09-15T22:21:06.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:05 smithi001 ceph-mon[30843]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fcad11dc-0a1b-44a2-ac32-74100e317255"}]': finished 2024-09-15T22:21:06.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:05 smithi001 ceph-mon[30843]: osdmap e66: 11 total, 10 up, 11 in 2024-09-15T22:21:06.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:05 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:21:07.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:06 smithi098 ceph-mon[35514]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:07.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:06 smithi098 ceph-mon[35514]: from='client.? 172.21.15.12:0/3176382490' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:21:07.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:06 smithi001 ceph-mon[30843]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:07.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:06 smithi001 ceph-mon[30843]: from='client.? 172.21.15.12:0/3176382490' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:21:07.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:07 smithi012 ceph-mon[34883]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:07.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:07 smithi012 ceph-mon[34883]: from='client.? 172.21.15.12:0/3176382490' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:21:09.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:08 smithi098 ceph-mon[35514]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:09.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:08 smithi001 ceph-mon[30843]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:09.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:08 smithi012 ceph-mon[34883]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:11.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:11 smithi098 ceph-mon[35514]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:11.348 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:11 smithi012 ceph-mon[34883]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:11.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:11 smithi001 ceph-mon[30843]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:13.149 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:13 smithi012 ceph-mon[34883]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:13.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:13 smithi098 ceph-mon[35514]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:13.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:13 smithi001 ceph-mon[30843]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:15.299 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:15 smithi012 ceph-mon[34883]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:15.299 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:15 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-15T22:21:15.299 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:15 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:21:15.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:15 smithi098 ceph-mon[35514]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:15.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:15 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-15T22:21:15.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:15 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:21:15.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:15 smithi001 ceph-mon[30843]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:15.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:15 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-15T22:21:15.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:15 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:21:16.213 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:16 smithi012 ceph-mon[34883]: Deploying daemon osd.10 on smithi012 2024-09-15T22:21:16.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:16 smithi098 ceph-mon[35514]: Deploying daemon osd.10 on smithi012 2024-09-15T22:21:16.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:16 smithi001 ceph-mon[30843]: Deploying daemon osd.10 on smithi012 2024-09-15T22:21:17.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:17 smithi012 ceph-mon[34883]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:17.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:17 smithi098 ceph-mon[35514]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:17.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:17 smithi001 ceph-mon[30843]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:19.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:19 smithi098 ceph-mon[35514]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:19.327 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:19 smithi012 ceph-mon[34883]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:19.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:19 smithi001 ceph-mon[30843]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:21.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:21 smithi012 ceph-mon[34883]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:21.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:21 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:21:21.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:21 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:21.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:21 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:21.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:21 smithi098 ceph-mon[35514]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:21.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:21 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:21:21.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:21 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:21.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:21 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:21.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:21 smithi001 ceph-mon[30843]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:21.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:21 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:21:21.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:21 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:21.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:21 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:23.102 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:23 smithi012 ceph-mon[34883]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:23.284 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:23 smithi001 ceph-mon[30843]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:23.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:23 smithi098 ceph-mon[35514]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:24.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:24.036+0000 7f62a17fa640 1 -- 172.21.15.12:0/1423739825 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f62a406a6d0 con 0x7f628c0a3240 2024-09-15T22:21:24.039 INFO:teuthology.orchestra.run.smithi012.stdout:Created osd(s) 10 on host 'smithi012' 2024-09-15T22:21:24.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:24.039+0000 7f62aa782640 1 -- 172.21.15.12:0/1423739825 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f628c0a3240 msgr2=0x7f628c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:24.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:24.039+0000 7f62aa782640 1 --2- 172.21.15.12:0/1423739825 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f628c0a3240 0x7f628c0a5700 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f62a4101b30 tx=0x7f6294005f90 comp rx=0 tx=0).stop 2024-09-15T22:21:24.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:24.039+0000 7f62aa782640 1 -- 172.21.15.12:0/1423739825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62a4101cd0 msgr2=0x7f62a41030b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:24.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:24.039+0000 7f62aa782640 1 --2- 172.21.15.12:0/1423739825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62a4101cd0 0x7f62a41030b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6298009230 tx=0x7f6298031b60 comp rx=0 tx=0).stop 2024-09-15T22:21:24.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:24.039+0000 7f62aa782640 1 -- 172.21.15.12:0/1423739825 shutdown_connections 2024-09-15T22:21:24.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:24.039+0000 7f62aa782640 1 --2- 172.21.15.12:0/1423739825 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f628c0a3240 0x7f628c0a5700 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:24.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:24.039+0000 7f62aa782640 1 --2- 172.21.15.12:0/1423739825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62a4102690 0x7f62a41035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:24.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:24.039+0000 7f62aa782640 1 --2- 172.21.15.12:0/1423739825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62a4101cd0 0x7f62a41030b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:24.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:24.039+0000 7f62aa782640 1 --2- 172.21.15.12:0/1423739825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62a4100ad0 0x7f62a4104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:24.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:24.039+0000 7f62aa782640 1 -- 172.21.15.12:0/1423739825 >> 172.21.15.12:0/1423739825 conn(0x7f62a40fc280 msgr2=0x7f62a4069fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:24.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:24.039+0000 7f62aa782640 1 -- 172.21.15.12:0/1423739825 shutdown_connections 2024-09-15T22:21:24.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-15T22:21:24.039+0000 7f62aa782640 1 -- 172.21.15.12:0/1423739825 wait complete. 2024-09-15T22:21:24.676 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:24.677 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:24.677 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:21:24.677 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:21:24.677 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:24.677 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:21:24.677 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:24.677 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:24.704 DEBUG:teuthology.orchestra.run.smithi012:osd.10> sudo journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.10.service 2024-09-15T22:21:24.706 INFO:tasks.cephadm:Deploying osd.11 on smithi098 with /dev/vg_nvme/lv_1... 2024-09-15T22:21:24.706 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-15T22:21:24.734 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:24.734 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:24.734 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:21:24.734 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:21:24.734 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:24.734 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:21:24.734 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:24.735 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:24.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:24.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:24.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:21:24.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:21:24.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:24.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:21:24.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:24.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:24.959 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:21:25.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:25 smithi012 ceph-mon[34883]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:25.764 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:25 smithi098 ceph-mon[35514]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:25.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:25 smithi001 ceph-mon[30843]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:27.097 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:21:26 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:21:26.857+0000 7fa9c8be2640 -1 osd.10 0 log_to_monitors true 2024-09-15T22:21:27.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:27 smithi098 ceph-mon[35514]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:27.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:27 smithi098 ceph-mon[35514]: from='osd.10 [v2:172.21.15.12:6824/3989063573,v1:172.21.15.12:6825/3989063573]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T22:21:27.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:27 smithi098 ceph-mon[35514]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T22:21:27.603 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-15T22:21:27.634 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi098:vg_nvme/lv_1 2024-09-15T22:21:27.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:27 smithi012 ceph-mon[34883]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:27.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:27 smithi012 ceph-mon[34883]: from='osd.10 [v2:172.21.15.12:6824/3989063573,v1:172.21.15.12:6825/3989063573]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T22:21:27.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:27 smithi012 ceph-mon[34883]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T22:21:27.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:27 smithi001 ceph-mon[30843]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:27.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:27 smithi001 ceph-mon[30843]: from='osd.10 [v2:172.21.15.12:6824/3989063573,v1:172.21.15.12:6825/3989063573]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T22:21:27.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:27 smithi001 ceph-mon[30843]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T22:21:27.926 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:21:28.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.418+0000 7f34859f8640 1 -- 172.21.15.98:0/3054835959 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34801037c0 msgr2=0x7f348010a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:28.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.418+0000 7f34859f8640 1 --2- 172.21.15.98:0/3054835959 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34801037c0 0x7f348010a050 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3478009ca0 tx=0x7f347802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:21:28.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.418+0000 7f34859f8640 1 -- 172.21.15.98:0/3054835959 shutdown_connections 2024-09-15T22:21:28.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.418+0000 7f34859f8640 1 --2- 172.21.15.98:0/3054835959 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34801037c0 0x7f348010a050 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:28.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.418+0000 7f34859f8640 1 --2- 172.21.15.98:0/3054835959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3480102e00 0x7f3480103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:28.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.418+0000 7f34859f8640 1 --2- 172.21.15.98:0/3054835959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3480101c00 0x7f3480102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:28.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.418+0000 7f34859f8640 1 -- 172.21.15.98:0/3054835959 >> 172.21.15.98:0/3054835959 conn(0x7f34800fd390 msgr2=0x7f34800ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:28.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.418+0000 7f34859f8640 1 -- 172.21.15.98:0/3054835959 shutdown_connections 2024-09-15T22:21:28.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.418+0000 7f34859f8640 1 -- 172.21.15.98:0/3054835959 wait complete. 2024-09-15T22:21:28.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.419+0000 7f34859f8640 1 Processor -- start 2024-09-15T22:21:28.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.419+0000 7f34859f8640 1 -- start start 2024-09-15T22:21:28.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.419+0000 7f34859f8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3480101c00 0x7f3480198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:28.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.419+0000 7f34859f8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3480102e00 0x7f3480198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:28.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.419+0000 7f34859f8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34801037c0 0x7f348019f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:28.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.419+0000 7f34859f8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f348010d980 con 0x7f3480102e00 2024-09-15T22:21:28.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.419+0000 7f34859f8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f348010d800 con 0x7f34801037c0 2024-09-15T22:21:28.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.419+0000 7f34859f8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f348010db00 con 0x7f3480101c00 2024-09-15T22:21:28.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.419+0000 7f347effd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3480101c00 0x7f3480198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:28.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.419+0000 7f347effd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3480101c00 0x7f3480198040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44796/0 (socket says 172.21.15.98:44796) 2024-09-15T22:21:28.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.419+0000 7f347effd640 1 -- 172.21.15.98:0/1688678817 learned_addr learned my addr 172.21.15.98:0/1688678817 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-15T22:21:28.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.419+0000 7f347f7fe640 1 --2- 172.21.15.98:0/1688678817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34801037c0 0x7f348019f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:28.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.420+0000 7f347effd640 1 -- 172.21.15.98:0/1688678817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34801037c0 msgr2=0x7f348019f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:28.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.420+0000 7f347effd640 1 --2- 172.21.15.98:0/1688678817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34801037c0 0x7f348019f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:28.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.420+0000 7f347effd640 1 -- 172.21.15.98:0/1688678817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3480102e00 msgr2=0x7f3480198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:28.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.420+0000 7f347e7fc640 1 --2- 172.21.15.98:0/1688678817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3480102e00 0x7f3480198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:28.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.420+0000 7f347effd640 1 --2- 172.21.15.98:0/1688678817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3480102e00 0x7f3480198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:28.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.420+0000 7f347effd640 1 -- 172.21.15.98:0/1688678817 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f348019fc70 con 0x7f3480101c00 2024-09-15T22:21:28.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.420+0000 7f347effd640 1 --2- 172.21.15.98:0/1688678817 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3480101c00 0x7f3480198040 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f347000b450 tx=0x7f347000b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:28.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.420+0000 7f34849f6640 1 -- 172.21.15.98:0/1688678817 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3470015020 con 0x7f3480101c00 2024-09-15T22:21:28.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.420+0000 7f34859f8640 1 -- 172.21.15.98:0/1688678817 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f348019ff60 con 0x7f3480101c00 2024-09-15T22:21:28.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.420+0000 7f34849f6640 1 -- 172.21.15.98:0/1688678817 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3470011d70 con 0x7f3480101c00 2024-09-15T22:21:28.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.420+0000 7f34849f6640 1 -- 172.21.15.98:0/1688678817 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347000f340 con 0x7f3480101c00 2024-09-15T22:21:28.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.420+0000 7f34859f8640 1 -- 172.21.15.98:0/1688678817 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34801a0490 con 0x7f3480101c00 2024-09-15T22:21:28.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.421+0000 7f34859f8640 1 -- 172.21.15.98:0/1688678817 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34801090a0 con 0x7f3480101c00 2024-09-15T22:21:28.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.422+0000 7f34849f6640 1 -- 172.21.15.98:0/1688678817 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f3470018020 con 0x7f3480101c00 2024-09-15T22:21:28.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.423+0000 7f34849f6640 1 --2- 172.21.15.98:0/1688678817 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f34680a32f0 0x7f34680a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:28.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.423+0000 7f34849f6640 1 -- 172.21.15.98:0/1688678817 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6398+0+0 (secure 0 0 0) 0x7f34700cf060 con 0x7f3480101c00 2024-09-15T22:21:28.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.423+0000 7f347e7fc640 1 --2- 172.21.15.98:0/1688678817 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f34680a32f0 0x7f34680a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:28.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.424+0000 7f347e7fc640 1 --2- 172.21.15.98:0/1688678817 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f34680a32f0 0x7f34680a57b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3480199560 tx=0x7f3474008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:28.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.430+0000 7f34849f6640 1 -- 172.21.15.98:0/1688678817 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f347001f020 con 0x7f3480101c00 2024-09-15T22:21:28.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:28 smithi098 ceph-mon[35514]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-15T22:21:28.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:28 smithi098 ceph-mon[35514]: osdmap e67: 11 total, 10 up, 11 in 2024-09-15T22:21:28.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:28 smithi098 ceph-mon[35514]: from='osd.10 [v2:172.21.15.12:6824/3989063573,v1:172.21.15.12:6825/3989063573]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-15T22:21:28.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:28 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:21:28.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:28 smithi098 ceph-mon[35514]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-15T22:21:28.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:28 smithi098 ceph-mon[35514]: Detected new or changed devices on smithi012 2024-09-15T22:21:28.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:28 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:28.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:28 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:28.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:28 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:28.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:28 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:28.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:28 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:28.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:28 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:28.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:28 smithi098 ceph-mon[35514]: Adjusting osd_memory_target on smithi012 to 4273M 2024-09-15T22:21:28.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:28 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:28.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:28 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:21:28.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:28 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:21:28.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:28 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:28.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:28.614+0000 7f34859f8640 1 -- 172.21.15.98:0/1688678817 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f3480062630 con 0x7f34680a32f0 2024-09-15T22:21:28.746 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:21:28 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:21:28.444+0000 7fa9c4342640 -1 osd.10 0 waiting for initial osdmap 2024-09-15T22:21:28.746 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:21:28 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:21:28.462+0000 7fa9c097c640 -1 osd.10 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:21:28.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:28 smithi012 ceph-mon[34883]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-15T22:21:28.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:28 smithi012 ceph-mon[34883]: osdmap e67: 11 total, 10 up, 11 in 2024-09-15T22:21:28.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:28 smithi012 ceph-mon[34883]: from='osd.10 [v2:172.21.15.12:6824/3989063573,v1:172.21.15.12:6825/3989063573]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-15T22:21:28.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:28 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:21:28.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:28 smithi012 ceph-mon[34883]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-15T22:21:28.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:28 smithi012 ceph-mon[34883]: Detected new or changed devices on smithi012 2024-09-15T22:21:28.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:28 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:28.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:28 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:28.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:28 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:28.747 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:28 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:28.747 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:28 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:28.747 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:28 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:28.747 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:28 smithi012 ceph-mon[34883]: Adjusting osd_memory_target on smithi012 to 4273M 2024-09-15T22:21:28.747 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:28 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:28.747 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:28 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:21:28.747 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:28 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:21:28.747 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:28 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:28.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:28 smithi001 ceph-mon[30843]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-15T22:21:28.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:28 smithi001 ceph-mon[30843]: osdmap e67: 11 total, 10 up, 11 in 2024-09-15T22:21:28.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:28 smithi001 ceph-mon[30843]: from='osd.10 [v2:172.21.15.12:6824/3989063573,v1:172.21.15.12:6825/3989063573]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-15T22:21:28.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:28 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:21:28.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:28 smithi001 ceph-mon[30843]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-15T22:21:28.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:28 smithi001 ceph-mon[30843]: Detected new or changed devices on smithi012 2024-09-15T22:21:28.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:28 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:28.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:28 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:28.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:28 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:28.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:28 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:28.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:28 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:28.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:28 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:28.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:28 smithi001 ceph-mon[30843]: Adjusting osd_memory_target on smithi012 to 4273M 2024-09-15T22:21:28.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:28 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:28.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:28 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:21:28.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:28 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:21:28.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:28 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:29.701 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:29 smithi098 ceph-mon[35514]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:29.701 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:29 smithi098 ceph-mon[35514]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-15T22:21:29.701 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:29 smithi098 ceph-mon[35514]: osdmap e68: 11 total, 10 up, 11 in 2024-09-15T22:21:29.701 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:29 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:21:29.701 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:29 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:21:29.701 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:29 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:21:29.701 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:29 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:21:29.701 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:29 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:21:29.701 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:29 smithi098 ceph-mon[35514]: osd.10 [v2:172.21.15.12:6824/3989063573,v1:172.21.15.12:6825/3989063573] boot 2024-09-15T22:21:29.701 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:29 smithi098 ceph-mon[35514]: osdmap e69: 11 total, 11 up, 11 in 2024-09-15T22:21:29.702 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:29 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:21:29.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:29 smithi012 ceph-mon[34883]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:29.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:29 smithi012 ceph-mon[34883]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-15T22:21:29.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:29 smithi012 ceph-mon[34883]: osdmap e68: 11 total, 10 up, 11 in 2024-09-15T22:21:29.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:29 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:21:29.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:29 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:21:29.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:29 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:21:29.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:29 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:21:29.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:29 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:21:29.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:29 smithi012 ceph-mon[34883]: osd.10 [v2:172.21.15.12:6824/3989063573,v1:172.21.15.12:6825/3989063573] boot 2024-09-15T22:21:29.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:29 smithi012 ceph-mon[34883]: osdmap e69: 11 total, 11 up, 11 in 2024-09-15T22:21:29.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:29 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:21:29.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:29 smithi001 ceph-mon[30843]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:21:29.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:29 smithi001 ceph-mon[30843]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-15T22:21:29.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:29 smithi001 ceph-mon[30843]: osdmap e68: 11 total, 10 up, 11 in 2024-09-15T22:21:29.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:29 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:21:29.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:29 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:21:29.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:29 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:21:29.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:29 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:21:29.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:29 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:21:29.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:29 smithi001 ceph-mon[30843]: osd.10 [v2:172.21.15.12:6824/3989063573,v1:172.21.15.12:6825/3989063573] boot 2024-09-15T22:21:29.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:29 smithi001 ceph-mon[30843]: osdmap e69: 11 total, 11 up, 11 in 2024-09-15T22:21:29.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:29 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:21:30.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:30 smithi012 ceph-mon[34883]: purged_snaps scrub starts 2024-09-15T22:21:30.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:30 smithi012 ceph-mon[34883]: purged_snaps scrub ok 2024-09-15T22:21:30.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:30 smithi012 ceph-mon[34883]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:21:30.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:30 smithi098 ceph-mon[35514]: purged_snaps scrub starts 2024-09-15T22:21:30.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:30 smithi098 ceph-mon[35514]: purged_snaps scrub ok 2024-09-15T22:21:30.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:30 smithi098 ceph-mon[35514]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:21:30.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:30 smithi001 ceph-mon[30843]: purged_snaps scrub starts 2024-09-15T22:21:30.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:30 smithi001 ceph-mon[30843]: purged_snaps scrub ok 2024-09-15T22:21:30.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:30 smithi001 ceph-mon[30843]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:21:31.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:31 smithi012 ceph-mon[34883]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:21:31.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:31 smithi012 ceph-mon[34883]: osdmap e70: 11 total, 11 up, 11 in 2024-09-15T22:21:31.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:31 smithi012 ceph-mon[34883]: from='client.? 172.21.15.98:0/3016957076' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f4e717bb-586d-4fe2-9e6b-f574be4db36c"}]: dispatch 2024-09-15T22:21:31.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:31 smithi012 ceph-mon[34883]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f4e717bb-586d-4fe2-9e6b-f574be4db36c"}]: dispatch 2024-09-15T22:21:31.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:31 smithi012 ceph-mon[34883]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f4e717bb-586d-4fe2-9e6b-f574be4db36c"}]': finished 2024-09-15T22:21:31.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:31 smithi012 ceph-mon[34883]: osdmap e71: 12 total, 11 up, 12 in 2024-09-15T22:21:31.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:31 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:21:31.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:31 smithi098 ceph-mon[35514]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:21:31.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:31 smithi098 ceph-mon[35514]: osdmap e70: 11 total, 11 up, 11 in 2024-09-15T22:21:31.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:31 smithi098 ceph-mon[35514]: from='client.? 172.21.15.98:0/3016957076' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f4e717bb-586d-4fe2-9e6b-f574be4db36c"}]: dispatch 2024-09-15T22:21:31.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:31 smithi098 ceph-mon[35514]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f4e717bb-586d-4fe2-9e6b-f574be4db36c"}]: dispatch 2024-09-15T22:21:31.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:31 smithi098 ceph-mon[35514]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f4e717bb-586d-4fe2-9e6b-f574be4db36c"}]': finished 2024-09-15T22:21:31.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:31 smithi098 ceph-mon[35514]: osdmap e71: 12 total, 11 up, 12 in 2024-09-15T22:21:31.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:31 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:21:31.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:31 smithi001 ceph-mon[30843]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:21:31.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:31 smithi001 ceph-mon[30843]: osdmap e70: 11 total, 11 up, 11 in 2024-09-15T22:21:31.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:31 smithi001 ceph-mon[30843]: from='client.? 172.21.15.98:0/3016957076' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f4e717bb-586d-4fe2-9e6b-f574be4db36c"}]: dispatch 2024-09-15T22:21:31.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:31 smithi001 ceph-mon[30843]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f4e717bb-586d-4fe2-9e6b-f574be4db36c"}]: dispatch 2024-09-15T22:21:31.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:31 smithi001 ceph-mon[30843]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f4e717bb-586d-4fe2-9e6b-f574be4db36c"}]': finished 2024-09-15T22:21:31.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:31 smithi001 ceph-mon[30843]: osdmap e71: 12 total, 11 up, 12 in 2024-09-15T22:21:31.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:31 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:21:32.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:32 smithi012 ceph-mon[34883]: from='client.? 172.21.15.98:0/3999717700' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:21:32.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:32 smithi098 ceph-mon[35514]: from='client.? 172.21.15.98:0/3999717700' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:21:32.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:32 smithi001 ceph-mon[30843]: from='client.? 172.21.15.98:0/3999717700' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:21:33.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:33 smithi012 ceph-mon[34883]: pgmap v241: 1 pgs: 1 remapped+peering; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:21:33.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:33 smithi012 ceph-mon[34883]: osdmap e72: 12 total, 11 up, 12 in 2024-09-15T22:21:33.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:33 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:21:33.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:33 smithi098 ceph-mon[35514]: pgmap v241: 1 pgs: 1 remapped+peering; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:21:33.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:33 smithi098 ceph-mon[35514]: osdmap e72: 12 total, 11 up, 12 in 2024-09-15T22:21:33.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:33 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:21:33.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:33 smithi001 ceph-mon[30843]: pgmap v241: 1 pgs: 1 remapped+peering; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:21:33.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:33 smithi001 ceph-mon[30843]: osdmap e72: 12 total, 11 up, 12 in 2024-09-15T22:21:33.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:33 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:21:34.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:34 smithi012 ceph-mon[34883]: osdmap e73: 12 total, 11 up, 12 in 2024-09-15T22:21:34.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:34 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:21:34.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:34 smithi098 ceph-mon[35514]: osdmap e73: 12 total, 11 up, 12 in 2024-09-15T22:21:34.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:34 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:21:34.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:34 smithi001 ceph-mon[30843]: osdmap e73: 12 total, 11 up, 12 in 2024-09-15T22:21:34.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:34 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:21:35.738 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:35 smithi098 ceph-mon[35514]: pgmap v244: 1 pgs: 1 remapped+peering; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:21:35.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:35 smithi012 ceph-mon[34883]: pgmap v244: 1 pgs: 1 remapped+peering; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:21:35.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:35 smithi001 ceph-mon[30843]: pgmap v244: 1 pgs: 1 remapped+peering; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:21:37.531 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:37 smithi098 ceph-mon[35514]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-09-15T22:21:37.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:37 smithi012 ceph-mon[34883]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-09-15T22:21:37.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:37 smithi001 ceph-mon[30843]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-09-15T22:21:39.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:39 smithi012 ceph-mon[34883]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-09-15T22:21:39.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:39 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-15T22:21:39.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:39 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:21:39.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:39 smithi098 ceph-mon[35514]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-09-15T22:21:39.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:39 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-15T22:21:39.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:39 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:21:39.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:39 smithi001 ceph-mon[30843]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-09-15T22:21:39.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:39 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-15T22:21:39.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:39 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:21:40.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:40 smithi012 ceph-mon[34883]: Deploying daemon osd.11 on smithi098 2024-09-15T22:21:40.773 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:40 smithi098 ceph-mon[35514]: Deploying daemon osd.11 on smithi098 2024-09-15T22:21:40.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:40 smithi001 ceph-mon[30843]: Deploying daemon osd.11 on smithi098 2024-09-15T22:21:41.672 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:41 smithi098 ceph-mon[35514]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T22:21:41.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:41 smithi012 ceph-mon[34883]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T22:21:41.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:41 smithi001 ceph-mon[30843]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T22:21:43.678 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:43 smithi001 ceph-mon[30843]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-15T22:21:43.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:43 smithi012 ceph-mon[34883]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-15T22:21:43.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:43 smithi098 ceph-mon[35514]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-15T22:21:45.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:45 smithi001 ceph-mon[30843]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-15T22:21:45.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:45 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:21:45.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:45 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:45.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:45 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:45.702 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:45 smithi098 ceph-mon[35514]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-15T22:21:45.703 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:45 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:21:45.703 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:45 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:45.703 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:45 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:45.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:45 smithi012 ceph-mon[34883]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-15T22:21:45.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:45 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:21:45.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:45 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:45.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:45 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:47.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:47 smithi012 ceph-mon[34883]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:21:47.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:47 smithi098 ceph-mon[35514]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:21:47.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:47 smithi001 ceph-mon[30843]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:21:48.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:48.257+0000 7f34849f6640 1 -- 172.21.15.98:0/1688678817 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f3480062630 con 0x7f34680a32f0 2024-09-15T22:21:48.260 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 11 on host 'smithi098' 2024-09-15T22:21:48.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:48.261+0000 7f34859f8640 1 -- 172.21.15.98:0/1688678817 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f34680a32f0 msgr2=0x7f34680a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:48.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:48.261+0000 7f34859f8640 1 --2- 172.21.15.98:0/1688678817 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f34680a32f0 0x7f34680a57b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3480199560 tx=0x7f3474008040 comp rx=0 tx=0).stop 2024-09-15T22:21:48.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:48.261+0000 7f34859f8640 1 -- 172.21.15.98:0/1688678817 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3480101c00 msgr2=0x7f3480198040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:48.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:48.261+0000 7f34859f8640 1 --2- 172.21.15.98:0/1688678817 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3480101c00 0x7f3480198040 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f347000b450 tx=0x7f347000b910 comp rx=0 tx=0).stop 2024-09-15T22:21:48.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:48.261+0000 7f34859f8640 1 -- 172.21.15.98:0/1688678817 shutdown_connections 2024-09-15T22:21:48.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:48.261+0000 7f34859f8640 1 --2- 172.21.15.98:0/1688678817 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f34680a32f0 0x7f34680a57b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:48.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:48.261+0000 7f34859f8640 1 --2- 172.21.15.98:0/1688678817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34801037c0 0x7f348019f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:48.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:48.261+0000 7f34859f8640 1 --2- 172.21.15.98:0/1688678817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3480102e00 0x7f3480198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:48.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:48.261+0000 7f34859f8640 1 --2- 172.21.15.98:0/1688678817 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3480101c00 0x7f3480198040 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:48.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:48.261+0000 7f34859f8640 1 -- 172.21.15.98:0/1688678817 >> 172.21.15.98:0/1688678817 conn(0x7f34800fd390 msgr2=0x7f3480106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:48.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:48.261+0000 7f34859f8640 1 -- 172.21.15.98:0/1688678817 shutdown_connections 2024-09-15T22:21:48.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:21:48.261+0000 7f34859f8640 1 -- 172.21.15.98:0/1688678817 wait complete. 2024-09-15T22:21:48.885 DEBUG:teuthology.orchestra.run.smithi098:osd.11> sudo journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.11.service 2024-09-15T22:21:48.888 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-15T22:21:48.888 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-15T22:21:49.279 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:21:49.560 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:49 smithi098 ceph-mon[35514]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:21:49.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:49 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:49.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:49 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:49.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:49 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:49.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:49 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:49.588 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:49 smithi001 ceph-mon[30843]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:21:49.588 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:49 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:49.588 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:49 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:49.588 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:49 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:49.589 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:49 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:49.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:49 smithi012 ceph-mon[34883]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:21:49.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:49 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:49.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:49 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:49.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:49 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:49.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:49 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:49.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.838+0000 7fa001000640 1 -- 172.21.15.1:0/1139571155 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ffc104e50 msgr2=0x7f9ffc1052d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:49.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.838+0000 7fa001000640 1 --2- 172.21.15.1:0/1139571155 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ffc104e50 0x7f9ffc1052d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8009900 tx=0x7f9fe802a410 comp rx=0 tx=0).stop 2024-09-15T22:21:49.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.838+0000 7fa001000640 1 -- 172.21.15.1:0/1139571155 shutdown_connections 2024-09-15T22:21:49.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.838+0000 7fa001000640 1 --2- 172.21.15.1:0/1139571155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ffc105810 0x7f9ffc10c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.838+0000 7fa001000640 1 --2- 172.21.15.1:0/1139571155 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ffc104e50 0x7f9ffc1052d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.838+0000 7fa001000640 1 --2- 172.21.15.1:0/1139571155 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ffc103c50 0x7f9ffc104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.838+0000 7fa001000640 1 -- 172.21.15.1:0/1139571155 >> 172.21.15.1:0/1139571155 conn(0x7f9ffc0ff3e0 msgr2=0x7f9ffc101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:49.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.838+0000 7fa001000640 1 -- 172.21.15.1:0/1139571155 shutdown_connections 2024-09-15T22:21:49.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.838+0000 7fa001000640 1 -- 172.21.15.1:0/1139571155 wait complete. 2024-09-15T22:21:49.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.839+0000 7fa001000640 1 Processor -- start 2024-09-15T22:21:49.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.839+0000 7fa001000640 1 -- start start 2024-09-15T22:21:49.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.839+0000 7fa001000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ffc103c50 0x7f9ffc19e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:49.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.839+0000 7fa001000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ffc104e50 0x7f9ffc19e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:49.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.839+0000 7fa001000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ffc105810 0x7f9ffc1a5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:49.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.840+0000 7fa001000640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc10f920 con 0x7f9ffc104e50 2024-09-15T22:21:49.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.840+0000 7fa001000640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc10f7a0 con 0x7f9ffc103c50 2024-09-15T22:21:49.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.840+0000 7fa001000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc10faa0 con 0x7f9ffc105810 2024-09-15T22:21:49.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.840+0000 7f9ffaa00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ffc104e50 0x7f9ffc19e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:49.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.840+0000 7f9ffb400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ffc103c50 0x7f9ffc19e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:49.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.840+0000 7f9ffbe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ffc105810 0x7f9ffc1a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:49.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.840+0000 7f9ffaa00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ffc104e50 0x7f9ffc19e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37394/0 (socket says 172.21.15.1:37394) 2024-09-15T22:21:49.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.840+0000 7f9ffaa00640 1 -- 172.21.15.1:0/2586234359 learned_addr learned my addr 172.21.15.1:0/2586234359 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:21:49.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.840+0000 7f9ffbe00640 1 -- 172.21.15.1:0/2586234359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ffc103c50 msgr2=0x7f9ffc19e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:49.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.840+0000 7f9ffbe00640 1 --2- 172.21.15.1:0/2586234359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ffc103c50 0x7f9ffc19e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.840+0000 7f9ffbe00640 1 -- 172.21.15.1:0/2586234359 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ffc104e50 msgr2=0x7f9ffc19e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:49.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.840+0000 7f9ffbe00640 1 --2- 172.21.15.1:0/2586234359 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ffc104e50 0x7f9ffc19e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.840+0000 7f9ffbe00640 1 -- 172.21.15.1:0/2586234359 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ffc1a5f00 con 0x7f9ffc105810 2024-09-15T22:21:49.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.841+0000 7f9ffbe00640 1 --2- 172.21.15.1:0/2586234359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ffc105810 0x7f9ffc1a5890 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400cab0 tx=0x7f9ff400cf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:49.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.841+0000 7f9ff3e00640 1 -- 172.21.15.1:0/2586234359 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff400ae20 con 0x7f9ffc105810 2024-09-15T22:21:49.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.841+0000 7f9ff3e00640 1 -- 172.21.15.1:0/2586234359 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ff400f930 con 0x7f9ffc105810 2024-09-15T22:21:49.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.841+0000 7fa001000640 1 -- 172.21.15.1:0/2586234359 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ffc1a61f0 con 0x7f9ffc105810 2024-09-15T22:21:49.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.841+0000 7f9ff3e00640 1 -- 172.21.15.1:0/2586234359 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4018b30 con 0x7f9ffc105810 2024-09-15T22:21:49.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.841+0000 7fa001000640 1 -- 172.21.15.1:0/2586234359 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ffc1a6730 con 0x7f9ffc105810 2024-09-15T22:21:49.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.842+0000 7fa001000640 1 -- 172.21.15.1:0/2586234359 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ffc1a69f0 con 0x7f9ffc105810 2024-09-15T22:21:49.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.844+0000 7f9ff3e00640 1 -- 172.21.15.1:0/2586234359 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f9ff400fae0 con 0x7f9ffc105810 2024-09-15T22:21:49.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.845+0000 7f9ff3e00640 1 --2- 172.21.15.1:0/2586234359 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f9fe00a32f0 0x7f9fe00a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:49.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.846+0000 7f9ff3e00640 1 -- 172.21.15.1:0/2586234359 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6809+0+0 (secure 0 0 0) 0x7f9ff40cf9f0 con 0x7f9ffc105810 2024-09-15T22:21:49.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.846+0000 7f9ffb400640 1 --2- 172.21.15.1:0/2586234359 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f9fe00a32f0 0x7f9fe00a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:49.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.846+0000 7f9ffb400640 1 --2- 172.21.15.1:0/2586234359 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f9fe00a32f0 0x7f9fe00a57b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc104cb0 tx=0x7f9fec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:49.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:49.849+0000 7f9ff3e00640 1 -- 172.21.15.1:0/2586234359 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9ff4014030 con 0x7f9ffc105810 2024-09-15T22:21:50.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:50.036+0000 7fa001000640 1 -- 172.21.15.1:0/2586234359 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f9ffc1a6bc0 con 0x7f9ffc105810 2024-09-15T22:21:50.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:50.037+0000 7f9ff3e00640 1 -- 172.21.15.1:0/2586234359 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7f9ff409cc50 con 0x7f9ffc105810 2024-09-15T22:21:50.039 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:21:50.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:50.039+0000 7fa001000640 1 -- 172.21.15.1:0/2586234359 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f9fe00a32f0 msgr2=0x7f9fe00a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:50.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:50.039+0000 7fa001000640 1 --2- 172.21.15.1:0/2586234359 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f9fe00a32f0 0x7f9fe00a57b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc104cb0 tx=0x7f9fec005f90 comp rx=0 tx=0).stop 2024-09-15T22:21:50.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:50.039+0000 7fa001000640 1 -- 172.21.15.1:0/2586234359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ffc105810 msgr2=0x7f9ffc1a5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:50.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:50.039+0000 7fa001000640 1 --2- 172.21.15.1:0/2586234359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ffc105810 0x7f9ffc1a5890 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400cab0 tx=0x7f9ff400cf70 comp rx=0 tx=0).stop 2024-09-15T22:21:50.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:50.039+0000 7fa001000640 1 -- 172.21.15.1:0/2586234359 shutdown_connections 2024-09-15T22:21:50.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:50.039+0000 7fa001000640 1 --2- 172.21.15.1:0/2586234359 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f9fe00a32f0 0x7f9fe00a57b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:50.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:50.039+0000 7fa001000640 1 --2- 172.21.15.1:0/2586234359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ffc105810 0x7f9ffc1a5890 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:50.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:50.039+0000 7fa001000640 1 --2- 172.21.15.1:0/2586234359 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ffc104e50 0x7f9ffc19e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:50.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:50.039+0000 7fa001000640 1 --2- 172.21.15.1:0/2586234359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ffc103c50 0x7f9ffc19e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:50.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:50.039+0000 7fa001000640 1 -- 172.21.15.1:0/2586234359 >> 172.21.15.1:0/2586234359 conn(0x7f9ffc0ff3e0 msgr2=0x7f9ffc078640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:50.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:50.039+0000 7fa001000640 1 -- 172.21.15.1:0/2586234359 shutdown_connections 2024-09-15T22:21:50.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:50.039+0000 7fa001000640 1 -- 172.21.15.1:0/2586234359 wait complete. 2024-09-15T22:21:50.463 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:50 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/2586234359' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:21:50.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:50 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/2586234359' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:21:50.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:50 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/2586234359' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:21:50.910 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":73,"num_osds":12,"num_up_osds":11,"osd_up_since":1726438889,"num_in_osds":12,"osd_in_since":1726438890,"num_remapped_pgs":0} 2024-09-15T22:21:51.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:51 smithi098 ceph-mon[35514]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:21:51.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:51 smithi098 ceph-mon[35514]: from='osd.11 [v2:172.21.15.98:6824/839956167,v1:172.21.15.98:6825/839956167]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T22:21:51.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:51 smithi098 ceph-mon[35514]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T22:21:51.311 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:21:51 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:21:51.057+0000 7fc9a3d88640 -1 osd.11 0 log_to_monitors true 2024-09-15T22:21:51.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:51 smithi001 ceph-mon[30843]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:21:51.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:51 smithi001 ceph-mon[30843]: from='osd.11 [v2:172.21.15.98:6824/839956167,v1:172.21.15.98:6825/839956167]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T22:21:51.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:51 smithi001 ceph-mon[30843]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T22:21:51.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:51 smithi012 ceph-mon[34883]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:21:51.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:51 smithi012 ceph-mon[34883]: from='osd.11 [v2:172.21.15.98:6824/839956167,v1:172.21.15.98:6825/839956167]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T22:21:51.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:51 smithi012 ceph-mon[34883]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T22:21:51.911 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-15T22:21:52.302 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:21:52.561 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:21:52 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:21:52.274+0000 7fc99f4e8640 -1 osd.11 0 waiting for initial osdmap 2024-09-15T22:21:52.561 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:21:52 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:21:52.288+0000 7fc99bb22640 -1 osd.11 75 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:21:52.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:52 smithi098 ceph-mon[35514]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-15T22:21:52.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:52 smithi098 ceph-mon[35514]: osdmap e74: 12 total, 11 up, 12 in 2024-09-15T22:21:52.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:52 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:21:52.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:52 smithi098 ceph-mon[35514]: from='osd.11 [v2:172.21.15.98:6824/839956167,v1:172.21.15.98:6825/839956167]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-15T22:21:52.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:52 smithi098 ceph-mon[35514]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-15T22:21:52.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:52 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:52.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:52 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:52.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:52 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:52.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:52 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:52.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:52 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:52.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:52 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:52.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:52 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:52.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:52 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:21:52.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:52 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:21:52.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:52 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:52.597 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:52 smithi001 ceph-mon[30843]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-15T22:21:52.597 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:52 smithi001 ceph-mon[30843]: osdmap e74: 12 total, 11 up, 12 in 2024-09-15T22:21:52.597 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:52 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:21:52.598 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:52 smithi001 ceph-mon[30843]: from='osd.11 [v2:172.21.15.98:6824/839956167,v1:172.21.15.98:6825/839956167]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-15T22:21:52.598 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:52 smithi001 ceph-mon[30843]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-15T22:21:52.598 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:52 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:52.598 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:52 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:52.598 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:52 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:52.598 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:52 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:52.598 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:52 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:52.598 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:52 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:52.598 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:52 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:52.598 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:52 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:21:52.598 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:52 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:21:52.598 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:52 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:52.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:52 smithi012 ceph-mon[34883]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-15T22:21:52.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:52 smithi012 ceph-mon[34883]: osdmap e74: 12 total, 11 up, 12 in 2024-09-15T22:21:52.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:52 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:21:52.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:52 smithi012 ceph-mon[34883]: from='osd.11 [v2:172.21.15.98:6824/839956167,v1:172.21.15.98:6825/839956167]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-15T22:21:52.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:52 smithi012 ceph-mon[34883]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-15T22:21:52.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:52 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:52.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:52 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:52.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:52 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:52.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:52 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:52.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:52 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:52.747 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:52 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:21:52.747 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:52 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:52.747 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:52 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:21:52.747 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:52 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:21:52.747 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:52 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:52.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.862+0000 7f088c000640 1 -- 172.21.15.1:0/398414495 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0884102e00 msgr2=0x7f0884103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:52.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.862+0000 7f088c000640 1 --2- 172.21.15.1:0/398414495 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0884102e00 0x7f0884103280 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0870009900 tx=0x7f087002a3f0 comp rx=0 tx=0).stop 2024-09-15T22:21:52.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.862+0000 7f088c000640 1 -- 172.21.15.1:0/398414495 shutdown_connections 2024-09-15T22:21:52.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.862+0000 7f088c000640 1 --2- 172.21.15.1:0/398414495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08841037c0 0x7f088410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:52.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.862+0000 7f088c000640 1 --2- 172.21.15.1:0/398414495 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0884102e00 0x7f0884103280 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:52.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.862+0000 7f088c000640 1 --2- 172.21.15.1:0/398414495 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0884101c00 0x7f0884102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:52.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.862+0000 7f088c000640 1 -- 172.21.15.1:0/398414495 >> 172.21.15.1:0/398414495 conn(0x7f08840fd390 msgr2=0x7f08840ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:52.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.862+0000 7f088c000640 1 -- 172.21.15.1:0/398414495 shutdown_connections 2024-09-15T22:21:52.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.862+0000 7f088c000640 1 -- 172.21.15.1:0/398414495 wait complete. 2024-09-15T22:21:52.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.863+0000 7f088c000640 1 Processor -- start 2024-09-15T22:21:52.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.863+0000 7f088c000640 1 -- start start 2024-09-15T22:21:52.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.863+0000 7f088c000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0884101c00 0x7f088419a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:52.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.863+0000 7f088c000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0884102e00 0x7f088419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:52.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.863+0000 7f088c000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08841037c0 0x7f08841a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:52.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.863+0000 7f088c000640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f088410d8b0 con 0x7f08841037c0 2024-09-15T22:21:52.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.863+0000 7f088c000640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f088410d730 con 0x7f0884101c00 2024-09-15T22:21:52.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.863+0000 7f088c000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f088410da30 con 0x7f0884102e00 2024-09-15T22:21:52.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.864+0000 7f0889600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0884101c00 0x7f088419a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:52.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.864+0000 7f088a000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08841037c0 0x7f08841a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:52.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.864+0000 7f0889600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0884101c00 0x7f088419a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:34776/0 (socket says 172.21.15.1:34776) 2024-09-15T22:21:52.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.864+0000 7f0889600640 1 -- 172.21.15.1:0/608107124 learned_addr learned my addr 172.21.15.1:0/608107124 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:21:52.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.864+0000 7f0888c00640 1 --2- 172.21.15.1:0/608107124 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0884102e00 0x7f088419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:52.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.864+0000 7f0889600640 1 -- 172.21.15.1:0/608107124 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0884102e00 msgr2=0x7f088419a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:52.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.864+0000 7f0889600640 1 --2- 172.21.15.1:0/608107124 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0884102e00 0x7f088419a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:52.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.864+0000 7f0889600640 1 -- 172.21.15.1:0/608107124 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08841037c0 msgr2=0x7f08841a1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:52.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.864+0000 7f0889600640 1 --2- 172.21.15.1:0/608107124 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08841037c0 0x7f08841a1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:52.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.864+0000 7f0889600640 1 -- 172.21.15.1:0/608107124 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08841a1cc0 con 0x7f0884101c00 2024-09-15T22:21:52.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.864+0000 7f088a000640 1 --2- 172.21.15.1:0/608107124 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08841037c0 0x7f08841a1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:21:52.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.864+0000 7f0889600640 1 --2- 172.21.15.1:0/608107124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0884101c00 0x7f088419a090 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f087800e9c0 tx=0x7f087800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:52.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.865+0000 7f0882000640 1 -- 172.21.15.1:0/608107124 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087800cd80 con 0x7f0884101c00 2024-09-15T22:21:52.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.865+0000 7f088c000640 1 -- 172.21.15.1:0/608107124 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08841a1fb0 con 0x7f0884101c00 2024-09-15T22:21:52.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.865+0000 7f0882000640 1 -- 172.21.15.1:0/608107124 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08780035f0 con 0x7f0884101c00 2024-09-15T22:21:52.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.865+0000 7f0882000640 1 -- 172.21.15.1:0/608107124 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0878010690 con 0x7f0884101c00 2024-09-15T22:21:52.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.865+0000 7f088c000640 1 -- 172.21.15.1:0/608107124 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08841a2410 con 0x7f0884101c00 2024-09-15T22:21:52.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.866+0000 7f088c000640 1 -- 172.21.15.1:0/608107124 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08841a26a0 con 0x7f0884101c00 2024-09-15T22:21:52.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.868+0000 7f0882000640 1 -- 172.21.15.1:0/608107124 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f08780037a0 con 0x7f0884101c00 2024-09-15T22:21:52.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.869+0000 7f0882000640 1 --2- 172.21.15.1:0/608107124 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f086c0a32f0 0x7f086c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:52.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.869+0000 7f0882000640 1 -- 172.21.15.1:0/608107124 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6847+0+0 (secure 0 0 0) 0x7f08780cf680 con 0x7f0884101c00 2024-09-15T22:21:52.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.869+0000 7f0888c00640 1 --2- 172.21.15.1:0/608107124 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f086c0a32f0 0x7f086c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:52.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.870+0000 7f0888c00640 1 --2- 172.21.15.1:0/608107124 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f086c0a32f0 0x7f086c0a57b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0870031440 tx=0x7f08700315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:52.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:52.871+0000 7f0882000640 1 -- 172.21.15.1:0/608107124 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f087809c9f0 con 0x7f0884101c00 2024-09-15T22:21:53.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:53.060+0000 7f088c000640 1 -- 172.21.15.1:0/608107124 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f08841a2870 con 0x7f0884101c00 2024-09-15T22:21:53.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:53.060+0000 7f0882000640 1 -- 172.21.15.1:0/608107124 <== mon.2 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v75) ==== 74+0+133 (secure 0 0 0) 0x7f087809c2f0 con 0x7f0884101c00 2024-09-15T22:21:53.063 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:21:53.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:53.063+0000 7f088c000640 1 -- 172.21.15.1:0/608107124 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f086c0a32f0 msgr2=0x7f086c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:53.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:53.063+0000 7f088c000640 1 --2- 172.21.15.1:0/608107124 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f086c0a32f0 0x7f086c0a57b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0870031440 tx=0x7f08700315b0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:53.063+0000 7f088c000640 1 -- 172.21.15.1:0/608107124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0884101c00 msgr2=0x7f088419a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:53.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:53.063+0000 7f088c000640 1 --2- 172.21.15.1:0/608107124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0884101c00 0x7f088419a090 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f087800e9c0 tx=0x7f087800ee80 comp rx=0 tx=0).stop 2024-09-15T22:21:53.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:53.063+0000 7f088c000640 1 -- 172.21.15.1:0/608107124 shutdown_connections 2024-09-15T22:21:53.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:53.063+0000 7f088c000640 1 --2- 172.21.15.1:0/608107124 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f086c0a32f0 0x7f086c0a57b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:53.063+0000 7f088c000640 1 --2- 172.21.15.1:0/608107124 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08841037c0 0x7f08841a1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:53.063+0000 7f088c000640 1 --2- 172.21.15.1:0/608107124 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0884102e00 0x7f088419a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:53.063+0000 7f088c000640 1 --2- 172.21.15.1:0/608107124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0884101c00 0x7f088419a090 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:53.063+0000 7f088c000640 1 -- 172.21.15.1:0/608107124 >> 172.21.15.1:0/608107124 conn(0x7f08840fd390 msgr2=0x7f0884074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:53.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:53.063+0000 7f088c000640 1 -- 172.21.15.1:0/608107124 shutdown_connections 2024-09-15T22:21:53.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:53.063+0000 7f088c000640 1 -- 172.21.15.1:0/608107124 wait complete. 2024-09-15T22:21:53.531 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:53 smithi001 ceph-mon[30843]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:21:53.531 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:53 smithi001 ceph-mon[30843]: Detected new or changed devices on smithi098 2024-09-15T22:21:53.531 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:53 smithi001 ceph-mon[30843]: Adjusting osd_memory_target on smithi098 to 4272M 2024-09-15T22:21:53.531 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:53 smithi001 ceph-mon[30843]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-15T22:21:53.531 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:53 smithi001 ceph-mon[30843]: osdmap e75: 12 total, 11 up, 12 in 2024-09-15T22:21:53.531 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:53 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:21:53.532 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:53 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:21:53.532 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:53 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:21:53.532 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:53 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:21:53.532 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:53 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:21:53.532 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:53 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:53.532 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:53 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/608107124' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:21:53.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:53 smithi098 ceph-mon[35514]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:21:53.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:53 smithi098 ceph-mon[35514]: Detected new or changed devices on smithi098 2024-09-15T22:21:53.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:53 smithi098 ceph-mon[35514]: Adjusting osd_memory_target on smithi098 to 4272M 2024-09-15T22:21:53.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:53 smithi098 ceph-mon[35514]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-15T22:21:53.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:53 smithi098 ceph-mon[35514]: osdmap e75: 12 total, 11 up, 12 in 2024-09-15T22:21:53.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:53 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:21:53.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:53 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:21:53.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:53 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:21:53.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:53 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:21:53.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:53 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:21:53.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:53 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:53.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:53 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/608107124' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:21:53.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:53 smithi012 ceph-mon[34883]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:21:53.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:53 smithi012 ceph-mon[34883]: Detected new or changed devices on smithi098 2024-09-15T22:21:53.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:53 smithi012 ceph-mon[34883]: Adjusting osd_memory_target on smithi098 to 4272M 2024-09-15T22:21:53.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:53 smithi012 ceph-mon[34883]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-15T22:21:53.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:53 smithi012 ceph-mon[34883]: osdmap e75: 12 total, 11 up, 12 in 2024-09-15T22:21:53.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:53 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:21:53.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:53 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:21:53.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:53 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:21:53.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:53 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:21:53.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:53 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:21:53.747 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:53 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:21:53.747 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:53 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/608107124' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:21:53.972 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":75,"num_osds":12,"num_up_osds":11,"osd_up_since":1726438889,"num_in_osds":12,"osd_in_since":1726438890,"num_remapped_pgs":0} 2024-09-15T22:21:54.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:54 smithi098 ceph-mon[35514]: purged_snaps scrub starts 2024-09-15T22:21:54.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:54 smithi098 ceph-mon[35514]: purged_snaps scrub ok 2024-09-15T22:21:54.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:54 smithi098 ceph-mon[35514]: osd.11 [v2:172.21.15.98:6824/839956167,v1:172.21.15.98:6825/839956167] boot 2024-09-15T22:21:54.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:54 smithi098 ceph-mon[35514]: osdmap e76: 12 total, 12 up, 12 in 2024-09-15T22:21:54.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:54 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:21:54.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:54 smithi001 ceph-mon[30843]: purged_snaps scrub starts 2024-09-15T22:21:54.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:54 smithi001 ceph-mon[30843]: purged_snaps scrub ok 2024-09-15T22:21:54.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:54 smithi001 ceph-mon[30843]: osd.11 [v2:172.21.15.98:6824/839956167,v1:172.21.15.98:6825/839956167] boot 2024-09-15T22:21:54.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:54 smithi001 ceph-mon[30843]: osdmap e76: 12 total, 12 up, 12 in 2024-09-15T22:21:54.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:54 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:21:54.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:54 smithi012 ceph-mon[34883]: purged_snaps scrub starts 2024-09-15T22:21:54.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:54 smithi012 ceph-mon[34883]: purged_snaps scrub ok 2024-09-15T22:21:54.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:54 smithi012 ceph-mon[34883]: osd.11 [v2:172.21.15.98:6824/839956167,v1:172.21.15.98:6825/839956167] boot 2024-09-15T22:21:54.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:54 smithi012 ceph-mon[34883]: osdmap e76: 12 total, 12 up, 12 in 2024-09-15T22:21:54.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:54 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:21:54.973 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-15T22:21:55.364 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:21:55.560 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:55 smithi098 ceph-mon[35514]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:21:55.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:55 smithi098 ceph-mon[35514]: osdmap e77: 12 total, 12 up, 12 in 2024-09-15T22:21:55.619 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:55 smithi001 ceph-mon[30843]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:21:55.619 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:55 smithi001 ceph-mon[30843]: osdmap e77: 12 total, 12 up, 12 in 2024-09-15T22:21:55.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:55 smithi012 ceph-mon[34883]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:21:55.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:55 smithi012 ceph-mon[34883]: osdmap e77: 12 total, 12 up, 12 in 2024-09-15T22:21:55.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.904+0000 7fe4ce200640 1 -- 172.21.15.1:0/676728719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4c8076ba0 msgr2=0x7fe4c8076fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:55.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.904+0000 7fe4ce200640 1 --2- 172.21.15.1:0/676728719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4c8076ba0 0x7fe4c8076fa0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009900 tx=0x7fe4bc02a3f0 comp rx=0 tx=0).stop 2024-09-15T22:21:55.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.904+0000 7fe4ce200640 1 -- 172.21.15.1:0/676728719 shutdown_connections 2024-09-15T22:21:55.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.904+0000 7fe4ce200640 1 --2- 172.21.15.1:0/676728719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4c8078790 0x7fe4c8079030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:55.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.904+0000 7fe4ce200640 1 --2- 172.21.15.1:0/676728719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4c8077df0 0x7fe4c8078250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:55.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.904+0000 7fe4ce200640 1 --2- 172.21.15.1:0/676728719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4c8076ba0 0x7fe4c8076fa0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:55.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.904+0000 7fe4ce200640 1 -- 172.21.15.1:0/676728719 >> 172.21.15.1:0/676728719 conn(0x7fe4c80ff3e0 msgr2=0x7fe4c8101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:55.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.904+0000 7fe4ce200640 1 -- 172.21.15.1:0/676728719 shutdown_connections 2024-09-15T22:21:55.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.904+0000 7fe4ce200640 1 -- 172.21.15.1:0/676728719 wait complete. 2024-09-15T22:21:55.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.905+0000 7fe4ce200640 1 Processor -- start 2024-09-15T22:21:55.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.905+0000 7fe4ce200640 1 -- start start 2024-09-15T22:21:55.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.906+0000 7fe4ce200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4c8076ba0 0x7fe4c819e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:55.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.906+0000 7fe4ce200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4c8077df0 0x7fe4c819e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:55.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.906+0000 7fe4ce200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4c8078790 0x7fe4c81a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:55.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.906+0000 7fe4ce200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c8113d20 con 0x7fe4c8078790 2024-09-15T22:21:55.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.906+0000 7fe4ce200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c8113ba0 con 0x7fe4c8077df0 2024-09-15T22:21:55.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.906+0000 7fe4ce200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c8113ea0 con 0x7fe4c8076ba0 2024-09-15T22:21:55.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.906+0000 7fe4cd800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4c8078790 0x7fe4c81a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:55.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.906+0000 7fe4cd800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4c8078790 0x7fe4c81a58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37420/0 (socket says 172.21.15.1:37420) 2024-09-15T22:21:55.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.906+0000 7fe4cd800640 1 -- 172.21.15.1:0/2057674175 learned_addr learned my addr 172.21.15.1:0/2057674175 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:21:55.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.906+0000 7fe4c7e00640 1 --2- 172.21.15.1:0/2057674175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4c8077df0 0x7fe4c819e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:55.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.906+0000 7fe4cce00640 1 --2- 172.21.15.1:0/2057674175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4c8076ba0 0x7fe4c819e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:55.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.907+0000 7fe4cd800640 1 -- 172.21.15.1:0/2057674175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4c8076ba0 msgr2=0x7fe4c819e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:55.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.907+0000 7fe4cd800640 1 --2- 172.21.15.1:0/2057674175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4c8076ba0 0x7fe4c819e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:55.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.907+0000 7fe4cd800640 1 -- 172.21.15.1:0/2057674175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4c8077df0 msgr2=0x7fe4c819e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:55.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.907+0000 7fe4cd800640 1 --2- 172.21.15.1:0/2057674175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4c8077df0 0x7fe4c819e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:55.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.907+0000 7fe4cd800640 1 -- 172.21.15.1:0/2057674175 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c81a5f10 con 0x7fe4c8078790 2024-09-15T22:21:55.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.907+0000 7fe4cd800640 1 --2- 172.21.15.1:0/2057674175 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4c8078790 0x7fe4c81a58a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe4c000eb10 tx=0x7fe4c000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:55.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.907+0000 7fe4c5600640 1 -- 172.21.15.1:0/2057674175 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c0004b20 con 0x7fe4c8078790 2024-09-15T22:21:55.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.907+0000 7fe4c5600640 1 -- 172.21.15.1:0/2057674175 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4c0004cc0 con 0x7fe4c8078790 2024-09-15T22:21:55.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.907+0000 7fe4c5600640 1 -- 172.21.15.1:0/2057674175 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c0010760 con 0x7fe4c8078790 2024-09-15T22:21:55.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.907+0000 7fe4ce200640 1 -- 172.21.15.1:0/2057674175 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4c81a6200 con 0x7fe4c8078790 2024-09-15T22:21:55.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.908+0000 7fe4ce200640 1 -- 172.21.15.1:0/2057674175 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4c81a66f0 con 0x7fe4c8078790 2024-09-15T22:21:55.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.909+0000 7fe4ce200640 1 -- 172.21.15.1:0/2057674175 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4c8110720 con 0x7fe4c8078790 2024-09-15T22:21:55.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.911+0000 7fe4c5600640 1 -- 172.21.15.1:0/2057674175 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fe4c0005020 con 0x7fe4c8078790 2024-09-15T22:21:55.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.912+0000 7fe4c5600640 1 --2- 172.21.15.1:0/2057674175 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe4b00a3270 0x7fe4b00a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:55.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.912+0000 7fe4c5600640 1 -- 172.21.15.1:0/2057674175 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fe4c00cf9d0 con 0x7fe4c8078790 2024-09-15T22:21:55.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.912+0000 7fe4cce00640 1 --2- 172.21.15.1:0/2057674175 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe4b00a3270 0x7fe4b00a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:55.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.913+0000 7fe4cce00640 1 --2- 172.21.15.1:0/2057674175 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe4b00a3270 0x7fe4b00a5730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc031440 tx=0x7fe4bc0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:55.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:55.916+0000 7fe4c5600640 1 -- 172.21.15.1:0/2057674175 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe4c009caf0 con 0x7fe4c8078790 2024-09-15T22:21:56.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:56.106+0000 7fe4ce200640 1 -- 172.21.15.1:0/2057674175 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fe4c8062df0 con 0x7fe4c8078790 2024-09-15T22:21:56.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:56.106+0000 7fe4c5600640 1 -- 172.21.15.1:0/2057674175 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v77) ==== 74+0+133 (secure 0 0 0) 0x7fe4c009c3f0 con 0x7fe4c8078790 2024-09-15T22:21:56.108 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:21:56.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:56.109+0000 7fe4ce200640 1 -- 172.21.15.1:0/2057674175 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe4b00a3270 msgr2=0x7fe4b00a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:56.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:56.109+0000 7fe4ce200640 1 --2- 172.21.15.1:0/2057674175 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe4b00a3270 0x7fe4b00a5730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc031440 tx=0x7fe4bc0315b0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:56.109+0000 7fe4ce200640 1 -- 172.21.15.1:0/2057674175 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4c8078790 msgr2=0x7fe4c81a58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:56.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:56.109+0000 7fe4ce200640 1 --2- 172.21.15.1:0/2057674175 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4c8078790 0x7fe4c81a58a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe4c000eb10 tx=0x7fe4c000c2d0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:56.109+0000 7fe4ce200640 1 -- 172.21.15.1:0/2057674175 shutdown_connections 2024-09-15T22:21:56.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:56.109+0000 7fe4ce200640 1 --2- 172.21.15.1:0/2057674175 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe4b00a3270 0x7fe4b00a5730 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:56.109+0000 7fe4ce200640 1 --2- 172.21.15.1:0/2057674175 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4c8078790 0x7fe4c81a58a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:56.109+0000 7fe4ce200640 1 --2- 172.21.15.1:0/2057674175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4c8077df0 0x7fe4c819e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:56.109+0000 7fe4ce200640 1 --2- 172.21.15.1:0/2057674175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4c8076ba0 0x7fe4c819e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:56.109+0000 7fe4ce200640 1 -- 172.21.15.1:0/2057674175 >> 172.21.15.1:0/2057674175 conn(0x7fe4c80ff3e0 msgr2=0x7fe4c8100ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:56.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:56.109+0000 7fe4ce200640 1 -- 172.21.15.1:0/2057674175 shutdown_connections 2024-09-15T22:21:56.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:56.109+0000 7fe4ce200640 1 -- 172.21.15.1:0/2057674175 wait complete. 2024-09-15T22:21:56.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:56 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/2057674175' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:21:56.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:56 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/2057674175' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:21:56.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:56 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/2057674175' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:21:56.903 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":77,"num_osds":12,"num_up_osds":12,"osd_up_since":1726438913,"num_in_osds":12,"osd_in_since":1726438890,"num_remapped_pgs":0} 2024-09-15T22:21:56.904 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:21:57.276 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:21:57.544 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:57 smithi001 ceph-mon[30843]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:21:57.560 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:57 smithi098 ceph-mon[35514]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:21:57.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:57 smithi012 ceph-mon[34883]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:21:57.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.802+0000 7f923d400640 1 -- 172.21.15.1:0/1478220602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9238104010 msgr2=0x7f92381043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:57.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.802+0000 7f923d400640 1 --2- 172.21.15.1:0/1478220602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9238104010 0x7f92381043f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9228009900 tx=0x7f922802a410 comp rx=0 tx=0).stop 2024-09-15T22:21:57.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.803+0000 7f923d400640 1 -- 172.21.15.1:0/1478220602 shutdown_connections 2024-09-15T22:21:57.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.803+0000 7f923d400640 1 --2- 172.21.15.1:0/1478220602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9238109140 0x7f9238110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:57.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.803+0000 7f923d400640 1 --2- 172.21.15.1:0/1478220602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92381049c0 0x7f9238108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:57.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.803+0000 7f923d400640 1 --2- 172.21.15.1:0/1478220602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9238104010 0x7f92381043f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:57.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.803+0000 7f923d400640 1 -- 172.21.15.1:0/1478220602 >> 172.21.15.1:0/1478220602 conn(0x7f92380ffa50 msgr2=0x7f9238101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:57.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.803+0000 7f923d400640 1 -- 172.21.15.1:0/1478220602 shutdown_connections 2024-09-15T22:21:57.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.803+0000 7f923d400640 1 -- 172.21.15.1:0/1478220602 wait complete. 2024-09-15T22:21:57.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.804+0000 7f923d400640 1 Processor -- start 2024-09-15T22:21:57.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.804+0000 7f923d400640 1 -- start start 2024-09-15T22:21:57.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.804+0000 7f923d400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9238104010 0x7f923819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:57.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.804+0000 7f923d400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92381049c0 0x7f923819ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:57.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.804+0000 7f923d400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9238109140 0x7f923819ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:57.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.804+0000 7f923d400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9238114190 con 0x7f9238109140 2024-09-15T22:21:57.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.804+0000 7f923d400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9238114010 con 0x7f92381049c0 2024-09-15T22:21:57.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.804+0000 7f923d400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9238114310 con 0x7f9238104010 2024-09-15T22:21:57.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.805+0000 7f922fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92381049c0 0x7f923819ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:57.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.805+0000 7f9237200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9238109140 0x7f923819ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:57.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.805+0000 7f922fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92381049c0 0x7f923819ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:51886/0 (socket says 172.21.15.1:51886) 2024-09-15T22:21:57.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.805+0000 7f922fe00640 1 -- 172.21.15.1:0/3636748004 learned_addr learned my addr 172.21.15.1:0/3636748004 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:21:57.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.805+0000 7f9236800640 1 --2- 172.21.15.1:0/3636748004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9238104010 0x7f923819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:57.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.805+0000 7f9236800640 1 -- 172.21.15.1:0/3636748004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92381049c0 msgr2=0x7f923819ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:57.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.805+0000 7f9236800640 1 --2- 172.21.15.1:0/3636748004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92381049c0 0x7f923819ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:57.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.805+0000 7f9236800640 1 -- 172.21.15.1:0/3636748004 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9238109140 msgr2=0x7f923819ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:57.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.805+0000 7f9236800640 1 --2- 172.21.15.1:0/3636748004 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9238109140 0x7f923819ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:57.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.805+0000 7f9236800640 1 -- 172.21.15.1:0/3636748004 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f923819f600 con 0x7f9238104010 2024-09-15T22:21:57.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.805+0000 7f9237200640 1 --2- 172.21.15.1:0/3636748004 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9238109140 0x7f923819ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:21:57.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.805+0000 7f922fe00640 1 --2- 172.21.15.1:0/3636748004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92381049c0 0x7f923819ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:21:57.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.805+0000 7f9236800640 1 --2- 172.21.15.1:0/3636748004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9238104010 0x7f923819a650 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f922802a930 tx=0x7f9228003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:57.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.806+0000 7f922f400640 1 -- 172.21.15.1:0/3636748004 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922803f070 con 0x7f9238104010 2024-09-15T22:21:57.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.806+0000 7f923d400640 1 -- 172.21.15.1:0/3636748004 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f923819f890 con 0x7f9238104010 2024-09-15T22:21:57.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.806+0000 7f922f400640 1 -- 172.21.15.1:0/3636748004 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9228031c90 con 0x7f9238104010 2024-09-15T22:21:57.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.806+0000 7f922f400640 1 -- 172.21.15.1:0/3636748004 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9228035030 con 0x7f9238104010 2024-09-15T22:21:57.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.806+0000 7f923d400640 1 -- 172.21.15.1:0/3636748004 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92381a71d0 con 0x7f9238104010 2024-09-15T22:21:57.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.807+0000 7f923d400640 1 -- 172.21.15.1:0/3636748004 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92381043f0 con 0x7f9238104010 2024-09-15T22:21:57.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.809+0000 7f922f400640 1 -- 172.21.15.1:0/3636748004 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f9228042070 con 0x7f9238104010 2024-09-15T22:21:57.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.810+0000 7f922f400640 1 --2- 172.21.15.1:0/3636748004 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f921c0a3240 0x7f921c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:57.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.810+0000 7f922f400640 1 -- 172.21.15.1:0/3636748004 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f92280f0050 con 0x7f9238104010 2024-09-15T22:21:57.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.810+0000 7f922fe00640 1 --2- 172.21.15.1:0/3636748004 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f921c0a3240 0x7f921c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:57.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.811+0000 7f922fe00640 1 --2- 172.21.15.1:0/3636748004 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f921c0a3240 0x7f921c0a5700 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f92380ffe70 tx=0x7f922000b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:57.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.812+0000 7f922f400640 1 -- 172.21.15.1:0/3636748004 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f92280bcb20 con 0x7f9238104010 2024-09-15T22:21:58.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:57.999+0000 7f923d400640 1 -- 172.21.15.1:0/3636748004 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f923819b9b0 con 0x7f9238104010 2024-09-15T22:21:58.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:58.000+0000 7f922f400640 1 -- 172.21.15.1:0/3636748004 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+18337 (secure 0 0 0) 0x7f92280c0e20 con 0x7f9238104010 2024-09-15T22:21:58.003 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:21:58.003 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":77,"fsid":"c1228c44-73af-11ef-bceb-c7b262605968","created":"2024-09-15T22:14:39.004556+0000","modified":"2024-09-15T22:21:54.277426+0000","last_up_change":"2024-09-15T22:21:53.270221+0000","last_in_change":"2024-09-15T22:21:30.911945+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:17:56.059390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28228d47-bbb7-4103-a4fb-3e126769f8bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6803","nonce":3588868833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6805","nonce":3588868833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6809","nonce":3588868833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6807","nonce":3588868833}]},"public_addr":"172.21.15.1:6803/3588868833","cluster_addr":"172.21.15.1:6805/3588868833","heartbeat_back_addr":"172.21.15.1:6809/3588868833","heartbeat_front_addr":"172.21.15.1:6807/3588868833","state":["exists","up"]},{"osd":1,"uuid":"d90dd2c1-2047-4491-8730-30793a354aa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6801","nonce":3951165354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6803","nonce":3951165354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6807","nonce":3951165354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6805","nonce":3951165354}]},"public_addr":"172.21.15.12:6801/3951165354","cluster_addr":"172.21.15.12:6803/3951165354","heartbeat_back_addr":"172.21.15.12:6807/3951165354","heartbeat_front_addr":"172.21.15.12:6805/3951165354","state":["exists","up"]},{"osd":2,"uuid":"22e38f44-88d3-4461-a57e-6dc4857ec48f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6801","nonce":1633982971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6803","nonce":1633982971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6807","nonce":1633982971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6805","nonce":1633982971}]},"public_addr":"172.21.15.98:6801/1633982971","cluster_addr":"172.21.15.98:6803/1633982971","heartbeat_back_addr":"172.21.15.98:6807/1633982971","heartbeat_front_addr":"172.21.15.98:6805/1633982971","state":["exists","up"]},{"osd":3,"uuid":"dd9d6e97-af81-442a-ac0d-543e440a8d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6811","nonce":3706738461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6813","nonce":3706738461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6817","nonce":3706738461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6815","nonce":3706738461}]},"public_addr":"172.21.15.1:6811/3706738461","cluster_addr":"172.21.15.1:6813/3706738461","heartbeat_back_addr":"172.21.15.1:6817/3706738461","heartbeat_front_addr":"172.21.15.1:6815/3706738461","state":["exists","up"]},{"osd":4,"uuid":"50116baa-dd99-4dbb-a7a1-2268f04052f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6809","nonce":4057902964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6811","nonce":4057902964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6815","nonce":4057902964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6813","nonce":4057902964}]},"public_addr":"172.21.15.12:6809/4057902964","cluster_addr":"172.21.15.12:6811/4057902964","heartbeat_back_addr":"172.21.15.12:6815/4057902964","heartbeat_front_addr":"172.21.15.12:6813/4057902964","state":["exists","up"]},{"osd":5,"uuid":"56ab0694-2f21-46c4-a086-44f72c271c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6809","nonce":4043567619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6811","nonce":4043567619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6815","nonce":4043567619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6813","nonce":4043567619}]},"public_addr":"172.21.15.98:6809/4043567619","cluster_addr":"172.21.15.98:6811/4043567619","heartbeat_back_addr":"172.21.15.98:6815/4043567619","heartbeat_front_addr":"172.21.15.98:6813/4043567619","state":["exists","up"]},{"osd":6,"uuid":"5ca0d114-4894-428e-bcd3-2ebd24d10a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6819","nonce":2236861161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6821","nonce":2236861161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6825","nonce":2236861161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6823","nonce":2236861161}]},"public_addr":"172.21.15.1:6819/2236861161","cluster_addr":"172.21.15.1:6821/2236861161","heartbeat_back_addr":"172.21.15.1:6825/2236861161","heartbeat_front_addr":"172.21.15.1:6823/2236861161","state":["exists","up"]},{"osd":7,"uuid":"db99cc6e-1717-4958-bf11-65aca94476b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6817","nonce":133202448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6819","nonce":133202448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6823","nonce":133202448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6821","nonce":133202448}]},"public_addr":"172.21.15.12:6817/133202448","cluster_addr":"172.21.15.12:6819/133202448","heartbeat_back_addr":"172.21.15.12:6823/133202448","heartbeat_front_addr":"172.21.15.12:6821/133202448","state":["exists","up"]},{"osd":8,"uuid":"4d3b6574-49f7-47f6-b36b-4da14ca290f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6817","nonce":3701478409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6819","nonce":3701478409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6823","nonce":3701478409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6821","nonce":3701478409}]},"public_addr":"172.21.15.98:6817/3701478409","cluster_addr":"172.21.15.98:6819/3701478409","heartbeat_back_addr":"172.21.15.98:6823/3701478409","heartbeat_front_addr":"172.21.15.98:6821/3701478409","state":["exists","up"]},{"osd":9,"uuid":"7dd2fe25-1b75-48e5-86c7-c7a3ab85053f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6827","nonce":2580755002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6829","nonce":2580755002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6833","nonce":2580755002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6831","nonce":2580755002}]},"public_addr":"172.21.15.1:6827/2580755002","cluster_addr":"172.21.15.1:6829/2580755002","heartbeat_back_addr":"172.21.15.1:6833/2580755002","heartbeat_front_addr":"172.21.15.1:6831/2580755002","state":["exists","up"]},{"osd":10,"uuid":"fcad11dc-0a1b-44a2-ac32-74100e317255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6825","nonce":3989063573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6827","nonce":3989063573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6831","nonce":3989063573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6829","nonce":3989063573}]},"public_addr":"172.21.15.12:6825/3989063573","cluster_addr":"172.21.15.12:6827/3989063573","heartbeat_back_addr":"172.21.15.12:6831/3989063573","heartbeat_front_addr":"172.21.15.12:6829/3989063573","state":["exists","up"]},{"osd":11,"uuid":"f4e717bb-586d-4fe2-9e6b-f574be4db36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6825","nonce":839956167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6827","nonce":839956167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6831","nonce":839956167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6829","nonce":839956167}]},"public_addr":"172.21.15.98:6825/839956167","cluster_addr":"172.21.15.98:6827/839956167","heartbeat_back_addr":"172.21.15.98:6831/839956167","heartbeat_front_addr":"172.21.15.98:6829/839956167","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:17:01.990618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:17:28.259003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:17:52.825080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:18:22.724038+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:18:48.383663+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:19:13.246563+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:19:42.318469+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:20:08.809160+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:20:32.628925+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:21:02.280217+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:21:27.897758+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:21:52.055015+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6800/3145051160":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/3101438101":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/4159811089":"2024-09-16T22:15:31.433375+0000","172.21.15.1:6801/3145051160":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/2785155592":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/714180295":"2024-09-16T22:15:03.937536+0000","172.21.15.1:6801/215291238":"2024-09-16T22:15:03.937536+0000","172.21.15.1:6800/215291238":"2024-09-16T22:15:03.937536+0000","172.21.15.1:0/1842817732":"2024-09-16T22:15:03.937536+0000","172.21.15.1:0/3888009741":"2024-09-16T22:15:03.937536+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:21:58.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:58.003+0000 7f923d400640 1 -- 172.21.15.1:0/3636748004 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f921c0a3240 msgr2=0x7f921c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:58.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:58.003+0000 7f923d400640 1 --2- 172.21.15.1:0/3636748004 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f921c0a3240 0x7f921c0a5700 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f92380ffe70 tx=0x7f922000b480 comp rx=0 tx=0).stop 2024-09-15T22:21:58.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:58.003+0000 7f923d400640 1 -- 172.21.15.1:0/3636748004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9238104010 msgr2=0x7f923819a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:58.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:58.003+0000 7f923d400640 1 --2- 172.21.15.1:0/3636748004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9238104010 0x7f923819a650 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f922802a930 tx=0x7f9228003b90 comp rx=0 tx=0).stop 2024-09-15T22:21:58.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:58.003+0000 7f923d400640 1 -- 172.21.15.1:0/3636748004 shutdown_connections 2024-09-15T22:21:58.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:58.003+0000 7f923d400640 1 --2- 172.21.15.1:0/3636748004 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f921c0a3240 0x7f921c0a5700 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:58.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:58.003+0000 7f923d400640 1 --2- 172.21.15.1:0/3636748004 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9238109140 0x7f923819ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:58.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:58.003+0000 7f923d400640 1 --2- 172.21.15.1:0/3636748004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92381049c0 0x7f923819ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:58.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:58.003+0000 7f923d400640 1 --2- 172.21.15.1:0/3636748004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9238104010 0x7f923819a650 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:58.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:58.003+0000 7f923d400640 1 -- 172.21.15.1:0/3636748004 >> 172.21.15.1:0/3636748004 conn(0x7f92380ffa50 msgr2=0x7f9238100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:58.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:58.003+0000 7f923d400640 1 -- 172.21.15.1:0/3636748004 shutdown_connections 2024-09-15T22:21:58.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:58.004+0000 7f923d400640 1 -- 172.21.15.1:0/3636748004 wait complete. 2024-09-15T22:21:58.424 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:58 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/3636748004' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:21:58.560 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:58 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/3636748004' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:21:58.747 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:58 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/3636748004' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:21:58.863 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T22:17:56.059390+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T22:21:58.864 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-15T22:21:59.233 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:21:59.556 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:21:59 smithi001 ceph-mon[30843]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:21:59.560 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:21:59 smithi098 ceph-mon[35514]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:21:59.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:21:59 smithi012 ceph-mon[34883]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:21:59.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.762+0000 7ffbb7200640 1 -- 172.21.15.1:0/526510737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbb8102360 msgr2=0x7ffbb810e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:59.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.762+0000 7ffbb7200640 1 --2- 172.21.15.1:0/526510737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbb8102360 0x7ffbb810e890 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0009930 tx=0x7ffbb002a420 comp rx=0 tx=0).stop 2024-09-15T22:21:59.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.762+0000 7ffbb7200640 1 -- 172.21.15.1:0/526510737 shutdown_connections 2024-09-15T22:21:59.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.762+0000 7ffbb7200640 1 --2- 172.21.15.1:0/526510737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbb8102360 0x7ffbb810e890 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.762+0000 7ffbb7200640 1 --2- 172.21.15.1:0/526510737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffbb81019c0 0x7ffbb8101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.762+0000 7ffbb7200640 1 --2- 172.21.15.1:0/526510737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbb81079c0 0x7ffbb8107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.762+0000 7ffbb7200640 1 -- 172.21.15.1:0/526510737 >> 172.21.15.1:0/526510737 conn(0x7ffbb80fd740 msgr2=0x7ffbb80ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:59.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.762+0000 7ffbb7200640 1 -- 172.21.15.1:0/526510737 shutdown_connections 2024-09-15T22:21:59.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.762+0000 7ffbb7200640 1 -- 172.21.15.1:0/526510737 wait complete. 2024-09-15T22:21:59.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.764+0000 7ffbb7200640 1 Processor -- start 2024-09-15T22:21:59.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.764+0000 7ffbb7200640 1 -- start start 2024-09-15T22:21:59.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.764+0000 7ffbb7200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbb81019c0 0x7ffbb819a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:59.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.764+0000 7ffbb7200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffbb8102360 0x7ffbb819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:59.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.764+0000 7ffbb7200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbb81079c0 0x7ffbb819ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:59.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.764+0000 7ffbb7200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb8111e10 con 0x7ffbb8102360 2024-09-15T22:21:59.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.764+0000 7ffbb7200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb8111c90 con 0x7ffbb81019c0 2024-09-15T22:21:59.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.764+0000 7ffbb7200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb8111f90 con 0x7ffbb81079c0 2024-09-15T22:21:59.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.765+0000 7ffbb5e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbb81019c0 0x7ffbb819a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:59.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.765+0000 7ffbb5e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbb81019c0 0x7ffbb819a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:51906/0 (socket says 172.21.15.1:51906) 2024-09-15T22:21:59.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.765+0000 7ffbb5e00640 1 -- 172.21.15.1:0/2678256179 learned_addr learned my addr 172.21.15.1:0/2678256179 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:21:59.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.765+0000 7ffbad400640 1 --2- 172.21.15.1:0/2678256179 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffbb8102360 0x7ffbb819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:59.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.765+0000 7ffbb6800640 1 --2- 172.21.15.1:0/2678256179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbb81079c0 0x7ffbb819ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:59.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.765+0000 7ffbb5e00640 1 -- 172.21.15.1:0/2678256179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbb81079c0 msgr2=0x7ffbb819ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:59.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.765+0000 7ffbb5e00640 1 --2- 172.21.15.1:0/2678256179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbb81079c0 0x7ffbb819ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.765+0000 7ffbb5e00640 1 -- 172.21.15.1:0/2678256179 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffbb8102360 msgr2=0x7ffbb819a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:59.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.765+0000 7ffbb5e00640 1 --2- 172.21.15.1:0/2678256179 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffbb8102360 0x7ffbb819a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.765+0000 7ffbb5e00640 1 -- 172.21.15.1:0/2678256179 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbb819f440 con 0x7ffbb81019c0 2024-09-15T22:21:59.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.765+0000 7ffbb5e00640 1 --2- 172.21.15.1:0/2678256179 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbb81019c0 0x7ffbb819a490 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ffba800ebc0 tx=0x7ffba800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:59.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.766+0000 7ffbaf400640 1 -- 172.21.15.1:0/2678256179 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba8010630 con 0x7ffbb81019c0 2024-09-15T22:21:59.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.766+0000 7ffbaf400640 1 -- 172.21.15.1:0/2678256179 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffba8010cb0 con 0x7ffbb81019c0 2024-09-15T22:21:59.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.766+0000 7ffbaf400640 1 -- 172.21.15.1:0/2678256179 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba8018bd0 con 0x7ffbb81019c0 2024-09-15T22:21:59.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.766+0000 7ffbb7200640 1 -- 172.21.15.1:0/2678256179 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbb819f730 con 0x7ffbb81019c0 2024-09-15T22:21:59.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.766+0000 7ffbb7200640 1 -- 172.21.15.1:0/2678256179 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbb81a7010 con 0x7ffbb81019c0 2024-09-15T22:21:59.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.767+0000 7ffbb7200640 1 -- 172.21.15.1:0/2678256179 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbb8101e20 con 0x7ffbb81019c0 2024-09-15T22:21:59.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.769+0000 7ffbaf400640 1 -- 172.21.15.1:0/2678256179 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7ffba80107d0 con 0x7ffbb81019c0 2024-09-15T22:21:59.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.770+0000 7ffbaf400640 1 --2- 172.21.15.1:0/2678256179 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ffb9c0a32c0 0x7ffb9c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:59.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.770+0000 7ffbaf400640 1 -- 172.21.15.1:0/2678256179 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7ffba80cfad0 con 0x7ffbb81019c0 2024-09-15T22:21:59.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.770+0000 7ffbad400640 1 --2- 172.21.15.1:0/2678256179 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ffb9c0a32c0 0x7ffb9c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:59.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.771+0000 7ffbad400640 1 --2- 172.21.15.1:0/2678256179 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ffb9c0a32c0 0x7ffb9c0a5780 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffba00095f0 tx=0x7ffba0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:59.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.774+0000 7ffbaf400640 1 -- 172.21.15.1:0/2678256179 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffba809cbf0 con 0x7ffbb81019c0 2024-09-15T22:21:59.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.962+0000 7ffbb7200640 1 -- 172.21.15.1:0/2678256179 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ffbb81a71e0 con 0x7ffbb81019c0 2024-09-15T22:21:59.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.963+0000 7ffbaf400640 1 -- 172.21.15.1:0/2678256179 <== mon.2 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) ==== 93+0+10 (secure 0 0 0) 0x7ffba809c4f0 con 0x7ffbb81019c0 2024-09-15T22:21:59.965 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2024-09-15T22:21:59.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.965+0000 7ffbb7200640 1 -- 172.21.15.1:0/2678256179 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ffb9c0a32c0 msgr2=0x7ffb9c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:59.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.965+0000 7ffbb7200640 1 --2- 172.21.15.1:0/2678256179 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ffb9c0a32c0 0x7ffb9c0a5780 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffba00095f0 tx=0x7ffba0005f90 comp rx=0 tx=0).stop 2024-09-15T22:21:59.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.965+0000 7ffbb7200640 1 -- 172.21.15.1:0/2678256179 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbb81019c0 msgr2=0x7ffbb819a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:59.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.965+0000 7ffbb7200640 1 --2- 172.21.15.1:0/2678256179 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbb81019c0 0x7ffbb819a490 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ffba800ebc0 tx=0x7ffba800c6a0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.965+0000 7ffbb7200640 1 -- 172.21.15.1:0/2678256179 shutdown_connections 2024-09-15T22:21:59.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.965+0000 7ffbb7200640 1 --2- 172.21.15.1:0/2678256179 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ffb9c0a32c0 0x7ffb9c0a5780 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.965+0000 7ffbb7200640 1 --2- 172.21.15.1:0/2678256179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbb81079c0 0x7ffbb819ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.965+0000 7ffbb7200640 1 --2- 172.21.15.1:0/2678256179 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffbb8102360 0x7ffbb819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.965+0000 7ffbb7200640 1 --2- 172.21.15.1:0/2678256179 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbb81019c0 0x7ffbb819a490 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.965+0000 7ffbb7200640 1 -- 172.21.15.1:0/2678256179 >> 172.21.15.1:0/2678256179 conn(0x7ffbb80fd740 msgr2=0x7ffbb810cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:59.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.965+0000 7ffbb7200640 1 -- 172.21.15.1:0/2678256179 shutdown_connections 2024-09-15T22:21:59.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:21:59.965+0000 7ffbb7200640 1 -- 172.21.15.1:0/2678256179 wait complete. 2024-09-15T22:22:00.560 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:00 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/2678256179' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T22:22:00.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:00 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/2678256179' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T22:22:00.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:00 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/2678256179' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T22:22:00.777 INFO:tasks.cephadm:Adding mds.a on smithi001 2024-09-15T22:22:00.777 INFO:tasks.cephadm:Adding mds.d on smithi001 2024-09-15T22:22:00.777 INFO:tasks.cephadm:Adding mds.g on smithi001 2024-09-15T22:22:00.777 INFO:tasks.cephadm:Adding mds.j on smithi001 2024-09-15T22:22:00.777 INFO:tasks.cephadm:Adding mds.b on smithi012 2024-09-15T22:22:00.777 INFO:tasks.cephadm:Adding mds.e on smithi012 2024-09-15T22:22:00.777 INFO:tasks.cephadm:Adding mds.h on smithi012 2024-09-15T22:22:00.777 INFO:tasks.cephadm:Adding mds.k on smithi012 2024-09-15T22:22:00.777 INFO:tasks.cephadm:Adding mds.c on smithi098 2024-09-15T22:22:00.777 INFO:tasks.cephadm:Adding mds.f on smithi098 2024-09-15T22:22:00.777 INFO:tasks.cephadm:Adding mds.i on smithi098 2024-09-15T22:22:00.777 INFO:tasks.cephadm:Adding mds.l on smithi098 2024-09-15T22:22:00.778 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi012=b;smithi012=e;smithi012=h;smithi012=k;smithi098=c;smithi098=f;smithi098=i;smithi098=l' 2024-09-15T22:22:01.035 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:22:01.441 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:01 smithi098 ceph-mon[35514]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:01.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.522+0000 7f6021747640 1 -- 172.21.15.98:0/3020648977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f601c102eb0 msgr2=0x7f601c103330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:01.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.522+0000 7f6021747640 1 --2- 172.21.15.98:0/3020648977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f601c102eb0 0x7f601c103330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6010009930 tx=0x7f601002a420 comp rx=0 tx=0).stop 2024-09-15T22:22:01.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.522+0000 7f6021747640 1 -- 172.21.15.98:0/3020648977 shutdown_connections 2024-09-15T22:22:01.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.522+0000 7f6021747640 1 --2- 172.21.15.98:0/3020648977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f601c103870 0x7f601c10a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.522+0000 7f6021747640 1 --2- 172.21.15.98:0/3020648977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f601c102eb0 0x7f601c103330 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.522+0000 7f6021747640 1 --2- 172.21.15.98:0/3020648977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f601c0ffed0 0x7f601c1002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.522+0000 7f6021747640 1 -- 172.21.15.98:0/3020648977 >> 172.21.15.98:0/3020648977 conn(0x7f601c0fba40 msgr2=0x7f601c0fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:01.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.522+0000 7f6021747640 1 -- 172.21.15.98:0/3020648977 shutdown_connections 2024-09-15T22:22:01.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.522+0000 7f6021747640 1 -- 172.21.15.98:0/3020648977 wait complete. 2024-09-15T22:22:01.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.523+0000 7f6021747640 1 Processor -- start 2024-09-15T22:22:01.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.523+0000 7f6021747640 1 -- start start 2024-09-15T22:22:01.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.523+0000 7f6021747640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f601c0ffed0 0x7f601c198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:01.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.523+0000 7f6021747640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f601c102eb0 0x7f601c198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:01.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.523+0000 7f6021747640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f601c103870 0x7f601c19f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:01.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.523+0000 7f6021747640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f601c10d9b0 con 0x7f601c102eb0 2024-09-15T22:22:01.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.523+0000 7f6021747640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f601c10d830 con 0x7f601c103870 2024-09-15T22:22:01.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.523+0000 7f6021747640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f601c10db30 con 0x7f601c0ffed0 2024-09-15T22:22:01.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.523+0000 7f601affd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f601c0ffed0 0x7f601c198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:01.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.523+0000 7f601affd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f601c0ffed0 0x7f601c198130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32880/0 (socket says 172.21.15.98:32880) 2024-09-15T22:22:01.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.523+0000 7f601affd640 1 -- 172.21.15.98:0/2657224429 learned_addr learned my addr 172.21.15.98:0/2657224429 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-15T22:22:01.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.524+0000 7f601a7fc640 1 --2- 172.21.15.98:0/2657224429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f601c102eb0 0x7f601c198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:01.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.524+0000 7f601b7fe640 1 --2- 172.21.15.98:0/2657224429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f601c103870 0x7f601c19f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:01.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.524+0000 7f601affd640 1 -- 172.21.15.98:0/2657224429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f601c103870 msgr2=0x7f601c19f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:01.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.524+0000 7f601affd640 1 --2- 172.21.15.98:0/2657224429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f601c103870 0x7f601c19f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.524+0000 7f601affd640 1 -- 172.21.15.98:0/2657224429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f601c102eb0 msgr2=0x7f601c198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:01.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.524+0000 7f601affd640 1 --2- 172.21.15.98:0/2657224429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f601c102eb0 0x7f601c198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.524+0000 7f601affd640 1 -- 172.21.15.98:0/2657224429 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f601c19fd60 con 0x7f601c0ffed0 2024-09-15T22:22:01.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.524+0000 7f601b7fe640 1 --2- 172.21.15.98:0/2657224429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f601c103870 0x7f601c19f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:22:01.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.524+0000 7f601affd640 1 --2- 172.21.15.98:0/2657224429 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f601c0ffed0 0x7f601c198130 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f600c00b450 tx=0x7f600c00b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:01.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.524+0000 7f6003fff640 1 -- 172.21.15.98:0/2657224429 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c015020 con 0x7f601c0ffed0 2024-09-15T22:22:01.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.524+0000 7f6003fff640 1 -- 172.21.15.98:0/2657224429 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f600c011d70 con 0x7f601c0ffed0 2024-09-15T22:22:01.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.524+0000 7f6021747640 1 -- 172.21.15.98:0/2657224429 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f601c19fff0 con 0x7f601c0ffed0 2024-09-15T22:22:01.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.524+0000 7f6003fff640 1 -- 172.21.15.98:0/2657224429 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c00f340 con 0x7f601c0ffed0 2024-09-15T22:22:01.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.524+0000 7f6021747640 1 -- 172.21.15.98:0/2657224429 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f601c1a0520 con 0x7f601c0ffed0 2024-09-15T22:22:01.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.525+0000 7f6021747640 1 -- 172.21.15.98:0/2657224429 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f601c1091f0 con 0x7f601c0ffed0 2024-09-15T22:22:01.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.526+0000 7f6003fff640 1 -- 172.21.15.98:0/2657224429 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f600c018020 con 0x7f601c0ffed0 2024-09-15T22:22:01.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.527+0000 7f6003fff640 1 --2- 172.21.15.98:0/2657224429 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f60040a3270 0x7f60040a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:01.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.527+0000 7f6003fff640 1 -- 172.21.15.98:0/2657224429 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f600c0cef40 con 0x7f601c0ffed0 2024-09-15T22:22:01.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.527+0000 7f601a7fc640 1 --2- 172.21.15.98:0/2657224429 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f60040a3270 0x7f60040a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:01.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.528+0000 7f601a7fc640 1 --2- 172.21.15.98:0/2657224429 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f60040a3270 0x7f60040a5730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6010000c00 tx=0x7f60100314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:01.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.531+0000 7f6003fff640 1 -- 172.21.15.98:0/2657224429 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f600c01f020 con 0x7f601c0ffed0 2024-09-15T22:22:01.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:01 smithi001 ceph-mon[30843]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:01.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.707+0000 7f6021747640 1 -- 172.21.15.98:0/2657224429 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi012=b;smithi012=e;smithi012=h;smithi012=k;smithi098=c;smithi098=f;smithi098=i;smithi098=l", "target": ["mon-mgr", ""]}) -- 0x7f601c062730 con 0x7f60040a3270 2024-09-15T22:22:01.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.715+0000 7f6003fff640 1 -- 172.21.15.98:0/2657224429 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f601c062730 con 0x7f60040a3270 2024-09-15T22:22:01.717 INFO:teuthology.orchestra.run.smithi098.stdout:Scheduled mds.all update... 2024-09-15T22:22:01.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.718+0000 7f6021747640 1 -- 172.21.15.98:0/2657224429 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f60040a3270 msgr2=0x7f60040a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:01.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.718+0000 7f6021747640 1 --2- 172.21.15.98:0/2657224429 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f60040a3270 0x7f60040a5730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6010000c00 tx=0x7f60100314a0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.718+0000 7f6021747640 1 -- 172.21.15.98:0/2657224429 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f601c0ffed0 msgr2=0x7f601c198130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:01.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.718+0000 7f6021747640 1 --2- 172.21.15.98:0/2657224429 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f601c0ffed0 0x7f601c198130 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f600c00b450 tx=0x7f600c00b910 comp rx=0 tx=0).stop 2024-09-15T22:22:01.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.718+0000 7f6021747640 1 -- 172.21.15.98:0/2657224429 shutdown_connections 2024-09-15T22:22:01.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.718+0000 7f6021747640 1 --2- 172.21.15.98:0/2657224429 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f60040a3270 0x7f60040a5730 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.718+0000 7f6021747640 1 --2- 172.21.15.98:0/2657224429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f601c103870 0x7f601c19f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.718+0000 7f6021747640 1 --2- 172.21.15.98:0/2657224429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f601c102eb0 0x7f601c198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.718+0000 7f6021747640 1 --2- 172.21.15.98:0/2657224429 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f601c0ffed0 0x7f601c198130 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.718+0000 7f6021747640 1 -- 172.21.15.98:0/2657224429 >> 172.21.15.98:0/2657224429 conn(0x7f601c0fba40 msgr2=0x7f601c1063c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:01.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.718+0000 7f6021747640 1 -- 172.21.15.98:0/2657224429 shutdown_connections 2024-09-15T22:22:01.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-15T22:22:01.718+0000 7f6021747640 1 -- 172.21.15.98:0/2657224429 wait complete. 2024-09-15T22:22:01.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:01 smithi012 ceph-mon[34883]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:02.375 DEBUG:teuthology.orchestra.run.smithi001:mds.a> sudo journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.a.service 2024-09-15T22:22:02.379 DEBUG:teuthology.orchestra.run.smithi001:mds.d> sudo journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.d.service 2024-09-15T22:22:02.424 DEBUG:teuthology.orchestra.run.smithi001:mds.g> sudo journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.g.service 2024-09-15T22:22:02.469 DEBUG:teuthology.orchestra.run.smithi001:mds.j> sudo journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.j.service 2024-09-15T22:22:02.517 DEBUG:teuthology.orchestra.run.smithi012:mds.b> sudo journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.b.service 2024-09-15T22:22:02.520 DEBUG:teuthology.orchestra.run.smithi012:mds.e> sudo journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.e.service 2024-09-15T22:22:02.564 DEBUG:teuthology.orchestra.run.smithi012:mds.h> sudo journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.h.service 2024-09-15T22:22:02.606 DEBUG:teuthology.orchestra.run.smithi012:mds.k> sudo journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.k.service 2024-09-15T22:22:02.649 DEBUG:teuthology.orchestra.run.smithi098:mds.c> sudo journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.c.service 2024-09-15T22:22:02.652 DEBUG:teuthology.orchestra.run.smithi098:mds.f> sudo journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.f.service 2024-09-15T22:22:02.694 DEBUG:teuthology.orchestra.run.smithi098:mds.i> sudo journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.i.service 2024-09-15T22:22:02.737 DEBUG:teuthology.orchestra.run.smithi098:mds.l> sudo journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.l.service 2024-09-15T22:22:02.780 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-15T22:22:02.781 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:22:02.957 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:02 smithi098 ceph-mon[35514]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:02.957 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:02 smithi098 ceph-mon[35514]: from='client.24454 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi012=b;smithi012=e;smithi012=h;smithi012=k;smithi098=c;smithi098=f;smithi098=i;smithi098=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:22:02.957 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:02 smithi098 ceph-mon[35514]: Saving service mds.all spec with placement smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi012=b;smithi012=e;smithi012=h;smithi012=k;smithi098=c;smithi098=f;smithi098=i;smithi098=l;count:12 2024-09-15T22:22:02.957 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:02 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:02.957 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:02 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:22:02.957 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:02 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:02.957 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:02 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:22:02.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:02 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:02.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:02 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:02.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:02 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:02.958 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:02 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:02.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:02 smithi012 ceph-mon[34883]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:02.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:02 smithi012 ceph-mon[34883]: from='client.24454 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi012=b;smithi012=e;smithi012=h;smithi012=k;smithi098=c;smithi098=f;smithi098=i;smithi098=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:22:02.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:02 smithi012 ceph-mon[34883]: Saving service mds.all spec with placement smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi012=b;smithi012=e;smithi012=h;smithi012=k;smithi098=c;smithi098=f;smithi098=i;smithi098=l;count:12 2024-09-15T22:22:02.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:02 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:02.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:02 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:22:02.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:02 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:02.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:02 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:22:02.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:02 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:02.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:02 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:02.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:02 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:02.997 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:02 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:03.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:02 smithi001 ceph-mon[30843]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:03.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:02 smithi001 ceph-mon[30843]: from='client.24454 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi012=b;smithi012=e;smithi012=h;smithi012=k;smithi098=c;smithi098=f;smithi098=i;smithi098=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:22:03.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:02 smithi001 ceph-mon[30843]: Saving service mds.all spec with placement smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi012=b;smithi012=e;smithi012=h;smithi012=k;smithi098=c;smithi098=f;smithi098=i;smithi098=l;count:12 2024-09-15T22:22:03.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:02 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:03.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:02 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:22:03.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:02 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:03.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:02 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:22:03.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:02 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:03.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:02 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:03.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:02 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:03.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:02 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:03.149 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:22:03.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.652+0000 7fb336400640 1 -- 172.21.15.1:0/3113443977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb330103ff0 msgr2=0x7fb3301043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:03.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.652+0000 7fb336400640 1 --2- 172.21.15.1:0/3113443977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb330103ff0 0x7fb3301043d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb320009900 tx=0x7fb32002a3f0 comp rx=0 tx=0).stop 2024-09-15T22:22:03.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.652+0000 7fb336400640 1 -- 172.21.15.1:0/3113443977 shutdown_connections 2024-09-15T22:22:03.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.652+0000 7fb336400640 1 --2- 172.21.15.1:0/3113443977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb330109120 0x7fb330110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:03.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.652+0000 7fb336400640 1 --2- 172.21.15.1:0/3113443977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3301049a0 0x7fb3301089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:03.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.652+0000 7fb336400640 1 --2- 172.21.15.1:0/3113443977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb330103ff0 0x7fb3301043d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:03.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.652+0000 7fb336400640 1 -- 172.21.15.1:0/3113443977 >> 172.21.15.1:0/3113443977 conn(0x7fb3300ffa90 msgr2=0x7fb330101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:03.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.652+0000 7fb336400640 1 -- 172.21.15.1:0/3113443977 shutdown_connections 2024-09-15T22:22:03.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.652+0000 7fb336400640 1 -- 172.21.15.1:0/3113443977 wait complete. 2024-09-15T22:22:03.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.653+0000 7fb336400640 1 Processor -- start 2024-09-15T22:22:03.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.653+0000 7fb336400640 1 -- start start 2024-09-15T22:22:03.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.654+0000 7fb336400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb330103ff0 0x7fb33019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:03.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.654+0000 7fb336400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3301049a0 0x7fb33019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:03.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.654+0000 7fb336400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb330109120 0x7fb33019ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:03.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.654+0000 7fb336400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb330114170 con 0x7fb3301049a0 2024-09-15T22:22:03.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.654+0000 7fb336400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb330113ff0 con 0x7fb330103ff0 2024-09-15T22:22:03.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.654+0000 7fb336400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb3301142f0 con 0x7fb330109120 2024-09-15T22:22:03.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.654+0000 7fb32f400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb330103ff0 0x7fb33019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:03.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.654+0000 7fb32f400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb330103ff0 0x7fb33019a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:51928/0 (socket says 172.21.15.1:51928) 2024-09-15T22:22:03.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.654+0000 7fb32f400640 1 -- 172.21.15.1:0/1811700287 learned_addr learned my addr 172.21.15.1:0/1811700287 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:22:03.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.654+0000 7fb32ea00640 1 --2- 172.21.15.1:0/1811700287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3301049a0 0x7fb33019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:03.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.654+0000 7fb32fe00640 1 --2- 172.21.15.1:0/1811700287 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb330109120 0x7fb33019ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:03.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.654+0000 7fb32f400640 1 -- 172.21.15.1:0/1811700287 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb330109120 msgr2=0x7fb33019ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:03.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.654+0000 7fb32f400640 1 --2- 172.21.15.1:0/1811700287 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb330109120 0x7fb33019ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:03.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.654+0000 7fb32f400640 1 -- 172.21.15.1:0/1811700287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3301049a0 msgr2=0x7fb33019abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:03.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.654+0000 7fb32f400640 1 --2- 172.21.15.1:0/1811700287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3301049a0 0x7fb33019abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:03.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.654+0000 7fb32f400640 1 -- 172.21.15.1:0/1811700287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb33019f620 con 0x7fb330103ff0 2024-09-15T22:22:03.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.655+0000 7fb32f400640 1 --2- 172.21.15.1:0/1811700287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb330103ff0 0x7fb33019a670 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb320004770 tx=0x7fb320003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:03.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.655+0000 7fb327e00640 1 -- 172.21.15.1:0/1811700287 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32003f070 con 0x7fb330103ff0 2024-09-15T22:22:03.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.655+0000 7fb336400640 1 -- 172.21.15.1:0/1811700287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb33019f8b0 con 0x7fb330103ff0 2024-09-15T22:22:03.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.655+0000 7fb327e00640 1 -- 172.21.15.1:0/1811700287 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb320031ca0 con 0x7fb330103ff0 2024-09-15T22:22:03.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.655+0000 7fb327e00640 1 -- 172.21.15.1:0/1811700287 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb320035030 con 0x7fb330103ff0 2024-09-15T22:22:03.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.655+0000 7fb336400640 1 -- 172.21.15.1:0/1811700287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3301a71f0 con 0x7fb330103ff0 2024-09-15T22:22:03.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.656+0000 7fb336400640 1 -- 172.21.15.1:0/1811700287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3301054d0 con 0x7fb330103ff0 2024-09-15T22:22:03.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.658+0000 7fb327e00640 1 -- 172.21.15.1:0/1811700287 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fb320042070 con 0x7fb330103ff0 2024-09-15T22:22:03.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.659+0000 7fb327e00640 1 --2- 172.21.15.1:0/1811700287 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb3140a3240 0x7fb3140a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:03.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.660+0000 7fb327e00640 1 -- 172.21.15.1:0/1811700287 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fb3200efe30 con 0x7fb330103ff0 2024-09-15T22:22:03.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.660+0000 7fb32ea00640 1 --2- 172.21.15.1:0/1811700287 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb3140a3240 0x7fb3140a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:03.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.660+0000 7fb32ea00640 1 --2- 172.21.15.1:0/1811700287 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb3140a3240 0x7fb3140a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb3300fff40 tx=0x7fb31c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:03.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.662+0000 7fb327e00640 1 -- 172.21.15.1:0/1811700287 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb3200bc900 con 0x7fb330103ff0 2024-09-15T22:22:03.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:03 smithi001 ceph-mon[30843]: Deploying daemon mds.l on smithi098 2024-09-15T22:22:03.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.884+0000 7fb336400640 1 -- 172.21.15.1:0/1811700287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb33010c300 con 0x7fb330103ff0 2024-09-15T22:22:03.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.885+0000 7fb327e00640 1 -- 172.21.15.1:0/1811700287 <== mon.2 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fb3200c0c00 con 0x7fb330103ff0 2024-09-15T22:22:03.887 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:22:03.887 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":1,"btime":"2024-09-15T22:14:39:004349+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-15T22:22:03.887 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 1 2024-09-15T22:22:03.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.887+0000 7fb336400640 1 -- 172.21.15.1:0/1811700287 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb3140a3240 msgr2=0x7fb3140a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:03.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.887+0000 7fb336400640 1 --2- 172.21.15.1:0/1811700287 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb3140a3240 0x7fb3140a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb3300fff40 tx=0x7fb31c005f90 comp rx=0 tx=0).stop 2024-09-15T22:22:03.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.887+0000 7fb336400640 1 -- 172.21.15.1:0/1811700287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb330103ff0 msgr2=0x7fb33019a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:03.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.887+0000 7fb336400640 1 --2- 172.21.15.1:0/1811700287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb330103ff0 0x7fb33019a670 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb320004770 tx=0x7fb320003c10 comp rx=0 tx=0).stop 2024-09-15T22:22:03.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.887+0000 7fb336400640 1 -- 172.21.15.1:0/1811700287 shutdown_connections 2024-09-15T22:22:03.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.887+0000 7fb336400640 1 --2- 172.21.15.1:0/1811700287 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb3140a3240 0x7fb3140a5700 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:03.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.887+0000 7fb336400640 1 --2- 172.21.15.1:0/1811700287 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb330109120 0x7fb33019ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:03.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.887+0000 7fb336400640 1 --2- 172.21.15.1:0/1811700287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3301049a0 0x7fb33019abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:03.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.887+0000 7fb336400640 1 --2- 172.21.15.1:0/1811700287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb330103ff0 0x7fb33019a670 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:03.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.887+0000 7fb336400640 1 -- 172.21.15.1:0/1811700287 >> 172.21.15.1:0/1811700287 conn(0x7fb3300ffa90 msgr2=0x7fb330100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:03.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.887+0000 7fb336400640 1 -- 172.21.15.1:0/1811700287 shutdown_connections 2024-09-15T22:22:03.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:03.887+0000 7fb336400640 1 -- 172.21.15.1:0/1811700287 wait complete. 2024-09-15T22:22:03.994 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:03 smithi098 ceph-mon[35514]: Deploying daemon mds.l on smithi098 2024-09-15T22:22:03.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:03 smithi012 ceph-mon[34883]: Deploying daemon mds.l on smithi098 2024-09-15T22:22:04.723 INFO:journalctl@ceph.mds.l.smithi098.stdout:Sep 15 22:22:04 smithi098 podman[65128]: 2024-09-15 22:22:04.620801045 +0000 UTC m=+0.143606850 container create 7f597d21822dde1a02b8ae4b372d33d5d6012ebfd857f696f2a7f4589fcd936b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-l, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-15T22:22:04.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:04 smithi001 ceph-mon[30843]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:04.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:04 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/1811700287' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:22:04.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:04 smithi012 ceph-mon[34883]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:04.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:04 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/1811700287' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:22:05.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:04 smithi098 ceph-mon[35514]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:05.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:04 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/1811700287' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:22:05.061 INFO:journalctl@ceph.mds.l.smithi098.stdout:Sep 15 22:22:04 smithi098 podman[65128]: 2024-09-15 22:22:04.864854355 +0000 UTC m=+0.387660162 container init 7f597d21822dde1a02b8ae4b372d33d5d6012ebfd857f696f2a7f4589fcd936b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-l, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-15T22:22:05.061 INFO:journalctl@ceph.mds.l.smithi098.stdout:Sep 15 22:22:04 smithi098 podman[65128]: 2024-09-15 22:22:04.867784184 +0000 UTC m=+0.390589989 container start 7f597d21822dde1a02b8ae4b372d33d5d6012ebfd857f696f2a7f4589fcd936b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-l, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:22:05.061 INFO:journalctl@ceph.mds.l.smithi098.stdout:Sep 15 22:22:04 smithi098 ceph-mds[65148]: -- 172.21.15.98:0/1912149290 <== mon.1 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ee60217860 con 0x55ee601f5400 2024-09-15T22:22:05.061 INFO:journalctl@ceph.mds.l.smithi098.stdout:Sep 15 22:22:04 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-l[65144]: starting mds.l at 2024-09-15T22:22:05.061 INFO:journalctl@ceph.mds.l.smithi098.stdout:Sep 15 22:22:04 smithi098 bash[65128]: 7f597d21822dde1a02b8ae4b372d33d5d6012ebfd857f696f2a7f4589fcd936b 2024-09-15T22:22:05.061 INFO:journalctl@ceph.mds.l.smithi098.stdout:Sep 15 22:22:04 smithi098 systemd[1]: Started Ceph mds.l for c1228c44-73af-11ef-bceb-c7b262605968. 2024-09-15T22:22:06.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:05 smithi012 ceph-mon[34883]: mds.? [v2:172.21.15.98:6832/94050093,v1:172.21.15.98:6833/94050093] up:boot 2024-09-15T22:22:06.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:05 smithi012 ceph-mon[34883]: fsmap 1 up:standby 2024-09-15T22:22:06.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:05 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T22:22:06.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:05 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:06.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:05 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:06.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:05 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:06.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:05 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:06.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:05 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:06.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:05 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:06.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:05 smithi012 ceph-mon[34883]: Deploying daemon mds.k on smithi012 2024-09-15T22:22:06.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:05 smithi098 ceph-mon[35514]: mds.? [v2:172.21.15.98:6832/94050093,v1:172.21.15.98:6833/94050093] up:boot 2024-09-15T22:22:06.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:05 smithi098 ceph-mon[35514]: fsmap 1 up:standby 2024-09-15T22:22:06.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:05 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T22:22:06.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:05 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:06.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:05 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:06.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:05 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:06.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:05 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:06.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:05 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:06.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:05 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:06.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:05 smithi098 ceph-mon[35514]: Deploying daemon mds.k on smithi012 2024-09-15T22:22:06.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:05 smithi001 ceph-mon[30843]: mds.? [v2:172.21.15.98:6832/94050093,v1:172.21.15.98:6833/94050093] up:boot 2024-09-15T22:22:06.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:05 smithi001 ceph-mon[30843]: fsmap 1 up:standby 2024-09-15T22:22:06.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:05 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T22:22:06.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:05 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:06.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:05 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:06.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:05 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:06.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:05 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:06.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:05 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:06.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:05 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:06.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:05 smithi001 ceph-mon[30843]: Deploying daemon mds.k on smithi012 2024-09-15T22:22:06.655 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:22:07.040 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:22:07.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:07 smithi012 ceph-mon[34883]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:07.246 INFO:journalctl@ceph.mds.k.smithi012.stdout:Sep 15 22:22:07 smithi012 systemd[1]: Starting Ceph mds.k for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:22:07.308 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:07 smithi001 ceph-mon[30843]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:07.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:07 smithi098 ceph-mon[35514]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:07.588 INFO:journalctl@ceph.mds.k.smithi012.stdout:Sep 15 22:22:07 smithi012 podman[64099]: 2024-09-15 22:22:07.192698381 +0000 UTC m=+0.015888900 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:22:07.588 INFO:journalctl@ceph.mds.k.smithi012.stdout:Sep 15 22:22:07 smithi012 podman[64099]: 2024-09-15 22:22:07.292988701 +0000 UTC m=+0.116179203 container create df95c7b72bee5d8c57a8512b63e1acd1ad12b068fecfa138454bb7935b72889e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-k, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-15T22:22:07.589 INFO:journalctl@ceph.mds.k.smithi012.stdout:Sep 15 22:22:07 smithi012 podman[64099]: 2024-09-15 22:22:07.587436658 +0000 UTC m=+0.410627170 container init df95c7b72bee5d8c57a8512b63e1acd1ad12b068fecfa138454bb7935b72889e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-k, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e) 2024-09-15T22:22:07.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.560+0000 7f4c5b000640 1 -- 172.21.15.1:0/2912294531 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c54074590 msgr2=0x7f4c54074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:07.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.560+0000 7f4c5b000640 1 --2- 172.21.15.1:0/2912294531 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c54074590 0x7f4c54074970 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4c44009900 tx=0x7f4c4402a480 comp rx=0 tx=0).stop 2024-09-15T22:22:07.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.560+0000 7f4c5b000640 1 -- 172.21.15.1:0/2912294531 shutdown_connections 2024-09-15T22:22:07.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.560+0000 7f4c5b000640 1 --2- 172.21.15.1:0/2912294531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c54112b90 0x7f4c54114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:07.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.560+0000 7f4c5b000640 1 --2- 172.21.15.1:0/2912294531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c54074eb0 0x7f4c54112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:07.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.560+0000 7f4c5b000640 1 --2- 172.21.15.1:0/2912294531 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c54074590 0x7f4c54074970 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:07.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.560+0000 7f4c5b000640 1 -- 172.21.15.1:0/2912294531 >> 172.21.15.1:0/2912294531 conn(0x7f4c540fd8c0 msgr2=0x7f4c540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:07.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.560+0000 7f4c5b000640 1 -- 172.21.15.1:0/2912294531 shutdown_connections 2024-09-15T22:22:07.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.560+0000 7f4c5b000640 1 -- 172.21.15.1:0/2912294531 wait complete. 2024-09-15T22:22:07.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.561+0000 7f4c5b000640 1 Processor -- start 2024-09-15T22:22:07.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.561+0000 7f4c5b000640 1 -- start start 2024-09-15T22:22:07.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.562+0000 7f4c5b000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c54074590 0x7f4c541a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:07.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.562+0000 7f4c5b000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c54074eb0 0x7f4c541a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:07.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.562+0000 7f4c5b000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c54112b90 0x7f4c5419e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:07.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.562+0000 7f4c5b000640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4c541185a0 con 0x7f4c54074590 2024-09-15T22:22:07.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.562+0000 7f4c5b000640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4c54118420 con 0x7f4c54074eb0 2024-09-15T22:22:07.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.562+0000 7f4c5b000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4c54118720 con 0x7f4c54112b90 2024-09-15T22:22:07.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.562+0000 7f4c53e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c54074590 0x7f4c541a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:07.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.562+0000 7f4c53e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c54074590 0x7f4c541a4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50782/0 (socket says 172.21.15.1:50782) 2024-09-15T22:22:07.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.562+0000 7f4c53e00640 1 -- 172.21.15.1:0/2863461212 learned_addr learned my addr 172.21.15.1:0/2863461212 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:22:07.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.562+0000 7f4c4b400640 1 --2- 172.21.15.1:0/2863461212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c54074eb0 0x7f4c541a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:07.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.562+0000 7f4c59000640 1 --2- 172.21.15.1:0/2863461212 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c54112b90 0x7f4c5419e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:07.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.562+0000 7f4c4b400640 1 -- 172.21.15.1:0/2863461212 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c54112b90 msgr2=0x7f4c5419e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:07.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.562+0000 7f4c4b400640 1 --2- 172.21.15.1:0/2863461212 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c54112b90 0x7f4c5419e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:07.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.562+0000 7f4c4b400640 1 -- 172.21.15.1:0/2863461212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c54074590 msgr2=0x7f4c541a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:07.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.562+0000 7f4c4b400640 1 --2- 172.21.15.1:0/2863461212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c54074590 0x7f4c541a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:07.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.562+0000 7f4c4b400640 1 -- 172.21.15.1:0/2863461212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c5419f000 con 0x7f4c54074eb0 2024-09-15T22:22:07.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.562+0000 7f4c53e00640 1 --2- 172.21.15.1:0/2863461212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c54074590 0x7f4c541a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:22:07.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.563+0000 7f4c4b400640 1 --2- 172.21.15.1:0/2863461212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c54074eb0 0x7f4c541a4c50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c00e9f0 tx=0x7f4c3c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:07.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.563+0000 7f4c51600640 1 -- 172.21.15.1:0/2863461212 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c00ccc0 con 0x7f4c54074eb0 2024-09-15T22:22:07.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.563+0000 7f4c51600640 1 -- 172.21.15.1:0/2863461212 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c3c010910 con 0x7f4c54074eb0 2024-09-15T22:22:07.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.563+0000 7f4c5b000640 1 -- 172.21.15.1:0/2863461212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c5419f2f0 con 0x7f4c54074eb0 2024-09-15T22:22:07.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.563+0000 7f4c51600640 1 -- 172.21.15.1:0/2863461212 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c018960 con 0x7f4c54074eb0 2024-09-15T22:22:07.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.563+0000 7f4c5b000640 1 -- 172.21.15.1:0/2863461212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c541ab5e0 con 0x7f4c54074eb0 2024-09-15T22:22:07.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.564+0000 7f4c5b000640 1 -- 172.21.15.1:0/2863461212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c54074970 con 0x7f4c54074eb0 2024-09-15T22:22:07.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.566+0000 7f4c51600640 1 -- 172.21.15.1:0/2863461212 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f4c3c010ac0 con 0x7f4c54074eb0 2024-09-15T22:22:07.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.567+0000 7f4c51600640 1 --2- 172.21.15.1:0/2863461212 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f4c380a3240 0x7f4c380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:07.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.567+0000 7f4c51600640 1 -- 172.21.15.1:0/2863461212 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f4c3c0cf950 con 0x7f4c54074eb0 2024-09-15T22:22:07.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.568+0000 7f4c53e00640 1 --2- 172.21.15.1:0/2863461212 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f4c380a3240 0x7f4c380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:07.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.568+0000 7f4c53e00640 1 --2- 172.21.15.1:0/2863461212 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f4c380a3240 0x7f4c380a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4c440096c0 tx=0x7f4c440046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:07.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.571+0000 7f4c51600640 1 -- 172.21.15.1:0/2863461212 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4c3c09ca70 con 0x7f4c54074eb0 2024-09-15T22:22:07.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.797+0000 7f4c5b000640 1 -- 172.21.15.1:0/2863461212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c541ab8d0 con 0x7f4c54074eb0 2024-09-15T22:22:07.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.798+0000 7f4c51600640 1 -- 172.21.15.1:0/2863461212 <== mon.2 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1429 (secure 0 0 0) 0x7f4c3c09c370 con 0x7f4c54074eb0 2024-09-15T22:22:07.800 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:22:07.800 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":2,"btime":"2024-09-15T22:22:04:895827+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24466,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/94050093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":94050093},{"type":"v1","addr":"172.21.15.98:6833","nonce":94050093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-15T22:22:07.800 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 2 2024-09-15T22:22:07.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.800+0000 7f4c5b000640 1 -- 172.21.15.1:0/2863461212 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f4c380a3240 msgr2=0x7f4c380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:07.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.800+0000 7f4c5b000640 1 --2- 172.21.15.1:0/2863461212 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f4c380a3240 0x7f4c380a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4c440096c0 tx=0x7f4c440046c0 comp rx=0 tx=0).stop 2024-09-15T22:22:07.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.800+0000 7f4c5b000640 1 -- 172.21.15.1:0/2863461212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c54074eb0 msgr2=0x7f4c541a4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:07.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.800+0000 7f4c5b000640 1 --2- 172.21.15.1:0/2863461212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c54074eb0 0x7f4c541a4c50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c00e9f0 tx=0x7f4c3c00eeb0 comp rx=0 tx=0).stop 2024-09-15T22:22:07.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.800+0000 7f4c5b000640 1 -- 172.21.15.1:0/2863461212 shutdown_connections 2024-09-15T22:22:07.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.800+0000 7f4c5b000640 1 --2- 172.21.15.1:0/2863461212 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f4c380a3240 0x7f4c380a5700 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:07.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.800+0000 7f4c5b000640 1 --2- 172.21.15.1:0/2863461212 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c54112b90 0x7f4c5419e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:07.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.800+0000 7f4c5b000640 1 --2- 172.21.15.1:0/2863461212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c54074eb0 0x7f4c541a4c50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:07.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.800+0000 7f4c5b000640 1 --2- 172.21.15.1:0/2863461212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c54074590 0x7f4c541a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:07.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.800+0000 7f4c5b000640 1 -- 172.21.15.1:0/2863461212 >> 172.21.15.1:0/2863461212 conn(0x7f4c540fd8c0 msgr2=0x7f4c540ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:07.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.801+0000 7f4c5b000640 1 -- 172.21.15.1:0/2863461212 shutdown_connections 2024-09-15T22:22:07.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:07.801+0000 7f4c5b000640 1 -- 172.21.15.1:0/2863461212 wait complete. 2024-09-15T22:22:07.996 INFO:journalctl@ceph.mds.k.smithi012.stdout:Sep 15 22:22:07 smithi012 podman[64099]: 2024-09-15 22:22:07.590546063 +0000 UTC m=+0.413736568 container start df95c7b72bee5d8c57a8512b63e1acd1ad12b068fecfa138454bb7935b72889e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-k, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:22:07.996 INFO:journalctl@ceph.mds.k.smithi012.stdout:Sep 15 22:22:07 smithi012 ceph-mds[64118]: -- 172.21.15.12:0/4291667770 <== mon.2 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dcdd419c20 con 0x55dcdd3f7400 2024-09-15T22:22:07.996 INFO:journalctl@ceph.mds.k.smithi012.stdout:Sep 15 22:22:07 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-k[64114]: starting mds.k at 2024-09-15T22:22:07.996 INFO:journalctl@ceph.mds.k.smithi012.stdout:Sep 15 22:22:07 smithi012 bash[64099]: df95c7b72bee5d8c57a8512b63e1acd1ad12b068fecfa138454bb7935b72889e 2024-09-15T22:22:07.996 INFO:journalctl@ceph.mds.k.smithi012.stdout:Sep 15 22:22:07 smithi012 systemd[1]: Started Ceph mds.k for c1228c44-73af-11ef-bceb-c7b262605968. 2024-09-15T22:22:08.808 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:08 smithi001 ceph-mon[30843]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:08.809 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:08 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:08.809 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:08 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:08.809 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:08 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:08.809 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:08 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:08.809 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:08 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:08.809 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:08 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:08.809 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:08 smithi001 ceph-mon[30843]: Deploying daemon mds.j on smithi001 2024-09-15T22:22:08.809 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:08 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/2863461212' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:22:08.809 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:08 smithi001 ceph-mon[30843]: mds.? [v2:172.21.15.12:6832/3122570659,v1:172.21.15.12:6833/3122570659] up:boot 2024-09-15T22:22:08.809 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:08 smithi001 ceph-mon[30843]: fsmap 2 up:standby 2024-09-15T22:22:08.809 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:08 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T22:22:09.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:08 smithi098 ceph-mon[35514]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:09.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:08 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:09.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:08 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:09.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:08 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:09.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:08 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:09.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:08 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:09.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:08 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:09.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:08 smithi098 ceph-mon[35514]: Deploying daemon mds.j on smithi001 2024-09-15T22:22:09.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:08 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/2863461212' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:22:09.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:08 smithi098 ceph-mon[35514]: mds.? [v2:172.21.15.12:6832/3122570659,v1:172.21.15.12:6833/3122570659] up:boot 2024-09-15T22:22:09.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:08 smithi098 ceph-mon[35514]: fsmap 2 up:standby 2024-09-15T22:22:09.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:08 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T22:22:09.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:08 smithi012 ceph-mon[34883]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:09.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:08 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:09.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:08 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:09.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:08 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:09.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:08 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:09.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:08 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:09.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:08 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:09.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:08 smithi012 ceph-mon[34883]: Deploying daemon mds.j on smithi001 2024-09-15T22:22:09.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:08 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/2863461212' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:22:09.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:08 smithi012 ceph-mon[34883]: mds.? [v2:172.21.15.12:6832/3122570659,v1:172.21.15.12:6833/3122570659] up:boot 2024-09-15T22:22:09.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:08 smithi012 ceph-mon[34883]: fsmap 2 up:standby 2024-09-15T22:22:09.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:08 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T22:22:10.584 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:22:10.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:10 smithi001 ceph-mon[30843]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:11.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:10 smithi098 ceph-mon[35514]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:11.239 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 15 22:22:10 smithi001 podman[67916]: 2024-09-15 22:22:10.970685493 +0000 UTC m=+0.151829620 container create 39779d0cb834b98540236762f0eb4a18184b0d5d73b7fa758fad5d212b8e6f50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-j, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e) 2024-09-15T22:22:11.239 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 15 22:22:11 smithi001 podman[67916]: 2024-09-15 22:22:11.237600989 +0000 UTC m=+0.418745077 container init 39779d0cb834b98540236762f0eb4a18184b0d5d73b7fa758fad5d212b8e6f50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-j, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:22:11.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:10 smithi012 ceph-mon[34883]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:11.502 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:22:11.626 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 15 22:22:11 smithi001 podman[67916]: 2024-09-15 22:22:11.244380268 +0000 UTC m=+0.425524355 container start 39779d0cb834b98540236762f0eb4a18184b0d5d73b7fa758fad5d212b8e6f50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-j, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e) 2024-09-15T22:22:11.626 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 15 22:22:11 smithi001 ceph-mds[67957]: -- 172.21.15.1:0/20716549 <== mon.0 v2:172.21.15.1:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562de933fc20 con 0x562de931d400 2024-09-15T22:22:11.626 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 15 22:22:11 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-j[67944]: starting mds.j at 2024-09-15T22:22:11.626 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 15 22:22:11 smithi001 bash[67916]: 39779d0cb834b98540236762f0eb4a18184b0d5d73b7fa758fad5d212b8e6f50 2024-09-15T22:22:11.626 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 15 22:22:11 smithi001 systemd[1]: Started Ceph mds.j for c1228c44-73af-11ef-bceb-c7b262605968. 2024-09-15T22:22:12.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.043+0000 7feb64a00640 1 -- 172.21.15.1:0/3789771286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb60077040 msgr2=0x7feb60112330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:12.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.043+0000 7feb64a00640 1 --2- 172.21.15.1:0/3789771286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb60077040 0x7feb60112330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feb4c009900 tx=0x7feb4c02a410 comp rx=0 tx=0).stop 2024-09-15T22:22:12.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.043+0000 7feb64a00640 1 -- 172.21.15.1:0/3789771286 shutdown_connections 2024-09-15T22:22:12.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.043+0000 7feb64a00640 1 --2- 172.21.15.1:0/3789771286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb60112870 0x7feb60114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:12.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.043+0000 7feb64a00640 1 --2- 172.21.15.1:0/3789771286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb60077040 0x7feb60112330 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:12.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.043+0000 7feb64a00640 1 --2- 172.21.15.1:0/3789771286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb60076720 0x7feb60076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:12.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.043+0000 7feb64a00640 1 -- 172.21.15.1:0/3789771286 >> 172.21.15.1:0/3789771286 conn(0x7feb600ff8d0 msgr2=0x7feb60101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:12.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.043+0000 7feb64a00640 1 -- 172.21.15.1:0/3789771286 shutdown_connections 2024-09-15T22:22:12.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.043+0000 7feb64a00640 1 -- 172.21.15.1:0/3789771286 wait complete. 2024-09-15T22:22:12.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.044+0000 7feb64a00640 1 Processor -- start 2024-09-15T22:22:12.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.044+0000 7feb64a00640 1 -- start start 2024-09-15T22:22:12.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.045+0000 7feb64a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb60076720 0x7feb601a4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:12.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.045+0000 7feb64a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb60077040 0x7feb601a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:12.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.045+0000 7feb64a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb60112870 0x7feb6019e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:12.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.045+0000 7feb64a00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7feb601183e0 con 0x7feb60076720 2024-09-15T22:22:12.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.045+0000 7feb64a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7feb60118260 con 0x7feb60112870 2024-09-15T22:22:12.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.045+0000 7feb64a00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7feb60118560 con 0x7feb60077040 2024-09-15T22:22:12.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.045+0000 7feb5f400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb60076720 0x7feb601a4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:12.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.045+0000 7feb5f400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb60076720 0x7feb601a4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50820/0 (socket says 172.21.15.1:50820) 2024-09-15T22:22:12.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.045+0000 7feb5f400640 1 -- 172.21.15.1:0/674907226 learned_addr learned my addr 172.21.15.1:0/674907226 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:22:12.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.045+0000 7feb5ea00640 1 --2- 172.21.15.1:0/674907226 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb60077040 0x7feb601a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:12.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.045+0000 7feb5fe00640 1 --2- 172.21.15.1:0/674907226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb60112870 0x7feb6019e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:12.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.046+0000 7feb5ea00640 1 -- 172.21.15.1:0/674907226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb60112870 msgr2=0x7feb6019e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:12.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.046+0000 7feb5ea00640 1 --2- 172.21.15.1:0/674907226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb60112870 0x7feb6019e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:12.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.046+0000 7feb5ea00640 1 -- 172.21.15.1:0/674907226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb60076720 msgr2=0x7feb601a4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:12.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.046+0000 7feb5ea00640 1 --2- 172.21.15.1:0/674907226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb60076720 0x7feb601a4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:12.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.046+0000 7feb5ea00640 1 -- 172.21.15.1:0/674907226 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb6019efa0 con 0x7feb60077040 2024-09-15T22:22:12.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.046+0000 7feb5f400640 1 --2- 172.21.15.1:0/674907226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb60076720 0x7feb601a4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:22:12.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.046+0000 7feb5fe00640 1 --2- 172.21.15.1:0/674907226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb60112870 0x7feb6019e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:22:12.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.046+0000 7feb5ea00640 1 --2- 172.21.15.1:0/674907226 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb60077040 0x7feb601a4ba0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feb4c005940 tx=0x7feb4c0040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:12.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.046+0000 7feb57e00640 1 -- 172.21.15.1:0/674907226 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4c03f030 con 0x7feb60077040 2024-09-15T22:22:12.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.046+0000 7feb64a00640 1 -- 172.21.15.1:0/674907226 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb6019f230 con 0x7feb60077040 2024-09-15T22:22:12.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.047+0000 7feb57e00640 1 -- 172.21.15.1:0/674907226 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb4c0044c0 con 0x7feb60077040 2024-09-15T22:22:12.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.047+0000 7feb57e00640 1 -- 172.21.15.1:0/674907226 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4c035070 con 0x7feb60077040 2024-09-15T22:22:12.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.047+0000 7feb64a00640 1 -- 172.21.15.1:0/674907226 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb601ab410 con 0x7feb60077040 2024-09-15T22:22:12.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.048+0000 7feb64a00640 1 -- 172.21.15.1:0/674907226 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb60077e60 con 0x7feb60077040 2024-09-15T22:22:12.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.049+0000 7feb57e00640 1 -- 172.21.15.1:0/674907226 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7feb4c042030 con 0x7feb60077040 2024-09-15T22:22:12.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.052+0000 7feb57e00640 1 --2- 172.21.15.1:0/674907226 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7feb440a3240 0x7feb440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:12.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.052+0000 7feb57e00640 1 -- 172.21.15.1:0/674907226 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7feb4c0ef7d0 con 0x7feb60077040 2024-09-15T22:22:12.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.052+0000 7feb5f400640 1 --2- 172.21.15.1:0/674907226 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7feb440a3240 0x7feb440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:12.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.053+0000 7feb5f400640 1 --2- 172.21.15.1:0/674907226 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7feb440a3240 0x7feb440a5700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7feb50011550 tx=0x7feb50005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:12.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.055+0000 7feb57e00640 1 -- 172.21.15.1:0/674907226 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feb4c0bc2a0 con 0x7feb60077040 2024-09-15T22:22:12.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.295+0000 7feb64a00640 1 -- 172.21.15.1:0/674907226 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb6010da00 con 0x7feb60077040 2024-09-15T22:22:12.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.295+0000 7feb57e00640 1 -- 172.21.15.1:0/674907226 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3076 (secure 0 0 0) 0x7feb4c0c05a0 con 0x7feb60077040 2024-09-15T22:22:12.298 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:22:12.298 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":4,"btime":"2024-09-15T22:22:11:748108+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2417768032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2417768032},{"type":"v1","addr":"172.21.15.1:6835","nonce":2417768032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3122570659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3122570659},{"type":"v1","addr":"172.21.15.12:6833","nonce":3122570659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24466,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/94050093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":94050093},{"type":"v1","addr":"172.21.15.98:6833","nonce":94050093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-15T22:22:12.298 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 4 2024-09-15T22:22:12.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.297+0000 7feb64a00640 1 -- 172.21.15.1:0/674907226 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7feb440a3240 msgr2=0x7feb440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:12.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.297+0000 7feb64a00640 1 --2- 172.21.15.1:0/674907226 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7feb440a3240 0x7feb440a5700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7feb50011550 tx=0x7feb50005f90 comp rx=0 tx=0).stop 2024-09-15T22:22:12.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.298+0000 7feb64a00640 1 -- 172.21.15.1:0/674907226 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb60077040 msgr2=0x7feb601a4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:12.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.298+0000 7feb64a00640 1 --2- 172.21.15.1:0/674907226 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb60077040 0x7feb601a4ba0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feb4c005940 tx=0x7feb4c0040c0 comp rx=0 tx=0).stop 2024-09-15T22:22:12.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.298+0000 7feb64a00640 1 -- 172.21.15.1:0/674907226 shutdown_connections 2024-09-15T22:22:12.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.298+0000 7feb64a00640 1 --2- 172.21.15.1:0/674907226 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7feb440a3240 0x7feb440a5700 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:12.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.298+0000 7feb64a00640 1 --2- 172.21.15.1:0/674907226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb60112870 0x7feb6019e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:12.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.298+0000 7feb64a00640 1 --2- 172.21.15.1:0/674907226 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb60077040 0x7feb601a4ba0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:12.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.298+0000 7feb64a00640 1 --2- 172.21.15.1:0/674907226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb60076720 0x7feb601a4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:12.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.298+0000 7feb64a00640 1 -- 172.21.15.1:0/674907226 >> 172.21.15.1:0/674907226 conn(0x7feb600ff8d0 msgr2=0x7feb60101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:12.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.298+0000 7feb64a00640 1 -- 172.21.15.1:0/674907226 shutdown_connections 2024-09-15T22:22:12.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:12.298+0000 7feb64a00640 1 -- 172.21.15.1:0/674907226 wait complete. 2024-09-15T22:22:12.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:12 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:12.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:12 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:12.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:12 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:12.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:12 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:12.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:12 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:12.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:12 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:12.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:12 smithi001 ceph-mon[30843]: Deploying daemon mds.d on smithi001 2024-09-15T22:22:12.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:12 smithi001 ceph-mon[30843]: mds.? [v2:172.21.15.1:6834/2417768032,v1:172.21.15.1:6835/2417768032] up:boot 2024-09-15T22:22:12.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:12 smithi001 ceph-mon[30843]: fsmap 3 up:standby 2024-09-15T22:22:12.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:12 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-15T22:22:12.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:12 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/674907226' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:22:12.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:12 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:12.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:12 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:12.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:12 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:12.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:12 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:12.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:12 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:12.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:12 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:12.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:12 smithi012 ceph-mon[34883]: Deploying daemon mds.d on smithi001 2024-09-15T22:22:12.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:12 smithi012 ceph-mon[34883]: mds.? [v2:172.21.15.1:6834/2417768032,v1:172.21.15.1:6835/2417768032] up:boot 2024-09-15T22:22:12.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:12 smithi012 ceph-mon[34883]: fsmap 3 up:standby 2024-09-15T22:22:12.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:12 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-15T22:22:12.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:12 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/674907226' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:22:12.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:12 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:12.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:12 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:12.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:12 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:12.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:12 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:12.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:12 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:12.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:12 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:12.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:12 smithi098 ceph-mon[35514]: Deploying daemon mds.d on smithi001 2024-09-15T22:22:12.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:12 smithi098 ceph-mon[35514]: mds.? [v2:172.21.15.1:6834/2417768032,v1:172.21.15.1:6835/2417768032] up:boot 2024-09-15T22:22:12.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:12 smithi098 ceph-mon[35514]: fsmap 3 up:standby 2024-09-15T22:22:12.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:12 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-15T22:22:12.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:12 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/674907226' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:22:13.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:13 smithi012 ceph-mon[34883]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:13.764 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:13 smithi001 ceph-mon[30843]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:13.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:13 smithi098 ceph-mon[35514]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:15.377 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 15 22:22:15 smithi001 podman[68310]: 2024-09-15 22:22:15.119682027 +0000 UTC m=+0.151568221 container create 7fb50fc7f87a8726100d277426e690fd0593f580d2f4fa0674dfcbbce1f783d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-d, RELEASE=squid-8921c8e, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:22:15.539 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:22:15.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:15 smithi012 ceph-mon[34883]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:15.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:15 smithi098 ceph-mon[35514]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:15.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:15 smithi001 ceph-mon[30843]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:15.876 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 15 22:22:15 smithi001 podman[68310]: 2024-09-15 22:22:15.402030702 +0000 UTC m=+0.433916895 container init 7fb50fc7f87a8726100d277426e690fd0593f580d2f4fa0674dfcbbce1f783d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-d, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-15T22:22:15.876 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 15 22:22:15 smithi001 podman[68310]: 2024-09-15 22:22:15.408866749 +0000 UTC m=+0.440752944 container start 7fb50fc7f87a8726100d277426e690fd0593f580d2f4fa0674dfcbbce1f783d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-d, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-15T22:22:15.876 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 15 22:22:15 smithi001 ceph-mds[68336]: -- 172.21.15.1:0/4003102884 <== mon.2 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f4688d5860 con 0x55f4688b2800 2024-09-15T22:22:15.876 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 15 22:22:15 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-d[68330]: starting mds.d at 2024-09-15T22:22:15.876 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 15 22:22:15 smithi001 bash[68310]: 7fb50fc7f87a8726100d277426e690fd0593f580d2f4fa0674dfcbbce1f783d9 2024-09-15T22:22:15.877 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 15 22:22:15 smithi001 systemd[1]: Started Ceph mds.d for c1228c44-73af-11ef-bceb-c7b262605968. 2024-09-15T22:22:15.929 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:22:16.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.520+0000 7f79ef600640 1 -- 172.21.15.1:0/3005648640 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79e810e450 msgr2=0x7f79e8110840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:16.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.520+0000 7f79ef600640 1 --2- 172.21.15.1:0/3005648640 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79e810e450 0x7f79e8110840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f79e0009ca0 tx=0x7f79e002a950 comp rx=0 tx=0).stop 2024-09-15T22:22:16.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.520+0000 7f79ef600640 1 -- 172.21.15.1:0/3005648640 shutdown_connections 2024-09-15T22:22:16.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.520+0000 7f79ef600640 1 --2- 172.21.15.1:0/3005648640 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79e810e450 0x7f79e8110840 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.520+0000 7f79ef600640 1 --2- 172.21.15.1:0/3005648640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79e8074e30 0x7f79e810df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.520+0000 7f79ef600640 1 --2- 172.21.15.1:0/3005648640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79e8074510 0x7f79e80748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.520+0000 7f79ef600640 1 -- 172.21.15.1:0/3005648640 >> 172.21.15.1:0/3005648640 conn(0x7f79e80fd8b0 msgr2=0x7f79e80ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:16.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.520+0000 7f79ef600640 1 -- 172.21.15.1:0/3005648640 shutdown_connections 2024-09-15T22:22:16.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.520+0000 7f79ef600640 1 -- 172.21.15.1:0/3005648640 wait complete. 2024-09-15T22:22:16.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.521+0000 7f79ef600640 1 Processor -- start 2024-09-15T22:22:16.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.521+0000 7f79ef600640 1 -- start start 2024-09-15T22:22:16.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.522+0000 7f79ef600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79e8074510 0x7f79e819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:16.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.522+0000 7f79ef600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79e8074e30 0x7f79e819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:16.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.522+0000 7f79ef600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79e810e450 0x7f79e819eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:16.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.522+0000 7f79ef600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f79e81141b0 con 0x7f79e8074510 2024-09-15T22:22:16.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.522+0000 7f79ef600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f79e8114030 con 0x7f79e810e450 2024-09-15T22:22:16.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.522+0000 7f79ef600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f79e8114330 con 0x7f79e8074e30 2024-09-15T22:22:16.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.522+0000 7f79ecc00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79e8074510 0x7f79e819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:16.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.522+0000 7f79ecc00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79e8074510 0x7f79e819a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50848/0 (socket says 172.21.15.1:50848) 2024-09-15T22:22:16.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.522+0000 7f79ed600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79e810e450 0x7f79e819eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:16.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.522+0000 7f79ecc00640 1 -- 172.21.15.1:0/3377852150 learned_addr learned my addr 172.21.15.1:0/3377852150 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:22:16.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.522+0000 7f79e7e00640 1 --2- 172.21.15.1:0/3377852150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79e8074e30 0x7f79e819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:16.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.522+0000 7f79ed600640 1 -- 172.21.15.1:0/3377852150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79e8074e30 msgr2=0x7f79e819ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:16.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.522+0000 7f79ed600640 1 --2- 172.21.15.1:0/3377852150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79e8074e30 0x7f79e819ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.522+0000 7f79ed600640 1 -- 172.21.15.1:0/3377852150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79e8074510 msgr2=0x7f79e819a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:16.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.522+0000 7f79ed600640 1 --2- 172.21.15.1:0/3377852150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79e8074510 0x7f79e819a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.522+0000 7f79ed600640 1 -- 172.21.15.1:0/3377852150 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e819f5b0 con 0x7f79e810e450 2024-09-15T22:22:16.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.523+0000 7f79ed600640 1 --2- 172.21.15.1:0/3377852150 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79e810e450 0x7f79e819eed0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f79e002af40 tx=0x7f79e0003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:16.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.523+0000 7f79e5600640 1 -- 172.21.15.1:0/3377852150 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e0034040 con 0x7f79e810e450 2024-09-15T22:22:16.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.523+0000 7f79ef600640 1 -- 172.21.15.1:0/3377852150 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79e819f840 con 0x7f79e810e450 2024-09-15T22:22:16.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.523+0000 7f79e5600640 1 -- 172.21.15.1:0/3377852150 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79e002fe20 con 0x7f79e810e450 2024-09-15T22:22:16.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.523+0000 7f79e5600640 1 -- 172.21.15.1:0/3377852150 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e0004640 con 0x7f79e810e450 2024-09-15T22:22:16.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.523+0000 7f79ef600640 1 -- 172.21.15.1:0/3377852150 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79e81a7180 con 0x7f79e810e450 2024-09-15T22:22:16.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.524+0000 7f79ef600640 1 -- 172.21.15.1:0/3377852150 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79e80748f0 con 0x7f79e810e450 2024-09-15T22:22:16.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.526+0000 7f79e5600640 1 -- 172.21.15.1:0/3377852150 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f79e0037020 con 0x7f79e810e450 2024-09-15T22:22:16.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.527+0000 7f79e5600640 1 --2- 172.21.15.1:0/3377852150 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f79d00a32c0 0x7f79d00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:16.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.528+0000 7f79e5600640 1 -- 172.21.15.1:0/3377852150 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f79e00f0500 con 0x7f79e810e450 2024-09-15T22:22:16.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.528+0000 7f79ecc00640 1 --2- 172.21.15.1:0/3377852150 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f79d00a32c0 0x7f79d00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:16.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.528+0000 7f79ecc00640 1 --2- 172.21.15.1:0/3377852150 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f79d00a32c0 0x7f79d00a5780 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f79dc005fd0 tx=0x7f79dc00b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:16.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.530+0000 7f79e5600640 1 -- 172.21.15.1:0/3377852150 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f79e00bd620 con 0x7f79e810e450 2024-09-15T22:22:16.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.752+0000 7f79ef600640 1 -- 172.21.15.1:0/3377852150 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79e81a7350 con 0x7f79e810e450 2024-09-15T22:22:16.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.753+0000 7f79e5600640 1 -- 172.21.15.1:0/3377852150 <== mon.2 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3898 (secure 0 0 0) 0x7f79e00bcf20 con 0x7f79e810e450 2024-09-15T22:22:16.755 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:22:16.755 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":5,"btime":"2024-09-15T22:22:16:441045+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2417768032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2417768032},{"type":"v1","addr":"172.21.15.1:6835","nonce":2417768032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14493,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2957993064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2957993064},{"type":"v1","addr":"172.21.15.1:6837","nonce":2957993064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3122570659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3122570659},{"type":"v1","addr":"172.21.15.12:6833","nonce":3122570659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24466,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/94050093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":94050093},{"type":"v1","addr":"172.21.15.98:6833","nonce":94050093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-15T22:22:16.755 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 5 2024-09-15T22:22:16.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.755+0000 7f79ef600640 1 -- 172.21.15.1:0/3377852150 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f79d00a32c0 msgr2=0x7f79d00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:16.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.755+0000 7f79ef600640 1 --2- 172.21.15.1:0/3377852150 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f79d00a32c0 0x7f79d00a5780 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f79dc005fd0 tx=0x7f79dc00b480 comp rx=0 tx=0).stop 2024-09-15T22:22:16.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.755+0000 7f79ef600640 1 -- 172.21.15.1:0/3377852150 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79e810e450 msgr2=0x7f79e819eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:16.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.755+0000 7f79ef600640 1 --2- 172.21.15.1:0/3377852150 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79e810e450 0x7f79e819eed0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f79e002af40 tx=0x7f79e0003c10 comp rx=0 tx=0).stop 2024-09-15T22:22:16.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.755+0000 7f79ef600640 1 -- 172.21.15.1:0/3377852150 shutdown_connections 2024-09-15T22:22:16.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.755+0000 7f79ef600640 1 --2- 172.21.15.1:0/3377852150 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f79d00a32c0 0x7f79d00a5780 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.755+0000 7f79ef600640 1 --2- 172.21.15.1:0/3377852150 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79e810e450 0x7f79e819eed0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.755+0000 7f79ef600640 1 --2- 172.21.15.1:0/3377852150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79e8074e30 0x7f79e819ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.755+0000 7f79ef600640 1 --2- 172.21.15.1:0/3377852150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79e8074510 0x7f79e819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.755+0000 7f79ef600640 1 -- 172.21.15.1:0/3377852150 >> 172.21.15.1:0/3377852150 conn(0x7f79e80fd8b0 msgr2=0x7f79e80fe4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:16.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.755+0000 7f79ef600640 1 -- 172.21.15.1:0/3377852150 shutdown_connections 2024-09-15T22:22:16.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:16.755+0000 7f79ef600640 1 -- 172.21.15.1:0/3377852150 wait complete. 2024-09-15T22:22:16.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:16 smithi001 ceph-mon[30843]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:16.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:16 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:16.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:16 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:16.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:16 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:16.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:16 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:16.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:16 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:16.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:16 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:16.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:16 smithi001 ceph-mon[30843]: Deploying daemon mds.e on smithi012 2024-09-15T22:22:16.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:16 smithi001 ceph-mon[30843]: mds.? [v2:172.21.15.1:6836/2957993064,v1:172.21.15.1:6837/2957993064] up:boot 2024-09-15T22:22:16.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:16 smithi001 ceph-mon[30843]: fsmap 4 up:standby 2024-09-15T22:22:16.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:16 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-15T22:22:16.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:16 smithi012 ceph-mon[34883]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:16.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:16 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:16.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:16 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:16.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:16 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:16.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:16 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:16.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:16 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:16.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:16 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:16.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:16 smithi012 ceph-mon[34883]: Deploying daemon mds.e on smithi012 2024-09-15T22:22:16.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:16 smithi012 ceph-mon[34883]: mds.? [v2:172.21.15.1:6836/2957993064,v1:172.21.15.1:6837/2957993064] up:boot 2024-09-15T22:22:16.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:16 smithi012 ceph-mon[34883]: fsmap 4 up:standby 2024-09-15T22:22:16.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:16 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-15T22:22:17.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:16 smithi098 ceph-mon[35514]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:17.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:16 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:17.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:16 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:17.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:16 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:17.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:16 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:17.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:16 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:17.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:16 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:17.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:16 smithi098 ceph-mon[35514]: Deploying daemon mds.e on smithi012 2024-09-15T22:22:17.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:16 smithi098 ceph-mon[35514]: mds.? [v2:172.21.15.1:6836/2957993064,v1:172.21.15.1:6837/2957993064] up:boot 2024-09-15T22:22:17.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:16 smithi098 ceph-mon[35514]: fsmap 4 up:standby 2024-09-15T22:22:17.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:16 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-15T22:22:17.788 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:17 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/3377852150' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:22:17.788 INFO:journalctl@ceph.mds.e.smithi012.stdout:Sep 15 22:22:17 smithi012 systemd[1]: Starting Ceph mds.e for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:22:17.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:17 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/3377852150' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:22:17.962 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:17 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/3377852150' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:22:18.127 INFO:journalctl@ceph.mds.e.smithi012.stdout:Sep 15 22:22:17 smithi012 podman[64397]: 2024-09-15 22:22:17.898662096 +0000 UTC m=+0.015859336 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:22:18.127 INFO:journalctl@ceph.mds.e.smithi012.stdout:Sep 15 22:22:18 smithi012 podman[64397]: 2024-09-15 22:22:18.011789633 +0000 UTC m=+0.128986903 container create 9e02fdcc515d1f5ec27f96a7cad0d76ad6213c35c3bd20f193e5b2cac185ad3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-e, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-15T22:22:18.495 INFO:journalctl@ceph.mds.e.smithi012.stdout:Sep 15 22:22:18 smithi012 podman[64397]: 2024-09-15 22:22:18.231149342 +0000 UTC m=+0.348346571 container init 9e02fdcc515d1f5ec27f96a7cad0d76ad6213c35c3bd20f193e5b2cac185ad3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-e, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:22:18.496 INFO:journalctl@ceph.mds.e.smithi012.stdout:Sep 15 22:22:18 smithi012 podman[64397]: 2024-09-15 22:22:18.233830865 +0000 UTC m=+0.351028105 container start 9e02fdcc515d1f5ec27f96a7cad0d76ad6213c35c3bd20f193e5b2cac185ad3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-e, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:22:18.496 INFO:journalctl@ceph.mds.e.smithi012.stdout:Sep 15 22:22:18 smithi012 ceph-mds[64416]: -- 172.21.15.12:0/1426311927 <== mon.2 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e19c891860 con 0x55e19c86e800 2024-09-15T22:22:18.496 INFO:journalctl@ceph.mds.e.smithi012.stdout:Sep 15 22:22:18 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-e[64412]: starting mds.e at 2024-09-15T22:22:18.496 INFO:journalctl@ceph.mds.e.smithi012.stdout:Sep 15 22:22:18 smithi012 bash[64397]: 9e02fdcc515d1f5ec27f96a7cad0d76ad6213c35c3bd20f193e5b2cac185ad3d 2024-09-15T22:22:18.496 INFO:journalctl@ceph.mds.e.smithi012.stdout:Sep 15 22:22:18 smithi012 systemd[1]: Started Ceph mds.e for c1228c44-73af-11ef-bceb-c7b262605968. 2024-09-15T22:22:19.500 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:22:19.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:19 smithi001 ceph-mon[30843]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:19.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:19 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:19.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:19 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:19.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:19 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:19.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:19 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:19.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:19 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:19.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:19 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:19.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:19 smithi001 ceph-mon[30843]: Deploying daemon mds.f on smithi098 2024-09-15T22:22:19.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:19 smithi001 ceph-mon[30843]: mds.? [v2:172.21.15.12:6834/2901262900,v1:172.21.15.12:6835/2901262900] up:boot 2024-09-15T22:22:19.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:19 smithi001 ceph-mon[30843]: fsmap 5 up:standby 2024-09-15T22:22:19.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:19 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T22:22:19.631 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:19 smithi098 ceph-mon[35514]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:19.631 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:19 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:19.631 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:19 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:19.631 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:19 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:19.631 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:19 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:19.631 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:19 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:19.631 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:19 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:19.631 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:19 smithi098 ceph-mon[35514]: Deploying daemon mds.f on smithi098 2024-09-15T22:22:19.631 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:19 smithi098 ceph-mon[35514]: mds.? [v2:172.21.15.12:6834/2901262900,v1:172.21.15.12:6835/2901262900] up:boot 2024-09-15T22:22:19.631 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:19 smithi098 ceph-mon[35514]: fsmap 5 up:standby 2024-09-15T22:22:19.631 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:19 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T22:22:19.635 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:19 smithi012 ceph-mon[34883]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:19.635 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:19 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:19.635 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:19 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:19.635 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:19 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:19.635 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:19 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:19.635 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:19 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:19.635 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:19 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:19.635 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:19 smithi012 ceph-mon[34883]: Deploying daemon mds.f on smithi098 2024-09-15T22:22:19.636 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:19 smithi012 ceph-mon[34883]: mds.? [v2:172.21.15.12:6834/2901262900,v1:172.21.15.12:6835/2901262900] up:boot 2024-09-15T22:22:19.636 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:19 smithi012 ceph-mon[34883]: fsmap 5 up:standby 2024-09-15T22:22:19.636 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:19 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T22:22:19.887 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:22:20.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.415+0000 7f1a36c00640 1 -- 172.21.15.1:0/175967942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a30077040 msgr2=0x7f1a30112330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:20.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.415+0000 7f1a36c00640 1 --2- 172.21.15.1:0/175967942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a30077040 0x7f1a30112330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009860 tx=0x7f1a1c02a340 comp rx=0 tx=0).stop 2024-09-15T22:22:20.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.416+0000 7f1a36c00640 1 -- 172.21.15.1:0/175967942 shutdown_connections 2024-09-15T22:22:20.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.416+0000 7f1a36c00640 1 --2- 172.21.15.1:0/175967942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a30112870 0x7f1a30114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:20.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.416+0000 7f1a36c00640 1 --2- 172.21.15.1:0/175967942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a30077040 0x7f1a30112330 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:20.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.416+0000 7f1a36c00640 1 --2- 172.21.15.1:0/175967942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a30076720 0x7f1a30076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:20.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.416+0000 7f1a36c00640 1 -- 172.21.15.1:0/175967942 >> 172.21.15.1:0/175967942 conn(0x7f1a300ff8d0 msgr2=0x7f1a30101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:20.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.416+0000 7f1a36c00640 1 -- 172.21.15.1:0/175967942 shutdown_connections 2024-09-15T22:22:20.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.416+0000 7f1a36c00640 1 -- 172.21.15.1:0/175967942 wait complete. 2024-09-15T22:22:20.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.417+0000 7f1a36c00640 1 Processor -- start 2024-09-15T22:22:20.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.417+0000 7f1a36c00640 1 -- start start 2024-09-15T22:22:20.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.417+0000 7f1a36c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a30076720 0x7f1a301a4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:20.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.417+0000 7f1a36c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a30077040 0x7f1a301a4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:20.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.417+0000 7f1a36c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a30112870 0x7f1a3019e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:20.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.417+0000 7f1a36c00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1a30118400 con 0x7f1a30112870 2024-09-15T22:22:20.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.417+0000 7f1a36c00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1a30118280 con 0x7f1a30077040 2024-09-15T22:22:20.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.417+0000 7f1a36c00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1a30118580 con 0x7f1a30076720 2024-09-15T22:22:20.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.417+0000 7f1a34e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a30077040 0x7f1a301a4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:20.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.417+0000 7f1a35800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a30076720 0x7f1a301a4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:20.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.418+0000 7f1a34e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a30077040 0x7f1a301a4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:43288/0 (socket says 172.21.15.1:43288) 2024-09-15T22:22:20.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.418+0000 7f1a35800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a30076720 0x7f1a301a4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:48504/0 (socket says 172.21.15.1:48504) 2024-09-15T22:22:20.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.418+0000 7f1a34e00640 1 -- 172.21.15.1:0/2527216931 learned_addr learned my addr 172.21.15.1:0/2527216931 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:22:20.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.418+0000 7f1a36200640 1 --2- 172.21.15.1:0/2527216931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a30112870 0x7f1a3019e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:20.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.418+0000 7f1a35800640 1 -- 172.21.15.1:0/2527216931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a30077040 msgr2=0x7f1a301a4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:20.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.418+0000 7f1a35800640 1 --2- 172.21.15.1:0/2527216931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a30077040 0x7f1a301a4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:20.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.418+0000 7f1a35800640 1 -- 172.21.15.1:0/2527216931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a30112870 msgr2=0x7f1a3019e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:20.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.418+0000 7f1a35800640 1 --2- 172.21.15.1:0/2527216931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a30112870 0x7f1a3019e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:20.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.418+0000 7f1a35800640 1 -- 172.21.15.1:0/2527216931 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a3019ef70 con 0x7f1a30076720 2024-09-15T22:22:20.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.418+0000 7f1a36200640 1 --2- 172.21.15.1:0/2527216931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a30112870 0x7f1a3019e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:22:20.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.418+0000 7f1a35800640 1 --2- 172.21.15.1:0/2527216931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a30076720 0x7f1a301a4650 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400e9f0 tx=0x7f1a2400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:20.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.419+0000 7f1a2e000640 1 -- 172.21.15.1:0/2527216931 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2400ccc0 con 0x7f1a30076720 2024-09-15T22:22:20.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.419+0000 7f1a2e000640 1 -- 172.21.15.1:0/2527216931 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a24005020 con 0x7f1a30076720 2024-09-15T22:22:20.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.419+0000 7f1a36c00640 1 -- 172.21.15.1:0/2527216931 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a3019f260 con 0x7f1a30076720 2024-09-15T22:22:20.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.419+0000 7f1a2e000640 1 -- 172.21.15.1:0/2527216931 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a240049e0 con 0x7f1a30076720 2024-09-15T22:22:20.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.419+0000 7f1a36c00640 1 -- 172.21.15.1:0/2527216931 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a301ab4b0 con 0x7f1a30076720 2024-09-15T22:22:20.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.420+0000 7f1a36c00640 1 -- 172.21.15.1:0/2527216931 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a30077e60 con 0x7f1a30076720 2024-09-15T22:22:20.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.422+0000 7f1a2e000640 1 -- 172.21.15.1:0/2527216931 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f1a24005560 con 0x7f1a30076720 2024-09-15T22:22:20.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.423+0000 7f1a2e000640 1 --2- 172.21.15.1:0/2527216931 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f1a180a32c0 0x7f1a180a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:20.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.423+0000 7f1a2e000640 1 -- 172.21.15.1:0/2527216931 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f1a240cf4d0 con 0x7f1a30076720 2024-09-15T22:22:20.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.423+0000 7f1a34e00640 1 --2- 172.21.15.1:0/2527216931 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f1a180a32c0 0x7f1a180a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:20.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.424+0000 7f1a34e00640 1 --2- 172.21.15.1:0/2527216931 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f1a180a32c0 0x7f1a180a5780 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1a30079300 tx=0x7f1a1c0056d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:20.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.427+0000 7f1a2e000640 1 -- 172.21.15.1:0/2527216931 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1a240051d0 con 0x7f1a30076720 2024-09-15T22:22:20.456 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 15 22:22:20 smithi098 systemd[1]: Starting Ceph mds.f for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:22:20.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.649+0000 7f1a36c00640 1 -- 172.21.15.1:0/2527216931 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1a3010da00 con 0x7f1a30076720 2024-09-15T22:22:20.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.650+0000 7f1a2e000640 1 -- 172.21.15.1:0/2527216931 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4723 (secure 0 0 0) 0x7f1a2409c5f0 con 0x7f1a30076720 2024-09-15T22:22:20.652 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:22:20.652 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":6,"btime":"2024-09-15T22:22:18:608731+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2417768032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2417768032},{"type":"v1","addr":"172.21.15.1:6835","nonce":2417768032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14493,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2957993064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2957993064},{"type":"v1","addr":"172.21.15.1:6837","nonce":2957993064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3122570659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3122570659},{"type":"v1","addr":"172.21.15.12:6833","nonce":3122570659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2901262900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2901262900},{"type":"v1","addr":"172.21.15.12:6835","nonce":2901262900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/94050093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":94050093},{"type":"v1","addr":"172.21.15.98:6833","nonce":94050093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-15T22:22:20.653 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 6 2024-09-15T22:22:20.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.652+0000 7f1a36c00640 1 -- 172.21.15.1:0/2527216931 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f1a180a32c0 msgr2=0x7f1a180a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:20.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.652+0000 7f1a36c00640 1 --2- 172.21.15.1:0/2527216931 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f1a180a32c0 0x7f1a180a5780 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1a30079300 tx=0x7f1a1c0056d0 comp rx=0 tx=0).stop 2024-09-15T22:22:20.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.652+0000 7f1a36c00640 1 -- 172.21.15.1:0/2527216931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a30076720 msgr2=0x7f1a301a4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:20.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.652+0000 7f1a36c00640 1 --2- 172.21.15.1:0/2527216931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a30076720 0x7f1a301a4650 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400e9f0 tx=0x7f1a2400eeb0 comp rx=0 tx=0).stop 2024-09-15T22:22:20.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.652+0000 7f1a36c00640 1 -- 172.21.15.1:0/2527216931 shutdown_connections 2024-09-15T22:22:20.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.652+0000 7f1a36c00640 1 --2- 172.21.15.1:0/2527216931 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f1a180a32c0 0x7f1a180a5780 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:20.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.652+0000 7f1a36c00640 1 --2- 172.21.15.1:0/2527216931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a30112870 0x7f1a3019e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:20.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.652+0000 7f1a36c00640 1 --2- 172.21.15.1:0/2527216931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a30077040 0x7f1a301a4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:20.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.652+0000 7f1a36c00640 1 --2- 172.21.15.1:0/2527216931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a30076720 0x7f1a301a4650 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:20.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.652+0000 7f1a36c00640 1 -- 172.21.15.1:0/2527216931 >> 172.21.15.1:0/2527216931 conn(0x7f1a300ff8d0 msgr2=0x7f1a30101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:20.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.653+0000 7f1a36c00640 1 -- 172.21.15.1:0/2527216931 shutdown_connections 2024-09-15T22:22:20.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:20.653+0000 7f1a36c00640 1 -- 172.21.15.1:0/2527216931 wait complete. 2024-09-15T22:22:20.720 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 15 22:22:20 smithi098 podman[65443]: 2024-09-15 22:22:20.357539521 +0000 UTC m=+0.015969437 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:22:20.720 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 15 22:22:20 smithi098 podman[65443]: 2024-09-15 22:22:20.457931694 +0000 UTC m=+0.116361653 container create fd056ace14bafdf7c5f81a8e554978868d651cc133f0219f5179cae4b3cbe597 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-f, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_CLEAN=True) 2024-09-15T22:22:20.720 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 15 22:22:20 smithi098 podman[65443]: 2024-09-15 22:22:20.719055673 +0000 UTC m=+0.377485590 container init fd056ace14bafdf7c5f81a8e554978868d651cc133f0219f5179cae4b3cbe597 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-f, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-15T22:22:21.061 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 15 22:22:20 smithi098 podman[65443]: 2024-09-15 22:22:20.721753762 +0000 UTC m=+0.380183686 container start fd056ace14bafdf7c5f81a8e554978868d651cc133f0219f5179cae4b3cbe597 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-f, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-15T22:22:21.061 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 15 22:22:20 smithi098 ceph-mds[65462]: -- 172.21.15.98:0/1026235325 <== mon.1 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5591a490b860 con 0x5591a48e8800 2024-09-15T22:22:21.061 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 15 22:22:20 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-f[65458]: starting mds.f at 2024-09-15T22:22:21.061 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 15 22:22:20 smithi098 bash[65443]: fd056ace14bafdf7c5f81a8e554978868d651cc133f0219f5179cae4b3cbe597 2024-09-15T22:22:21.061 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 15 22:22:20 smithi098 systemd[1]: Started Ceph mds.f for c1228c44-73af-11ef-bceb-c7b262605968. 2024-09-15T22:22:21.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:21 smithi098 ceph-mon[35514]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:21.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:21 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/2527216931' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:22:21.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:21 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:21.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:21 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:21.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:21 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:21.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:21 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:21.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:21 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:21.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:21 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:21.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:21 smithi001 ceph-mon[30843]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:21.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:21 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/2527216931' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:22:21.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:21 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:21.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:21 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:21.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:21 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:21.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:21 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:21.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:21 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:21.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:21 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:21.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:21 smithi012 ceph-mon[34883]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:21.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:21 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/2527216931' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:22:21.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:21 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:21.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:21 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:21.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:21 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:21.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:21 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:21.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:21 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:21.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:21 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:22.619 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:22 smithi098 ceph-mon[35514]: Deploying daemon mds.c on smithi098 2024-09-15T22:22:22.619 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:22 smithi098 ceph-mon[35514]: mds.? [v2:172.21.15.98:6834/1848806705,v1:172.21.15.98:6835/1848806705] up:boot 2024-09-15T22:22:22.619 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:22 smithi098 ceph-mon[35514]: fsmap 6 up:standby 2024-09-15T22:22:22.619 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:22 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T22:22:22.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:22 smithi001 ceph-mon[30843]: Deploying daemon mds.c on smithi098 2024-09-15T22:22:22.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:22 smithi001 ceph-mon[30843]: mds.? [v2:172.21.15.98:6834/1848806705,v1:172.21.15.98:6835/1848806705] up:boot 2024-09-15T22:22:22.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:22 smithi001 ceph-mon[30843]: fsmap 6 up:standby 2024-09-15T22:22:22.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:22 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T22:22:22.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:22 smithi012 ceph-mon[34883]: Deploying daemon mds.c on smithi098 2024-09-15T22:22:22.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:22 smithi012 ceph-mon[34883]: mds.? [v2:172.21.15.98:6834/1848806705,v1:172.21.15.98:6835/1848806705] up:boot 2024-09-15T22:22:22.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:22 smithi012 ceph-mon[34883]: fsmap 6 up:standby 2024-09-15T22:22:22.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:22 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T22:22:23.014 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 15 22:22:22 smithi098 systemd[1]: Starting Ceph mds.c for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:22:23.311 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 15 22:22:23 smithi098 podman[65743]: 2024-09-15 22:22:22.915136297 +0000 UTC m=+0.015714343 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:22:23.311 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 15 22:22:23 smithi098 podman[65743]: 2024-09-15 22:22:23.028432333 +0000 UTC m=+0.129010417 container create c58abb493dbdb4e40252e71ae8d7be7049b804d7fa59da1b0c8538409bb0003d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-c, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-8921c8e) 2024-09-15T22:22:23.393 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:22:23.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:23 smithi001 ceph-mon[30843]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:23.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:23 smithi012 ceph-mon[34883]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:23.777 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:22:23.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:23 smithi098 ceph-mon[35514]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:23.812 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 15 22:22:23 smithi098 podman[65743]: 2024-09-15 22:22:23.330830822 +0000 UTC m=+0.431408868 container init c58abb493dbdb4e40252e71ae8d7be7049b804d7fa59da1b0c8538409bb0003d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-c, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:22:23.812 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 15 22:22:23 smithi098 podman[65743]: 2024-09-15 22:22:23.333918245 +0000 UTC m=+0.434496286 container start c58abb493dbdb4e40252e71ae8d7be7049b804d7fa59da1b0c8538409bb0003d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-c, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:22:23.812 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 15 22:22:23 smithi098 ceph-mds[65762]: -- 172.21.15.98:0/1996139224 <== mon.1 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555d4464f860 con 0x555d4462d000 2024-09-15T22:22:23.812 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 15 22:22:23 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-c[65758]: starting mds.c at 2024-09-15T22:22:23.812 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 15 22:22:23 smithi098 bash[65743]: c58abb493dbdb4e40252e71ae8d7be7049b804d7fa59da1b0c8538409bb0003d 2024-09-15T22:22:23.812 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 15 22:22:23 smithi098 systemd[1]: Started Ceph mds.c for c1228c44-73af-11ef-bceb-c7b262605968. 2024-09-15T22:22:24.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.264+0000 7f033ae00640 1 -- 172.21.15.1:0/2726596461 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0334076720 msgr2=0x7f0334076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:24.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.264+0000 7f033ae00640 1 --2- 172.21.15.1:0/2726596461 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0334076720 0x7f0334076b00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0328009ca0 tx=0x7f032802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:22:24.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.264+0000 7f033ae00640 1 -- 172.21.15.1:0/2726596461 shutdown_connections 2024-09-15T22:22:24.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.264+0000 7f033ae00640 1 --2- 172.21.15.1:0/2726596461 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0334112870 0x7f0334114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:24.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.264+0000 7f033ae00640 1 --2- 172.21.15.1:0/2726596461 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0334077040 0x7f0334112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:24.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.264+0000 7f033ae00640 1 --2- 172.21.15.1:0/2726596461 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0334076720 0x7f0334076b00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:24.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.264+0000 7f033ae00640 1 -- 172.21.15.1:0/2726596461 >> 172.21.15.1:0/2726596461 conn(0x7f03340ff8d0 msgr2=0x7f0334101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:24.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.264+0000 7f033ae00640 1 -- 172.21.15.1:0/2726596461 shutdown_connections 2024-09-15T22:22:24.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.264+0000 7f033ae00640 1 -- 172.21.15.1:0/2726596461 wait complete. 2024-09-15T22:22:24.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.265+0000 7f033ae00640 1 Processor -- start 2024-09-15T22:22:24.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.265+0000 7f033ae00640 1 -- start start 2024-09-15T22:22:24.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.266+0000 7f033ae00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0334076720 0x7f03341a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:24.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.266+0000 7f033ae00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0334077040 0x7f03341a4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:24.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.266+0000 7f033ae00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0334112870 0x7f033419e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:24.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.266+0000 7f033ae00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0334118450 con 0x7f0334112870 2024-09-15T22:22:24.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.266+0000 7f033ae00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f03341182d0 con 0x7f0334077040 2024-09-15T22:22:24.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.266+0000 7f033ae00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f03341185d0 con 0x7f0334076720 2024-09-15T22:22:24.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.266+0000 7f0339a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0334076720 0x7f03341a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:24.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.266+0000 7f033a400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0334112870 0x7f033419e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:24.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.266+0000 7f0339a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0334076720 0x7f03341a4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:48520/0 (socket says 172.21.15.1:48520) 2024-09-15T22:22:24.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.266+0000 7f0339a00640 1 -- 172.21.15.1:0/157322161 learned_addr learned my addr 172.21.15.1:0/157322161 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:22:24.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.266+0000 7f0339000640 1 --2- 172.21.15.1:0/157322161 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0334077040 0x7f03341a4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:24.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.266+0000 7f0339a00640 1 -- 172.21.15.1:0/157322161 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0334077040 msgr2=0x7f03341a4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:24.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.266+0000 7f0339a00640 1 --2- 172.21.15.1:0/157322161 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0334077040 0x7f03341a4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:24.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.266+0000 7f0339a00640 1 -- 172.21.15.1:0/157322161 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0334112870 msgr2=0x7f033419e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:24.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.266+0000 7f0339a00640 1 --2- 172.21.15.1:0/157322161 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0334112870 0x7f033419e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:24.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.266+0000 7f0339a00640 1 -- 172.21.15.1:0/157322161 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f033419ef50 con 0x7f0334076720 2024-09-15T22:22:24.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.266+0000 7f033a400640 1 --2- 172.21.15.1:0/157322161 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0334112870 0x7f033419e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:22:24.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.266+0000 7f0339000640 1 --2- 172.21.15.1:0/157322161 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0334077040 0x7f03341a4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:22:24.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.267+0000 7f0339a00640 1 --2- 172.21.15.1:0/157322161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0334076720 0x7f03341a4610 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0328005e30 tx=0x7f0328003f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:24.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.267+0000 7f0332000640 1 -- 172.21.15.1:0/157322161 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0328031650 con 0x7f0334076720 2024-09-15T22:22:24.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.267+0000 7f0332000640 1 -- 172.21.15.1:0/157322161 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03280317f0 con 0x7f0334076720 2024-09-15T22:22:24.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.267+0000 7f0332000640 1 -- 172.21.15.1:0/157322161 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032802fa30 con 0x7f0334076720 2024-09-15T22:22:24.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.267+0000 7f033ae00640 1 -- 172.21.15.1:0/157322161 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f033419f1e0 con 0x7f0334076720 2024-09-15T22:22:24.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.267+0000 7f033ae00640 1 -- 172.21.15.1:0/157322161 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03341ab3c0 con 0x7f0334076720 2024-09-15T22:22:24.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.269+0000 7f033ae00640 1 -- 172.21.15.1:0/157322161 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0334077e60 con 0x7f0334076720 2024-09-15T22:22:24.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.270+0000 7f0332000640 1 -- 172.21.15.1:0/157322161 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f032802fc10 con 0x7f0334076720 2024-09-15T22:22:24.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.272+0000 7f0332000640 1 --2- 172.21.15.1:0/157322161 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f031c0a3240 0x7f031c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:24.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.272+0000 7f0332000640 1 -- 172.21.15.1:0/157322161 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f03280f0890 con 0x7f0334076720 2024-09-15T22:22:24.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.272+0000 7f0339000640 1 --2- 172.21.15.1:0/157322161 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f031c0a3240 0x7f031c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:24.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.272+0000 7f0339000640 1 --2- 172.21.15.1:0/157322161 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f031c0a3240 0x7f031c0a5700 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f033419ff30 tx=0x7f0320005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:24.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.275+0000 7f0332000640 1 -- 172.21.15.1:0/157322161 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f03280319a0 con 0x7f0334076720 2024-09-15T22:22:24.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.498+0000 7f033ae00640 1 -- 172.21.15.1:0/157322161 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f03341ab590 con 0x7f0334076720 2024-09-15T22:22:24.501 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:24 smithi001 ceph-mon[30843]: mds.? [v2:172.21.15.98:6836/493594054,v1:172.21.15.98:6837/493594054] up:boot 2024-09-15T22:22:24.501 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:24 smithi001 ceph-mon[30843]: fsmap 7 up:standby 2024-09-15T22:22:24.501 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T22:22:24.501 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:24.501 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:24.501 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:24.501 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:24.501 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:24.501 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:24 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:24.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.499+0000 7f0332000640 1 -- 172.21.15.1:0/157322161 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6370 (secure 0 0 0) 0x7f03280b7e20 con 0x7f0334076720 2024-09-15T22:22:24.502 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:22:24.502 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":8,"btime":"2024-09-15T22:22:23:364436+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2417768032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2417768032},{"type":"v1","addr":"172.21.15.1:6835","nonce":2417768032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14493,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2957993064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2957993064},{"type":"v1","addr":"172.21.15.1:6837","nonce":2957993064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3122570659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3122570659},{"type":"v1","addr":"172.21.15.12:6833","nonce":3122570659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2901262900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2901262900},{"type":"v1","addr":"172.21.15.12:6835","nonce":2901262900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/94050093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":94050093},{"type":"v1","addr":"172.21.15.98:6833","nonce":94050093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/1848806705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1848806705},{"type":"v1","addr":"172.21.15.98:6835","nonce":1848806705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24520,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/493594054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":493594054},{"type":"v1","addr":"172.21.15.98:6837","nonce":493594054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-15T22:22:24.502 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 8 2024-09-15T22:22:24.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.501+0000 7f033ae00640 1 -- 172.21.15.1:0/157322161 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f031c0a3240 msgr2=0x7f031c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:24.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.501+0000 7f033ae00640 1 --2- 172.21.15.1:0/157322161 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f031c0a3240 0x7f031c0a5700 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f033419ff30 tx=0x7f0320005f90 comp rx=0 tx=0).stop 2024-09-15T22:22:24.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.501+0000 7f033ae00640 1 -- 172.21.15.1:0/157322161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0334076720 msgr2=0x7f03341a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:24.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.501+0000 7f033ae00640 1 --2- 172.21.15.1:0/157322161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0334076720 0x7f03341a4610 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0328005e30 tx=0x7f0328003f90 comp rx=0 tx=0).stop 2024-09-15T22:22:24.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.502+0000 7f033ae00640 1 -- 172.21.15.1:0/157322161 shutdown_connections 2024-09-15T22:22:24.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.502+0000 7f033ae00640 1 --2- 172.21.15.1:0/157322161 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f031c0a3240 0x7f031c0a5700 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:24.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.502+0000 7f033ae00640 1 --2- 172.21.15.1:0/157322161 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0334112870 0x7f033419e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:24.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.502+0000 7f033ae00640 1 --2- 172.21.15.1:0/157322161 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0334077040 0x7f03341a4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:24.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.502+0000 7f033ae00640 1 --2- 172.21.15.1:0/157322161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0334076720 0x7f03341a4610 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:24.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.502+0000 7f033ae00640 1 -- 172.21.15.1:0/157322161 >> 172.21.15.1:0/157322161 conn(0x7f03340ff8d0 msgr2=0x7f0334101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:24.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.502+0000 7f033ae00640 1 -- 172.21.15.1:0/157322161 shutdown_connections 2024-09-15T22:22:24.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:24.502+0000 7f033ae00640 1 -- 172.21.15.1:0/157322161 wait complete. 2024-09-15T22:22:24.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:24 smithi012 ceph-mon[34883]: mds.? [v2:172.21.15.98:6836/493594054,v1:172.21.15.98:6837/493594054] up:boot 2024-09-15T22:22:24.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:24 smithi012 ceph-mon[34883]: fsmap 7 up:standby 2024-09-15T22:22:24.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T22:22:24.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:24.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:24.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:24.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:24.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:24.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:24 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:24.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:24 smithi098 ceph-mon[35514]: mds.? [v2:172.21.15.98:6836/493594054,v1:172.21.15.98:6837/493594054] up:boot 2024-09-15T22:22:24.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:24 smithi098 ceph-mon[35514]: fsmap 7 up:standby 2024-09-15T22:22:24.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T22:22:24.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:24.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:24.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:24.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:24.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:24.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:24 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:25.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:25 smithi012 ceph-mon[34883]: Deploying daemon mds.h on smithi012 2024-09-15T22:22:25.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:25 smithi012 ceph-mon[34883]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:25.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:25 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/157322161' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:22:25.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:25 smithi001 ceph-mon[30843]: Deploying daemon mds.h on smithi012 2024-09-15T22:22:25.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:25 smithi001 ceph-mon[30843]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:25.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:25 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/157322161' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:22:25.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:25 smithi098 ceph-mon[35514]: Deploying daemon mds.h on smithi012 2024-09-15T22:22:25.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:25 smithi098 ceph-mon[35514]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:25.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:25 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/157322161' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:22:26.496 INFO:journalctl@ceph.mds.h.smithi012.stdout:Sep 15 22:22:26 smithi012 systemd[1]: Started Ceph mds.h for c1228c44-73af-11ef-bceb-c7b262605968. 2024-09-15T22:22:27.263 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:22:27.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:27 smithi012 ceph-mon[34883]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:27.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:27 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:27.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:27 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:27.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:27 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:27.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:27 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:27.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:27 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:27.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:27 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:27.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:27 smithi012 ceph-mon[34883]: Deploying daemon mds.i on smithi098 2024-09-15T22:22:27.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:27 smithi012 ceph-mon[34883]: mds.? [v2:172.21.15.12:6836/2378138381,v1:172.21.15.12:6837/2378138381] up:boot 2024-09-15T22:22:27.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:27 smithi012 ceph-mon[34883]: fsmap 8 up:standby 2024-09-15T22:22:27.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:27 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T22:22:27.560 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:27 smithi098 ceph-mon[35514]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:27.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:27 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:27.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:27 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:27.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:27 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:27.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:27 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:27.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:27 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:27.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:27 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:27.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:27 smithi098 ceph-mon[35514]: Deploying daemon mds.i on smithi098 2024-09-15T22:22:27.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:27 smithi098 ceph-mon[35514]: mds.? [v2:172.21.15.12:6836/2378138381,v1:172.21.15.12:6837/2378138381] up:boot 2024-09-15T22:22:27.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:27 smithi098 ceph-mon[35514]: fsmap 8 up:standby 2024-09-15T22:22:27.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:27 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T22:22:27.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:27 smithi001 ceph-mon[30843]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:27.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:27 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:27.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:27 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:27.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:27 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:27.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:27 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:27.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:27 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:27.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:27 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:27.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:27 smithi001 ceph-mon[30843]: Deploying daemon mds.i on smithi098 2024-09-15T22:22:27.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:27 smithi001 ceph-mon[30843]: mds.? [v2:172.21.15.12:6836/2378138381,v1:172.21.15.12:6837/2378138381] up:boot 2024-09-15T22:22:27.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:27 smithi001 ceph-mon[30843]: fsmap 8 up:standby 2024-09-15T22:22:27.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:27 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T22:22:27.648 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:22:28.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.130+0000 7ffaa1200640 1 -- 172.21.15.1:0/2567168767 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa9c074ee0 msgr2=0x7ffa9c10dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:28.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.130+0000 7ffaa1200640 1 --2- 172.21.15.1:0/2567168767 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa9c074ee0 0x7ffa9c10dd20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffa84009900 tx=0x7ffa8402a480 comp rx=0 tx=0).stop 2024-09-15T22:22:28.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.130+0000 7ffaa1200640 1 -- 172.21.15.1:0/2567168767 shutdown_connections 2024-09-15T22:22:28.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.130+0000 7ffaa1200640 1 --2- 172.21.15.1:0/2567168767 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa9c10e260 0x7ffa9c110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:28.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.130+0000 7ffaa1200640 1 --2- 172.21.15.1:0/2567168767 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa9c074ee0 0x7ffa9c10dd20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:28.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.130+0000 7ffaa1200640 1 --2- 172.21.15.1:0/2567168767 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa9c0745c0 0x7ffa9c0749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:28.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.130+0000 7ffaa1200640 1 -- 172.21.15.1:0/2567168767 >> 172.21.15.1:0/2567168767 conn(0x7ffa9c0fd6e0 msgr2=0x7ffa9c0ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:28.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.130+0000 7ffaa1200640 1 -- 172.21.15.1:0/2567168767 shutdown_connections 2024-09-15T22:22:28.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.130+0000 7ffaa1200640 1 -- 172.21.15.1:0/2567168767 wait complete. 2024-09-15T22:22:28.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.131+0000 7ffaa1200640 1 Processor -- start 2024-09-15T22:22:28.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.131+0000 7ffaa1200640 1 -- start start 2024-09-15T22:22:28.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.131+0000 7ffaa1200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa9c0745c0 0x7ffa9c19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:28.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.131+0000 7ffaa1200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa9c074ee0 0x7ffa9c19aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:28.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.131+0000 7ffaa1200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa9c10e260 0x7ffa9c19ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:28.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.131+0000 7ffaa1200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffa9c114000 con 0x7ffa9c10e260 2024-09-15T22:22:28.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.131+0000 7ffaa1200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ffa9c113e80 con 0x7ffa9c0745c0 2024-09-15T22:22:28.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.132+0000 7ffaa1200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ffa9c114180 con 0x7ffa9c074ee0 2024-09-15T22:22:28.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.132+0000 7ffa9b400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa9c0745c0 0x7ffa9c19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:28.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.132+0000 7ffa9b400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa9c0745c0 0x7ffa9c19a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:59664/0 (socket says 172.21.15.1:59664) 2024-09-15T22:22:28.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.132+0000 7ffa9b400640 1 -- 172.21.15.1:0/1732698340 learned_addr learned my addr 172.21.15.1:0/1732698340 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:22:28.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.132+0000 7ffa92a00640 1 --2- 172.21.15.1:0/1732698340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa9c074ee0 0x7ffa9c19aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:28.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.132+0000 7ffa9be00640 1 --2- 172.21.15.1:0/1732698340 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa9c10e260 0x7ffa9c19ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:28.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.132+0000 7ffa9b400640 1 -- 172.21.15.1:0/1732698340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa9c074ee0 msgr2=0x7ffa9c19aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:28.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.132+0000 7ffa9b400640 1 --2- 172.21.15.1:0/1732698340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa9c074ee0 0x7ffa9c19aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:28.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.132+0000 7ffa9b400640 1 -- 172.21.15.1:0/1732698340 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa9c10e260 msgr2=0x7ffa9c19ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:28.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.132+0000 7ffa9b400640 1 --2- 172.21.15.1:0/1732698340 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa9c10e260 0x7ffa9c19ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:28.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.132+0000 7ffa9b400640 1 -- 172.21.15.1:0/1732698340 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa9c19f470 con 0x7ffa9c0745c0 2024-09-15T22:22:28.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.132+0000 7ffa92a00640 1 --2- 172.21.15.1:0/1732698340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa9c074ee0 0x7ffa9c19aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:22:28.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.132+0000 7ffa9b400640 1 --2- 172.21.15.1:0/1732698340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa9c0745c0 0x7ffa9c19a4c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c00ea60 tx=0x7ffa8c00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:28.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.133+0000 7ffa98c00640 1 -- 172.21.15.1:0/1732698340 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c00cde0 con 0x7ffa9c0745c0 2024-09-15T22:22:28.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.133+0000 7ffaa1200640 1 -- 172.21.15.1:0/1732698340 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa9c19f760 con 0x7ffa9c0745c0 2024-09-15T22:22:28.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.133+0000 7ffa98c00640 1 -- 172.21.15.1:0/1732698340 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa8c0035f0 con 0x7ffa9c0745c0 2024-09-15T22:22:28.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.133+0000 7ffa98c00640 1 -- 172.21.15.1:0/1732698340 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c010670 con 0x7ffa9c0745c0 2024-09-15T22:22:28.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.133+0000 7ffaa1200640 1 -- 172.21.15.1:0/1732698340 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa9c1a7040 con 0x7ffa9c0745c0 2024-09-15T22:22:28.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.134+0000 7ffaa1200640 1 -- 172.21.15.1:0/1732698340 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa9c0749a0 con 0x7ffa9c0745c0 2024-09-15T22:22:28.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.136+0000 7ffa98c00640 1 -- 172.21.15.1:0/1732698340 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7ffa8c0037a0 con 0x7ffa9c0745c0 2024-09-15T22:22:28.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.137+0000 7ffa98c00640 1 --2- 172.21.15.1:0/1732698340 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ffa800a3240 0x7ffa800a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:28.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.137+0000 7ffa98c00640 1 -- 172.21.15.1:0/1732698340 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7ffa8c0cf880 con 0x7ffa9c0745c0 2024-09-15T22:22:28.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.138+0000 7ffa92a00640 1 --2- 172.21.15.1:0/1732698340 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ffa800a3240 0x7ffa800a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:28.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.138+0000 7ffa92a00640 1 --2- 172.21.15.1:0/1732698340 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ffa800a3240 0x7ffa800a5700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ffa84000c00 tx=0x7ffa84031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:28.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.139+0000 7ffa98c00640 1 -- 172.21.15.1:0/1732698340 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffa8c09ca30 con 0x7ffa9c0745c0 2024-09-15T22:22:28.311 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 15 22:22:28 smithi098 systemd[1]: Starting Ceph mds.i for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:22:28.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.360+0000 7ffaa1200640 1 -- 172.21.15.1:0/1732698340 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffa9c19b820 con 0x7ffa9c0745c0 2024-09-15T22:22:28.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.361+0000 7ffa98c00640 1 -- 172.21.15.1:0/1732698340 <== mon.2 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7195 (secure 0 0 0) 0x7ffa8c09c330 con 0x7ffa9c0745c0 2024-09-15T22:22:28.363 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:22:28.363 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":9,"btime":"2024-09-15T22:22:26:374250+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2417768032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2417768032},{"type":"v1","addr":"172.21.15.1:6835","nonce":2417768032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14493,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2957993064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2957993064},{"type":"v1","addr":"172.21.15.1:6837","nonce":2957993064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3122570659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3122570659},{"type":"v1","addr":"172.21.15.12:6833","nonce":3122570659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2901262900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2901262900},{"type":"v1","addr":"172.21.15.12:6835","nonce":2901262900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/94050093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":94050093},{"type":"v1","addr":"172.21.15.98:6833","nonce":94050093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2378138381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2378138381},{"type":"v1","addr":"172.21.15.12:6837","nonce":2378138381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/1848806705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1848806705},{"type":"v1","addr":"172.21.15.98:6835","nonce":1848806705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24520,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/493594054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":493594054},{"type":"v1","addr":"172.21.15.98:6837","nonce":493594054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-15T22:22:28.363 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 9 2024-09-15T22:22:28.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.363+0000 7ffaa1200640 1 -- 172.21.15.1:0/1732698340 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ffa800a3240 msgr2=0x7ffa800a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:28.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.363+0000 7ffaa1200640 1 --2- 172.21.15.1:0/1732698340 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ffa800a3240 0x7ffa800a5700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ffa84000c00 tx=0x7ffa84031510 comp rx=0 tx=0).stop 2024-09-15T22:22:28.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.363+0000 7ffaa1200640 1 -- 172.21.15.1:0/1732698340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa9c0745c0 msgr2=0x7ffa9c19a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:28.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.363+0000 7ffaa1200640 1 --2- 172.21.15.1:0/1732698340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa9c0745c0 0x7ffa9c19a4c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c00ea60 tx=0x7ffa8c00ef20 comp rx=0 tx=0).stop 2024-09-15T22:22:28.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.363+0000 7ffaa1200640 1 -- 172.21.15.1:0/1732698340 shutdown_connections 2024-09-15T22:22:28.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.363+0000 7ffaa1200640 1 --2- 172.21.15.1:0/1732698340 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ffa800a3240 0x7ffa800a5700 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:28.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.363+0000 7ffaa1200640 1 --2- 172.21.15.1:0/1732698340 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa9c10e260 0x7ffa9c19ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:28.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.363+0000 7ffaa1200640 1 --2- 172.21.15.1:0/1732698340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa9c074ee0 0x7ffa9c19aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:28.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.363+0000 7ffaa1200640 1 --2- 172.21.15.1:0/1732698340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa9c0745c0 0x7ffa9c19a4c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:28.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.363+0000 7ffaa1200640 1 -- 172.21.15.1:0/1732698340 >> 172.21.15.1:0/1732698340 conn(0x7ffa9c0fd6e0 msgr2=0x7ffa9c0fe380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:28.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.363+0000 7ffaa1200640 1 -- 172.21.15.1:0/1732698340 shutdown_connections 2024-09-15T22:22:28.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:28.363+0000 7ffaa1200640 1 -- 172.21.15.1:0/1732698340 wait complete. 2024-09-15T22:22:28.670 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 15 22:22:28 smithi098 podman[66045]: 2024-09-15 22:22:28.307612399 +0000 UTC m=+0.015675146 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:22:28.670 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 15 22:22:28 smithi098 podman[66045]: 2024-09-15 22:22:28.424750369 +0000 UTC m=+0.132813117 container create e2fb1c79b33ca8a3e2ce9bba216fa3b74f9b57ad81cb41908d78fc931ebd8380 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-i, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731) 2024-09-15T22:22:28.670 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 15 22:22:28 smithi098 podman[66045]: 2024-09-15 22:22:28.669050768 +0000 UTC m=+0.377113530 container init e2fb1c79b33ca8a3e2ce9bba216fa3b74f9b57ad81cb41908d78fc931ebd8380 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-15T22:22:29.061 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 15 22:22:28 smithi098 podman[66045]: 2024-09-15 22:22:28.671813785 +0000 UTC m=+0.379876534 container start e2fb1c79b33ca8a3e2ce9bba216fa3b74f9b57ad81cb41908d78fc931ebd8380 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-i, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-15T22:22:29.061 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 15 22:22:28 smithi098 ceph-mds[66064]: -- 172.21.15.98:0/1748107832 <== mon.1 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a30fa9f860 con 0x55a30fa7c800 2024-09-15T22:22:29.061 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 15 22:22:28 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-i[66060]: starting mds.i at 2024-09-15T22:22:29.061 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 15 22:22:28 smithi098 bash[66045]: e2fb1c79b33ca8a3e2ce9bba216fa3b74f9b57ad81cb41908d78fc931ebd8380 2024-09-15T22:22:29.061 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 15 22:22:28 smithi098 systemd[1]: Started Ceph mds.i for c1228c44-73af-11ef-bceb-c7b262605968. 2024-09-15T22:22:29.466 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:29 smithi001 ceph-mon[30843]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:29.467 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:29 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/1732698340' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:22:29.467 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:29 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:29.467 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:29 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:29.467 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:29 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:29.467 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:29 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:29.467 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:29 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:29.467 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:29 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:29.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:29 smithi012 ceph-mon[34883]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:29.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:29 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/1732698340' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:22:29.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:29 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:29.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:29 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:29.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:29 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:29.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:29 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:29.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:29 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:29.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:29 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:29.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:29 smithi098 ceph-mon[35514]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:29.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:29 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/1732698340' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:22:29.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:29 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:29.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:29 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:29.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:29 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:29.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:29 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:29.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:29 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:29.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:29 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:30.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:30 smithi012 ceph-mon[34883]: Deploying daemon mds.g on smithi001 2024-09-15T22:22:30.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:30 smithi012 ceph-mon[34883]: mds.? [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] up:boot 2024-09-15T22:22:30.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:30 smithi012 ceph-mon[34883]: fsmap 9 up:standby 2024-09-15T22:22:30.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:30 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T22:22:30.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:30 smithi098 ceph-mon[35514]: Deploying daemon mds.g on smithi001 2024-09-15T22:22:30.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:30 smithi098 ceph-mon[35514]: mds.? [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] up:boot 2024-09-15T22:22:30.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:30 smithi098 ceph-mon[35514]: fsmap 9 up:standby 2024-09-15T22:22:30.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:30 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T22:22:30.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:30 smithi001 ceph-mon[30843]: Deploying daemon mds.g on smithi001 2024-09-15T22:22:30.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:30 smithi001 ceph-mon[30843]: mds.? [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] up:boot 2024-09-15T22:22:30.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:30 smithi001 ceph-mon[30843]: fsmap 9 up:standby 2024-09-15T22:22:30.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:30 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T22:22:31.202 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:22:31.321 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:31 smithi001 ceph-mon[30843]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:31.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:31 smithi012 ceph-mon[34883]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:31.560 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:31 smithi098 ceph-mon[35514]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:31.626 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 15 22:22:31 smithi001 systemd[1]: Starting Ceph mds.g for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:22:31.966 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 15 22:22:31 smithi001 podman[69103]: 2024-09-15 22:22:31.584715244 +0000 UTC m=+0.030384657 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:22:31.966 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 15 22:22:31 smithi001 podman[69103]: 2024-09-15 22:22:31.701340083 +0000 UTC m=+0.147009495 container create 400c8e3d39dfbf7defb4a3831e55800ea265767c4124ce637bdd1541b175bcc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-g, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-15T22:22:31.966 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 15 22:22:31 smithi001 podman[69103]: 2024-09-15 22:22:31.920703048 +0000 UTC m=+0.366372470 container init 400c8e3d39dfbf7defb4a3831e55800ea265767c4124ce637bdd1541b175bcc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-g, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-8921c8e) 2024-09-15T22:22:31.966 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 15 22:22:31 smithi001 podman[69103]: 2024-09-15 22:22:31.926780366 +0000 UTC m=+0.372449778 container start 400c8e3d39dfbf7defb4a3831e55800ea265767c4124ce637bdd1541b175bcc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-g, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-15T22:22:32.023 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:22:32.346 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 15 22:22:31 smithi001 ceph-mds[69146]: -- 172.21.15.1:0/2733151969 <== mon.0 v2:172.21.15.1:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f2a42df860 con 0x55f2a42bd000 2024-09-15T22:22:32.346 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 15 22:22:31 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-g[69142]: starting mds.g at 2024-09-15T22:22:32.346 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 15 22:22:32 smithi001 bash[69103]: 400c8e3d39dfbf7defb4a3831e55800ea265767c4124ce637bdd1541b175bcc3 2024-09-15T22:22:32.346 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 15 22:22:32 smithi001 systemd[1]: Started Ceph mds.g for c1228c44-73af-11ef-bceb-c7b262605968. 2024-09-15T22:22:32.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.610+0000 7fe3ac400640 1 -- 172.21.15.1:0/3675506566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3a4103ff0 msgr2=0x7fe3a41043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:32.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.610+0000 7fe3ac400640 1 --2- 172.21.15.1:0/3675506566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3a4103ff0 0x7fe3a41043d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe398009900 tx=0x7fe39802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.610+0000 7fe3ac400640 1 -- 172.21.15.1:0/3675506566 shutdown_connections 2024-09-15T22:22:32.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.610+0000 7fe3ac400640 1 --2- 172.21.15.1:0/3675506566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3a4109120 0x7fe3a4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.610+0000 7fe3ac400640 1 --2- 172.21.15.1:0/3675506566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3a41049a0 0x7fe3a41089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.610+0000 7fe3ac400640 1 --2- 172.21.15.1:0/3675506566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3a4103ff0 0x7fe3a41043d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.610+0000 7fe3ac400640 1 -- 172.21.15.1:0/3675506566 >> 172.21.15.1:0/3675506566 conn(0x7fe3a40ffa90 msgr2=0x7fe3a4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:32.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.610+0000 7fe3ac400640 1 -- 172.21.15.1:0/3675506566 shutdown_connections 2024-09-15T22:22:32.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.610+0000 7fe3ac400640 1 -- 172.21.15.1:0/3675506566 wait complete. 2024-09-15T22:22:32.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.611+0000 7fe3ac400640 1 Processor -- start 2024-09-15T22:22:32.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.612+0000 7fe3ac400640 1 -- start start 2024-09-15T22:22:32.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.612+0000 7fe3ac400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3a4103ff0 0x7fe3a419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:32.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.612+0000 7fe3ac400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3a41049a0 0x7fe3a419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:32.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.612+0000 7fe3ac400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3a4109120 0x7fe3a419eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:32.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.612+0000 7fe3ac400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a4114140 con 0x7fe3a41049a0 2024-09-15T22:22:32.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.612+0000 7fe3ac400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a4113fc0 con 0x7fe3a4109120 2024-09-15T22:22:32.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.612+0000 7fe3ac400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a41142c0 con 0x7fe3a4103ff0 2024-09-15T22:22:32.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.612+0000 7fe3a9000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3a41049a0 0x7fe3a419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:32.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.612+0000 7fe3a9000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3a41049a0 0x7fe3a419ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45566/0 (socket says 172.21.15.1:45566) 2024-09-15T22:22:32.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.612+0000 7fe3a9000640 1 -- 172.21.15.1:0/3442664025 learned_addr learned my addr 172.21.15.1:0/3442664025 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:22:32.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.612+0000 7fe3aa400640 1 --2- 172.21.15.1:0/3442664025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3a4109120 0x7fe3a419eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:32.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.612+0000 7fe3a9a00640 1 --2- 172.21.15.1:0/3442664025 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3a4103ff0 0x7fe3a419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:32.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.613+0000 7fe3a9000640 1 -- 172.21.15.1:0/3442664025 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3a4103ff0 msgr2=0x7fe3a419a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:32.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.613+0000 7fe3a9000640 1 --2- 172.21.15.1:0/3442664025 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3a4103ff0 0x7fe3a419a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.613+0000 7fe3a9000640 1 -- 172.21.15.1:0/3442664025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3a4109120 msgr2=0x7fe3a419eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:32.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.613+0000 7fe3a9000640 1 --2- 172.21.15.1:0/3442664025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3a4109120 0x7fe3a419eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.613+0000 7fe3a9000640 1 -- 172.21.15.1:0/3442664025 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a419f5b0 con 0x7fe3a41049a0 2024-09-15T22:22:32.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.613+0000 7fe3a9000640 1 --2- 172.21.15.1:0/3442664025 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3a41049a0 0x7fe3a419ab40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe39000e9f0 tx=0x7fe39000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:32.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.613+0000 7fe3a2000640 1 -- 172.21.15.1:0/3442664025 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39000ccc0 con 0x7fe3a41049a0 2024-09-15T22:22:32.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.613+0000 7fe3a2000640 1 -- 172.21.15.1:0/3442664025 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe39000ce60 con 0x7fe3a41049a0 2024-09-15T22:22:32.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.613+0000 7fe3ac400640 1 -- 172.21.15.1:0/3442664025 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3a419f8a0 con 0x7fe3a41049a0 2024-09-15T22:22:32.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.613+0000 7fe3a2000640 1 -- 172.21.15.1:0/3442664025 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe390010690 con 0x7fe3a41049a0 2024-09-15T22:22:32.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.613+0000 7fe3ac400640 1 -- 172.21.15.1:0/3442664025 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3a41a7180 con 0x7fe3a41049a0 2024-09-15T22:22:32.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.615+0000 7fe3ac400640 1 -- 172.21.15.1:0/3442664025 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3a41043d0 con 0x7fe3a41049a0 2024-09-15T22:22:32.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.617+0000 7fe3a2000640 1 -- 172.21.15.1:0/3442664025 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fe3900046c0 con 0x7fe3a41049a0 2024-09-15T22:22:32.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.618+0000 7fe3a2000640 1 --2- 172.21.15.1:0/3442664025 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe38c0a3240 0x7fe38c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:32.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.618+0000 7fe3a2000640 1 -- 172.21.15.1:0/3442664025 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fe3900cfaf0 con 0x7fe3a41049a0 2024-09-15T22:22:32.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.618+0000 7fe3a9a00640 1 --2- 172.21.15.1:0/3442664025 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe38c0a3240 0x7fe38c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:32.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.619+0000 7fe3a9a00640 1 --2- 172.21.15.1:0/3442664025 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe38c0a3240 0x7fe38c0a5700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe398009230 tx=0x7fe3980058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:32.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.621+0000 7fe3a2000640 1 -- 172.21.15.1:0/3442664025 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe3900541b0 con 0x7fe3a41049a0 2024-09-15T22:22:32.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.850+0000 7fe3ac400640 1 -- 172.21.15.1:0/3442664025 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3a419b960 con 0x7fe3a41049a0 2024-09-15T22:22:32.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.851+0000 7fe3a2000640 1 -- 172.21.15.1:0/3442664025 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8845 (secure 0 0 0) 0x7fe3a419b960 con 0x7fe3a41049a0 2024-09-15T22:22:32.853 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:22:32.854 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":11,"btime":"2024-09-15T22:22:32:215830+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2417768032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2417768032},{"type":"v1","addr":"172.21.15.1:6835","nonce":2417768032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14493,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2957993064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2957993064},{"type":"v1","addr":"172.21.15.1:6837","nonce":2957993064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14529,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3887277479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3887277479},{"type":"v1","addr":"172.21.15.1:6839","nonce":3887277479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3122570659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3122570659},{"type":"v1","addr":"172.21.15.12:6833","nonce":3122570659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2901262900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2901262900},{"type":"v1","addr":"172.21.15.12:6835","nonce":2901262900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/94050093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":94050093},{"type":"v1","addr":"172.21.15.98:6833","nonce":94050093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2378138381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2378138381},{"type":"v1","addr":"172.21.15.12:6837","nonce":2378138381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/1848806705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1848806705},{"type":"v1","addr":"172.21.15.98:6835","nonce":1848806705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24520,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/493594054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":493594054},{"type":"v1","addr":"172.21.15.98:6837","nonce":493594054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24538,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2831161859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2831161859},{"type":"v1","addr":"172.21.15.98:6839","nonce":2831161859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-15T22:22:32.854 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 11 2024-09-15T22:22:32.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.853+0000 7fe3ac400640 1 -- 172.21.15.1:0/3442664025 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe38c0a3240 msgr2=0x7fe38c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:32.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.853+0000 7fe3ac400640 1 --2- 172.21.15.1:0/3442664025 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe38c0a3240 0x7fe38c0a5700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe398009230 tx=0x7fe3980058d0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.853+0000 7fe3ac400640 1 -- 172.21.15.1:0/3442664025 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3a41049a0 msgr2=0x7fe3a419ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:32.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.853+0000 7fe3ac400640 1 --2- 172.21.15.1:0/3442664025 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3a41049a0 0x7fe3a419ab40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe39000e9f0 tx=0x7fe39000edf0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.853+0000 7fe3ac400640 1 -- 172.21.15.1:0/3442664025 shutdown_connections 2024-09-15T22:22:32.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.853+0000 7fe3ac400640 1 --2- 172.21.15.1:0/3442664025 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe38c0a3240 0x7fe38c0a5700 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.853+0000 7fe3ac400640 1 --2- 172.21.15.1:0/3442664025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3a4109120 0x7fe3a419eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.853+0000 7fe3ac400640 1 --2- 172.21.15.1:0/3442664025 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3a41049a0 0x7fe3a419ab40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.853+0000 7fe3ac400640 1 --2- 172.21.15.1:0/3442664025 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3a4103ff0 0x7fe3a419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.853+0000 7fe3ac400640 1 -- 172.21.15.1:0/3442664025 >> 172.21.15.1:0/3442664025 conn(0x7fe3a40ffa90 msgr2=0x7fe3a4100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:32.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.854+0000 7fe3ac400640 1 -- 172.21.15.1:0/3442664025 shutdown_connections 2024-09-15T22:22:32.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:32.854+0000 7fe3ac400640 1 -- 172.21.15.1:0/3442664025 wait complete. 2024-09-15T22:22:33.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:33 smithi001 ceph-mon[30843]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:33.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:33 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:33.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:33 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:33.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:33 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:33.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:33 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:33.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:33 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:33.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:33 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:33.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:33 smithi001 ceph-mon[30843]: Deploying daemon mds.a on smithi001 2024-09-15T22:22:33.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:33 smithi001 ceph-mon[30843]: mds.? [v2:172.21.15.1:6838/3887277479,v1:172.21.15.1:6839/3887277479] up:boot 2024-09-15T22:22:33.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:33 smithi001 ceph-mon[30843]: fsmap 10 up:standby 2024-09-15T22:22:33.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:33 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T22:22:33.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:33 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/3442664025' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:22:33.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:33 smithi012 ceph-mon[34883]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:33.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:33 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:33.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:33 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:33.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:33 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:33.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:33 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:33.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:33 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:33.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:33 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:33.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:33 smithi012 ceph-mon[34883]: Deploying daemon mds.a on smithi001 2024-09-15T22:22:33.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:33 smithi012 ceph-mon[34883]: mds.? [v2:172.21.15.1:6838/3887277479,v1:172.21.15.1:6839/3887277479] up:boot 2024-09-15T22:22:33.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:33 smithi012 ceph-mon[34883]: fsmap 10 up:standby 2024-09-15T22:22:33.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:33 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T22:22:33.497 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:33 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/3442664025' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:22:33.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:33 smithi098 ceph-mon[35514]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:33.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:33 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:33.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:33 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:33.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:33 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:33.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:33 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:33.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:33 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:33.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:33 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:33.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:33 smithi098 ceph-mon[35514]: Deploying daemon mds.a on smithi001 2024-09-15T22:22:33.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:33 smithi098 ceph-mon[35514]: mds.? [v2:172.21.15.1:6838/3887277479,v1:172.21.15.1:6839/3887277479] up:boot 2024-09-15T22:22:33.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:33 smithi098 ceph-mon[35514]: fsmap 10 up:standby 2024-09-15T22:22:33.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:33 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T22:22:33.562 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:33 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/3442664025' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:22:35.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:35 smithi001 ceph-mon[30843]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:35.376 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 15 22:22:35 smithi001 podman[69478]: 2024-09-15 22:22:35.262536953 +0000 UTC m=+0.155398686 container create b0beb6cadcb15c0033610aa15ee1bbf2008ffea0449f87705269fc35a7ed20e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-a, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:22:35.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:35 smithi012 ceph-mon[34883]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:35.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:35 smithi098 ceph-mon[35514]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:35.876 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 15 22:22:35 smithi001 podman[69478]: 2024-09-15 22:22:35.548439553 +0000 UTC m=+0.441301247 container init b0beb6cadcb15c0033610aa15ee1bbf2008ffea0449f87705269fc35a7ed20e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-15T22:22:35.876 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 15 22:22:35 smithi001 podman[69478]: 2024-09-15 22:22:35.554778585 +0000 UTC m=+0.447640278 container start b0beb6cadcb15c0033610aa15ee1bbf2008ffea0449f87705269fc35a7ed20e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-a, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-15T22:22:35.876 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 15 22:22:35 smithi001 ceph-mds[69497]: -- 172.21.15.1:0/609868664 <== mon.0 v2:172.21.15.1:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562a888f7c20 con 0x562a888d4800 2024-09-15T22:22:35.876 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 15 22:22:35 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-a[69493]: starting mds.a at 2024-09-15T22:22:35.877 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 15 22:22:35 smithi001 bash[69478]: b0beb6cadcb15c0033610aa15ee1bbf2008ffea0449f87705269fc35a7ed20e4 2024-09-15T22:22:35.877 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 15 22:22:35 smithi001 systemd[1]: Started Ceph mds.a for c1228c44-73af-11ef-bceb-c7b262605968. 2024-09-15T22:22:36.966 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:36 smithi012 ceph-mon[34883]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:36.966 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:36 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:36.966 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:36 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:36.966 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:36 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:36.966 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:36 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:36.966 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:36 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:36.966 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:36 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:36.966 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:36 smithi012 ceph-mon[34883]: Deploying daemon mds.b on smithi012 2024-09-15T22:22:36.966 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:36 smithi012 ceph-mon[34883]: mds.? [v2:172.21.15.1:6840/1674822398,v1:172.21.15.1:6841/1674822398] up:boot 2024-09-15T22:22:36.966 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:36 smithi012 ceph-mon[34883]: fsmap 11 up:standby 2024-09-15T22:22:36.967 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:36 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T22:22:36.988 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:22:37.046 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:36 smithi001 ceph-mon[30843]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:37.046 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:36 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:37.046 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:36 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:37.046 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:36 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:37.047 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:36 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:37.047 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:36 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:37.047 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:36 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:37.047 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:36 smithi001 ceph-mon[30843]: Deploying daemon mds.b on smithi012 2024-09-15T22:22:37.047 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:36 smithi001 ceph-mon[30843]: mds.? [v2:172.21.15.1:6840/1674822398,v1:172.21.15.1:6841/1674822398] up:boot 2024-09-15T22:22:37.047 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:36 smithi001 ceph-mon[30843]: fsmap 11 up:standby 2024-09-15T22:22:37.047 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:36 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T22:22:37.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:36 smithi098 ceph-mon[35514]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:37.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:36 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:37.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:36 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:37.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:36 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:37.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:36 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:22:37.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:36 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:22:37.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:36 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:37.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:36 smithi098 ceph-mon[35514]: Deploying daemon mds.b on smithi012 2024-09-15T22:22:37.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:36 smithi098 ceph-mon[35514]: mds.? [v2:172.21.15.1:6840/1674822398,v1:172.21.15.1:6841/1674822398] up:boot 2024-09-15T22:22:37.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:36 smithi098 ceph-mon[35514]: fsmap 11 up:standby 2024-09-15T22:22:37.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:36 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T22:22:37.383 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:22:37.996 INFO:journalctl@ceph.mds.b.smithi012.stdout:Sep 15 22:22:37 smithi012 systemd[1]: Starting Ceph mds.b for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:22:38.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.081+0000 7f836b400640 1 -- 172.21.15.1:0/1292737878 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8364101de0 msgr2=0x7f83641021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:38.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.081+0000 7f836b400640 1 --2- 172.21.15.1:0/1292737878 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8364101de0 0x7f83641021c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8354009900 tx=0x7f835402a3f0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.081+0000 7f836b400640 1 -- 172.21.15.1:0/1292737878 shutdown_connections 2024-09-15T22:22:38.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.081+0000 7f836b400640 1 --2- 172.21.15.1:0/1292737878 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8364106f10 0x7f836410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.081+0000 7f836b400640 1 --2- 172.21.15.1:0/1292737878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8364102790 0x7f83641067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.081+0000 7f836b400640 1 --2- 172.21.15.1:0/1292737878 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8364101de0 0x7f83641021c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.081+0000 7f836b400640 1 -- 172.21.15.1:0/1292737878 >> 172.21.15.1:0/1292737878 conn(0x7f83640fd8c0 msgr2=0x7f83640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:38.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.082+0000 7f836b400640 1 -- 172.21.15.1:0/1292737878 shutdown_connections 2024-09-15T22:22:38.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.082+0000 7f836b400640 1 -- 172.21.15.1:0/1292737878 wait complete. 2024-09-15T22:22:38.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.083+0000 7f836b400640 1 Processor -- start 2024-09-15T22:22:38.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.083+0000 7f836b400640 1 -- start start 2024-09-15T22:22:38.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.083+0000 7f836b400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8364101de0 0x7f836419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:38.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.083+0000 7f836b400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8364102790 0x7f836419ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:38.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.083+0000 7f836b400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8364106f10 0x7f836419ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:38.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.083+0000 7f836b400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8364111f80 con 0x7f8364102790 2024-09-15T22:22:38.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.083+0000 7f836b400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8364111e00 con 0x7f8364101de0 2024-09-15T22:22:38.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.083+0000 7f836b400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8364112100 con 0x7f8364106f10 2024-09-15T22:22:38.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.083+0000 7f835be00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8364102790 0x7f836419ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:38.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.083+0000 7f835be00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8364102790 0x7f836419ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44604/0 (socket says 172.21.15.1:44604) 2024-09-15T22:22:38.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.083+0000 7f835be00640 1 -- 172.21.15.1:0/520442575 learned_addr learned my addr 172.21.15.1:0/520442575 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:22:38.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.083+0000 7f8368a00640 1 --2- 172.21.15.1:0/520442575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8364101de0 0x7f836419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:38.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.083+0000 7f8369400640 1 --2- 172.21.15.1:0/520442575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8364106f10 0x7f836419ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:38.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.084+0000 7f8368a00640 1 -- 172.21.15.1:0/520442575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8364106f10 msgr2=0x7f836419ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:38.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.084+0000 7f8368a00640 1 --2- 172.21.15.1:0/520442575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8364106f10 0x7f836419ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.084+0000 7f8368a00640 1 -- 172.21.15.1:0/520442575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8364102790 msgr2=0x7f836419ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:38.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.084+0000 7f8368a00640 1 --2- 172.21.15.1:0/520442575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8364102790 0x7f836419ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.084+0000 7f8368a00640 1 -- 172.21.15.1:0/520442575 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f836419f670 con 0x7f8364101de0 2024-09-15T22:22:38.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.084+0000 7f835be00640 1 --2- 172.21.15.1:0/520442575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8364102790 0x7f836419ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:22:38.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.084+0000 7f8368a00640 1 --2- 172.21.15.1:0/520442575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8364101de0 0x7f836419a6c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f835402a910 tx=0x7f8354003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:38.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.084+0000 7f8362000640 1 -- 172.21.15.1:0/520442575 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835403f070 con 0x7f8364101de0 2024-09-15T22:22:38.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.085+0000 7f8362000640 1 -- 172.21.15.1:0/520442575 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8354031c90 con 0x7f8364101de0 2024-09-15T22:22:38.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.085+0000 7f836b400640 1 -- 172.21.15.1:0/520442575 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f836419f900 con 0x7f8364101de0 2024-09-15T22:22:38.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.085+0000 7f836b400640 1 -- 172.21.15.1:0/520442575 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83641a7240 con 0x7f8364101de0 2024-09-15T22:22:38.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.085+0000 7f8362000640 1 -- 172.21.15.1:0/520442575 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8354035030 con 0x7f8364101de0 2024-09-15T22:22:38.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.086+0000 7f836b400640 1 -- 172.21.15.1:0/520442575 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83641021c0 con 0x7f8364101de0 2024-09-15T22:22:38.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.088+0000 7f8362000640 1 -- 172.21.15.1:0/520442575 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f8354042070 con 0x7f8364101de0 2024-09-15T22:22:38.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.089+0000 7f8362000640 1 --2- 172.21.15.1:0/520442575 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f83480a32c0 0x7f83480a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:38.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.089+0000 7f8362000640 1 -- 172.21.15.1:0/520442575 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f83540efaa0 con 0x7f8364101de0 2024-09-15T22:22:38.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.089+0000 7f835be00640 1 --2- 172.21.15.1:0/520442575 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f83480a32c0 0x7f83480a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:38.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.090+0000 7f835be00640 1 --2- 172.21.15.1:0/520442575 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f83480a32c0 0x7f83480a5780 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f836410eee0 tx=0x7f834c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:38.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.093+0000 7f8362000640 1 -- 172.21.15.1:0/520442575 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f83540bc570 con 0x7f8364101de0 2024-09-15T22:22:38.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.315+0000 7f836b400640 1 -- 172.21.15.1:0/520442575 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f83641a7410 con 0x7f8364101de0 2024-09-15T22:22:38.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.316+0000 7f8362000640 1 -- 172.21.15.1:0/520442575 <== mon.2 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9668 (secure 0 0 0) 0x7f83540c0870 con 0x7f8364101de0 2024-09-15T22:22:38.318 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:22:38.318 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":12,"btime":"2024-09-15T22:22:36:093909+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2417768032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2417768032},{"type":"v1","addr":"172.21.15.1:6835","nonce":2417768032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14493,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2957993064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2957993064},{"type":"v1","addr":"172.21.15.1:6837","nonce":2957993064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14529,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3887277479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3887277479},{"type":"v1","addr":"172.21.15.1:6839","nonce":3887277479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14541,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/1674822398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":1674822398},{"type":"v1","addr":"172.21.15.1:6841","nonce":1674822398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3122570659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3122570659},{"type":"v1","addr":"172.21.15.12:6833","nonce":3122570659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2901262900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2901262900},{"type":"v1","addr":"172.21.15.12:6835","nonce":2901262900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/94050093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":94050093},{"type":"v1","addr":"172.21.15.98:6833","nonce":94050093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2378138381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2378138381},{"type":"v1","addr":"172.21.15.12:6837","nonce":2378138381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/1848806705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1848806705},{"type":"v1","addr":"172.21.15.98:6835","nonce":1848806705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24520,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/493594054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":493594054},{"type":"v1","addr":"172.21.15.98:6837","nonce":493594054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24538,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2831161859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2831161859},{"type":"v1","addr":"172.21.15.98:6839","nonce":2831161859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-15T22:22:38.319 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 12 2024-09-15T22:22:38.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.318+0000 7f836b400640 1 -- 172.21.15.1:0/520442575 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f83480a32c0 msgr2=0x7f83480a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:38.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.318+0000 7f836b400640 1 --2- 172.21.15.1:0/520442575 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f83480a32c0 0x7f83480a5780 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f836410eee0 tx=0x7f834c005f90 comp rx=0 tx=0).stop 2024-09-15T22:22:38.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.318+0000 7f836b400640 1 -- 172.21.15.1:0/520442575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8364101de0 msgr2=0x7f836419a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:38.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.318+0000 7f836b400640 1 --2- 172.21.15.1:0/520442575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8364101de0 0x7f836419a6c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f835402a910 tx=0x7f8354003b90 comp rx=0 tx=0).stop 2024-09-15T22:22:38.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.319+0000 7f836b400640 1 -- 172.21.15.1:0/520442575 shutdown_connections 2024-09-15T22:22:38.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.319+0000 7f836b400640 1 --2- 172.21.15.1:0/520442575 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f83480a32c0 0x7f83480a5780 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.319+0000 7f836b400640 1 --2- 172.21.15.1:0/520442575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8364106f10 0x7f836419ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.319+0000 7f836b400640 1 --2- 172.21.15.1:0/520442575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8364102790 0x7f836419ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.319+0000 7f836b400640 1 --2- 172.21.15.1:0/520442575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8364101de0 0x7f836419a6c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.319+0000 7f836b400640 1 -- 172.21.15.1:0/520442575 >> 172.21.15.1:0/520442575 conn(0x7f83640fd8c0 msgr2=0x7f83640ffc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:38.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.319+0000 7f836b400640 1 -- 172.21.15.1:0/520442575 shutdown_connections 2024-09-15T22:22:38.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:38.319+0000 7f836b400640 1 -- 172.21.15.1:0/520442575 wait complete. 2024-09-15T22:22:38.364 INFO:journalctl@ceph.mds.b.smithi012.stdout:Sep 15 22:22:38 smithi012 podman[65013]: 2024-09-15 22:22:37.993092478 +0000 UTC m=+0.015888401 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:22:38.364 INFO:journalctl@ceph.mds.b.smithi012.stdout:Sep 15 22:22:38 smithi012 podman[65013]: 2024-09-15 22:22:38.092164574 +0000 UTC m=+0.114960496 container create 13ce424b84e7f1ea6c71f0d8b304cd2081c59bfe8c1c127a045ae5a10b3db09a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-b, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-15T22:22:38.364 INFO:journalctl@ceph.mds.b.smithi012.stdout:Sep 15 22:22:38 smithi012 podman[65013]: 2024-09-15 22:22:38.336532037 +0000 UTC m=+0.359327962 container init 13ce424b84e7f1ea6c71f0d8b304cd2081c59bfe8c1c127a045ae5a10b3db09a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-b, RELEASE=squid-8921c8e, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-15T22:22:38.364 INFO:journalctl@ceph.mds.b.smithi012.stdout:Sep 15 22:22:38 smithi012 podman[65013]: 2024-09-15 22:22:38.339496411 +0000 UTC m=+0.362292334 container start 13ce424b84e7f1ea6c71f0d8b304cd2081c59bfe8c1c127a045ae5a10b3db09a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-b, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-15T22:22:38.726 INFO:journalctl@ceph.mds.b.smithi012.stdout:Sep 15 22:22:38 smithi012 ceph-mds[65032]: -- 172.21.15.12:0/3700306019 <== mon.2 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563a35af9860 con 0x563a35ad6800 2024-09-15T22:22:38.727 INFO:journalctl@ceph.mds.b.smithi012.stdout:Sep 15 22:22:38 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-b[65028]: starting mds.b at 2024-09-15T22:22:38.727 INFO:journalctl@ceph.mds.b.smithi012.stdout:Sep 15 22:22:38 smithi012 bash[65013]: 13ce424b84e7f1ea6c71f0d8b304cd2081c59bfe8c1c127a045ae5a10b3db09a 2024-09-15T22:22:38.727 INFO:journalctl@ceph.mds.b.smithi012.stdout:Sep 15 22:22:38 smithi012 systemd[1]: Started Ceph mds.b for c1228c44-73af-11ef-bceb-c7b262605968. 2024-09-15T22:22:38.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:38 smithi012 ceph-mon[34883]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:38.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:38 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/520442575' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:22:38.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:38 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:38.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:38 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:38.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:38 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:38.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:38 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:38.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:38 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:38.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:38 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:22:39.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:38 smithi098 ceph-mon[35514]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:39.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:38 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/520442575' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:22:39.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:38 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:39.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:38 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:39.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:38 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:39.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:38 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:39.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:38 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:39.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:38 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:22:39.075 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:38 smithi001 ceph-mon[30843]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:39.075 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:38 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/520442575' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:22:39.075 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:38 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:39.075 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:38 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:39.075 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:38 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:39.075 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:38 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:39.075 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:38 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:39.075 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:38 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:22:39.895 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:39 smithi001 ceph-mon[30843]: mds.? [v2:172.21.15.12:6838/1469511155,v1:172.21.15.12:6839/1469511155] up:boot 2024-09-15T22:22:39.895 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:39 smithi001 ceph-mon[30843]: fsmap 12 up:standby 2024-09-15T22:22:39.895 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:39 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T22:22:39.994 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:39 smithi012 ceph-mon[34883]: mds.? [v2:172.21.15.12:6838/1469511155,v1:172.21.15.12:6839/1469511155] up:boot 2024-09-15T22:22:39.994 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:39 smithi012 ceph-mon[34883]: fsmap 12 up:standby 2024-09-15T22:22:39.994 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:39 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T22:22:40.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:39 smithi098 ceph-mon[35514]: mds.? [v2:172.21.15.12:6838/1469511155,v1:172.21.15.12:6839/1469511155] up:boot 2024-09-15T22:22:40.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:39 smithi098 ceph-mon[35514]: fsmap 12 up:standby 2024-09-15T22:22:40.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:39 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T22:22:41.116 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:22:41.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:41 smithi098 ceph-mon[35514]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:41.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:41 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:41.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:41 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:41.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:41 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:41.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:41 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:41.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:41 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:41.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:41 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:41.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:41 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:41.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:41 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:22:41.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:41 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:41.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:41 smithi001 ceph-mon[30843]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:41.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:41 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:41.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:41 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:41.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:41 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:41.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:41 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:41.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:41 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:41.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:41 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:41.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:41 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:41.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:41 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:22:41.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:41 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:41.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:41 smithi012 ceph-mon[34883]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:41.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:41 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:41.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:41 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:41.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:41 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:41.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:41 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:41.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:41 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:41.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:41 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:41.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:41 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:41.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:41 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:22:41.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:41 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:41.523 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:22:42.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.119+0000 7f3f17600640 1 -- 172.21.15.1:0/3623196247 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f10101de0 msgr2=0x7f3f101021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:42.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.119+0000 7f3f17600640 1 --2- 172.21.15.1:0/3623196247 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f10101de0 0x7f3f101021c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3f00009900 tx=0x7f3f0002a3f0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.120+0000 7f3f17600640 1 -- 172.21.15.1:0/3623196247 shutdown_connections 2024-09-15T22:22:42.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.120+0000 7f3f17600640 1 --2- 172.21.15.1:0/3623196247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f10106f10 0x7f3f1010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.120+0000 7f3f17600640 1 --2- 172.21.15.1:0/3623196247 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f10102790 0x7f3f101067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.120+0000 7f3f17600640 1 --2- 172.21.15.1:0/3623196247 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f10101de0 0x7f3f101021c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.120+0000 7f3f17600640 1 -- 172.21.15.1:0/3623196247 >> 172.21.15.1:0/3623196247 conn(0x7f3f100fd8c0 msgr2=0x7f3f100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:42.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.120+0000 7f3f17600640 1 -- 172.21.15.1:0/3623196247 shutdown_connections 2024-09-15T22:22:42.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.120+0000 7f3f17600640 1 -- 172.21.15.1:0/3623196247 wait complete. 2024-09-15T22:22:42.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.121+0000 7f3f17600640 1 Processor -- start 2024-09-15T22:22:42.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.121+0000 7f3f17600640 1 -- start start 2024-09-15T22:22:42.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.121+0000 7f3f17600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f10101de0 0x7f3f101984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:42.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.121+0000 7f3f17600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f10102790 0x7f3f101989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:42.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.121+0000 7f3f17600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f10106f10 0x7f3f1019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:42.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.121+0000 7f3f17600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3f10111f70 con 0x7f3f10101de0 2024-09-15T22:22:42.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.121+0000 7f3f17600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3f10111df0 con 0x7f3f10106f10 2024-09-15T22:22:42.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.121+0000 7f3f17600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3f101120f0 con 0x7f3f10102790 2024-09-15T22:22:42.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.121+0000 7f3f14c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f10101de0 0x7f3f101984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:42.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.122+0000 7f3f07e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f10102790 0x7f3f101989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:42.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.122+0000 7f3f15600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f10106f10 0x7f3f1019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:42.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.122+0000 7f3f15600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f10106f10 0x7f3f1019cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:35284/0 (socket says 172.21.15.1:35284) 2024-09-15T22:22:42.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.122+0000 7f3f14c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f10101de0 0x7f3f101984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44618/0 (socket says 172.21.15.1:44618) 2024-09-15T22:22:42.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.122+0000 7f3f07e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f10102790 0x7f3f101989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:56360/0 (socket says 172.21.15.1:56360) 2024-09-15T22:22:42.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.122+0000 7f3f15600640 1 -- 172.21.15.1:0/169779084 learned_addr learned my addr 172.21.15.1:0/169779084 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:22:42.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.122+0000 7f3f07e00640 1 -- 172.21.15.1:0/169779084 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f10106f10 msgr2=0x7f3f1019cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:42.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.122+0000 7f3f07e00640 1 --2- 172.21.15.1:0/169779084 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f10106f10 0x7f3f1019cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.122+0000 7f3f07e00640 1 -- 172.21.15.1:0/169779084 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f10101de0 msgr2=0x7f3f101984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:42.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.122+0000 7f3f07e00640 1 --2- 172.21.15.1:0/169779084 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f10101de0 0x7f3f101984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.122+0000 7f3f07e00640 1 -- 172.21.15.1:0/169779084 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f1019d460 con 0x7f3f10102790 2024-09-15T22:22:42.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.122+0000 7f3f14c00640 1 --2- 172.21.15.1:0/169779084 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f10101de0 0x7f3f101984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:22:42.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.122+0000 7f3f15600640 1 --2- 172.21.15.1:0/169779084 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f10106f10 0x7f3f1019cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:22:42.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.122+0000 7f3f07e00640 1 --2- 172.21.15.1:0/169779084 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f10102790 0x7f3f101989f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3ef800e9f0 tx=0x7f3ef800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:42.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.123+0000 7f3f0e000640 1 -- 172.21.15.1:0/169779084 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef800ccc0 con 0x7f3f10102790 2024-09-15T22:22:42.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.123+0000 7f3f0e000640 1 -- 172.21.15.1:0/169779084 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ef8005020 con 0x7f3f10102790 2024-09-15T22:22:42.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.123+0000 7f3f0e000640 1 -- 172.21.15.1:0/169779084 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef80049e0 con 0x7f3f10102790 2024-09-15T22:22:42.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.123+0000 7f3f17600640 1 -- 172.21.15.1:0/169779084 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f1019d750 con 0x7f3f10102790 2024-09-15T22:22:42.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.123+0000 7f3f17600640 1 -- 172.21.15.1:0/169779084 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f101a5030 con 0x7f3f10102790 2024-09-15T22:22:42.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.124+0000 7f3f17600640 1 -- 172.21.15.1:0/169779084 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f101021c0 con 0x7f3f10102790 2024-09-15T22:22:42.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.126+0000 7f3f0e000640 1 -- 172.21.15.1:0/169779084 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f3ef8005560 con 0x7f3f10102790 2024-09-15T22:22:42.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.127+0000 7f3f0e000640 1 --2- 172.21.15.1:0/169779084 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3ef40a32c0 0x7f3ef40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:42.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.127+0000 7f3f0e000640 1 -- 172.21.15.1:0/169779084 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f3ef80cf420 con 0x7f3f10102790 2024-09-15T22:22:42.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.127+0000 7f3f14c00640 1 --2- 172.21.15.1:0/169779084 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3ef40a32c0 0x7f3ef40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:42.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.128+0000 7f3f14c00640 1 --2- 172.21.15.1:0/169779084 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3ef40a32c0 0x7f3ef40a5780 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3f00009230 tx=0x7f3f000058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:42.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.131+0000 7f3f0e000640 1 -- 172.21.15.1:0/169779084 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3ef80051d0 con 0x7f3f10102790 2024-09-15T22:22:42.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:42 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:22:42.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:42 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:42.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.354+0000 7f3f17600640 1 -- 172.21.15.1:0/169779084 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f10109b60 con 0x7f3f10102790 2024-09-15T22:22:42.356 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:42 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:22:42.357 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:42 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:42.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.355+0000 7f3f0e000640 1 -- 172.21.15.1:0/169779084 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10494 (secure 0 0 0) 0x7f3ef809c540 con 0x7f3f10102790 2024-09-15T22:22:42.357 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:22:42.358 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":13,"btime":"2024-09-15T22:22:38:724429+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2417768032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2417768032},{"type":"v1","addr":"172.21.15.1:6835","nonce":2417768032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14493,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2957993064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2957993064},{"type":"v1","addr":"172.21.15.1:6837","nonce":2957993064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14529,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3887277479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3887277479},{"type":"v1","addr":"172.21.15.1:6839","nonce":3887277479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14541,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/1674822398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":1674822398},{"type":"v1","addr":"172.21.15.1:6841","nonce":1674822398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3122570659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3122570659},{"type":"v1","addr":"172.21.15.12:6833","nonce":3122570659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2901262900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2901262900},{"type":"v1","addr":"172.21.15.12:6835","nonce":2901262900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/94050093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":94050093},{"type":"v1","addr":"172.21.15.98:6833","nonce":94050093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2378138381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2378138381},{"type":"v1","addr":"172.21.15.12:6837","nonce":2378138381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/1848806705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1848806705},{"type":"v1","addr":"172.21.15.98:6835","nonce":1848806705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24520,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/493594054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":493594054},{"type":"v1","addr":"172.21.15.98:6837","nonce":493594054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24524,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/1469511155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":1469511155},{"type":"v1","addr":"172.21.15.12:6839","nonce":1469511155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24538,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2831161859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2831161859},{"type":"v1","addr":"172.21.15.98:6839","nonce":2831161859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-15T22:22:42.358 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 13 2024-09-15T22:22:42.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.357+0000 7f3f17600640 1 -- 172.21.15.1:0/169779084 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3ef40a32c0 msgr2=0x7f3ef40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:42.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.357+0000 7f3f17600640 1 --2- 172.21.15.1:0/169779084 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3ef40a32c0 0x7f3ef40a5780 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3f00009230 tx=0x7f3f000058d0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.357+0000 7f3f17600640 1 -- 172.21.15.1:0/169779084 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f10102790 msgr2=0x7f3f101989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:42.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.357+0000 7f3f17600640 1 --2- 172.21.15.1:0/169779084 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f10102790 0x7f3f101989f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3ef800e9f0 tx=0x7f3ef800eeb0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.357+0000 7f3f17600640 1 -- 172.21.15.1:0/169779084 shutdown_connections 2024-09-15T22:22:42.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.357+0000 7f3f17600640 1 --2- 172.21.15.1:0/169779084 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3ef40a32c0 0x7f3ef40a5780 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.357+0000 7f3f17600640 1 --2- 172.21.15.1:0/169779084 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f10106f10 0x7f3f1019cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.357+0000 7f3f17600640 1 --2- 172.21.15.1:0/169779084 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f10102790 0x7f3f101989f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.357+0000 7f3f17600640 1 --2- 172.21.15.1:0/169779084 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f10101de0 0x7f3f101984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.357+0000 7f3f17600640 1 -- 172.21.15.1:0/169779084 >> 172.21.15.1:0/169779084 conn(0x7f3f100fd8c0 msgr2=0x7f3f100fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:42.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.358+0000 7f3f17600640 1 -- 172.21.15.1:0/169779084 shutdown_connections 2024-09-15T22:22:42.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:42.358+0000 7f3f17600640 1 -- 172.21.15.1:0/169779084 wait complete. 2024-09-15T22:22:42.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:42 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:22:42.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:42 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:43.215 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:43 smithi001 ceph-mon[30843]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:43.215 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:43 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/169779084' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:22:43.215 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:43 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:43.215 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:43 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:43.215 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:43 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:43.215 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:43 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:43.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:43 smithi098 ceph-mon[35514]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:43.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:43 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/169779084' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:22:43.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:43 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:43.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:43 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:43.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:43 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:43.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:43 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:43.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:43 smithi012 ceph-mon[34883]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:43.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:43 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/169779084' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:22:43.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:43 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:43.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:43 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:43.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:43 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:43.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:43 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:43.576 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-15T22:22:43.999 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:22:44.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.565+0000 7f4ccf600640 1 -- 172.21.15.1:0/1978114307 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4cc8106f10 msgr2=0x7f4cc810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:44.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.565+0000 7f4ccf600640 1 --2- 172.21.15.1:0/1978114307 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4cc8106f10 0x7f4cc810ea90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0009ca0 tx=0x7f4cc002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:22:44.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.565+0000 7f4ccf600640 1 -- 172.21.15.1:0/1978114307 shutdown_connections 2024-09-15T22:22:44.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.565+0000 7f4ccf600640 1 --2- 172.21.15.1:0/1978114307 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4cc8106f10 0x7f4cc810ea90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:44.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.566+0000 7f4ccf600640 1 --2- 172.21.15.1:0/1978114307 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4cc8102790 0x7f4cc81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:44.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.566+0000 7f4ccf600640 1 --2- 172.21.15.1:0/1978114307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cc8101de0 0x7f4cc81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:44.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.566+0000 7f4ccf600640 1 -- 172.21.15.1:0/1978114307 >> 172.21.15.1:0/1978114307 conn(0x7f4cc80fd8c0 msgr2=0x7f4cc80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:44.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.566+0000 7f4ccf600640 1 -- 172.21.15.1:0/1978114307 shutdown_connections 2024-09-15T22:22:44.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.566+0000 7f4ccf600640 1 -- 172.21.15.1:0/1978114307 wait complete. 2024-09-15T22:22:44.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.566+0000 7f4ccf600640 1 Processor -- start 2024-09-15T22:22:44.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.567+0000 7f4ccf600640 1 -- start start 2024-09-15T22:22:44.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.567+0000 7f4ccf600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4cc8101de0 0x7f4cc819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:44.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.567+0000 7f4ccf600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cc8102790 0x7f4cc819aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:44.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.567+0000 7f4ccf600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4cc8106f10 0x7f4cc819ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:44.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.567+0000 7f4ccf600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc8111fc0 con 0x7f4cc8101de0 2024-09-15T22:22:44.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.567+0000 7f4ccf600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc8111e40 con 0x7f4cc8102790 2024-09-15T22:22:44.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.567+0000 7f4ccf600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc8112140 con 0x7f4cc8106f10 2024-09-15T22:22:44.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.567+0000 7f4cccc00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4cc8101de0 0x7f4cc819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:44.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.567+0000 7f4cccc00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4cc8101de0 0x7f4cc819a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44630/0 (socket says 172.21.15.1:44630) 2024-09-15T22:22:44.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.567+0000 7f4cccc00640 1 -- 172.21.15.1:0/2402887081 learned_addr learned my addr 172.21.15.1:0/2402887081 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:22:44.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.567+0000 7f4ccd600640 1 --2- 172.21.15.1:0/2402887081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4cc8106f10 0x7f4cc819ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:44.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.568+0000 7f4cc7e00640 1 --2- 172.21.15.1:0/2402887081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cc8102790 0x7f4cc819aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:44.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.568+0000 7f4cccc00640 1 -- 172.21.15.1:0/2402887081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4cc8106f10 msgr2=0x7f4cc819ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:44.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.568+0000 7f4cccc00640 1 --2- 172.21.15.1:0/2402887081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4cc8106f10 0x7f4cc819ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:44.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.568+0000 7f4cccc00640 1 -- 172.21.15.1:0/2402887081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cc8102790 msgr2=0x7f4cc819aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:44.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.568+0000 7f4cccc00640 1 --2- 172.21.15.1:0/2402887081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cc8102790 0x7f4cc819aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:44.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.568+0000 7f4cccc00640 1 -- 172.21.15.1:0/2402887081 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc819f560 con 0x7f4cc8101de0 2024-09-15T22:22:44.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.568+0000 7f4cccc00640 1 --2- 172.21.15.1:0/2402887081 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4cc8101de0 0x7f4cc819a5b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc00e9f0 tx=0x7f4cbc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:44.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.568+0000 7f4cc5600640 1 -- 172.21.15.1:0/2402887081 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc00cd80 con 0x7f4cc8101de0 2024-09-15T22:22:44.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.568+0000 7f4cc5600640 1 -- 172.21.15.1:0/2402887081 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cbc010910 con 0x7f4cc8101de0 2024-09-15T22:22:44.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.568+0000 7f4ccf600640 1 -- 172.21.15.1:0/2402887081 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc819f850 con 0x7f4cc8101de0 2024-09-15T22:22:44.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.569+0000 7f4cc5600640 1 -- 172.21.15.1:0/2402887081 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc018980 con 0x7f4cc8101de0 2024-09-15T22:22:44.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.569+0000 7f4ccf600640 1 -- 172.21.15.1:0/2402887081 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc81a7130 con 0x7f4cc8101de0 2024-09-15T22:22:44.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.570+0000 7f4ccf600640 1 -- 172.21.15.1:0/2402887081 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cc81021c0 con 0x7f4cc8101de0 2024-09-15T22:22:44.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.572+0000 7f4cc5600640 1 -- 172.21.15.1:0/2402887081 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f4cbc010ac0 con 0x7f4cc8101de0 2024-09-15T22:22:44.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.574+0000 7f4cc5600640 1 --2- 172.21.15.1:0/2402887081 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f4cb00a3240 0x7f4cb00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:44.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.574+0000 7f4cc5600640 1 -- 172.21.15.1:0/2402887081 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f4cbc0cf800 con 0x7f4cc8101de0 2024-09-15T22:22:44.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.574+0000 7f4cc7e00640 1 --2- 172.21.15.1:0/2402887081 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f4cb00a3240 0x7f4cb00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:44.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.575+0000 7f4cc7e00640 1 --2- 172.21.15.1:0/2402887081 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f4cb00a3240 0x7f4cb00a5700 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4cc81088e0 tx=0x7f4cb4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:44.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.578+0000 7f4cc5600640 1 -- 172.21.15.1:0/2402887081 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4cbc09c2d0 con 0x7f4cc8101de0 2024-09-15T22:22:44.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.783+0000 7f4ccf600640 1 -- 172.21.15.1:0/2402887081 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f4cc81a7420 con 0x7f4cc8101de0 2024-09-15T22:22:44.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.783+0000 7f4cc5600640 1 -- 172.21.15.1:0/2402887081 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v77) ==== 84+0+65 (secure 0 0 0) 0x7f4cbc0a05d0 con 0x7f4cc8101de0 2024-09-15T22:22:44.786 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:22:44.786 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2024-09-15T22:22:44.786 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:22:44.786 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 1, 2024-09-15T22:22:44.786 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": ".mgr" 2024-09-15T22:22:44.786 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:22:44.786 INFO:teuthology.orchestra.run.smithi001.stdout:] 2024-09-15T22:22:44.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.787+0000 7f4ccf600640 1 -- 172.21.15.1:0/2402887081 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f4cb00a3240 msgr2=0x7f4cb00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:44.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.787+0000 7f4ccf600640 1 --2- 172.21.15.1:0/2402887081 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f4cb00a3240 0x7f4cb00a5700 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4cc81088e0 tx=0x7f4cb4005f90 comp rx=0 tx=0).stop 2024-09-15T22:22:44.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.787+0000 7f4ccf600640 1 -- 172.21.15.1:0/2402887081 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4cc8101de0 msgr2=0x7f4cc819a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:44.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.787+0000 7f4ccf600640 1 --2- 172.21.15.1:0/2402887081 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4cc8101de0 0x7f4cc819a5b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc00e9f0 tx=0x7f4cbc00eeb0 comp rx=0 tx=0).stop 2024-09-15T22:22:44.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.787+0000 7f4ccf600640 1 -- 172.21.15.1:0/2402887081 shutdown_connections 2024-09-15T22:22:44.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.787+0000 7f4ccf600640 1 --2- 172.21.15.1:0/2402887081 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f4cb00a3240 0x7f4cb00a5700 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:44.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.787+0000 7f4ccf600640 1 --2- 172.21.15.1:0/2402887081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4cc8106f10 0x7f4cc819ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:44.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.787+0000 7f4ccf600640 1 --2- 172.21.15.1:0/2402887081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cc8102790 0x7f4cc819aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:44.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.787+0000 7f4ccf600640 1 --2- 172.21.15.1:0/2402887081 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4cc8101de0 0x7f4cc819a5b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:44.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.787+0000 7f4ccf600640 1 -- 172.21.15.1:0/2402887081 >> 172.21.15.1:0/2402887081 conn(0x7f4cc80fd8c0 msgr2=0x7f4cc80ffc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:44.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.787+0000 7f4ccf600640 1 -- 172.21.15.1:0/2402887081 shutdown_connections 2024-09-15T22:22:44.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:44.787+0000 7f4ccf600640 1 -- 172.21.15.1:0/2402887081 wait complete. 2024-09-15T22:22:45.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:45 smithi001 ceph-mon[30843]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:45.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:45 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:45.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:45 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:45.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:45 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:45.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:45 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:22:45.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:45 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:45.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:45 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/2402887081' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-15T22:22:45.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:45 smithi012 ceph-mon[34883]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:45.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:45 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:45.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:45 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:45.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:45 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:45.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:45 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:22:45.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:45 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:45.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:45 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/2402887081' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-15T22:22:45.542 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T22:22:45.543 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T22:22:45.560 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:45 smithi098 ceph-mon[35514]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:45.560 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:45 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:45.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:45 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:45.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:45 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:45.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:45 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:22:45.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:45 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:22:45.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:45 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/2402887081' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-15T22:22:45.932 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:22:46.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.536+0000 7fa8b0c00640 1 -- 172.21.15.1:0/1024015212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8ac076720 msgr2=0x7fa8ac076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:46.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.536+0000 7fa8b0c00640 1 --2- 172.21.15.1:0/1024015212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8ac076720 0x7fa8ac076b00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa89c009900 tx=0x7fa89c02a410 comp rx=0 tx=0).stop 2024-09-15T22:22:46.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.537+0000 7fa8b0c00640 1 -- 172.21.15.1:0/1024015212 shutdown_connections 2024-09-15T22:22:46.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.537+0000 7fa8b0c00640 1 --2- 172.21.15.1:0/1024015212 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8ac112a30 0x7fa8ac114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:46.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.537+0000 7fa8b0c00640 1 --2- 172.21.15.1:0/1024015212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8ac077040 0x7fa8ac1124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:46.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.537+0000 7fa8b0c00640 1 --2- 172.21.15.1:0/1024015212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8ac076720 0x7fa8ac076b00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:46.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.537+0000 7fa8b0c00640 1 -- 172.21.15.1:0/1024015212 >> 172.21.15.1:0/1024015212 conn(0x7fa8ac0ffa90 msgr2=0x7fa8ac101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:46.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.537+0000 7fa8b0c00640 1 -- 172.21.15.1:0/1024015212 shutdown_connections 2024-09-15T22:22:46.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.537+0000 7fa8b0c00640 1 -- 172.21.15.1:0/1024015212 wait complete. 2024-09-15T22:22:46.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.538+0000 7fa8b0c00640 1 Processor -- start 2024-09-15T22:22:46.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.538+0000 7fa8b0c00640 1 -- start start 2024-09-15T22:22:46.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.538+0000 7fa8b0c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8ac076720 0x7fa8ac1a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:46.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.538+0000 7fa8b0c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8ac077040 0x7fa8ac1a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:46.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.538+0000 7fa8b0c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8ac112a30 0x7fa8ac19e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:46.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.538+0000 7fa8b0c00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ac1185a0 con 0x7fa8ac112a30 2024-09-15T22:22:46.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.538+0000 7fa8b0c00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ac118420 con 0x7fa8ac076720 2024-09-15T22:22:46.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.538+0000 7fa8b0c00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ac118720 con 0x7fa8ac077040 2024-09-15T22:22:46.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.538+0000 7fa8aa800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8ac112a30 0x7fa8ac19e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:46.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.538+0000 7fa8a1400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8ac077040 0x7fa8ac1a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:46.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.539+0000 7fa8aa800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8ac112a30 0x7fa8ac19e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44650/0 (socket says 172.21.15.1:44650) 2024-09-15T22:22:46.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.539+0000 7fa8aa800640 1 -- 172.21.15.1:0/1374007365 learned_addr learned my addr 172.21.15.1:0/1374007365 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:22:46.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.539+0000 7fa8a1400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8ac077040 0x7fa8ac1a4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:56406/0 (socket says 172.21.15.1:56406) 2024-09-15T22:22:46.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.539+0000 7fa8a9e00640 1 --2- 172.21.15.1:0/1374007365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8ac076720 0x7fa8ac1a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:46.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.539+0000 7fa8a1400640 1 -- 172.21.15.1:0/1374007365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8ac076720 msgr2=0x7fa8ac1a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:46.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.539+0000 7fa8a1400640 1 --2- 172.21.15.1:0/1374007365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8ac076720 0x7fa8ac1a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:46.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.539+0000 7fa8a1400640 1 -- 172.21.15.1:0/1374007365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8ac112a30 msgr2=0x7fa8ac19e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:46.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.539+0000 7fa8a1400640 1 --2- 172.21.15.1:0/1374007365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8ac112a30 0x7fa8ac19e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:46.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.539+0000 7fa8a1400640 1 -- 172.21.15.1:0/1374007365 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8ac19f000 con 0x7fa8ac077040 2024-09-15T22:22:46.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.539+0000 7fa8aa800640 1 --2- 172.21.15.1:0/1374007365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8ac112a30 0x7fa8ac19e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:22:46.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.539+0000 7fa8a1400640 1 --2- 172.21.15.1:0/1374007365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8ac077040 0x7fa8ac1a4c50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa89400d6d0 tx=0x7fa89400db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:46.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.539+0000 7fa8a3400640 1 -- 172.21.15.1:0/1374007365 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa894017070 con 0x7fa8ac077040 2024-09-15T22:22:46.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.540+0000 7fa8a3400640 1 -- 172.21.15.1:0/1374007365 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa894009820 con 0x7fa8ac077040 2024-09-15T22:22:46.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.540+0000 7fa8b0c00640 1 -- 172.21.15.1:0/1374007365 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8ac19f2f0 con 0x7fa8ac077040 2024-09-15T22:22:46.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.540+0000 7fa8a3400640 1 -- 172.21.15.1:0/1374007365 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa894004d00 con 0x7fa8ac077040 2024-09-15T22:22:46.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.540+0000 7fa8b0c00640 1 -- 172.21.15.1:0/1374007365 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8ac1ab5e0 con 0x7fa8ac077040 2024-09-15T22:22:46.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.541+0000 7fa8b0c00640 1 -- 172.21.15.1:0/1374007365 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8ac076b00 con 0x7fa8ac077040 2024-09-15T22:22:46.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.543+0000 7fa8a3400640 1 -- 172.21.15.1:0/1374007365 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fa8940099d0 con 0x7fa8ac077040 2024-09-15T22:22:46.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.544+0000 7fa8a3400640 1 --2- 172.21.15.1:0/1374007365 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa8900a32c0 0x7fa8900a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:46.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.544+0000 7fa8a3400640 1 -- 172.21.15.1:0/1374007365 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fa8940cef90 con 0x7fa8ac077040 2024-09-15T22:22:46.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.544+0000 7fa8a9e00640 1 --2- 172.21.15.1:0/1374007365 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa8900a32c0 0x7fa8900a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:46.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.545+0000 7fa8a9e00640 1 --2- 172.21.15.1:0/1374007365 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa8900a32c0 0x7fa8900a5780 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac19fa10 tx=0x7fa89c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:46.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.548+0000 7fa8a3400640 1 -- 172.21.15.1:0/1374007365 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa89409ba60 con 0x7fa8ac077040 2024-09-15T22:22:46.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:46.734+0000 7fa8b0c00640 1 -- 172.21.15.1:0/1374007365 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fa8ac10dc20 con 0x7fa8ac077040 2024-09-15T22:22:47.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:47.323+0000 7fa8a3400640 1 -- 172.21.15.1:0/1374007365 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v78) ==== 138+0+0 (secure 0 0 0) 0x7fa89409fd60 con 0x7fa8ac077040 2024-09-15T22:22:47.324 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' created 2024-09-15T22:22:47.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:47.326+0000 7fa8b0c00640 1 -- 172.21.15.1:0/1374007365 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa8900a32c0 msgr2=0x7fa8900a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:47.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:47.326+0000 7fa8b0c00640 1 --2- 172.21.15.1:0/1374007365 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa8900a32c0 0x7fa8900a5780 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac19fa10 tx=0x7fa89c0058d0 comp rx=0 tx=0).stop 2024-09-15T22:22:47.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:47.326+0000 7fa8b0c00640 1 -- 172.21.15.1:0/1374007365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8ac077040 msgr2=0x7fa8ac1a4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:47.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:47.326+0000 7fa8b0c00640 1 --2- 172.21.15.1:0/1374007365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8ac077040 0x7fa8ac1a4c50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa89400d6d0 tx=0x7fa89400db90 comp rx=0 tx=0).stop 2024-09-15T22:22:47.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:47.326+0000 7fa8b0c00640 1 -- 172.21.15.1:0/1374007365 shutdown_connections 2024-09-15T22:22:47.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:47.326+0000 7fa8b0c00640 1 --2- 172.21.15.1:0/1374007365 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa8900a32c0 0x7fa8900a5780 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:47.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:47.326+0000 7fa8b0c00640 1 --2- 172.21.15.1:0/1374007365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8ac112a30 0x7fa8ac19e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:47.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:47.326+0000 7fa8b0c00640 1 --2- 172.21.15.1:0/1374007365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8ac077040 0x7fa8ac1a4c50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:47.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:47.326+0000 7fa8b0c00640 1 --2- 172.21.15.1:0/1374007365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8ac076720 0x7fa8ac1a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:47.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:47.326+0000 7fa8b0c00640 1 -- 172.21.15.1:0/1374007365 >> 172.21.15.1:0/1374007365 conn(0x7fa8ac0ffa90 msgr2=0x7fa8ac101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:47.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:47.326+0000 7fa8b0c00640 1 -- 172.21.15.1:0/1374007365 shutdown_connections 2024-09-15T22:22:47.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:47.326+0000 7fa8b0c00640 1 -- 172.21.15.1:0/1374007365 wait complete. 2024-09-15T22:22:47.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:47 smithi098 ceph-mon[35514]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:47.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:47 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/1374007365' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-15T22:22:47.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:47 smithi001 ceph-mon[30843]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:47.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:47 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/1374007365' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-15T22:22:47.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:47 smithi012 ceph-mon[34883]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:47.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:47 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/1374007365' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-15T22:22:48.059 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T22:22:48.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:48 smithi001 ceph-mon[30843]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-15T22:22:48.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:48 smithi001 ceph-mon[30843]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-15T22:22:48.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:48 smithi001 ceph-mon[30843]: osdmap e78: 12 total, 12 up, 12 in 2024-09-15T22:22:48.454 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:22:48.560 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:48 smithi098 ceph-mon[35514]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-15T22:22:48.560 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:48 smithi098 ceph-mon[35514]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-15T22:22:48.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:48 smithi098 ceph-mon[35514]: osdmap e78: 12 total, 12 up, 12 in 2024-09-15T22:22:48.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:48 smithi012 ceph-mon[34883]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-15T22:22:48.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:48 smithi012 ceph-mon[34883]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-15T22:22:48.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:48 smithi012 ceph-mon[34883]: osdmap e78: 12 total, 12 up, 12 in 2024-09-15T22:22:49.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.024+0000 7f6df2200640 1 -- 172.21.15.1:0/506565656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6dec1079c0 msgr2=0x7f6dec107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:49.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.024+0000 7f6df2200640 1 --2- 172.21.15.1:0/506565656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6dec1079c0 0x7f6dec107da0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc009cd0 tx=0x7f6ddc02a8f0 comp rx=0 tx=0).stop 2024-09-15T22:22:49.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.024+0000 7f6df2200640 1 -- 172.21.15.1:0/506565656 shutdown_connections 2024-09-15T22:22:49.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.024+0000 7f6df2200640 1 --2- 172.21.15.1:0/506565656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6dec102360 0x7f6dec10e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:49.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.024+0000 7f6df2200640 1 --2- 172.21.15.1:0/506565656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6dec1019c0 0x7f6dec101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:49.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.024+0000 7f6df2200640 1 --2- 172.21.15.1:0/506565656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6dec1079c0 0x7f6dec107da0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:49.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.024+0000 7f6df2200640 1 -- 172.21.15.1:0/506565656 >> 172.21.15.1:0/506565656 conn(0x7f6dec0fd740 msgr2=0x7f6dec0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:49.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.024+0000 7f6df2200640 1 -- 172.21.15.1:0/506565656 shutdown_connections 2024-09-15T22:22:49.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.024+0000 7f6df2200640 1 -- 172.21.15.1:0/506565656 wait complete. 2024-09-15T22:22:49.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.025+0000 7f6df2200640 1 Processor -- start 2024-09-15T22:22:49.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.025+0000 7f6df2200640 1 -- start start 2024-09-15T22:22:49.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.025+0000 7f6df2200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6dec1019c0 0x7f6dec0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:49.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.026+0000 7f6df2200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6dec102360 0x7f6dec074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:49.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.026+0000 7f6df2200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6dec1079c0 0x7f6dec074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:49.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.026+0000 7f6df2200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6dec111e10 con 0x7f6dec102360 2024-09-15T22:22:49.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.026+0000 7f6df2200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6dec111c90 con 0x7f6dec1019c0 2024-09-15T22:22:49.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.026+0000 7f6df2200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6dec111f90 con 0x7f6dec1079c0 2024-09-15T22:22:49.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.026+0000 7f6de3e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6dec102360 0x7f6dec074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:49.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.026+0000 7f6de3e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6dec102360 0x7f6dec074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59286/0 (socket says 172.21.15.1:59286) 2024-09-15T22:22:49.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.026+0000 7f6de3e00640 1 -- 172.21.15.1:0/2011744978 learned_addr learned my addr 172.21.15.1:0/2011744978 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:22:49.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.026+0000 7f6df0e00640 1 --2- 172.21.15.1:0/2011744978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6dec1019c0 0x7f6dec0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:49.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.026+0000 7f6df1800640 1 --2- 172.21.15.1:0/2011744978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6dec1079c0 0x7f6dec074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:49.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.026+0000 7f6de3e00640 1 -- 172.21.15.1:0/2011744978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6dec1079c0 msgr2=0x7f6dec074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:49.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.026+0000 7f6de3e00640 1 --2- 172.21.15.1:0/2011744978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6dec1079c0 0x7f6dec074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:49.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.026+0000 7f6de3e00640 1 -- 172.21.15.1:0/2011744978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6dec1019c0 msgr2=0x7f6dec0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:49.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.026+0000 7f6de3e00640 1 --2- 172.21.15.1:0/2011744978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6dec1019c0 0x7f6dec0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:49.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.026+0000 7f6de3e00640 1 -- 172.21.15.1:0/2011744978 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dec1a67d0 con 0x7f6dec102360 2024-09-15T22:22:49.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.027+0000 7f6de3e00640 1 --2- 172.21.15.1:0/2011744978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6dec102360 0x7f6dec074a30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400e9f0 tx=0x7f6dd400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:49.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.027+0000 7f6dea000640 1 -- 172.21.15.1:0/2011744978 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd400ccc0 con 0x7f6dec102360 2024-09-15T22:22:49.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.027+0000 7f6dea000640 1 -- 172.21.15.1:0/2011744978 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6dd400ce60 con 0x7f6dec102360 2024-09-15T22:22:49.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.027+0000 7f6df2200640 1 -- 172.21.15.1:0/2011744978 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dec1a6ac0 con 0x7f6dec102360 2024-09-15T22:22:49.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.027+0000 7f6dea000640 1 -- 172.21.15.1:0/2011744978 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4010690 con 0x7f6dec102360 2024-09-15T22:22:49.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.027+0000 7f6df2200640 1 -- 172.21.15.1:0/2011744978 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dec1a6fb0 con 0x7f6dec102360 2024-09-15T22:22:49.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.028+0000 7f6df2200640 1 -- 172.21.15.1:0/2011744978 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dec101e20 con 0x7f6dec102360 2024-09-15T22:22:49.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.030+0000 7f6dea000640 1 -- 172.21.15.1:0/2011744978 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f6dd40046c0 con 0x7f6dec102360 2024-09-15T22:22:49.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.032+0000 7f6dea000640 1 --2- 172.21.15.1:0/2011744978 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f6dd00a3240 0x7f6dd00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:49.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.033+0000 7f6dea000640 1 -- 172.21.15.1:0/2011744978 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7497+0+0 (secure 0 0 0) 0x7f6dd40cfc60 con 0x7f6dec102360 2024-09-15T22:22:49.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.033+0000 7f6df0e00640 1 --2- 172.21.15.1:0/2011744978 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f6dd00a3240 0x7f6dd00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:49.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.033+0000 7f6df0e00640 1 --2- 172.21.15.1:0/2011744978 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f6dd00a3240 0x7f6dd00a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc004af0 tx=0x7f6ddc009820 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:49.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.035+0000 7f6dea000640 1 -- 172.21.15.1:0/2011744978 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6dd40541b0 con 0x7f6dec102360 2024-09-15T22:22:49.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.219+0000 7f6df2200640 1 -- 172.21.15.1:0/2011744978 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f6dec075a20 con 0x7f6dec102360 2024-09-15T22:22:49.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.754+0000 7f6dea000640 1 -- 172.21.15.1:0/2011744978 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v80) ==== 170+0+0 (secure 0 0 0) 0x7f6dd409cc10 con 0x7f6dec102360 2024-09-15T22:22:49.755 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' created 2024-09-15T22:22:49.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.756+0000 7f6df2200640 1 -- 172.21.15.1:0/2011744978 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f6dd00a3240 msgr2=0x7f6dd00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:49.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.756+0000 7f6df2200640 1 --2- 172.21.15.1:0/2011744978 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f6dd00a3240 0x7f6dd00a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc004af0 tx=0x7f6ddc009820 comp rx=0 tx=0).stop 2024-09-15T22:22:49.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.756+0000 7f6df2200640 1 -- 172.21.15.1:0/2011744978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6dec102360 msgr2=0x7f6dec074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:49.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.756+0000 7f6df2200640 1 --2- 172.21.15.1:0/2011744978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6dec102360 0x7f6dec074a30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400e9f0 tx=0x7f6dd400edf0 comp rx=0 tx=0).stop 2024-09-15T22:22:49.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.757+0000 7f6df2200640 1 -- 172.21.15.1:0/2011744978 shutdown_connections 2024-09-15T22:22:49.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.757+0000 7f6df2200640 1 --2- 172.21.15.1:0/2011744978 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f6dd00a3240 0x7f6dd00a5700 secure :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc004af0 tx=0x7f6ddc009820 comp rx=0 tx=0).stop 2024-09-15T22:22:49.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.757+0000 7f6df2200640 1 --2- 172.21.15.1:0/2011744978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6dec1079c0 0x7f6dec074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:49.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.757+0000 7f6df2200640 1 --2- 172.21.15.1:0/2011744978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6dec102360 0x7f6dec074a30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:49.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.757+0000 7f6df2200640 1 --2- 172.21.15.1:0/2011744978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6dec1019c0 0x7f6dec0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:49.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.757+0000 7f6df2200640 1 -- 172.21.15.1:0/2011744978 >> 172.21.15.1:0/2011744978 conn(0x7f6dec0fd740 msgr2=0x7f6dec0fdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:49.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.758+0000 7f6df2200640 1 -- 172.21.15.1:0/2011744978 shutdown_connections 2024-09-15T22:22:49.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:49.758+0000 7f6df2200640 1 -- 172.21.15.1:0/2011744978 wait complete. 2024-09-15T22:22:50.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:49 smithi098 ceph-mon[35514]: pgmap v286: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:50.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:49 smithi098 ceph-mon[35514]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T22:22:50.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:49 smithi098 ceph-mon[35514]: osdmap e79: 12 total, 12 up, 12 in 2024-09-15T22:22:50.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:49 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/2011744978' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-15T22:22:50.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:49 smithi001 ceph-mon[30843]: pgmap v286: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:50.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:49 smithi001 ceph-mon[30843]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T22:22:50.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:49 smithi001 ceph-mon[30843]: osdmap e79: 12 total, 12 up, 12 in 2024-09-15T22:22:50.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:49 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/2011744978' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-15T22:22:50.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:49 smithi012 ceph-mon[34883]: pgmap v286: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:50.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:49 smithi012 ceph-mon[34883]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T22:22:50.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:49 smithi012 ceph-mon[34883]: osdmap e79: 12 total, 12 up, 12 in 2024-09-15T22:22:50.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:49 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/2011744978' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-15T22:22:50.550 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T22:22:50.944 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:22:51.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:50 smithi098 ceph-mon[35514]: pgmap v288: 33 pgs: 24 unknown, 9 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:51.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:50 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/2011744978' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-15T22:22:51.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:50 smithi098 ceph-mon[35514]: osdmap e80: 12 total, 12 up, 12 in 2024-09-15T22:22:51.083 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:50 smithi001 ceph-mon[30843]: pgmap v288: 33 pgs: 24 unknown, 9 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:51.083 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:50 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/2011744978' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-15T22:22:51.083 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:50 smithi001 ceph-mon[30843]: osdmap e80: 12 total, 12 up, 12 in 2024-09-15T22:22:51.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:50 smithi012 ceph-mon[34883]: pgmap v288: 33 pgs: 24 unknown, 9 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:51.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:50 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/2011744978' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-15T22:22:51.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:50 smithi012 ceph-mon[34883]: osdmap e80: 12 total, 12 up, 12 in 2024-09-15T22:22:51.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.505+0000 7f3aab600640 1 -- 172.21.15.1:0/1425724962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3aa41049a0 msgr2=0x7f3aa41089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:51.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.505+0000 7f3aab600640 1 --2- 172.21.15.1:0/1425724962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3aa41049a0 0x7f3aa41089f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3a90009860 tx=0x7f3a9002a340 comp rx=0 tx=0).stop 2024-09-15T22:22:51.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.505+0000 7f3aab600640 1 -- 172.21.15.1:0/1425724962 shutdown_connections 2024-09-15T22:22:51.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.505+0000 7f3aab600640 1 --2- 172.21.15.1:0/1425724962 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3aa4109120 0x7f3aa4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:51.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.505+0000 7f3aab600640 1 --2- 172.21.15.1:0/1425724962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3aa41049a0 0x7f3aa41089f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:51.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.505+0000 7f3aab600640 1 --2- 172.21.15.1:0/1425724962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3aa4103ff0 0x7f3aa41043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:51.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.505+0000 7f3aab600640 1 -- 172.21.15.1:0/1425724962 >> 172.21.15.1:0/1425724962 conn(0x7f3aa40ffa90 msgr2=0x7f3aa4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:51.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.505+0000 7f3aab600640 1 -- 172.21.15.1:0/1425724962 shutdown_connections 2024-09-15T22:22:51.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.505+0000 7f3aab600640 1 -- 172.21.15.1:0/1425724962 wait complete. 2024-09-15T22:22:51.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.506+0000 7f3aab600640 1 Processor -- start 2024-09-15T22:22:51.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.506+0000 7f3aab600640 1 -- start start 2024-09-15T22:22:51.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.506+0000 7f3aab600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3aa4103ff0 0x7f3aa419a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:51.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.506+0000 7f3aab600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3aa41049a0 0x7f3aa419aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:51.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.506+0000 7f3aab600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3aa4109120 0x7f3aa419df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:51.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.506+0000 7f3aab600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa4114120 con 0x7f3aa41049a0 2024-09-15T22:22:51.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.506+0000 7f3aab600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa4113fa0 con 0x7f3aa4103ff0 2024-09-15T22:22:51.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.506+0000 7f3aab600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa41142a0 con 0x7f3aa4109120 2024-09-15T22:22:51.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.507+0000 7f3aa8c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3aa4103ff0 0x7f3aa419a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:51.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.507+0000 7f3aa8c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3aa4103ff0 0x7f3aa419a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:46150/0 (socket says 172.21.15.1:46150) 2024-09-15T22:22:51.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.507+0000 7f3aa8c00640 1 -- 172.21.15.1:0/4261196513 learned_addr learned my addr 172.21.15.1:0/4261196513 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:22:51.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.507+0000 7f3aa3e00640 1 --2- 172.21.15.1:0/4261196513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3aa41049a0 0x7f3aa419aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:51.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.507+0000 7f3aa9600640 1 --2- 172.21.15.1:0/4261196513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3aa4109120 0x7f3aa419df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:51.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.507+0000 7f3aa8c00640 1 -- 172.21.15.1:0/4261196513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3aa4109120 msgr2=0x7f3aa419df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:51.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.507+0000 7f3aa8c00640 1 --2- 172.21.15.1:0/4261196513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3aa4109120 0x7f3aa419df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:51.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.507+0000 7f3aa8c00640 1 -- 172.21.15.1:0/4261196513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3aa41049a0 msgr2=0x7f3aa419aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:51.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.507+0000 7f3aa8c00640 1 --2- 172.21.15.1:0/4261196513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3aa41049a0 0x7f3aa419aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:51.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.507+0000 7f3aa8c00640 1 -- 172.21.15.1:0/4261196513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aa419e6b0 con 0x7f3aa4103ff0 2024-09-15T22:22:51.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.507+0000 7f3aa8c00640 1 --2- 172.21.15.1:0/4261196513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3aa4103ff0 0x7f3aa419a760 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3a9800e9c0 tx=0x7f3a9800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:51.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.508+0000 7f3aa1600640 1 -- 172.21.15.1:0/4261196513 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a9800ccc0 con 0x7f3aa4103ff0 2024-09-15T22:22:51.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.508+0000 7f3aa1600640 1 -- 172.21.15.1:0/4261196513 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a98005500 con 0x7f3aa4103ff0 2024-09-15T22:22:51.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.508+0000 7f3aab600640 1 -- 172.21.15.1:0/4261196513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3aa419e9a0 con 0x7f3aa4103ff0 2024-09-15T22:22:51.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.508+0000 7f3aa1600640 1 -- 172.21.15.1:0/4261196513 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a98010430 con 0x7f3aa4103ff0 2024-09-15T22:22:51.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.508+0000 7f3aab600640 1 -- 172.21.15.1:0/4261196513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3aa41a7310 con 0x7f3aa4103ff0 2024-09-15T22:22:51.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.509+0000 7f3aab600640 1 -- 172.21.15.1:0/4261196513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3aa41043d0 con 0x7f3aa4103ff0 2024-09-15T22:22:51.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.511+0000 7f3aa1600640 1 -- 172.21.15.1:0/4261196513 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f3a980046c0 con 0x7f3aa4103ff0 2024-09-15T22:22:51.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.512+0000 7f3aa1600640 1 --2- 172.21.15.1:0/4261196513 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3a8c0a3240 0x7f3a8c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:51.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.512+0000 7f3aa1600640 1 -- 172.21.15.1:0/4261196513 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7879+0+0 (secure 0 0 0) 0x7f3a980cfb80 con 0x7f3aa4103ff0 2024-09-15T22:22:51.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.512+0000 7f3aa3e00640 1 --2- 172.21.15.1:0/4261196513 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3a8c0a3240 0x7f3a8c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:51.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.513+0000 7f3aa3e00640 1 --2- 172.21.15.1:0/4261196513 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3a8c0a3240 0x7f3a8c0a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3a9002a930 tx=0x7f3a900056d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:51.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.517+0000 7f3aa1600640 1 -- 172.21.15.1:0/4261196513 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3a9809c9b0 con 0x7f3aa4103ff0 2024-09-15T22:22:51.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.741+0000 7f3aab600640 1 -- 172.21.15.1:0/4261196513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f3aa410c360 con 0x7f3aa4103ff0 2024-09-15T22:22:51.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.777+0000 7f3aa1600640 1 -- 172.21.15.1:0/4261196513 <== mon.2 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f3a98096e20 con 0x7f3aa4103ff0 2024-09-15T22:22:51.779 INFO:teuthology.orchestra.run.smithi001.stderr:new fs with metadata pool 2 and data pool 3 2024-09-15T22:22:51.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.780+0000 7f3aab600640 1 -- 172.21.15.1:0/4261196513 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3a8c0a3240 msgr2=0x7f3a8c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:51.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.780+0000 7f3aab600640 1 --2- 172.21.15.1:0/4261196513 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3a8c0a3240 0x7f3a8c0a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3a9002a930 tx=0x7f3a900056d0 comp rx=0 tx=0).stop 2024-09-15T22:22:51.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.780+0000 7f3aab600640 1 -- 172.21.15.1:0/4261196513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3aa4103ff0 msgr2=0x7f3aa419a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:51.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.780+0000 7f3aab600640 1 --2- 172.21.15.1:0/4261196513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3aa4103ff0 0x7f3aa419a760 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3a9800e9c0 tx=0x7f3a9800ee80 comp rx=0 tx=0).stop 2024-09-15T22:22:51.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.780+0000 7f3aab600640 1 -- 172.21.15.1:0/4261196513 shutdown_connections 2024-09-15T22:22:51.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.780+0000 7f3aab600640 1 --2- 172.21.15.1:0/4261196513 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3a8c0a3240 0x7f3a8c0a5700 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:51.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.780+0000 7f3aab600640 1 --2- 172.21.15.1:0/4261196513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3aa4109120 0x7f3aa419df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:51.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.780+0000 7f3aab600640 1 --2- 172.21.15.1:0/4261196513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3aa41049a0 0x7f3aa419aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:51.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.780+0000 7f3aab600640 1 --2- 172.21.15.1:0/4261196513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3aa4103ff0 0x7f3aa419a760 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:51.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.780+0000 7f3aab600640 1 -- 172.21.15.1:0/4261196513 >> 172.21.15.1:0/4261196513 conn(0x7f3aa40ffa90 msgr2=0x7f3aa4100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:51.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.780+0000 7f3aab600640 1 -- 172.21.15.1:0/4261196513 shutdown_connections 2024-09-15T22:22:51.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:51.780+0000 7f3aab600640 1 -- 172.21.15.1:0/4261196513 wait complete. 2024-09-15T22:22:52.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:51 smithi098 ceph-mon[35514]: osdmap e81: 12 total, 12 up, 12 in 2024-09-15T22:22:52.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:51 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/4261196513' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-15T22:22:52.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:51 smithi098 ceph-mon[35514]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-15T22:22:52.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:51 smithi098 ceph-mon[35514]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-15T22:22:52.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:51 smithi001 ceph-mon[30843]: osdmap e81: 12 total, 12 up, 12 in 2024-09-15T22:22:52.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:51 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/4261196513' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-15T22:22:52.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:51 smithi001 ceph-mon[30843]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-15T22:22:52.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:51 smithi001 ceph-mon[30843]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-15T22:22:52.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:51 smithi012 ceph-mon[34883]: osdmap e81: 12 total, 12 up, 12 in 2024-09-15T22:22:52.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:51 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/4261196513' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-15T22:22:52.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:51 smithi012 ceph-mon[34883]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-15T22:22:52.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:51 smithi012 ceph-mon[34883]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-15T22:22:52.699 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:22:53.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:52 smithi098 ceph-mon[35514]: pgmap v291: 97 pgs: 33 creating+peering, 29 unknown, 35 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:53.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:52 smithi098 ceph-mon[35514]: osdmap e82: 12 total, 12 up, 12 in 2024-09-15T22:22:53.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:52 smithi098 ceph-mon[35514]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-15T22:22:53.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:52 smithi098 ceph-mon[35514]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-15T22:22:53.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:52 smithi098 ceph-mon[35514]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-15T22:22:53.076 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:22:53.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:52 smithi001 ceph-mon[30843]: pgmap v291: 97 pgs: 33 creating+peering, 29 unknown, 35 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:53.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:52 smithi001 ceph-mon[30843]: osdmap e82: 12 total, 12 up, 12 in 2024-09-15T22:22:53.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:52 smithi001 ceph-mon[30843]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-15T22:22:53.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:52 smithi001 ceph-mon[30843]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-15T22:22:53.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:52 smithi001 ceph-mon[30843]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-15T22:22:53.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:52 smithi012 ceph-mon[34883]: pgmap v291: 97 pgs: 33 creating+peering, 29 unknown, 35 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:53.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:52 smithi012 ceph-mon[34883]: osdmap e82: 12 total, 12 up, 12 in 2024-09-15T22:22:53.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:52 smithi012 ceph-mon[34883]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-15T22:22:53.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:52 smithi012 ceph-mon[34883]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-15T22:22:53.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:52 smithi012 ceph-mon[34883]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-15T22:22:53.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.676+0000 7f6a7d000640 1 -- 172.21.15.1:0/2649255800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a78077040 msgr2=0x7f6a78112510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:53.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.676+0000 7f6a7d000640 1 --2- 172.21.15.1:0/2649255800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a78077040 0x7f6a78112510 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6a60009900 tx=0x7f6a6002a410 comp rx=0 tx=0).stop 2024-09-15T22:22:53.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.677+0000 7f6a7d000640 1 -- 172.21.15.1:0/2649255800 shutdown_connections 2024-09-15T22:22:53.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.677+0000 7f6a7d000640 1 --2- 172.21.15.1:0/2649255800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a78112a50 0x7f6a78114e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:53.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.677+0000 7f6a7d000640 1 --2- 172.21.15.1:0/2649255800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a78077040 0x7f6a78112510 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:53.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.677+0000 7f6a7d000640 1 --2- 172.21.15.1:0/2649255800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a78076720 0x7f6a78076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:53.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.677+0000 7f6a7d000640 1 -- 172.21.15.1:0/2649255800 >> 172.21.15.1:0/2649255800 conn(0x7f6a780ffa50 msgr2=0x7f6a78101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:53.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.677+0000 7f6a7d000640 1 -- 172.21.15.1:0/2649255800 shutdown_connections 2024-09-15T22:22:53.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.677+0000 7f6a7d000640 1 -- 172.21.15.1:0/2649255800 wait complete. 2024-09-15T22:22:53.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.678+0000 7f6a7d000640 1 Processor -- start 2024-09-15T22:22:53.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.678+0000 7f6a7d000640 1 -- start start 2024-09-15T22:22:53.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.678+0000 7f6a7d000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a78076720 0x7f6a781a4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:53.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.678+0000 7f6a7d000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a78077040 0x7f6a781a4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:53.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.678+0000 7f6a7d000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a78112a50 0x7f6a7819ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:53.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.678+0000 7f6a7d000640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6a78118610 con 0x7f6a78077040 2024-09-15T22:22:53.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.678+0000 7f6a7d000640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6a78118490 con 0x7f6a78112a50 2024-09-15T22:22:53.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.678+0000 7f6a7d000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6a78118790 con 0x7f6a78076720 2024-09-15T22:22:53.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.679+0000 7f6a75e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a78076720 0x7f6a781a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:53.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.679+0000 7f6a6fe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a78077040 0x7f6a781a4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:53.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.679+0000 7f6a75e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a78076720 0x7f6a781a4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:45790/0 (socket says 172.21.15.1:45790) 2024-09-15T22:22:53.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.679+0000 7f6a75e00640 1 -- 172.21.15.1:0/2772869398 learned_addr learned my addr 172.21.15.1:0/2772869398 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:22:53.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.679+0000 7f6a76800640 1 --2- 172.21.15.1:0/2772869398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a78112a50 0x7f6a7819ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:53.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.679+0000 7f6a75e00640 1 -- 172.21.15.1:0/2772869398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a78112a50 msgr2=0x7f6a7819ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:53.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.679+0000 7f6a75e00640 1 --2- 172.21.15.1:0/2772869398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a78112a50 0x7f6a7819ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:53.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.679+0000 7f6a75e00640 1 -- 172.21.15.1:0/2772869398 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a78077040 msgr2=0x7f6a781a4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:53.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.679+0000 7f6a75e00640 1 --2- 172.21.15.1:0/2772869398 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a78077040 0x7f6a781a4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:53.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.679+0000 7f6a75e00640 1 -- 172.21.15.1:0/2772869398 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a7819f130 con 0x7f6a78076720 2024-09-15T22:22:53.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.679+0000 7f6a76800640 1 --2- 172.21.15.1:0/2772869398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a78112a50 0x7f6a7819ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:22:53.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.679+0000 7f6a75e00640 1 --2- 172.21.15.1:0/2772869398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a78076720 0x7f6a781a4840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6a6800d950 tx=0x7f6a6800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:53.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.679+0000 7f6a6ea00640 1 -- 172.21.15.1:0/2772869398 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a68017030 con 0x7f6a78076720 2024-09-15T22:22:53.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.680+0000 7f6a6ea00640 1 -- 172.21.15.1:0/2772869398 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a68004020 con 0x7f6a78076720 2024-09-15T22:22:53.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.680+0000 7f6a7d000640 1 -- 172.21.15.1:0/2772869398 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a7819f420 con 0x7f6a78076720 2024-09-15T22:22:53.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.680+0000 7f6a6ea00640 1 -- 172.21.15.1:0/2772869398 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a680047a0 con 0x7f6a78076720 2024-09-15T22:22:53.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.680+0000 7f6a7d000640 1 -- 172.21.15.1:0/2772869398 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a781ab710 con 0x7f6a78076720 2024-09-15T22:22:53.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.681+0000 7f6a7d000640 1 -- 172.21.15.1:0/2772869398 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a78076b00 con 0x7f6a78076720 2024-09-15T22:22:53.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.683+0000 7f6a6ea00640 1 -- 172.21.15.1:0/2772869398 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f6a680041d0 con 0x7f6a78076720 2024-09-15T22:22:53.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.684+0000 7f6a6ea00640 1 --2- 172.21.15.1:0/2772869398 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f6a5c0a3240 0x7f6a5c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:53.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.684+0000 7f6a6ea00640 1 -- 172.21.15.1:0/2772869398 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f6a680cf810 con 0x7f6a78076720 2024-09-15T22:22:53.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.684+0000 7f6a6fe00640 1 --2- 172.21.15.1:0/2772869398 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f6a5c0a3240 0x7f6a5c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:53.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.685+0000 7f6a6fe00640 1 --2- 172.21.15.1:0/2772869398 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f6a5c0a3240 0x7f6a5c0a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6a60000c00 tx=0x7f6a60005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:53.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.686+0000 7f6a6ea00640 1 -- 172.21.15.1:0/2772869398 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6a6809c5e0 con 0x7f6a78076720 2024-09-15T22:22:53.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.873+0000 7f6a7d000640 1 -- 172.21.15.1:0/2772869398 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a7819ff30 con 0x7f6a78076720 2024-09-15T22:22:53.875 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:53 smithi001 ceph-mon[30843]: mds.? [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] up:active 2024-09-15T22:22:53.875 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:53 smithi001 ceph-mon[30843]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-15T22:22:53.875 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:53 smithi001 ceph-mon[30843]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-15T22:22:53.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.875+0000 7f6a6ea00640 1 -- 172.21.15.1:0/2772869398 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22148 (secure 0 0 0) 0x7f6a6809bee0 con 0x7f6a78076720 2024-09-15T22:22:53.876 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:22:53.877 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":82,"fsid":"c1228c44-73af-11ef-bceb-c7b262605968","created":"2024-09-15T22:14:39.004556+0000","modified":"2024-09-15T22:22:51.743047+0000","last_up_change":"2024-09-15T22:21:53.270221+0000","last_in_change":"2024-09-15T22:21:30.911945+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:17:56.059390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:22:47.262081+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:22:49.746577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28228d47-bbb7-4103-a4fb-3e126769f8bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6803","nonce":3588868833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6805","nonce":3588868833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6809","nonce":3588868833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6807","nonce":3588868833}]},"public_addr":"172.21.15.1:6803/3588868833","cluster_addr":"172.21.15.1:6805/3588868833","heartbeat_back_addr":"172.21.15.1:6809/3588868833","heartbeat_front_addr":"172.21.15.1:6807/3588868833","state":["exists","up"]},{"osd":1,"uuid":"d90dd2c1-2047-4491-8730-30793a354aa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6801","nonce":3951165354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6803","nonce":3951165354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6807","nonce":3951165354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6805","nonce":3951165354}]},"public_addr":"172.21.15.12:6801/3951165354","cluster_addr":"172.21.15.12:6803/3951165354","heartbeat_back_addr":"172.21.15.12:6807/3951165354","heartbeat_front_addr":"172.21.15.12:6805/3951165354","state":["exists","up"]},{"osd":2,"uuid":"22e38f44-88d3-4461-a57e-6dc4857ec48f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6801","nonce":1633982971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6803","nonce":1633982971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6807","nonce":1633982971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6805","nonce":1633982971}]},"public_addr":"172.21.15.98:6801/1633982971","cluster_addr":"172.21.15.98:6803/1633982971","heartbeat_back_addr":"172.21.15.98:6807/1633982971","heartbeat_front_addr":"172.21.15.98:6805/1633982971","state":["exists","up"]},{"osd":3,"uuid":"dd9d6e97-af81-442a-ac0d-543e440a8d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6811","nonce":3706738461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6813","nonce":3706738461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6817","nonce":3706738461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6815","nonce":3706738461}]},"public_addr":"172.21.15.1:6811/3706738461","cluster_addr":"172.21.15.1:6813/3706738461","heartbeat_back_addr":"172.21.15.1:6817/3706738461","heartbeat_front_addr":"172.21.15.1:6815/3706738461","state":["exists","up"]},{"osd":4,"uuid":"50116baa-dd99-4dbb-a7a1-2268f04052f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6809","nonce":4057902964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6811","nonce":4057902964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6815","nonce":4057902964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6813","nonce":4057902964}]},"public_addr":"172.21.15.12:6809/4057902964","cluster_addr":"172.21.15.12:6811/4057902964","heartbeat_back_addr":"172.21.15.12:6815/4057902964","heartbeat_front_addr":"172.21.15.12:6813/4057902964","state":["exists","up"]},{"osd":5,"uuid":"56ab0694-2f21-46c4-a086-44f72c271c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6809","nonce":4043567619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6811","nonce":4043567619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6815","nonce":4043567619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6813","nonce":4043567619}]},"public_addr":"172.21.15.98:6809/4043567619","cluster_addr":"172.21.15.98:6811/4043567619","heartbeat_back_addr":"172.21.15.98:6815/4043567619","heartbeat_front_addr":"172.21.15.98:6813/4043567619","state":["exists","up"]},{"osd":6,"uuid":"5ca0d114-4894-428e-bcd3-2ebd24d10a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6819","nonce":2236861161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6821","nonce":2236861161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6825","nonce":2236861161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6823","nonce":2236861161}]},"public_addr":"172.21.15.1:6819/2236861161","cluster_addr":"172.21.15.1:6821/2236861161","heartbeat_back_addr":"172.21.15.1:6825/2236861161","heartbeat_front_addr":"172.21.15.1:6823/2236861161","state":["exists","up"]},{"osd":7,"uuid":"db99cc6e-1717-4958-bf11-65aca94476b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6817","nonce":133202448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6819","nonce":133202448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6823","nonce":133202448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6821","nonce":133202448}]},"public_addr":"172.21.15.12:6817/133202448","cluster_addr":"172.21.15.12:6819/133202448","heartbeat_back_addr":"172.21.15.12:6823/133202448","heartbeat_front_addr":"172.21.15.12:6821/133202448","state":["exists","up"]},{"osd":8,"uuid":"4d3b6574-49f7-47f6-b36b-4da14ca290f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6817","nonce":3701478409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6819","nonce":3701478409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6823","nonce":3701478409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6821","nonce":3701478409}]},"public_addr":"172.21.15.98:6817/3701478409","cluster_addr":"172.21.15.98:6819/3701478409","heartbeat_back_addr":"172.21.15.98:6823/3701478409","heartbeat_front_addr":"172.21.15.98:6821/3701478409","state":["exists","up"]},{"osd":9,"uuid":"7dd2fe25-1b75-48e5-86c7-c7a3ab85053f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6827","nonce":2580755002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6829","nonce":2580755002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6833","nonce":2580755002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6831","nonce":2580755002}]},"public_addr":"172.21.15.1:6827/2580755002","cluster_addr":"172.21.15.1:6829/2580755002","heartbeat_back_addr":"172.21.15.1:6833/2580755002","heartbeat_front_addr":"172.21.15.1:6831/2580755002","state":["exists","up"]},{"osd":10,"uuid":"fcad11dc-0a1b-44a2-ac32-74100e317255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6825","nonce":3989063573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6827","nonce":3989063573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6831","nonce":3989063573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6829","nonce":3989063573}]},"public_addr":"172.21.15.12:6825/3989063573","cluster_addr":"172.21.15.12:6827/3989063573","heartbeat_back_addr":"172.21.15.12:6831/3989063573","heartbeat_front_addr":"172.21.15.12:6829/3989063573","state":["exists","up"]},{"osd":11,"uuid":"f4e717bb-586d-4fe2-9e6b-f574be4db36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6825","nonce":839956167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6827","nonce":839956167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6831","nonce":839956167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6829","nonce":839956167}]},"public_addr":"172.21.15.98:6825/839956167","cluster_addr":"172.21.15.98:6827/839956167","heartbeat_back_addr":"172.21.15.98:6831/839956167","heartbeat_front_addr":"172.21.15.98:6829/839956167","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:17:01.990618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:17:28.259003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:17:52.825080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:18:22.724038+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:18:48.383663+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:19:13.246563+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:19:42.318469+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:20:08.809160+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:20:32.628925+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:21:02.280217+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:21:27.897758+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:21:52.055015+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6800/3145051160":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/3101438101":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/4159811089":"2024-09-16T22:15:31.433375+0000","172.21.15.1:6801/3145051160":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/2785155592":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/714180295":"2024-09-16T22:15:03.937536+0000","172.21.15.1:6801/215291238":"2024-09-16T22:15:03.937536+0000","172.21.15.1:6800/215291238":"2024-09-16T22:15:03.937536+0000","172.21.15.1:0/1842817732":"2024-09-16T22:15:03.937536+0000","172.21.15.1:0/3888009741":"2024-09-16T22:15:03.937536+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:22:53.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.877+0000 7f6a7d000640 1 -- 172.21.15.1:0/2772869398 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f6a5c0a3240 msgr2=0x7f6a5c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:53.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.877+0000 7f6a7d000640 1 --2- 172.21.15.1:0/2772869398 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f6a5c0a3240 0x7f6a5c0a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6a60000c00 tx=0x7f6a60005b50 comp rx=0 tx=0).stop 2024-09-15T22:22:53.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.877+0000 7f6a7d000640 1 -- 172.21.15.1:0/2772869398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a78076720 msgr2=0x7f6a781a4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:53.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.877+0000 7f6a7d000640 1 --2- 172.21.15.1:0/2772869398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a78076720 0x7f6a781a4840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6a6800d950 tx=0x7f6a6800de10 comp rx=0 tx=0).stop 2024-09-15T22:22:53.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.877+0000 7f6a7d000640 1 -- 172.21.15.1:0/2772869398 shutdown_connections 2024-09-15T22:22:53.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.877+0000 7f6a7d000640 1 --2- 172.21.15.1:0/2772869398 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f6a5c0a3240 0x7f6a5c0a5700 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:53.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.877+0000 7f6a7d000640 1 --2- 172.21.15.1:0/2772869398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a78112a50 0x7f6a7819ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:53.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.877+0000 7f6a7d000640 1 --2- 172.21.15.1:0/2772869398 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a78077040 0x7f6a781a4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:53.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.877+0000 7f6a7d000640 1 --2- 172.21.15.1:0/2772869398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a78076720 0x7f6a781a4840 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:53.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.877+0000 7f6a7d000640 1 -- 172.21.15.1:0/2772869398 >> 172.21.15.1:0/2772869398 conn(0x7f6a780ffa50 msgr2=0x7f6a78101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:53.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.878+0000 7f6a7d000640 1 -- 172.21.15.1:0/2772869398 shutdown_connections 2024-09-15T22:22:53.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:53.878+0000 7f6a7d000640 1 -- 172.21.15.1:0/2772869398 wait complete. 2024-09-15T22:22:54.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:53 smithi098 ceph-mon[35514]: mds.? [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] up:active 2024-09-15T22:22:54.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:53 smithi098 ceph-mon[35514]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-15T22:22:54.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:53 smithi098 ceph-mon[35514]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-15T22:22:54.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:53 smithi012 ceph-mon[34883]: mds.? [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] up:active 2024-09-15T22:22:54.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:53 smithi012 ceph-mon[34883]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-15T22:22:54.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:53 smithi012 ceph-mon[34883]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-15T22:22:54.560 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 15 22:22:54 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-i[66060]: 2024-09-15T22:22:54.210+0000 7f6a135a9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:22:54.944 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:22:55.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:54 smithi098 ceph-mon[35514]: pgmap v293: 97 pgs: 33 creating+peering, 29 unknown, 35 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:55.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:54 smithi098 ceph-mon[35514]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-15T22:22:55.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:54 smithi098 ceph-mon[35514]: Cluster is now healthy 2024-09-15T22:22:55.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:54 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/2772869398' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:22:55.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:54 smithi001 ceph-mon[30843]: pgmap v293: 97 pgs: 33 creating+peering, 29 unknown, 35 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:55.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:54 smithi001 ceph-mon[30843]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-15T22:22:55.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:54 smithi001 ceph-mon[30843]: Cluster is now healthy 2024-09-15T22:22:55.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:54 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/2772869398' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:22:55.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:54 smithi012 ceph-mon[34883]: pgmap v293: 97 pgs: 33 creating+peering, 29 unknown, 35 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:22:55.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:54 smithi012 ceph-mon[34883]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-15T22:22:55.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:54 smithi012 ceph-mon[34883]: Cluster is now healthy 2024-09-15T22:22:55.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:54 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/2772869398' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:22:55.320 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:22:55.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.902+0000 7fb570800640 1 -- 172.21.15.1:0/367526088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb568074f40 msgr2=0x7fb56810de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:55.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.902+0000 7fb570800640 1 --2- 172.21.15.1:0/367526088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb568074f40 0x7fb56810de80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb558009900 tx=0x7fb55802a480 comp rx=0 tx=0).stop 2024-09-15T22:22:55.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.902+0000 7fb570800640 1 -- 172.21.15.1:0/367526088 shutdown_connections 2024-09-15T22:22:55.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.902+0000 7fb570800640 1 --2- 172.21.15.1:0/367526088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb56810e3c0 0x7fb568110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.902+0000 7fb570800640 1 --2- 172.21.15.1:0/367526088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb568074f40 0x7fb56810de80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.902+0000 7fb570800640 1 --2- 172.21.15.1:0/367526088 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb568074620 0x7fb568074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.902+0000 7fb570800640 1 -- 172.21.15.1:0/367526088 >> 172.21.15.1:0/367526088 conn(0x7fb5680fd8c0 msgr2=0x7fb5680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:55.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.903+0000 7fb570800640 1 -- 172.21.15.1:0/367526088 shutdown_connections 2024-09-15T22:22:55.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.903+0000 7fb570800640 1 -- 172.21.15.1:0/367526088 wait complete. 2024-09-15T22:22:55.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.904+0000 7fb570800640 1 Processor -- start 2024-09-15T22:22:55.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.904+0000 7fb570800640 1 -- start start 2024-09-15T22:22:55.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.904+0000 7fb570800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb568074620 0x7fb56819a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:55.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.904+0000 7fb570800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb568074f40 0x7fb56819abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:55.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.905+0000 7fb570800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb56810e3c0 0x7fb56819ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:55.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.905+0000 7fb570800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb5681141b0 con 0x7fb56810e3c0 2024-09-15T22:22:55.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.905+0000 7fb570800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb568114030 con 0x7fb568074620 2024-09-15T22:22:55.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.905+0000 7fb56de00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb568074620 0x7fb56819a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:55.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.905+0000 7fb56de00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb568074620 0x7fb56819a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:46192/0 (socket says 172.21.15.1:46192) 2024-09-15T22:22:55.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.905+0000 7fb56de00640 1 -- 172.21.15.1:0/3494191031 learned_addr learned my addr 172.21.15.1:0/3494191031 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:22:55.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.905+0000 7fb56e800640 1 --2- 172.21.15.1:0/3494191031 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb56810e3c0 0x7fb56819ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:55.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.905+0000 7fb56d400640 1 --2- 172.21.15.1:0/3494191031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb568074f40 0x7fb56819abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:55.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.905+0000 7fb570800640 1 -- 172.21.15.1:0/3494191031 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb568114330 con 0x7fb568074f40 2024-09-15T22:22:55.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.905+0000 7fb56d400640 1 -- 172.21.15.1:0/3494191031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb568074620 msgr2=0x7fb56819a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:55.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.905+0000 7fb56d400640 1 --2- 172.21.15.1:0/3494191031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb568074620 0x7fb56819a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.905+0000 7fb56d400640 1 -- 172.21.15.1:0/3494191031 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb56810e3c0 msgr2=0x7fb56819ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:55.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.905+0000 7fb56d400640 1 --2- 172.21.15.1:0/3494191031 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb56810e3c0 0x7fb56819ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.905+0000 7fb56d400640 1 -- 172.21.15.1:0/3494191031 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb56819f620 con 0x7fb568074f40 2024-09-15T22:22:55.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.905+0000 7fb56e800640 1 --2- 172.21.15.1:0/3494191031 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb56810e3c0 0x7fb56819ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:22:55.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.906+0000 7fb56d400640 1 --2- 172.21.15.1:0/3494191031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb568074f40 0x7fb56819abb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb55802a9a0 tx=0x7fb558003b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:55.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.906+0000 7fb562a00640 1 -- 172.21.15.1:0/3494191031 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55803f070 con 0x7fb568074f40 2024-09-15T22:22:55.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.906+0000 7fb570800640 1 -- 172.21.15.1:0/3494191031 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb56819f8b0 con 0x7fb568074f40 2024-09-15T22:22:55.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.906+0000 7fb562a00640 1 -- 172.21.15.1:0/3494191031 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb558031c90 con 0x7fb568074f40 2024-09-15T22:22:55.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.906+0000 7fb562a00640 1 -- 172.21.15.1:0/3494191031 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb558035030 con 0x7fb568074f40 2024-09-15T22:22:55.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.906+0000 7fb570800640 1 -- 172.21.15.1:0/3494191031 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5681a71f0 con 0x7fb568074f40 2024-09-15T22:22:55.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.907+0000 7fb570800640 1 -- 172.21.15.1:0/3494191031 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb568074a00 con 0x7fb568074f40 2024-09-15T22:22:55.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.909+0000 7fb562a00640 1 -- 172.21.15.1:0/3494191031 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fb558042070 con 0x7fb568074f40 2024-09-15T22:22:55.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.910+0000 7fb562a00640 1 --2- 172.21.15.1:0/3494191031 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb5500a32c0 0x7fb5500a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:55.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.911+0000 7fb562a00640 1 -- 172.21.15.1:0/3494191031 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fb5580f0340 con 0x7fb568074f40 2024-09-15T22:22:55.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.911+0000 7fb56de00640 1 --2- 172.21.15.1:0/3494191031 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb5500a32c0 0x7fb5500a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:55.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.911+0000 7fb56de00640 1 --2- 172.21.15.1:0/3494191031 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb5500a32c0 0x7fb5500a5780 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb55c0095f0 tx=0x7fb55c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:55.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:55.912+0000 7fb562a00640 1 -- 172.21.15.1:0/3494191031 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb5580bcac0 con 0x7fb568074f40 2024-09-15T22:22:56.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:56.097+0000 7fb570800640 1 -- 172.21.15.1:0/3494191031 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb568109570 con 0x7fb568074f40 2024-09-15T22:22:56.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:56.099+0000 7fb562a00640 1 -- 172.21.15.1:0/3494191031 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22148 (secure 0 0 0) 0x7fb5580c0dc0 con 0x7fb568074f40 2024-09-15T22:22:56.100 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:22:56.101 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":82,"fsid":"c1228c44-73af-11ef-bceb-c7b262605968","created":"2024-09-15T22:14:39.004556+0000","modified":"2024-09-15T22:22:51.743047+0000","last_up_change":"2024-09-15T22:21:53.270221+0000","last_in_change":"2024-09-15T22:21:30.911945+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:17:56.059390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:22:47.262081+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:22:49.746577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28228d47-bbb7-4103-a4fb-3e126769f8bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6803","nonce":3588868833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6805","nonce":3588868833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6809","nonce":3588868833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6807","nonce":3588868833}]},"public_addr":"172.21.15.1:6803/3588868833","cluster_addr":"172.21.15.1:6805/3588868833","heartbeat_back_addr":"172.21.15.1:6809/3588868833","heartbeat_front_addr":"172.21.15.1:6807/3588868833","state":["exists","up"]},{"osd":1,"uuid":"d90dd2c1-2047-4491-8730-30793a354aa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6801","nonce":3951165354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6803","nonce":3951165354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6807","nonce":3951165354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6805","nonce":3951165354}]},"public_addr":"172.21.15.12:6801/3951165354","cluster_addr":"172.21.15.12:6803/3951165354","heartbeat_back_addr":"172.21.15.12:6807/3951165354","heartbeat_front_addr":"172.21.15.12:6805/3951165354","state":["exists","up"]},{"osd":2,"uuid":"22e38f44-88d3-4461-a57e-6dc4857ec48f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6801","nonce":1633982971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6803","nonce":1633982971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6807","nonce":1633982971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6805","nonce":1633982971}]},"public_addr":"172.21.15.98:6801/1633982971","cluster_addr":"172.21.15.98:6803/1633982971","heartbeat_back_addr":"172.21.15.98:6807/1633982971","heartbeat_front_addr":"172.21.15.98:6805/1633982971","state":["exists","up"]},{"osd":3,"uuid":"dd9d6e97-af81-442a-ac0d-543e440a8d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6811","nonce":3706738461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6813","nonce":3706738461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6817","nonce":3706738461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6815","nonce":3706738461}]},"public_addr":"172.21.15.1:6811/3706738461","cluster_addr":"172.21.15.1:6813/3706738461","heartbeat_back_addr":"172.21.15.1:6817/3706738461","heartbeat_front_addr":"172.21.15.1:6815/3706738461","state":["exists","up"]},{"osd":4,"uuid":"50116baa-dd99-4dbb-a7a1-2268f04052f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6809","nonce":4057902964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6811","nonce":4057902964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6815","nonce":4057902964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6813","nonce":4057902964}]},"public_addr":"172.21.15.12:6809/4057902964","cluster_addr":"172.21.15.12:6811/4057902964","heartbeat_back_addr":"172.21.15.12:6815/4057902964","heartbeat_front_addr":"172.21.15.12:6813/4057902964","state":["exists","up"]},{"osd":5,"uuid":"56ab0694-2f21-46c4-a086-44f72c271c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6809","nonce":4043567619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6811","nonce":4043567619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6815","nonce":4043567619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6813","nonce":4043567619}]},"public_addr":"172.21.15.98:6809/4043567619","cluster_addr":"172.21.15.98:6811/4043567619","heartbeat_back_addr":"172.21.15.98:6815/4043567619","heartbeat_front_addr":"172.21.15.98:6813/4043567619","state":["exists","up"]},{"osd":6,"uuid":"5ca0d114-4894-428e-bcd3-2ebd24d10a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6819","nonce":2236861161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6821","nonce":2236861161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6825","nonce":2236861161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6823","nonce":2236861161}]},"public_addr":"172.21.15.1:6819/2236861161","cluster_addr":"172.21.15.1:6821/2236861161","heartbeat_back_addr":"172.21.15.1:6825/2236861161","heartbeat_front_addr":"172.21.15.1:6823/2236861161","state":["exists","up"]},{"osd":7,"uuid":"db99cc6e-1717-4958-bf11-65aca94476b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6817","nonce":133202448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6819","nonce":133202448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6823","nonce":133202448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6821","nonce":133202448}]},"public_addr":"172.21.15.12:6817/133202448","cluster_addr":"172.21.15.12:6819/133202448","heartbeat_back_addr":"172.21.15.12:6823/133202448","heartbeat_front_addr":"172.21.15.12:6821/133202448","state":["exists","up"]},{"osd":8,"uuid":"4d3b6574-49f7-47f6-b36b-4da14ca290f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6817","nonce":3701478409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6819","nonce":3701478409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6823","nonce":3701478409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6821","nonce":3701478409}]},"public_addr":"172.21.15.98:6817/3701478409","cluster_addr":"172.21.15.98:6819/3701478409","heartbeat_back_addr":"172.21.15.98:6823/3701478409","heartbeat_front_addr":"172.21.15.98:6821/3701478409","state":["exists","up"]},{"osd":9,"uuid":"7dd2fe25-1b75-48e5-86c7-c7a3ab85053f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6827","nonce":2580755002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6829","nonce":2580755002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6833","nonce":2580755002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6831","nonce":2580755002}]},"public_addr":"172.21.15.1:6827/2580755002","cluster_addr":"172.21.15.1:6829/2580755002","heartbeat_back_addr":"172.21.15.1:6833/2580755002","heartbeat_front_addr":"172.21.15.1:6831/2580755002","state":["exists","up"]},{"osd":10,"uuid":"fcad11dc-0a1b-44a2-ac32-74100e317255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6825","nonce":3989063573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6827","nonce":3989063573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6831","nonce":3989063573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6829","nonce":3989063573}]},"public_addr":"172.21.15.12:6825/3989063573","cluster_addr":"172.21.15.12:6827/3989063573","heartbeat_back_addr":"172.21.15.12:6831/3989063573","heartbeat_front_addr":"172.21.15.12:6829/3989063573","state":["exists","up"]},{"osd":11,"uuid":"f4e717bb-586d-4fe2-9e6b-f574be4db36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6825","nonce":839956167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6827","nonce":839956167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6831","nonce":839956167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6829","nonce":839956167}]},"public_addr":"172.21.15.98:6825/839956167","cluster_addr":"172.21.15.98:6827/839956167","heartbeat_back_addr":"172.21.15.98:6831/839956167","heartbeat_front_addr":"172.21.15.98:6829/839956167","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:17:01.990618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:17:28.259003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:17:52.825080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:18:22.724038+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:18:48.383663+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:19:13.246563+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:19:42.318469+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:20:08.809160+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:20:32.628925+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:21:02.280217+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:21:27.897758+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:21:52.055015+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6800/3145051160":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/3101438101":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/4159811089":"2024-09-16T22:15:31.433375+0000","172.21.15.1:6801/3145051160":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/2785155592":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/714180295":"2024-09-16T22:15:03.937536+0000","172.21.15.1:6801/215291238":"2024-09-16T22:15:03.937536+0000","172.21.15.1:6800/215291238":"2024-09-16T22:15:03.937536+0000","172.21.15.1:0/1842817732":"2024-09-16T22:15:03.937536+0000","172.21.15.1:0/3888009741":"2024-09-16T22:15:03.937536+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:22:56.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:56.101+0000 7fb570800640 1 -- 172.21.15.1:0/3494191031 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb5500a32c0 msgr2=0x7fb5500a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:56.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:56.101+0000 7fb570800640 1 --2- 172.21.15.1:0/3494191031 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb5500a32c0 0x7fb5500a5780 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb55c0095f0 tx=0x7fb55c005f90 comp rx=0 tx=0).stop 2024-09-15T22:22:56.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:56.101+0000 7fb570800640 1 -- 172.21.15.1:0/3494191031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb568074f40 msgr2=0x7fb56819abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:56.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:56.101+0000 7fb570800640 1 --2- 172.21.15.1:0/3494191031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb568074f40 0x7fb56819abb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb55802a9a0 tx=0x7fb558003b20 comp rx=0 tx=0).stop 2024-09-15T22:22:56.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:56.101+0000 7fb570800640 1 -- 172.21.15.1:0/3494191031 shutdown_connections 2024-09-15T22:22:56.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:56.101+0000 7fb570800640 1 --2- 172.21.15.1:0/3494191031 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb5500a32c0 0x7fb5500a5780 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:56.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:56.101+0000 7fb570800640 1 --2- 172.21.15.1:0/3494191031 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb56810e3c0 0x7fb56819ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:56.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:56.101+0000 7fb570800640 1 --2- 172.21.15.1:0/3494191031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb568074f40 0x7fb56819abb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:56.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:56.101+0000 7fb570800640 1 --2- 172.21.15.1:0/3494191031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb568074620 0x7fb56819a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:56.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:56.101+0000 7fb570800640 1 -- 172.21.15.1:0/3494191031 >> 172.21.15.1:0/3494191031 conn(0x7fb5680fd8c0 msgr2=0x7fb5680fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:56.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:56.102+0000 7fb570800640 1 -- 172.21.15.1:0/3494191031 shutdown_connections 2024-09-15T22:22:56.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:56.102+0000 7fb570800640 1 -- 172.21.15.1:0/3494191031 wait complete. 2024-09-15T22:22:56.969 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-15T22:22:57.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:56 smithi098 ceph-mon[35514]: pgmap v294: 97 pgs: 6 creating+peering, 91 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-15T22:22:57.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:56 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/3494191031' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:22:57.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:56 smithi001 ceph-mon[30843]: pgmap v294: 97 pgs: 6 creating+peering, 91 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-15T22:22:57.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:56 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/3494191031' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:22:57.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:56 smithi012 ceph-mon[34883]: pgmap v294: 97 pgs: 6 creating+peering, 91 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-15T22:22:57.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:56 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/3494191031' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:22:57.348 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:22:57.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.880+0000 7f0655a00640 1 -- 172.21.15.1:0/1077931655 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0650101de0 msgr2=0x7f06501021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:57.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.880+0000 7f0655a00640 1 --2- 172.21.15.1:0/1077931655 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0650101de0 0x7f06501021c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0640009900 tx=0x7f064002a410 comp rx=0 tx=0).stop 2024-09-15T22:22:57.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.880+0000 7f0655a00640 1 -- 172.21.15.1:0/1077931655 shutdown_connections 2024-09-15T22:22:57.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.880+0000 7f0655a00640 1 --2- 172.21.15.1:0/1077931655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0650106f10 0x7f065010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:57.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.880+0000 7f0655a00640 1 --2- 172.21.15.1:0/1077931655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0650102790 0x7f06501067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:57.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.880+0000 7f0655a00640 1 --2- 172.21.15.1:0/1077931655 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0650101de0 0x7f06501021c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:57.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.880+0000 7f0655a00640 1 -- 172.21.15.1:0/1077931655 >> 172.21.15.1:0/1077931655 conn(0x7f06500fd8c0 msgr2=0x7f06500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:57.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.880+0000 7f0655a00640 1 -- 172.21.15.1:0/1077931655 shutdown_connections 2024-09-15T22:22:57.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.880+0000 7f0655a00640 1 -- 172.21.15.1:0/1077931655 wait complete. 2024-09-15T22:22:57.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.881+0000 7f0655a00640 1 Processor -- start 2024-09-15T22:22:57.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.881+0000 7f0655a00640 1 -- start start 2024-09-15T22:22:57.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.881+0000 7f0655a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0650101de0 0x7f065019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:57.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.881+0000 7f0655a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0650102790 0x7f065019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:57.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.882+0000 7f0655a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0650106f10 0x7f065019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:57.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.882+0000 7f0655a00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0650111fc0 con 0x7f0650101de0 2024-09-15T22:22:57.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.882+0000 7f0655a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0650111e40 con 0x7f0650106f10 2024-09-15T22:22:57.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.882+0000 7f0655a00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0650112140 con 0x7f0650102790 2024-09-15T22:22:57.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.882+0000 7f064ea00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0650101de0 0x7f065019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:57.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.882+0000 7f064ea00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0650101de0 0x7f065019a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52716/0 (socket says 172.21.15.1:52716) 2024-09-15T22:22:57.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.882+0000 7f064ea00640 1 -- 172.21.15.1:0/4180868202 learned_addr learned my addr 172.21.15.1:0/4180868202 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:22:57.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.882+0000 7f064f400640 1 --2- 172.21.15.1:0/4180868202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0650106f10 0x7f065019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:57.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.882+0000 7f0646000640 1 --2- 172.21.15.1:0/4180868202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0650102790 0x7f065019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:57.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.882+0000 7f064ea00640 1 -- 172.21.15.1:0/4180868202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0650102790 msgr2=0x7f065019ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:57.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.882+0000 7f064ea00640 1 --2- 172.21.15.1:0/4180868202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0650102790 0x7f065019ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:57.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.882+0000 7f064ea00640 1 -- 172.21.15.1:0/4180868202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0650106f10 msgr2=0x7f065019ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:57.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.882+0000 7f064ea00640 1 --2- 172.21.15.1:0/4180868202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0650106f10 0x7f065019ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:57.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.882+0000 7f064ea00640 1 -- 172.21.15.1:0/4180868202 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f065019f5f0 con 0x7f0650101de0 2024-09-15T22:22:57.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.882+0000 7f064f400640 1 --2- 172.21.15.1:0/4180868202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0650106f10 0x7f065019ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:22:57.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.883+0000 7f064ea00640 1 --2- 172.21.15.1:0/4180868202 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0650101de0 0x7f065019a640 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0640004770 tx=0x7f0640003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:57.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.883+0000 7f0647e00640 1 -- 172.21.15.1:0/4180868202 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064003f070 con 0x7f0650101de0 2024-09-15T22:22:57.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.883+0000 7f0647e00640 1 -- 172.21.15.1:0/4180868202 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0640031ca0 con 0x7f0650101de0 2024-09-15T22:22:57.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.883+0000 7f0655a00640 1 -- 172.21.15.1:0/4180868202 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f065019f880 con 0x7f0650101de0 2024-09-15T22:22:57.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.883+0000 7f0647e00640 1 -- 172.21.15.1:0/4180868202 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0640035030 con 0x7f0650101de0 2024-09-15T22:22:57.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.883+0000 7f0655a00640 1 -- 172.21.15.1:0/4180868202 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06501a71c0 con 0x7f0650101de0 2024-09-15T22:22:57.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.884+0000 7f0655a00640 1 -- 172.21.15.1:0/4180868202 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06501032c0 con 0x7f0650101de0 2024-09-15T22:22:57.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.888+0000 7f0647e00640 1 -- 172.21.15.1:0/4180868202 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f0640042070 con 0x7f0650101de0 2024-09-15T22:22:57.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.889+0000 7f0647e00640 1 --2- 172.21.15.1:0/4180868202 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f06340a3240 0x7f06340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:57.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.889+0000 7f0647e00640 1 -- 172.21.15.1:0/4180868202 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f06400f03e0 con 0x7f0650101de0 2024-09-15T22:22:57.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.889+0000 7f0646000640 1 --2- 172.21.15.1:0/4180868202 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f06340a3240 0x7f06340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:57.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.890+0000 7f0646000640 1 --2- 172.21.15.1:0/4180868202 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f06340a3240 0x7f06340a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f06380095f0 tx=0x7f0638005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:57.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:57.892+0000 7f0647e00640 1 -- 172.21.15.1:0/4180868202 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f06400bcc20 con 0x7f0650101de0 2024-09-15T22:22:58.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:58.119+0000 7f0655a00640 1 -- 172.21.15.1:0/4180868202 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f06501021c0 con 0x7f0650101de0 2024-09-15T22:22:58.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:58.800+0000 7f0647e00640 1 -- 172.21.15.1:0/4180868202 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f06501021c0 con 0x7f0650101de0 2024-09-15T22:22:58.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:58.803+0000 7f0655a00640 1 -- 172.21.15.1:0/4180868202 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f06340a3240 msgr2=0x7f06340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:58.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:58.803+0000 7f0655a00640 1 --2- 172.21.15.1:0/4180868202 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f06340a3240 0x7f06340a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f06380095f0 tx=0x7f0638005f90 comp rx=0 tx=0).stop 2024-09-15T22:22:58.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:58.803+0000 7f0655a00640 1 -- 172.21.15.1:0/4180868202 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0650101de0 msgr2=0x7f065019a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:58.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:58.803+0000 7f0655a00640 1 --2- 172.21.15.1:0/4180868202 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0650101de0 0x7f065019a640 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0640004770 tx=0x7f0640003c10 comp rx=0 tx=0).stop 2024-09-15T22:22:58.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:58.803+0000 7f0655a00640 1 -- 172.21.15.1:0/4180868202 shutdown_connections 2024-09-15T22:22:58.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:58.803+0000 7f0655a00640 1 --2- 172.21.15.1:0/4180868202 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f06340a3240 0x7f06340a5700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:58.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:58.803+0000 7f0655a00640 1 --2- 172.21.15.1:0/4180868202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0650106f10 0x7f065019ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:58.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:58.803+0000 7f0655a00640 1 --2- 172.21.15.1:0/4180868202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0650102790 0x7f065019ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:58.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:58.803+0000 7f0655a00640 1 --2- 172.21.15.1:0/4180868202 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0650101de0 0x7f065019a640 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:58.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:58.803+0000 7f0655a00640 1 -- 172.21.15.1:0/4180868202 >> 172.21.15.1:0/4180868202 conn(0x7f06500fd8c0 msgr2=0x7f06500feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:58.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:58.803+0000 7f0655a00640 1 -- 172.21.15.1:0/4180868202 shutdown_connections 2024-09-15T22:22:58.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:22:58.804+0000 7f0655a00640 1 -- 172.21.15.1:0/4180868202 wait complete. 2024-09-15T22:22:59.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:58 smithi098 ceph-mon[35514]: pgmap v295: 97 pgs: 97 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-15T22:22:59.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:58 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/4180868202' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-15T22:22:59.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:58 smithi001 ceph-mon[30843]: pgmap v295: 97 pgs: 97 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-15T22:22:59.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:58 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/4180868202' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-15T22:22:59.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:58 smithi012 ceph-mon[34883]: pgmap v295: 97 pgs: 97 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-15T22:22:59.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:58 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/4180868202' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-15T22:22:59.603 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-09-15T22:22:59.604 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-09-15T22:22:59.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:59 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/4180868202' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-15T22:22:59.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:22:59 smithi001 ceph-mon[30843]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-15T22:22:59.982 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:00.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:59 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/4180868202' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-15T22:23:00.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:22:59 smithi098 ceph-mon[35514]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-15T22:23:00.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:59 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/4180868202' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-15T22:23:00.247 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:22:59 smithi012 ceph-mon[34883]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-15T22:23:00.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.630+0000 7f2b74c00640 1 -- 172.21.15.1:0/27737188 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b701049c0 msgr2=0x7f2b70108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:00.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.630+0000 7f2b74c00640 1 --2- 172.21.15.1:0/27737188 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b701049c0 0x7f2b70108a10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2b58009900 tx=0x7f2b5802a410 comp rx=0 tx=0).stop 2024-09-15T22:23:00.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.631+0000 7f2b74c00640 1 -- 172.21.15.1:0/27737188 shutdown_connections 2024-09-15T22:23:00.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.631+0000 7f2b74c00640 1 --2- 172.21.15.1:0/27737188 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b70109140 0x7f2b70110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:00.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.631+0000 7f2b74c00640 1 --2- 172.21.15.1:0/27737188 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b701049c0 0x7f2b70108a10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:00.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.631+0000 7f2b74c00640 1 --2- 172.21.15.1:0/27737188 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b70104010 0x7f2b701043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:00.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.631+0000 7f2b74c00640 1 -- 172.21.15.1:0/27737188 >> 172.21.15.1:0/27737188 conn(0x7f2b700ffa50 msgr2=0x7f2b70101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:00.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.631+0000 7f2b74c00640 1 -- 172.21.15.1:0/27737188 shutdown_connections 2024-09-15T22:23:00.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.631+0000 7f2b74c00640 1 -- 172.21.15.1:0/27737188 wait complete. 2024-09-15T22:23:00.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.632+0000 7f2b74c00640 1 Processor -- start 2024-09-15T22:23:00.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.632+0000 7f2b74c00640 1 -- start start 2024-09-15T22:23:00.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.632+0000 7f2b74c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b70104010 0x7f2b7019a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:00.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.632+0000 7f2b74c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b701049c0 0x7f2b7019ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:00.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.632+0000 7f2b74c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b70109140 0x7f2b7019eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:00.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.632+0000 7f2b74c00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2b70114160 con 0x7f2b70109140 2024-09-15T22:23:00.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.632+0000 7f2b74c00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2b70113fe0 con 0x7f2b701049c0 2024-09-15T22:23:00.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.632+0000 7f2b74c00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2b701142e0 con 0x7f2b70104010 2024-09-15T22:23:00.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.632+0000 7f2b6e800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b70109140 0x7f2b7019eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:00.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.632+0000 7f2b6de00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b70104010 0x7f2b7019a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:00.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.632+0000 7f2b6e800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b70109140 0x7f2b7019eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52742/0 (socket says 172.21.15.1:52742) 2024-09-15T22:23:00.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.632+0000 7f2b6e800640 1 -- 172.21.15.1:0/2356858156 learned_addr learned my addr 172.21.15.1:0/2356858156 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:00.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.632+0000 7f2b67e00640 1 --2- 172.21.15.1:0/2356858156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b701049c0 0x7f2b7019ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:00.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.633+0000 7f2b6de00640 1 -- 172.21.15.1:0/2356858156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b701049c0 msgr2=0x7f2b7019ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:00.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.633+0000 7f2b6de00640 1 --2- 172.21.15.1:0/2356858156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b701049c0 0x7f2b7019ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:00.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.633+0000 7f2b6de00640 1 -- 172.21.15.1:0/2356858156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b70109140 msgr2=0x7f2b7019eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:00.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.633+0000 7f2b6de00640 1 --2- 172.21.15.1:0/2356858156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b70109140 0x7f2b7019eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:00.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.633+0000 7f2b6de00640 1 -- 172.21.15.1:0/2356858156 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b7019f6d0 con 0x7f2b70104010 2024-09-15T22:23:00.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.633+0000 7f2b6de00640 1 --2- 172.21.15.1:0/2356858156 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b70104010 0x7f2b7019a720 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2b6000e9f0 tx=0x7f2b6000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:00.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.634+0000 7f2b66a00640 1 -- 172.21.15.1:0/2356858156 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6000ccc0 con 0x7f2b70104010 2024-09-15T22:23:00.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.634+0000 7f2b74c00640 1 -- 172.21.15.1:0/2356858156 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b7019f9c0 con 0x7f2b70104010 2024-09-15T22:23:00.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.634+0000 7f2b66a00640 1 -- 172.21.15.1:0/2356858156 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b60005020 con 0x7f2b70104010 2024-09-15T22:23:00.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.634+0000 7f2b66a00640 1 -- 172.21.15.1:0/2356858156 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b600049e0 con 0x7f2b70104010 2024-09-15T22:23:00.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.634+0000 7f2b74c00640 1 -- 172.21.15.1:0/2356858156 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b701a72a0 con 0x7f2b70104010 2024-09-15T22:23:00.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.635+0000 7f2b74c00640 1 -- 172.21.15.1:0/2356858156 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b701043f0 con 0x7f2b70104010 2024-09-15T22:23:00.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.637+0000 7f2b66a00640 1 -- 172.21.15.1:0/2356858156 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f2b60005560 con 0x7f2b70104010 2024-09-15T22:23:00.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.638+0000 7f2b66a00640 1 --2- 172.21.15.1:0/2356858156 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2b540a3240 0x7f2b540a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:00.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.638+0000 7f2b66a00640 1 -- 172.21.15.1:0/2356858156 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f2b600cf870 con 0x7f2b70104010 2024-09-15T22:23:00.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.638+0000 7f2b67e00640 1 --2- 172.21.15.1:0/2356858156 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2b540a3240 0x7f2b540a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:00.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.639+0000 7f2b67e00640 1 --2- 172.21.15.1:0/2356858156 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2b540a3240 0x7f2b540a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2b58009230 tx=0x7f2b580058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:00.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.640+0000 7f2b66a00640 1 -- 172.21.15.1:0/2356858156 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2b600051d0 con 0x7f2b70104010 2024-09-15T22:23:00.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:00.864+0000 7f2b74c00640 1 -- 172.21.15.1:0/2356858156 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f2b7010c380 con 0x7f2b70104010 2024-09-15T22:23:01.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:00 smithi098 ceph-mon[35514]: pgmap v296: 97 pgs: 97 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-15T22:23:01.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:00 smithi001 ceph-mon[30843]: pgmap v296: 97 pgs: 97 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-15T22:23:01.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:00 smithi012 ceph-mon[34883]: pgmap v296: 97 pgs: 97 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-15T22:23:01.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:01.812+0000 7f2b66a00640 1 -- 172.21.15.1:0/2356858156 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f2b6009c6d0 con 0x7f2b70104010 2024-09-15T22:23:01.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:01.815+0000 7f2b74c00640 1 -- 172.21.15.1:0/2356858156 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2b540a3240 msgr2=0x7f2b540a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:01.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:01.815+0000 7f2b74c00640 1 --2- 172.21.15.1:0/2356858156 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2b540a3240 0x7f2b540a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2b58009230 tx=0x7f2b580058d0 comp rx=0 tx=0).stop 2024-09-15T22:23:01.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:01.815+0000 7f2b74c00640 1 -- 172.21.15.1:0/2356858156 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b70104010 msgr2=0x7f2b7019a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:01.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:01.815+0000 7f2b74c00640 1 --2- 172.21.15.1:0/2356858156 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b70104010 0x7f2b7019a720 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2b6000e9f0 tx=0x7f2b6000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:23:01.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:01.816+0000 7f2b74c00640 1 -- 172.21.15.1:0/2356858156 shutdown_connections 2024-09-15T22:23:01.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:01.816+0000 7f2b74c00640 1 --2- 172.21.15.1:0/2356858156 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2b540a3240 0x7f2b540a5700 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:01.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:01.816+0000 7f2b74c00640 1 --2- 172.21.15.1:0/2356858156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b70109140 0x7f2b7019eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:01.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:01.816+0000 7f2b74c00640 1 --2- 172.21.15.1:0/2356858156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b701049c0 0x7f2b7019ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:01.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:01.816+0000 7f2b74c00640 1 --2- 172.21.15.1:0/2356858156 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b70104010 0x7f2b7019a720 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:01.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:01.816+0000 7f2b74c00640 1 -- 172.21.15.1:0/2356858156 >> 172.21.15.1:0/2356858156 conn(0x7f2b700ffa50 msgr2=0x7f2b70100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:01.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:01.816+0000 7f2b74c00640 1 -- 172.21.15.1:0/2356858156 shutdown_connections 2024-09-15T22:23:01.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:01.816+0000 7f2b74c00640 1 -- 172.21.15.1:0/2356858156 wait complete. 2024-09-15T22:23:02.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:01 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/2356858156' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-15T22:23:02.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:01 smithi001 ceph-mon[30843]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-15T22:23:02.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:01 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/2356858156' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-15T22:23:02.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:01 smithi012 ceph-mon[34883]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-15T22:23:02.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:01 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/2356858156' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-15T22:23:02.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:01 smithi098 ceph-mon[35514]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-15T22:23:02.602 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-15T22:23:02.989 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:03.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:02 smithi001 ceph-mon[30843]: pgmap v297: 97 pgs: 97 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-15T22:23:03.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:02 smithi001 ceph-mon[30843]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-15T22:23:03.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:02 smithi001 ceph-mon[30843]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-15T22:23:03.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:02 smithi001 ceph-mon[30843]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-15T22:23:03.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:02 smithi001 ceph-mon[30843]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-15T22:23:03.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:02 smithi001 ceph-mon[30843]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-15T22:23:03.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:02 smithi001 ceph-mon[30843]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-15T22:23:03.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:02 smithi012 ceph-mon[34883]: pgmap v297: 97 pgs: 97 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-15T22:23:03.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:02 smithi012 ceph-mon[34883]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-15T22:23:03.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:02 smithi012 ceph-mon[34883]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-15T22:23:03.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:02 smithi012 ceph-mon[34883]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-15T22:23:03.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:02 smithi012 ceph-mon[34883]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-15T22:23:03.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:02 smithi012 ceph-mon[34883]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-15T22:23:03.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:02 smithi012 ceph-mon[34883]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-15T22:23:03.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:02 smithi098 ceph-mon[35514]: pgmap v297: 97 pgs: 97 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-15T22:23:03.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:02 smithi098 ceph-mon[35514]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-15T22:23:03.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:02 smithi098 ceph-mon[35514]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-15T22:23:03.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:02 smithi098 ceph-mon[35514]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-15T22:23:03.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:02 smithi098 ceph-mon[35514]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-15T22:23:03.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:02 smithi098 ceph-mon[35514]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-15T22:23:03.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:02 smithi098 ceph-mon[35514]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-15T22:23:03.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.661+0000 7f3562200640 1 -- 172.21.15.1:0/735327177 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f355c1049c0 msgr2=0x7f355c108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:03.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.661+0000 7f3562200640 1 --2- 172.21.15.1:0/735327177 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f355c1049c0 0x7f355c108a10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3548009900 tx=0x7f354802a410 comp rx=0 tx=0).stop 2024-09-15T22:23:03.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.661+0000 7f3562200640 1 -- 172.21.15.1:0/735327177 shutdown_connections 2024-09-15T22:23:03.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.661+0000 7f3562200640 1 --2- 172.21.15.1:0/735327177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f355c109140 0x7f355c110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:03.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.661+0000 7f3562200640 1 --2- 172.21.15.1:0/735327177 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f355c1049c0 0x7f355c108a10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:03.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.661+0000 7f3562200640 1 --2- 172.21.15.1:0/735327177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f355c104010 0x7f355c1043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:03.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.661+0000 7f3562200640 1 -- 172.21.15.1:0/735327177 >> 172.21.15.1:0/735327177 conn(0x7f355c0ffa50 msgr2=0x7f355c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:03.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.661+0000 7f3562200640 1 -- 172.21.15.1:0/735327177 shutdown_connections 2024-09-15T22:23:03.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.661+0000 7f3562200640 1 -- 172.21.15.1:0/735327177 wait complete. 2024-09-15T22:23:03.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.662+0000 7f3562200640 1 Processor -- start 2024-09-15T22:23:03.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.662+0000 7f3562200640 1 -- start start 2024-09-15T22:23:03.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.663+0000 7f3562200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f355c104010 0x7f355c19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:03.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.663+0000 7f3562200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f355c1049c0 0x7f355c19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:03.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.663+0000 7f3562200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f355c109140 0x7f355c19ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:03.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.663+0000 7f3562200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f355c114160 con 0x7f355c109140 2024-09-15T22:23:03.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.663+0000 7f3562200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f355c113fe0 con 0x7f355c104010 2024-09-15T22:23:03.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.663+0000 7f3562200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f355c1142e0 con 0x7f355c1049c0 2024-09-15T22:23:03.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.663+0000 7f355b400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f355c104010 0x7f355c19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:03.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.663+0000 7f355b400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f355c104010 0x7f355c19a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:40032/0 (socket says 172.21.15.1:40032) 2024-09-15T22:23:03.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.663+0000 7f355b400640 1 -- 172.21.15.1:0/325584166 learned_addr learned my addr 172.21.15.1:0/325584166 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:03.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.663+0000 7f355aa00640 1 --2- 172.21.15.1:0/325584166 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f355c1049c0 0x7f355c19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:03.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.663+0000 7f355be00640 1 --2- 172.21.15.1:0/325584166 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f355c109140 0x7f355c19ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:03.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.663+0000 7f355b400640 1 -- 172.21.15.1:0/325584166 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f355c1049c0 msgr2=0x7f355c19ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:03.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.663+0000 7f355b400640 1 --2- 172.21.15.1:0/325584166 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f355c1049c0 0x7f355c19ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:03.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.663+0000 7f355b400640 1 -- 172.21.15.1:0/325584166 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f355c109140 msgr2=0x7f355c19ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:03.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.663+0000 7f355b400640 1 --2- 172.21.15.1:0/325584166 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f355c109140 0x7f355c19ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:03.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.663+0000 7f355b400640 1 -- 172.21.15.1:0/325584166 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f355c19f5f0 con 0x7f355c104010 2024-09-15T22:23:03.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.663+0000 7f355be00640 1 --2- 172.21.15.1:0/325584166 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f355c109140 0x7f355c19ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:23:03.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.664+0000 7f355b400640 1 --2- 172.21.15.1:0/325584166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f355c104010 0x7f355c19a640 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f354c00e9f0 tx=0x7f354c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:03.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.664+0000 7f3553e00640 1 -- 172.21.15.1:0/325584166 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354c00cd80 con 0x7f355c104010 2024-09-15T22:23:03.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.664+0000 7f3553e00640 1 -- 172.21.15.1:0/325584166 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f354c010910 con 0x7f355c104010 2024-09-15T22:23:03.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.664+0000 7f3553e00640 1 -- 172.21.15.1:0/325584166 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354c018990 con 0x7f355c104010 2024-09-15T22:23:03.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.664+0000 7f3562200640 1 -- 172.21.15.1:0/325584166 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f355c19f8e0 con 0x7f355c104010 2024-09-15T22:23:03.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.664+0000 7f3562200640 1 -- 172.21.15.1:0/325584166 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f355c1a71c0 con 0x7f355c104010 2024-09-15T22:23:03.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.665+0000 7f3562200640 1 -- 172.21.15.1:0/325584166 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f355c1043f0 con 0x7f355c104010 2024-09-15T22:23:03.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.667+0000 7f3553e00640 1 -- 172.21.15.1:0/325584166 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f354c010ac0 con 0x7f355c104010 2024-09-15T22:23:03.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.669+0000 7f3553e00640 1 --2- 172.21.15.1:0/325584166 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f35400a32c0 0x7f35400a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:03.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.669+0000 7f3553e00640 1 -- 172.21.15.1:0/325584166 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f354c0cffa0 con 0x7f355c104010 2024-09-15T22:23:03.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.669+0000 7f355aa00640 1 --2- 172.21.15.1:0/325584166 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f35400a32c0 0x7f35400a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:03.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.669+0000 7f355aa00640 1 --2- 172.21.15.1:0/325584166 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f35400a32c0 0x7f35400a5780 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3548009230 tx=0x7f35480058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:03.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.671+0000 7f3553e00640 1 -- 172.21.15.1:0/325584166 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f354c09cd70 con 0x7f355c104010 2024-09-15T22:23:03.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:03.895+0000 7f3562200640 1 -- 172.21.15.1:0/325584166 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f355c10c3b0 con 0x7f355c104010 2024-09-15T22:23:04.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:03 smithi001 ceph-mon[30843]: mds.? [v2:172.21.15.12:6838/1469511155,v1:172.21.15.12:6839/1469511155] up:active 2024-09-15T22:23:04.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:03 smithi001 ceph-mon[30843]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-15T22:23:04.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:03 smithi001 ceph-mon[30843]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-15T22:23:04.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:03 smithi001 ceph-mon[30843]: Cluster is now healthy 2024-09-15T22:23:04.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:03 smithi001 ceph-mon[30843]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-15T22:23:04.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:03 smithi001 ceph-mon[30843]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-15T22:23:04.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:03 smithi001 ceph-mon[30843]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-15T22:23:04.212 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:03 smithi098 ceph-mon[35514]: mds.? [v2:172.21.15.12:6838/1469511155,v1:172.21.15.12:6839/1469511155] up:active 2024-09-15T22:23:04.212 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:03 smithi098 ceph-mon[35514]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-15T22:23:04.213 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:03 smithi098 ceph-mon[35514]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-15T22:23:04.213 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:03 smithi098 ceph-mon[35514]: Cluster is now healthy 2024-09-15T22:23:04.213 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:03 smithi098 ceph-mon[35514]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-15T22:23:04.213 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:03 smithi098 ceph-mon[35514]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-15T22:23:04.213 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:03 smithi098 ceph-mon[35514]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-15T22:23:04.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:03 smithi012 ceph-mon[34883]: mds.? [v2:172.21.15.12:6838/1469511155,v1:172.21.15.12:6839/1469511155] up:active 2024-09-15T22:23:04.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:03 smithi012 ceph-mon[34883]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-15T22:23:04.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:03 smithi012 ceph-mon[34883]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-15T22:23:04.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:03 smithi012 ceph-mon[34883]: Cluster is now healthy 2024-09-15T22:23:04.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:03 smithi012 ceph-mon[34883]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-15T22:23:04.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:03 smithi012 ceph-mon[34883]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-15T22:23:04.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:03 smithi012 ceph-mon[34883]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-15T22:23:04.561 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 15 22:23:04 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-i[66060]: 2024-09-15T22:23:04.210+0000 7f6a135a9640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-15T22:23:04.561 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 15 22:23:04 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-i[66060]: 2024-09-15T22:23:04.210+0000 7f6a135a9640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-15T22:23:04.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:04.834+0000 7f3553e00640 1 -- 172.21.15.1:0/325584166 <== mon.2 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f354c09c670 con 0x7f355c104010 2024-09-15T22:23:04.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:04.838+0000 7f3562200640 1 -- 172.21.15.1:0/325584166 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f35400a32c0 msgr2=0x7f35400a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:04.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:04.838+0000 7f3562200640 1 --2- 172.21.15.1:0/325584166 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f35400a32c0 0x7f35400a5780 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3548009230 tx=0x7f35480058d0 comp rx=0 tx=0).stop 2024-09-15T22:23:04.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:04.838+0000 7f3562200640 1 -- 172.21.15.1:0/325584166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f355c104010 msgr2=0x7f355c19a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:04.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:04.838+0000 7f3562200640 1 --2- 172.21.15.1:0/325584166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f355c104010 0x7f355c19a640 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f354c00e9f0 tx=0x7f354c00eeb0 comp rx=0 tx=0).stop 2024-09-15T22:23:04.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:04.838+0000 7f3562200640 1 -- 172.21.15.1:0/325584166 shutdown_connections 2024-09-15T22:23:04.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:04.838+0000 7f3562200640 1 --2- 172.21.15.1:0/325584166 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f35400a32c0 0x7f35400a5780 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:04.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:04.838+0000 7f3562200640 1 --2- 172.21.15.1:0/325584166 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f355c109140 0x7f355c19ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:04.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:04.838+0000 7f3562200640 1 --2- 172.21.15.1:0/325584166 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f355c1049c0 0x7f355c19ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:04.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:04.838+0000 7f3562200640 1 --2- 172.21.15.1:0/325584166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f355c104010 0x7f355c19a640 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:04.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:04.838+0000 7f3562200640 1 -- 172.21.15.1:0/325584166 >> 172.21.15.1:0/325584166 conn(0x7f355c0ffa50 msgr2=0x7f355c100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:04.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:04.838+0000 7f3562200640 1 -- 172.21.15.1:0/325584166 shutdown_connections 2024-09-15T22:23:04.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:04.838+0000 7f3562200640 1 -- 172.21.15.1:0/325584166 wait complete. 2024-09-15T22:23:05.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:04 smithi001 ceph-mon[30843]: pgmap v298: 97 pgs: 97 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-09-15T22:23:05.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:04 smithi001 ceph-mon[30843]: mds.? [v2:172.21.15.98:6836/493594054,v1:172.21.15.98:6837/493594054] up:active 2024-09-15T22:23:05.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:04 smithi001 ceph-mon[30843]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-15T22:23:05.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:04 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/325584166' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-15T22:23:05.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:04 smithi001 ceph-mon[30843]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-15T22:23:05.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:04 smithi012 ceph-mon[34883]: pgmap v298: 97 pgs: 97 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-09-15T22:23:05.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:04 smithi012 ceph-mon[34883]: mds.? [v2:172.21.15.98:6836/493594054,v1:172.21.15.98:6837/493594054] up:active 2024-09-15T22:23:05.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:04 smithi012 ceph-mon[34883]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-15T22:23:05.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:04 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/325584166' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-15T22:23:05.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:04 smithi012 ceph-mon[34883]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-15T22:23:05.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:04 smithi098 ceph-mon[35514]: pgmap v298: 97 pgs: 97 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-09-15T22:23:05.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:04 smithi098 ceph-mon[35514]: mds.? [v2:172.21.15.98:6836/493594054,v1:172.21.15.98:6837/493594054] up:active 2024-09-15T22:23:05.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:04 smithi098 ceph-mon[35514]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-15T22:23:05.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:04 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/325584166' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-15T22:23:05.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:04 smithi098 ceph-mon[35514]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-15T22:23:05.777 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-15T22:23:06.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:05 smithi001 ceph-mon[30843]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-15T22:23:06.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:05 smithi001 ceph-mon[30843]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-15T22:23:06.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:05 smithi001 ceph-mon[30843]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-15T22:23:06.156 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:06.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:05 smithi012 ceph-mon[34883]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-15T22:23:06.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:05 smithi012 ceph-mon[34883]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-15T22:23:06.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:05 smithi012 ceph-mon[34883]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-15T22:23:06.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:05 smithi098 ceph-mon[35514]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-15T22:23:06.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:05 smithi098 ceph-mon[35514]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-15T22:23:06.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:05 smithi098 ceph-mon[35514]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-15T22:23:06.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.743+0000 7f4597e00640 1 -- 172.21.15.1:0/1245260458 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45981019d0 msgr2=0x7f4598101e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:06.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.743+0000 7f4597e00640 1 --2- 172.21.15.1:0/1245260458 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45981019d0 0x7f4598101e30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4584009930 tx=0x7f458402a420 comp rx=0 tx=0).stop 2024-09-15T22:23:06.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.743+0000 7f4597e00640 1 -- 172.21.15.1:0/1245260458 shutdown_connections 2024-09-15T22:23:06.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.743+0000 7f4597e00640 1 --2- 172.21.15.1:0/1245260458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4598102370 0x7f459810e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:06.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.743+0000 7f4597e00640 1 --2- 172.21.15.1:0/1245260458 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45981019d0 0x7f4598101e30 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:06.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.743+0000 7f4597e00640 1 --2- 172.21.15.1:0/1245260458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45981079d0 0x7f4598107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:06.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.743+0000 7f4597e00640 1 -- 172.21.15.1:0/1245260458 >> 172.21.15.1:0/1245260458 conn(0x7f45980fd710 msgr2=0x7f45980ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:06.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.743+0000 7f4597e00640 1 -- 172.21.15.1:0/1245260458 shutdown_connections 2024-09-15T22:23:06.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.743+0000 7f4597e00640 1 -- 172.21.15.1:0/1245260458 wait complete. 2024-09-15T22:23:06.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.744+0000 7f4597e00640 1 Processor -- start 2024-09-15T22:23:06.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.744+0000 7f4597e00640 1 -- start start 2024-09-15T22:23:06.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.745+0000 7f4597e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45981019d0 0x7f45980744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:06.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.745+0000 7f4597e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4598102370 0x7f4598074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:06.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.745+0000 7f4597e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45981079d0 0x7f4598074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:06.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.745+0000 7f4597e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4598111e20 con 0x7f45981079d0 2024-09-15T22:23:06.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.745+0000 7f4597e00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4598111ca0 con 0x7f45981019d0 2024-09-15T22:23:06.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.745+0000 7f4597e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4598111fa0 con 0x7f4598102370 2024-09-15T22:23:06.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.745+0000 7f4597400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45981079d0 0x7f4598074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:06.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.745+0000 7f4596a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45981019d0 0x7f45980744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:06.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.745+0000 7f4597400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45981079d0 0x7f4598074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52772/0 (socket says 172.21.15.1:52772) 2024-09-15T22:23:06.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.745+0000 7f4597400640 1 -- 172.21.15.1:0/584472257 learned_addr learned my addr 172.21.15.1:0/584472257 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:06.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.745+0000 7f4596000640 1 --2- 172.21.15.1:0/584472257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4598102370 0x7f4598074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:06.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.746+0000 7f4597400640 1 -- 172.21.15.1:0/584472257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4598102370 msgr2=0x7f4598074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:06.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.746+0000 7f4597400640 1 --2- 172.21.15.1:0/584472257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4598102370 0x7f4598074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:06.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.746+0000 7f4597400640 1 -- 172.21.15.1:0/584472257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45981019d0 msgr2=0x7f45980744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:06.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.746+0000 7f4597400640 1 --2- 172.21.15.1:0/584472257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45981019d0 0x7f45980744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:06.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.746+0000 7f4597400640 1 -- 172.21.15.1:0/584472257 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45981a6760 con 0x7f45981079d0 2024-09-15T22:23:06.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.746+0000 7f4597400640 1 --2- 172.21.15.1:0/584472257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45981079d0 0x7f4598074f70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f459000eb10 tx=0x7f459000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:06.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.746+0000 7f458f400640 1 -- 172.21.15.1:0/584472257 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4590004b20 con 0x7f45981079d0 2024-09-15T22:23:06.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.746+0000 7f458f400640 1 -- 172.21.15.1:0/584472257 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4590004cc0 con 0x7f45981079d0 2024-09-15T22:23:06.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.746+0000 7f4597e00640 1 -- 172.21.15.1:0/584472257 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45981a6a50 con 0x7f45981079d0 2024-09-15T22:23:06.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.746+0000 7f458f400640 1 -- 172.21.15.1:0/584472257 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4590010760 con 0x7f45981079d0 2024-09-15T22:23:06.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.746+0000 7f4597e00640 1 -- 172.21.15.1:0/584472257 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45981a6fb0 con 0x7f45981079d0 2024-09-15T22:23:06.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.747+0000 7f4597e00640 1 -- 172.21.15.1:0/584472257 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4598101e30 con 0x7f45981079d0 2024-09-15T22:23:06.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.749+0000 7f458f400640 1 -- 172.21.15.1:0/584472257 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f4590005020 con 0x7f45981079d0 2024-09-15T22:23:06.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.751+0000 7f458f400640 1 --2- 172.21.15.1:0/584472257 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f457c0a32c0 0x7f457c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:06.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.751+0000 7f458f400640 1 -- 172.21.15.1:0/584472257 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f45900cff30 con 0x7f45981079d0 2024-09-15T22:23:06.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.751+0000 7f4596a00640 1 --2- 172.21.15.1:0/584472257 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f457c0a32c0 0x7f457c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:06.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.752+0000 7f4596a00640 1 --2- 172.21.15.1:0/584472257 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f457c0a32c0 0x7f457c0a5780 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4588009b50 tx=0x7f4588005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:06.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.755+0000 7f458f400640 1 -- 172.21.15.1:0/584472257 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f459009cd00 con 0x7f45981079d0 2024-09-15T22:23:06.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:06.983+0000 7f4597e00640 1 -- 172.21.15.1:0/584472257 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f4598109f40 con 0x7f45981079d0 2024-09-15T22:23:06.985 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:06 smithi001 ceph-mon[30843]: pgmap v299: 97 pgs: 97 active+clean; 581 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-15T22:23:07.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:06 smithi012 ceph-mon[34883]: pgmap v299: 97 pgs: 97 active+clean; 581 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-15T22:23:07.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:06 smithi098 ceph-mon[35514]: pgmap v299: 97 pgs: 97 active+clean; 581 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-15T22:23:07.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:07.850+0000 7f458f400640 1 -- 172.21.15.1:0/584472257 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v25) ==== 115+0+0 (secure 0 0 0) 0x7f459009c600 con 0x7f45981079d0 2024-09-15T22:23:07.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:07.853+0000 7f4597e00640 1 -- 172.21.15.1:0/584472257 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f457c0a32c0 msgr2=0x7f457c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:07.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:07.853+0000 7f4597e00640 1 --2- 172.21.15.1:0/584472257 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f457c0a32c0 0x7f457c0a5780 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4588009b50 tx=0x7f4588005f90 comp rx=0 tx=0).stop 2024-09-15T22:23:07.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:07.853+0000 7f4597e00640 1 -- 172.21.15.1:0/584472257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45981079d0 msgr2=0x7f4598074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:07.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:07.853+0000 7f4597e00640 1 --2- 172.21.15.1:0/584472257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45981079d0 0x7f4598074f70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f459000eb10 tx=0x7f459000c2d0 comp rx=0 tx=0).stop 2024-09-15T22:23:07.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:07.853+0000 7f4597e00640 1 -- 172.21.15.1:0/584472257 shutdown_connections 2024-09-15T22:23:07.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:07.853+0000 7f4597e00640 1 --2- 172.21.15.1:0/584472257 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f457c0a32c0 0x7f457c0a5780 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:07.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:07.853+0000 7f4597e00640 1 --2- 172.21.15.1:0/584472257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45981079d0 0x7f4598074f70 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:07.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:07.853+0000 7f4597e00640 1 --2- 172.21.15.1:0/584472257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4598102370 0x7f4598074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:07.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:07.853+0000 7f4597e00640 1 --2- 172.21.15.1:0/584472257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45981019d0 0x7f45980744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:07.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:07.853+0000 7f4597e00640 1 -- 172.21.15.1:0/584472257 >> 172.21.15.1:0/584472257 conn(0x7f45980fd710 msgr2=0x7f45980fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:07.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:07.853+0000 7f4597e00640 1 -- 172.21.15.1:0/584472257 shutdown_connections 2024-09-15T22:23:07.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:07.853+0000 7f4597e00640 1 -- 172.21.15.1:0/584472257 wait complete. 2024-09-15T22:23:08.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:07 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/584472257' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-15T22:23:08.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:07 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/584472257' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-15T22:23:08.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:07 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/584472257' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-15T22:23:08.802 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-09-15T22:23:08.802 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-15T22:23:09.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:08 smithi001 ceph-mon[30843]: pgmap v300: 97 pgs: 97 active+clean; 582 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-09-15T22:23:09.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:08 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/584472257' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-15T22:23:09.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:08 smithi001 ceph-mon[30843]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-15T22:23:09.183 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:09.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:08 smithi012 ceph-mon[34883]: pgmap v300: 97 pgs: 97 active+clean; 582 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-09-15T22:23:09.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:08 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/584472257' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-15T22:23:09.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:08 smithi012 ceph-mon[34883]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-15T22:23:09.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:08 smithi098 ceph-mon[35514]: pgmap v300: 97 pgs: 97 active+clean; 582 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-09-15T22:23:09.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:08 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/584472257' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-15T22:23:09.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:08 smithi098 ceph-mon[35514]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-15T22:23:09.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.759+0000 7f5097c00640 1 -- 172.21.15.1:0/200298305 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5090109140 msgr2=0x7f5090110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:09.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.759+0000 7f5097c00640 1 --2- 172.21.15.1:0/200298305 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5090109140 0x7f5090110cc0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5088009ca0 tx=0x7f508802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:23:09.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.759+0000 7f5097c00640 1 -- 172.21.15.1:0/200298305 shutdown_connections 2024-09-15T22:23:09.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.759+0000 7f5097c00640 1 --2- 172.21.15.1:0/200298305 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5090109140 0x7f5090110cc0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:09.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.759+0000 7f5097c00640 1 --2- 172.21.15.1:0/200298305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50901049c0 0x7f5090108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:09.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.759+0000 7f5097c00640 1 --2- 172.21.15.1:0/200298305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5090104010 0x7f50901043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:09.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.759+0000 7f5097c00640 1 -- 172.21.15.1:0/200298305 >> 172.21.15.1:0/200298305 conn(0x7f50900ffa50 msgr2=0x7f5090101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:09.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.759+0000 7f5097c00640 1 -- 172.21.15.1:0/200298305 shutdown_connections 2024-09-15T22:23:09.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.760+0000 7f5097c00640 1 -- 172.21.15.1:0/200298305 wait complete. 2024-09-15T22:23:09.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.760+0000 7f5097c00640 1 Processor -- start 2024-09-15T22:23:09.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.761+0000 7f5097c00640 1 -- start start 2024-09-15T22:23:09.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.761+0000 7f5097c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5090104010 0x7f509019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:09.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.761+0000 7f5097c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50901049c0 0x7f509019ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:09.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.761+0000 7f5097c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5090109140 0x7f509019eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:09.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.761+0000 7f5097c00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5090114150 con 0x7f5090104010 2024-09-15T22:23:09.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.761+0000 7f5097c00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5090113fd0 con 0x7f50901049c0 2024-09-15T22:23:09.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.761+0000 7f5097c00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f50901142d0 con 0x7f5090109140 2024-09-15T22:23:09.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.761+0000 7f5095200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5090104010 0x7f509019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:09.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.761+0000 7f508fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50901049c0 0x7f509019ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:09.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.761+0000 7f508fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50901049c0 0x7f509019ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:57762/0 (socket says 172.21.15.1:57762) 2024-09-15T22:23:09.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.762+0000 7f508fe00640 1 -- 172.21.15.1:0/1039803283 learned_addr learned my addr 172.21.15.1:0/1039803283 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:09.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.761+0000 7f5095200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5090104010 0x7f509019a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60762/0 (socket says 172.21.15.1:60762) 2024-09-15T22:23:09.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.762+0000 7f5095c00640 1 --2- 172.21.15.1:0/1039803283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5090109140 0x7f509019eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:09.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.762+0000 7f508fe00640 1 -- 172.21.15.1:0/1039803283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5090109140 msgr2=0x7f509019eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:09.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.762+0000 7f508fe00640 1 --2- 172.21.15.1:0/1039803283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5090109140 0x7f509019eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:09.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.762+0000 7f508fe00640 1 -- 172.21.15.1:0/1039803283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5090104010 msgr2=0x7f509019a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:09.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.762+0000 7f508fe00640 1 --2- 172.21.15.1:0/1039803283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5090104010 0x7f509019a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:09.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.762+0000 7f508fe00640 1 -- 172.21.15.1:0/1039803283 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f509019f5a0 con 0x7f50901049c0 2024-09-15T22:23:09.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.762+0000 7f508fe00640 1 --2- 172.21.15.1:0/1039803283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50901049c0 0x7f509019ab30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f507c00e9f0 tx=0x7f507c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:09.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.763+0000 7f508d600640 1 -- 172.21.15.1:0/1039803283 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c00cd80 con 0x7f50901049c0 2024-09-15T22:23:09.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.763+0000 7f508d600640 1 -- 172.21.15.1:0/1039803283 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f507c010910 con 0x7f50901049c0 2024-09-15T22:23:09.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.763+0000 7f508d600640 1 -- 172.21.15.1:0/1039803283 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c018990 con 0x7f50901049c0 2024-09-15T22:23:09.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.763+0000 7f5097c00640 1 -- 172.21.15.1:0/1039803283 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f509019f890 con 0x7f50901049c0 2024-09-15T22:23:09.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.763+0000 7f5097c00640 1 -- 172.21.15.1:0/1039803283 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50901a7170 con 0x7f50901049c0 2024-09-15T22:23:09.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.764+0000 7f5097c00640 1 -- 172.21.15.1:0/1039803283 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50901043f0 con 0x7f50901049c0 2024-09-15T22:23:09.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.766+0000 7f508d600640 1 -- 172.21.15.1:0/1039803283 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f507c010ac0 con 0x7f50901049c0 2024-09-15T22:23:09.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.767+0000 7f508d600640 1 --2- 172.21.15.1:0/1039803283 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f50780a32c0 0x7f50780a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:09.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.767+0000 7f508d600640 1 -- 172.21.15.1:0/1039803283 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f507c0cfde0 con 0x7f50901049c0 2024-09-15T22:23:09.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.767+0000 7f5095200640 1 --2- 172.21.15.1:0/1039803283 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f50780a32c0 0x7f50780a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:09.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.768+0000 7f5095200640 1 --2- 172.21.15.1:0/1039803283 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f50780a32c0 0x7f50780a5780 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5084009bd0 tx=0x7f5084005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:09.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.769+0000 7f508d600640 1 -- 172.21.15.1:0/1039803283 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f507c09c560 con 0x7f50901049c0 2024-09-15T22:23:09.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:09.983+0000 7f5097c00640 1 -- 172.21.15.1:0/1039803283 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f5090062630 con 0x7f50780a32c0 2024-09-15T22:23:10.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:10.017+0000 7f508d600640 1 -- 172.21.15.1:0/1039803283 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5090062630 con 0x7f50780a32c0 2024-09-15T22:23:10.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:10.020+0000 7f5097c00640 1 -- 172.21.15.1:0/1039803283 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f50780a32c0 msgr2=0x7f50780a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:10.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:10.020+0000 7f5097c00640 1 --2- 172.21.15.1:0/1039803283 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f50780a32c0 0x7f50780a5780 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5084009bd0 tx=0x7f5084005f90 comp rx=0 tx=0).stop 2024-09-15T22:23:10.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:10.020+0000 7f5097c00640 1 -- 172.21.15.1:0/1039803283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50901049c0 msgr2=0x7f509019ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:10.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:10.020+0000 7f5097c00640 1 --2- 172.21.15.1:0/1039803283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50901049c0 0x7f509019ab30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f507c00e9f0 tx=0x7f507c00eeb0 comp rx=0 tx=0).stop 2024-09-15T22:23:10.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:10.020+0000 7f5097c00640 1 -- 172.21.15.1:0/1039803283 shutdown_connections 2024-09-15T22:23:10.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:10.020+0000 7f5097c00640 1 --2- 172.21.15.1:0/1039803283 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f50780a32c0 0x7f50780a5780 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:10.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:10.020+0000 7f5097c00640 1 --2- 172.21.15.1:0/1039803283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5090109140 0x7f509019eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:10.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:10.020+0000 7f5097c00640 1 --2- 172.21.15.1:0/1039803283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50901049c0 0x7f509019ab30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:10.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:10.020+0000 7f5097c00640 1 --2- 172.21.15.1:0/1039803283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5090104010 0x7f509019a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:10.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:10.020+0000 7f5097c00640 1 -- 172.21.15.1:0/1039803283 >> 172.21.15.1:0/1039803283 conn(0x7f50900ffa50 msgr2=0x7f5090100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:10.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:10.020+0000 7f5097c00640 1 -- 172.21.15.1:0/1039803283 shutdown_connections 2024-09-15T22:23:10.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:10.020+0000 7f5097c00640 1 -- 172.21.15.1:0/1039803283 wait complete. 2024-09-15T22:23:10.376 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:23:09 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:23:09.990+0000 7f802a200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:23:10.376 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:23:09 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:23:09.990+0000 7f802a200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:23:10.376 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:23:09 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:23:09.990+0000 7f802a200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:23:10.376 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:23:09 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:23:09.990+0000 7f802a200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:23:10.376 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:23:09 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:23:09.990+0000 7f802a200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:23:10.866 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-15T22:23:11.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:10 smithi001 ceph-mon[30843]: pgmap v301: 97 pgs: 97 active+clean; 582 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-09-15T22:23:11.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:10 smithi001 ceph-mon[30843]: from='client.24596 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:23:11.239 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:11.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:10 smithi012 ceph-mon[34883]: pgmap v301: 97 pgs: 97 active+clean; 582 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-09-15T22:23:11.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:10 smithi012 ceph-mon[34883]: from='client.24596 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:23:11.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:10 smithi098 ceph-mon[35514]: pgmap v301: 97 pgs: 97 active+clean; 582 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-09-15T22:23:11.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:10 smithi098 ceph-mon[35514]: from='client.24596 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:23:11.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.796+0000 7fa626c00640 1 -- 172.21.15.1:0/3646066567 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa620074510 msgr2=0x7fa6200748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:11.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.796+0000 7fa626c00640 1 --2- 172.21.15.1:0/3646066567 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa620074510 0x7fa6200748f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa614009900 tx=0x7fa61402a480 comp rx=0 tx=0).stop 2024-09-15T22:23:11.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.796+0000 7fa626c00640 1 -- 172.21.15.1:0/3646066567 shutdown_connections 2024-09-15T22:23:11.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.796+0000 7fa626c00640 1 --2- 172.21.15.1:0/3646066567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa62010e280 0x7fa620110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.796+0000 7fa626c00640 1 --2- 172.21.15.1:0/3646066567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa620074e30 0x7fa62010dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.796+0000 7fa626c00640 1 --2- 172.21.15.1:0/3646066567 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa620074510 0x7fa6200748f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.796+0000 7fa626c00640 1 -- 172.21.15.1:0/3646066567 >> 172.21.15.1:0/3646066567 conn(0x7fa6200fd740 msgr2=0x7fa6200ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:11.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.796+0000 7fa626c00640 1 -- 172.21.15.1:0/3646066567 shutdown_connections 2024-09-15T22:23:11.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.796+0000 7fa626c00640 1 -- 172.21.15.1:0/3646066567 wait complete. 2024-09-15T22:23:11.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.797+0000 7fa626c00640 1 Processor -- start 2024-09-15T22:23:11.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.797+0000 7fa626c00640 1 -- start start 2024-09-15T22:23:11.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.798+0000 7fa626c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa620074510 0x7fa62019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:11.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.798+0000 7fa626c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa620074e30 0x7fa62019a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:11.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.798+0000 7fa626c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa62010e280 0x7fa62019ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:11.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.798+0000 7fa626c00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa620114000 con 0x7fa62010e280 2024-09-15T22:23:11.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.798+0000 7fa626c00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa620113e80 con 0x7fa620074510 2024-09-15T22:23:11.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.798+0000 7fa626c00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa620114180 con 0x7fa620074e30 2024-09-15T22:23:11.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.798+0000 7fa625800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa620074510 0x7fa62019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:11.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.798+0000 7fa625800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa620074510 0x7fa62019a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:57800/0 (socket says 172.21.15.1:57800) 2024-09-15T22:23:11.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.798+0000 7fa625800640 1 -- 172.21.15.1:0/2271460301 learned_addr learned my addr 172.21.15.1:0/2271460301 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:11.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.798+0000 7fa626200640 1 --2- 172.21.15.1:0/2271460301 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa62010e280 0x7fa62019ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:11.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.798+0000 7fa624e00640 1 --2- 172.21.15.1:0/2271460301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa620074e30 0x7fa62019a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:11.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.799+0000 7fa625800640 1 -- 172.21.15.1:0/2271460301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa620074e30 msgr2=0x7fa62019a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:11.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.799+0000 7fa625800640 1 --2- 172.21.15.1:0/2271460301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa620074e30 0x7fa62019a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.799+0000 7fa625800640 1 -- 172.21.15.1:0/2271460301 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa62010e280 msgr2=0x7fa62019ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:11.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.799+0000 7fa625800640 1 --2- 172.21.15.1:0/2271460301 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa62010e280 0x7fa62019ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.799+0000 7fa625800640 1 -- 172.21.15.1:0/2271460301 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa62019f460 con 0x7fa620074510 2024-09-15T22:23:11.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.799+0000 7fa625800640 1 --2- 172.21.15.1:0/2271460301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa620074510 0x7fa62019a4b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa614004770 tx=0x7fa614003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:11.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.799+0000 7fa61e000640 1 -- 172.21.15.1:0/2271460301 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61403f070 con 0x7fa620074510 2024-09-15T22:23:11.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.799+0000 7fa626c00640 1 -- 172.21.15.1:0/2271460301 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa62019f6f0 con 0x7fa620074510 2024-09-15T22:23:11.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.799+0000 7fa626c00640 1 -- 172.21.15.1:0/2271460301 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6201a7030 con 0x7fa620074510 2024-09-15T22:23:11.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.799+0000 7fa61e000640 1 -- 172.21.15.1:0/2271460301 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa614031ca0 con 0x7fa620074510 2024-09-15T22:23:11.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.800+0000 7fa61e000640 1 -- 172.21.15.1:0/2271460301 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa614049060 con 0x7fa620074510 2024-09-15T22:23:11.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.800+0000 7fa626c00640 1 -- 172.21.15.1:0/2271460301 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6200748f0 con 0x7fa620074510 2024-09-15T22:23:11.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.803+0000 7fa61e000640 1 -- 172.21.15.1:0/2271460301 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fa614042070 con 0x7fa620074510 2024-09-15T22:23:11.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.804+0000 7fa61e000640 1 --2- 172.21.15.1:0/2271460301 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa6080a32c0 0x7fa6080a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:11.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.804+0000 7fa61e000640 1 -- 172.21.15.1:0/2271460301 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fa6140f0060 con 0x7fa620074510 2024-09-15T22:23:11.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.804+0000 7fa624e00640 1 --2- 172.21.15.1:0/2271460301 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa6080a32c0 0x7fa6080a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:11.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.805+0000 7fa624e00640 1 --2- 172.21.15.1:0/2271460301 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa6080a32c0 0x7fa6080a5780 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa6200ffd40 tx=0x7fa60c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:11.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.806+0000 7fa61e000640 1 -- 172.21.15.1:0/2271460301 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa6140bc8a0 con 0x7fa620074510 2024-09-15T22:23:11.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:11.871+0000 7fa61e000640 1 -- 172.21.15.1:0/2271460301 <== mon.2 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fa6140b8f10 con 0x7fa620074510 2024-09-15T22:23:12.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:12.021+0000 7fa626c00640 1 -- 172.21.15.1:0/2271460301 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fa620062630 con 0x7fa6080a32c0 2024-09-15T22:23:12.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:12.045+0000 7fa61e000640 1 -- 172.21.15.1:0/2271460301 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa620062630 con 0x7fa6080a32c0 2024-09-15T22:23:12.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:12.047+0000 7fa626c00640 1 -- 172.21.15.1:0/2271460301 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa6080a32c0 msgr2=0x7fa6080a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:12.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:12.047+0000 7fa626c00640 1 --2- 172.21.15.1:0/2271460301 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa6080a32c0 0x7fa6080a5780 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa6200ffd40 tx=0x7fa60c005f90 comp rx=0 tx=0).stop 2024-09-15T22:23:12.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:12.047+0000 7fa626c00640 1 -- 172.21.15.1:0/2271460301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa620074510 msgr2=0x7fa62019a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:12.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:12.047+0000 7fa626c00640 1 --2- 172.21.15.1:0/2271460301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa620074510 0x7fa62019a4b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa614004770 tx=0x7fa614003c10 comp rx=0 tx=0).stop 2024-09-15T22:23:12.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:12.047+0000 7fa626c00640 1 -- 172.21.15.1:0/2271460301 shutdown_connections 2024-09-15T22:23:12.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:12.047+0000 7fa626c00640 1 --2- 172.21.15.1:0/2271460301 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa6080a32c0 0x7fa6080a5780 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:12.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:12.047+0000 7fa626c00640 1 --2- 172.21.15.1:0/2271460301 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa62010e280 0x7fa62019ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:12.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:12.047+0000 7fa626c00640 1 --2- 172.21.15.1:0/2271460301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa620074e30 0x7fa62019a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:12.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:12.047+0000 7fa626c00640 1 --2- 172.21.15.1:0/2271460301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa620074510 0x7fa62019a4b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:12.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:12.047+0000 7fa626c00640 1 -- 172.21.15.1:0/2271460301 >> 172.21.15.1:0/2271460301 conn(0x7fa6200fd740 msgr2=0x7fa6200feed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:12.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:12.047+0000 7fa626c00640 1 -- 172.21.15.1:0/2271460301 shutdown_connections 2024-09-15T22:23:12.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:12.047+0000 7fa626c00640 1 -- 172.21.15.1:0/2271460301 wait complete. 2024-09-15T22:23:12.771 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-15T22:23:13.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:12 smithi001 ceph-mon[30843]: pgmap v302: 97 pgs: 97 active+clean; 582 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-15T22:23:13.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:12 smithi001 ceph-mon[30843]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-15T22:23:13.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:12 smithi001 ceph-mon[30843]: from='client.24608 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:23:13.150 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:13.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:12 smithi012 ceph-mon[34883]: pgmap v302: 97 pgs: 97 active+clean; 582 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-15T22:23:13.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:12 smithi012 ceph-mon[34883]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-15T22:23:13.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:12 smithi012 ceph-mon[34883]: from='client.24608 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:23:13.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:12 smithi098 ceph-mon[35514]: pgmap v302: 97 pgs: 97 active+clean; 582 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-15T22:23:13.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:12 smithi098 ceph-mon[35514]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-15T22:23:13.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:12 smithi098 ceph-mon[35514]: from='client.24608 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:23:13.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.661+0000 7f2277e00640 1 -- 172.21.15.1:0/3989640066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2278074eb0 msgr2=0x7f22781124a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:13.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.661+0000 7f2277e00640 1 --2- 172.21.15.1:0/3989640066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2278074eb0 0x7f22781124a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2260009900 tx=0x7f226002a480 comp rx=0 tx=0).stop 2024-09-15T22:23:13.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.661+0000 7f2277e00640 1 -- 172.21.15.1:0/3989640066 shutdown_connections 2024-09-15T22:23:13.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.661+0000 7f2277e00640 1 --2- 172.21.15.1:0/3989640066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f22781129e0 0x7f2278114dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:13.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.661+0000 7f2277e00640 1 --2- 172.21.15.1:0/3989640066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2278074eb0 0x7f22781124a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:13.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.661+0000 7f2277e00640 1 --2- 172.21.15.1:0/3989640066 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2278074590 0x7f2278074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:13.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.661+0000 7f2277e00640 1 -- 172.21.15.1:0/3989640066 >> 172.21.15.1:0/3989640066 conn(0x7f22780fd710 msgr2=0x7f22780ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:13.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.662+0000 7f2277e00640 1 -- 172.21.15.1:0/3989640066 shutdown_connections 2024-09-15T22:23:13.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.662+0000 7f2277e00640 1 -- 172.21.15.1:0/3989640066 wait complete. 2024-09-15T22:23:13.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.662+0000 7f2277e00640 1 Processor -- start 2024-09-15T22:23:13.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.663+0000 7f2277e00640 1 -- start start 2024-09-15T22:23:13.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.663+0000 7f2277e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2278074590 0x7f22781a4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:13.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.663+0000 7f2277e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2278074eb0 0x7f22781a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:13.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.663+0000 7f2277e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f22781129e0 0x7f227819e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:13.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.663+0000 7f2277e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2278118390 con 0x7f2278074590 2024-09-15T22:23:13.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.663+0000 7f2277e00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2278118210 con 0x7f22781129e0 2024-09-15T22:23:13.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.663+0000 7f2277e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2278118510 con 0x7f2278074eb0 2024-09-15T22:23:13.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.663+0000 7f2276a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2278074590 0x7f22781a4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:13.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.663+0000 7f2276a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2278074590 0x7f22781a4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60826/0 (socket says 172.21.15.1:60826) 2024-09-15T22:23:13.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.663+0000 7f2276a00640 1 -- 172.21.15.1:0/526837149 learned_addr learned my addr 172.21.15.1:0/526837149 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:13.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.663+0000 7f2277400640 1 --2- 172.21.15.1:0/526837149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f22781129e0 0x7f227819e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:13.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.663+0000 7f226e000640 1 --2- 172.21.15.1:0/526837149 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2278074eb0 0x7f22781a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:13.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.664+0000 7f2276a00640 1 -- 172.21.15.1:0/526837149 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2278074eb0 msgr2=0x7f22781a4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:13.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.664+0000 7f2276a00640 1 --2- 172.21.15.1:0/526837149 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2278074eb0 0x7f22781a4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:13.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.664+0000 7f2276a00640 1 -- 172.21.15.1:0/526837149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f22781129e0 msgr2=0x7f227819e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:13.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.664+0000 7f2276a00640 1 --2- 172.21.15.1:0/526837149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f22781129e0 0x7f227819e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:13.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.664+0000 7f2276a00640 1 -- 172.21.15.1:0/526837149 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f227819ef70 con 0x7f2278074590 2024-09-15T22:23:13.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.664+0000 7f2277400640 1 --2- 172.21.15.1:0/526837149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f22781129e0 0x7f227819e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:23:13.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.664+0000 7f2276a00640 1 --2- 172.21.15.1:0/526837149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2278074590 0x7f22781a4630 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2268009d50 tx=0x7f226800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:13.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.664+0000 7f226fe00640 1 -- 172.21.15.1:0/526837149 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2268003b70 con 0x7f2278074590 2024-09-15T22:23:13.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.664+0000 7f2277e00640 1 -- 172.21.15.1:0/526837149 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f227819f260 con 0x7f2278074590 2024-09-15T22:23:13.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.664+0000 7f226fe00640 1 -- 172.21.15.1:0/526837149 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2268003d10 con 0x7f2278074590 2024-09-15T22:23:13.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.664+0000 7f2277e00640 1 -- 172.21.15.1:0/526837149 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22781ab5b0 con 0x7f2278074590 2024-09-15T22:23:13.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.665+0000 7f226fe00640 1 -- 172.21.15.1:0/526837149 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2268004d20 con 0x7f2278074590 2024-09-15T22:23:13.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.665+0000 7f2277e00640 1 -- 172.21.15.1:0/526837149 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2278075cd0 con 0x7f2278074590 2024-09-15T22:23:13.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.667+0000 7f226fe00640 1 -- 172.21.15.1:0/526837149 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f2268004000 con 0x7f2278074590 2024-09-15T22:23:13.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.670+0000 7f226fe00640 1 --2- 172.21.15.1:0/526837149 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f225c0a32d0 0x7f225c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:13.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.670+0000 7f226fe00640 1 -- 172.21.15.1:0/526837149 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f22680d0400 con 0x7f2278074590 2024-09-15T22:23:13.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.670+0000 7f226e000640 1 --2- 172.21.15.1:0/526837149 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f225c0a32d0 0x7f225c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:13.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.671+0000 7f226e000640 1 --2- 172.21.15.1:0/526837149 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f225c0a32d0 0x7f225c0a5790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2260009230 tx=0x7f22600058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:13.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.672+0000 7f226fe00640 1 -- 172.21.15.1:0/526837149 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f226809d070 con 0x7f2278074590 2024-09-15T22:23:13.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.886+0000 7f2277e00640 1 -- 172.21.15.1:0/526837149 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f22780ff5e0 con 0x7f225c0a32d0 2024-09-15T22:23:13.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.891+0000 7f226fe00640 1 -- 172.21.15.1:0/526837149 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f22780ff5e0 con 0x7f225c0a32d0 2024-09-15T22:23:13.893 INFO:teuthology.orchestra.run.smithi001.stdout:/volumes/qa/sv_0/54cc21e1-33fb-4c10-ac00-8b27b70ec744 2024-09-15T22:23:13.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.894+0000 7f2277e00640 1 -- 172.21.15.1:0/526837149 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f225c0a32d0 msgr2=0x7f225c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:13.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.894+0000 7f2277e00640 1 --2- 172.21.15.1:0/526837149 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f225c0a32d0 0x7f225c0a5790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2260009230 tx=0x7f22600058d0 comp rx=0 tx=0).stop 2024-09-15T22:23:13.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.894+0000 7f2277e00640 1 -- 172.21.15.1:0/526837149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2278074590 msgr2=0x7f22781a4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:13.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.894+0000 7f2277e00640 1 --2- 172.21.15.1:0/526837149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2278074590 0x7f22781a4630 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2268009d50 tx=0x7f226800c6a0 comp rx=0 tx=0).stop 2024-09-15T22:23:13.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.894+0000 7f2277e00640 1 -- 172.21.15.1:0/526837149 shutdown_connections 2024-09-15T22:23:13.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.894+0000 7f2277e00640 1 --2- 172.21.15.1:0/526837149 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f225c0a32d0 0x7f225c0a5790 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:13.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.894+0000 7f2277e00640 1 --2- 172.21.15.1:0/526837149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f22781129e0 0x7f227819e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:13.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.894+0000 7f2277e00640 1 --2- 172.21.15.1:0/526837149 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2278074eb0 0x7f22781a4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:13.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.894+0000 7f2277e00640 1 --2- 172.21.15.1:0/526837149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2278074590 0x7f22781a4630 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:13.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.894+0000 7f2277e00640 1 -- 172.21.15.1:0/526837149 >> 172.21.15.1:0/526837149 conn(0x7f22780fd710 msgr2=0x7f22780feed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:13.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.894+0000 7f2277e00640 1 -- 172.21.15.1:0/526837149 shutdown_connections 2024-09-15T22:23:13.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:13.894+0000 7f2277e00640 1 -- 172.21.15.1:0/526837149 wait complete. 2024-09-15T22:23:14.801 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-15T22:23:15.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:14 smithi001 ceph-mon[30843]: pgmap v303: 97 pgs: 97 active+clean; 582 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-15T22:23:15.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:14 smithi001 ceph-mon[30843]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:23:15.191 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:15.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:14 smithi012 ceph-mon[34883]: pgmap v303: 97 pgs: 97 active+clean; 582 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-15T22:23:15.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:14 smithi012 ceph-mon[34883]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:23:15.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:14 smithi098 ceph-mon[35514]: pgmap v303: 97 pgs: 97 active+clean; 582 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-15T22:23:15.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:14 smithi098 ceph-mon[35514]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:23:15.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.700+0000 7feece600640 1 -- 172.21.15.1:0/3531850549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feec81049a0 msgr2=0x7feec81089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:15.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.700+0000 7feece600640 1 --2- 172.21.15.1:0/3531850549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feec81049a0 0x7feec81089f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7feeb4009900 tx=0x7feeb402a3f0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.700+0000 7feece600640 1 -- 172.21.15.1:0/3531850549 shutdown_connections 2024-09-15T22:23:15.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.700+0000 7feece600640 1 --2- 172.21.15.1:0/3531850549 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feec8109120 0x7feec8110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.700+0000 7feece600640 1 --2- 172.21.15.1:0/3531850549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feec81049a0 0x7feec81089f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.700+0000 7feece600640 1 --2- 172.21.15.1:0/3531850549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feec8103ff0 0x7feec81043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.700+0000 7feece600640 1 -- 172.21.15.1:0/3531850549 >> 172.21.15.1:0/3531850549 conn(0x7feec80ffa90 msgr2=0x7feec8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:15.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.701+0000 7feece600640 1 -- 172.21.15.1:0/3531850549 shutdown_connections 2024-09-15T22:23:15.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.701+0000 7feece600640 1 -- 172.21.15.1:0/3531850549 wait complete. 2024-09-15T22:23:15.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.702+0000 7feece600640 1 Processor -- start 2024-09-15T22:23:15.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.702+0000 7feece600640 1 -- start start 2024-09-15T22:23:15.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.702+0000 7feece600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feec8103ff0 0x7feec819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:15.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.702+0000 7feece600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feec81049a0 0x7feec819abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:15.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.702+0000 7feece600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feec8109120 0x7feec819ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:15.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.702+0000 7feece600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7feec8114140 con 0x7feec8103ff0 2024-09-15T22:23:15.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.702+0000 7feece600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7feec8113fc0 con 0x7feec81049a0 2024-09-15T22:23:15.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.702+0000 7feece600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7feec81142c0 con 0x7feec8109120 2024-09-15T22:23:15.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.702+0000 7feec7400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feec8103ff0 0x7feec819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:15.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.702+0000 7feec6a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feec81049a0 0x7feec819abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:15.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.702+0000 7feec7400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feec8103ff0 0x7feec819a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60852/0 (socket says 172.21.15.1:60852) 2024-09-15T22:23:15.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.702+0000 7feec7400640 1 -- 172.21.15.1:0/4293740448 learned_addr learned my addr 172.21.15.1:0/4293740448 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:15.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.702+0000 7feec7e00640 1 --2- 172.21.15.1:0/4293740448 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feec8109120 0x7feec819ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:15.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.703+0000 7feec6a00640 1 -- 172.21.15.1:0/4293740448 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feec8109120 msgr2=0x7feec819ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:15.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.703+0000 7feec6a00640 1 --2- 172.21.15.1:0/4293740448 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feec8109120 0x7feec819ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.703+0000 7feec6a00640 1 -- 172.21.15.1:0/4293740448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feec8103ff0 msgr2=0x7feec819a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:15.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.703+0000 7feec6a00640 1 --2- 172.21.15.1:0/4293740448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feec8103ff0 0x7feec819a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.703+0000 7feec6a00640 1 -- 172.21.15.1:0/4293740448 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec819f650 con 0x7feec81049a0 2024-09-15T22:23:15.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.703+0000 7feec7e00640 1 --2- 172.21.15.1:0/4293740448 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feec8109120 0x7feec819ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:23:15.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.703+0000 7feec7400640 1 --2- 172.21.15.1:0/4293740448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feec8103ff0 0x7feec819a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:23:15.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.703+0000 7feec6a00640 1 --2- 172.21.15.1:0/4293740448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feec81049a0 0x7feec819abe0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feeb4005940 tx=0x7feeb40040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:15.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.704+0000 7feebfe00640 1 -- 172.21.15.1:0/4293740448 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb403f030 con 0x7feec81049a0 2024-09-15T22:23:15.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.704+0000 7feebfe00640 1 -- 172.21.15.1:0/4293740448 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feeb40044c0 con 0x7feec81049a0 2024-09-15T22:23:15.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.704+0000 7feece600640 1 -- 172.21.15.1:0/4293740448 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feec819f8e0 con 0x7feec81049a0 2024-09-15T22:23:15.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.704+0000 7feebfe00640 1 -- 172.21.15.1:0/4293740448 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb4035070 con 0x7feec81049a0 2024-09-15T22:23:15.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.704+0000 7feece600640 1 -- 172.21.15.1:0/4293740448 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feec81a7220 con 0x7feec81049a0 2024-09-15T22:23:15.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.705+0000 7feece600640 1 -- 172.21.15.1:0/4293740448 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feec81043d0 con 0x7feec81049a0 2024-09-15T22:23:15.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.707+0000 7feebfe00640 1 -- 172.21.15.1:0/4293740448 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7feeb4042030 con 0x7feec81049a0 2024-09-15T22:23:15.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.708+0000 7feebfe00640 1 --2- 172.21.15.1:0/4293740448 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7feeac0a3350 0x7feeac0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:15.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.708+0000 7feebfe00640 1 -- 172.21.15.1:0/4293740448 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7feeb40eff20 con 0x7feec81049a0 2024-09-15T22:23:15.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.708+0000 7feec7400640 1 --2- 172.21.15.1:0/4293740448 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7feeac0a3350 0x7feeac0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:15.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.709+0000 7feec7400640 1 --2- 172.21.15.1:0/4293740448 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7feeac0a3350 0x7feeac0a5810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7feeb80095f0 tx=0x7feeb8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:15.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.710+0000 7feebfe00640 1 -- 172.21.15.1:0/4293740448 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feeb40bc540 con 0x7feec81049a0 2024-09-15T22:23:15.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.929+0000 7feece600640 1 -- 172.21.15.1:0/4293740448 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7feec8062630 con 0x7feeac0a3350 2024-09-15T22:23:15.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.955+0000 7feebfe00640 1 -- 172.21.15.1:0/4293740448 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7feec8062630 con 0x7feeac0a3350 2024-09-15T22:23:15.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.958+0000 7feece600640 1 -- 172.21.15.1:0/4293740448 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7feeac0a3350 msgr2=0x7feeac0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:15.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.958+0000 7feece600640 1 --2- 172.21.15.1:0/4293740448 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7feeac0a3350 0x7feeac0a5810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7feeb80095f0 tx=0x7feeb8005f90 comp rx=0 tx=0).stop 2024-09-15T22:23:15.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.958+0000 7feece600640 1 -- 172.21.15.1:0/4293740448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feec81049a0 msgr2=0x7feec819abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:15.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.958+0000 7feece600640 1 --2- 172.21.15.1:0/4293740448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feec81049a0 0x7feec819abe0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feeb4005940 tx=0x7feeb40040c0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.958+0000 7feece600640 1 -- 172.21.15.1:0/4293740448 shutdown_connections 2024-09-15T22:23:15.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.958+0000 7feece600640 1 --2- 172.21.15.1:0/4293740448 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7feeac0a3350 0x7feeac0a5810 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.958+0000 7feece600640 1 --2- 172.21.15.1:0/4293740448 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feec8109120 0x7feec819ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.958+0000 7feece600640 1 --2- 172.21.15.1:0/4293740448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feec81049a0 0x7feec819abe0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.958+0000 7feece600640 1 --2- 172.21.15.1:0/4293740448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feec8103ff0 0x7feec819a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.958+0000 7feece600640 1 -- 172.21.15.1:0/4293740448 >> 172.21.15.1:0/4293740448 conn(0x7feec80ffa90 msgr2=0x7feec8100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:15.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.958+0000 7feece600640 1 -- 172.21.15.1:0/4293740448 shutdown_connections 2024-09-15T22:23:15.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:15.958+0000 7feece600640 1 -- 172.21.15.1:0/4293740448 wait complete. 2024-09-15T22:23:16.882 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-15T22:23:17.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:16 smithi001 ceph-mon[30843]: pgmap v304: 97 pgs: 97 active+clean; 607 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.8 KiB/s wr, 15 op/s 2024-09-15T22:23:17.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:16 smithi001 ceph-mon[30843]: from='client.24620 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:23:17.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:16 smithi012 ceph-mon[34883]: pgmap v304: 97 pgs: 97 active+clean; 607 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.8 KiB/s wr, 15 op/s 2024-09-15T22:23:17.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:16 smithi012 ceph-mon[34883]: from='client.24620 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:23:17.260 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:17.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:16 smithi098 ceph-mon[35514]: pgmap v304: 97 pgs: 97 active+clean; 607 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.8 KiB/s wr, 15 op/s 2024-09-15T22:23:17.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:16 smithi098 ceph-mon[35514]: from='client.24620 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:23:17.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.829+0000 7f663e800640 1 -- 172.21.15.1:0/3493620838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6638104010 msgr2=0x7f66381043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:17.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.829+0000 7f663e800640 1 --2- 172.21.15.1:0/3493620838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6638104010 0x7f66381043f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6628009900 tx=0x7f662802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.829+0000 7f663e800640 1 -- 172.21.15.1:0/3493620838 shutdown_connections 2024-09-15T22:23:17.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.829+0000 7f663e800640 1 --2- 172.21.15.1:0/3493620838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6638109140 0x7f6638110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.829+0000 7f663e800640 1 --2- 172.21.15.1:0/3493620838 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66381049c0 0x7f6638108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.829+0000 7f663e800640 1 --2- 172.21.15.1:0/3493620838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6638104010 0x7f66381043f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.829+0000 7f663e800640 1 -- 172.21.15.1:0/3493620838 >> 172.21.15.1:0/3493620838 conn(0x7f66380ffa50 msgr2=0x7f6638101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:17.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.829+0000 7f663e800640 1 -- 172.21.15.1:0/3493620838 shutdown_connections 2024-09-15T22:23:17.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.829+0000 7f663e800640 1 -- 172.21.15.1:0/3493620838 wait complete. 2024-09-15T22:23:17.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.830+0000 7f663e800640 1 Processor -- start 2024-09-15T22:23:17.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.830+0000 7f663e800640 1 -- start start 2024-09-15T22:23:17.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.830+0000 7f663e800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6638104010 0x7f663819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:17.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.830+0000 7f663e800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66381049c0 0x7f663819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:17.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.830+0000 7f663e800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6638109140 0x7f663819eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:17.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.830+0000 7f663e800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6638114140 con 0x7f6638109140 2024-09-15T22:23:17.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.830+0000 7f663e800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6638113fc0 con 0x7f66381049c0 2024-09-15T22:23:17.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.830+0000 7f663e800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f66381142c0 con 0x7f6638104010 2024-09-15T22:23:17.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.831+0000 7f662ea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66381049c0 0x7f663819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:17.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.831+0000 7f662ea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66381049c0 0x7f663819ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:49572/0 (socket says 172.21.15.1:49572) 2024-09-15T22:23:17.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.831+0000 7f6637400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6638104010 0x7f663819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:17.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.831+0000 7f662ea00640 1 -- 172.21.15.1:0/1840410917 learned_addr learned my addr 172.21.15.1:0/1840410917 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:17.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.831+0000 7f6637e00640 1 --2- 172.21.15.1:0/1840410917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6638109140 0x7f663819eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:17.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.831+0000 7f662ea00640 1 -- 172.21.15.1:0/1840410917 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6638104010 msgr2=0x7f663819a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:17.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.831+0000 7f662ea00640 1 --2- 172.21.15.1:0/1840410917 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6638104010 0x7f663819a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.831+0000 7f662ea00640 1 -- 172.21.15.1:0/1840410917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6638109140 msgr2=0x7f663819eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:17.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.831+0000 7f662ea00640 1 --2- 172.21.15.1:0/1840410917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6638109140 0x7f663819eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.831+0000 7f662ea00640 1 -- 172.21.15.1:0/1840410917 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f663819f5b0 con 0x7f66381049c0 2024-09-15T22:23:17.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.832+0000 7f662ea00640 1 --2- 172.21.15.1:0/1840410917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66381049c0 0x7f663819ab40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f662000d950 tx=0x7f662000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:17.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.832+0000 7f6634c00640 1 -- 172.21.15.1:0/1840410917 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6620017070 con 0x7f66381049c0 2024-09-15T22:23:17.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.832+0000 7f663e800640 1 -- 172.21.15.1:0/1840410917 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f663819f8a0 con 0x7f66381049c0 2024-09-15T22:23:17.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.832+0000 7f6634c00640 1 -- 172.21.15.1:0/1840410917 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6620009c30 con 0x7f66381049c0 2024-09-15T22:23:17.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.832+0000 7f6634c00640 1 -- 172.21.15.1:0/1840410917 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662000f6b0 con 0x7f66381049c0 2024-09-15T22:23:17.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.832+0000 7f663e800640 1 -- 172.21.15.1:0/1840410917 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66381a7180 con 0x7f66381049c0 2024-09-15T22:23:17.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.833+0000 7f663e800640 1 -- 172.21.15.1:0/1840410917 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66381043f0 con 0x7f66381049c0 2024-09-15T22:23:17.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.836+0000 7f6634c00640 1 -- 172.21.15.1:0/1840410917 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f66200109d0 con 0x7f66381049c0 2024-09-15T22:23:17.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.837+0000 7f6634c00640 1 --2- 172.21.15.1:0/1840410917 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f661c0a32d0 0x7f661c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:17.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.837+0000 7f6634c00640 1 -- 172.21.15.1:0/1840410917 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f66200cf5b0 con 0x7f66381049c0 2024-09-15T22:23:17.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.837+0000 7f6637400640 1 --2- 172.21.15.1:0/1840410917 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f661c0a32d0 0x7f661c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:17.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.838+0000 7f6637400640 1 --2- 172.21.15.1:0/1840410917 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f661c0a32d0 0x7f661c0a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6628009230 tx=0x7f66280058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:17.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:17.841+0000 7f6634c00640 1 -- 172.21.15.1:0/1840410917 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6620009de0 con 0x7f66381049c0 2024-09-15T22:23:18.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:18.057+0000 7f663e800640 1 -- 172.21.15.1:0/1840410917 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f6638062630 con 0x7f661c0a32d0 2024-09-15T22:23:18.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:18.062+0000 7f6634c00640 1 -- 172.21.15.1:0/1840410917 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f6638062630 con 0x7f661c0a32d0 2024-09-15T22:23:18.065 INFO:teuthology.orchestra.run.smithi001.stdout:/volumes/qa/sv_1/5d0e9612-686f-45ae-8040-b496e57d08ba 2024-09-15T22:23:18.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:18.065+0000 7f663e800640 1 -- 172.21.15.1:0/1840410917 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f661c0a32d0 msgr2=0x7f661c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:18.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:18.065+0000 7f663e800640 1 --2- 172.21.15.1:0/1840410917 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f661c0a32d0 0x7f661c0a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6628009230 tx=0x7f66280058d0 comp rx=0 tx=0).stop 2024-09-15T22:23:18.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:18.065+0000 7f663e800640 1 -- 172.21.15.1:0/1840410917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66381049c0 msgr2=0x7f663819ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:18.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:18.065+0000 7f663e800640 1 --2- 172.21.15.1:0/1840410917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66381049c0 0x7f663819ab40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f662000d950 tx=0x7f662000de10 comp rx=0 tx=0).stop 2024-09-15T22:23:18.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:18.065+0000 7f663e800640 1 -- 172.21.15.1:0/1840410917 shutdown_connections 2024-09-15T22:23:18.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:18.065+0000 7f663e800640 1 --2- 172.21.15.1:0/1840410917 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f661c0a32d0 0x7f661c0a5790 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:18.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:18.065+0000 7f663e800640 1 --2- 172.21.15.1:0/1840410917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6638109140 0x7f663819eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:18.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:18.065+0000 7f663e800640 1 --2- 172.21.15.1:0/1840410917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66381049c0 0x7f663819ab40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:18.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:18.065+0000 7f663e800640 1 --2- 172.21.15.1:0/1840410917 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6638104010 0x7f663819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:18.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:18.065+0000 7f663e800640 1 -- 172.21.15.1:0/1840410917 >> 172.21.15.1:0/1840410917 conn(0x7f66380ffa50 msgr2=0x7f6638100e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:18.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:18.065+0000 7f663e800640 1 -- 172.21.15.1:0/1840410917 shutdown_connections 2024-09-15T22:23:18.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:18.065+0000 7f663e800640 1 -- 172.21.15.1:0/1840410917 wait complete. 2024-09-15T22:23:18.852 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:23:19.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:18 smithi001 ceph-mon[30843]: pgmap v305: 97 pgs: 97 active+clean; 607 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.5 KiB/s wr, 8 op/s 2024-09-15T22:23:19.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:18 smithi001 ceph-mon[30843]: from='client.24626 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:23:19.227 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:19.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:18 smithi012 ceph-mon[34883]: pgmap v305: 97 pgs: 97 active+clean; 607 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.5 KiB/s wr, 8 op/s 2024-09-15T22:23:19.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:18 smithi012 ceph-mon[34883]: from='client.24626 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:23:19.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:18 smithi098 ceph-mon[35514]: pgmap v305: 97 pgs: 97 active+clean; 607 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.5 KiB/s wr, 8 op/s 2024-09-15T22:23:19.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:18 smithi098 ceph-mon[35514]: from='client.24626 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:23:19.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.814+0000 7fae55200640 1 -- 172.21.15.1:0/89216286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae50077040 msgr2=0x7fae501124f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:19.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.814+0000 7fae55200640 1 --2- 172.21.15.1:0/89216286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae50077040 0x7fae501124f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fae38009900 tx=0x7fae3802a410 comp rx=0 tx=0).stop 2024-09-15T22:23:19.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.814+0000 7fae55200640 1 -- 172.21.15.1:0/89216286 shutdown_connections 2024-09-15T22:23:19.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.814+0000 7fae55200640 1 --2- 172.21.15.1:0/89216286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae50112a30 0x7fae50114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.814+0000 7fae55200640 1 --2- 172.21.15.1:0/89216286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae50077040 0x7fae501124f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.814+0000 7fae55200640 1 --2- 172.21.15.1:0/89216286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae50076720 0x7fae50076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.814+0000 7fae55200640 1 -- 172.21.15.1:0/89216286 >> 172.21.15.1:0/89216286 conn(0x7fae500ffa90 msgr2=0x7fae50101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:19.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.814+0000 7fae55200640 1 -- 172.21.15.1:0/89216286 shutdown_connections 2024-09-15T22:23:19.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.815+0000 7fae55200640 1 -- 172.21.15.1:0/89216286 wait complete. 2024-09-15T22:23:19.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.816+0000 7fae55200640 1 Processor -- start 2024-09-15T22:23:19.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.816+0000 7fae55200640 1 -- start start 2024-09-15T22:23:19.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.816+0000 7fae55200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae50076720 0x7fae5019eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:19.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.816+0000 7fae55200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae50077040 0x7fae5019f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:19.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.816+0000 7fae55200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae50112a30 0x7fae501a3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:19.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.816+0000 7fae55200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fae501185a0 con 0x7fae50077040 2024-09-15T22:23:19.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.816+0000 7fae55200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fae50118420 con 0x7fae50112a30 2024-09-15T22:23:19.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.816+0000 7fae55200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fae50118720 con 0x7fae50076720 2024-09-15T22:23:19.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.817+0000 7fae4e800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae50112a30 0x7fae501a3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:19.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.817+0000 7fae4e800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae50112a30 0x7fae501a3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:49598/0 (socket says 172.21.15.1:49598) 2024-09-15T22:23:19.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.817+0000 7fae47e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae50077040 0x7fae5019f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:19.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.817+0000 7fae4e800640 1 -- 172.21.15.1:0/2087399227 learned_addr learned my addr 172.21.15.1:0/2087399227 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:19.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.817+0000 7fae4de00640 1 --2- 172.21.15.1:0/2087399227 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae50076720 0x7fae5019eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:19.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.817+0000 7fae4e800640 1 -- 172.21.15.1:0/2087399227 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae50076720 msgr2=0x7fae5019eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:19.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.817+0000 7fae4e800640 1 --2- 172.21.15.1:0/2087399227 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae50076720 0x7fae5019eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.817+0000 7fae4e800640 1 -- 172.21.15.1:0/2087399227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae50077040 msgr2=0x7fae5019f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:19.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.817+0000 7fae4e800640 1 --2- 172.21.15.1:0/2087399227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae50077040 0x7fae5019f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.817+0000 7fae4e800640 1 -- 172.21.15.1:0/2087399227 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae501a3b90 con 0x7fae50112a30 2024-09-15T22:23:19.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.817+0000 7fae4e800640 1 --2- 172.21.15.1:0/2087399227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae50112a30 0x7fae501a3460 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fae4800eb10 tx=0x7fae4800c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:19.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.817+0000 7fae46a00640 1 -- 172.21.15.1:0/2087399227 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae48004b20 con 0x7fae50112a30 2024-09-15T22:23:19.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.817+0000 7fae46a00640 1 -- 172.21.15.1:0/2087399227 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae48004cc0 con 0x7fae50112a30 2024-09-15T22:23:19.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.817+0000 7fae55200640 1 -- 172.21.15.1:0/2087399227 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae501a3e80 con 0x7fae50112a30 2024-09-15T22:23:19.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.818+0000 7fae46a00640 1 -- 172.21.15.1:0/2087399227 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae48010790 con 0x7fae50112a30 2024-09-15T22:23:19.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.818+0000 7fae55200640 1 -- 172.21.15.1:0/2087399227 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae501ab710 con 0x7fae50112a30 2024-09-15T22:23:19.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.819+0000 7fae55200640 1 -- 172.21.15.1:0/2087399227 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae50076b00 con 0x7fae50112a30 2024-09-15T22:23:19.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.821+0000 7fae46a00640 1 -- 172.21.15.1:0/2087399227 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fae48010930 con 0x7fae50112a30 2024-09-15T22:23:19.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.822+0000 7fae46a00640 1 --2- 172.21.15.1:0/2087399227 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fae340a32d0 0x7fae340a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:19.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.822+0000 7fae46a00640 1 -- 172.21.15.1:0/2087399227 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fae480d0260 con 0x7fae50112a30 2024-09-15T22:23:19.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.822+0000 7fae4de00640 1 --2- 172.21.15.1:0/2087399227 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fae340a32d0 0x7fae340a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:19.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.823+0000 7fae4de00640 1 --2- 172.21.15.1:0/2087399227 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fae340a32d0 0x7fae340a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fae4000bbe0 tx=0x7fae4000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:19.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:19.824+0000 7fae46a00640 1 -- 172.21.15.1:0/2087399227 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fae4809ced0 con 0x7fae50112a30 2024-09-15T22:23:20.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:20.048+0000 7fae55200640 1 -- 172.21.15.1:0/2087399227 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fae5019fec0 con 0x7fae50112a30 2024-09-15T22:23:20.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:20.050+0000 7fae46a00640 1 -- 172.21.15.1:0/2087399227 <== mon.2 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11882 (secure 0 0 0) 0x7fae4809c7d0 con 0x7fae50112a30 2024-09-15T22:23:20.052 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:23:20.052 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":25,"btime":"2024-09-15T22:23:07:844952+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2417768032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2417768032},{"type":"v1","addr":"172.21.15.1:6835","nonce":2417768032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14493,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2957993064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2957993064},{"type":"v1","addr":"172.21.15.1:6837","nonce":2957993064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14529,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3887277479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3887277479},{"type":"v1","addr":"172.21.15.1:6839","nonce":3887277479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14541,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/1674822398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":1674822398},{"type":"v1","addr":"172.21.15.1:6841","nonce":1674822398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3122570659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3122570659},{"type":"v1","addr":"172.21.15.12:6833","nonce":3122570659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2901262900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2901262900},{"type":"v1","addr":"172.21.15.12:6835","nonce":2901262900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:22:51.743282+0000","modified":"2024-09-15T22:23:06.984789+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24538,"mds_1":24524,"mds_2":24520},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/94050093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":94050093},{"type":"v1","addr":"172.21.15.98:6833","nonce":94050093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6837/2378138381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2378138381},{"type":"v1","addr":"172.21.15.12:6837","nonce":2378138381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1848806705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1848806705},{"type":"v1","addr":"172.21.15.98:6835","nonce":1848806705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.98:6837/493594054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":493594054},{"type":"v1","addr":"172.21.15.98:6837","nonce":493594054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.12:6839/1469511155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":1469511155},{"type":"v1","addr":"172.21.15.12:6839","nonce":1469511155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.98:6839/2831161859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2831161859},{"type":"v1","addr":"172.21.15.98:6839","nonce":2831161859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24538,"qdb_cluster":[24538,24524,24520]},"id":1}]} 2024-09-15T22:23:20.052 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 25 2024-09-15T22:23:20.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:20.052+0000 7fae55200640 1 -- 172.21.15.1:0/2087399227 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fae340a32d0 msgr2=0x7fae340a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:20.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:20.052+0000 7fae55200640 1 --2- 172.21.15.1:0/2087399227 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fae340a32d0 0x7fae340a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fae4000bbe0 tx=0x7fae4000b390 comp rx=0 tx=0).stop 2024-09-15T22:23:20.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:20.052+0000 7fae55200640 1 -- 172.21.15.1:0/2087399227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae50112a30 msgr2=0x7fae501a3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:20.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:20.052+0000 7fae55200640 1 --2- 172.21.15.1:0/2087399227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae50112a30 0x7fae501a3460 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fae4800eb10 tx=0x7fae4800c2d0 comp rx=0 tx=0).stop 2024-09-15T22:23:20.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:20.052+0000 7fae55200640 1 -- 172.21.15.1:0/2087399227 shutdown_connections 2024-09-15T22:23:20.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:20.052+0000 7fae55200640 1 --2- 172.21.15.1:0/2087399227 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fae340a32d0 0x7fae340a5790 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:20.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:20.052+0000 7fae55200640 1 --2- 172.21.15.1:0/2087399227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae50112a30 0x7fae501a3460 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:20.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:20.052+0000 7fae55200640 1 --2- 172.21.15.1:0/2087399227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae50077040 0x7fae5019f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:20.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:20.052+0000 7fae55200640 1 --2- 172.21.15.1:0/2087399227 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae50076720 0x7fae5019eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:20.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:20.052+0000 7fae55200640 1 -- 172.21.15.1:0/2087399227 >> 172.21.15.1:0/2087399227 conn(0x7fae500ffa90 msgr2=0x7fae50101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:20.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:20.052+0000 7fae55200640 1 -- 172.21.15.1:0/2087399227 shutdown_connections 2024-09-15T22:23:20.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:20.052+0000 7fae55200640 1 -- 172.21.15.1:0/2087399227 wait complete. 2024-09-15T22:23:20.905 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:23:21.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:20 smithi001 ceph-mon[30843]: pgmap v306: 97 pgs: 97 active+clean; 630 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.1 KiB/s wr, 9 op/s 2024-09-15T22:23:21.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:20 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/2087399227' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:23:21.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:20 smithi012 ceph-mon[34883]: pgmap v306: 97 pgs: 97 active+clean; 630 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.1 KiB/s wr, 9 op/s 2024-09-15T22:23:21.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:20 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/2087399227' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:23:21.282 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:21.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:20 smithi098 ceph-mon[35514]: pgmap v306: 97 pgs: 97 active+clean; 630 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.1 KiB/s wr, 9 op/s 2024-09-15T22:23:21.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:20 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/2087399227' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:23:21.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.851+0000 7fcbba000640 1 -- 172.21.15.1:0/3640827287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcbb4112a30 msgr2=0x7fcbb4114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:21.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.851+0000 7fcbba000640 1 --2- 172.21.15.1:0/3640827287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcbb4112a30 0x7fcbb4114e20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcbac009ca0 tx=0x7fcbac02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:23:21.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.851+0000 7fcbba000640 1 -- 172.21.15.1:0/3640827287 shutdown_connections 2024-09-15T22:23:21.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.851+0000 7fcbba000640 1 --2- 172.21.15.1:0/3640827287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcbb4112a30 0x7fcbb4114e20 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:21.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.851+0000 7fcbba000640 1 --2- 172.21.15.1:0/3640827287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbb4077040 0x7fcbb41124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:21.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.851+0000 7fcbba000640 1 --2- 172.21.15.1:0/3640827287 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbb4076720 0x7fcbb4076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:21.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.851+0000 7fcbba000640 1 -- 172.21.15.1:0/3640827287 >> 172.21.15.1:0/3640827287 conn(0x7fcbb40ffa90 msgr2=0x7fcbb4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:21.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.851+0000 7fcbba000640 1 -- 172.21.15.1:0/3640827287 shutdown_connections 2024-09-15T22:23:21.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.852+0000 7fcbba000640 1 -- 172.21.15.1:0/3640827287 wait complete. 2024-09-15T22:23:21.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.852+0000 7fcbba000640 1 Processor -- start 2024-09-15T22:23:21.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.853+0000 7fcbba000640 1 -- start start 2024-09-15T22:23:21.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.853+0000 7fcbba000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcbb4076720 0x7fcbb41a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:21.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.853+0000 7fcbba000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbb4077040 0x7fcbb41a4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:21.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.853+0000 7fcbba000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbb4112a30 0x7fcbb419e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:21.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.853+0000 7fcbba000640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb41185d0 con 0x7fcbb4076720 2024-09-15T22:23:21.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.853+0000 7fcbba000640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb4118450 con 0x7fcbb4077040 2024-09-15T22:23:21.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.853+0000 7fcbba000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb4118750 con 0x7fcbb4112a30 2024-09-15T22:23:21.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.853+0000 7fcbb3400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcbb4076720 0x7fcbb41a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:21.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.853+0000 7fcbb3400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcbb4076720 0x7fcbb41a46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47574/0 (socket says 172.21.15.1:47574) 2024-09-15T22:23:21.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.853+0000 7fcbb3400640 1 -- 172.21.15.1:0/2491979879 learned_addr learned my addr 172.21.15.1:0/2491979879 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:21.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.853+0000 7fcbb2a00640 1 --2- 172.21.15.1:0/2491979879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbb4077040 0x7fcbb41a4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:21.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.853+0000 7fcbb3e00640 1 --2- 172.21.15.1:0/2491979879 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbb4112a30 0x7fcbb419e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:21.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.854+0000 7fcbb3400640 1 -- 172.21.15.1:0/2491979879 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbb4112a30 msgr2=0x7fcbb419e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:21.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.854+0000 7fcbb3400640 1 --2- 172.21.15.1:0/2491979879 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbb4112a30 0x7fcbb419e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:21.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.854+0000 7fcbb3400640 1 -- 172.21.15.1:0/2491979879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbb4077040 msgr2=0x7fcbb41a4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:21.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.854+0000 7fcbb3400640 1 --2- 172.21.15.1:0/2491979879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbb4077040 0x7fcbb41a4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:21.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.854+0000 7fcbb3400640 1 -- 172.21.15.1:0/2491979879 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb419efd0 con 0x7fcbb4076720 2024-09-15T22:23:21.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.854+0000 7fcbb2a00640 1 --2- 172.21.15.1:0/2491979879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbb4077040 0x7fcbb41a4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:23:21.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.854+0000 7fcbb3400640 1 --2- 172.21.15.1:0/2491979879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcbb4076720 0x7fcbb41a46e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcba400e9f0 tx=0x7fcba400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:21.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.854+0000 7fcbabe00640 1 -- 172.21.15.1:0/2491979879 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba400cd80 con 0x7fcbb4076720 2024-09-15T22:23:21.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.854+0000 7fcbabe00640 1 -- 172.21.15.1:0/2491979879 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcba4005500 con 0x7fcbb4076720 2024-09-15T22:23:21.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.854+0000 7fcbabe00640 1 -- 172.21.15.1:0/2491979879 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba4010690 con 0x7fcbb4076720 2024-09-15T22:23:21.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.854+0000 7fcbba000640 1 -- 172.21.15.1:0/2491979879 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbb419f2c0 con 0x7fcbb4076720 2024-09-15T22:23:21.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.854+0000 7fcbba000640 1 -- 172.21.15.1:0/2491979879 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbb41ab5b0 con 0x7fcbb4076720 2024-09-15T22:23:21.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.855+0000 7fcbba000640 1 -- 172.21.15.1:0/2491979879 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbb4076b00 con 0x7fcbb4076720 2024-09-15T22:23:21.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.857+0000 7fcbabe00640 1 -- 172.21.15.1:0/2491979879 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fcba40046c0 con 0x7fcbb4076720 2024-09-15T22:23:21.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.858+0000 7fcbabe00640 1 --2- 172.21.15.1:0/2491979879 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fcb980a3350 0x7fcb980a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:21.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.859+0000 7fcbabe00640 1 -- 172.21.15.1:0/2491979879 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fcba40cfd70 con 0x7fcbb4076720 2024-09-15T22:23:21.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.859+0000 7fcbb2a00640 1 --2- 172.21.15.1:0/2491979879 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fcb980a3350 0x7fcb980a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:21.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.859+0000 7fcbb2a00640 1 --2- 172.21.15.1:0/2491979879 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fcb980a3350 0x7fcb980a5810 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4079290 tx=0x7fcba0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:21.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:21.863+0000 7fcbabe00640 1 -- 172.21.15.1:0/2491979879 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcba409c9e0 con 0x7fcbb4076720 2024-09-15T22:23:22.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:22.049+0000 7fcbba000640 1 -- 172.21.15.1:0/2491979879 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcbb419fdd0 con 0x7fcbb4076720 2024-09-15T22:23:22.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:22.051+0000 7fcbabe00640 1 -- 172.21.15.1:0/2491979879 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22148 (secure 0 0 0) 0x7fcba409c2e0 con 0x7fcbb4076720 2024-09-15T22:23:22.053 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:23:22.054 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":82,"fsid":"c1228c44-73af-11ef-bceb-c7b262605968","created":"2024-09-15T22:14:39.004556+0000","modified":"2024-09-15T22:22:51.743047+0000","last_up_change":"2024-09-15T22:21:53.270221+0000","last_in_change":"2024-09-15T22:21:30.911945+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:17:56.059390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:22:47.262081+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:22:49.746577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28228d47-bbb7-4103-a4fb-3e126769f8bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6803","nonce":3588868833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6805","nonce":3588868833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6809","nonce":3588868833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6807","nonce":3588868833}]},"public_addr":"172.21.15.1:6803/3588868833","cluster_addr":"172.21.15.1:6805/3588868833","heartbeat_back_addr":"172.21.15.1:6809/3588868833","heartbeat_front_addr":"172.21.15.1:6807/3588868833","state":["exists","up"]},{"osd":1,"uuid":"d90dd2c1-2047-4491-8730-30793a354aa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6801","nonce":3951165354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6803","nonce":3951165354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6807","nonce":3951165354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6805","nonce":3951165354}]},"public_addr":"172.21.15.12:6801/3951165354","cluster_addr":"172.21.15.12:6803/3951165354","heartbeat_back_addr":"172.21.15.12:6807/3951165354","heartbeat_front_addr":"172.21.15.12:6805/3951165354","state":["exists","up"]},{"osd":2,"uuid":"22e38f44-88d3-4461-a57e-6dc4857ec48f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6801","nonce":1633982971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6803","nonce":1633982971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6807","nonce":1633982971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6805","nonce":1633982971}]},"public_addr":"172.21.15.98:6801/1633982971","cluster_addr":"172.21.15.98:6803/1633982971","heartbeat_back_addr":"172.21.15.98:6807/1633982971","heartbeat_front_addr":"172.21.15.98:6805/1633982971","state":["exists","up"]},{"osd":3,"uuid":"dd9d6e97-af81-442a-ac0d-543e440a8d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6811","nonce":3706738461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6813","nonce":3706738461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6817","nonce":3706738461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6815","nonce":3706738461}]},"public_addr":"172.21.15.1:6811/3706738461","cluster_addr":"172.21.15.1:6813/3706738461","heartbeat_back_addr":"172.21.15.1:6817/3706738461","heartbeat_front_addr":"172.21.15.1:6815/3706738461","state":["exists","up"]},{"osd":4,"uuid":"50116baa-dd99-4dbb-a7a1-2268f04052f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6809","nonce":4057902964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6811","nonce":4057902964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6815","nonce":4057902964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6813","nonce":4057902964}]},"public_addr":"172.21.15.12:6809/4057902964","cluster_addr":"172.21.15.12:6811/4057902964","heartbeat_back_addr":"172.21.15.12:6815/4057902964","heartbeat_front_addr":"172.21.15.12:6813/4057902964","state":["exists","up"]},{"osd":5,"uuid":"56ab0694-2f21-46c4-a086-44f72c271c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6809","nonce":4043567619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6811","nonce":4043567619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6815","nonce":4043567619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6813","nonce":4043567619}]},"public_addr":"172.21.15.98:6809/4043567619","cluster_addr":"172.21.15.98:6811/4043567619","heartbeat_back_addr":"172.21.15.98:6815/4043567619","heartbeat_front_addr":"172.21.15.98:6813/4043567619","state":["exists","up"]},{"osd":6,"uuid":"5ca0d114-4894-428e-bcd3-2ebd24d10a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6819","nonce":2236861161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6821","nonce":2236861161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6825","nonce":2236861161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6823","nonce":2236861161}]},"public_addr":"172.21.15.1:6819/2236861161","cluster_addr":"172.21.15.1:6821/2236861161","heartbeat_back_addr":"172.21.15.1:6825/2236861161","heartbeat_front_addr":"172.21.15.1:6823/2236861161","state":["exists","up"]},{"osd":7,"uuid":"db99cc6e-1717-4958-bf11-65aca94476b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6817","nonce":133202448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6819","nonce":133202448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6823","nonce":133202448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6821","nonce":133202448}]},"public_addr":"172.21.15.12:6817/133202448","cluster_addr":"172.21.15.12:6819/133202448","heartbeat_back_addr":"172.21.15.12:6823/133202448","heartbeat_front_addr":"172.21.15.12:6821/133202448","state":["exists","up"]},{"osd":8,"uuid":"4d3b6574-49f7-47f6-b36b-4da14ca290f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6817","nonce":3701478409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6819","nonce":3701478409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6823","nonce":3701478409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6821","nonce":3701478409}]},"public_addr":"172.21.15.98:6817/3701478409","cluster_addr":"172.21.15.98:6819/3701478409","heartbeat_back_addr":"172.21.15.98:6823/3701478409","heartbeat_front_addr":"172.21.15.98:6821/3701478409","state":["exists","up"]},{"osd":9,"uuid":"7dd2fe25-1b75-48e5-86c7-c7a3ab85053f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6827","nonce":2580755002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6829","nonce":2580755002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6833","nonce":2580755002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6831","nonce":2580755002}]},"public_addr":"172.21.15.1:6827/2580755002","cluster_addr":"172.21.15.1:6829/2580755002","heartbeat_back_addr":"172.21.15.1:6833/2580755002","heartbeat_front_addr":"172.21.15.1:6831/2580755002","state":["exists","up"]},{"osd":10,"uuid":"fcad11dc-0a1b-44a2-ac32-74100e317255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6825","nonce":3989063573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6827","nonce":3989063573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6831","nonce":3989063573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6829","nonce":3989063573}]},"public_addr":"172.21.15.12:6825/3989063573","cluster_addr":"172.21.15.12:6827/3989063573","heartbeat_back_addr":"172.21.15.12:6831/3989063573","heartbeat_front_addr":"172.21.15.12:6829/3989063573","state":["exists","up"]},{"osd":11,"uuid":"f4e717bb-586d-4fe2-9e6b-f574be4db36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6825","nonce":839956167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6827","nonce":839956167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6831","nonce":839956167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6829","nonce":839956167}]},"public_addr":"172.21.15.98:6825/839956167","cluster_addr":"172.21.15.98:6827/839956167","heartbeat_back_addr":"172.21.15.98:6831/839956167","heartbeat_front_addr":"172.21.15.98:6829/839956167","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:17:01.990618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:17:28.259003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:17:52.825080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:18:22.724038+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:18:48.383663+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:19:13.246563+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:19:42.318469+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:20:08.809160+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:20:32.628925+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:21:02.280217+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:21:27.897758+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:21:52.055015+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6800/3145051160":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/3101438101":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/4159811089":"2024-09-16T22:15:31.433375+0000","172.21.15.1:6801/3145051160":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/2785155592":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/714180295":"2024-09-16T22:15:03.937536+0000","172.21.15.1:6801/215291238":"2024-09-16T22:15:03.937536+0000","172.21.15.1:6800/215291238":"2024-09-16T22:15:03.937536+0000","172.21.15.1:0/1842817732":"2024-09-16T22:15:03.937536+0000","172.21.15.1:0/3888009741":"2024-09-16T22:15:03.937536+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:23:22.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:22.053+0000 7fcbba000640 1 -- 172.21.15.1:0/2491979879 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fcb980a3350 msgr2=0x7fcb980a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:22.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:22.053+0000 7fcbba000640 1 --2- 172.21.15.1:0/2491979879 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fcb980a3350 0x7fcb980a5810 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4079290 tx=0x7fcba0005f90 comp rx=0 tx=0).stop 2024-09-15T22:23:22.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:22.053+0000 7fcbba000640 1 -- 172.21.15.1:0/2491979879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcbb4076720 msgr2=0x7fcbb41a46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:22.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:22.053+0000 7fcbba000640 1 --2- 172.21.15.1:0/2491979879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcbb4076720 0x7fcbb41a46e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcba400e9f0 tx=0x7fcba400edf0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:22.054+0000 7fcbba000640 1 -- 172.21.15.1:0/2491979879 shutdown_connections 2024-09-15T22:23:22.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:22.054+0000 7fcbba000640 1 --2- 172.21.15.1:0/2491979879 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fcb980a3350 0x7fcb980a5810 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:22.054+0000 7fcbba000640 1 --2- 172.21.15.1:0/2491979879 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbb4112a30 0x7fcbb419e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:22.054+0000 7fcbba000640 1 --2- 172.21.15.1:0/2491979879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbb4077040 0x7fcbb41a4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:22.054+0000 7fcbba000640 1 --2- 172.21.15.1:0/2491979879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcbb4076720 0x7fcbb41a46e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:22.054+0000 7fcbba000640 1 -- 172.21.15.1:0/2491979879 >> 172.21.15.1:0/2491979879 conn(0x7fcbb40ffa90 msgr2=0x7fcbb4101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:22.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:22.054+0000 7fcbba000640 1 -- 172.21.15.1:0/2491979879 shutdown_connections 2024-09-15T22:23:22.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:22.054+0000 7fcbba000640 1 -- 172.21.15.1:0/2491979879 wait complete. 2024-09-15T22:23:22.977 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-15T22:23:22.977 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T22:23:23.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:22 smithi012 ceph-mon[34883]: pgmap v307: 97 pgs: 97 active+clean; 630 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.2 KiB/s wr, 9 op/s 2024-09-15T22:23:23.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:22 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/2491979879' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:23:23.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:22 smithi098 ceph-mon[35514]: pgmap v307: 97 pgs: 97 active+clean; 630 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.2 KiB/s wr, 9 op/s 2024-09-15T22:23:23.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:22 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/2491979879' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:23:23.353 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:23.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:22 smithi001 ceph-mon[30843]: pgmap v307: 97 pgs: 97 active+clean; 630 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.2 KiB/s wr, 9 op/s 2024-09-15T22:23:23.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:22 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/2491979879' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:23:23.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.904+0000 7f2219e00640 1 -- 172.21.15.1:0/2666734915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22141047e0 msgr2=0x7f2214108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:23.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.904+0000 7f2219e00640 1 --2- 172.21.15.1:0/2666734915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22141047e0 0x7f2214108830 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2200009900 tx=0x7f220002a410 comp rx=0 tx=0).stop 2024-09-15T22:23:23.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.904+0000 7f2219e00640 1 -- 172.21.15.1:0/2666734915 shutdown_connections 2024-09-15T22:23:23.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.904+0000 7f2219e00640 1 --2- 172.21.15.1:0/2666734915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2214108f60 0x7f2214110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:23.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.904+0000 7f2219e00640 1 --2- 172.21.15.1:0/2666734915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22141047e0 0x7f2214108830 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:23.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.904+0000 7f2219e00640 1 --2- 172.21.15.1:0/2666734915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2214103e30 0x7f2214104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:23.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.904+0000 7f2219e00640 1 -- 172.21.15.1:0/2666734915 >> 172.21.15.1:0/2666734915 conn(0x7f22140ff8d0 msgr2=0x7f2214101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:23.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.904+0000 7f2219e00640 1 -- 172.21.15.1:0/2666734915 shutdown_connections 2024-09-15T22:23:23.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.904+0000 7f2219e00640 1 -- 172.21.15.1:0/2666734915 wait complete. 2024-09-15T22:23:23.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.905+0000 7f2219e00640 1 Processor -- start 2024-09-15T22:23:23.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.905+0000 7f2219e00640 1 -- start start 2024-09-15T22:23:23.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.905+0000 7f2219e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2214103e30 0x7f2214076700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:23.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.905+0000 7f2219e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22141047e0 0x7f2214076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:23.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.905+0000 7f2219e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2214108f60 0x7f2214077180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:23.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.905+0000 7f2219e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2214114010 con 0x7f22141047e0 2024-09-15T22:23:23.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.905+0000 7f2219e00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2214113e90 con 0x7f2214103e30 2024-09-15T22:23:23.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.905+0000 7f2219e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2214114190 con 0x7f2214108f60 2024-09-15T22:23:23.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.905+0000 7f2213e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22141047e0 0x7f2214076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:23.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.905+0000 7f2213e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22141047e0 0x7f2214076c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47588/0 (socket says 172.21.15.1:47588) 2024-09-15T22:23:23.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.906+0000 7f2213e00640 1 -- 172.21.15.1:0/2413100789 learned_addr learned my addr 172.21.15.1:0/2413100789 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:23.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.906+0000 7f2218a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2214103e30 0x7f2214076700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:23.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.906+0000 7f2219400640 1 --2- 172.21.15.1:0/2413100789 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2214108f60 0x7f2214077180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:23.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.906+0000 7f2218a00640 1 -- 172.21.15.1:0/2413100789 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2214108f60 msgr2=0x7f2214077180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:23.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.906+0000 7f2218a00640 1 --2- 172.21.15.1:0/2413100789 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2214108f60 0x7f2214077180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:23.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.906+0000 7f2218a00640 1 -- 172.21.15.1:0/2413100789 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22141047e0 msgr2=0x7f2214076c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:23.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.906+0000 7f2218a00640 1 --2- 172.21.15.1:0/2413100789 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22141047e0 0x7f2214076c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:23.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.906+0000 7f2218a00640 1 -- 172.21.15.1:0/2413100789 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22141aab10 con 0x7f2214103e30 2024-09-15T22:23:23.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.906+0000 7f2213e00640 1 --2- 172.21.15.1:0/2413100789 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22141047e0 0x7f2214076c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:23:23.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.906+0000 7f2218a00640 1 --2- 172.21.15.1:0/2413100789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2214103e30 0x7f2214076700 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f220800ea50 tx=0x7f220800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:23.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.906+0000 7f2211600640 1 -- 172.21.15.1:0/2413100789 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220800cd30 con 0x7f2214103e30 2024-09-15T22:23:23.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.906+0000 7f2211600640 1 -- 172.21.15.1:0/2413100789 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22080035f0 con 0x7f2214103e30 2024-09-15T22:23:23.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.907+0000 7f2219e00640 1 -- 172.21.15.1:0/2413100789 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22141aae00 con 0x7f2214103e30 2024-09-15T22:23:23.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.907+0000 7f2211600640 1 -- 172.21.15.1:0/2413100789 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2208010650 con 0x7f2214103e30 2024-09-15T22:23:23.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.907+0000 7f2219e00640 1 -- 172.21.15.1:0/2413100789 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22141ab2b0 con 0x7f2214103e30 2024-09-15T22:23:23.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.908+0000 7f2219e00640 1 -- 172.21.15.1:0/2413100789 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2214105310 con 0x7f2214103e30 2024-09-15T22:23:23.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.909+0000 7f2211600640 1 -- 172.21.15.1:0/2413100789 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f22080037a0 con 0x7f2214103e30 2024-09-15T22:23:23.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.911+0000 7f2211600640 1 --2- 172.21.15.1:0/2413100789 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f21fc0a32d0 0x7f21fc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:23.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.911+0000 7f2211600640 1 -- 172.21.15.1:0/2413100789 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f22080cfc40 con 0x7f2214103e30 2024-09-15T22:23:23.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.911+0000 7f2213e00640 1 --2- 172.21.15.1:0/2413100789 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f21fc0a32d0 0x7f21fc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:23.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.911+0000 7f2213e00640 1 --2- 172.21.15.1:0/2413100789 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f21fc0a32d0 0x7f21fc0a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2214077ec0 tx=0x7f22000046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:23.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:23.915+0000 7f2211600640 1 -- 172.21.15.1:0/2413100789 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f220809c8b0 con 0x7f2214103e30 2024-09-15T22:23:24.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:24.097+0000 7f2219e00640 1 -- 172.21.15.1:0/2413100789 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2214062630 con 0x7f21fc0a32d0 2024-09-15T22:23:24.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:24.105+0000 7f2211600640 1 -- 172.21.15.1:0/2413100789 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258701 (secure 0 0 0) 0x7f2214062630 con 0x7f21fc0a32d0 2024-09-15T22:23:24.110 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:23:24.112 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-15T22:23:24.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:24.109+0000 7f2219e00640 1 -- 172.21.15.1:0/2413100789 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f21fc0a32d0 msgr2=0x7f21fc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:24.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:24.109+0000 7f2219e00640 1 --2- 172.21.15.1:0/2413100789 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f21fc0a32d0 0x7f21fc0a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2214077ec0 tx=0x7f22000046c0 comp rx=0 tx=0).stop 2024-09-15T22:23:24.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:24.109+0000 7f2219e00640 1 -- 172.21.15.1:0/2413100789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2214103e30 msgr2=0x7f2214076700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:24.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:24.109+0000 7f2219e00640 1 --2- 172.21.15.1:0/2413100789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2214103e30 0x7f2214076700 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f220800ea50 tx=0x7f220800ef10 comp rx=0 tx=0).stop 2024-09-15T22:23:24.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:24.110+0000 7f2219e00640 1 -- 172.21.15.1:0/2413100789 shutdown_connections 2024-09-15T22:23:24.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:24.110+0000 7f2219e00640 1 --2- 172.21.15.1:0/2413100789 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f21fc0a32d0 0x7f21fc0a5790 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:24.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:24.110+0000 7f2219e00640 1 --2- 172.21.15.1:0/2413100789 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2214108f60 0x7f2214077180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:24.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:24.110+0000 7f2219e00640 1 --2- 172.21.15.1:0/2413100789 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22141047e0 0x7f2214076c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:24.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:24.110+0000 7f2219e00640 1 --2- 172.21.15.1:0/2413100789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2214103e30 0x7f2214076700 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:24.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:24.110+0000 7f2219e00640 1 -- 172.21.15.1:0/2413100789 >> 172.21.15.1:0/2413100789 conn(0x7f22140ff8d0 msgr2=0x7f2214100bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:24.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:24.110+0000 7f2219e00640 1 -- 172.21.15.1:0/2413100789 shutdown_connections 2024-09-15T22:23:24.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:24.110+0000 7f2219e00640 1 -- 172.21.15.1:0/2413100789 wait complete. 2024-09-15T22:23:24.945 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":308,"stamp":"2024-09-15T22:23:23.530734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":645110,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":247,"num_read_kb":226,"num_write":338,"num_write_kb":3038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":272,"ondisk_log_size":272,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":357556,"kb_used_data":12468,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124584268,"statfs":{"total":1151940427776,"available":1151574290432,"internally_reserved":0,"allocated":12767232,"data_stored":7008978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":353154361},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":48734,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":80,"num_write":30,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003186"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.770496+0000","last_change":"2024-09-15T22:22:50.777000+0000","last_active":"2024-09-15T22:22:51.770496+0000","last_peered":"2024-09-15T22:22:51.770496+0000","last_clean":"2024-09-15T22:22:51.770496+0000","last_became_active":"2024-09-15T22:22:50.776448+0000","last_became_peered":"2024-09-15T22:22:50.776448+0000","last_unstale":"2024-09-15T22:22:51.770496+0000","last_undegraded":"2024-09-15T22:22:51.770496+0000","last_fullsized":"2024-09-15T22:22:51.770496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:20:09.218864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.787284+0000","last_change":"2024-09-15T22:22:50.772294+0000","last_active":"2024-09-15T22:22:51.787284+0000","last_peered":"2024-09-15T22:22:51.787284+0000","last_clean":"2024-09-15T22:22:51.787284+0000","last_became_active":"2024-09-15T22:22:50.771993+0000","last_became_peered":"2024-09-15T22:22:50.771993+0000","last_unstale":"2024-09-15T22:22:51.787284+0000","last_undegraded":"2024-09-15T22:22:51.787284+0000","last_fullsized":"2024-09-15T22:22:51.787284+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:23.770489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.787821+0000","last_change":"2024-09-15T22:22:50.775717+0000","last_active":"2024-09-15T22:22:51.787821+0000","last_peered":"2024-09-15T22:22:51.787821+0000","last_clean":"2024-09-15T22:22:51.787821+0000","last_became_active":"2024-09-15T22:22:50.775405+0000","last_became_peered":"2024-09-15T22:22:50.775405+0000","last_unstale":"2024-09-15T22:22:51.787821+0000","last_undegraded":"2024-09-15T22:22:51.787821+0000","last_fullsized":"2024-09-15T22:22:51.787821+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:28.765207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.770558+0000","last_change":"2024-09-15T22:22:50.786473+0000","last_active":"2024-09-15T22:22:51.770558+0000","last_peered":"2024-09-15T22:22:51.770558+0000","last_clean":"2024-09-15T22:22:51.770558+0000","last_became_active":"2024-09-15T22:22:50.786001+0000","last_became_peered":"2024-09-15T22:22:50.786001+0000","last_unstale":"2024-09-15T22:22:51.770558+0000","last_undegraded":"2024-09-15T22:22:51.770558+0000","last_fullsized":"2024-09-15T22:22:51.770558+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:47.378713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.782976+0000","last_change":"2024-09-15T22:22:50.777784+0000","last_active":"2024-09-15T22:22:51.782976+0000","last_peered":"2024-09-15T22:22:51.782976+0000","last_clean":"2024-09-15T22:22:51.782976+0000","last_became_active":"2024-09-15T22:22:50.777457+0000","last_became_peered":"2024-09-15T22:22:50.777457+0000","last_unstale":"2024-09-15T22:22:51.782976+0000","last_undegraded":"2024-09-15T22:22:51.782976+0000","last_fullsized":"2024-09-15T22:22:51.782976+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:25.106526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.782794+0000","last_change":"2024-09-15T22:22:50.773565+0000","last_active":"2024-09-15T22:22:51.782794+0000","last_peered":"2024-09-15T22:22:51.782794+0000","last_clean":"2024-09-15T22:22:51.782794+0000","last_became_active":"2024-09-15T22:22:50.773208+0000","last_became_peered":"2024-09-15T22:22:50.773208+0000","last_unstale":"2024-09-15T22:22:51.782794+0000","last_undegraded":"2024-09-15T22:22:51.782794+0000","last_fullsized":"2024-09-15T22:22:51.782794+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:07:43.996923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.783577+0000","last_change":"2024-09-15T22:22:50.779699+0000","last_active":"2024-09-15T22:22:51.783577+0000","last_peered":"2024-09-15T22:22:51.783577+0000","last_clean":"2024-09-15T22:22:51.783577+0000","last_became_active":"2024-09-15T22:22:50.779290+0000","last_became_peered":"2024-09-15T22:22:50.779290+0000","last_unstale":"2024-09-15T22:22:51.783577+0000","last_undegraded":"2024-09-15T22:22:51.783577+0000","last_fullsized":"2024-09-15T22:22:51.783577+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:41:21.741094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.784083+0000","last_change":"2024-09-15T22:22:50.786051+0000","last_active":"2024-09-15T22:22:51.784083+0000","last_peered":"2024-09-15T22:22:51.784083+0000","last_clean":"2024-09-15T22:22:51.784083+0000","last_became_active":"2024-09-15T22:22:50.785767+0000","last_became_peered":"2024-09-15T22:22:50.785767+0000","last_unstale":"2024-09-15T22:22:51.784083+0000","last_undegraded":"2024-09-15T22:22:51.784083+0000","last_fullsized":"2024-09-15T22:22:51.784083+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:23:09.849960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.787584+0000","last_change":"2024-09-15T22:22:50.781257+0000","last_active":"2024-09-15T22:22:51.787584+0000","last_peered":"2024-09-15T22:22:51.787584+0000","last_clean":"2024-09-15T22:22:51.787584+0000","last_became_active":"2024-09-15T22:22:50.780470+0000","last_became_peered":"2024-09-15T22:22:50.780470+0000","last_unstale":"2024-09-15T22:22:51.787584+0000","last_undegraded":"2024-09-15T22:22:51.787584+0000","last_fullsized":"2024-09-15T22:22:51.787584+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:46:01.515377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.784062+0000","last_change":"2024-09-15T22:22:50.776481+0000","last_active":"2024-09-15T22:22:51.784062+0000","last_peered":"2024-09-15T22:22:51.784062+0000","last_clean":"2024-09-15T22:22:51.784062+0000","last_became_active":"2024-09-15T22:22:50.775915+0000","last_became_peered":"2024-09-15T22:22:50.775915+0000","last_unstale":"2024-09-15T22:22:51.784062+0000","last_undegraded":"2024-09-15T22:22:51.784062+0000","last_fullsized":"2024-09-15T22:22:51.784062+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:35.923867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.783872+0000","last_change":"2024-09-15T22:22:50.777986+0000","last_active":"2024-09-15T22:22:51.783872+0000","last_peered":"2024-09-15T22:22:51.783872+0000","last_clean":"2024-09-15T22:22:51.783872+0000","last_became_active":"2024-09-15T22:22:50.777624+0000","last_became_peered":"2024-09-15T22:22:50.777624+0000","last_unstale":"2024-09-15T22:22:51.783872+0000","last_undegraded":"2024-09-15T22:22:51.783872+0000","last_fullsized":"2024-09-15T22:22:51.783872+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:07.135073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.770648+0000","last_change":"2024-09-15T22:22:50.786563+0000","last_active":"2024-09-15T22:22:51.770648+0000","last_peered":"2024-09-15T22:22:51.770648+0000","last_clean":"2024-09-15T22:22:51.770648+0000","last_became_active":"2024-09-15T22:22:50.786074+0000","last_became_peered":"2024-09-15T22:22:50.786074+0000","last_unstale":"2024-09-15T22:22:51.770648+0000","last_undegraded":"2024-09-15T22:22:51.770648+0000","last_fullsized":"2024-09-15T22:22:51.770648+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:10:16.804185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.784132+0000","last_change":"2024-09-15T22:22:50.778817+0000","last_active":"2024-09-15T22:22:51.784132+0000","last_peered":"2024-09-15T22:22:51.784132+0000","last_clean":"2024-09-15T22:22:51.784132+0000","last_became_active":"2024-09-15T22:22:50.776127+0000","last_became_peered":"2024-09-15T22:22:50.776127+0000","last_unstale":"2024-09-15T22:22:51.784132+0000","last_undegraded":"2024-09-15T22:22:51.784132+0000","last_fullsized":"2024-09-15T22:22:51.784132+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:19.233333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.787924+0000","last_change":"2024-09-15T22:22:50.771502+0000","last_active":"2024-09-15T22:22:51.787924+0000","last_peered":"2024-09-15T22:22:51.787924+0000","last_clean":"2024-09-15T22:22:51.787924+0000","last_became_active":"2024-09-15T22:22:50.771201+0000","last_became_peered":"2024-09-15T22:22:50.771201+0000","last_unstale":"2024-09-15T22:22:51.787924+0000","last_undegraded":"2024-09-15T22:22:51.787924+0000","last_fullsized":"2024-09-15T22:22:51.787924+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:24:34.668603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.787442+0000","last_change":"2024-09-15T22:22:50.776677+0000","last_active":"2024-09-15T22:22:51.787442+0000","last_peered":"2024-09-15T22:22:51.787442+0000","last_clean":"2024-09-15T22:22:51.787442+0000","last_became_active":"2024-09-15T22:22:50.774861+0000","last_became_peered":"2024-09-15T22:22:50.774861+0000","last_unstale":"2024-09-15T22:22:51.787442+0000","last_undegraded":"2024-09-15T22:22:51.787442+0000","last_fullsized":"2024-09-15T22:22:51.787442+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:25:00.652606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.786714+0000","last_change":"2024-09-15T22:22:50.784162+0000","last_active":"2024-09-15T22:22:51.786714+0000","last_peered":"2024-09-15T22:22:51.786714+0000","last_clean":"2024-09-15T22:22:51.786714+0000","last_became_active":"2024-09-15T22:22:50.783782+0000","last_became_peered":"2024-09-15T22:22:50.783782+0000","last_unstale":"2024-09-15T22:22:51.786714+0000","last_undegraded":"2024-09-15T22:22:51.786714+0000","last_fullsized":"2024-09-15T22:22:51.786714+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:36:22.785321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.770479+0000","last_change":"2024-09-15T22:22:50.775360+0000","last_active":"2024-09-15T22:22:51.770479+0000","last_peered":"2024-09-15T22:22:51.770479+0000","last_clean":"2024-09-15T22:22:51.770479+0000","last_became_active":"2024-09-15T22:22:50.775075+0000","last_became_peered":"2024-09-15T22:22:50.775075+0000","last_unstale":"2024-09-15T22:22:51.770479+0000","last_undegraded":"2024-09-15T22:22:51.770479+0000","last_fullsized":"2024-09-15T22:22:51.770479+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:25:42.484125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.767078+0000","last_change":"2024-09-15T22:22:50.772497+0000","last_active":"2024-09-15T22:22:51.767078+0000","last_peered":"2024-09-15T22:22:51.767078+0000","last_clean":"2024-09-15T22:22:51.767078+0000","last_became_active":"2024-09-15T22:22:50.770061+0000","last_became_peered":"2024-09-15T22:22:50.770061+0000","last_unstale":"2024-09-15T22:22:51.767078+0000","last_undegraded":"2024-09-15T22:22:51.767078+0000","last_fullsized":"2024-09-15T22:22:51.767078+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:23.420138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.785188+0000","last_change":"2024-09-15T22:22:50.788026+0000","last_active":"2024-09-15T22:22:51.785188+0000","last_peered":"2024-09-15T22:22:51.785188+0000","last_clean":"2024-09-15T22:22:51.785188+0000","last_became_active":"2024-09-15T22:22:50.787247+0000","last_became_peered":"2024-09-15T22:22:50.787247+0000","last_unstale":"2024-09-15T22:22:51.785188+0000","last_undegraded":"2024-09-15T22:22:51.785188+0000","last_fullsized":"2024-09-15T22:22:51.785188+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:52:48.408625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.770142+0000","last_change":"2024-09-15T22:22:50.777295+0000","last_active":"2024-09-15T22:22:51.770142+0000","last_peered":"2024-09-15T22:22:51.770142+0000","last_clean":"2024-09-15T22:22:51.770142+0000","last_became_active":"2024-09-15T22:22:50.776957+0000","last_became_peered":"2024-09-15T22:22:50.776957+0000","last_unstale":"2024-09-15T22:22:51.770142+0000","last_undegraded":"2024-09-15T22:22:51.770142+0000","last_fullsized":"2024-09-15T22:22:51.770142+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:50:45.858031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.784296+0000","last_change":"2024-09-15T22:22:50.778773+0000","last_active":"2024-09-15T22:22:51.784296+0000","last_peered":"2024-09-15T22:22:51.784296+0000","last_clean":"2024-09-15T22:22:51.784296+0000","last_became_active":"2024-09-15T22:22:50.778346+0000","last_became_peered":"2024-09-15T22:22:50.778346+0000","last_unstale":"2024-09-15T22:22:51.784296+0000","last_undegraded":"2024-09-15T22:22:51.784296+0000","last_fullsized":"2024-09-15T22:22:51.784296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:21:11.785059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.786935+0000","last_change":"2024-09-15T22:22:50.776172+0000","last_active":"2024-09-15T22:22:51.786935+0000","last_peered":"2024-09-15T22:22:51.786935+0000","last_clean":"2024-09-15T22:22:51.786935+0000","last_became_active":"2024-09-15T22:22:50.775838+0000","last_became_peered":"2024-09-15T22:22:50.775838+0000","last_unstale":"2024-09-15T22:22:51.786935+0000","last_undegraded":"2024-09-15T22:22:51.786935+0000","last_fullsized":"2024-09-15T22:22:51.786935+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:16:35.834565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.785312+0000","last_change":"2024-09-15T22:22:50.780158+0000","last_active":"2024-09-15T22:22:51.785312+0000","last_peered":"2024-09-15T22:22:51.785312+0000","last_clean":"2024-09-15T22:22:51.785312+0000","last_became_active":"2024-09-15T22:22:50.779858+0000","last_became_peered":"2024-09-15T22:22:50.779858+0000","last_unstale":"2024-09-15T22:22:51.785312+0000","last_undegraded":"2024-09-15T22:22:51.785312+0000","last_fullsized":"2024-09-15T22:22:51.785312+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:38.760239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.782587+0000","last_change":"2024-09-15T22:22:50.787980+0000","last_active":"2024-09-15T22:22:51.782587+0000","last_peered":"2024-09-15T22:22:51.782587+0000","last_clean":"2024-09-15T22:22:51.782587+0000","last_became_active":"2024-09-15T22:22:50.787189+0000","last_became_peered":"2024-09-15T22:22:50.787189+0000","last_unstale":"2024-09-15T22:22:51.782587+0000","last_undegraded":"2024-09-15T22:22:51.782587+0000","last_fullsized":"2024-09-15T22:22:51.782587+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:05:31.741961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.788004+0000","last_change":"2024-09-15T22:22:50.782833+0000","last_active":"2024-09-15T22:22:51.788004+0000","last_peered":"2024-09-15T22:22:51.788004+0000","last_clean":"2024-09-15T22:22:51.788004+0000","last_became_active":"2024-09-15T22:22:50.782450+0000","last_became_peered":"2024-09-15T22:22:50.782450+0000","last_unstale":"2024-09-15T22:22:51.788004+0000","last_undegraded":"2024-09-15T22:22:51.788004+0000","last_fullsized":"2024-09-15T22:22:51.788004+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:32:07.931321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.785657+0000","last_change":"2024-09-15T22:22:50.784199+0000","last_active":"2024-09-15T22:22:51.785657+0000","last_peered":"2024-09-15T22:22:51.785657+0000","last_clean":"2024-09-15T22:22:51.785657+0000","last_became_active":"2024-09-15T22:22:50.783858+0000","last_became_peered":"2024-09-15T22:22:50.783858+0000","last_unstale":"2024-09-15T22:22:51.785657+0000","last_undegraded":"2024-09-15T22:22:51.785657+0000","last_fullsized":"2024-09-15T22:22:51.785657+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:40:01.271188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.770502+0000","last_change":"2024-09-15T22:22:50.772094+0000","last_active":"2024-09-15T22:22:51.770502+0000","last_peered":"2024-09-15T22:22:51.770502+0000","last_clean":"2024-09-15T22:22:51.770502+0000","last_became_active":"2024-09-15T22:22:50.771633+0000","last_became_peered":"2024-09-15T22:22:50.771633+0000","last_unstale":"2024-09-15T22:22:51.770502+0000","last_undegraded":"2024-09-15T22:22:51.770502+0000","last_fullsized":"2024-09-15T22:22:51.770502+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:06:46.194573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.784471+0000","last_change":"2024-09-15T22:22:50.781069+0000","last_active":"2024-09-15T22:22:51.784471+0000","last_peered":"2024-09-15T22:22:51.784471+0000","last_clean":"2024-09-15T22:22:51.784471+0000","last_became_active":"2024-09-15T22:22:50.780742+0000","last_became_peered":"2024-09-15T22:22:50.780742+0000","last_unstale":"2024-09-15T22:22:51.784471+0000","last_undegraded":"2024-09-15T22:22:51.784471+0000","last_fullsized":"2024-09-15T22:22:51.784471+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:21:05.323542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.787081+0000","last_change":"2024-09-15T22:22:50.776252+0000","last_active":"2024-09-15T22:22:51.787081+0000","last_peered":"2024-09-15T22:22:51.787081+0000","last_clean":"2024-09-15T22:22:51.787081+0000","last_became_active":"2024-09-15T22:22:50.775911+0000","last_became_peered":"2024-09-15T22:22:50.775911+0000","last_unstale":"2024-09-15T22:22:51.787081+0000","last_undegraded":"2024-09-15T22:22:51.787081+0000","last_fullsized":"2024-09-15T22:22:51.787081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:01:43.836637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.783929+0000","last_change":"2024-09-15T22:22:50.775992+0000","last_active":"2024-09-15T22:22:51.783929+0000","last_peered":"2024-09-15T22:22:51.783929+0000","last_clean":"2024-09-15T22:22:51.783929+0000","last_became_active":"2024-09-15T22:22:50.775619+0000","last_became_peered":"2024-09-15T22:22:50.775619+0000","last_unstale":"2024-09-15T22:22:51.783929+0000","last_undegraded":"2024-09-15T22:22:51.783929+0000","last_fullsized":"2024-09-15T22:22:51.783929+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:57.623706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.785382+0000","last_change":"2024-09-15T22:22:50.786376+0000","last_active":"2024-09-15T22:22:51.785382+0000","last_peered":"2024-09-15T22:22:51.785382+0000","last_clean":"2024-09-15T22:22:51.785382+0000","last_became_active":"2024-09-15T22:22:50.786011+0000","last_became_peered":"2024-09-15T22:22:50.786011+0000","last_unstale":"2024-09-15T22:22:51.785382+0000","last_undegraded":"2024-09-15T22:22:51.785382+0000","last_fullsized":"2024-09-15T22:22:51.785382+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:54.492349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.770106+0000","last_change":"2024-09-15T22:22:50.777114+0000","last_active":"2024-09-15T22:22:51.770106+0000","last_peered":"2024-09-15T22:22:51.770106+0000","last_clean":"2024-09-15T22:22:51.770106+0000","last_became_active":"2024-09-15T22:22:50.776756+0000","last_became_peered":"2024-09-15T22:22:50.776756+0000","last_unstale":"2024-09-15T22:22:51.770106+0000","last_undegraded":"2024-09-15T22:22:51.770106+0000","last_fullsized":"2024-09-15T22:22:51.770106+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:51.220074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.782469+0000","last_change":"2024-09-15T22:22:50.777228+0000","last_active":"2024-09-15T22:22:51.782469+0000","last_peered":"2024-09-15T22:22:51.782469+0000","last_clean":"2024-09-15T22:22:51.782469+0000","last_became_active":"2024-09-15T22:22:50.776926+0000","last_became_peered":"2024-09-15T22:22:50.776926+0000","last_unstale":"2024-09-15T22:22:51.782469+0000","last_undegraded":"2024-09-15T22:22:51.782469+0000","last_fullsized":"2024-09-15T22:22:51.782469+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:28:20.346803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:18.865594+0000","last_change":"2024-09-15T22:22:48.333147+0000","last_active":"2024-09-15T22:23:18.865594+0000","last_peered":"2024-09-15T22:23:18.865594+0000","last_clean":"2024-09-15T22:23:18.865594+0000","last_became_active":"2024-09-15T22:22:48.332862+0000","last_became_peered":"2024-09-15T22:22:48.332862+0000","last_unstale":"2024-09-15T22:23:18.865594+0000","last_undegraded":"2024-09-15T22:23:18.865594+0000","last_fullsized":"2024-09-15T22:23:18.865594+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:18:25.043411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.782705+0000","last_change":"2024-09-15T22:22:50.787593+0000","last_active":"2024-09-15T22:22:51.782705+0000","last_peered":"2024-09-15T22:22:51.782705+0000","last_clean":"2024-09-15T22:22:51.782705+0000","last_became_active":"2024-09-15T22:22:50.787262+0000","last_became_peered":"2024-09-15T22:22:50.787262+0000","last_unstale":"2024-09-15T22:22:51.782705+0000","last_undegraded":"2024-09-15T22:22:51.782705+0000","last_fullsized":"2024-09-15T22:22:51.782705+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:40:40.529295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:02.836512+0000","last_change":"2024-09-15T22:22:48.333060+0000","last_active":"2024-09-15T22:23:02.836512+0000","last_peered":"2024-09-15T22:23:02.836512+0000","last_clean":"2024-09-15T22:23:02.836512+0000","last_became_active":"2024-09-15T22:22:48.332713+0000","last_became_peered":"2024-09-15T22:22:48.332713+0000","last_unstale":"2024-09-15T22:23:02.836512+0000","last_undegraded":"2024-09-15T22:23:02.836512+0000","last_fullsized":"2024-09-15T22:23:02.836512+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:44.664497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:02.836596+0000","last_change":"2024-09-15T22:22:48.335104+0000","last_active":"2024-09-15T22:23:02.836596+0000","last_peered":"2024-09-15T22:23:02.836596+0000","last_clean":"2024-09-15T22:23:02.836596+0000","last_became_active":"2024-09-15T22:22:48.334276+0000","last_became_peered":"2024-09-15T22:22:48.334276+0000","last_unstale":"2024-09-15T22:23:02.836596+0000","last_undegraded":"2024-09-15T22:23:02.836596+0000","last_fullsized":"2024-09-15T22:23:02.836596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:49:24.414968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.784241+0000","last_change":"2024-09-15T22:22:50.773324+0000","last_active":"2024-09-15T22:22:51.784241+0000","last_peered":"2024-09-15T22:22:51.784241+0000","last_clean":"2024-09-15T22:22:51.784241+0000","last_became_active":"2024-09-15T22:22:50.773013+0000","last_became_peered":"2024-09-15T22:22:50.773013+0000","last_unstale":"2024-09-15T22:22:51.784241+0000","last_undegraded":"2024-09-15T22:22:51.784241+0000","last_fullsized":"2024-09-15T22:22:51.784241+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:41:06.642144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.783068+0000","last_change":"2024-09-15T22:22:48.334707+0000","last_active":"2024-09-15T22:22:51.783068+0000","last_peered":"2024-09-15T22:22:51.783068+0000","last_clean":"2024-09-15T22:22:51.783068+0000","last_became_active":"2024-09-15T22:22:48.334418+0000","last_became_peered":"2024-09-15T22:22:48.334418+0000","last_unstale":"2024-09-15T22:22:51.783068+0000","last_undegraded":"2024-09-15T22:22:51.783068+0000","last_fullsized":"2024-09-15T22:22:51.783068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:40.285547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.766861+0000","last_change":"2024-09-15T22:22:50.772760+0000","last_active":"2024-09-15T22:22:51.766861+0000","last_peered":"2024-09-15T22:22:51.766861+0000","last_clean":"2024-09-15T22:22:51.766861+0000","last_became_active":"2024-09-15T22:22:50.772162+0000","last_became_peered":"2024-09-15T22:22:50.772162+0000","last_unstale":"2024-09-15T22:22:51.766861+0000","last_undegraded":"2024-09-15T22:22:51.766861+0000","last_fullsized":"2024-09-15T22:22:51.766861+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:23.368902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:17.863755+0000","last_change":"2024-09-15T22:22:48.336282+0000","last_active":"2024-09-15T22:23:17.863755+0000","last_peered":"2024-09-15T22:23:17.863755+0000","last_clean":"2024-09-15T22:23:17.863755+0000","last_became_active":"2024-09-15T22:22:48.335696+0000","last_became_peered":"2024-09-15T22:22:48.335696+0000","last_unstale":"2024-09-15T22:23:17.863755+0000","last_undegraded":"2024-09-15T22:23:17.863755+0000","last_fullsized":"2024-09-15T22:23:17.863755+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:22.990996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.787585+0000","last_change":"2024-09-15T22:22:50.778166+0000","last_active":"2024-09-15T22:22:51.787585+0000","last_peered":"2024-09-15T22:22:51.787585+0000","last_clean":"2024-09-15T22:22:51.787585+0000","last_became_active":"2024-09-15T22:22:50.777755+0000","last_became_peered":"2024-09-15T22:22:50.777755+0000","last_unstale":"2024-09-15T22:22:51.787585+0000","last_undegraded":"2024-09-15T22:22:51.787585+0000","last_fullsized":"2024-09-15T22:22:51.787585+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:45:50.513358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:01.825492+0000","last_change":"2024-09-15T22:22:48.334952+0000","last_active":"2024-09-15T22:23:01.825492+0000","last_peered":"2024-09-15T22:23:01.825492+0000","last_clean":"2024-09-15T22:23:01.825492+0000","last_became_active":"2024-09-15T22:22:48.332190+0000","last_became_peered":"2024-09-15T22:22:48.332190+0000","last_unstale":"2024-09-15T22:23:01.825492+0000","last_undegraded":"2024-09-15T22:23:01.825492+0000","last_fullsized":"2024-09-15T22:23:01.825492+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:45:14.877713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.787767+0000","last_change":"2024-09-15T22:22:50.776507+0000","last_active":"2024-09-15T22:22:51.787767+0000","last_peered":"2024-09-15T22:22:51.787767+0000","last_clean":"2024-09-15T22:22:51.787767+0000","last_became_active":"2024-09-15T22:22:50.774508+0000","last_became_peered":"2024-09-15T22:22:50.774508+0000","last_unstale":"2024-09-15T22:22:51.787767+0000","last_undegraded":"2024-09-15T22:22:51.787767+0000","last_fullsized":"2024-09-15T22:22:51.787767+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:07:51.335655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:01.826000+0000","last_change":"2024-09-15T22:22:48.388864+0000","last_active":"2024-09-15T22:23:01.826000+0000","last_peered":"2024-09-15T22:23:01.826000+0000","last_clean":"2024-09-15T22:23:01.826000+0000","last_became_active":"2024-09-15T22:22:48.388576+0000","last_became_peered":"2024-09-15T22:22:48.388576+0000","last_unstale":"2024-09-15T22:23:01.826000+0000","last_undegraded":"2024-09-15T22:23:01.826000+0000","last_fullsized":"2024-09-15T22:23:01.826000+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:19:44.416306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.787177+0000","last_change":"2024-09-15T22:22:50.783189+0000","last_active":"2024-09-15T22:22:51.787177+0000","last_peered":"2024-09-15T22:22:51.787177+0000","last_clean":"2024-09-15T22:22:51.787177+0000","last_became_active":"2024-09-15T22:22:50.782790+0000","last_became_peered":"2024-09-15T22:22:50.782790+0000","last_unstale":"2024-09-15T22:22:51.787177+0000","last_undegraded":"2024-09-15T22:22:51.787177+0000","last_fullsized":"2024-09-15T22:22:51.787177+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:12.650413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'25","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:18.868937+0000","last_change":"2024-09-15T22:22:48.336216+0000","last_active":"2024-09-15T22:23:18.868937+0000","last_peered":"2024-09-15T22:23:18.868937+0000","last_clean":"2024-09-15T22:23:18.868937+0000","last_became_active":"2024-09-15T22:22:48.334958+0000","last_became_peered":"2024-09-15T22:22:48.334958+0000","last_unstale":"2024-09-15T22:23:18.868937+0000","last_undegraded":"2024-09-15T22:23:18.868937+0000","last_fullsized":"2024-09-15T22:23:18.868937+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:58:31.990060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50112,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":66,"num_write":26,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.786256+0000","last_change":"2024-09-15T22:22:50.773996+0000","last_active":"2024-09-15T22:22:51.786256+0000","last_peered":"2024-09-15T22:22:51.786256+0000","last_clean":"2024-09-15T22:22:51.786256+0000","last_became_active":"2024-09-15T22:22:50.773651+0000","last_became_peered":"2024-09-15T22:22:50.773651+0000","last_unstale":"2024-09-15T22:22:51.786256+0000","last_undegraded":"2024-09-15T22:22:51.786256+0000","last_fullsized":"2024-09-15T22:22:51.786256+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:16.876455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:02.834564+0000","last_change":"2024-09-15T22:22:48.336138+0000","last_active":"2024-09-15T22:23:02.834564+0000","last_peered":"2024-09-15T22:23:02.834564+0000","last_clean":"2024-09-15T22:23:02.834564+0000","last_became_active":"2024-09-15T22:22:48.335538+0000","last_became_peered":"2024-09-15T22:22:48.335538+0000","last_unstale":"2024-09-15T22:23:02.834564+0000","last_undegraded":"2024-09-15T22:23:02.834564+0000","last_fullsized":"2024-09-15T22:23:02.834564+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:12.917499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.783815+0000","last_change":"2024-09-15T22:22:50.787247+0000","last_active":"2024-09-15T22:22:51.783815+0000","last_peered":"2024-09-15T22:22:51.783815+0000","last_clean":"2024-09-15T22:22:51.783815+0000","last_became_active":"2024-09-15T22:22:50.786880+0000","last_became_peered":"2024-09-15T22:22:50.786880+0000","last_unstale":"2024-09-15T22:22:51.783815+0000","last_undegraded":"2024-09-15T22:22:51.783815+0000","last_fullsized":"2024-09-15T22:22:51.783815+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:02.648581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:01.825273+0000","last_change":"2024-09-15T22:22:48.335633+0000","last_active":"2024-09-15T22:23:01.825273+0000","last_peered":"2024-09-15T22:23:01.825273+0000","last_clean":"2024-09-15T22:23:01.825273+0000","last_became_active":"2024-09-15T22:22:48.335354+0000","last_became_peered":"2024-09-15T22:22:48.335354+0000","last_unstale":"2024-09-15T22:23:01.825273+0000","last_undegraded":"2024-09-15T22:23:01.825273+0000","last_fullsized":"2024-09-15T22:23:01.825273+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:01:24.009614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.783672+0000","last_change":"2024-09-15T22:22:50.777583+0000","last_active":"2024-09-15T22:22:51.783672+0000","last_peered":"2024-09-15T22:22:51.783672+0000","last_clean":"2024-09-15T22:22:51.783672+0000","last_became_active":"2024-09-15T22:22:50.777235+0000","last_became_peered":"2024-09-15T22:22:50.777235+0000","last_unstale":"2024-09-15T22:22:51.783672+0000","last_undegraded":"2024-09-15T22:22:51.783672+0000","last_fullsized":"2024-09-15T22:22:51.783672+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:28:48.449725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'4","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:19.867415+0000","last_change":"2024-09-15T22:22:48.338517+0000","last_active":"2024-09-15T22:23:19.867415+0000","last_peered":"2024-09-15T22:23:19.867415+0000","last_clean":"2024-09-15T22:23:19.867415+0000","last_became_active":"2024-09-15T22:22:48.338159+0000","last_became_peered":"2024-09-15T22:22:48.338159+0000","last_unstale":"2024-09-15T22:23:19.867415+0000","last_undegraded":"2024-09-15T22:23:19.867415+0000","last_fullsized":"2024-09-15T22:23:19.867415+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:48:14.792180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.783536+0000","last_change":"2024-09-15T22:22:50.776455+0000","last_active":"2024-09-15T22:22:51.783536+0000","last_peered":"2024-09-15T22:22:51.783536+0000","last_clean":"2024-09-15T22:22:51.783536+0000","last_became_active":"2024-09-15T22:22:50.776049+0000","last_became_peered":"2024-09-15T22:22:50.776049+0000","last_unstale":"2024-09-15T22:22:51.783536+0000","last_undegraded":"2024-09-15T22:22:51.783536+0000","last_fullsized":"2024-09-15T22:22:51.783536+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:32:01.675470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:02.835966+0000","last_change":"2024-09-15T22:22:48.387333+0000","last_active":"2024-09-15T22:23:02.835966+0000","last_peered":"2024-09-15T22:23:02.835966+0000","last_clean":"2024-09-15T22:23:02.835966+0000","last_became_active":"2024-09-15T22:22:48.386669+0000","last_became_peered":"2024-09-15T22:22:48.386669+0000","last_unstale":"2024-09-15T22:23:02.835966+0000","last_undegraded":"2024-09-15T22:23:02.835966+0000","last_fullsized":"2024-09-15T22:23:02.835966+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:57.310653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.782771+0000","last_change":"2024-09-15T22:22:50.782530+0000","last_active":"2024-09-15T22:22:51.782771+0000","last_peered":"2024-09-15T22:22:51.782771+0000","last_clean":"2024-09-15T22:22:51.782771+0000","last_became_active":"2024-09-15T22:22:50.782201+0000","last_became_peered":"2024-09-15T22:22:50.782201+0000","last_unstale":"2024-09-15T22:22:51.782771+0000","last_undegraded":"2024-09-15T22:22:51.782771+0000","last_fullsized":"2024-09-15T22:22:51.782771+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:05.652843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:04.831088+0000","last_change":"2024-09-15T22:22:48.330909+0000","last_active":"2024-09-15T22:23:04.831088+0000","last_peered":"2024-09-15T22:23:04.831088+0000","last_clean":"2024-09-15T22:23:04.831088+0000","last_became_active":"2024-09-15T22:22:48.330603+0000","last_became_peered":"2024-09-15T22:22:48.330603+0000","last_unstale":"2024-09-15T22:23:04.831088+0000","last_undegraded":"2024-09-15T22:23:04.831088+0000","last_fullsized":"2024-09-15T22:23:04.831088+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:32:41.489246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.770312+0000","last_change":"2024-09-15T22:22:50.776404+0000","last_active":"2024-09-15T22:22:51.770312+0000","last_peered":"2024-09-15T22:22:51.770312+0000","last_clean":"2024-09-15T22:22:51.770312+0000","last_became_active":"2024-09-15T22:22:50.776014+0000","last_became_peered":"2024-09-15T22:22:50.776014+0000","last_unstale":"2024-09-15T22:22:51.770312+0000","last_undegraded":"2024-09-15T22:22:51.770312+0000","last_fullsized":"2024-09-15T22:22:51.770312+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:56.644834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.787464+0000","last_change":"2024-09-15T22:22:48.333019+0000","last_active":"2024-09-15T22:22:51.787464+0000","last_peered":"2024-09-15T22:22:51.787464+0000","last_clean":"2024-09-15T22:22:51.787464+0000","last_became_active":"2024-09-15T22:22:48.332669+0000","last_became_peered":"2024-09-15T22:22:48.332669+0000","last_unstale":"2024-09-15T22:22:51.787464+0000","last_undegraded":"2024-09-15T22:22:51.787464+0000","last_fullsized":"2024-09-15T22:22:51.787464+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:36.415483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.784378+0000","last_change":"2024-09-15T22:22:50.774131+0000","last_active":"2024-09-15T22:22:51.784378+0000","last_peered":"2024-09-15T22:22:51.784378+0000","last_clean":"2024-09-15T22:22:51.784378+0000","last_became_active":"2024-09-15T22:22:50.773783+0000","last_became_peered":"2024-09-15T22:22:50.773783+0000","last_unstale":"2024-09-15T22:22:51.784378+0000","last_undegraded":"2024-09-15T22:22:51.784378+0000","last_fullsized":"2024-09-15T22:22:51.784378+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:21:57.459883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.785948+0000","last_change":"2024-09-15T22:22:48.337317+0000","last_active":"2024-09-15T22:22:51.785948+0000","last_peered":"2024-09-15T22:22:51.785948+0000","last_clean":"2024-09-15T22:22:51.785948+0000","last_became_active":"2024-09-15T22:22:48.337004+0000","last_became_peered":"2024-09-15T22:22:48.337004+0000","last_unstale":"2024-09-15T22:22:51.785948+0000","last_undegraded":"2024-09-15T22:22:51.785948+0000","last_fullsized":"2024-09-15T22:22:51.785948+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:09.385389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.783820+0000","last_change":"2024-09-15T22:22:50.785360+0000","last_active":"2024-09-15T22:22:51.783820+0000","last_peered":"2024-09-15T22:22:51.783820+0000","last_clean":"2024-09-15T22:22:51.783820+0000","last_became_active":"2024-09-15T22:22:50.785041+0000","last_became_peered":"2024-09-15T22:22:50.785041+0000","last_unstale":"2024-09-15T22:22:51.783820+0000","last_undegraded":"2024-09-15T22:22:51.783820+0000","last_fullsized":"2024-09-15T22:22:51.783820+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:18.173219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:02.836355+0000","last_change":"2024-09-15T22:22:48.387680+0000","last_active":"2024-09-15T22:23:02.836355+0000","last_peered":"2024-09-15T22:23:02.836355+0000","last_clean":"2024-09-15T22:23:02.836355+0000","last_became_active":"2024-09-15T22:22:48.387345+0000","last_became_peered":"2024-09-15T22:22:48.387345+0000","last_unstale":"2024-09-15T22:23:02.836355+0000","last_undegraded":"2024-09-15T22:23:02.836355+0000","last_fullsized":"2024-09-15T22:23:02.836355+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:01:12.814275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.784065+0000","last_change":"2024-09-15T22:22:50.781268+0000","last_active":"2024-09-15T22:22:51.784065+0000","last_peered":"2024-09-15T22:22:51.784065+0000","last_clean":"2024-09-15T22:22:51.784065+0000","last_became_active":"2024-09-15T22:22:50.780949+0000","last_became_peered":"2024-09-15T22:22:50.780949+0000","last_unstale":"2024-09-15T22:22:51.784065+0000","last_undegraded":"2024-09-15T22:22:51.784065+0000","last_fullsized":"2024-09-15T22:22:51.784065+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:55:46.107326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":331,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.783920+0000","last_change":"2024-09-15T22:21:33.463741+0000","last_active":"2024-09-15T22:22:51.783920+0000","last_peered":"2024-09-15T22:22:51.783920+0000","last_clean":"2024-09-15T22:22:51.783920+0000","last_became_active":"2024-09-15T22:21:33.463177+0000","last_became_peered":"2024-09-15T22:21:33.463177+0000","last_unstale":"2024-09-15T22:22:51.783920+0000","last_undegraded":"2024-09-15T22:22:51.783920+0000","last_fullsized":"2024-09-15T22:22:51.783920+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:17:56.109541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:17:56.109541+0000","last_clean_scrub_stamp":"2024-09-15T22:17:56.109541+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:43.974077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:04.842584+0000","last_change":"2024-09-15T22:22:48.337556+0000","last_active":"2024-09-15T22:23:04.842584+0000","last_peered":"2024-09-15T22:23:04.842584+0000","last_clean":"2024-09-15T22:23:04.842584+0000","last_became_active":"2024-09-15T22:22:48.337163+0000","last_became_peered":"2024-09-15T22:22:48.337163+0000","last_unstale":"2024-09-15T22:23:04.842584+0000","last_undegraded":"2024-09-15T22:23:04.842584+0000","last_fullsized":"2024-09-15T22:23:04.842584+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:57.087797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.786294+0000","last_change":"2024-09-15T22:22:50.778807+0000","last_active":"2024-09-15T22:22:51.786294+0000","last_peered":"2024-09-15T22:22:51.786294+0000","last_clean":"2024-09-15T22:22:51.786294+0000","last_became_active":"2024-09-15T22:22:50.778515+0000","last_became_peered":"2024-09-15T22:22:50.778515+0000","last_unstale":"2024-09-15T22:22:51.786294+0000","last_undegraded":"2024-09-15T22:22:51.786294+0000","last_fullsized":"2024-09-15T22:22:51.786294+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:15:40.969573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:02.833723+0000","last_change":"2024-09-15T22:22:48.332525+0000","last_active":"2024-09-15T22:23:02.833723+0000","last_peered":"2024-09-15T22:23:02.833723+0000","last_clean":"2024-09-15T22:23:02.833723+0000","last_became_active":"2024-09-15T22:22:48.331615+0000","last_became_peered":"2024-09-15T22:22:48.331615+0000","last_unstale":"2024-09-15T22:23:02.833723+0000","last_undegraded":"2024-09-15T22:23:02.833723+0000","last_fullsized":"2024-09-15T22:23:02.833723+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:47:00.012013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.783300+0000","last_change":"2024-09-15T22:22:50.778422+0000","last_active":"2024-09-15T22:22:51.783300+0000","last_peered":"2024-09-15T22:22:51.783300+0000","last_clean":"2024-09-15T22:22:51.783300+0000","last_became_active":"2024-09-15T22:22:50.777549+0000","last_became_peered":"2024-09-15T22:22:50.777549+0000","last_unstale":"2024-09-15T22:22:51.783300+0000","last_undegraded":"2024-09-15T22:22:51.783300+0000","last_fullsized":"2024-09-15T22:22:51.783300+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:30:03.130474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:18.865583+0000","last_change":"2024-09-15T22:22:48.387992+0000","last_active":"2024-09-15T22:23:18.865583+0000","last_peered":"2024-09-15T22:23:18.865583+0000","last_clean":"2024-09-15T22:23:18.865583+0000","last_became_active":"2024-09-15T22:22:48.386645+0000","last_became_peered":"2024-09-15T22:22:48.386645+0000","last_unstale":"2024-09-15T22:23:18.865583+0000","last_undegraded":"2024-09-15T22:23:18.865583+0000","last_fullsized":"2024-09-15T22:23:18.865583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:00.893946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.782910+0000","last_change":"2024-09-15T22:22:50.778939+0000","last_active":"2024-09-15T22:22:51.782910+0000","last_peered":"2024-09-15T22:22:51.782910+0000","last_clean":"2024-09-15T22:22:51.782910+0000","last_became_active":"2024-09-15T22:22:50.778620+0000","last_became_peered":"2024-09-15T22:22:50.778620+0000","last_unstale":"2024-09-15T22:22:51.782910+0000","last_undegraded":"2024-09-15T22:22:51.782910+0000","last_fullsized":"2024-09-15T22:22:51.782910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:16:28.957377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.784560+0000","last_change":"2024-09-15T22:22:48.334598+0000","last_active":"2024-09-15T22:22:51.784560+0000","last_peered":"2024-09-15T22:22:51.784560+0000","last_clean":"2024-09-15T22:22:51.784560+0000","last_became_active":"2024-09-15T22:22:48.333022+0000","last_became_peered":"2024-09-15T22:22:48.333022+0000","last_unstale":"2024-09-15T22:22:51.784560+0000","last_undegraded":"2024-09-15T22:22:51.784560+0000","last_fullsized":"2024-09-15T22:22:51.784560+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:28.577791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.782710+0000","last_change":"2024-09-15T22:22:50.777045+0000","last_active":"2024-09-15T22:22:51.782710+0000","last_peered":"2024-09-15T22:22:51.782710+0000","last_clean":"2024-09-15T22:22:51.782710+0000","last_became_active":"2024-09-15T22:22:50.776677+0000","last_became_peered":"2024-09-15T22:22:50.776677+0000","last_unstale":"2024-09-15T22:22:51.782710+0000","last_undegraded":"2024-09-15T22:22:51.782710+0000","last_fullsized":"2024-09-15T22:22:51.782710+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:24.946214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.766928+0000","last_change":"2024-09-15T22:22:48.387707+0000","last_active":"2024-09-15T22:22:51.766928+0000","last_peered":"2024-09-15T22:22:51.766928+0000","last_clean":"2024-09-15T22:22:51.766928+0000","last_became_active":"2024-09-15T22:22:48.387323+0000","last_became_peered":"2024-09-15T22:22:48.387323+0000","last_unstale":"2024-09-15T22:22:51.766928+0000","last_undegraded":"2024-09-15T22:22:51.766928+0000","last_fullsized":"2024-09-15T22:22:51.766928+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:43.430648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:54.464841+0000","last_change":"2024-09-15T22:22:50.775365+0000","last_active":"2024-09-15T22:22:54.464841+0000","last_peered":"2024-09-15T22:22:54.464841+0000","last_clean":"2024-09-15T22:22:54.464841+0000","last_became_active":"2024-09-15T22:22:50.774988+0000","last_became_peered":"2024-09-15T22:22:50.774988+0000","last_unstale":"2024-09-15T22:22:54.464841+0000","last_undegraded":"2024-09-15T22:22:54.464841+0000","last_fullsized":"2024-09-15T22:22:54.464841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:32:33.268976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:01.825837+0000","last_change":"2024-09-15T22:22:48.387142+0000","last_active":"2024-09-15T22:23:01.825837+0000","last_peered":"2024-09-15T22:23:01.825837+0000","last_clean":"2024-09-15T22:23:01.825837+0000","last_became_active":"2024-09-15T22:22:48.386669+0000","last_became_peered":"2024-09-15T22:22:48.386669+0000","last_unstale":"2024-09-15T22:23:01.825837+0000","last_undegraded":"2024-09-15T22:23:01.825837+0000","last_fullsized":"2024-09-15T22:23:01.825837+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:01.590592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.784617+0000","last_change":"2024-09-15T22:22:50.788723+0000","last_active":"2024-09-15T22:22:51.784617+0000","last_peered":"2024-09-15T22:22:51.784617+0000","last_clean":"2024-09-15T22:22:51.784617+0000","last_became_active":"2024-09-15T22:22:50.786767+0000","last_became_peered":"2024-09-15T22:22:50.786767+0000","last_unstale":"2024-09-15T22:22:51.784617+0000","last_undegraded":"2024-09-15T22:22:51.784617+0000","last_fullsized":"2024-09-15T22:22:51.784617+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:10:54.859140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'8","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:16.782318+0000","last_change":"2024-09-15T22:22:48.329971+0000","last_active":"2024-09-15T22:23:16.782318+0000","last_peered":"2024-09-15T22:23:16.782318+0000","last_clean":"2024-09-15T22:23:16.782318+0000","last_became_active":"2024-09-15T22:22:48.329526+0000","last_became_peered":"2024-09-15T22:22:48.329526+0000","last_unstale":"2024-09-15T22:23:16.782318+0000","last_undegraded":"2024-09-15T22:23:16.782318+0000","last_fullsized":"2024-09-15T22:23:16.782318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:53.665784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.788255+0000","last_change":"2024-09-15T22:22:50.778281+0000","last_active":"2024-09-15T22:22:51.788255+0000","last_peered":"2024-09-15T22:22:51.788255+0000","last_clean":"2024-09-15T22:22:51.788255+0000","last_became_active":"2024-09-15T22:22:50.777969+0000","last_became_peered":"2024-09-15T22:22:50.777969+0000","last_unstale":"2024-09-15T22:22:51.788255+0000","last_undegraded":"2024-09-15T22:22:51.788255+0000","last_fullsized":"2024-09-15T22:22:51.788255+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:25:04.566350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:01.825500+0000","last_change":"2024-09-15T22:22:48.370056+0000","last_active":"2024-09-15T22:23:01.825500+0000","last_peered":"2024-09-15T22:23:01.825500+0000","last_clean":"2024-09-15T22:23:01.825500+0000","last_became_active":"2024-09-15T22:22:48.369729+0000","last_became_peered":"2024-09-15T22:22:48.369729+0000","last_unstale":"2024-09-15T22:23:01.825500+0000","last_undegraded":"2024-09-15T22:23:01.825500+0000","last_fullsized":"2024-09-15T22:23:01.825500+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:43.894706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.787482+0000","last_change":"2024-09-15T22:22:50.785270+0000","last_active":"2024-09-15T22:22:51.787482+0000","last_peered":"2024-09-15T22:22:51.787482+0000","last_clean":"2024-09-15T22:22:51.787482+0000","last_became_active":"2024-09-15T22:22:50.785035+0000","last_became_peered":"2024-09-15T22:22:50.785035+0000","last_unstale":"2024-09-15T22:22:51.787482+0000","last_undegraded":"2024-09-15T22:22:51.787482+0000","last_fullsized":"2024-09-15T22:22:51.787482+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:58.505722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:01.826737+0000","last_change":"2024-09-15T22:22:48.387181+0000","last_active":"2024-09-15T22:23:01.826737+0000","last_peered":"2024-09-15T22:23:01.826737+0000","last_clean":"2024-09-15T22:23:01.826737+0000","last_became_active":"2024-09-15T22:22:48.386792+0000","last_became_peered":"2024-09-15T22:22:48.386792+0000","last_unstale":"2024-09-15T22:23:01.826737+0000","last_undegraded":"2024-09-15T22:23:01.826737+0000","last_fullsized":"2024-09-15T22:23:01.826737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:25.362961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.782329+0000","last_change":"2024-09-15T22:22:50.774054+0000","last_active":"2024-09-15T22:22:51.782329+0000","last_peered":"2024-09-15T22:22:51.782329+0000","last_clean":"2024-09-15T22:22:51.782329+0000","last_became_active":"2024-09-15T22:22:50.773686+0000","last_became_peered":"2024-09-15T22:22:50.773686+0000","last_unstale":"2024-09-15T22:22:51.782329+0000","last_undegraded":"2024-09-15T22:22:51.782329+0000","last_fullsized":"2024-09-15T22:22:51.782329+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:34.512814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:01.827753+0000","last_change":"2024-09-15T22:22:48.337042+0000","last_active":"2024-09-15T22:23:01.827753+0000","last_peered":"2024-09-15T22:23:01.827753+0000","last_clean":"2024-09-15T22:23:01.827753+0000","last_became_active":"2024-09-15T22:22:48.336648+0000","last_became_peered":"2024-09-15T22:22:48.336648+0000","last_unstale":"2024-09-15T22:23:01.827753+0000","last_undegraded":"2024-09-15T22:23:01.827753+0000","last_fullsized":"2024-09-15T22:23:01.827753+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:14:09.777606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.770208+0000","last_change":"2024-09-15T22:22:50.774012+0000","last_active":"2024-09-15T22:22:51.770208+0000","last_peered":"2024-09-15T22:22:51.770208+0000","last_clean":"2024-09-15T22:22:51.770208+0000","last_became_active":"2024-09-15T22:22:50.773442+0000","last_became_peered":"2024-09-15T22:22:50.773442+0000","last_unstale":"2024-09-15T22:22:51.770208+0000","last_undegraded":"2024-09-15T22:22:51.770208+0000","last_fullsized":"2024-09-15T22:22:51.770208+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:29.980429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.784449+0000","last_change":"2024-09-15T22:22:48.335817+0000","last_active":"2024-09-15T22:22:51.784449+0000","last_peered":"2024-09-15T22:22:51.784449+0000","last_clean":"2024-09-15T22:22:51.784449+0000","last_became_active":"2024-09-15T22:22:48.335307+0000","last_became_peered":"2024-09-15T22:22:48.335307+0000","last_unstale":"2024-09-15T22:22:51.784449+0000","last_undegraded":"2024-09-15T22:22:51.784449+0000","last_fullsized":"2024-09-15T22:22:51.784449+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:27.297866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.787644+0000","last_change":"2024-09-15T22:22:50.782798+0000","last_active":"2024-09-15T22:22:51.787644+0000","last_peered":"2024-09-15T22:22:51.787644+0000","last_clean":"2024-09-15T22:22:51.787644+0000","last_became_active":"2024-09-15T22:22:50.782316+0000","last_became_peered":"2024-09-15T22:22:50.782316+0000","last_unstale":"2024-09-15T22:22:51.787644+0000","last_undegraded":"2024-09-15T22:22:51.787644+0000","last_fullsized":"2024-09-15T22:22:51.787644+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:35:26.104790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:01.825969+0000","last_change":"2024-09-15T22:22:48.332485+0000","last_active":"2024-09-15T22:23:01.825969+0000","last_peered":"2024-09-15T22:23:01.825969+0000","last_clean":"2024-09-15T22:23:01.825969+0000","last_became_active":"2024-09-15T22:22:48.332158+0000","last_became_peered":"2024-09-15T22:22:48.332158+0000","last_unstale":"2024-09-15T22:23:01.825969+0000","last_undegraded":"2024-09-15T22:23:01.825969+0000","last_fullsized":"2024-09-15T22:23:01.825969+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:20.947915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.784260+0000","last_change":"2024-09-15T22:22:50.781961+0000","last_active":"2024-09-15T22:22:51.784260+0000","last_peered":"2024-09-15T22:22:51.784260+0000","last_clean":"2024-09-15T22:22:51.784260+0000","last_became_active":"2024-09-15T22:22:50.781622+0000","last_became_peered":"2024-09-15T22:22:50.781622+0000","last_unstale":"2024-09-15T22:22:51.784260+0000","last_undegraded":"2024-09-15T22:22:51.784260+0000","last_fullsized":"2024-09-15T22:22:51.784260+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:57.848953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.782869+0000","last_change":"2024-09-15T22:22:50.781337+0000","last_active":"2024-09-15T22:22:51.782869+0000","last_peered":"2024-09-15T22:22:51.782869+0000","last_clean":"2024-09-15T22:22:51.782869+0000","last_became_active":"2024-09-15T22:22:50.780956+0000","last_became_peered":"2024-09-15T22:22:50.780956+0000","last_unstale":"2024-09-15T22:22:51.782869+0000","last_undegraded":"2024-09-15T22:22:51.782869+0000","last_fullsized":"2024-09-15T22:22:51.782869+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:27.447614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.791002+0000","last_change":"2024-09-15T22:22:48.329098+0000","last_active":"2024-09-15T22:22:51.791002+0000","last_peered":"2024-09-15T22:22:51.791002+0000","last_clean":"2024-09-15T22:22:51.791002+0000","last_became_active":"2024-09-15T22:22:48.328755+0000","last_became_peered":"2024-09-15T22:22:48.328755+0000","last_unstale":"2024-09-15T22:22:51.791002+0000","last_undegraded":"2024-09-15T22:22:51.791002+0000","last_fullsized":"2024-09-15T22:22:51.791002+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:31.197422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.787154+0000","last_change":"2024-09-15T22:22:50.778437+0000","last_active":"2024-09-15T22:22:51.787154+0000","last_peered":"2024-09-15T22:22:51.787154+0000","last_clean":"2024-09-15T22:22:51.787154+0000","last_became_active":"2024-09-15T22:22:50.776847+0000","last_became_peered":"2024-09-15T22:22:50.776847+0000","last_unstale":"2024-09-15T22:22:51.787154+0000","last_undegraded":"2024-09-15T22:22:51.787154+0000","last_fullsized":"2024-09-15T22:22:51.787154+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:56.740028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:02.833416+0000","last_change":"2024-09-15T22:22:48.331965+0000","last_active":"2024-09-15T22:23:02.833416+0000","last_peered":"2024-09-15T22:23:02.833416+0000","last_clean":"2024-09-15T22:23:02.833416+0000","last_became_active":"2024-09-15T22:22:48.331652+0000","last_became_peered":"2024-09-15T22:22:48.331652+0000","last_unstale":"2024-09-15T22:23:02.833416+0000","last_undegraded":"2024-09-15T22:23:02.833416+0000","last_fullsized":"2024-09-15T22:23:02.833416+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:39.232097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.787619+0000","last_change":"2024-09-15T22:22:50.778091+0000","last_active":"2024-09-15T22:22:51.787619+0000","last_peered":"2024-09-15T22:22:51.787619+0000","last_clean":"2024-09-15T22:22:51.787619+0000","last_became_active":"2024-09-15T22:22:50.777782+0000","last_became_peered":"2024-09-15T22:22:50.777782+0000","last_unstale":"2024-09-15T22:22:51.787619+0000","last_undegraded":"2024-09-15T22:22:51.787619+0000","last_fullsized":"2024-09-15T22:22:51.787619+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:14:30.221629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.790651+0000","last_change":"2024-09-15T22:22:48.387133+0000","last_active":"2024-09-15T22:22:51.790651+0000","last_peered":"2024-09-15T22:22:51.790651+0000","last_clean":"2024-09-15T22:22:51.790651+0000","last_became_active":"2024-09-15T22:22:48.386796+0000","last_became_peered":"2024-09-15T22:22:48.386796+0000","last_unstale":"2024-09-15T22:22:51.790651+0000","last_undegraded":"2024-09-15T22:22:51.790651+0000","last_fullsized":"2024-09-15T22:22:51.790651+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:18:24.267326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.788042+0000","last_change":"2024-09-15T22:22:50.780869+0000","last_active":"2024-09-15T22:22:51.788042+0000","last_peered":"2024-09-15T22:22:51.788042+0000","last_clean":"2024-09-15T22:22:51.788042+0000","last_became_active":"2024-09-15T22:22:50.780411+0000","last_became_peered":"2024-09-15T22:22:50.780411+0000","last_unstale":"2024-09-15T22:22:51.788042+0000","last_undegraded":"2024-09-15T22:22:51.788042+0000","last_fullsized":"2024-09-15T22:22:51.788042+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:38:05.410234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:02.836276+0000","last_change":"2024-09-15T22:22:48.332789+0000","last_active":"2024-09-15T22:23:02.836276+0000","last_peered":"2024-09-15T22:23:02.836276+0000","last_clean":"2024-09-15T22:23:02.836276+0000","last_became_active":"2024-09-15T22:22:48.332165+0000","last_became_peered":"2024-09-15T22:22:48.332165+0000","last_unstale":"2024-09-15T22:23:02.836276+0000","last_undegraded":"2024-09-15T22:23:02.836276+0000","last_fullsized":"2024-09-15T22:23:02.836276+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:44:07.190316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":54508,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":121,"num_read_kb":117,"num_write":155,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":163524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514515,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":423386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28560,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716592,"statfs":{"total":95995035648,"available":95965790208,"internally_reserved":0,"allocated":1572864,"data_stored":1065372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906973,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":423622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135908,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":423542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364839,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32644,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712508,"statfs":{"total":95995035648,"available":95961608192,"internally_reserved":0,"allocated":1495040,"data_stored":1015867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528364,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":423011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757299,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28496,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716656,"statfs":{"total":95995035648,"available":95965855744,"internally_reserved":0,"allocated":1507328,"data_stored":1015158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920824,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":892928,"data_stored":423841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149756,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":905216,"data_stored":423322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411395,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":474659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32104,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713048,"statfs":{"total":95995035648,"available":95962161152,"internally_reserved":0,"allocated":942080,"data_stored":472916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738445,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":424282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":50112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":51855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":52083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:23:24.950 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T22:23:25.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:24 smithi012 ceph-mon[34883]: pgmap v308: 97 pgs: 97 active+clean; 630 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 KiB/s wr, 7 op/s 2024-09-15T22:23:25.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:24 smithi012 ceph-mon[34883]: from='client.24644 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:23:25.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:24 smithi098 ceph-mon[35514]: pgmap v308: 97 pgs: 97 active+clean; 630 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 KiB/s wr, 7 op/s 2024-09-15T22:23:25.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:24 smithi098 ceph-mon[35514]: from='client.24644 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:23:25.327 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:25.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:24 smithi001 ceph-mon[30843]: pgmap v308: 97 pgs: 97 active+clean; 630 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 KiB/s wr, 7 op/s 2024-09-15T22:23:25.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:24 smithi001 ceph-mon[30843]: from='client.24644 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:23:25.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.897+0000 7efc20e00640 1 -- 172.21.15.1:0/3830761004 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc1c103ff0 msgr2=0x7efc1c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:25.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.897+0000 7efc20e00640 1 --2- 172.21.15.1:0/3830761004 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc1c103ff0 0x7efc1c1043d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efc0c009900 tx=0x7efc0c02a3f0 comp rx=0 tx=0).stop 2024-09-15T22:23:25.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.897+0000 7efc20e00640 1 -- 172.21.15.1:0/3830761004 shutdown_connections 2024-09-15T22:23:25.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.897+0000 7efc20e00640 1 --2- 172.21.15.1:0/3830761004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc1c109120 0x7efc1c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:25.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.897+0000 7efc20e00640 1 --2- 172.21.15.1:0/3830761004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc1c1049a0 0x7efc1c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:25.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.897+0000 7efc20e00640 1 --2- 172.21.15.1:0/3830761004 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc1c103ff0 0x7efc1c1043d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:25.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.897+0000 7efc20e00640 1 -- 172.21.15.1:0/3830761004 >> 172.21.15.1:0/3830761004 conn(0x7efc1c0ffa90 msgr2=0x7efc1c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:25.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.897+0000 7efc20e00640 1 -- 172.21.15.1:0/3830761004 shutdown_connections 2024-09-15T22:23:25.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.897+0000 7efc20e00640 1 -- 172.21.15.1:0/3830761004 wait complete. 2024-09-15T22:23:25.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.899+0000 7efc20e00640 1 Processor -- start 2024-09-15T22:23:25.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.899+0000 7efc20e00640 1 -- start start 2024-09-15T22:23:25.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.899+0000 7efc20e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc1c103ff0 0x7efc1c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:25.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.899+0000 7efc20e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc1c1049a0 0x7efc1c19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:25.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.899+0000 7efc20e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc1c109120 0x7efc1c19eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:25.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.899+0000 7efc20e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efc1c114140 con 0x7efc1c103ff0 2024-09-15T22:23:25.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.899+0000 7efc20e00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efc1c113fc0 con 0x7efc1c109120 2024-09-15T22:23:25.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.899+0000 7efc20e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efc1c1142c0 con 0x7efc1c1049a0 2024-09-15T22:23:25.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.899+0000 7efc19e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc1c103ff0 0x7efc1c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:25.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.899+0000 7efc19e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc1c103ff0 0x7efc1c19a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47610/0 (socket says 172.21.15.1:47610) 2024-09-15T22:23:25.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.900+0000 7efc19e00640 1 -- 172.21.15.1:0/1363107511 learned_addr learned my addr 172.21.15.1:0/1363107511 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:25.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.900+0000 7efc1a800640 1 --2- 172.21.15.1:0/1363107511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc1c109120 0x7efc1c19eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:25.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.900+0000 7efc19400640 1 --2- 172.21.15.1:0/1363107511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc1c1049a0 0x7efc1c19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:25.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.900+0000 7efc1a800640 1 -- 172.21.15.1:0/1363107511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc1c1049a0 msgr2=0x7efc1c19ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:25.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.900+0000 7efc1a800640 1 --2- 172.21.15.1:0/1363107511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc1c1049a0 0x7efc1c19ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:25.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.900+0000 7efc1a800640 1 -- 172.21.15.1:0/1363107511 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc1c103ff0 msgr2=0x7efc1c19a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:25.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.900+0000 7efc1a800640 1 --2- 172.21.15.1:0/1363107511 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc1c103ff0 0x7efc1c19a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:25.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.900+0000 7efc1a800640 1 -- 172.21.15.1:0/1363107511 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc1c19f5b0 con 0x7efc1c109120 2024-09-15T22:23:25.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.900+0000 7efc19e00640 1 --2- 172.21.15.1:0/1363107511 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc1c103ff0 0x7efc1c19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:23:25.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.900+0000 7efc1a800640 1 --2- 172.21.15.1:0/1363107511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc1c109120 0x7efc1c19eed0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efc1400ec50 tx=0x7efc1400c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:25.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.900+0000 7efc12a00640 1 -- 172.21.15.1:0/1363107511 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc14003b70 con 0x7efc1c109120 2024-09-15T22:23:25.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.900+0000 7efc12a00640 1 -- 172.21.15.1:0/1363107511 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc14003d10 con 0x7efc1c109120 2024-09-15T22:23:25.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.900+0000 7efc20e00640 1 -- 172.21.15.1:0/1363107511 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc1c19f8a0 con 0x7efc1c109120 2024-09-15T22:23:25.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.900+0000 7efc12a00640 1 -- 172.21.15.1:0/1363107511 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc14010890 con 0x7efc1c109120 2024-09-15T22:23:25.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.901+0000 7efc20e00640 1 -- 172.21.15.1:0/1363107511 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc1c1a7180 con 0x7efc1c109120 2024-09-15T22:23:25.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.902+0000 7efc20e00640 1 -- 172.21.15.1:0/1363107511 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc1c1043d0 con 0x7efc1c109120 2024-09-15T22:23:25.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.904+0000 7efc12a00640 1 -- 172.21.15.1:0/1363107511 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7efc14003fc0 con 0x7efc1c109120 2024-09-15T22:23:25.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.905+0000 7efc12a00640 1 --2- 172.21.15.1:0/1363107511 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7efc000a3350 0x7efc000a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:25.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.905+0000 7efc12a00640 1 -- 172.21.15.1:0/1363107511 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7efc140cfee0 con 0x7efc1c109120 2024-09-15T22:23:25.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.905+0000 7efc19e00640 1 --2- 172.21.15.1:0/1363107511 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7efc000a3350 0x7efc000a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:25.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.906+0000 7efc19e00640 1 --2- 172.21.15.1:0/1363107511 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7efc000a3350 0x7efc000a5810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efc0c0096c0 tx=0x7efc0c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:25.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:25.909+0000 7efc12a00640 1 -- 172.21.15.1:0/1363107511 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efc1409cb50 con 0x7efc1c109120 2024-09-15T22:23:26.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:26.091+0000 7efc20e00640 1 -- 172.21.15.1:0/1363107511 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efc1c062630 con 0x7efc000a3350 2024-09-15T22:23:26.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:26.098+0000 7efc12a00640 1 -- 172.21.15.1:0/1363107511 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258706 (secure 0 0 0) 0x7efc1c062630 con 0x7efc000a3350 2024-09-15T22:23:26.102 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:23:26.103 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-15T22:23:26.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:26.102+0000 7efc20e00640 1 -- 172.21.15.1:0/1363107511 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7efc000a3350 msgr2=0x7efc000a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:26.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:26.102+0000 7efc20e00640 1 --2- 172.21.15.1:0/1363107511 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7efc000a3350 0x7efc000a5810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efc0c0096c0 tx=0x7efc0c005a20 comp rx=0 tx=0).stop 2024-09-15T22:23:26.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:26.102+0000 7efc20e00640 1 -- 172.21.15.1:0/1363107511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc1c109120 msgr2=0x7efc1c19eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:26.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:26.102+0000 7efc20e00640 1 --2- 172.21.15.1:0/1363107511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc1c109120 0x7efc1c19eed0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efc1400ec50 tx=0x7efc1400c6a0 comp rx=0 tx=0).stop 2024-09-15T22:23:26.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:26.102+0000 7efc20e00640 1 -- 172.21.15.1:0/1363107511 shutdown_connections 2024-09-15T22:23:26.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:26.102+0000 7efc20e00640 1 --2- 172.21.15.1:0/1363107511 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7efc000a3350 0x7efc000a5810 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:26.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:26.102+0000 7efc20e00640 1 --2- 172.21.15.1:0/1363107511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc1c109120 0x7efc1c19eed0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:26.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:26.102+0000 7efc20e00640 1 --2- 172.21.15.1:0/1363107511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc1c1049a0 0x7efc1c19ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:26.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:26.102+0000 7efc20e00640 1 --2- 172.21.15.1:0/1363107511 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc1c103ff0 0x7efc1c19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:26.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:26.102+0000 7efc20e00640 1 -- 172.21.15.1:0/1363107511 >> 172.21.15.1:0/1363107511 conn(0x7efc1c0ffa90 msgr2=0x7efc1c100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:26.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:26.102+0000 7efc20e00640 1 -- 172.21.15.1:0/1363107511 shutdown_connections 2024-09-15T22:23:26.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:26.102+0000 7efc20e00640 1 -- 172.21.15.1:0/1363107511 wait complete. 2024-09-15T22:23:26.925 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:26 smithi001 ceph-mon[30843]: pgmap v309: 97 pgs: 97 active+clean; 634 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.4 KiB/s wr, 10 op/s 2024-09-15T22:23:26.925 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:26 smithi001 ceph-mon[30843]: from='client.24650 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:23:26.927 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2024-09-15T22:23:25.531072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":649367,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":273,"num_read_kb":246,"num_write":343,"num_write_kb":3043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":357564,"kb_used_data":12476,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124584260,"statfs":{"total":1151940427776,"available":1151574282240,"internally_reserved":0,"allocated":12775424,"data_stored":7017492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":353154361},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":52991,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":100,"num_write":35,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002831"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.770496+0000","last_change":"2024-09-15T22:22:50.777000+0000","last_active":"2024-09-15T22:22:51.770496+0000","last_peered":"2024-09-15T22:22:51.770496+0000","last_clean":"2024-09-15T22:22:51.770496+0000","last_became_active":"2024-09-15T22:22:50.776448+0000","last_became_peered":"2024-09-15T22:22:50.776448+0000","last_unstale":"2024-09-15T22:22:51.770496+0000","last_undegraded":"2024-09-15T22:22:51.770496+0000","last_fullsized":"2024-09-15T22:22:51.770496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:20:09.218864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.787284+0000","last_change":"2024-09-15T22:22:50.772294+0000","last_active":"2024-09-15T22:22:51.787284+0000","last_peered":"2024-09-15T22:22:51.787284+0000","last_clean":"2024-09-15T22:22:51.787284+0000","last_became_active":"2024-09-15T22:22:50.771993+0000","last_became_peered":"2024-09-15T22:22:50.771993+0000","last_unstale":"2024-09-15T22:22:51.787284+0000","last_undegraded":"2024-09-15T22:22:51.787284+0000","last_fullsized":"2024-09-15T22:22:51.787284+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:23.770489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.787821+0000","last_change":"2024-09-15T22:22:50.775717+0000","last_active":"2024-09-15T22:22:51.787821+0000","last_peered":"2024-09-15T22:22:51.787821+0000","last_clean":"2024-09-15T22:22:51.787821+0000","last_became_active":"2024-09-15T22:22:50.775405+0000","last_became_peered":"2024-09-15T22:22:50.775405+0000","last_unstale":"2024-09-15T22:22:51.787821+0000","last_undegraded":"2024-09-15T22:22:51.787821+0000","last_fullsized":"2024-09-15T22:22:51.787821+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:28.765207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.770558+0000","last_change":"2024-09-15T22:22:50.786473+0000","last_active":"2024-09-15T22:22:51.770558+0000","last_peered":"2024-09-15T22:22:51.770558+0000","last_clean":"2024-09-15T22:22:51.770558+0000","last_became_active":"2024-09-15T22:22:50.786001+0000","last_became_peered":"2024-09-15T22:22:50.786001+0000","last_unstale":"2024-09-15T22:22:51.770558+0000","last_undegraded":"2024-09-15T22:22:51.770558+0000","last_fullsized":"2024-09-15T22:22:51.770558+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:47.378713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.782976+0000","last_change":"2024-09-15T22:22:50.777784+0000","last_active":"2024-09-15T22:22:51.782976+0000","last_peered":"2024-09-15T22:22:51.782976+0000","last_clean":"2024-09-15T22:22:51.782976+0000","last_became_active":"2024-09-15T22:22:50.777457+0000","last_became_peered":"2024-09-15T22:22:50.777457+0000","last_unstale":"2024-09-15T22:22:51.782976+0000","last_undegraded":"2024-09-15T22:22:51.782976+0000","last_fullsized":"2024-09-15T22:22:51.782976+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:25.106526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.782794+0000","last_change":"2024-09-15T22:22:50.773565+0000","last_active":"2024-09-15T22:22:51.782794+0000","last_peered":"2024-09-15T22:22:51.782794+0000","last_clean":"2024-09-15T22:22:51.782794+0000","last_became_active":"2024-09-15T22:22:50.773208+0000","last_became_peered":"2024-09-15T22:22:50.773208+0000","last_unstale":"2024-09-15T22:22:51.782794+0000","last_undegraded":"2024-09-15T22:22:51.782794+0000","last_fullsized":"2024-09-15T22:22:51.782794+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:07:43.996923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.783577+0000","last_change":"2024-09-15T22:22:50.779699+0000","last_active":"2024-09-15T22:22:51.783577+0000","last_peered":"2024-09-15T22:22:51.783577+0000","last_clean":"2024-09-15T22:22:51.783577+0000","last_became_active":"2024-09-15T22:22:50.779290+0000","last_became_peered":"2024-09-15T22:22:50.779290+0000","last_unstale":"2024-09-15T22:22:51.783577+0000","last_undegraded":"2024-09-15T22:22:51.783577+0000","last_fullsized":"2024-09-15T22:22:51.783577+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:41:21.741094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.784083+0000","last_change":"2024-09-15T22:22:50.786051+0000","last_active":"2024-09-15T22:22:51.784083+0000","last_peered":"2024-09-15T22:22:51.784083+0000","last_clean":"2024-09-15T22:22:51.784083+0000","last_became_active":"2024-09-15T22:22:50.785767+0000","last_became_peered":"2024-09-15T22:22:50.785767+0000","last_unstale":"2024-09-15T22:22:51.784083+0000","last_undegraded":"2024-09-15T22:22:51.784083+0000","last_fullsized":"2024-09-15T22:22:51.784083+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:23:09.849960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.787584+0000","last_change":"2024-09-15T22:22:50.781257+0000","last_active":"2024-09-15T22:22:51.787584+0000","last_peered":"2024-09-15T22:22:51.787584+0000","last_clean":"2024-09-15T22:22:51.787584+0000","last_became_active":"2024-09-15T22:22:50.780470+0000","last_became_peered":"2024-09-15T22:22:50.780470+0000","last_unstale":"2024-09-15T22:22:51.787584+0000","last_undegraded":"2024-09-15T22:22:51.787584+0000","last_fullsized":"2024-09-15T22:22:51.787584+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:46:01.515377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.784062+0000","last_change":"2024-09-15T22:22:50.776481+0000","last_active":"2024-09-15T22:22:51.784062+0000","last_peered":"2024-09-15T22:22:51.784062+0000","last_clean":"2024-09-15T22:22:51.784062+0000","last_became_active":"2024-09-15T22:22:50.775915+0000","last_became_peered":"2024-09-15T22:22:50.775915+0000","last_unstale":"2024-09-15T22:22:51.784062+0000","last_undegraded":"2024-09-15T22:22:51.784062+0000","last_fullsized":"2024-09-15T22:22:51.784062+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:35.923867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.783872+0000","last_change":"2024-09-15T22:22:50.777986+0000","last_active":"2024-09-15T22:22:51.783872+0000","last_peered":"2024-09-15T22:22:51.783872+0000","last_clean":"2024-09-15T22:22:51.783872+0000","last_became_active":"2024-09-15T22:22:50.777624+0000","last_became_peered":"2024-09-15T22:22:50.777624+0000","last_unstale":"2024-09-15T22:22:51.783872+0000","last_undegraded":"2024-09-15T22:22:51.783872+0000","last_fullsized":"2024-09-15T22:22:51.783872+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:07.135073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.770648+0000","last_change":"2024-09-15T22:22:50.786563+0000","last_active":"2024-09-15T22:22:51.770648+0000","last_peered":"2024-09-15T22:22:51.770648+0000","last_clean":"2024-09-15T22:22:51.770648+0000","last_became_active":"2024-09-15T22:22:50.786074+0000","last_became_peered":"2024-09-15T22:22:50.786074+0000","last_unstale":"2024-09-15T22:22:51.770648+0000","last_undegraded":"2024-09-15T22:22:51.770648+0000","last_fullsized":"2024-09-15T22:22:51.770648+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:10:16.804185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.784132+0000","last_change":"2024-09-15T22:22:50.778817+0000","last_active":"2024-09-15T22:22:51.784132+0000","last_peered":"2024-09-15T22:22:51.784132+0000","last_clean":"2024-09-15T22:22:51.784132+0000","last_became_active":"2024-09-15T22:22:50.776127+0000","last_became_peered":"2024-09-15T22:22:50.776127+0000","last_unstale":"2024-09-15T22:22:51.784132+0000","last_undegraded":"2024-09-15T22:22:51.784132+0000","last_fullsized":"2024-09-15T22:22:51.784132+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:19.233333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.787924+0000","last_change":"2024-09-15T22:22:50.771502+0000","last_active":"2024-09-15T22:22:51.787924+0000","last_peered":"2024-09-15T22:22:51.787924+0000","last_clean":"2024-09-15T22:22:51.787924+0000","last_became_active":"2024-09-15T22:22:50.771201+0000","last_became_peered":"2024-09-15T22:22:50.771201+0000","last_unstale":"2024-09-15T22:22:51.787924+0000","last_undegraded":"2024-09-15T22:22:51.787924+0000","last_fullsized":"2024-09-15T22:22:51.787924+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:24:34.668603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.787442+0000","last_change":"2024-09-15T22:22:50.776677+0000","last_active":"2024-09-15T22:22:51.787442+0000","last_peered":"2024-09-15T22:22:51.787442+0000","last_clean":"2024-09-15T22:22:51.787442+0000","last_became_active":"2024-09-15T22:22:50.774861+0000","last_became_peered":"2024-09-15T22:22:50.774861+0000","last_unstale":"2024-09-15T22:22:51.787442+0000","last_undegraded":"2024-09-15T22:22:51.787442+0000","last_fullsized":"2024-09-15T22:22:51.787442+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:25:00.652606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.786714+0000","last_change":"2024-09-15T22:22:50.784162+0000","last_active":"2024-09-15T22:22:51.786714+0000","last_peered":"2024-09-15T22:22:51.786714+0000","last_clean":"2024-09-15T22:22:51.786714+0000","last_became_active":"2024-09-15T22:22:50.783782+0000","last_became_peered":"2024-09-15T22:22:50.783782+0000","last_unstale":"2024-09-15T22:22:51.786714+0000","last_undegraded":"2024-09-15T22:22:51.786714+0000","last_fullsized":"2024-09-15T22:22:51.786714+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:36:22.785321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.770479+0000","last_change":"2024-09-15T22:22:50.775360+0000","last_active":"2024-09-15T22:22:51.770479+0000","last_peered":"2024-09-15T22:22:51.770479+0000","last_clean":"2024-09-15T22:22:51.770479+0000","last_became_active":"2024-09-15T22:22:50.775075+0000","last_became_peered":"2024-09-15T22:22:50.775075+0000","last_unstale":"2024-09-15T22:22:51.770479+0000","last_undegraded":"2024-09-15T22:22:51.770479+0000","last_fullsized":"2024-09-15T22:22:51.770479+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:25:42.484125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.767078+0000","last_change":"2024-09-15T22:22:50.772497+0000","last_active":"2024-09-15T22:22:51.767078+0000","last_peered":"2024-09-15T22:22:51.767078+0000","last_clean":"2024-09-15T22:22:51.767078+0000","last_became_active":"2024-09-15T22:22:50.770061+0000","last_became_peered":"2024-09-15T22:22:50.770061+0000","last_unstale":"2024-09-15T22:22:51.767078+0000","last_undegraded":"2024-09-15T22:22:51.767078+0000","last_fullsized":"2024-09-15T22:22:51.767078+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:23.420138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.785188+0000","last_change":"2024-09-15T22:22:50.788026+0000","last_active":"2024-09-15T22:22:51.785188+0000","last_peered":"2024-09-15T22:22:51.785188+0000","last_clean":"2024-09-15T22:22:51.785188+0000","last_became_active":"2024-09-15T22:22:50.787247+0000","last_became_peered":"2024-09-15T22:22:50.787247+0000","last_unstale":"2024-09-15T22:22:51.785188+0000","last_undegraded":"2024-09-15T22:22:51.785188+0000","last_fullsized":"2024-09-15T22:22:51.785188+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:52:48.408625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.770142+0000","last_change":"2024-09-15T22:22:50.777295+0000","last_active":"2024-09-15T22:22:51.770142+0000","last_peered":"2024-09-15T22:22:51.770142+0000","last_clean":"2024-09-15T22:22:51.770142+0000","last_became_active":"2024-09-15T22:22:50.776957+0000","last_became_peered":"2024-09-15T22:22:50.776957+0000","last_unstale":"2024-09-15T22:22:51.770142+0000","last_undegraded":"2024-09-15T22:22:51.770142+0000","last_fullsized":"2024-09-15T22:22:51.770142+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:50:45.858031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.784296+0000","last_change":"2024-09-15T22:22:50.778773+0000","last_active":"2024-09-15T22:22:51.784296+0000","last_peered":"2024-09-15T22:22:51.784296+0000","last_clean":"2024-09-15T22:22:51.784296+0000","last_became_active":"2024-09-15T22:22:50.778346+0000","last_became_peered":"2024-09-15T22:22:50.778346+0000","last_unstale":"2024-09-15T22:22:51.784296+0000","last_undegraded":"2024-09-15T22:22:51.784296+0000","last_fullsized":"2024-09-15T22:22:51.784296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:21:11.785059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.786935+0000","last_change":"2024-09-15T22:22:50.776172+0000","last_active":"2024-09-15T22:22:51.786935+0000","last_peered":"2024-09-15T22:22:51.786935+0000","last_clean":"2024-09-15T22:22:51.786935+0000","last_became_active":"2024-09-15T22:22:50.775838+0000","last_became_peered":"2024-09-15T22:22:50.775838+0000","last_unstale":"2024-09-15T22:22:51.786935+0000","last_undegraded":"2024-09-15T22:22:51.786935+0000","last_fullsized":"2024-09-15T22:22:51.786935+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:16:35.834565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.785312+0000","last_change":"2024-09-15T22:22:50.780158+0000","last_active":"2024-09-15T22:22:51.785312+0000","last_peered":"2024-09-15T22:22:51.785312+0000","last_clean":"2024-09-15T22:22:51.785312+0000","last_became_active":"2024-09-15T22:22:50.779858+0000","last_became_peered":"2024-09-15T22:22:50.779858+0000","last_unstale":"2024-09-15T22:22:51.785312+0000","last_undegraded":"2024-09-15T22:22:51.785312+0000","last_fullsized":"2024-09-15T22:22:51.785312+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:38.760239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.782587+0000","last_change":"2024-09-15T22:22:50.787980+0000","last_active":"2024-09-15T22:22:51.782587+0000","last_peered":"2024-09-15T22:22:51.782587+0000","last_clean":"2024-09-15T22:22:51.782587+0000","last_became_active":"2024-09-15T22:22:50.787189+0000","last_became_peered":"2024-09-15T22:22:50.787189+0000","last_unstale":"2024-09-15T22:22:51.782587+0000","last_undegraded":"2024-09-15T22:22:51.782587+0000","last_fullsized":"2024-09-15T22:22:51.782587+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:05:31.741961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.788004+0000","last_change":"2024-09-15T22:22:50.782833+0000","last_active":"2024-09-15T22:22:51.788004+0000","last_peered":"2024-09-15T22:22:51.788004+0000","last_clean":"2024-09-15T22:22:51.788004+0000","last_became_active":"2024-09-15T22:22:50.782450+0000","last_became_peered":"2024-09-15T22:22:50.782450+0000","last_unstale":"2024-09-15T22:22:51.788004+0000","last_undegraded":"2024-09-15T22:22:51.788004+0000","last_fullsized":"2024-09-15T22:22:51.788004+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:32:07.931321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.785657+0000","last_change":"2024-09-15T22:22:50.784199+0000","last_active":"2024-09-15T22:22:51.785657+0000","last_peered":"2024-09-15T22:22:51.785657+0000","last_clean":"2024-09-15T22:22:51.785657+0000","last_became_active":"2024-09-15T22:22:50.783858+0000","last_became_peered":"2024-09-15T22:22:50.783858+0000","last_unstale":"2024-09-15T22:22:51.785657+0000","last_undegraded":"2024-09-15T22:22:51.785657+0000","last_fullsized":"2024-09-15T22:22:51.785657+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:40:01.271188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.770502+0000","last_change":"2024-09-15T22:22:50.772094+0000","last_active":"2024-09-15T22:22:51.770502+0000","last_peered":"2024-09-15T22:22:51.770502+0000","last_clean":"2024-09-15T22:22:51.770502+0000","last_became_active":"2024-09-15T22:22:50.771633+0000","last_became_peered":"2024-09-15T22:22:50.771633+0000","last_unstale":"2024-09-15T22:22:51.770502+0000","last_undegraded":"2024-09-15T22:22:51.770502+0000","last_fullsized":"2024-09-15T22:22:51.770502+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:06:46.194573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.784471+0000","last_change":"2024-09-15T22:22:50.781069+0000","last_active":"2024-09-15T22:22:51.784471+0000","last_peered":"2024-09-15T22:22:51.784471+0000","last_clean":"2024-09-15T22:22:51.784471+0000","last_became_active":"2024-09-15T22:22:50.780742+0000","last_became_peered":"2024-09-15T22:22:50.780742+0000","last_unstale":"2024-09-15T22:22:51.784471+0000","last_undegraded":"2024-09-15T22:22:51.784471+0000","last_fullsized":"2024-09-15T22:22:51.784471+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:21:05.323542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.787081+0000","last_change":"2024-09-15T22:22:50.776252+0000","last_active":"2024-09-15T22:22:51.787081+0000","last_peered":"2024-09-15T22:22:51.787081+0000","last_clean":"2024-09-15T22:22:51.787081+0000","last_became_active":"2024-09-15T22:22:50.775911+0000","last_became_peered":"2024-09-15T22:22:50.775911+0000","last_unstale":"2024-09-15T22:22:51.787081+0000","last_undegraded":"2024-09-15T22:22:51.787081+0000","last_fullsized":"2024-09-15T22:22:51.787081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:01:43.836637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.783929+0000","last_change":"2024-09-15T22:22:50.775992+0000","last_active":"2024-09-15T22:22:51.783929+0000","last_peered":"2024-09-15T22:22:51.783929+0000","last_clean":"2024-09-15T22:22:51.783929+0000","last_became_active":"2024-09-15T22:22:50.775619+0000","last_became_peered":"2024-09-15T22:22:50.775619+0000","last_unstale":"2024-09-15T22:22:51.783929+0000","last_undegraded":"2024-09-15T22:22:51.783929+0000","last_fullsized":"2024-09-15T22:22:51.783929+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:57.623706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.785382+0000","last_change":"2024-09-15T22:22:50.786376+0000","last_active":"2024-09-15T22:22:51.785382+0000","last_peered":"2024-09-15T22:22:51.785382+0000","last_clean":"2024-09-15T22:22:51.785382+0000","last_became_active":"2024-09-15T22:22:50.786011+0000","last_became_peered":"2024-09-15T22:22:50.786011+0000","last_unstale":"2024-09-15T22:22:51.785382+0000","last_undegraded":"2024-09-15T22:22:51.785382+0000","last_fullsized":"2024-09-15T22:22:51.785382+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:54.492349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.770106+0000","last_change":"2024-09-15T22:22:50.777114+0000","last_active":"2024-09-15T22:22:51.770106+0000","last_peered":"2024-09-15T22:22:51.770106+0000","last_clean":"2024-09-15T22:22:51.770106+0000","last_became_active":"2024-09-15T22:22:50.776756+0000","last_became_peered":"2024-09-15T22:22:50.776756+0000","last_unstale":"2024-09-15T22:22:51.770106+0000","last_undegraded":"2024-09-15T22:22:51.770106+0000","last_fullsized":"2024-09-15T22:22:51.770106+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:51.220074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.782469+0000","last_change":"2024-09-15T22:22:50.777228+0000","last_active":"2024-09-15T22:22:51.782469+0000","last_peered":"2024-09-15T22:22:51.782469+0000","last_clean":"2024-09-15T22:22:51.782469+0000","last_became_active":"2024-09-15T22:22:50.776926+0000","last_became_peered":"2024-09-15T22:22:50.776926+0000","last_unstale":"2024-09-15T22:22:51.782469+0000","last_undegraded":"2024-09-15T22:22:51.782469+0000","last_fullsized":"2024-09-15T22:22:51.782469+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:28:20.346803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":48,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:23.872434+0000","last_change":"2024-09-15T22:22:48.333147+0000","last_active":"2024-09-15T22:23:23.872434+0000","last_peered":"2024-09-15T22:23:23.872434+0000","last_clean":"2024-09-15T22:23:23.872434+0000","last_became_active":"2024-09-15T22:22:48.332862+0000","last_became_peered":"2024-09-15T22:22:48.332862+0000","last_unstale":"2024-09-15T22:23:23.872434+0000","last_undegraded":"2024-09-15T22:23:23.872434+0000","last_fullsized":"2024-09-15T22:23:23.872434+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:18:25.043411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.782705+0000","last_change":"2024-09-15T22:22:50.787593+0000","last_active":"2024-09-15T22:22:51.782705+0000","last_peered":"2024-09-15T22:22:51.782705+0000","last_clean":"2024-09-15T22:22:51.782705+0000","last_became_active":"2024-09-15T22:22:50.787262+0000","last_became_peered":"2024-09-15T22:22:50.787262+0000","last_unstale":"2024-09-15T22:22:51.782705+0000","last_undegraded":"2024-09-15T22:22:51.782705+0000","last_fullsized":"2024-09-15T22:22:51.782705+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:40:40.529295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:02.836512+0000","last_change":"2024-09-15T22:22:48.333060+0000","last_active":"2024-09-15T22:23:02.836512+0000","last_peered":"2024-09-15T22:23:02.836512+0000","last_clean":"2024-09-15T22:23:02.836512+0000","last_became_active":"2024-09-15T22:22:48.332713+0000","last_became_peered":"2024-09-15T22:22:48.332713+0000","last_unstale":"2024-09-15T22:23:02.836512+0000","last_undegraded":"2024-09-15T22:23:02.836512+0000","last_fullsized":"2024-09-15T22:23:02.836512+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:44.664497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:02.836596+0000","last_change":"2024-09-15T22:22:48.335104+0000","last_active":"2024-09-15T22:23:02.836596+0000","last_peered":"2024-09-15T22:23:02.836596+0000","last_clean":"2024-09-15T22:23:02.836596+0000","last_became_active":"2024-09-15T22:22:48.334276+0000","last_became_peered":"2024-09-15T22:22:48.334276+0000","last_unstale":"2024-09-15T22:23:02.836596+0000","last_undegraded":"2024-09-15T22:23:02.836596+0000","last_fullsized":"2024-09-15T22:23:02.836596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:49:24.414968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.784241+0000","last_change":"2024-09-15T22:22:50.773324+0000","last_active":"2024-09-15T22:22:51.784241+0000","last_peered":"2024-09-15T22:22:51.784241+0000","last_clean":"2024-09-15T22:22:51.784241+0000","last_became_active":"2024-09-15T22:22:50.773013+0000","last_became_peered":"2024-09-15T22:22:50.773013+0000","last_unstale":"2024-09-15T22:22:51.784241+0000","last_undegraded":"2024-09-15T22:22:51.784241+0000","last_fullsized":"2024-09-15T22:22:51.784241+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:41:06.642144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.783068+0000","last_change":"2024-09-15T22:22:48.334707+0000","last_active":"2024-09-15T22:22:51.783068+0000","last_peered":"2024-09-15T22:22:51.783068+0000","last_clean":"2024-09-15T22:22:51.783068+0000","last_became_active":"2024-09-15T22:22:48.334418+0000","last_became_peered":"2024-09-15T22:22:48.334418+0000","last_unstale":"2024-09-15T22:22:51.783068+0000","last_undegraded":"2024-09-15T22:22:51.783068+0000","last_fullsized":"2024-09-15T22:22:51.783068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:40.285547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.766861+0000","last_change":"2024-09-15T22:22:50.772760+0000","last_active":"2024-09-15T22:22:51.766861+0000","last_peered":"2024-09-15T22:22:51.766861+0000","last_clean":"2024-09-15T22:22:51.766861+0000","last_became_active":"2024-09-15T22:22:50.772162+0000","last_became_peered":"2024-09-15T22:22:50.772162+0000","last_unstale":"2024-09-15T22:22:51.766861+0000","last_undegraded":"2024-09-15T22:22:51.766861+0000","last_fullsized":"2024-09-15T22:22:51.766861+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:23.368902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:22.870325+0000","last_change":"2024-09-15T22:22:48.336282+0000","last_active":"2024-09-15T22:23:22.870325+0000","last_peered":"2024-09-15T22:23:22.870325+0000","last_clean":"2024-09-15T22:23:22.870325+0000","last_became_active":"2024-09-15T22:22:48.335696+0000","last_became_peered":"2024-09-15T22:22:48.335696+0000","last_unstale":"2024-09-15T22:23:22.870325+0000","last_undegraded":"2024-09-15T22:23:22.870325+0000","last_fullsized":"2024-09-15T22:23:22.870325+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:22.990996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.787585+0000","last_change":"2024-09-15T22:22:50.778166+0000","last_active":"2024-09-15T22:22:51.787585+0000","last_peered":"2024-09-15T22:22:51.787585+0000","last_clean":"2024-09-15T22:22:51.787585+0000","last_became_active":"2024-09-15T22:22:50.777755+0000","last_became_peered":"2024-09-15T22:22:50.777755+0000","last_unstale":"2024-09-15T22:22:51.787585+0000","last_undegraded":"2024-09-15T22:22:51.787585+0000","last_fullsized":"2024-09-15T22:22:51.787585+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:45:50.513358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:01.825492+0000","last_change":"2024-09-15T22:22:48.334952+0000","last_active":"2024-09-15T22:23:01.825492+0000","last_peered":"2024-09-15T22:23:01.825492+0000","last_clean":"2024-09-15T22:23:01.825492+0000","last_became_active":"2024-09-15T22:22:48.332190+0000","last_became_peered":"2024-09-15T22:22:48.332190+0000","last_unstale":"2024-09-15T22:23:01.825492+0000","last_undegraded":"2024-09-15T22:23:01.825492+0000","last_fullsized":"2024-09-15T22:23:01.825492+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:45:14.877713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.787767+0000","last_change":"2024-09-15T22:22:50.776507+0000","last_active":"2024-09-15T22:22:51.787767+0000","last_peered":"2024-09-15T22:22:51.787767+0000","last_clean":"2024-09-15T22:22:51.787767+0000","last_became_active":"2024-09-15T22:22:50.774508+0000","last_became_peered":"2024-09-15T22:22:50.774508+0000","last_unstale":"2024-09-15T22:22:51.787767+0000","last_undegraded":"2024-09-15T22:22:51.787767+0000","last_fullsized":"2024-09-15T22:22:51.787767+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:07:51.335655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:01.826000+0000","last_change":"2024-09-15T22:22:48.388864+0000","last_active":"2024-09-15T22:23:01.826000+0000","last_peered":"2024-09-15T22:23:01.826000+0000","last_clean":"2024-09-15T22:23:01.826000+0000","last_became_active":"2024-09-15T22:22:48.388576+0000","last_became_peered":"2024-09-15T22:22:48.388576+0000","last_unstale":"2024-09-15T22:23:01.826000+0000","last_undegraded":"2024-09-15T22:23:01.826000+0000","last_fullsized":"2024-09-15T22:23:01.826000+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:19:44.416306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.787177+0000","last_change":"2024-09-15T22:22:50.783189+0000","last_active":"2024-09-15T22:22:51.787177+0000","last_peered":"2024-09-15T22:22:51.787177+0000","last_clean":"2024-09-15T22:22:51.787177+0000","last_became_active":"2024-09-15T22:22:50.782790+0000","last_became_peered":"2024-09-15T22:22:50.782790+0000","last_unstale":"2024-09-15T22:22:51.787177+0000","last_undegraded":"2024-09-15T22:22:51.787177+0000","last_fullsized":"2024-09-15T22:22:51.787177+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:12.650413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'26","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:23.876305+0000","last_change":"2024-09-15T22:22:48.336216+0000","last_active":"2024-09-15T22:23:23.876305+0000","last_peered":"2024-09-15T22:23:23.876305+0000","last_clean":"2024-09-15T22:23:23.876305+0000","last_became_active":"2024-09-15T22:22:48.334958+0000","last_became_peered":"2024-09-15T22:22:48.334958+0000","last_unstale":"2024-09-15T22:23:23.876305+0000","last_undegraded":"2024-09-15T22:23:23.876305+0000","last_fullsized":"2024-09-15T22:23:23.876305+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:58:31.990060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54369,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":76,"num_write":27,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.786256+0000","last_change":"2024-09-15T22:22:50.773996+0000","last_active":"2024-09-15T22:22:51.786256+0000","last_peered":"2024-09-15T22:22:51.786256+0000","last_clean":"2024-09-15T22:22:51.786256+0000","last_became_active":"2024-09-15T22:22:50.773651+0000","last_became_peered":"2024-09-15T22:22:50.773651+0000","last_unstale":"2024-09-15T22:22:51.786256+0000","last_undegraded":"2024-09-15T22:22:51.786256+0000","last_fullsized":"2024-09-15T22:22:51.786256+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:16.876455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:02.834564+0000","last_change":"2024-09-15T22:22:48.336138+0000","last_active":"2024-09-15T22:23:02.834564+0000","last_peered":"2024-09-15T22:23:02.834564+0000","last_clean":"2024-09-15T22:23:02.834564+0000","last_became_active":"2024-09-15T22:22:48.335538+0000","last_became_peered":"2024-09-15T22:22:48.335538+0000","last_unstale":"2024-09-15T22:23:02.834564+0000","last_undegraded":"2024-09-15T22:23:02.834564+0000","last_fullsized":"2024-09-15T22:23:02.834564+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:12.917499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.783815+0000","last_change":"2024-09-15T22:22:50.787247+0000","last_active":"2024-09-15T22:22:51.783815+0000","last_peered":"2024-09-15T22:22:51.783815+0000","last_clean":"2024-09-15T22:22:51.783815+0000","last_became_active":"2024-09-15T22:22:50.786880+0000","last_became_peered":"2024-09-15T22:22:50.786880+0000","last_unstale":"2024-09-15T22:22:51.783815+0000","last_undegraded":"2024-09-15T22:22:51.783815+0000","last_fullsized":"2024-09-15T22:22:51.783815+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:02.648581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:01.825273+0000","last_change":"2024-09-15T22:22:48.335633+0000","last_active":"2024-09-15T22:23:01.825273+0000","last_peered":"2024-09-15T22:23:01.825273+0000","last_clean":"2024-09-15T22:23:01.825273+0000","last_became_active":"2024-09-15T22:22:48.335354+0000","last_became_peered":"2024-09-15T22:22:48.335354+0000","last_unstale":"2024-09-15T22:23:01.825273+0000","last_undegraded":"2024-09-15T22:23:01.825273+0000","last_fullsized":"2024-09-15T22:23:01.825273+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:01:24.009614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.783672+0000","last_change":"2024-09-15T22:22:50.777583+0000","last_active":"2024-09-15T22:22:51.783672+0000","last_peered":"2024-09-15T22:22:51.783672+0000","last_clean":"2024-09-15T22:22:51.783672+0000","last_became_active":"2024-09-15T22:22:50.777235+0000","last_became_peered":"2024-09-15T22:22:50.777235+0000","last_unstale":"2024-09-15T22:22:51.783672+0000","last_undegraded":"2024-09-15T22:22:51.783672+0000","last_fullsized":"2024-09-15T22:22:51.783672+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:28:48.449725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'4","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:19.867415+0000","last_change":"2024-09-15T22:22:48.338517+0000","last_active":"2024-09-15T22:23:19.867415+0000","last_peered":"2024-09-15T22:23:19.867415+0000","last_clean":"2024-09-15T22:23:19.867415+0000","last_became_active":"2024-09-15T22:22:48.338159+0000","last_became_peered":"2024-09-15T22:22:48.338159+0000","last_unstale":"2024-09-15T22:23:19.867415+0000","last_undegraded":"2024-09-15T22:23:19.867415+0000","last_fullsized":"2024-09-15T22:23:19.867415+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:48:14.792180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.783536+0000","last_change":"2024-09-15T22:22:50.776455+0000","last_active":"2024-09-15T22:22:51.783536+0000","last_peered":"2024-09-15T22:22:51.783536+0000","last_clean":"2024-09-15T22:22:51.783536+0000","last_became_active":"2024-09-15T22:22:50.776049+0000","last_became_peered":"2024-09-15T22:22:50.776049+0000","last_unstale":"2024-09-15T22:22:51.783536+0000","last_undegraded":"2024-09-15T22:22:51.783536+0000","last_fullsized":"2024-09-15T22:22:51.783536+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:32:01.675470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:02.835966+0000","last_change":"2024-09-15T22:22:48.387333+0000","last_active":"2024-09-15T22:23:02.835966+0000","last_peered":"2024-09-15T22:23:02.835966+0000","last_clean":"2024-09-15T22:23:02.835966+0000","last_became_active":"2024-09-15T22:22:48.386669+0000","last_became_peered":"2024-09-15T22:22:48.386669+0000","last_unstale":"2024-09-15T22:23:02.835966+0000","last_undegraded":"2024-09-15T22:23:02.835966+0000","last_fullsized":"2024-09-15T22:23:02.835966+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:57.310653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.782771+0000","last_change":"2024-09-15T22:22:50.782530+0000","last_active":"2024-09-15T22:22:51.782771+0000","last_peered":"2024-09-15T22:22:51.782771+0000","last_clean":"2024-09-15T22:22:51.782771+0000","last_became_active":"2024-09-15T22:22:50.782201+0000","last_became_peered":"2024-09-15T22:22:50.782201+0000","last_unstale":"2024-09-15T22:22:51.782771+0000","last_undegraded":"2024-09-15T22:22:51.782771+0000","last_fullsized":"2024-09-15T22:22:51.782771+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:05.652843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:04.831088+0000","last_change":"2024-09-15T22:22:48.330909+0000","last_active":"2024-09-15T22:23:04.831088+0000","last_peered":"2024-09-15T22:23:04.831088+0000","last_clean":"2024-09-15T22:23:04.831088+0000","last_became_active":"2024-09-15T22:22:48.330603+0000","last_became_peered":"2024-09-15T22:22:48.330603+0000","last_unstale":"2024-09-15T22:23:04.831088+0000","last_undegraded":"2024-09-15T22:23:04.831088+0000","last_fullsized":"2024-09-15T22:23:04.831088+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:32:41.489246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.770312+0000","last_change":"2024-09-15T22:22:50.776404+0000","last_active":"2024-09-15T22:22:51.770312+0000","last_peered":"2024-09-15T22:22:51.770312+0000","last_clean":"2024-09-15T22:22:51.770312+0000","last_became_active":"2024-09-15T22:22:50.776014+0000","last_became_peered":"2024-09-15T22:22:50.776014+0000","last_unstale":"2024-09-15T22:22:51.770312+0000","last_undegraded":"2024-09-15T22:22:51.770312+0000","last_fullsized":"2024-09-15T22:22:51.770312+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:56.644834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.787464+0000","last_change":"2024-09-15T22:22:48.333019+0000","last_active":"2024-09-15T22:22:51.787464+0000","last_peered":"2024-09-15T22:22:51.787464+0000","last_clean":"2024-09-15T22:22:51.787464+0000","last_became_active":"2024-09-15T22:22:48.332669+0000","last_became_peered":"2024-09-15T22:22:48.332669+0000","last_unstale":"2024-09-15T22:22:51.787464+0000","last_undegraded":"2024-09-15T22:22:51.787464+0000","last_fullsized":"2024-09-15T22:22:51.787464+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:36.415483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.784378+0000","last_change":"2024-09-15T22:22:50.774131+0000","last_active":"2024-09-15T22:22:51.784378+0000","last_peered":"2024-09-15T22:22:51.784378+0000","last_clean":"2024-09-15T22:22:51.784378+0000","last_became_active":"2024-09-15T22:22:50.773783+0000","last_became_peered":"2024-09-15T22:22:50.773783+0000","last_unstale":"2024-09-15T22:22:51.784378+0000","last_undegraded":"2024-09-15T22:22:51.784378+0000","last_fullsized":"2024-09-15T22:22:51.784378+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:21:57.459883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.785948+0000","last_change":"2024-09-15T22:22:48.337317+0000","last_active":"2024-09-15T22:22:51.785948+0000","last_peered":"2024-09-15T22:22:51.785948+0000","last_clean":"2024-09-15T22:22:51.785948+0000","last_became_active":"2024-09-15T22:22:48.337004+0000","last_became_peered":"2024-09-15T22:22:48.337004+0000","last_unstale":"2024-09-15T22:22:51.785948+0000","last_undegraded":"2024-09-15T22:22:51.785948+0000","last_fullsized":"2024-09-15T22:22:51.785948+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:09.385389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.783820+0000","last_change":"2024-09-15T22:22:50.785360+0000","last_active":"2024-09-15T22:22:51.783820+0000","last_peered":"2024-09-15T22:22:51.783820+0000","last_clean":"2024-09-15T22:22:51.783820+0000","last_became_active":"2024-09-15T22:22:50.785041+0000","last_became_peered":"2024-09-15T22:22:50.785041+0000","last_unstale":"2024-09-15T22:22:51.783820+0000","last_undegraded":"2024-09-15T22:22:51.783820+0000","last_fullsized":"2024-09-15T22:22:51.783820+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:18.173219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:02.836355+0000","last_change":"2024-09-15T22:22:48.387680+0000","last_active":"2024-09-15T22:23:02.836355+0000","last_peered":"2024-09-15T22:23:02.836355+0000","last_clean":"2024-09-15T22:23:02.836355+0000","last_became_active":"2024-09-15T22:22:48.387345+0000","last_became_peered":"2024-09-15T22:22:48.387345+0000","last_unstale":"2024-09-15T22:23:02.836355+0000","last_undegraded":"2024-09-15T22:23:02.836355+0000","last_fullsized":"2024-09-15T22:23:02.836355+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:01:12.814275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.784065+0000","last_change":"2024-09-15T22:22:50.781268+0000","last_active":"2024-09-15T22:22:51.784065+0000","last_peered":"2024-09-15T22:22:51.784065+0000","last_clean":"2024-09-15T22:22:51.784065+0000","last_became_active":"2024-09-15T22:22:50.780949+0000","last_became_peered":"2024-09-15T22:22:50.780949+0000","last_unstale":"2024-09-15T22:22:51.784065+0000","last_undegraded":"2024-09-15T22:22:51.784065+0000","last_fullsized":"2024-09-15T22:22:51.784065+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:55:46.107326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":331,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.783920+0000","last_change":"2024-09-15T22:21:33.463741+0000","last_active":"2024-09-15T22:22:51.783920+0000","last_peered":"2024-09-15T22:22:51.783920+0000","last_clean":"2024-09-15T22:22:51.783920+0000","last_became_active":"2024-09-15T22:21:33.463177+0000","last_became_peered":"2024-09-15T22:21:33.463177+0000","last_unstale":"2024-09-15T22:22:51.783920+0000","last_undegraded":"2024-09-15T22:22:51.783920+0000","last_fullsized":"2024-09-15T22:22:51.783920+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:17:56.109541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:17:56.109541+0000","last_clean_scrub_stamp":"2024-09-15T22:17:56.109541+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:43.974077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:04.842584+0000","last_change":"2024-09-15T22:22:48.337556+0000","last_active":"2024-09-15T22:23:04.842584+0000","last_peered":"2024-09-15T22:23:04.842584+0000","last_clean":"2024-09-15T22:23:04.842584+0000","last_became_active":"2024-09-15T22:22:48.337163+0000","last_became_peered":"2024-09-15T22:22:48.337163+0000","last_unstale":"2024-09-15T22:23:04.842584+0000","last_undegraded":"2024-09-15T22:23:04.842584+0000","last_fullsized":"2024-09-15T22:23:04.842584+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:57.087797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.786294+0000","last_change":"2024-09-15T22:22:50.778807+0000","last_active":"2024-09-15T22:22:51.786294+0000","last_peered":"2024-09-15T22:22:51.786294+0000","last_clean":"2024-09-15T22:22:51.786294+0000","last_became_active":"2024-09-15T22:22:50.778515+0000","last_became_peered":"2024-09-15T22:22:50.778515+0000","last_unstale":"2024-09-15T22:22:51.786294+0000","last_undegraded":"2024-09-15T22:22:51.786294+0000","last_fullsized":"2024-09-15T22:22:51.786294+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:15:40.969573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:02.833723+0000","last_change":"2024-09-15T22:22:48.332525+0000","last_active":"2024-09-15T22:23:02.833723+0000","last_peered":"2024-09-15T22:23:02.833723+0000","last_clean":"2024-09-15T22:23:02.833723+0000","last_became_active":"2024-09-15T22:22:48.331615+0000","last_became_peered":"2024-09-15T22:22:48.331615+0000","last_unstale":"2024-09-15T22:23:02.833723+0000","last_undegraded":"2024-09-15T22:23:02.833723+0000","last_fullsized":"2024-09-15T22:23:02.833723+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:47:00.012013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.783300+0000","last_change":"2024-09-15T22:22:50.778422+0000","last_active":"2024-09-15T22:22:51.783300+0000","last_peered":"2024-09-15T22:22:51.783300+0000","last_clean":"2024-09-15T22:22:51.783300+0000","last_became_active":"2024-09-15T22:22:50.777549+0000","last_became_peered":"2024-09-15T22:22:50.777549+0000","last_unstale":"2024-09-15T22:22:51.783300+0000","last_undegraded":"2024-09-15T22:22:51.783300+0000","last_fullsized":"2024-09-15T22:22:51.783300+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:30:03.130474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:23.872728+0000","last_change":"2024-09-15T22:22:48.387992+0000","last_active":"2024-09-15T22:23:23.872728+0000","last_peered":"2024-09-15T22:23:23.872728+0000","last_clean":"2024-09-15T22:23:23.872728+0000","last_became_active":"2024-09-15T22:22:48.386645+0000","last_became_peered":"2024-09-15T22:22:48.386645+0000","last_unstale":"2024-09-15T22:23:23.872728+0000","last_undegraded":"2024-09-15T22:23:23.872728+0000","last_fullsized":"2024-09-15T22:23:23.872728+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:00.893946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.782910+0000","last_change":"2024-09-15T22:22:50.778939+0000","last_active":"2024-09-15T22:22:51.782910+0000","last_peered":"2024-09-15T22:22:51.782910+0000","last_clean":"2024-09-15T22:22:51.782910+0000","last_became_active":"2024-09-15T22:22:50.778620+0000","last_became_peered":"2024-09-15T22:22:50.778620+0000","last_unstale":"2024-09-15T22:22:51.782910+0000","last_undegraded":"2024-09-15T22:22:51.782910+0000","last_fullsized":"2024-09-15T22:22:51.782910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:16:28.957377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.784560+0000","last_change":"2024-09-15T22:22:48.334598+0000","last_active":"2024-09-15T22:22:51.784560+0000","last_peered":"2024-09-15T22:22:51.784560+0000","last_clean":"2024-09-15T22:22:51.784560+0000","last_became_active":"2024-09-15T22:22:48.333022+0000","last_became_peered":"2024-09-15T22:22:48.333022+0000","last_unstale":"2024-09-15T22:22:51.784560+0000","last_undegraded":"2024-09-15T22:22:51.784560+0000","last_fullsized":"2024-09-15T22:22:51.784560+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:28.577791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.782710+0000","last_change":"2024-09-15T22:22:50.777045+0000","last_active":"2024-09-15T22:22:51.782710+0000","last_peered":"2024-09-15T22:22:51.782710+0000","last_clean":"2024-09-15T22:22:51.782710+0000","last_became_active":"2024-09-15T22:22:50.776677+0000","last_became_peered":"2024-09-15T22:22:50.776677+0000","last_unstale":"2024-09-15T22:22:51.782710+0000","last_undegraded":"2024-09-15T22:22:51.782710+0000","last_fullsized":"2024-09-15T22:22:51.782710+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:24.946214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.766928+0000","last_change":"2024-09-15T22:22:48.387707+0000","last_active":"2024-09-15T22:22:51.766928+0000","last_peered":"2024-09-15T22:22:51.766928+0000","last_clean":"2024-09-15T22:22:51.766928+0000","last_became_active":"2024-09-15T22:22:48.387323+0000","last_became_peered":"2024-09-15T22:22:48.387323+0000","last_unstale":"2024-09-15T22:22:51.766928+0000","last_undegraded":"2024-09-15T22:22:51.766928+0000","last_fullsized":"2024-09-15T22:22:51.766928+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:43.430648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:54.464841+0000","last_change":"2024-09-15T22:22:50.775365+0000","last_active":"2024-09-15T22:22:54.464841+0000","last_peered":"2024-09-15T22:22:54.464841+0000","last_clean":"2024-09-15T22:22:54.464841+0000","last_became_active":"2024-09-15T22:22:50.774988+0000","last_became_peered":"2024-09-15T22:22:50.774988+0000","last_unstale":"2024-09-15T22:22:54.464841+0000","last_undegraded":"2024-09-15T22:22:54.464841+0000","last_fullsized":"2024-09-15T22:22:54.464841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:32:33.268976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:01.825837+0000","last_change":"2024-09-15T22:22:48.387142+0000","last_active":"2024-09-15T22:23:01.825837+0000","last_peered":"2024-09-15T22:23:01.825837+0000","last_clean":"2024-09-15T22:23:01.825837+0000","last_became_active":"2024-09-15T22:22:48.386669+0000","last_became_peered":"2024-09-15T22:22:48.386669+0000","last_unstale":"2024-09-15T22:23:01.825837+0000","last_undegraded":"2024-09-15T22:23:01.825837+0000","last_fullsized":"2024-09-15T22:23:01.825837+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:01.590592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.784617+0000","last_change":"2024-09-15T22:22:50.788723+0000","last_active":"2024-09-15T22:22:51.784617+0000","last_peered":"2024-09-15T22:22:51.784617+0000","last_clean":"2024-09-15T22:22:51.784617+0000","last_became_active":"2024-09-15T22:22:50.786767+0000","last_became_peered":"2024-09-15T22:22:50.786767+0000","last_unstale":"2024-09-15T22:22:51.784617+0000","last_undegraded":"2024-09-15T22:22:51.784617+0000","last_fullsized":"2024-09-15T22:22:51.784617+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:10:54.859140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'10","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:19.782996+0000","last_change":"2024-09-15T22:22:48.329971+0000","last_active":"2024-09-15T22:23:19.782996+0000","last_peered":"2024-09-15T22:23:19.782996+0000","last_clean":"2024-09-15T22:23:19.782996+0000","last_became_active":"2024-09-15T22:22:48.329526+0000","last_became_peered":"2024-09-15T22:22:48.329526+0000","last_unstale":"2024-09-15T22:23:19.782996+0000","last_undegraded":"2024-09-15T22:23:19.782996+0000","last_fullsized":"2024-09-15T22:23:19.782996+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:53.665784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.788255+0000","last_change":"2024-09-15T22:22:50.778281+0000","last_active":"2024-09-15T22:22:51.788255+0000","last_peered":"2024-09-15T22:22:51.788255+0000","last_clean":"2024-09-15T22:22:51.788255+0000","last_became_active":"2024-09-15T22:22:50.777969+0000","last_became_peered":"2024-09-15T22:22:50.777969+0000","last_unstale":"2024-09-15T22:22:51.788255+0000","last_undegraded":"2024-09-15T22:22:51.788255+0000","last_fullsized":"2024-09-15T22:22:51.788255+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:25:04.566350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:01.825500+0000","last_change":"2024-09-15T22:22:48.370056+0000","last_active":"2024-09-15T22:23:01.825500+0000","last_peered":"2024-09-15T22:23:01.825500+0000","last_clean":"2024-09-15T22:23:01.825500+0000","last_became_active":"2024-09-15T22:22:48.369729+0000","last_became_peered":"2024-09-15T22:22:48.369729+0000","last_unstale":"2024-09-15T22:23:01.825500+0000","last_undegraded":"2024-09-15T22:23:01.825500+0000","last_fullsized":"2024-09-15T22:23:01.825500+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:43.894706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.787482+0000","last_change":"2024-09-15T22:22:50.785270+0000","last_active":"2024-09-15T22:22:51.787482+0000","last_peered":"2024-09-15T22:22:51.787482+0000","last_clean":"2024-09-15T22:22:51.787482+0000","last_became_active":"2024-09-15T22:22:50.785035+0000","last_became_peered":"2024-09-15T22:22:50.785035+0000","last_unstale":"2024-09-15T22:22:51.787482+0000","last_undegraded":"2024-09-15T22:22:51.787482+0000","last_fullsized":"2024-09-15T22:22:51.787482+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:58.505722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:01.826737+0000","last_change":"2024-09-15T22:22:48.387181+0000","last_active":"2024-09-15T22:23:01.826737+0000","last_peered":"2024-09-15T22:23:01.826737+0000","last_clean":"2024-09-15T22:23:01.826737+0000","last_became_active":"2024-09-15T22:22:48.386792+0000","last_became_peered":"2024-09-15T22:22:48.386792+0000","last_unstale":"2024-09-15T22:23:01.826737+0000","last_undegraded":"2024-09-15T22:23:01.826737+0000","last_fullsized":"2024-09-15T22:23:01.826737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:25.362961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.782329+0000","last_change":"2024-09-15T22:22:50.774054+0000","last_active":"2024-09-15T22:22:51.782329+0000","last_peered":"2024-09-15T22:22:51.782329+0000","last_clean":"2024-09-15T22:22:51.782329+0000","last_became_active":"2024-09-15T22:22:50.773686+0000","last_became_peered":"2024-09-15T22:22:50.773686+0000","last_unstale":"2024-09-15T22:22:51.782329+0000","last_undegraded":"2024-09-15T22:22:51.782329+0000","last_fullsized":"2024-09-15T22:22:51.782329+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:34.512814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:01.827753+0000","last_change":"2024-09-15T22:22:48.337042+0000","last_active":"2024-09-15T22:23:01.827753+0000","last_peered":"2024-09-15T22:23:01.827753+0000","last_clean":"2024-09-15T22:23:01.827753+0000","last_became_active":"2024-09-15T22:22:48.336648+0000","last_became_peered":"2024-09-15T22:22:48.336648+0000","last_unstale":"2024-09-15T22:23:01.827753+0000","last_undegraded":"2024-09-15T22:23:01.827753+0000","last_fullsized":"2024-09-15T22:23:01.827753+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:14:09.777606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.770208+0000","last_change":"2024-09-15T22:22:50.774012+0000","last_active":"2024-09-15T22:22:51.770208+0000","last_peered":"2024-09-15T22:22:51.770208+0000","last_clean":"2024-09-15T22:22:51.770208+0000","last_became_active":"2024-09-15T22:22:50.773442+0000","last_became_peered":"2024-09-15T22:22:50.773442+0000","last_unstale":"2024-09-15T22:22:51.770208+0000","last_undegraded":"2024-09-15T22:22:51.770208+0000","last_fullsized":"2024-09-15T22:22:51.770208+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:29.980429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.784449+0000","last_change":"2024-09-15T22:22:48.335817+0000","last_active":"2024-09-15T22:22:51.784449+0000","last_peered":"2024-09-15T22:22:51.784449+0000","last_clean":"2024-09-15T22:22:51.784449+0000","last_became_active":"2024-09-15T22:22:48.335307+0000","last_became_peered":"2024-09-15T22:22:48.335307+0000","last_unstale":"2024-09-15T22:22:51.784449+0000","last_undegraded":"2024-09-15T22:22:51.784449+0000","last_fullsized":"2024-09-15T22:22:51.784449+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:27.297866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.787644+0000","last_change":"2024-09-15T22:22:50.782798+0000","last_active":"2024-09-15T22:22:51.787644+0000","last_peered":"2024-09-15T22:22:51.787644+0000","last_clean":"2024-09-15T22:22:51.787644+0000","last_became_active":"2024-09-15T22:22:50.782316+0000","last_became_peered":"2024-09-15T22:22:50.782316+0000","last_unstale":"2024-09-15T22:22:51.787644+0000","last_undegraded":"2024-09-15T22:22:51.787644+0000","last_fullsized":"2024-09-15T22:22:51.787644+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:35:26.104790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:01.825969+0000","last_change":"2024-09-15T22:22:48.332485+0000","last_active":"2024-09-15T22:23:01.825969+0000","last_peered":"2024-09-15T22:23:01.825969+0000","last_clean":"2024-09-15T22:23:01.825969+0000","last_became_active":"2024-09-15T22:22:48.332158+0000","last_became_peered":"2024-09-15T22:22:48.332158+0000","last_unstale":"2024-09-15T22:23:01.825969+0000","last_undegraded":"2024-09-15T22:23:01.825969+0000","last_fullsized":"2024-09-15T22:23:01.825969+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:20.947915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.784260+0000","last_change":"2024-09-15T22:22:50.781961+0000","last_active":"2024-09-15T22:22:51.784260+0000","last_peered":"2024-09-15T22:22:51.784260+0000","last_clean":"2024-09-15T22:22:51.784260+0000","last_became_active":"2024-09-15T22:22:50.781622+0000","last_became_peered":"2024-09-15T22:22:50.781622+0000","last_unstale":"2024-09-15T22:22:51.784260+0000","last_undegraded":"2024-09-15T22:22:51.784260+0000","last_fullsized":"2024-09-15T22:22:51.784260+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:57.848953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.782869+0000","last_change":"2024-09-15T22:22:50.781337+0000","last_active":"2024-09-15T22:22:51.782869+0000","last_peered":"2024-09-15T22:22:51.782869+0000","last_clean":"2024-09-15T22:22:51.782869+0000","last_became_active":"2024-09-15T22:22:50.780956+0000","last_became_peered":"2024-09-15T22:22:50.780956+0000","last_unstale":"2024-09-15T22:22:51.782869+0000","last_undegraded":"2024-09-15T22:22:51.782869+0000","last_fullsized":"2024-09-15T22:22:51.782869+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:27.447614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.791002+0000","last_change":"2024-09-15T22:22:48.329098+0000","last_active":"2024-09-15T22:22:51.791002+0000","last_peered":"2024-09-15T22:22:51.791002+0000","last_clean":"2024-09-15T22:22:51.791002+0000","last_became_active":"2024-09-15T22:22:48.328755+0000","last_became_peered":"2024-09-15T22:22:48.328755+0000","last_unstale":"2024-09-15T22:22:51.791002+0000","last_undegraded":"2024-09-15T22:22:51.791002+0000","last_fullsized":"2024-09-15T22:22:51.791002+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:31.197422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.787154+0000","last_change":"2024-09-15T22:22:50.778437+0000","last_active":"2024-09-15T22:22:51.787154+0000","last_peered":"2024-09-15T22:22:51.787154+0000","last_clean":"2024-09-15T22:22:51.787154+0000","last_became_active":"2024-09-15T22:22:50.776847+0000","last_became_peered":"2024-09-15T22:22:50.776847+0000","last_unstale":"2024-09-15T22:22:51.787154+0000","last_undegraded":"2024-09-15T22:22:51.787154+0000","last_fullsized":"2024-09-15T22:22:51.787154+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:56.740028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:02.833416+0000","last_change":"2024-09-15T22:22:48.331965+0000","last_active":"2024-09-15T22:23:02.833416+0000","last_peered":"2024-09-15T22:23:02.833416+0000","last_clean":"2024-09-15T22:23:02.833416+0000","last_became_active":"2024-09-15T22:22:48.331652+0000","last_became_peered":"2024-09-15T22:22:48.331652+0000","last_unstale":"2024-09-15T22:23:02.833416+0000","last_undegraded":"2024-09-15T22:23:02.833416+0000","last_fullsized":"2024-09-15T22:23:02.833416+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:39.232097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.787619+0000","last_change":"2024-09-15T22:22:50.778091+0000","last_active":"2024-09-15T22:22:51.787619+0000","last_peered":"2024-09-15T22:22:51.787619+0000","last_clean":"2024-09-15T22:22:51.787619+0000","last_became_active":"2024-09-15T22:22:50.777782+0000","last_became_peered":"2024-09-15T22:22:50.777782+0000","last_unstale":"2024-09-15T22:22:51.787619+0000","last_undegraded":"2024-09-15T22:22:51.787619+0000","last_fullsized":"2024-09-15T22:22:51.787619+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:14:30.221629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.790651+0000","last_change":"2024-09-15T22:22:48.387133+0000","last_active":"2024-09-15T22:22:51.790651+0000","last_peered":"2024-09-15T22:22:51.790651+0000","last_clean":"2024-09-15T22:22:51.790651+0000","last_became_active":"2024-09-15T22:22:48.386796+0000","last_became_peered":"2024-09-15T22:22:48.386796+0000","last_unstale":"2024-09-15T22:22:51.790651+0000","last_undegraded":"2024-09-15T22:22:51.790651+0000","last_fullsized":"2024-09-15T22:22:51.790651+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:18:24.267326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:22:51.788042+0000","last_change":"2024-09-15T22:22:50.780869+0000","last_active":"2024-09-15T22:22:51.788042+0000","last_peered":"2024-09-15T22:22:51.788042+0000","last_clean":"2024-09-15T22:22:51.788042+0000","last_became_active":"2024-09-15T22:22:50.780411+0000","last_became_peered":"2024-09-15T22:22:50.780411+0000","last_unstale":"2024-09-15T22:22:51.788042+0000","last_undegraded":"2024-09-15T22:22:51.788042+0000","last_fullsized":"2024-09-15T22:22:51.788042+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:38:05.410234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:23:02.836276+0000","last_change":"2024-09-15T22:22:48.332789+0000","last_active":"2024-09-15T22:23:02.836276+0000","last_peered":"2024-09-15T22:23:02.836276+0000","last_clean":"2024-09-15T22:23:02.836276+0000","last_became_active":"2024-09-15T22:22:48.332165+0000","last_became_peered":"2024-09-15T22:22:48.332165+0000","last_unstale":"2024-09-15T22:23:02.836276+0000","last_undegraded":"2024-09-15T22:23:02.836276+0000","last_fullsized":"2024-09-15T22:23:02.836276+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:44:07.190316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":58765,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":147,"num_read_kb":137,"num_write":160,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":172038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514516,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":423386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743449,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28564,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716588,"statfs":{"total":95995035648,"available":95965786112,"internally_reserved":0,"allocated":1576960,"data_stored":1069629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906974,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":423622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135909,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":423542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364840,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32644,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712508,"statfs":{"total":95995035648,"available":95961608192,"internally_reserved":0,"allocated":1495040,"data_stored":1015867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528365,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":423011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757300,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28496,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716656,"statfs":{"total":95995035648,"available":95965855744,"internally_reserved":0,"allocated":1507328,"data_stored":1015158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920824,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":892928,"data_stored":423841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149757,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":905216,"data_stored":423322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411396,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":478916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32104,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713048,"statfs":{"total":95995035648,"available":95962161152,"internally_reserved":0,"allocated":942080,"data_stored":472916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738446,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":424282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":50112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":56112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":56340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:23:26.931 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-15T22:23:26.932 INFO:tasks.cephadm:Setting up client nodes... 2024-09-15T22:23:26.933 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-15T22:23:27.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:26 smithi012 ceph-mon[34883]: pgmap v309: 97 pgs: 97 active+clean; 634 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.4 KiB/s wr, 10 op/s 2024-09-15T22:23:27.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:26 smithi012 ceph-mon[34883]: from='client.24650 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:23:27.310 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:27.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:26 smithi098 ceph-mon[35514]: pgmap v309: 97 pgs: 97 active+clean; 634 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.4 KiB/s wr, 10 op/s 2024-09-15T22:23:27.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:26 smithi098 ceph-mon[35514]: from='client.24650 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:23:27.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.887+0000 7f9929000640 1 -- 172.21.15.1:0/992444188 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9924105920 msgr2=0x7f992410c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:27.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.887+0000 7f9929000640 1 --2- 172.21.15.1:0/992444188 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9924105920 0x7f992410c240 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f991c009ca0 tx=0x7f991c02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:23:27.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.887+0000 7f9929000640 1 -- 172.21.15.1:0/992444188 shutdown_connections 2024-09-15T22:23:27.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.887+0000 7f9929000640 1 --2- 172.21.15.1:0/992444188 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9924105920 0x7f992410c240 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:27.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.887+0000 7f9929000640 1 --2- 172.21.15.1:0/992444188 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9924104f60 0x7f99241053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:27.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.887+0000 7f9929000640 1 --2- 172.21.15.1:0/992444188 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9924103e00 0x7f9924104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:27.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.887+0000 7f9929000640 1 -- 172.21.15.1:0/992444188 >> 172.21.15.1:0/992444188 conn(0x7f99240ff5b0 msgr2=0x7f99241019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:27.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.887+0000 7f9929000640 1 -- 172.21.15.1:0/992444188 shutdown_connections 2024-09-15T22:23:27.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.887+0000 7f9929000640 1 -- 172.21.15.1:0/992444188 wait complete. 2024-09-15T22:23:27.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.888+0000 7f9929000640 1 Processor -- start 2024-09-15T22:23:27.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.888+0000 7f9929000640 1 -- start start 2024-09-15T22:23:27.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.888+0000 7f9929000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9924103e00 0x7f992419a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:27.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.888+0000 7f9929000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9924104f60 0x7f992419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:27.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.889+0000 7f9929000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9924105920 0x7f99241a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:27.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.889+0000 7f9929000640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f992410fab0 con 0x7f9924104f60 2024-09-15T22:23:27.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.889+0000 7f9929000640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f992410f930 con 0x7f9924103e00 2024-09-15T22:23:27.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.889+0000 7f9929000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f992410fc30 con 0x7f9924105920 2024-09-15T22:23:27.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.889+0000 7f991be00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9924104f60 0x7f992419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:27.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.889+0000 7f991be00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9924104f60 0x7f992419a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40306/0 (socket says 172.21.15.1:40306) 2024-09-15T22:23:27.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.889+0000 7f991be00640 1 -- 172.21.15.1:0/2362765238 learned_addr learned my addr 172.21.15.1:0/2362765238 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:27.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.889+0000 7f9921e00640 1 --2- 172.21.15.1:0/2362765238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9924103e00 0x7f992419a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:27.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.889+0000 7f9922800640 1 --2- 172.21.15.1:0/2362765238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9924105920 0x7f99241a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:27.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.889+0000 7f9921e00640 1 -- 172.21.15.1:0/2362765238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9924105920 msgr2=0x7f99241a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:27.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.889+0000 7f9921e00640 1 --2- 172.21.15.1:0/2362765238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9924105920 0x7f99241a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:27.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.889+0000 7f9921e00640 1 -- 172.21.15.1:0/2362765238 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9924104f60 msgr2=0x7f992419a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:27.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.889+0000 7f9921e00640 1 --2- 172.21.15.1:0/2362765238 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9924104f60 0x7f992419a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:27.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.889+0000 7f9921e00640 1 -- 172.21.15.1:0/2362765238 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99241a1cb0 con 0x7f9924103e00 2024-09-15T22:23:27.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.889+0000 7f991be00640 1 --2- 172.21.15.1:0/2362765238 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9924104f60 0x7f992419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:23:27.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.890+0000 7f9921e00640 1 --2- 172.21.15.1:0/2362765238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9924103e00 0x7f992419a080 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f991400e9f0 tx=0x7f991400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:27.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.890+0000 7f991aa00640 1 -- 172.21.15.1:0/2362765238 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991400cd80 con 0x7f9924103e00 2024-09-15T22:23:27.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.890+0000 7f991aa00640 1 -- 172.21.15.1:0/2362765238 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99140035f0 con 0x7f9924103e00 2024-09-15T22:23:27.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.890+0000 7f9929000640 1 -- 172.21.15.1:0/2362765238 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99241a1fa0 con 0x7f9924103e00 2024-09-15T22:23:27.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.890+0000 7f991aa00640 1 -- 172.21.15.1:0/2362765238 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9914010690 con 0x7f9924103e00 2024-09-15T22:23:27.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.890+0000 7f9929000640 1 -- 172.21.15.1:0/2362765238 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99241a2450 con 0x7f9924103e00 2024-09-15T22:23:27.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.891+0000 7f9929000640 1 -- 172.21.15.1:0/2362765238 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f992410b170 con 0x7f9924103e00 2024-09-15T22:23:27.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.894+0000 7f991aa00640 1 -- 172.21.15.1:0/2362765238 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f9914003b30 con 0x7f9924103e00 2024-09-15T22:23:27.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.896+0000 7f991aa00640 1 --2- 172.21.15.1:0/2362765238 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f99080a3380 0x7f99080a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:27.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.896+0000 7f991aa00640 1 -- 172.21.15.1:0/2362765238 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f99140cfc70 con 0x7f9924103e00 2024-09-15T22:23:27.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.896+0000 7f991be00640 1 --2- 172.21.15.1:0/2362765238 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f99080a3380 0x7f99080a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:27.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.897+0000 7f991aa00640 1 -- 172.21.15.1:0/2362765238 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f991409c970 con 0x7f9924103e00 2024-09-15T22:23:27.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:27.897+0000 7f991be00640 1 --2- 172.21.15.1:0/2362765238 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f99080a3380 0x7f99080a5840 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f992419b5a0 tx=0x7f990c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:28.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:28.147+0000 7f9929000640 1 -- 172.21.15.1:0/2362765238 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f992402d7c0 con 0x7f9924103e00 2024-09-15T22:23:28.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:28.152+0000 7f991aa00640 1 -- 172.21.15.1:0/2362765238 <== mon.2 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f99140bae20 con 0x7f9924103e00 2024-09-15T22:23:28.155 INFO:teuthology.orchestra.run.smithi001.stdout:[client.0] 2024-09-15T22:23:28.155 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQBgXudmxhzpCBAAHggm+v+NOwMxnmjVDm3Lhg== 2024-09-15T22:23:28.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:28.155+0000 7f9929000640 1 -- 172.21.15.1:0/2362765238 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f99080a3380 msgr2=0x7f99080a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:28.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:28.155+0000 7f9929000640 1 --2- 172.21.15.1:0/2362765238 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f99080a3380 0x7f99080a5840 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f992419b5a0 tx=0x7f990c005f90 comp rx=0 tx=0).stop 2024-09-15T22:23:28.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:28.155+0000 7f9929000640 1 -- 172.21.15.1:0/2362765238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9924103e00 msgr2=0x7f992419a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:28.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:28.155+0000 7f9929000640 1 --2- 172.21.15.1:0/2362765238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9924103e00 0x7f992419a080 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f991400e9f0 tx=0x7f991400eeb0 comp rx=0 tx=0).stop 2024-09-15T22:23:28.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:28.155+0000 7f9929000640 1 -- 172.21.15.1:0/2362765238 shutdown_connections 2024-09-15T22:23:28.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:28.155+0000 7f9929000640 1 --2- 172.21.15.1:0/2362765238 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f99080a3380 0x7f99080a5840 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:28.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:28.155+0000 7f9929000640 1 --2- 172.21.15.1:0/2362765238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9924105920 0x7f99241a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:28.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:28.155+0000 7f9929000640 1 --2- 172.21.15.1:0/2362765238 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9924104f60 0x7f992419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:28.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:28.155+0000 7f9929000640 1 --2- 172.21.15.1:0/2362765238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9924103e00 0x7f992419a080 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:28.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:28.155+0000 7f9929000640 1 -- 172.21.15.1:0/2362765238 >> 172.21.15.1:0/2362765238 conn(0x7f99240ff5b0 msgr2=0x7f9924108340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:28.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:28.155+0000 7f9929000640 1 -- 172.21.15.1:0/2362765238 shutdown_connections 2024-09-15T22:23:28.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:28.155+0000 7f9929000640 1 -- 172.21.15.1:0/2362765238 wait complete. 2024-09-15T22:23:28.928 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T22:23:28.928 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-15T22:23:28.928 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-15T22:23:29.009 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-15T22:23:29.009 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-15T22:23:29.009 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-15T22:23:29.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:28 smithi012 ceph-mon[34883]: pgmap v310: 97 pgs: 97 active+clean; 634 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-09-15T22:23:29.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:28 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/2362765238' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T22:23:29.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:28 smithi012 ceph-mon[34883]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T22:23:29.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:28 smithi012 ceph-mon[34883]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-15T22:23:29.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:28 smithi098 ceph-mon[35514]: pgmap v310: 97 pgs: 97 active+clean; 634 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-09-15T22:23:29.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:28 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/2362765238' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T22:23:29.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:28 smithi098 ceph-mon[35514]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T22:23:29.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:28 smithi098 ceph-mon[35514]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-15T22:23:29.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:28 smithi001 ceph-mon[30843]: pgmap v310: 97 pgs: 97 active+clean; 634 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-09-15T22:23:29.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:28 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/2362765238' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T22:23:29.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:28 smithi001 ceph-mon[30843]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T22:23:29.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:28 smithi001 ceph-mon[30843]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-15T22:23:29.425 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:30.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:29.998+0000 7fdb5e800640 1 -- 172.21.15.1:0/1780740853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb58109120 msgr2=0x7fdb58110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:30.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:29.998+0000 7fdb5e800640 1 --2- 172.21.15.1:0/1780740853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb58109120 0x7fdb58110ca0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009ca0 tx=0x7fdb5002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:23:30.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:29.998+0000 7fdb5e800640 1 -- 172.21.15.1:0/1780740853 shutdown_connections 2024-09-15T22:23:30.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:29.998+0000 7fdb5e800640 1 --2- 172.21.15.1:0/1780740853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb58109120 0x7fdb58110ca0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:30.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:29.998+0000 7fdb5e800640 1 --2- 172.21.15.1:0/1780740853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb581049a0 0x7fdb581089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:30.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:29.998+0000 7fdb5e800640 1 --2- 172.21.15.1:0/1780740853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb58103ff0 0x7fdb581043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:30.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:29.998+0000 7fdb5e800640 1 -- 172.21.15.1:0/1780740853 >> 172.21.15.1:0/1780740853 conn(0x7fdb580ffa90 msgr2=0x7fdb58101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:30.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:29.998+0000 7fdb5e800640 1 -- 172.21.15.1:0/1780740853 shutdown_connections 2024-09-15T22:23:30.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:29.998+0000 7fdb5e800640 1 -- 172.21.15.1:0/1780740853 wait complete. 2024-09-15T22:23:30.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:29.999+0000 7fdb5e800640 1 Processor -- start 2024-09-15T22:23:30.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:29.999+0000 7fdb5e800640 1 -- start start 2024-09-15T22:23:30.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:29.999+0000 7fdb5e800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb58103ff0 0x7fdb5819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:30.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:29.999+0000 7fdb5e800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb581049a0 0x7fdb5819ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:30.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.000+0000 7fdb5e800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb58109120 0x7fdb5819ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:30.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.000+0000 7fdb5e800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdb58114150 con 0x7fdb581049a0 2024-09-15T22:23:30.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.000+0000 7fdb5e800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdb58113fd0 con 0x7fdb58109120 2024-09-15T22:23:30.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.000+0000 7fdb5e800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdb581142d0 con 0x7fdb58103ff0 2024-09-15T22:23:30.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.000+0000 7fdb56a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb581049a0 0x7fdb5819ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:30.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.000+0000 7fdb56a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb581049a0 0x7fdb5819ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40322/0 (socket says 172.21.15.1:40322) 2024-09-15T22:23:30.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.000+0000 7fdb56a00640 1 -- 172.21.15.1:0/1013885792 learned_addr learned my addr 172.21.15.1:0/1013885792 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:30.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.000+0000 7fdb57400640 1 --2- 172.21.15.1:0/1013885792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb58103ff0 0x7fdb5819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:30.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.000+0000 7fdb57e00640 1 --2- 172.21.15.1:0/1013885792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb58109120 0x7fdb5819ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:30.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.000+0000 7fdb56a00640 1 -- 172.21.15.1:0/1013885792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb58103ff0 msgr2=0x7fdb5819a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:30.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.000+0000 7fdb56a00640 1 --2- 172.21.15.1:0/1013885792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb58103ff0 0x7fdb5819a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:30.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.000+0000 7fdb56a00640 1 -- 172.21.15.1:0/1013885792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb58109120 msgr2=0x7fdb5819ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:30.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.000+0000 7fdb56a00640 1 --2- 172.21.15.1:0/1013885792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb58109120 0x7fdb5819ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:30.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.000+0000 7fdb56a00640 1 -- 172.21.15.1:0/1013885792 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb5819f5e0 con 0x7fdb581049a0 2024-09-15T22:23:30.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.000+0000 7fdb57400640 1 --2- 172.21.15.1:0/1013885792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb58103ff0 0x7fdb5819a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:23:30.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.001+0000 7fdb56a00640 1 --2- 172.21.15.1:0/1013885792 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb581049a0 0x7fdb5819ab70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400e9f0 tx=0x7fdb4400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:30.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.001+0000 7fdb4fe00640 1 -- 172.21.15.1:0/1013885792 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4400cd80 con 0x7fdb581049a0 2024-09-15T22:23:30.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.001+0000 7fdb4fe00640 1 -- 172.21.15.1:0/1013885792 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb44010910 con 0x7fdb581049a0 2024-09-15T22:23:30.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.001+0000 7fdb5e800640 1 -- 172.21.15.1:0/1013885792 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb5819f8d0 con 0x7fdb581049a0 2024-09-15T22:23:30.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.001+0000 7fdb4fe00640 1 -- 172.21.15.1:0/1013885792 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb44018990 con 0x7fdb581049a0 2024-09-15T22:23:30.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.001+0000 7fdb5e800640 1 -- 172.21.15.1:0/1013885792 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb581a71b0 con 0x7fdb581049a0 2024-09-15T22:23:30.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.002+0000 7fdb5e800640 1 -- 172.21.15.1:0/1013885792 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb581043d0 con 0x7fdb581049a0 2024-09-15T22:23:30.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.005+0000 7fdb4fe00640 1 -- 172.21.15.1:0/1013885792 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fdb44010ac0 con 0x7fdb581049a0 2024-09-15T22:23:30.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.007+0000 7fdb4fe00640 1 --2- 172.21.15.1:0/1013885792 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fdb3c0a32d0 0x7fdb3c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:30.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.007+0000 7fdb4fe00640 1 -- 172.21.15.1:0/1013885792 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fdb440cfc80 con 0x7fdb581049a0 2024-09-15T22:23:30.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.007+0000 7fdb57400640 1 --2- 172.21.15.1:0/1013885792 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fdb3c0a32d0 0x7fdb3c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:30.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.008+0000 7fdb57400640 1 --2- 172.21.15.1:0/1013885792 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fdb3c0a32d0 0x7fdb3c0a5790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009fc0 tx=0x7fdb48005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:30.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.012+0000 7fdb4fe00640 1 -- 172.21.15.1:0/1013885792 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdb4409c2a0 con 0x7fdb581049a0 2024-09-15T22:23:30.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.246+0000 7fdb5e800640 1 -- 172.21.15.1:0/1013885792 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fdb581a7410 con 0x7fdb581049a0 2024-09-15T22:23:30.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.251+0000 7fdb4fe00640 1 -- 172.21.15.1:0/1013885792 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264039 (secure 0 0 0) 0x7fdb440a05a0 con 0x7fdb581049a0 2024-09-15T22:23:30.258 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:23:30.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.256+0000 7fdb5e800640 1 -- 172.21.15.1:0/1013885792 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fdb3c0a32d0 msgr2=0x7fdb3c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:30.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.256+0000 7fdb5e800640 1 --2- 172.21.15.1:0/1013885792 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fdb3c0a32d0 0x7fdb3c0a5790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009fc0 tx=0x7fdb48005f90 comp rx=0 tx=0).stop 2024-09-15T22:23:30.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.256+0000 7fdb5e800640 1 -- 172.21.15.1:0/1013885792 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb581049a0 msgr2=0x7fdb5819ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:30.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.256+0000 7fdb5e800640 1 --2- 172.21.15.1:0/1013885792 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb581049a0 0x7fdb5819ab70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400e9f0 tx=0x7fdb4400eeb0 comp rx=0 tx=0).stop 2024-09-15T22:23:30.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.257+0000 7fdb5e800640 1 -- 172.21.15.1:0/1013885792 shutdown_connections 2024-09-15T22:23:30.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.257+0000 7fdb5e800640 1 --2- 172.21.15.1:0/1013885792 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fdb3c0a32d0 0x7fdb3c0a5790 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:30.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.257+0000 7fdb5e800640 1 --2- 172.21.15.1:0/1013885792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb58109120 0x7fdb5819ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:30.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.257+0000 7fdb5e800640 1 --2- 172.21.15.1:0/1013885792 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb581049a0 0x7fdb5819ab70 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:30.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.257+0000 7fdb5e800640 1 --2- 172.21.15.1:0/1013885792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb58103ff0 0x7fdb5819a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:30.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.257+0000 7fdb5e800640 1 -- 172.21.15.1:0/1013885792 >> 172.21.15.1:0/1013885792 conn(0x7fdb580ffa90 msgr2=0x7fdb581005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:30.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.257+0000 7fdb5e800640 1 -- 172.21.15.1:0/1013885792 shutdown_connections 2024-09-15T22:23:30.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:30.257+0000 7fdb5e800640 1 -- 172.21.15.1:0/1013885792 wait complete. 2024-09-15T22:23:31.052 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":3816767836},{"type":"v1","addr":"172.21.15.1:6801","nonce":3816767836}]},"active_addr":"172.21.15.1:6801/3816767836","active_change":"2024-09-15T22:15:31.433526+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.1:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":379317950}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":2728247418}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":193522291}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":1354528810}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":2531306855}]}]} 2024-09-15T22:23:31.059 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-15T22:23:31.059 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-15T22:23:31.060 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:23:31.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:30 smithi012 ceph-mon[34883]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.4 KiB/s wr, 8 op/s 2024-09-15T22:23:31.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:30 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/1013885792' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-15T22:23:31.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:30 smithi098 ceph-mon[35514]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.4 KiB/s wr, 8 op/s 2024-09-15T22:23:31.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:30 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/1013885792' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-15T22:23:31.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:30 smithi001 ceph-mon[30843]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.4 KiB/s wr, 8 op/s 2024-09-15T22:23:31.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:30 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/1013885792' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-15T22:23:31.434 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:32.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.027+0000 7f17a4000640 1 -- 172.21.15.1:0/1733797848 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f179c103ff0 msgr2=0x7f179c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:32.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.027+0000 7f17a4000640 1 --2- 172.21.15.1:0/1733797848 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f179c103ff0 0x7f179c1043d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1790009900 tx=0x7f179002a410 comp rx=0 tx=0).stop 2024-09-15T22:23:32.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.027+0000 7f17a4000640 1 -- 172.21.15.1:0/1733797848 shutdown_connections 2024-09-15T22:23:32.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.027+0000 7f17a4000640 1 --2- 172.21.15.1:0/1733797848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f179c109120 0x7f179c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:32.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.027+0000 7f17a4000640 1 --2- 172.21.15.1:0/1733797848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f179c1049a0 0x7f179c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:32.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.027+0000 7f17a4000640 1 --2- 172.21.15.1:0/1733797848 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f179c103ff0 0x7f179c1043d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:32.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.027+0000 7f17a4000640 1 -- 172.21.15.1:0/1733797848 >> 172.21.15.1:0/1733797848 conn(0x7f179c0ffa90 msgr2=0x7f179c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:32.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.027+0000 7f17a4000640 1 -- 172.21.15.1:0/1733797848 shutdown_connections 2024-09-15T22:23:32.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.027+0000 7f17a4000640 1 -- 172.21.15.1:0/1733797848 wait complete. 2024-09-15T22:23:32.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.028+0000 7f17a4000640 1 Processor -- start 2024-09-15T22:23:32.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.028+0000 7f17a4000640 1 -- start start 2024-09-15T22:23:32.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.029+0000 7f17a4000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f179c103ff0 0x7f179c19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:32.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.029+0000 7f17a4000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f179c1049a0 0x7f179c19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:32.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.029+0000 7f17a4000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f179c109120 0x7f179c19eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:32.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.029+0000 7f17a4000640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f179c1141a0 con 0x7f179c109120 2024-09-15T22:23:32.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.029+0000 7f17a4000640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f179c114020 con 0x7f179c1049a0 2024-09-15T22:23:32.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.029+0000 7f17a4000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f179c114320 con 0x7f179c103ff0 2024-09-15T22:23:32.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.029+0000 7f17a2000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f179c109120 0x7f179c19eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:32.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.029+0000 7f17a2000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f179c109120 0x7f179c19eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40344/0 (socket says 172.21.15.1:40344) 2024-09-15T22:23:32.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.029+0000 7f17a2000640 1 -- 172.21.15.1:0/6532701 learned_addr learned my addr 172.21.15.1:0/6532701 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:32.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.029+0000 7f17a1600640 1 --2- 172.21.15.1:0/6532701 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f179c103ff0 0x7f179c19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:32.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.029+0000 7f17a0c00640 1 --2- 172.21.15.1:0/6532701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f179c1049a0 0x7f179c19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:32.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.029+0000 7f17a2000640 1 -- 172.21.15.1:0/6532701 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f179c103ff0 msgr2=0x7f179c19a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:32.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.029+0000 7f17a2000640 1 --2- 172.21.15.1:0/6532701 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f179c103ff0 0x7f179c19a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:32.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.029+0000 7f17a2000640 1 -- 172.21.15.1:0/6532701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f179c1049a0 msgr2=0x7f179c19ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:32.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.029+0000 7f17a2000640 1 --2- 172.21.15.1:0/6532701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f179c1049a0 0x7f179c19ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:32.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.029+0000 7f17a2000640 1 -- 172.21.15.1:0/6532701 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f179c19f5d0 con 0x7f179c109120 2024-09-15T22:23:32.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.030+0000 7f17a2000640 1 --2- 172.21.15.1:0/6532701 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f179c109120 0x7f179c19eef0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f179400eaa0 tx=0x7f179400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:32.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.030+0000 7f179a000640 1 -- 172.21.15.1:0/6532701 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179400cdb0 con 0x7f179c109120 2024-09-15T22:23:32.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.030+0000 7f179a000640 1 -- 172.21.15.1:0/6532701 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1794005020 con 0x7f179c109120 2024-09-15T22:23:32.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.030+0000 7f17a4000640 1 -- 172.21.15.1:0/6532701 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f179c19f8c0 con 0x7f179c109120 2024-09-15T22:23:32.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.030+0000 7f179a000640 1 -- 172.21.15.1:0/6532701 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17940116b0 con 0x7f179c109120 2024-09-15T22:23:32.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.030+0000 7f17a4000640 1 -- 172.21.15.1:0/6532701 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f179c1a71a0 con 0x7f179c109120 2024-09-15T22:23:32.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.031+0000 7f17a4000640 1 -- 172.21.15.1:0/6532701 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f179c1043d0 con 0x7f179c109120 2024-09-15T22:23:32.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.033+0000 7f179a000640 1 -- 172.21.15.1:0/6532701 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f1794005560 con 0x7f179c109120 2024-09-15T22:23:32.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.034+0000 7f179a000640 1 --2- 172.21.15.1:0/6532701 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f17840a32d0 0x7f17840a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:32.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.034+0000 7f179a000640 1 -- 172.21.15.1:0/6532701 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7f17940cfc10 con 0x7f179c109120 2024-09-15T22:23:32.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.035+0000 7f17a1600640 1 --2- 172.21.15.1:0/6532701 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f17840a32d0 0x7f17840a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:32.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.035+0000 7f17a1600640 1 --2- 172.21.15.1:0/6532701 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f17840a32d0 0x7f17840a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1790000c00 tx=0x7f1790005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:32.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.039+0000 7f179a000640 1 -- 172.21.15.1:0/6532701 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1794016030 con 0x7f179c109120 2024-09-15T22:23:32.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.225+0000 7f17a4000640 1 -- 172.21.15.1:0/6532701 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f179c02d7c0 con 0x7f179c109120 2024-09-15T22:23:32.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:31 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-15T22:23:32.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:31 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4, 8, 11]}]: dispatch 2024-09-15T22:23:32.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:31 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-09-15T22:23:32.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:31 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-09-15T22:23:32.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:31 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]: dispatch 2024-09-15T22:23:32.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:31 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]: dispatch 2024-09-15T22:23:32.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:31 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]: dispatch 2024-09-15T22:23:32.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:31 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-09-15T22:23:32.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:31 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 6]}]: dispatch 2024-09-15T22:23:32.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.227+0000 7f179a000640 1 -- 172.21.15.1:0/6532701 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22647 (secure 0 0 0) 0x7f179409c110 con 0x7f179c109120 2024-09-15T22:23:32.230 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:23:32.230 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":83,"fsid":"c1228c44-73af-11ef-bceb-c7b262605968","created":"2024-09-15T22:14:39.004556+0000","modified":"2024-09-15T22:23:31.898325+0000","last_up_change":"2024-09-15T22:21:53.270221+0000","last_in_change":"2024-09-15T22:21:30.911945+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:17:56.059390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:22:47.262081+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:22:49.746577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28228d47-bbb7-4103-a4fb-3e126769f8bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6803","nonce":3588868833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6805","nonce":3588868833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6809","nonce":3588868833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6807","nonce":3588868833}]},"public_addr":"172.21.15.1:6803/3588868833","cluster_addr":"172.21.15.1:6805/3588868833","heartbeat_back_addr":"172.21.15.1:6809/3588868833","heartbeat_front_addr":"172.21.15.1:6807/3588868833","state":["exists","up"]},{"osd":1,"uuid":"d90dd2c1-2047-4491-8730-30793a354aa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6801","nonce":3951165354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6803","nonce":3951165354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6807","nonce":3951165354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6805","nonce":3951165354}]},"public_addr":"172.21.15.12:6801/3951165354","cluster_addr":"172.21.15.12:6803/3951165354","heartbeat_back_addr":"172.21.15.12:6807/3951165354","heartbeat_front_addr":"172.21.15.12:6805/3951165354","state":["exists","up"]},{"osd":2,"uuid":"22e38f44-88d3-4461-a57e-6dc4857ec48f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6801","nonce":1633982971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6803","nonce":1633982971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6807","nonce":1633982971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6805","nonce":1633982971}]},"public_addr":"172.21.15.98:6801/1633982971","cluster_addr":"172.21.15.98:6803/1633982971","heartbeat_back_addr":"172.21.15.98:6807/1633982971","heartbeat_front_addr":"172.21.15.98:6805/1633982971","state":["exists","up"]},{"osd":3,"uuid":"dd9d6e97-af81-442a-ac0d-543e440a8d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6811","nonce":3706738461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6813","nonce":3706738461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6817","nonce":3706738461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6815","nonce":3706738461}]},"public_addr":"172.21.15.1:6811/3706738461","cluster_addr":"172.21.15.1:6813/3706738461","heartbeat_back_addr":"172.21.15.1:6817/3706738461","heartbeat_front_addr":"172.21.15.1:6815/3706738461","state":["exists","up"]},{"osd":4,"uuid":"50116baa-dd99-4dbb-a7a1-2268f04052f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6809","nonce":4057902964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6811","nonce":4057902964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6815","nonce":4057902964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6813","nonce":4057902964}]},"public_addr":"172.21.15.12:6809/4057902964","cluster_addr":"172.21.15.12:6811/4057902964","heartbeat_back_addr":"172.21.15.12:6815/4057902964","heartbeat_front_addr":"172.21.15.12:6813/4057902964","state":["exists","up"]},{"osd":5,"uuid":"56ab0694-2f21-46c4-a086-44f72c271c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6809","nonce":4043567619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6811","nonce":4043567619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6815","nonce":4043567619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6813","nonce":4043567619}]},"public_addr":"172.21.15.98:6809/4043567619","cluster_addr":"172.21.15.98:6811/4043567619","heartbeat_back_addr":"172.21.15.98:6815/4043567619","heartbeat_front_addr":"172.21.15.98:6813/4043567619","state":["exists","up"]},{"osd":6,"uuid":"5ca0d114-4894-428e-bcd3-2ebd24d10a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6819","nonce":2236861161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6821","nonce":2236861161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6825","nonce":2236861161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6823","nonce":2236861161}]},"public_addr":"172.21.15.1:6819/2236861161","cluster_addr":"172.21.15.1:6821/2236861161","heartbeat_back_addr":"172.21.15.1:6825/2236861161","heartbeat_front_addr":"172.21.15.1:6823/2236861161","state":["exists","up"]},{"osd":7,"uuid":"db99cc6e-1717-4958-bf11-65aca94476b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6817","nonce":133202448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6819","nonce":133202448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6823","nonce":133202448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6821","nonce":133202448}]},"public_addr":"172.21.15.12:6817/133202448","cluster_addr":"172.21.15.12:6819/133202448","heartbeat_back_addr":"172.21.15.12:6823/133202448","heartbeat_front_addr":"172.21.15.12:6821/133202448","state":["exists","up"]},{"osd":8,"uuid":"4d3b6574-49f7-47f6-b36b-4da14ca290f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6817","nonce":3701478409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6819","nonce":3701478409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6823","nonce":3701478409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6821","nonce":3701478409}]},"public_addr":"172.21.15.98:6817/3701478409","cluster_addr":"172.21.15.98:6819/3701478409","heartbeat_back_addr":"172.21.15.98:6823/3701478409","heartbeat_front_addr":"172.21.15.98:6821/3701478409","state":["exists","up"]},{"osd":9,"uuid":"7dd2fe25-1b75-48e5-86c7-c7a3ab85053f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6827","nonce":2580755002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6829","nonce":2580755002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6833","nonce":2580755002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6831","nonce":2580755002}]},"public_addr":"172.21.15.1:6827/2580755002","cluster_addr":"172.21.15.1:6829/2580755002","heartbeat_back_addr":"172.21.15.1:6833/2580755002","heartbeat_front_addr":"172.21.15.1:6831/2580755002","state":["exists","up"]},{"osd":10,"uuid":"fcad11dc-0a1b-44a2-ac32-74100e317255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6825","nonce":3989063573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6827","nonce":3989063573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6831","nonce":3989063573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6829","nonce":3989063573}]},"public_addr":"172.21.15.12:6825/3989063573","cluster_addr":"172.21.15.12:6827/3989063573","heartbeat_back_addr":"172.21.15.12:6831/3989063573","heartbeat_front_addr":"172.21.15.12:6829/3989063573","state":["exists","up"]},{"osd":11,"uuid":"f4e717bb-586d-4fe2-9e6b-f574be4db36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6825","nonce":839956167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6827","nonce":839956167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6831","nonce":839956167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6829","nonce":839956167}]},"public_addr":"172.21.15.98:6825/839956167","cluster_addr":"172.21.15.98:6827/839956167","heartbeat_back_addr":"172.21.15.98:6831/839956167","heartbeat_front_addr":"172.21.15.98:6829/839956167","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:17:01.990618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:17:28.259003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:17:52.825080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:18:22.724038+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:18:48.383663+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:19:13.246563+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:19:42.318469+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:20:08.809160+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:20:32.628925+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:21:02.280217+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:21:27.897758+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:21:52.055015+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6800/3145051160":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/3101438101":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/4159811089":"2024-09-16T22:15:31.433375+0000","172.21.15.1:6801/3145051160":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/2785155592":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/714180295":"2024-09-16T22:15:03.937536+0000","172.21.15.1:6801/215291238":"2024-09-16T22:15:03.937536+0000","172.21.15.1:6800/215291238":"2024-09-16T22:15:03.937536+0000","172.21.15.1:0/1842817732":"2024-09-16T22:15:03.937536+0000","172.21.15.1:0/3888009741":"2024-09-16T22:15:03.937536+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:23:32.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.229+0000 7f17a4000640 1 -- 172.21.15.1:0/6532701 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f17840a32d0 msgr2=0x7f17840a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:32.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.229+0000 7f17a4000640 1 --2- 172.21.15.1:0/6532701 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f17840a32d0 0x7f17840a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1790000c00 tx=0x7f1790005b50 comp rx=0 tx=0).stop 2024-09-15T22:23:32.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.229+0000 7f17a4000640 1 -- 172.21.15.1:0/6532701 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f179c109120 msgr2=0x7f179c19eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:32.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.229+0000 7f17a4000640 1 --2- 172.21.15.1:0/6532701 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f179c109120 0x7f179c19eef0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f179400eaa0 tx=0x7f179400ef60 comp rx=0 tx=0).stop 2024-09-15T22:23:32.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.229+0000 7f17a4000640 1 -- 172.21.15.1:0/6532701 shutdown_connections 2024-09-15T22:23:32.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.229+0000 7f17a4000640 1 --2- 172.21.15.1:0/6532701 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f17840a32d0 0x7f17840a5790 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:32.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.229+0000 7f17a4000640 1 --2- 172.21.15.1:0/6532701 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f179c109120 0x7f179c19eef0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:32.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.229+0000 7f17a4000640 1 --2- 172.21.15.1:0/6532701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f179c1049a0 0x7f179c19ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:32.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.229+0000 7f17a4000640 1 --2- 172.21.15.1:0/6532701 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f179c103ff0 0x7f179c19a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:32.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.229+0000 7f17a4000640 1 -- 172.21.15.1:0/6532701 >> 172.21.15.1:0/6532701 conn(0x7f179c0ffa90 msgr2=0x7f179c100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:32.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.229+0000 7f17a4000640 1 -- 172.21.15.1:0/6532701 shutdown_connections 2024-09-15T22:23:32.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:32.229+0000 7f17a4000640 1 -- 172.21.15.1:0/6532701 wait complete. 2024-09-15T22:23:32.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:31 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-15T22:23:32.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:31 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4, 8, 11]}]: dispatch 2024-09-15T22:23:32.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:31 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-09-15T22:23:32.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:31 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-09-15T22:23:32.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:31 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]: dispatch 2024-09-15T22:23:32.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:31 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]: dispatch 2024-09-15T22:23:32.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:31 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]: dispatch 2024-09-15T22:23:32.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:31 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-09-15T22:23:32.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:31 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 6]}]: dispatch 2024-09-15T22:23:32.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:31 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-15T22:23:32.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:31 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4, 8, 11]}]: dispatch 2024-09-15T22:23:32.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:31 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-09-15T22:23:32.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:31 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-09-15T22:23:32.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:31 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]: dispatch 2024-09-15T22:23:32.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:31 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]: dispatch 2024-09-15T22:23:32.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:31 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]: dispatch 2024-09-15T22:23:32.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:31 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-09-15T22:23:32.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:31 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 6]}]: dispatch 2024-09-15T22:23:33.037 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-15T22:23:33.037 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:23:33.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:32 smithi012 ceph-mon[34883]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-15T22:23:33.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:32 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-15T22:23:33.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:32 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4, 8, 11]}]': finished 2024-09-15T22:23:33.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:32 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-09-15T22:23:33.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:32 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-09-15T22:23:33.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:32 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]': finished 2024-09-15T22:23:33.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:32 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]': finished 2024-09-15T22:23:33.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:32 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]': finished 2024-09-15T22:23:33.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:32 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-15T22:23:33.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:32 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 6]}]': finished 2024-09-15T22:23:33.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:32 smithi012 ceph-mon[34883]: osdmap e83: 12 total, 12 up, 12 in 2024-09-15T22:23:33.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:32 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/6532701' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:23:33.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:32 smithi098 ceph-mon[35514]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-15T22:23:33.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:32 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-15T22:23:33.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:32 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4, 8, 11]}]': finished 2024-09-15T22:23:33.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:32 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-09-15T22:23:33.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:32 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-09-15T22:23:33.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:32 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]': finished 2024-09-15T22:23:33.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:32 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]': finished 2024-09-15T22:23:33.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:32 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]': finished 2024-09-15T22:23:33.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:32 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-15T22:23:33.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:32 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 6]}]': finished 2024-09-15T22:23:33.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:32 smithi098 ceph-mon[35514]: osdmap e83: 12 total, 12 up, 12 in 2024-09-15T22:23:33.312 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:32 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/6532701' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:23:33.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:32 smithi001 ceph-mon[30843]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-15T22:23:33.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:32 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-15T22:23:33.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:32 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4, 8, 11]}]': finished 2024-09-15T22:23:33.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:32 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-09-15T22:23:33.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:32 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-09-15T22:23:33.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:32 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]': finished 2024-09-15T22:23:33.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:32 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]': finished 2024-09-15T22:23:33.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:32 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]': finished 2024-09-15T22:23:33.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:32 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-15T22:23:33.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:32 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 6]}]': finished 2024-09-15T22:23:33.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:32 smithi001 ceph-mon[30843]: osdmap e83: 12 total, 12 up, 12 in 2024-09-15T22:23:33.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:32 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/6532701' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:23:33.412 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:34.115 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:33 smithi001 ceph-mon[30843]: osdmap e84: 12 total, 12 up, 12 in 2024-09-15T22:23:34.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.113+0000 7fc1df200640 1 -- 172.21.15.1:0/1618691191 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1e0108f60 msgr2=0x7fc1e0110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:34.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.113+0000 7fc1df200640 1 --2- 172.21.15.1:0/1618691191 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1e0108f60 0x7fc1e0110ae0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8009900 tx=0x7fc1d802a410 comp rx=0 tx=0).stop 2024-09-15T22:23:34.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.113+0000 7fc1df200640 1 -- 172.21.15.1:0/1618691191 shutdown_connections 2024-09-15T22:23:34.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.113+0000 7fc1df200640 1 --2- 172.21.15.1:0/1618691191 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1e0108f60 0x7fc1e0110ae0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:34.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.113+0000 7fc1df200640 1 --2- 172.21.15.1:0/1618691191 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1e01047e0 0x7fc1e0108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:34.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.113+0000 7fc1df200640 1 --2- 172.21.15.1:0/1618691191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1e0103e30 0x7fc1e0104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:34.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.113+0000 7fc1df200640 1 -- 172.21.15.1:0/1618691191 >> 172.21.15.1:0/1618691191 conn(0x7fc1e00ff8d0 msgr2=0x7fc1e0101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:34.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.113+0000 7fc1df200640 1 -- 172.21.15.1:0/1618691191 shutdown_connections 2024-09-15T22:23:34.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.113+0000 7fc1df200640 1 -- 172.21.15.1:0/1618691191 wait complete. 2024-09-15T22:23:34.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.114+0000 7fc1df200640 1 Processor -- start 2024-09-15T22:23:34.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.114+0000 7fc1df200640 1 -- start start 2024-09-15T22:23:34.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.115+0000 7fc1df200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1e0103e30 0x7fc1e019a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:34.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.115+0000 7fc1df200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1e01047e0 0x7fc1e019a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:34.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.115+0000 7fc1df200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1e0108f60 0x7fc1e019ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:34.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.115+0000 7fc1df200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e0114010 con 0x7fc1e0108f60 2024-09-15T22:23:34.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.115+0000 7fc1df200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e0113e90 con 0x7fc1e01047e0 2024-09-15T22:23:34.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.115+0000 7fc1df200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e0114190 con 0x7fc1e0103e30 2024-09-15T22:23:34.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.115+0000 7fc1dde00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1e0103e30 0x7fc1e019a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:34.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.115+0000 7fc1de800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1e0108f60 0x7fc1e019ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:34.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.115+0000 7fc1dde00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1e0103e30 0x7fc1e019a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:34244/0 (socket says 172.21.15.1:34244) 2024-09-15T22:23:34.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.115+0000 7fc1dde00640 1 -- 172.21.15.1:0/1380834367 learned_addr learned my addr 172.21.15.1:0/1380834367 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:34.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.115+0000 7fc1d5400640 1 --2- 172.21.15.1:0/1380834367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1e01047e0 0x7fc1e019a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:34.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.115+0000 7fc1de800640 1 -- 172.21.15.1:0/1380834367 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1e0103e30 msgr2=0x7fc1e019a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:34.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.115+0000 7fc1de800640 1 --2- 172.21.15.1:0/1380834367 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1e0103e30 0x7fc1e019a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:34.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.115+0000 7fc1de800640 1 -- 172.21.15.1:0/1380834367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1e01047e0 msgr2=0x7fc1e019a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:34.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.115+0000 7fc1de800640 1 --2- 172.21.15.1:0/1380834367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1e01047e0 0x7fc1e019a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:34.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.115+0000 7fc1de800640 1 -- 172.21.15.1:0/1380834367 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e019f3a0 con 0x7fc1e0108f60 2024-09-15T22:23:34.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.116+0000 7fc1de800640 1 --2- 172.21.15.1:0/1380834367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1e0108f60 0x7fc1e019ecc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc1d802a930 tx=0x7fc1d8003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:34.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.116+0000 7fc1d7400640 1 -- 172.21.15.1:0/1380834367 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d803f070 con 0x7fc1e0108f60 2024-09-15T22:23:34.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.116+0000 7fc1d7400640 1 -- 172.21.15.1:0/1380834367 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1d8031c90 con 0x7fc1e0108f60 2024-09-15T22:23:34.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.116+0000 7fc1d7400640 1 -- 172.21.15.1:0/1380834367 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d8035030 con 0x7fc1e0108f60 2024-09-15T22:23:34.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.116+0000 7fc1df200640 1 -- 172.21.15.1:0/1380834367 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1e019f630 con 0x7fc1e0108f60 2024-09-15T22:23:34.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.116+0000 7fc1df200640 1 -- 172.21.15.1:0/1380834367 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1e019fa90 con 0x7fc1e0108f60 2024-09-15T22:23:34.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.117+0000 7fc1df200640 1 -- 172.21.15.1:0/1380834367 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1e0104210 con 0x7fc1e0108f60 2024-09-15T22:23:34.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.119+0000 7fc1d7400640 1 -- 172.21.15.1:0/1380834367 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fc1d8042070 con 0x7fc1e0108f60 2024-09-15T22:23:34.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.120+0000 7fc1d7400640 1 --2- 172.21.15.1:0/1380834367 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc1c40a3350 0x7fc1c40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:34.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.121+0000 7fc1d7400640 1 -- 172.21.15.1:0/1380834367 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fc1d80f00d0 con 0x7fc1e0108f60 2024-09-15T22:23:34.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.121+0000 7fc1dde00640 1 --2- 172.21.15.1:0/1380834367 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc1c40a3350 0x7fc1c40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:34.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.121+0000 7fc1dde00640 1 --2- 172.21.15.1:0/1380834367 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc1c40a3350 0x7fc1c40a5810 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0009fd0 tx=0x7fc1d0009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:34.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.124+0000 7fc1d7400640 1 -- 172.21.15.1:0/1380834367 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc1d80bc5d0 con 0x7fc1e0108f60 2024-09-15T22:23:34.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:33 smithi012 ceph-mon[34883]: osdmap e84: 12 total, 12 up, 12 in 2024-09-15T22:23:34.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:33 smithi098 ceph-mon[35514]: osdmap e84: 12 total, 12 up, 12 in 2024-09-15T22:23:34.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.357+0000 7fc1df200640 1 -- 172.21.15.1:0/1380834367 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc1e01a7120 con 0x7fc1e0108f60 2024-09-15T22:23:34.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.359+0000 7fc1d7400640 1 -- 172.21.15.1:0/1380834367 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22647 (secure 0 0 0) 0x7fc1d80c08d0 con 0x7fc1e0108f60 2024-09-15T22:23:34.361 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:23:34.361 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":84,"fsid":"c1228c44-73af-11ef-bceb-c7b262605968","created":"2024-09-15T22:14:39.004556+0000","modified":"2024-09-15T22:23:32.904008+0000","last_up_change":"2024-09-15T22:21:53.270221+0000","last_in_change":"2024-09-15T22:21:30.911945+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:17:56.059390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:22:47.262081+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:22:49.746577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28228d47-bbb7-4103-a4fb-3e126769f8bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6803","nonce":3588868833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6805","nonce":3588868833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6809","nonce":3588868833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6807","nonce":3588868833}]},"public_addr":"172.21.15.1:6803/3588868833","cluster_addr":"172.21.15.1:6805/3588868833","heartbeat_back_addr":"172.21.15.1:6809/3588868833","heartbeat_front_addr":"172.21.15.1:6807/3588868833","state":["exists","up"]},{"osd":1,"uuid":"d90dd2c1-2047-4491-8730-30793a354aa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6801","nonce":3951165354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6803","nonce":3951165354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6807","nonce":3951165354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6805","nonce":3951165354}]},"public_addr":"172.21.15.12:6801/3951165354","cluster_addr":"172.21.15.12:6803/3951165354","heartbeat_back_addr":"172.21.15.12:6807/3951165354","heartbeat_front_addr":"172.21.15.12:6805/3951165354","state":["exists","up"]},{"osd":2,"uuid":"22e38f44-88d3-4461-a57e-6dc4857ec48f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6801","nonce":1633982971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6803","nonce":1633982971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6807","nonce":1633982971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6805","nonce":1633982971}]},"public_addr":"172.21.15.98:6801/1633982971","cluster_addr":"172.21.15.98:6803/1633982971","heartbeat_back_addr":"172.21.15.98:6807/1633982971","heartbeat_front_addr":"172.21.15.98:6805/1633982971","state":["exists","up"]},{"osd":3,"uuid":"dd9d6e97-af81-442a-ac0d-543e440a8d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6811","nonce":3706738461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6813","nonce":3706738461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6817","nonce":3706738461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6815","nonce":3706738461}]},"public_addr":"172.21.15.1:6811/3706738461","cluster_addr":"172.21.15.1:6813/3706738461","heartbeat_back_addr":"172.21.15.1:6817/3706738461","heartbeat_front_addr":"172.21.15.1:6815/3706738461","state":["exists","up"]},{"osd":4,"uuid":"50116baa-dd99-4dbb-a7a1-2268f04052f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6809","nonce":4057902964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6811","nonce":4057902964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6815","nonce":4057902964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6813","nonce":4057902964}]},"public_addr":"172.21.15.12:6809/4057902964","cluster_addr":"172.21.15.12:6811/4057902964","heartbeat_back_addr":"172.21.15.12:6815/4057902964","heartbeat_front_addr":"172.21.15.12:6813/4057902964","state":["exists","up"]},{"osd":5,"uuid":"56ab0694-2f21-46c4-a086-44f72c271c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6809","nonce":4043567619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6811","nonce":4043567619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6815","nonce":4043567619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6813","nonce":4043567619}]},"public_addr":"172.21.15.98:6809/4043567619","cluster_addr":"172.21.15.98:6811/4043567619","heartbeat_back_addr":"172.21.15.98:6815/4043567619","heartbeat_front_addr":"172.21.15.98:6813/4043567619","state":["exists","up"]},{"osd":6,"uuid":"5ca0d114-4894-428e-bcd3-2ebd24d10a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6819","nonce":2236861161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6821","nonce":2236861161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6825","nonce":2236861161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6823","nonce":2236861161}]},"public_addr":"172.21.15.1:6819/2236861161","cluster_addr":"172.21.15.1:6821/2236861161","heartbeat_back_addr":"172.21.15.1:6825/2236861161","heartbeat_front_addr":"172.21.15.1:6823/2236861161","state":["exists","up"]},{"osd":7,"uuid":"db99cc6e-1717-4958-bf11-65aca94476b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6817","nonce":133202448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6819","nonce":133202448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6823","nonce":133202448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6821","nonce":133202448}]},"public_addr":"172.21.15.12:6817/133202448","cluster_addr":"172.21.15.12:6819/133202448","heartbeat_back_addr":"172.21.15.12:6823/133202448","heartbeat_front_addr":"172.21.15.12:6821/133202448","state":["exists","up"]},{"osd":8,"uuid":"4d3b6574-49f7-47f6-b36b-4da14ca290f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6817","nonce":3701478409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6819","nonce":3701478409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6823","nonce":3701478409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6821","nonce":3701478409}]},"public_addr":"172.21.15.98:6817/3701478409","cluster_addr":"172.21.15.98:6819/3701478409","heartbeat_back_addr":"172.21.15.98:6823/3701478409","heartbeat_front_addr":"172.21.15.98:6821/3701478409","state":["exists","up"]},{"osd":9,"uuid":"7dd2fe25-1b75-48e5-86c7-c7a3ab85053f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6827","nonce":2580755002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6829","nonce":2580755002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6833","nonce":2580755002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6831","nonce":2580755002}]},"public_addr":"172.21.15.1:6827/2580755002","cluster_addr":"172.21.15.1:6829/2580755002","heartbeat_back_addr":"172.21.15.1:6833/2580755002","heartbeat_front_addr":"172.21.15.1:6831/2580755002","state":["exists","up"]},{"osd":10,"uuid":"fcad11dc-0a1b-44a2-ac32-74100e317255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6825","nonce":3989063573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6827","nonce":3989063573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6831","nonce":3989063573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6829","nonce":3989063573}]},"public_addr":"172.21.15.12:6825/3989063573","cluster_addr":"172.21.15.12:6827/3989063573","heartbeat_back_addr":"172.21.15.12:6831/3989063573","heartbeat_front_addr":"172.21.15.12:6829/3989063573","state":["exists","up"]},{"osd":11,"uuid":"f4e717bb-586d-4fe2-9e6b-f574be4db36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6825","nonce":839956167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6827","nonce":839956167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6831","nonce":839956167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6829","nonce":839956167}]},"public_addr":"172.21.15.98:6825/839956167","cluster_addr":"172.21.15.98:6827/839956167","heartbeat_back_addr":"172.21.15.98:6831/839956167","heartbeat_front_addr":"172.21.15.98:6829/839956167","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:17:01.990618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:17:28.259003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:17:52.825080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:18:22.724038+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:18:48.383663+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:19:13.246563+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:19:42.318469+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:20:08.809160+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:20:32.628925+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:21:02.280217+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:21:27.897758+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:21:52.055015+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6800/3145051160":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/3101438101":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/4159811089":"2024-09-16T22:15:31.433375+0000","172.21.15.1:6801/3145051160":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/2785155592":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/714180295":"2024-09-16T22:15:03.937536+0000","172.21.15.1:6801/215291238":"2024-09-16T22:15:03.937536+0000","172.21.15.1:6800/215291238":"2024-09-16T22:15:03.937536+0000","172.21.15.1:0/1842817732":"2024-09-16T22:15:03.937536+0000","172.21.15.1:0/3888009741":"2024-09-16T22:15:03.937536+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:23:34.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.361+0000 7fc1df200640 1 -- 172.21.15.1:0/1380834367 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc1c40a3350 msgr2=0x7fc1c40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:34.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.361+0000 7fc1df200640 1 --2- 172.21.15.1:0/1380834367 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc1c40a3350 0x7fc1c40a5810 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0009fd0 tx=0x7fc1d0009500 comp rx=0 tx=0).stop 2024-09-15T22:23:34.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.361+0000 7fc1df200640 1 -- 172.21.15.1:0/1380834367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1e0108f60 msgr2=0x7fc1e019ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:34.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.361+0000 7fc1df200640 1 --2- 172.21.15.1:0/1380834367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1e0108f60 0x7fc1e019ecc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc1d802a930 tx=0x7fc1d8003b90 comp rx=0 tx=0).stop 2024-09-15T22:23:34.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.361+0000 7fc1df200640 1 -- 172.21.15.1:0/1380834367 shutdown_connections 2024-09-15T22:23:34.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.361+0000 7fc1df200640 1 --2- 172.21.15.1:0/1380834367 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc1c40a3350 0x7fc1c40a5810 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:34.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.361+0000 7fc1df200640 1 --2- 172.21.15.1:0/1380834367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1e0108f60 0x7fc1e019ecc0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:34.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.361+0000 7fc1df200640 1 --2- 172.21.15.1:0/1380834367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1e01047e0 0x7fc1e019a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:34.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.361+0000 7fc1df200640 1 --2- 172.21.15.1:0/1380834367 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1e0103e30 0x7fc1e019a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:34.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.361+0000 7fc1df200640 1 -- 172.21.15.1:0/1380834367 >> 172.21.15.1:0/1380834367 conn(0x7fc1e00ff8d0 msgr2=0x7fc1e0101cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:34.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.361+0000 7fc1df200640 1 -- 172.21.15.1:0/1380834367 shutdown_connections 2024-09-15T22:23:34.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:34.362+0000 7fc1df200640 1 -- 172.21.15.1:0/1380834367 wait complete. 2024-09-15T22:23:35.088 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:34 smithi001 ceph-mon[30843]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-15T22:23:35.089 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:34 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/1380834367' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:23:35.128 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-15T22:23:35.129 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-15T22:23:35.129 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-15T22:23:35.130 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-15T22:23:35.130 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-15T22:23:35.130 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-15T22:23:35.131 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-15T22:23:35.131 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-15T22:23:35.132 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-15T22:23:35.132 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-15T22:23:35.133 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-15T22:23:35.133 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-15T22:23:35.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:34 smithi012 ceph-mon[34883]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-15T22:23:35.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:34 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/1380834367' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:23:35.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:34 smithi098 ceph-mon[35514]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-15T22:23:35.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:34 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/1380834367' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:23:36.184 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:36.203 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:36.223 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:36.225 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:36.229 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:36.229 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:36.979 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:36 smithi001 ceph-mon[30843]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1023 B/s wr, 7 op/s; 13 B/s, 1 objects/s recovering 2024-09-15T22:23:37.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.976+0000 7f5d0fe00640 1 -- 172.21.15.1:0/2585172803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d101019c0 msgr2=0x7f5d10101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:37.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.976+0000 7f5d0fe00640 1 --2- 172.21.15.1:0/2585172803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d101019c0 0x7f5d10101e20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc009890 tx=0x7f5cfc02a380 comp rx=0 tx=0).stop 2024-09-15T22:23:37.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.976+0000 7f5d0fe00640 1 -- 172.21.15.1:0/2585172803 shutdown_connections 2024-09-15T22:23:37.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.976+0000 7f5d0fe00640 1 --2- 172.21.15.1:0/2585172803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d10102360 0x7f5d1010e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:37.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.976+0000 7f5d0fe00640 1 --2- 172.21.15.1:0/2585172803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d101019c0 0x7f5d10101e20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:37.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.976+0000 7f5d0fe00640 1 --2- 172.21.15.1:0/2585172803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d101079c0 0x7f5d10107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:37.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.976+0000 7f5d0fe00640 1 -- 172.21.15.1:0/2585172803 >> 172.21.15.1:0/2585172803 conn(0x7f5d100fd740 msgr2=0x7f5d100ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:37.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.976+0000 7f5d0fe00640 1 -- 172.21.15.1:0/2585172803 shutdown_connections 2024-09-15T22:23:37.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.976+0000 7f5d0fe00640 1 -- 172.21.15.1:0/2585172803 wait complete. 2024-09-15T22:23:37.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.977+0000 7f5d0fe00640 1 Processor -- start 2024-09-15T22:23:37.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.977+0000 7f5d0fe00640 1 -- start start 2024-09-15T22:23:37.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.978+0000 7f5d0fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d101019c0 0x7f5d101982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:37.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.978+0000 7f5d0fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d10102360 0x7f5d10198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:37.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.978+0000 7f5d0fe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d101079c0 0x7f5d1019cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:37.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.978+0000 7f5d0fe00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5d10111dc0 con 0x7f5d101079c0 2024-09-15T22:23:37.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.978+0000 7f5d0fe00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5d10111c40 con 0x7f5d101019c0 2024-09-15T22:23:37.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.978+0000 7f5d0fe00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5d10111f40 con 0x7f5d10102360 2024-09-15T22:23:37.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.978+0000 7f5d0f400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d101079c0 0x7f5d1019cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:37.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.978+0000 7f5d0f400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d101079c0 0x7f5d1019cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34588/0 (socket says 172.21.15.1:34588) 2024-09-15T22:23:37.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.978+0000 7f5d0f400640 1 -- 172.21.15.1:0/1909289616 learned_addr learned my addr 172.21.15.1:0/1909289616 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:37.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.978+0000 7f5d0ea00640 1 --2- 172.21.15.1:0/1909289616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d101019c0 0x7f5d101982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:37.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.978+0000 7f5d0e000640 1 --2- 172.21.15.1:0/1909289616 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d10102360 0x7f5d10198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:37.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.978+0000 7f5d0f400640 1 -- 172.21.15.1:0/1909289616 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d10102360 msgr2=0x7f5d10198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:37.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.978+0000 7f5d0f400640 1 --2- 172.21.15.1:0/1909289616 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d10102360 0x7f5d10198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:37.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.978+0000 7f5d0f400640 1 -- 172.21.15.1:0/1909289616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d101019c0 msgr2=0x7f5d101982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:37.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.978+0000 7f5d0f400640 1 --2- 172.21.15.1:0/1909289616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d101019c0 0x7f5d101982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:37.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.978+0000 7f5d0f400640 1 -- 172.21.15.1:0/1909289616 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d1019d2a0 con 0x7f5d101079c0 2024-09-15T22:23:37.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.979+0000 7f5d0f400640 1 --2- 172.21.15.1:0/1909289616 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d101079c0 0x7f5d1019cbc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5d0800efc0 tx=0x7f5d0800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:37.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.979+0000 7f5d07400640 1 -- 172.21.15.1:0/1909289616 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d08003970 con 0x7f5d101079c0 2024-09-15T22:23:37.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.979+0000 7f5d07400640 1 -- 172.21.15.1:0/1909289616 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d08004020 con 0x7f5d101079c0 2024-09-15T22:23:37.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.979+0000 7f5d07400640 1 -- 172.21.15.1:0/1909289616 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d0800b9f0 con 0x7f5d101079c0 2024-09-15T22:23:37.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.979+0000 7f5d0fe00640 1 -- 172.21.15.1:0/1909289616 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d1019d590 con 0x7f5d101079c0 2024-09-15T22:23:37.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.979+0000 7f5d0fe00640 1 -- 172.21.15.1:0/1909289616 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d101a4e70 con 0x7f5d101079c0 2024-09-15T22:23:37.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.980+0000 7f5d0fe00640 1 -- 172.21.15.1:0/1909289616 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5d10062980 con 0x7f5d101079c0 2024-09-15T22:23:37.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.982+0000 7f5d07400640 1 -- 172.21.15.1:0/1909289616 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f5d0801d020 con 0x7f5d101079c0 2024-09-15T22:23:37.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.984+0000 7f5d07400640 1 --2- 172.21.15.1:0/1909289616 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f5cf40a32d0 0x7f5cf40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:37.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.984+0000 7f5d07400640 1 -- 172.21.15.1:0/1909289616 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f5d080d0230 con 0x7f5d101079c0 2024-09-15T22:23:37.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.984+0000 7f5d0ea00640 1 --2- 172.21.15.1:0/1909289616 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f5cf40a32d0 0x7f5cf40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:37.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.984+0000 7f5d07400640 1 --2- 172.21.15.1:0/1909289616 >> [v2:172.21.15.12:6800/3951165354,v1:172.21.15.12:6801/3951165354] conn(0x7f5cf40acf00 0x7f5cf40af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:37.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.984+0000 7f5d07400640 1 -- 172.21.15.1:0/1909289616 --> [v2:172.21.15.12:6800/3951165354,v1:172.21.15.12:6801/3951165354] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5cf40afa70 con 0x7f5cf40acf00 2024-09-15T22:23:37.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.984+0000 7f5d07400640 1 -- 172.21.15.1:0/1909289616 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f5d080d05e0 con 0x7f5d101079c0 2024-09-15T22:23:37.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.984+0000 7f5d0e000640 1 --2- 172.21.15.1:0/1909289616 >> [v2:172.21.15.12:6800/3951165354,v1:172.21.15.12:6801/3951165354] conn(0x7f5cf40acf00 0x7f5cf40af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:37.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.984+0000 7f5d0ea00640 1 --2- 172.21.15.1:0/1909289616 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f5cf40a32d0 0x7f5cf40a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5d00009b50 tx=0x7f5d00005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:37.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.985+0000 7f5d0e000640 1 --2- 172.21.15.1:0/1909289616 >> [v2:172.21.15.12:6800/3951165354,v1:172.21.15.12:6801/3951165354] conn(0x7f5cf40acf00 0x7f5cf40af3a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:37.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:36.986+0000 7f5d07400640 1 -- 172.21.15.1:0/1909289616 <== osd.1 v2:172.21.15.12:6800/3951165354 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5cf40afa70 con 0x7f5cf40acf00 2024-09-15T22:23:37.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.000+0000 7f5d0fe00640 1 -- 172.21.15.1:0/1909289616 --> [v2:172.21.15.12:6800/3951165354,v1:172.21.15.12:6801/3951165354] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5d10062e00 con 0x7f5cf40acf00 2024-09-15T22:23:37.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.001+0000 7f5d07400640 1 -- 172.21.15.1:0/1909289616 <== osd.1 v2:172.21.15.12:6800/3951165354 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5d10062e00 con 0x7f5cf40acf00 2024-09-15T22:23:37.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.001+0000 7f5d0fe00640 1 -- 172.21.15.1:0/1909289616 >> [v2:172.21.15.12:6800/3951165354,v1:172.21.15.12:6801/3951165354] conn(0x7f5cf40acf00 msgr2=0x7f5cf40af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:37.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.001+0000 7f5d0fe00640 1 --2- 172.21.15.1:0/1909289616 >> [v2:172.21.15.12:6800/3951165354,v1:172.21.15.12:6801/3951165354] conn(0x7f5cf40acf00 0x7f5cf40af3a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:37.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.002+0000 7f5d0fe00640 1 -- 172.21.15.1:0/1909289616 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f5cf40a32d0 msgr2=0x7f5cf40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:37.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.002+0000 7f5d0fe00640 1 --2- 172.21.15.1:0/1909289616 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f5cf40a32d0 0x7f5cf40a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5d00009b50 tx=0x7f5d00005f90 comp rx=0 tx=0).stop 2024-09-15T22:23:37.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.002+0000 7f5d0fe00640 1 -- 172.21.15.1:0/1909289616 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d101079c0 msgr2=0x7f5d1019cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:37.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.002+0000 7f5d0fe00640 1 --2- 172.21.15.1:0/1909289616 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d101079c0 0x7f5d1019cbc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5d0800efc0 tx=0x7f5d0800c800 comp rx=0 tx=0).stop 2024-09-15T22:23:37.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.002+0000 7f5d0f400640 1 -- 172.21.15.1:0/1909289616 reap_dead start 2024-09-15T22:23:37.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.002+0000 7f5d0fe00640 1 -- 172.21.15.1:0/1909289616 shutdown_connections 2024-09-15T22:23:37.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.002+0000 7f5d0fe00640 1 -- 172.21.15.1:0/1909289616 >> 172.21.15.1:0/1909289616 conn(0x7f5d100fd740 msgr2=0x7f5d100fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:37.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.002+0000 7f5d0fe00640 1 -- 172.21.15.1:0/1909289616 shutdown_connections 2024-09-15T22:23:37.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.002+0000 7f5d0fe00640 1 -- 172.21.15.1:0/1909289616 wait complete. 2024-09-15T22:23:37.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:36 smithi012 ceph-mon[34883]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1023 B/s wr, 7 op/s; 13 B/s, 1 objects/s recovering 2024-09-15T22:23:37.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:36 smithi098 ceph-mon[35514]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1023 B/s wr, 7 op/s; 13 B/s, 1 objects/s recovering 2024-09-15T22:23:37.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.943+0000 7fe785800640 1 -- 172.21.15.1:0/3464840264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe780103e30 msgr2=0x7fe780104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:37.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.943+0000 7fe785800640 1 --2- 172.21.15.1:0/3464840264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe780103e30 0x7fe780104210 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe770009900 tx=0x7fe77002a3f0 comp rx=0 tx=0).stop 2024-09-15T22:23:37.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.943+0000 7fe785800640 1 -- 172.21.15.1:0/3464840264 shutdown_connections 2024-09-15T22:23:37.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.943+0000 7fe785800640 1 --2- 172.21.15.1:0/3464840264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe780108f60 0x7fe780110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:37.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.943+0000 7fe785800640 1 --2- 172.21.15.1:0/3464840264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7801047e0 0x7fe780108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:37.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.943+0000 7fe785800640 1 --2- 172.21.15.1:0/3464840264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe780103e30 0x7fe780104210 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:37.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.943+0000 7fe785800640 1 -- 172.21.15.1:0/3464840264 >> 172.21.15.1:0/3464840264 conn(0x7fe7800ff910 msgr2=0x7fe780101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:37.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.943+0000 7fe785800640 1 -- 172.21.15.1:0/3464840264 shutdown_connections 2024-09-15T22:23:37.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.943+0000 7fe785800640 1 -- 172.21.15.1:0/3464840264 wait complete. 2024-09-15T22:23:37.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.945+0000 7fe785800640 1 Processor -- start 2024-09-15T22:23:37.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.945+0000 7fe785800640 1 -- start start 2024-09-15T22:23:37.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.945+0000 7fe785800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe780103e30 0x7fe78019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:37.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.945+0000 7fe785800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7801047e0 0x7fe78019a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:37.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.945+0000 7fe785800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe780108f60 0x7fe78019ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:37.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.945+0000 7fe785800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe780114010 con 0x7fe780103e30 2024-09-15T22:23:37.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.945+0000 7fe785800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe780113e90 con 0x7fe7801047e0 2024-09-15T22:23:37.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.945+0000 7fe785800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe780114190 con 0x7fe780108f60 2024-09-15T22:23:37.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.946+0000 7fe77f400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7801047e0 0x7fe78019a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:37.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.946+0000 7fe77f400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7801047e0 0x7fe78019a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:49328/0 (socket says 172.21.15.1:49328) 2024-09-15T22:23:37.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.946+0000 7fe77f400640 1 -- 172.21.15.1:0/4175478801 learned_addr learned my addr 172.21.15.1:0/4175478801 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:37.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.946+0000 7fe77fe00640 1 --2- 172.21.15.1:0/4175478801 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe780103e30 0x7fe78019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:37.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.946+0000 7fe784e00640 1 --2- 172.21.15.1:0/4175478801 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe780108f60 0x7fe78019ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:37.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.946+0000 7fe77f400640 1 -- 172.21.15.1:0/4175478801 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe780108f60 msgr2=0x7fe78019ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:37.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.946+0000 7fe77f400640 1 --2- 172.21.15.1:0/4175478801 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe780108f60 0x7fe78019ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:37.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.946+0000 7fe77f400640 1 -- 172.21.15.1:0/4175478801 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe780103e30 msgr2=0x7fe78019a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:37.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.946+0000 7fe77f400640 1 --2- 172.21.15.1:0/4175478801 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe780103e30 0x7fe78019a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:37.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.946+0000 7fe77f400640 1 -- 172.21.15.1:0/4175478801 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe78019f420 con 0x7fe7801047e0 2024-09-15T22:23:37.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.946+0000 7fe77fe00640 1 --2- 172.21.15.1:0/4175478801 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe780103e30 0x7fe78019a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:23:37.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.946+0000 7fe77f400640 1 --2- 172.21.15.1:0/4175478801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7801047e0 0x7fe78019a9b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe76c00e9f0 tx=0x7fe76c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:37.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.947+0000 7fe77cc00640 1 -- 172.21.15.1:0/4175478801 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76c00cd80 con 0x7fe7801047e0 2024-09-15T22:23:37.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.947+0000 7fe77cc00640 1 -- 172.21.15.1:0/4175478801 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe76c010910 con 0x7fe7801047e0 2024-09-15T22:23:37.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.947+0000 7fe785800640 1 -- 172.21.15.1:0/4175478801 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe78019f710 con 0x7fe7801047e0 2024-09-15T22:23:37.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.947+0000 7fe77cc00640 1 -- 172.21.15.1:0/4175478801 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76c018990 con 0x7fe7801047e0 2024-09-15T22:23:37.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.947+0000 7fe785800640 1 -- 172.21.15.1:0/4175478801 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7801a6ff0 con 0x7fe7801047e0 2024-09-15T22:23:37.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.948+0000 7fe785800640 1 -- 172.21.15.1:0/4175478801 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe780062940 con 0x7fe7801047e0 2024-09-15T22:23:37.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.950+0000 7fe77cc00640 1 -- 172.21.15.1:0/4175478801 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fe76c010ac0 con 0x7fe7801047e0 2024-09-15T22:23:37.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.952+0000 7fe77cc00640 1 --2- 172.21.15.1:0/4175478801 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe7640a32d0 0x7fe7640a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:37.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.952+0000 7fe77cc00640 1 -- 172.21.15.1:0/4175478801 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fe76c0d01d0 con 0x7fe7801047e0 2024-09-15T22:23:37.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.952+0000 7fe77fe00640 1 --2- 172.21.15.1:0/4175478801 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe7640a32d0 0x7fe7640a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:37.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.952+0000 7fe77cc00640 1 --2- 172.21.15.1:0/4175478801 >> [v2:172.21.15.12:6816/133202448,v1:172.21.15.12:6817/133202448] conn(0x7fe7640acf00 0x7fe7640af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:37.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.952+0000 7fe77cc00640 1 -- 172.21.15.1:0/4175478801 --> [v2:172.21.15.12:6816/133202448,v1:172.21.15.12:6817/133202448] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe7640afa70 con 0x7fe7640acf00 2024-09-15T22:23:37.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.952+0000 7fe77cc00640 1 -- 172.21.15.1:0/4175478801 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7fe76c0d0580 con 0x7fe7801047e0 2024-09-15T22:23:37.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.953+0000 7fe784e00640 1 --2- 172.21.15.1:0/4175478801 >> [v2:172.21.15.12:6816/133202448,v1:172.21.15.12:6817/133202448] conn(0x7fe7640acf00 0x7fe7640af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:37.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.953+0000 7fe77fe00640 1 --2- 172.21.15.1:0/4175478801 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe7640a32d0 0x7fe7640a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe770000c00 tx=0x7fe770005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:37.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.953+0000 7fe784e00640 1 --2- 172.21.15.1:0/4175478801 >> [v2:172.21.15.12:6816/133202448,v1:172.21.15.12:6817/133202448] conn(0x7fe7640acf00 0x7fe7640af3a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:37.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.954+0000 7fe77cc00640 1 -- 172.21.15.1:0/4175478801 <== osd.7 v2:172.21.15.12:6816/133202448 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe7640afa70 con 0x7fe7640acf00 2024-09-15T22:23:37.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.968+0000 7fe785800640 1 -- 172.21.15.1:0/4175478801 --> [v2:172.21.15.12:6816/133202448,v1:172.21.15.12:6817/133202448] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe780062dc0 con 0x7fe7640acf00 2024-09-15T22:23:37.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.969+0000 7fe77cc00640 1 -- 172.21.15.1:0/4175478801 <== osd.7 v2:172.21.15.12:6816/133202448 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe780062dc0 con 0x7fe7640acf00 2024-09-15T22:23:37.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.970+0000 7fe785800640 1 -- 172.21.15.1:0/4175478801 >> [v2:172.21.15.12:6816/133202448,v1:172.21.15.12:6817/133202448] conn(0x7fe7640acf00 msgr2=0x7fe7640af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:37.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.970+0000 7fe785800640 1 --2- 172.21.15.1:0/4175478801 >> [v2:172.21.15.12:6816/133202448,v1:172.21.15.12:6817/133202448] conn(0x7fe7640acf00 0x7fe7640af3a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:37.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.970+0000 7fe785800640 1 -- 172.21.15.1:0/4175478801 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe7640a32d0 msgr2=0x7fe7640a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:37.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.970+0000 7fe785800640 1 --2- 172.21.15.1:0/4175478801 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe7640a32d0 0x7fe7640a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe770000c00 tx=0x7fe770005a40 comp rx=0 tx=0).stop 2024-09-15T22:23:37.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.970+0000 7fe785800640 1 -- 172.21.15.1:0/4175478801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7801047e0 msgr2=0x7fe78019a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:37.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.970+0000 7fe785800640 1 --2- 172.21.15.1:0/4175478801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7801047e0 0x7fe78019a9b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe76c00e9f0 tx=0x7fe76c00eeb0 comp rx=0 tx=0).stop 2024-09-15T22:23:37.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.970+0000 7fe784e00640 1 -- 172.21.15.1:0/4175478801 reap_dead start 2024-09-15T22:23:37.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.970+0000 7fe785800640 1 -- 172.21.15.1:0/4175478801 shutdown_connections 2024-09-15T22:23:37.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.970+0000 7fe785800640 1 -- 172.21.15.1:0/4175478801 >> 172.21.15.1:0/4175478801 conn(0x7fe7800ff910 msgr2=0x7fe780100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:37.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.970+0000 7fe785800640 1 -- 172.21.15.1:0/4175478801 shutdown_connections 2024-09-15T22:23:37.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:37.970+0000 7fe785800640 1 -- 172.21.15.1:0/4175478801 wait complete. 2024-09-15T22:23:39.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.651+0000 7fdd94c00640 1 -- 172.21.15.1:0/3150366535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd90108f60 msgr2=0x7fdd90110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:39.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.651+0000 7fdd94c00640 1 --2- 172.21.15.1:0/3150366535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd90108f60 0x7fdd90110ae0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdd88009ca0 tx=0x7fdd8802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:23:39.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.651+0000 7fdd94c00640 1 -- 172.21.15.1:0/3150366535 shutdown_connections 2024-09-15T22:23:39.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.651+0000 7fdd94c00640 1 --2- 172.21.15.1:0/3150366535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd90108f60 0x7fdd90110ae0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:39.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.651+0000 7fdd94c00640 1 --2- 172.21.15.1:0/3150366535 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd901047e0 0x7fdd90108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:39.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.651+0000 7fdd94c00640 1 --2- 172.21.15.1:0/3150366535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd90103e30 0x7fdd90104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:39.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.651+0000 7fdd94c00640 1 -- 172.21.15.1:0/3150366535 >> 172.21.15.1:0/3150366535 conn(0x7fdd900ff910 msgr2=0x7fdd90101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:39.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.651+0000 7fdd94c00640 1 -- 172.21.15.1:0/3150366535 shutdown_connections 2024-09-15T22:23:39.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.651+0000 7fdd94c00640 1 -- 172.21.15.1:0/3150366535 wait complete. 2024-09-15T22:23:39.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.652+0000 7fdd94c00640 1 Processor -- start 2024-09-15T22:23:39.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.652+0000 7fdd94c00640 1 -- start start 2024-09-15T22:23:39.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.653+0000 7fdd94c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd90103e30 0x7fdd9019a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:39.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.653+0000 7fdd94c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd901047e0 0x7fdd9019a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:39.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.653+0000 7fdd94c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd90108f60 0x7fdd9019ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:39.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.653+0000 7fdd94c00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdd90113fc0 con 0x7fdd901047e0 2024-09-15T22:23:39.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.653+0000 7fdd94c00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdd90113e40 con 0x7fdd90103e30 2024-09-15T22:23:39.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.653+0000 7fdd94c00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdd90114140 con 0x7fdd90108f60 2024-09-15T22:23:39.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.653+0000 7fdd86a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd901047e0 0x7fdd9019a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:39.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.653+0000 7fdd8f400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd90103e30 0x7fdd9019a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:39.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.653+0000 7fdd8f400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd90103e30 0x7fdd9019a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:49338/0 (socket says 172.21.15.1:49338) 2024-09-15T22:23:39.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.653+0000 7fdd8f400640 1 -- 172.21.15.1:0/3626464526 learned_addr learned my addr 172.21.15.1:0/3626464526 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:39.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.653+0000 7fdd8fe00640 1 --2- 172.21.15.1:0/3626464526 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd90108f60 0x7fdd9019ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:39.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.653+0000 7fdd86a00640 1 -- 172.21.15.1:0/3626464526 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd90108f60 msgr2=0x7fdd9019ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:39.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.653+0000 7fdd86a00640 1 --2- 172.21.15.1:0/3626464526 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd90108f60 0x7fdd9019ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:39.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.653+0000 7fdd86a00640 1 -- 172.21.15.1:0/3626464526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd90103e30 msgr2=0x7fdd9019a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:39.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.653+0000 7fdd86a00640 1 --2- 172.21.15.1:0/3626464526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd90103e30 0x7fdd9019a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:39.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.653+0000 7fdd86a00640 1 -- 172.21.15.1:0/3626464526 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd9019f410 con 0x7fdd901047e0 2024-09-15T22:23:39.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.654+0000 7fdd86a00640 1 --2- 172.21.15.1:0/3626464526 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd901047e0 0x7fdd9019a9a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdd7800d6d0 tx=0x7fdd7800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:39.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.654+0000 7fdd8cc00640 1 -- 172.21.15.1:0/3626464526 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd78017070 con 0x7fdd901047e0 2024-09-15T22:23:39.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.654+0000 7fdd8cc00640 1 -- 172.21.15.1:0/3626464526 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd78009820 con 0x7fdd901047e0 2024-09-15T22:23:39.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.654+0000 7fdd8cc00640 1 -- 172.21.15.1:0/3626464526 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd78004d00 con 0x7fdd901047e0 2024-09-15T22:23:39.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.654+0000 7fdd94c00640 1 -- 172.21.15.1:0/3626464526 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd9019f700 con 0x7fdd901047e0 2024-09-15T22:23:39.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.654+0000 7fdd94c00640 1 -- 172.21.15.1:0/3626464526 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd901a6fe0 con 0x7fdd901047e0 2024-09-15T22:23:39.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.655+0000 7fdd85600640 1 -- 172.21.15.1:0/3626464526 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdd90062980 con 0x7fdd901047e0 2024-09-15T22:23:39.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.657+0000 7fdd8cc00640 1 -- 172.21.15.1:0/3626464526 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fdd780099d0 con 0x7fdd901047e0 2024-09-15T22:23:39.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.659+0000 7fdd8cc00640 1 --2- 172.21.15.1:0/3626464526 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fdd740a3350 0x7fdd740a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:39.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.659+0000 7fdd8cc00640 1 -- 172.21.15.1:0/3626464526 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fdd780cf150 con 0x7fdd901047e0 2024-09-15T22:23:39.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.659+0000 7fdd8f400640 1 --2- 172.21.15.1:0/3626464526 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fdd740a3350 0x7fdd740a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:39.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.660+0000 7fdd8cc00640 1 --2- 172.21.15.1:0/3626464526 >> [v2:172.21.15.1:6818/2236861161,v1:172.21.15.1:6819/2236861161] conn(0x7fdd740acf80 0x7fdd740af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:39.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.660+0000 7fdd8cc00640 1 -- 172.21.15.1:0/3626464526 --> [v2:172.21.15.1:6818/2236861161,v1:172.21.15.1:6819/2236861161] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdd740afaf0 con 0x7fdd740acf80 2024-09-15T22:23:39.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.660+0000 7fdd8cc00640 1 -- 172.21.15.1:0/3626464526 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7fdd780d6050 con 0x7fdd901047e0 2024-09-15T22:23:39.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.660+0000 7fdd8fe00640 1 --2- 172.21.15.1:0/3626464526 >> [v2:172.21.15.1:6818/2236861161,v1:172.21.15.1:6819/2236861161] conn(0x7fdd740acf80 0x7fdd740af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:39.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.660+0000 7fdd8f400640 1 --2- 172.21.15.1:0/3626464526 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fdd740a3350 0x7fdd740a5810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdd80009c90 tx=0x7fdd80005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:39.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.660+0000 7fdd8fe00640 1 --2- 172.21.15.1:0/3626464526 >> [v2:172.21.15.1:6818/2236861161,v1:172.21.15.1:6819/2236861161] conn(0x7fdd740acf80 0x7fdd740af420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:39.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.661+0000 7fdd8cc00640 1 -- 172.21.15.1:0/3626464526 <== osd.6 v2:172.21.15.1:6818/2236861161 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdd740afaf0 con 0x7fdd740acf80 2024-09-15T22:23:39.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.676+0000 7fdd85600640 1 -- 172.21.15.1:0/3626464526 --> [v2:172.21.15.1:6818/2236861161,v1:172.21.15.1:6819/2236861161] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdd90062e50 con 0x7fdd740acf80 2024-09-15T22:23:39.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.677+0000 7fdd8cc00640 1 -- 172.21.15.1:0/3626464526 <== osd.6 v2:172.21.15.1:6818/2236861161 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdd90062e50 con 0x7fdd740acf80 2024-09-15T22:23:39.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.677+0000 7fdd85600640 1 -- 172.21.15.1:0/3626464526 >> [v2:172.21.15.1:6818/2236861161,v1:172.21.15.1:6819/2236861161] conn(0x7fdd740acf80 msgr2=0x7fdd740af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:39.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.677+0000 7fdd85600640 1 --2- 172.21.15.1:0/3626464526 >> [v2:172.21.15.1:6818/2236861161,v1:172.21.15.1:6819/2236861161] conn(0x7fdd740acf80 0x7fdd740af420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:39.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.677+0000 7fdd85600640 1 -- 172.21.15.1:0/3626464526 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fdd740a3350 msgr2=0x7fdd740a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:39.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.677+0000 7fdd85600640 1 --2- 172.21.15.1:0/3626464526 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fdd740a3350 0x7fdd740a5810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdd80009c90 tx=0x7fdd80005f90 comp rx=0 tx=0).stop 2024-09-15T22:23:39.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.677+0000 7fdd85600640 1 -- 172.21.15.1:0/3626464526 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd901047e0 msgr2=0x7fdd9019a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:39.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.677+0000 7fdd85600640 1 --2- 172.21.15.1:0/3626464526 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd901047e0 0x7fdd9019a9a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdd7800d6d0 tx=0x7fdd7800db90 comp rx=0 tx=0).stop 2024-09-15T22:23:39.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.677+0000 7fdd8fe00640 1 -- 172.21.15.1:0/3626464526 reap_dead start 2024-09-15T22:23:39.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.677+0000 7fdd85600640 1 -- 172.21.15.1:0/3626464526 shutdown_connections 2024-09-15T22:23:39.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.677+0000 7fdd85600640 1 -- 172.21.15.1:0/3626464526 >> 172.21.15.1:0/3626464526 conn(0x7fdd900ff910 msgr2=0x7fdd90100be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:39.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.678+0000 7fdd85600640 1 -- 172.21.15.1:0/3626464526 shutdown_connections 2024-09-15T22:23:39.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:38.678+0000 7fdd85600640 1 -- 172.21.15.1:0/3626464526 wait complete. 2024-09-15T22:23:39.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:38 smithi012 ceph-mon[34883]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s; 13 B/s, 1 objects/s recovering 2024-09-15T22:23:39.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:38 smithi098 ceph-mon[35514]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s; 13 B/s, 1 objects/s recovering 2024-09-15T22:23:39.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:38 smithi001 ceph-mon[30843]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s; 13 B/s, 1 objects/s recovering 2024-09-15T22:23:40.100 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:40.101 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:40.129 INFO:teuthology.orchestra.run.smithi001.stdout:193273528368 2024-09-15T22:23:40.130 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-15T22:23:40.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.475+0000 7f3c5d000640 1 -- 172.21.15.1:0/3769382758 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c58076720 msgr2=0x7f3c58076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:40.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.475+0000 7f3c5d000640 1 --2- 172.21.15.1:0/3769382758 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c58076720 0x7f3c58076b00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009900 tx=0x7f3c4802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:23:40.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.475+0000 7f3c5d000640 1 -- 172.21.15.1:0/3769382758 shutdown_connections 2024-09-15T22:23:40.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.475+0000 7f3c5d000640 1 --2- 172.21.15.1:0/3769382758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c58112a30 0x7f3c58114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:40.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.475+0000 7f3c5d000640 1 --2- 172.21.15.1:0/3769382758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c58077040 0x7f3c581124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:40.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.475+0000 7f3c5d000640 1 --2- 172.21.15.1:0/3769382758 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c58076720 0x7f3c58076b00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:40.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.475+0000 7f3c5d000640 1 -- 172.21.15.1:0/3769382758 >> 172.21.15.1:0/3769382758 conn(0x7f3c580ffa90 msgr2=0x7f3c58101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:40.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.475+0000 7f3c5d000640 1 -- 172.21.15.1:0/3769382758 shutdown_connections 2024-09-15T22:23:40.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.475+0000 7f3c5d000640 1 -- 172.21.15.1:0/3769382758 wait complete. 2024-09-15T22:23:40.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.477+0000 7f3c5d000640 1 Processor -- start 2024-09-15T22:23:40.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.477+0000 7f3c5d000640 1 -- start start 2024-09-15T22:23:40.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.477+0000 7f3c5d000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c58076720 0x7f3c581a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:40.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.477+0000 7f3c5d000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c58077040 0x7f3c581a4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:40.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.477+0000 7f3c5d000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c58112a30 0x7f3c5819e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:40.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.477+0000 7f3c5d000640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3c58118610 con 0x7f3c58077040 2024-09-15T22:23:40.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.477+0000 7f3c5d000640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3c58118490 con 0x7f3c58112a30 2024-09-15T22:23:40.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.477+0000 7f3c5d000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3c58118790 con 0x7f3c58076720 2024-09-15T22:23:40.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.477+0000 7f3c55e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c58076720 0x7f3c581a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:40.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.478+0000 7f3c4fe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c58077040 0x7f3c581a4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:40.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.478+0000 7f3c55e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c58076720 0x7f3c581a46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:49386/0 (socket says 172.21.15.1:49386) 2024-09-15T22:23:40.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.478+0000 7f3c55e00640 1 -- 172.21.15.1:0/2818726201 learned_addr learned my addr 172.21.15.1:0/2818726201 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:40.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.478+0000 7f3c56800640 1 --2- 172.21.15.1:0/2818726201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c58112a30 0x7f3c5819e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:40.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.478+0000 7f3c55e00640 1 -- 172.21.15.1:0/2818726201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c58112a30 msgr2=0x7f3c5819e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:40.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.478+0000 7f3c55e00640 1 --2- 172.21.15.1:0/2818726201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c58112a30 0x7f3c5819e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:40.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.478+0000 7f3c55e00640 1 -- 172.21.15.1:0/2818726201 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c58077040 msgr2=0x7f3c581a4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:40.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.478+0000 7f3c55e00640 1 --2- 172.21.15.1:0/2818726201 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c58077040 0x7f3c581a4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:40.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.478+0000 7f3c55e00640 1 -- 172.21.15.1:0/2818726201 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c5819efd0 con 0x7f3c58076720 2024-09-15T22:23:40.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.478+0000 7f3c4fe00640 1 --2- 172.21.15.1:0/2818726201 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c58077040 0x7f3c581a4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:23:40.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.479+0000 7f3c55e00640 1 --2- 172.21.15.1:0/2818726201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c58076720 0x7f3c581a46e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3c48004770 tx=0x7f3c48003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:40.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.479+0000 7f3c4ea00640 1 -- 172.21.15.1:0/2818726201 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c4803f070 con 0x7f3c58076720 2024-09-15T22:23:40.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.479+0000 7f3c5d000640 1 -- 172.21.15.1:0/2818726201 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c5819f260 con 0x7f3c58076720 2024-09-15T22:23:40.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.479+0000 7f3c4ea00640 1 -- 172.21.15.1:0/2818726201 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c48031ca0 con 0x7f3c58076720 2024-09-15T22:23:40.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.479+0000 7f3c4ea00640 1 -- 172.21.15.1:0/2818726201 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c48035030 con 0x7f3c58076720 2024-09-15T22:23:40.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.479+0000 7f3c5d000640 1 -- 172.21.15.1:0/2818726201 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c581ab5b0 con 0x7f3c58076720 2024-09-15T22:23:40.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.480+0000 7f3c5d000640 1 -- 172.21.15.1:0/2818726201 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3c58114ed0 con 0x7f3c58076720 2024-09-15T22:23:40.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.482+0000 7f3c4ea00640 1 -- 172.21.15.1:0/2818726201 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f3c48042070 con 0x7f3c58076720 2024-09-15T22:23:40.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.483+0000 7f3c4ea00640 1 --2- 172.21.15.1:0/2818726201 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3c3c0a32d0 0x7f3c3c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:40.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.484+0000 7f3c4ea00640 1 -- 172.21.15.1:0/2818726201 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f3c480f0300 con 0x7f3c58076720 2024-09-15T22:23:40.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.484+0000 7f3c4fe00640 1 --2- 172.21.15.1:0/2818726201 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3c3c0a32d0 0x7f3c3c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:40.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.484+0000 7f3c4ea00640 1 --2- 172.21.15.1:0/2818726201 >> [v2:172.21.15.12:6808/4057902964,v1:172.21.15.12:6809/4057902964] conn(0x7f3c3c0acf00 0x7f3c3c0af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:40.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.484+0000 7f3c4ea00640 1 -- 172.21.15.1:0/2818726201 --> [v2:172.21.15.12:6808/4057902964,v1:172.21.15.12:6809/4057902964] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3c48046e50 con 0x7f3c3c0acf00 2024-09-15T22:23:40.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.484+0000 7f3c4ea00640 1 -- 172.21.15.1:0/2818726201 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f3c480f06b0 con 0x7f3c58076720 2024-09-15T22:23:40.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.484+0000 7f3c56800640 1 --2- 172.21.15.1:0/2818726201 >> [v2:172.21.15.12:6808/4057902964,v1:172.21.15.12:6809/4057902964] conn(0x7f3c3c0acf00 0x7f3c3c0af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:40.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.484+0000 7f3c4fe00640 1 --2- 172.21.15.1:0/2818726201 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3c3c0a32d0 0x7f3c3c0a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3c580797b0 tx=0x7f3c40005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:40.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.485+0000 7f3c56800640 1 --2- 172.21.15.1:0/2818726201 >> [v2:172.21.15.12:6808/4057902964,v1:172.21.15.12:6809/4057902964] conn(0x7f3c3c0acf00 0x7f3c3c0af3a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:40.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.486+0000 7f3c4ea00640 1 -- 172.21.15.1:0/2818726201 <== osd.4 v2:172.21.15.12:6808/4057902964 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3c48046e50 con 0x7f3c3c0acf00 2024-09-15T22:23:40.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.500+0000 7f3c5d000640 1 -- 172.21.15.1:0/2818726201 --> [v2:172.21.15.12:6808/4057902964,v1:172.21.15.12:6809/4057902964] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3c58077e60 con 0x7f3c3c0acf00 2024-09-15T22:23:40.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.501+0000 7f3c4ea00640 1 -- 172.21.15.1:0/2818726201 <== osd.4 v2:172.21.15.12:6808/4057902964 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3c58077e60 con 0x7f3c3c0acf00 2024-09-15T22:23:40.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.501+0000 7f3c5d000640 1 -- 172.21.15.1:0/2818726201 >> [v2:172.21.15.12:6808/4057902964,v1:172.21.15.12:6809/4057902964] conn(0x7f3c3c0acf00 msgr2=0x7f3c3c0af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:40.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.501+0000 7f3c5d000640 1 --2- 172.21.15.1:0/2818726201 >> [v2:172.21.15.12:6808/4057902964,v1:172.21.15.12:6809/4057902964] conn(0x7f3c3c0acf00 0x7f3c3c0af3a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:40.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.501+0000 7f3c5d000640 1 -- 172.21.15.1:0/2818726201 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3c3c0a32d0 msgr2=0x7f3c3c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:40.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.501+0000 7f3c5d000640 1 --2- 172.21.15.1:0/2818726201 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3c3c0a32d0 0x7f3c3c0a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3c580797b0 tx=0x7f3c40005f90 comp rx=0 tx=0).stop 2024-09-15T22:23:40.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.501+0000 7f3c5d000640 1 -- 172.21.15.1:0/2818726201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c58076720 msgr2=0x7f3c581a46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:40.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.501+0000 7f3c5d000640 1 --2- 172.21.15.1:0/2818726201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c58076720 0x7f3c581a46e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3c48004770 tx=0x7f3c48003c10 comp rx=0 tx=0).stop 2024-09-15T22:23:40.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.501+0000 7f3c56800640 1 -- 172.21.15.1:0/2818726201 reap_dead start 2024-09-15T22:23:40.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.501+0000 7f3c5d000640 1 -- 172.21.15.1:0/2818726201 shutdown_connections 2024-09-15T22:23:40.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.501+0000 7f3c5d000640 1 -- 172.21.15.1:0/2818726201 >> 172.21.15.1:0/2818726201 conn(0x7f3c580ffa90 msgr2=0x7f3c58101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:40.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.501+0000 7f3c5d000640 1 -- 172.21.15.1:0/2818726201 shutdown_connections 2024-09-15T22:23:40.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.501+0000 7f3c5d000640 1 -- 172.21.15.1:0/2818726201 wait complete. 2024-09-15T22:23:40.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.699+0000 7f40c2600640 1 -- 172.21.15.1:0/3816806761 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40bc101de0 msgr2=0x7f40bc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:40.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.699+0000 7f40c2600640 1 --2- 172.21.15.1:0/3816806761 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40bc101de0 0x7f40bc1021c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f40ac009900 tx=0x7f40ac02a410 comp rx=0 tx=0).stop 2024-09-15T22:23:40.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.699+0000 7f40c2600640 1 -- 172.21.15.1:0/3816806761 shutdown_connections 2024-09-15T22:23:40.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.699+0000 7f40c2600640 1 --2- 172.21.15.1:0/3816806761 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40bc106f10 0x7f40bc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:40.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.699+0000 7f40c2600640 1 --2- 172.21.15.1:0/3816806761 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40bc102790 0x7f40bc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:40.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.699+0000 7f40c2600640 1 --2- 172.21.15.1:0/3816806761 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40bc101de0 0x7f40bc1021c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:40.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.699+0000 7f40c2600640 1 -- 172.21.15.1:0/3816806761 >> 172.21.15.1:0/3816806761 conn(0x7f40bc0fd8c0 msgr2=0x7f40bc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:40.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.699+0000 7f40c2600640 1 -- 172.21.15.1:0/3816806761 shutdown_connections 2024-09-15T22:23:40.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.699+0000 7f40c2600640 1 -- 172.21.15.1:0/3816806761 wait complete. 2024-09-15T22:23:40.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.700+0000 7f40c2600640 1 Processor -- start 2024-09-15T22:23:40.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.700+0000 7f40c2600640 1 -- start start 2024-09-15T22:23:40.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.701+0000 7f40c2600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40bc101de0 0x7f40bc198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:40.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.701+0000 7f40c2600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40bc102790 0x7f40bc198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:40.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.701+0000 7f40c2600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40bc106f10 0x7f40bc19cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:40.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.701+0000 7f40c2600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f40bc111fc0 con 0x7f40bc102790 2024-09-15T22:23:40.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.701+0000 7f40c2600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f40bc111e40 con 0x7f40bc101de0 2024-09-15T22:23:40.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.701+0000 7f40c2600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f40bc112140 con 0x7f40bc106f10 2024-09-15T22:23:40.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.701+0000 7f40b3e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40bc102790 0x7f40bc198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:40.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.701+0000 7f40b3e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40bc102790 0x7f40bc198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34656/0 (socket says 172.21.15.1:34656) 2024-09-15T22:23:40.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.701+0000 7f40b3e00640 1 -- 172.21.15.1:0/2286402144 learned_addr learned my addr 172.21.15.1:0/2286402144 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:40.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.701+0000 7f40bb400640 1 --2- 172.21.15.1:0/2286402144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40bc101de0 0x7f40bc198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:40.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.701+0000 7f40bbe00640 1 --2- 172.21.15.1:0/2286402144 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40bc106f10 0x7f40bc19cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:40.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.701+0000 7f40b3e00640 1 -- 172.21.15.1:0/2286402144 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40bc106f10 msgr2=0x7f40bc19cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:40.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.701+0000 7f40b3e00640 1 --2- 172.21.15.1:0/2286402144 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40bc106f10 0x7f40bc19cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:40.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.701+0000 7f40b3e00640 1 -- 172.21.15.1:0/2286402144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40bc101de0 msgr2=0x7f40bc198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:40.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.701+0000 7f40b3e00640 1 --2- 172.21.15.1:0/2286402144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40bc101de0 0x7f40bc198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:40.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.702+0000 7f40b3e00640 1 -- 172.21.15.1:0/2286402144 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40bc19d3f0 con 0x7f40bc102790 2024-09-15T22:23:40.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.702+0000 7f40b3e00640 1 --2- 172.21.15.1:0/2286402144 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40bc102790 0x7f40bc198980 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f40a400d950 tx=0x7f40a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:40.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.702+0000 7f40b8c00640 1 -- 172.21.15.1:0/2286402144 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a4017030 con 0x7f40bc102790 2024-09-15T22:23:40.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.702+0000 7f40c2600640 1 -- 172.21.15.1:0/2286402144 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40bc19d6e0 con 0x7f40bc102790 2024-09-15T22:23:40.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.702+0000 7f40b8c00640 1 -- 172.21.15.1:0/2286402144 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40a4004020 con 0x7f40bc102790 2024-09-15T22:23:40.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.702+0000 7f40c2600640 1 -- 172.21.15.1:0/2286402144 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40bc1a4fc0 con 0x7f40bc102790 2024-09-15T22:23:40.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.702+0000 7f40b8c00640 1 -- 172.21.15.1:0/2286402144 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a40047a0 con 0x7f40bc102790 2024-09-15T22:23:40.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.703+0000 7f40c2600640 1 -- 172.21.15.1:0/2286402144 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f40bc062980 con 0x7f40bc102790 2024-09-15T22:23:40.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.705+0000 7f40b8c00640 1 -- 172.21.15.1:0/2286402144 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f40a40041d0 con 0x7f40bc102790 2024-09-15T22:23:40.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.707+0000 7f40b8c00640 1 --2- 172.21.15.1:0/2286402144 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f40a00a32d0 0x7f40a00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:40.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.707+0000 7f40b8c00640 1 -- 172.21.15.1:0/2286402144 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f40a40cfad0 con 0x7f40bc102790 2024-09-15T22:23:40.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.707+0000 7f40bb400640 1 --2- 172.21.15.1:0/2286402144 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f40a00a32d0 0x7f40a00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:40.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.707+0000 7f40b8c00640 1 --2- 172.21.15.1:0/2286402144 >> [v2:172.21.15.1:6826/2580755002,v1:172.21.15.1:6827/2580755002] conn(0x7f40a00acf00 0x7f40a00af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:40.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.707+0000 7f40b8c00640 1 -- 172.21.15.1:0/2286402144 --> [v2:172.21.15.1:6826/2580755002,v1:172.21.15.1:6827/2580755002] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f40a4023ea0 con 0x7f40a00acf00 2024-09-15T22:23:40.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.707+0000 7f40b8c00640 1 -- 172.21.15.1:0/2286402144 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f40a40cfe80 con 0x7f40bc102790 2024-09-15T22:23:40.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.707+0000 7f40bbe00640 1 --2- 172.21.15.1:0/2286402144 >> [v2:172.21.15.1:6826/2580755002,v1:172.21.15.1:6827/2580755002] conn(0x7f40a00acf00 0x7f40a00af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:40.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.708+0000 7f40bb400640 1 --2- 172.21.15.1:0/2286402144 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f40a00a32d0 0x7f40a00a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f40ac000c00 tx=0x7f40ac005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:40.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.708+0000 7f40bbe00640 1 --2- 172.21.15.1:0/2286402144 >> [v2:172.21.15.1:6826/2580755002,v1:172.21.15.1:6827/2580755002] conn(0x7f40a00acf00 0x7f40a00af3a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:40.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.709+0000 7f40b8c00640 1 -- 172.21.15.1:0/2286402144 <== osd.9 v2:172.21.15.1:6826/2580755002 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f40a4023ea0 con 0x7f40a00acf00 2024-09-15T22:23:40.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.723+0000 7f40c2600640 1 -- 172.21.15.1:0/2286402144 --> [v2:172.21.15.1:6826/2580755002,v1:172.21.15.1:6827/2580755002] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f40bc062d80 con 0x7f40a00acf00 2024-09-15T22:23:40.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.724+0000 7f40b8c00640 1 -- 172.21.15.1:0/2286402144 <== osd.9 v2:172.21.15.1:6826/2580755002 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f40bc062d80 con 0x7f40a00acf00 2024-09-15T22:23:40.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.724+0000 7f40c2600640 1 -- 172.21.15.1:0/2286402144 >> [v2:172.21.15.1:6826/2580755002,v1:172.21.15.1:6827/2580755002] conn(0x7f40a00acf00 msgr2=0x7f40a00af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:40.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.724+0000 7f40c2600640 1 --2- 172.21.15.1:0/2286402144 >> [v2:172.21.15.1:6826/2580755002,v1:172.21.15.1:6827/2580755002] conn(0x7f40a00acf00 0x7f40a00af3a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:40.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.724+0000 7f40c2600640 1 -- 172.21.15.1:0/2286402144 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f40a00a32d0 msgr2=0x7f40a00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:40.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.724+0000 7f40c2600640 1 --2- 172.21.15.1:0/2286402144 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f40a00a32d0 0x7f40a00a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f40ac000c00 tx=0x7f40ac005b50 comp rx=0 tx=0).stop 2024-09-15T22:23:40.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.724+0000 7f40c2600640 1 -- 172.21.15.1:0/2286402144 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40bc102790 msgr2=0x7f40bc198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:40.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.724+0000 7f40c2600640 1 --2- 172.21.15.1:0/2286402144 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40bc102790 0x7f40bc198980 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f40a400d950 tx=0x7f40a400de10 comp rx=0 tx=0).stop 2024-09-15T22:23:40.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.724+0000 7f40bbe00640 1 -- 172.21.15.1:0/2286402144 reap_dead start 2024-09-15T22:23:40.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.724+0000 7f40c2600640 1 -- 172.21.15.1:0/2286402144 shutdown_connections 2024-09-15T22:23:40.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.724+0000 7f40c2600640 1 -- 172.21.15.1:0/2286402144 >> 172.21.15.1:0/2286402144 conn(0x7f40bc0fd8c0 msgr2=0x7f40bc0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:40.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.724+0000 7f40c2600640 1 -- 172.21.15.1:0/2286402144 shutdown_connections 2024-09-15T22:23:40.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:40.724+0000 7f40c2600640 1 -- 172.21.15.1:0/2286402144 wait complete. 2024-09-15T22:23:41.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:40 smithi001 ceph-mon[30843]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s; 13 B/s, 1 objects/s recovering 2024-09-15T22:23:41.185 INFO:teuthology.orchestra.run.smithi001.stdout:214748364843 2024-09-15T22:23:41.186 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-15T22:23:41.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:40 smithi012 ceph-mon[34883]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s; 13 B/s, 1 objects/s recovering 2024-09-15T22:23:41.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:40 smithi098 ceph-mon[35514]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s; 13 B/s, 1 objects/s recovering 2024-09-15T22:23:41.672 INFO:teuthology.orchestra.run.smithi001.stdout:274877906978 2024-09-15T22:23:41.673 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-15T22:23:42.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.229+0000 7f3ce3400640 1 -- 172.21.15.1:0/3727701543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3cdc10e430 msgr2=0x7f3cdc110820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:42.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.229+0000 7f3ce3400640 1 --2- 172.21.15.1:0/3727701543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3cdc10e430 0x7f3cdc110820 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4009ca0 tx=0x7f3cd402a950 comp rx=0 tx=0).stop 2024-09-15T22:23:42.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.229+0000 7f3ce3400640 1 -- 172.21.15.1:0/3727701543 shutdown_connections 2024-09-15T22:23:42.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.229+0000 7f3ce3400640 1 --2- 172.21.15.1:0/3727701543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3cdc10e430 0x7f3cdc110820 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:42.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.229+0000 7f3ce3400640 1 --2- 172.21.15.1:0/3727701543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cdc074ee0 0x7f3cdc10def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:42.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.229+0000 7f3ce3400640 1 --2- 172.21.15.1:0/3727701543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cdc0745c0 0x7f3cdc0749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:42.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.229+0000 7f3ce3400640 1 -- 172.21.15.1:0/3727701543 >> 172.21.15.1:0/3727701543 conn(0x7f3cdc0fd8b0 msgr2=0x7f3cdc0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:42.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.229+0000 7f3ce3400640 1 -- 172.21.15.1:0/3727701543 shutdown_connections 2024-09-15T22:23:42.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.229+0000 7f3ce3400640 1 -- 172.21.15.1:0/3727701543 wait complete. 2024-09-15T22:23:42.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.230+0000 7f3ce3400640 1 Processor -- start 2024-09-15T22:23:42.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.230+0000 7f3ce3400640 1 -- start start 2024-09-15T22:23:42.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.230+0000 7f3ce3400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3cdc0745c0 0x7f3cdc19a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:42.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.230+0000 7f3ce3400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cdc074ee0 0x7f3cdc19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:42.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.230+0000 7f3ce3400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cdc10e430 0x7f3cdc19eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:42.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.230+0000 7f3ce3400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3cdc1141b0 con 0x7f3cdc0745c0 2024-09-15T22:23:42.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.231+0000 7f3ce3400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3cdc114030 con 0x7f3cdc074ee0 2024-09-15T22:23:42.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.231+0000 7f3ce3400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3cdc114330 con 0x7f3cdc10e430 2024-09-15T22:23:42.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.231+0000 7f3ce0a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3cdc0745c0 0x7f3cdc19a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:42.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.231+0000 7f3ce0a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3cdc0745c0 0x7f3cdc19a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34666/0 (socket says 172.21.15.1:34666) 2024-09-15T22:23:42.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.231+0000 7f3ce0a00640 1 -- 172.21.15.1:0/2082376182 learned_addr learned my addr 172.21.15.1:0/2082376182 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:42.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.231+0000 7f3cdbe00640 1 --2- 172.21.15.1:0/2082376182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cdc074ee0 0x7f3cdc19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:42.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.231+0000 7f3ce1400640 1 --2- 172.21.15.1:0/2082376182 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cdc10e430 0x7f3cdc19eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:42.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.231+0000 7f3ce0a00640 1 -- 172.21.15.1:0/2082376182 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cdc10e430 msgr2=0x7f3cdc19eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:42.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.231+0000 7f3ce0a00640 1 --2- 172.21.15.1:0/2082376182 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cdc10e430 0x7f3cdc19eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:42.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.231+0000 7f3ce0a00640 1 -- 172.21.15.1:0/2082376182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cdc074ee0 msgr2=0x7f3cdc19ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:42.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.231+0000 7f3ce0a00640 1 --2- 172.21.15.1:0/2082376182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cdc074ee0 0x7f3cdc19ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:42.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.231+0000 7f3ce0a00640 1 -- 172.21.15.1:0/2082376182 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cdc19f5a0 con 0x7f3cdc0745c0 2024-09-15T22:23:42.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.232+0000 7f3ce0a00640 1 --2- 172.21.15.1:0/2082376182 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3cdc0745c0 0x7f3cdc19a5f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000e9f0 tx=0x7f3cd000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:42.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.232+0000 7f3cd9600640 1 -- 172.21.15.1:0/2082376182 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd000cd80 con 0x7f3cdc0745c0 2024-09-15T22:23:42.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.232+0000 7f3ce3400640 1 -- 172.21.15.1:0/2082376182 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cdc19f890 con 0x7f3cdc0745c0 2024-09-15T22:23:42.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.232+0000 7f3cd9600640 1 -- 172.21.15.1:0/2082376182 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cd0010910 con 0x7f3cdc0745c0 2024-09-15T22:23:42.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.232+0000 7f3cd9600640 1 -- 172.21.15.1:0/2082376182 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0018990 con 0x7f3cdc0745c0 2024-09-15T22:23:42.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.232+0000 7f3ce3400640 1 -- 172.21.15.1:0/2082376182 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cdc1a7170 con 0x7f3cdc0745c0 2024-09-15T22:23:42.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.233+0000 7f3ce3400640 1 -- 172.21.15.1:0/2082376182 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3cdc0fff20 con 0x7f3cdc0745c0 2024-09-15T22:23:42.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.236+0000 7f3cd9600640 1 -- 172.21.15.1:0/2082376182 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f3cd0010ac0 con 0x7f3cdc0745c0 2024-09-15T22:23:42.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.237+0000 7f3cd9600640 1 --2- 172.21.15.1:0/2082376182 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3cc40a32d0 0x7f3cc40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:42.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.237+0000 7f3cd9600640 1 -- 172.21.15.1:0/2082376182 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f3cd00d0490 con 0x7f3cdc0745c0 2024-09-15T22:23:42.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.237+0000 7f3cdbe00640 1 --2- 172.21.15.1:0/2082376182 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3cc40a32d0 0x7f3cc40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:42.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.237+0000 7f3cd9600640 1 --2- 172.21.15.1:0/2082376182 >> [v2:172.21.15.98:6816/3701478409,v1:172.21.15.98:6817/3701478409] conn(0x7f3cc40acf00 0x7f3cc40af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:42.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.237+0000 7f3cd9600640 1 -- 172.21.15.1:0/2082376182 --> [v2:172.21.15.98:6816/3701478409,v1:172.21.15.98:6817/3701478409] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3cd0022e50 con 0x7f3cc40acf00 2024-09-15T22:23:42.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.237+0000 7f3cd9600640 1 -- 172.21.15.1:0/2082376182 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f3cd00d0840 con 0x7f3cdc0745c0 2024-09-15T22:23:42.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.238+0000 7f3ce1400640 1 --2- 172.21.15.1:0/2082376182 >> [v2:172.21.15.98:6816/3701478409,v1:172.21.15.98:6817/3701478409] conn(0x7f3cc40acf00 0x7f3cc40af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:42.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.238+0000 7f3cdbe00640 1 --2- 172.21.15.1:0/2082376182 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3cc40a32d0 0x7f3cc40a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3cc80095f0 tx=0x7f3cc8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:42.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.238+0000 7f3ce1400640 1 --2- 172.21.15.1:0/2082376182 >> [v2:172.21.15.98:6816/3701478409,v1:172.21.15.98:6817/3701478409] conn(0x7f3cc40acf00 0x7f3cc40af3a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:42.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.239+0000 7f3cd9600640 1 -- 172.21.15.1:0/2082376182 <== osd.8 v2:172.21.15.98:6816/3701478409 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3cd0022e50 con 0x7f3cc40acf00 2024-09-15T22:23:42.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.254+0000 7f3ce3400640 1 -- 172.21.15.1:0/2082376182 --> [v2:172.21.15.98:6816/3701478409,v1:172.21.15.98:6817/3701478409] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3cdc075c70 con 0x7f3cc40acf00 2024-09-15T22:23:42.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.255+0000 7f3cd9600640 1 -- 172.21.15.1:0/2082376182 <== osd.8 v2:172.21.15.98:6816/3701478409 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3cdc075c70 con 0x7f3cc40acf00 2024-09-15T22:23:42.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.255+0000 7f3ce3400640 1 -- 172.21.15.1:0/2082376182 >> [v2:172.21.15.98:6816/3701478409,v1:172.21.15.98:6817/3701478409] conn(0x7f3cc40acf00 msgr2=0x7f3cc40af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:42.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.255+0000 7f3ce3400640 1 --2- 172.21.15.1:0/2082376182 >> [v2:172.21.15.98:6816/3701478409,v1:172.21.15.98:6817/3701478409] conn(0x7f3cc40acf00 0x7f3cc40af3a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:42.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.255+0000 7f3ce3400640 1 -- 172.21.15.1:0/2082376182 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3cc40a32d0 msgr2=0x7f3cc40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:42.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.255+0000 7f3ce3400640 1 --2- 172.21.15.1:0/2082376182 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3cc40a32d0 0x7f3cc40a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3cc80095f0 tx=0x7f3cc8005f90 comp rx=0 tx=0).stop 2024-09-15T22:23:42.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.255+0000 7f3ce3400640 1 -- 172.21.15.1:0/2082376182 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3cdc0745c0 msgr2=0x7f3cdc19a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:42.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.255+0000 7f3ce3400640 1 --2- 172.21.15.1:0/2082376182 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3cdc0745c0 0x7f3cdc19a5f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000e9f0 tx=0x7f3cd000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:23:42.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.256+0000 7f3ce1400640 1 -- 172.21.15.1:0/2082376182 reap_dead start 2024-09-15T22:23:42.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.256+0000 7f3ce3400640 1 -- 172.21.15.1:0/2082376182 shutdown_connections 2024-09-15T22:23:42.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.256+0000 7f3ce3400640 1 -- 172.21.15.1:0/2082376182 >> 172.21.15.1:0/2082376182 conn(0x7f3cdc0fd8b0 msgr2=0x7f3cdc0fe4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:42.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.256+0000 7f3ce3400640 1 -- 172.21.15.1:0/2082376182 shutdown_connections 2024-09-15T22:23:42.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:42.256+0000 7f3ce3400640 1 -- 172.21.15.1:0/2082376182 wait complete. 2024-09-15T22:23:43.082 INFO:teuthology.orchestra.run.smithi001.stdout:55834574925 2024-09-15T22:23:43.082 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-15T22:23:43.201 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:42 smithi001 ceph-mon[30843]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s; 11 B/s, 0 objects/s recovering 2024-09-15T22:23:43.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:42 smithi012 ceph-mon[34883]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s; 11 B/s, 0 objects/s recovering 2024-09-15T22:23:43.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:42 smithi098 ceph-mon[35514]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s; 11 B/s, 0 objects/s recovering 2024-09-15T22:23:43.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.404+0000 7f05e2600640 1 -- 172.21.15.1:0/653740627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05dc109120 msgr2=0x7f05dc110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:43.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.404+0000 7f05e2600640 1 --2- 172.21.15.1:0/653740627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05dc109120 0x7f05dc110ca0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f05d4009ca0 tx=0x7f05d402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:23:43.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.405+0000 7f05e2600640 1 -- 172.21.15.1:0/653740627 shutdown_connections 2024-09-15T22:23:43.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.405+0000 7f05e2600640 1 --2- 172.21.15.1:0/653740627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05dc109120 0x7f05dc110ca0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:43.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.405+0000 7f05e2600640 1 --2- 172.21.15.1:0/653740627 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05dc1049a0 0x7f05dc1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:43.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.405+0000 7f05e2600640 1 --2- 172.21.15.1:0/653740627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05dc103ff0 0x7f05dc1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:43.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.405+0000 7f05e2600640 1 -- 172.21.15.1:0/653740627 >> 172.21.15.1:0/653740627 conn(0x7f05dc0ffa90 msgr2=0x7f05dc101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:43.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.405+0000 7f05e2600640 1 -- 172.21.15.1:0/653740627 shutdown_connections 2024-09-15T22:23:43.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.405+0000 7f05e2600640 1 -- 172.21.15.1:0/653740627 wait complete. 2024-09-15T22:23:43.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.406+0000 7f05e2600640 1 Processor -- start 2024-09-15T22:23:43.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.406+0000 7f05e2600640 1 -- start start 2024-09-15T22:23:43.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.406+0000 7f05e2600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05dc103ff0 0x7f05dc19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:43.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.406+0000 7f05e2600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05dc1049a0 0x7f05dc19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:43.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.406+0000 7f05e2600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05dc109120 0x7f05dc19eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:43.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.406+0000 7f05e2600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f05dc1141a0 con 0x7f05dc1049a0 2024-09-15T22:23:43.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.406+0000 7f05e2600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f05dc114020 con 0x7f05dc103ff0 2024-09-15T22:23:43.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.406+0000 7f05e2600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f05dc114320 con 0x7f05dc109120 2024-09-15T22:23:43.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.407+0000 7f05dbe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05dc109120 0x7f05dc19eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:43.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.407+0000 7f05daa00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05dc1049a0 0x7f05dc19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:43.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.407+0000 7f05db400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05dc103ff0 0x7f05dc19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:43.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.407+0000 7f05dbe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05dc109120 0x7f05dc19eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:49450/0 (socket says 172.21.15.1:49450) 2024-09-15T22:23:43.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.407+0000 7f05dbe00640 1 -- 172.21.15.1:0/3228133911 learned_addr learned my addr 172.21.15.1:0/3228133911 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:43.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.407+0000 7f05dbe00640 1 -- 172.21.15.1:0/3228133911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05dc103ff0 msgr2=0x7f05dc19a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:43.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.407+0000 7f05dbe00640 1 --2- 172.21.15.1:0/3228133911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05dc103ff0 0x7f05dc19a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:43.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.407+0000 7f05dbe00640 1 -- 172.21.15.1:0/3228133911 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05dc1049a0 msgr2=0x7f05dc19ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:43.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.407+0000 7f05dbe00640 1 --2- 172.21.15.1:0/3228133911 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05dc1049a0 0x7f05dc19ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:43.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.407+0000 7f05dbe00640 1 -- 172.21.15.1:0/3228133911 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05dc19f5b0 con 0x7f05dc109120 2024-09-15T22:23:43.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.407+0000 7f05db400640 1 --2- 172.21.15.1:0/3228133911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05dc103ff0 0x7f05dc19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:23:43.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.407+0000 7f05dbe00640 1 --2- 172.21.15.1:0/3228133911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05dc109120 0x7f05dc19eed0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f05d4005e30 tx=0x7f05d4003d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:43.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.408+0000 7f05d3e00640 1 -- 172.21.15.1:0/3228133911 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4031650 con 0x7f05dc109120 2024-09-15T22:23:43.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.408+0000 7f05d3e00640 1 -- 172.21.15.1:0/3228133911 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05d40317f0 con 0x7f05dc109120 2024-09-15T22:23:43.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.408+0000 7f05e2600640 1 -- 172.21.15.1:0/3228133911 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05dc19f840 con 0x7f05dc109120 2024-09-15T22:23:43.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.408+0000 7f05d3e00640 1 -- 172.21.15.1:0/3228133911 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d402f9d0 con 0x7f05dc109120 2024-09-15T22:23:43.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.408+0000 7f05e2600640 1 -- 172.21.15.1:0/3228133911 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05dc1a7180 con 0x7f05dc109120 2024-09-15T22:23:43.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.409+0000 7f05e2600640 1 -- 172.21.15.1:0/3228133911 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f05dc101070 con 0x7f05dc109120 2024-09-15T22:23:43.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.411+0000 7f05d3e00640 1 -- 172.21.15.1:0/3228133911 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f05d402fb70 con 0x7f05dc109120 2024-09-15T22:23:43.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.412+0000 7f05d3e00640 1 --2- 172.21.15.1:0/3228133911 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f05c00a32d0 0x7f05c00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:43.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.412+0000 7f05d3e00640 1 -- 172.21.15.1:0/3228133911 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f05d40f0f90 con 0x7f05dc109120 2024-09-15T22:23:43.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.413+0000 7f05db400640 1 --2- 172.21.15.1:0/3228133911 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f05c00a32d0 0x7f05c00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:43.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.413+0000 7f05d3e00640 1 --2- 172.21.15.1:0/3228133911 >> [v2:172.21.15.98:6824/839956167,v1:172.21.15.98:6825/839956167] conn(0x7f05c00acf00 0x7f05c00af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:43.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.413+0000 7f05d3e00640 1 -- 172.21.15.1:0/3228133911 --> [v2:172.21.15.98:6824/839956167,v1:172.21.15.98:6825/839956167] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f05d400b150 con 0x7f05c00acf00 2024-09-15T22:23:43.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.413+0000 7f05d3e00640 1 -- 172.21.15.1:0/3228133911 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f05d40f13e0 con 0x7f05dc109120 2024-09-15T22:23:43.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.413+0000 7f05daa00640 1 --2- 172.21.15.1:0/3228133911 >> [v2:172.21.15.98:6824/839956167,v1:172.21.15.98:6825/839956167] conn(0x7f05c00acf00 0x7f05c00af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:43.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.413+0000 7f05db400640 1 --2- 172.21.15.1:0/3228133911 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f05c00a32d0 0x7f05c00a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f05cc0095f0 tx=0x7f05cc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:43.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.414+0000 7f05daa00640 1 --2- 172.21.15.1:0/3228133911 >> [v2:172.21.15.98:6824/839956167,v1:172.21.15.98:6825/839956167] conn(0x7f05c00acf00 0x7f05c00af3a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:43.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.415+0000 7f05d3e00640 1 -- 172.21.15.1:0/3228133911 <== osd.11 v2:172.21.15.98:6824/839956167 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f05d400b150 con 0x7f05c00acf00 2024-09-15T22:23:43.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.429+0000 7f05e2600640 1 -- 172.21.15.1:0/3228133911 --> [v2:172.21.15.98:6824/839956167,v1:172.21.15.98:6825/839956167] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f05dc1054d0 con 0x7f05c00acf00 2024-09-15T22:23:43.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.430+0000 7f05d3e00640 1 -- 172.21.15.1:0/3228133911 <== osd.11 v2:172.21.15.98:6824/839956167 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f05dc1054d0 con 0x7f05c00acf00 2024-09-15T22:23:43.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.430+0000 7f05e2600640 1 -- 172.21.15.1:0/3228133911 >> [v2:172.21.15.98:6824/839956167,v1:172.21.15.98:6825/839956167] conn(0x7f05c00acf00 msgr2=0x7f05c00af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:43.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.430+0000 7f05e2600640 1 --2- 172.21.15.1:0/3228133911 >> [v2:172.21.15.98:6824/839956167,v1:172.21.15.98:6825/839956167] conn(0x7f05c00acf00 0x7f05c00af3a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:43.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.430+0000 7f05e2600640 1 -- 172.21.15.1:0/3228133911 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f05c00a32d0 msgr2=0x7f05c00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:43.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.430+0000 7f05e2600640 1 --2- 172.21.15.1:0/3228133911 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f05c00a32d0 0x7f05c00a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f05cc0095f0 tx=0x7f05cc005f90 comp rx=0 tx=0).stop 2024-09-15T22:23:43.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.430+0000 7f05e2600640 1 -- 172.21.15.1:0/3228133911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05dc109120 msgr2=0x7f05dc19eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:43.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.430+0000 7f05e2600640 1 --2- 172.21.15.1:0/3228133911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05dc109120 0x7f05dc19eed0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f05d4005e30 tx=0x7f05d4003d00 comp rx=0 tx=0).stop 2024-09-15T22:23:43.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.430+0000 7f05dbe00640 1 -- 172.21.15.1:0/3228133911 reap_dead start 2024-09-15T22:23:43.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.430+0000 7f05e2600640 1 -- 172.21.15.1:0/3228133911 shutdown_connections 2024-09-15T22:23:43.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.430+0000 7f05e2600640 1 -- 172.21.15.1:0/3228133911 >> 172.21.15.1:0/3228133911 conn(0x7f05dc0ffa90 msgr2=0x7f05dc101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:43.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.430+0000 7f05e2600640 1 -- 172.21.15.1:0/3228133911 shutdown_connections 2024-09-15T22:23:43.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:43.430+0000 7f05e2600640 1 -- 172.21.15.1:0/3228133911 wait complete. 2024-09-15T22:23:44.373 INFO:teuthology.orchestra.run.smithi001.stdout:141733920828 2024-09-15T22:23:44.374 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-15T22:23:44.543 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:44.544 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:44.554 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:44.556 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:44.981 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:44 smithi001 ceph-mon[30843]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s; 10 B/s, 0 objects/s recovering 2024-09-15T22:23:44.981 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:44 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:23:45.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.821+0000 7efe43400640 1 -- 172.21.15.1:0/1964287313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe3c103ff0 msgr2=0x7efe3c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:45.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.821+0000 7efe43400640 1 --2- 172.21.15.1:0/1964287313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe3c103ff0 0x7efe3c1043d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efe30009900 tx=0x7efe3002a410 comp rx=0 tx=0).stop 2024-09-15T22:23:45.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.821+0000 7efe43400640 1 -- 172.21.15.1:0/1964287313 shutdown_connections 2024-09-15T22:23:45.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.821+0000 7efe43400640 1 --2- 172.21.15.1:0/1964287313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe3c109120 0x7efe3c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:45.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.821+0000 7efe43400640 1 --2- 172.21.15.1:0/1964287313 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe3c1049a0 0x7efe3c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:45.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.821+0000 7efe43400640 1 --2- 172.21.15.1:0/1964287313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe3c103ff0 0x7efe3c1043d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:45.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.821+0000 7efe43400640 1 -- 172.21.15.1:0/1964287313 >> 172.21.15.1:0/1964287313 conn(0x7efe3c0ffa90 msgr2=0x7efe3c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:45.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.821+0000 7efe43400640 1 -- 172.21.15.1:0/1964287313 shutdown_connections 2024-09-15T22:23:45.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.822+0000 7efe43400640 1 -- 172.21.15.1:0/1964287313 wait complete. 2024-09-15T22:23:45.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.822+0000 7efe43400640 1 Processor -- start 2024-09-15T22:23:45.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.823+0000 7efe43400640 1 -- start start 2024-09-15T22:23:45.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.823+0000 7efe43400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe3c103ff0 0x7efe3c19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:45.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.823+0000 7efe43400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe3c1049a0 0x7efe3c19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:45.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.823+0000 7efe43400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe3c109120 0x7efe3c19eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:45.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.823+0000 7efe43400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efe3c114150 con 0x7efe3c1049a0 2024-09-15T22:23:45.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.823+0000 7efe43400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efe3c113fd0 con 0x7efe3c109120 2024-09-15T22:23:45.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.823+0000 7efe43400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efe3c1142d0 con 0x7efe3c103ff0 2024-09-15T22:23:45.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.823+0000 7efe41400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe3c109120 0x7efe3c19eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:45.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.823+0000 7efe41400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe3c109120 0x7efe3c19eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:49426/0 (socket says 172.21.15.1:49426) 2024-09-15T22:23:45.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.823+0000 7efe41400640 1 -- 172.21.15.1:0/1002719945 learned_addr learned my addr 172.21.15.1:0/1002719945 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:45.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.823+0000 7efe3be00640 1 --2- 172.21.15.1:0/1002719945 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe3c1049a0 0x7efe3c19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:45.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.823+0000 7efe40a00640 1 --2- 172.21.15.1:0/1002719945 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe3c103ff0 0x7efe3c19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:45.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.824+0000 7efe41400640 1 -- 172.21.15.1:0/1002719945 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe3c103ff0 msgr2=0x7efe3c19a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:45.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.824+0000 7efe41400640 1 --2- 172.21.15.1:0/1002719945 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe3c103ff0 0x7efe3c19a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:45.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.824+0000 7efe41400640 1 -- 172.21.15.1:0/1002719945 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe3c1049a0 msgr2=0x7efe3c19ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:45.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.824+0000 7efe41400640 1 --2- 172.21.15.1:0/1002719945 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe3c1049a0 0x7efe3c19ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:45.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.824+0000 7efe41400640 1 -- 172.21.15.1:0/1002719945 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe3c19f5c0 con 0x7efe3c109120 2024-09-15T22:23:45.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.824+0000 7efe41400640 1 --2- 172.21.15.1:0/1002719945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe3c109120 0x7efe3c19eee0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efe3400eb10 tx=0x7efe3400c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:45.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.824+0000 7efe39600640 1 -- 172.21.15.1:0/1002719945 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe34004b20 con 0x7efe3c109120 2024-09-15T22:23:45.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.824+0000 7efe43400640 1 -- 172.21.15.1:0/1002719945 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe3c19f8b0 con 0x7efe3c109120 2024-09-15T22:23:45.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.824+0000 7efe39600640 1 -- 172.21.15.1:0/1002719945 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe34004cc0 con 0x7efe3c109120 2024-09-15T22:23:45.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.824+0000 7efe39600640 1 -- 172.21.15.1:0/1002719945 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe34010760 con 0x7efe3c109120 2024-09-15T22:23:45.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.824+0000 7efe43400640 1 -- 172.21.15.1:0/1002719945 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe3c1a7190 con 0x7efe3c109120 2024-09-15T22:23:45.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.825+0000 7efe43400640 1 -- 172.21.15.1:0/1002719945 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efe3c062940 con 0x7efe3c109120 2024-09-15T22:23:45.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.827+0000 7efe39600640 1 -- 172.21.15.1:0/1002719945 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7efe34010900 con 0x7efe3c109120 2024-09-15T22:23:45.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.829+0000 7efe39600640 1 --2- 172.21.15.1:0/1002719945 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7efe240a32d0 0x7efe240a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:45.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.829+0000 7efe39600640 1 -- 172.21.15.1:0/1002719945 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7efe340d0560 con 0x7efe3c109120 2024-09-15T22:23:45.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.829+0000 7efe40a00640 1 --2- 172.21.15.1:0/1002719945 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7efe240a32d0 0x7efe240a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:45.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.829+0000 7efe39600640 1 --2- 172.21.15.1:0/1002719945 >> [v2:172.21.15.12:6824/3989063573,v1:172.21.15.12:6825/3989063573] conn(0x7efe240acf00 0x7efe240af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:45.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.829+0000 7efe39600640 1 -- 172.21.15.1:0/1002719945 --> [v2:172.21.15.12:6824/3989063573,v1:172.21.15.12:6825/3989063573] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efe3400e1a0 con 0x7efe240acf00 2024-09-15T22:23:45.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.829+0000 7efe39600640 1 -- 172.21.15.1:0/1002719945 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7efe340d0910 con 0x7efe3c109120 2024-09-15T22:23:45.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.830+0000 7efe3be00640 1 --2- 172.21.15.1:0/1002719945 >> [v2:172.21.15.12:6824/3989063573,v1:172.21.15.12:6825/3989063573] conn(0x7efe240acf00 0x7efe240af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:45.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.830+0000 7efe40a00640 1 --2- 172.21.15.1:0/1002719945 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7efe240a32d0 0x7efe240a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efe30009230 tx=0x7efe300058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:45.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.830+0000 7efe3be00640 1 --2- 172.21.15.1:0/1002719945 >> [v2:172.21.15.12:6824/3989063573,v1:172.21.15.12:6825/3989063573] conn(0x7efe240acf00 0x7efe240af3a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:45.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.831+0000 7efe39600640 1 -- 172.21.15.1:0/1002719945 <== osd.10 v2:172.21.15.12:6824/3989063573 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efe3400e1a0 con 0x7efe240acf00 2024-09-15T22:23:45.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.845+0000 7efe43400640 1 -- 172.21.15.1:0/1002719945 --> [v2:172.21.15.12:6824/3989063573,v1:172.21.15.12:6825/3989063573] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efe3c062dc0 con 0x7efe240acf00 2024-09-15T22:23:45.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.846+0000 7efe39600640 1 -- 172.21.15.1:0/1002719945 <== osd.10 v2:172.21.15.12:6824/3989063573 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7efe3c062dc0 con 0x7efe240acf00 2024-09-15T22:23:45.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.846+0000 7efe43400640 1 -- 172.21.15.1:0/1002719945 >> [v2:172.21.15.12:6824/3989063573,v1:172.21.15.12:6825/3989063573] conn(0x7efe240acf00 msgr2=0x7efe240af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:45.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.846+0000 7efe43400640 1 --2- 172.21.15.1:0/1002719945 >> [v2:172.21.15.12:6824/3989063573,v1:172.21.15.12:6825/3989063573] conn(0x7efe240acf00 0x7efe240af3a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:45.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.846+0000 7efe43400640 1 -- 172.21.15.1:0/1002719945 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7efe240a32d0 msgr2=0x7efe240a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:45.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.846+0000 7efe43400640 1 --2- 172.21.15.1:0/1002719945 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7efe240a32d0 0x7efe240a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efe30009230 tx=0x7efe300058d0 comp rx=0 tx=0).stop 2024-09-15T22:23:45.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.847+0000 7efe43400640 1 -- 172.21.15.1:0/1002719945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe3c109120 msgr2=0x7efe3c19eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:45.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.847+0000 7efe43400640 1 --2- 172.21.15.1:0/1002719945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe3c109120 0x7efe3c19eee0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efe3400eb10 tx=0x7efe3400c2d0 comp rx=0 tx=0).stop 2024-09-15T22:23:45.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.847+0000 7efe41400640 1 -- 172.21.15.1:0/1002719945 reap_dead start 2024-09-15T22:23:45.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.847+0000 7efe43400640 1 -- 172.21.15.1:0/1002719945 shutdown_connections 2024-09-15T22:23:45.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.847+0000 7efe43400640 1 -- 172.21.15.1:0/1002719945 >> 172.21.15.1:0/1002719945 conn(0x7efe3c0ffa90 msgr2=0x7efe3c100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:45.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.847+0000 7efe43400640 1 -- 172.21.15.1:0/1002719945 shutdown_connections 2024-09-15T22:23:45.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:44.847+0000 7efe43400640 1 -- 172.21.15.1:0/1002719945 wait complete. 2024-09-15T22:23:45.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:44 smithi012 ceph-mon[34883]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s; 10 B/s, 0 objects/s recovering 2024-09-15T22:23:45.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:44 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:23:45.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:44 smithi098 ceph-mon[35514]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s; 10 B/s, 0 objects/s recovering 2024-09-15T22:23:45.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:44 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:23:46.399 INFO:teuthology.orchestra.run.smithi001.stdout:244813135913 2024-09-15T22:23:46.400 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-15T22:23:46.908 INFO:teuthology.orchestra.run.smithi001.stdout:326417514520 2024-09-15T22:23:46.908 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-15T22:23:47.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.121+0000 7fdf68600640 1 -- 172.21.15.1:0/3231147894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf60112a30 msgr2=0x7fdf60114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:47.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.121+0000 7fdf68600640 1 --2- 172.21.15.1:0/3231147894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf60112a30 0x7fdf60114e20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdf58009be0 tx=0x7fdf5802a6c0 comp rx=0 tx=0).stop 2024-09-15T22:23:47.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.122+0000 7fdf68600640 1 -- 172.21.15.1:0/3231147894 shutdown_connections 2024-09-15T22:23:47.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.122+0000 7fdf68600640 1 --2- 172.21.15.1:0/3231147894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf60112a30 0x7fdf60114e20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:47.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.122+0000 7fdf68600640 1 --2- 172.21.15.1:0/3231147894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdf60077040 0x7fdf601124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:47.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.122+0000 7fdf68600640 1 --2- 172.21.15.1:0/3231147894 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf60076720 0x7fdf60076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:47.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.122+0000 7fdf68600640 1 -- 172.21.15.1:0/3231147894 >> 172.21.15.1:0/3231147894 conn(0x7fdf600ffa90 msgr2=0x7fdf60101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:47.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.122+0000 7fdf68600640 1 -- 172.21.15.1:0/3231147894 shutdown_connections 2024-09-15T22:23:47.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.122+0000 7fdf68600640 1 -- 172.21.15.1:0/3231147894 wait complete. 2024-09-15T22:23:47.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.123+0000 7fdf68600640 1 Processor -- start 2024-09-15T22:23:47.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.123+0000 7fdf68600640 1 -- start start 2024-09-15T22:23:47.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.124+0000 7fdf68600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf60076720 0x7fdf601a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:47.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.124+0000 7fdf68600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf60077040 0x7fdf601a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:47.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.124+0000 7fdf68600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdf60112a30 0x7fdf6019e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:47.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.124+0000 7fdf68600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdf60118570 con 0x7fdf60112a30 2024-09-15T22:23:47.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.124+0000 7fdf68600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdf601183f0 con 0x7fdf60077040 2024-09-15T22:23:47.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.124+0000 7fdf68600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdf601186f0 con 0x7fdf60076720 2024-09-15T22:23:47.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.124+0000 7fdf66600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdf60112a30 0x7fdf6019e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:47.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.124+0000 7fdf65200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf60077040 0x7fdf601a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:47.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.124+0000 7fdf65200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf60077040 0x7fdf601a4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:36050/0 (socket says 172.21.15.1:36050) 2024-09-15T22:23:47.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.124+0000 7fdf65200640 1 -- 172.21.15.1:0/3137109607 learned_addr learned my addr 172.21.15.1:0/3137109607 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:47.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.124+0000 7fdf65c00640 1 --2- 172.21.15.1:0/3137109607 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf60076720 0x7fdf601a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:47.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.125+0000 7fdf66600640 1 -- 172.21.15.1:0/3137109607 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf60076720 msgr2=0x7fdf601a46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:47.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.125+0000 7fdf66600640 1 --2- 172.21.15.1:0/3137109607 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf60076720 0x7fdf601a46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:47.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.125+0000 7fdf66600640 1 -- 172.21.15.1:0/3137109607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf60077040 msgr2=0x7fdf601a4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:47.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.125+0000 7fdf66600640 1 --2- 172.21.15.1:0/3137109607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf60077040 0x7fdf601a4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:47.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.125+0000 7fdf66600640 1 -- 172.21.15.1:0/3137109607 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf6019ef90 con 0x7fdf60112a30 2024-09-15T22:23:47.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.125+0000 7fdf65c00640 1 --2- 172.21.15.1:0/3137109607 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf60076720 0x7fdf601a46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:23:47.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.125+0000 7fdf66600640 1 --2- 172.21.15.1:0/3137109607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdf60112a30 0x7fdf6019e860 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdf5802acb0 tx=0x7fdf580305b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:47.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.126+0000 7fdf5e000640 1 -- 172.21.15.1:0/3137109607 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf58041020 con 0x7fdf60112a30 2024-09-15T22:23:47.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.126+0000 7fdf5e000640 1 -- 172.21.15.1:0/3137109607 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf58003e50 con 0x7fdf60112a30 2024-09-15T22:23:47.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.126+0000 7fdf68600640 1 -- 172.21.15.1:0/3137109607 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf6019f220 con 0x7fdf60112a30 2024-09-15T22:23:47.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.126+0000 7fdf68600640 1 -- 172.21.15.1:0/3137109607 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf601ab570 con 0x7fdf60112a30 2024-09-15T22:23:47.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.126+0000 7fdf5e000640 1 -- 172.21.15.1:0/3137109607 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf58036040 con 0x7fdf60112a30 2024-09-15T22:23:47.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.127+0000 7fdf68600640 1 -- 172.21.15.1:0/3137109607 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdf60062980 con 0x7fdf60112a30 2024-09-15T22:23:47.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.129+0000 7fdf5e000640 1 -- 172.21.15.1:0/3137109607 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fdf58044020 con 0x7fdf60112a30 2024-09-15T22:23:47.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.132+0000 7fdf5e000640 1 --2- 172.21.15.1:0/3137109607 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fdf480a3350 0x7fdf480a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:47.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.132+0000 7fdf5e000640 1 -- 172.21.15.1:0/3137109607 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fdf580f0b60 con 0x7fdf60112a30 2024-09-15T22:23:47.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.132+0000 7fdf5e000640 1 --2- 172.21.15.1:0/3137109607 >> [v2:172.21.15.98:6800/1633982971,v1:172.21.15.98:6801/1633982971] conn(0x7fdf480acf80 0x7fdf480af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:47.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.132+0000 7fdf65c00640 1 --2- 172.21.15.1:0/3137109607 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fdf480a3350 0x7fdf480a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:47.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.132+0000 7fdf5e000640 1 -- 172.21.15.1:0/3137109607 --> [v2:172.21.15.98:6800/1633982971,v1:172.21.15.98:6801/1633982971] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdf58035e50 con 0x7fdf480acf80 2024-09-15T22:23:47.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.132+0000 7fdf5e000640 1 -- 172.21.15.1:0/3137109607 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7fdf580f0f10 con 0x7fdf60112a30 2024-09-15T22:23:47.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.133+0000 7fdf65200640 1 --2- 172.21.15.1:0/3137109607 >> [v2:172.21.15.98:6800/1633982971,v1:172.21.15.98:6801/1633982971] conn(0x7fdf480acf80 0x7fdf480af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:47.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.133+0000 7fdf65c00640 1 --2- 172.21.15.1:0/3137109607 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fdf480a3350 0x7fdf480a5810 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdf54005fd0 tx=0x7fdf54005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:47.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.133+0000 7fdf65200640 1 --2- 172.21.15.1:0/3137109607 >> [v2:172.21.15.98:6800/1633982971,v1:172.21.15.98:6801/1633982971] conn(0x7fdf480acf80 0x7fdf480af420 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:47.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.134+0000 7fdf5e000640 1 -- 172.21.15.1:0/3137109607 <== osd.2 v2:172.21.15.98:6800/1633982971 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdf58035e50 con 0x7fdf480acf80 2024-09-15T22:23:47.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.152+0000 7fdf68600640 1 -- 172.21.15.1:0/3137109607 --> [v2:172.21.15.98:6800/1633982971,v1:172.21.15.98:6801/1633982971] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdf60062d80 con 0x7fdf480acf80 2024-09-15T22:23:47.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.153+0000 7fdf5e000640 1 -- 172.21.15.1:0/3137109607 <== osd.2 v2:172.21.15.98:6800/1633982971 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdf60062d80 con 0x7fdf480acf80 2024-09-15T22:23:47.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.153+0000 7fdf68600640 1 -- 172.21.15.1:0/3137109607 >> [v2:172.21.15.98:6800/1633982971,v1:172.21.15.98:6801/1633982971] conn(0x7fdf480acf80 msgr2=0x7fdf480af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:47.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.153+0000 7fdf68600640 1 --2- 172.21.15.1:0/3137109607 >> [v2:172.21.15.98:6800/1633982971,v1:172.21.15.98:6801/1633982971] conn(0x7fdf480acf80 0x7fdf480af420 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:47.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.153+0000 7fdf68600640 1 -- 172.21.15.1:0/3137109607 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fdf480a3350 msgr2=0x7fdf480a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:47.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.153+0000 7fdf68600640 1 --2- 172.21.15.1:0/3137109607 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fdf480a3350 0x7fdf480a5810 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdf54005fd0 tx=0x7fdf54005850 comp rx=0 tx=0).stop 2024-09-15T22:23:47.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.154+0000 7fdf68600640 1 -- 172.21.15.1:0/3137109607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdf60112a30 msgr2=0x7fdf6019e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:47.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.154+0000 7fdf68600640 1 --2- 172.21.15.1:0/3137109607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdf60112a30 0x7fdf6019e860 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdf5802acb0 tx=0x7fdf580305b0 comp rx=0 tx=0).stop 2024-09-15T22:23:47.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.154+0000 7fdf66600640 1 -- 172.21.15.1:0/3137109607 reap_dead start 2024-09-15T22:23:47.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.154+0000 7fdf68600640 1 -- 172.21.15.1:0/3137109607 shutdown_connections 2024-09-15T22:23:47.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.154+0000 7fdf68600640 1 -- 172.21.15.1:0/3137109607 >> 172.21.15.1:0/3137109607 conn(0x7fdf600ffa90 msgr2=0x7fdf60101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:47.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.154+0000 7fdf68600640 1 -- 172.21.15.1:0/3137109607 shutdown_connections 2024-09-15T22:23:47.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.154+0000 7fdf68600640 1 -- 172.21.15.1:0/3137109607 wait complete. 2024-09-15T22:23:47.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:47 smithi001 ceph-mon[30843]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s; 9 B/s, 0 objects/s recovering 2024-09-15T22:23:47.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:47 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:23:47.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:47 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:23:47.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:47 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:23:47.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:47 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:23:47.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:47 smithi012 ceph-mon[34883]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s; 9 B/s, 0 objects/s recovering 2024-09-15T22:23:47.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:47 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:23:47.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:47 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:23:47.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:47 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:23:47.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:47 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:23:47.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:47 smithi098 ceph-mon[35514]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s; 9 B/s, 0 objects/s recovering 2024-09-15T22:23:47.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:47 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:23:47.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:47 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:23:47.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:47 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:23:47.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:47 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:23:47.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.859+0000 7fc6d6600640 1 -- 172.21.15.1:0/769595968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6d01049c0 msgr2=0x7fc6d0108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:47.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.859+0000 7fc6d6600640 1 --2- 172.21.15.1:0/769595968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6d01049c0 0x7fc6d0108a10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc009860 tx=0x7fc6bc02a340 comp rx=0 tx=0).stop 2024-09-15T22:23:47.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.859+0000 7fc6d6600640 1 -- 172.21.15.1:0/769595968 shutdown_connections 2024-09-15T22:23:47.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.859+0000 7fc6d6600640 1 --2- 172.21.15.1:0/769595968 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6d0109140 0x7fc6d0110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:47.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.859+0000 7fc6d6600640 1 --2- 172.21.15.1:0/769595968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6d01049c0 0x7fc6d0108a10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:47.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.859+0000 7fc6d6600640 1 --2- 172.21.15.1:0/769595968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6d0104010 0x7fc6d01043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:47.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.859+0000 7fc6d6600640 1 -- 172.21.15.1:0/769595968 >> 172.21.15.1:0/769595968 conn(0x7fc6d00ffa50 msgr2=0x7fc6d0101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:47.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.859+0000 7fc6d6600640 1 -- 172.21.15.1:0/769595968 shutdown_connections 2024-09-15T22:23:47.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.859+0000 7fc6d6600640 1 -- 172.21.15.1:0/769595968 wait complete. 2024-09-15T22:23:47.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.860+0000 7fc6d6600640 1 Processor -- start 2024-09-15T22:23:47.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.861+0000 7fc6d6600640 1 -- start start 2024-09-15T22:23:47.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.861+0000 7fc6d6600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6d0104010 0x7fc6d019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:47.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.861+0000 7fc6d6600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6d01049c0 0x7fc6d019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:47.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.861+0000 7fc6d6600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6d0109140 0x7fc6d019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:47.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.861+0000 7fc6d6600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d0114140 con 0x7fc6d0104010 2024-09-15T22:23:47.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.861+0000 7fc6d6600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d0113fc0 con 0x7fc6d0109140 2024-09-15T22:23:47.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.861+0000 7fc6d6600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d01142c0 con 0x7fc6d01049c0 2024-09-15T22:23:47.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.861+0000 7fc6cf400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6d0104010 0x7fc6d019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:47.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.861+0000 7fc6cea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6d01049c0 0x7fc6d019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:47.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.861+0000 7fc6cea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6d01049c0 0x7fc6d019ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:55066/0 (socket says 172.21.15.1:55066) 2024-09-15T22:23:47.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.861+0000 7fc6cfe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6d0109140 0x7fc6d019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:47.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.861+0000 7fc6cea00640 1 -- 172.21.15.1:0/3971616039 learned_addr learned my addr 172.21.15.1:0/3971616039 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:47.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.862+0000 7fc6cea00640 1 -- 172.21.15.1:0/3971616039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6d0109140 msgr2=0x7fc6d019ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:47.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.862+0000 7fc6cea00640 1 --2- 172.21.15.1:0/3971616039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6d0109140 0x7fc6d019ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:47.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.862+0000 7fc6cea00640 1 -- 172.21.15.1:0/3971616039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6d0104010 msgr2=0x7fc6d019a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:47.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.862+0000 7fc6cea00640 1 --2- 172.21.15.1:0/3971616039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6d0104010 0x7fc6d019a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:47.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.862+0000 7fc6cea00640 1 -- 172.21.15.1:0/3971616039 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6d019f5f0 con 0x7fc6d01049c0 2024-09-15T22:23:47.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.862+0000 7fc6cea00640 1 --2- 172.21.15.1:0/3971616039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6d01049c0 0x7fc6d019ab80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc035040 tx=0x7fc6bc033d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:47.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.862+0000 7fc6c7e00640 1 -- 172.21.15.1:0/3971616039 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc037040 con 0x7fc6d01049c0 2024-09-15T22:23:47.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.862+0000 7fc6d6600640 1 -- 172.21.15.1:0/3971616039 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6d019f880 con 0x7fc6d01049c0 2024-09-15T22:23:47.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.862+0000 7fc6c7e00640 1 -- 172.21.15.1:0/3971616039 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6bc040070 con 0x7fc6d01049c0 2024-09-15T22:23:47.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.862+0000 7fc6c7e00640 1 -- 172.21.15.1:0/3971616039 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc0039f0 con 0x7fc6d01049c0 2024-09-15T22:23:47.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.863+0000 7fc6d6600640 1 -- 172.21.15.1:0/3971616039 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6d01a71c0 con 0x7fc6d01049c0 2024-09-15T22:23:47.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.863+0000 7fc6d6600640 1 -- 172.21.15.1:0/3971616039 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc6d0062980 con 0x7fc6d01049c0 2024-09-15T22:23:47.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.866+0000 7fc6c7e00640 1 -- 172.21.15.1:0/3971616039 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fc6bc003b90 con 0x7fc6d01049c0 2024-09-15T22:23:47.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.867+0000 7fc6c7e00640 1 --2- 172.21.15.1:0/3971616039 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc6b40a32d0 0x7fc6b40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:47.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.867+0000 7fc6c7e00640 1 -- 172.21.15.1:0/3971616039 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fc6bc0f0480 con 0x7fc6d01049c0 2024-09-15T22:23:47.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.867+0000 7fc6cf400640 1 --2- 172.21.15.1:0/3971616039 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc6b40a32d0 0x7fc6b40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:47.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.867+0000 7fc6c7e00640 1 --2- 172.21.15.1:0/3971616039 >> [v2:172.21.15.1:6802/3588868833,v1:172.21.15.1:6803/3588868833] conn(0x7fc6b40acf00 0x7fc6b40af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:47.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.867+0000 7fc6c7e00640 1 -- 172.21.15.1:0/3971616039 --> [v2:172.21.15.1:6802/3588868833,v1:172.21.15.1:6803/3588868833] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc6b40afa70 con 0x7fc6b40acf00 2024-09-15T22:23:47.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.867+0000 7fc6c7e00640 1 -- 172.21.15.1:0/3971616039 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7fc6bc0f0830 con 0x7fc6d01049c0 2024-09-15T22:23:47.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.868+0000 7fc6cfe00640 1 --2- 172.21.15.1:0/3971616039 >> [v2:172.21.15.1:6802/3588868833,v1:172.21.15.1:6803/3588868833] conn(0x7fc6b40acf00 0x7fc6b40af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:47.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.868+0000 7fc6cf400640 1 --2- 172.21.15.1:0/3971616039 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc6b40a32d0 0x7fc6b40a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000abe0 tx=0x7fc6c000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:47.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.868+0000 7fc6cfe00640 1 --2- 172.21.15.1:0/3971616039 >> [v2:172.21.15.1:6802/3588868833,v1:172.21.15.1:6803/3588868833] conn(0x7fc6b40acf00 0x7fc6b40af3a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:47.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.869+0000 7fc6c7e00640 1 -- 172.21.15.1:0/3971616039 <== osd.0 v2:172.21.15.1:6802/3588868833 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc6b40afa70 con 0x7fc6b40acf00 2024-09-15T22:23:47.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.884+0000 7fc6d6600640 1 -- 172.21.15.1:0/3971616039 --> [v2:172.21.15.1:6802/3588868833,v1:172.21.15.1:6803/3588868833] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc6d0062d80 con 0x7fc6b40acf00 2024-09-15T22:23:47.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.884+0000 7fc6c7e00640 1 -- 172.21.15.1:0/3971616039 <== osd.0 v2:172.21.15.1:6802/3588868833 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc6d0062d80 con 0x7fc6b40acf00 2024-09-15T22:23:47.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.885+0000 7fc6d6600640 1 -- 172.21.15.1:0/3971616039 >> [v2:172.21.15.1:6802/3588868833,v1:172.21.15.1:6803/3588868833] conn(0x7fc6b40acf00 msgr2=0x7fc6b40af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:47.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.885+0000 7fc6d6600640 1 --2- 172.21.15.1:0/3971616039 >> [v2:172.21.15.1:6802/3588868833,v1:172.21.15.1:6803/3588868833] conn(0x7fc6b40acf00 0x7fc6b40af3a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:47.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.885+0000 7fc6d6600640 1 -- 172.21.15.1:0/3971616039 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc6b40a32d0 msgr2=0x7fc6b40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:47.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.885+0000 7fc6d6600640 1 --2- 172.21.15.1:0/3971616039 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc6b40a32d0 0x7fc6b40a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000abe0 tx=0x7fc6c000a2d0 comp rx=0 tx=0).stop 2024-09-15T22:23:47.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.885+0000 7fc6d6600640 1 -- 172.21.15.1:0/3971616039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6d01049c0 msgr2=0x7fc6d019ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:47.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.885+0000 7fc6d6600640 1 --2- 172.21.15.1:0/3971616039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6d01049c0 0x7fc6d019ab80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc035040 tx=0x7fc6bc033d90 comp rx=0 tx=0).stop 2024-09-15T22:23:47.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.885+0000 7fc6cfe00640 1 -- 172.21.15.1:0/3971616039 reap_dead start 2024-09-15T22:23:47.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.885+0000 7fc6d6600640 1 -- 172.21.15.1:0/3971616039 shutdown_connections 2024-09-15T22:23:47.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.885+0000 7fc6d6600640 1 -- 172.21.15.1:0/3971616039 >> 172.21.15.1:0/3971616039 conn(0x7fc6d00ffa50 msgr2=0x7fc6d0100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:47.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.885+0000 7fc6d6600640 1 -- 172.21.15.1:0/3971616039 shutdown_connections 2024-09-15T22:23:47.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.885+0000 7fc6d6600640 1 -- 172.21.15.1:0/3971616039 wait complete. 2024-09-15T22:23:48.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.971+0000 7f57a2200640 1 -- 172.21.15.1:0/2977462651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f579c0745c0 msgr2=0x7f579c0749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:48.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.971+0000 7f57a2200640 1 --2- 172.21.15.1:0/2977462651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f579c0745c0 0x7f579c0749a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f578c009900 tx=0x7f578c02a480 comp rx=0 tx=0).stop 2024-09-15T22:23:48.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.971+0000 7f57a2200640 1 -- 172.21.15.1:0/2977462651 shutdown_connections 2024-09-15T22:23:48.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.971+0000 7f57a2200640 1 --2- 172.21.15.1:0/2977462651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f579c10e430 0x7f579c110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.971+0000 7f57a2200640 1 --2- 172.21.15.1:0/2977462651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f579c074ee0 0x7f579c10def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.971+0000 7f57a2200640 1 --2- 172.21.15.1:0/2977462651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f579c0745c0 0x7f579c0749a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.971+0000 7f57a2200640 1 -- 172.21.15.1:0/2977462651 >> 172.21.15.1:0/2977462651 conn(0x7f579c0fd8b0 msgr2=0x7f579c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:48.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.971+0000 7f57a2200640 1 -- 172.21.15.1:0/2977462651 shutdown_connections 2024-09-15T22:23:48.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.971+0000 7f57a2200640 1 -- 172.21.15.1:0/2977462651 wait complete. 2024-09-15T22:23:48.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.972+0000 7f57a2200640 1 Processor -- start 2024-09-15T22:23:48.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.972+0000 7f57a2200640 1 -- start start 2024-09-15T22:23:48.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.972+0000 7f57a2200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f579c0745c0 0x7f579c19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:48.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.972+0000 7f57a2200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f579c074ee0 0x7f579c19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:48.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.972+0000 7f57a2200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f579c10e430 0x7f579c19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:48.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.972+0000 7f57a2200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f579c114190 con 0x7f579c074ee0 2024-09-15T22:23:48.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.972+0000 7f57a2200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f579c114010 con 0x7f579c0745c0 2024-09-15T22:23:48.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.972+0000 7f57a2200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f579c114310 con 0x7f579c10e430 2024-09-15T22:23:48.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.972+0000 7f579be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f579c10e430 0x7f579c19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:48.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.972+0000 7f579aa00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f579c074ee0 0x7f579c19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:48.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.972+0000 7f579be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f579c10e430 0x7f579c19ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:55074/0 (socket says 172.21.15.1:55074) 2024-09-15T22:23:48.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.972+0000 7f579be00640 1 -- 172.21.15.1:0/3162990099 learned_addr learned my addr 172.21.15.1:0/3162990099 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:48.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.973+0000 7f579b400640 1 --2- 172.21.15.1:0/3162990099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f579c0745c0 0x7f579c19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:48.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.973+0000 7f579be00640 1 -- 172.21.15.1:0/3162990099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f579c0745c0 msgr2=0x7f579c19a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:48.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.973+0000 7f579be00640 1 --2- 172.21.15.1:0/3162990099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f579c0745c0 0x7f579c19a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.973+0000 7f579be00640 1 -- 172.21.15.1:0/3162990099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f579c074ee0 msgr2=0x7f579c19abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:48.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.973+0000 7f579be00640 1 --2- 172.21.15.1:0/3162990099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f579c074ee0 0x7f579c19abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.973+0000 7f579be00640 1 -- 172.21.15.1:0/3162990099 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f579c19f620 con 0x7f579c10e430 2024-09-15T22:23:48.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.973+0000 7f579be00640 1 --2- 172.21.15.1:0/3162990099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f579c10e430 0x7f579c19ef40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f579400eb40 tx=0x7f579400c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:48.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.973+0000 7f5793e00640 1 -- 172.21.15.1:0/3162990099 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5794004b20 con 0x7f579c10e430 2024-09-15T22:23:48.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.973+0000 7f5793e00640 1 -- 172.21.15.1:0/3162990099 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5794004cc0 con 0x7f579c10e430 2024-09-15T22:23:48.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.973+0000 7f57a2200640 1 -- 172.21.15.1:0/3162990099 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f579c19f910 con 0x7f579c10e430 2024-09-15T22:23:48.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.973+0000 7f5793e00640 1 -- 172.21.15.1:0/3162990099 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5794010850 con 0x7f579c10e430 2024-09-15T22:23:48.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.974+0000 7f57a2200640 1 -- 172.21.15.1:0/3162990099 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f579c1a71f0 con 0x7f579c10e430 2024-09-15T22:23:48.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.974+0000 7f57a2200640 1 -- 172.21.15.1:0/3162990099 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f579c062980 con 0x7f579c10e430 2024-09-15T22:23:48.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.976+0000 7f5793e00640 1 -- 172.21.15.1:0/3162990099 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f5794005000 con 0x7f579c10e430 2024-09-15T22:23:48.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.978+0000 7f5793e00640 1 --2- 172.21.15.1:0/3162990099 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f57800a32d0 0x7f57800a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:48.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.978+0000 7f5793e00640 1 -- 172.21.15.1:0/3162990099 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f57940d0540 con 0x7f579c10e430 2024-09-15T22:23:48.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.978+0000 7f579b400640 1 --2- 172.21.15.1:0/3162990099 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f57800a32d0 0x7f57800a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:48.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.978+0000 7f5793e00640 1 --2- 172.21.15.1:0/3162990099 >> [v2:172.21.15.1:6810/3706738461,v1:172.21.15.1:6811/3706738461] conn(0x7f57800acf00 0x7f57800af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:48.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.978+0000 7f5793e00640 1 -- 172.21.15.1:0/3162990099 --> [v2:172.21.15.1:6810/3706738461,v1:172.21.15.1:6811/3706738461] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f579401ee50 con 0x7f57800acf00 2024-09-15T22:23:48.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.978+0000 7f5793e00640 1 -- 172.21.15.1:0/3162990099 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f57940d08f0 con 0x7f579c10e430 2024-09-15T22:23:48.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.979+0000 7f579aa00640 1 --2- 172.21.15.1:0/3162990099 >> [v2:172.21.15.1:6810/3706738461,v1:172.21.15.1:6811/3706738461] conn(0x7f57800acf00 0x7f57800af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:48.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.979+0000 7f579b400640 1 --2- 172.21.15.1:0/3162990099 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f57800a32d0 0x7f57800a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f578c005ab0 tx=0x7f578c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:48.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.979+0000 7f579aa00640 1 --2- 172.21.15.1:0/3162990099 >> [v2:172.21.15.1:6810/3706738461,v1:172.21.15.1:6811/3706738461] conn(0x7f57800acf00 0x7f57800af3a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:48.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.980+0000 7f5793e00640 1 -- 172.21.15.1:0/3162990099 <== osd.3 v2:172.21.15.1:6810/3706738461 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f579401ee50 con 0x7f57800acf00 2024-09-15T22:23:48.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.994+0000 7f57a2200640 1 -- 172.21.15.1:0/3162990099 --> [v2:172.21.15.1:6810/3706738461,v1:172.21.15.1:6811/3706738461] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f579c062e00 con 0x7f57800acf00 2024-09-15T22:23:48.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.995+0000 7f5793e00640 1 -- 172.21.15.1:0/3162990099 <== osd.3 v2:172.21.15.1:6810/3706738461 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f579c062e00 con 0x7f57800acf00 2024-09-15T22:23:48.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.995+0000 7f57a2200640 1 -- 172.21.15.1:0/3162990099 >> [v2:172.21.15.1:6810/3706738461,v1:172.21.15.1:6811/3706738461] conn(0x7f57800acf00 msgr2=0x7f57800af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:48.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.995+0000 7f57a2200640 1 --2- 172.21.15.1:0/3162990099 >> [v2:172.21.15.1:6810/3706738461,v1:172.21.15.1:6811/3706738461] conn(0x7f57800acf00 0x7f57800af3a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.995+0000 7f57a2200640 1 -- 172.21.15.1:0/3162990099 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f57800a32d0 msgr2=0x7f57800a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:48.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.995+0000 7f57a2200640 1 --2- 172.21.15.1:0/3162990099 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f57800a32d0 0x7f57800a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f578c005ab0 tx=0x7f578c005a20 comp rx=0 tx=0).stop 2024-09-15T22:23:48.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.995+0000 7f57a2200640 1 -- 172.21.15.1:0/3162990099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f579c10e430 msgr2=0x7f579c19ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:48.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.995+0000 7f57a2200640 1 --2- 172.21.15.1:0/3162990099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f579c10e430 0x7f579c19ef40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f579400eb40 tx=0x7f579400c2d0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.995+0000 7f579be00640 1 -- 172.21.15.1:0/3162990099 reap_dead start 2024-09-15T22:23:48.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.996+0000 7f57a2200640 1 -- 172.21.15.1:0/3162990099 shutdown_connections 2024-09-15T22:23:48.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.996+0000 7f57a2200640 1 -- 172.21.15.1:0/3162990099 >> 172.21.15.1:0/3162990099 conn(0x7f579c0fd8b0 msgr2=0x7f579c0fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:48.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.996+0000 7f57a2200640 1 -- 172.21.15.1:0/3162990099 shutdown_connections 2024-09-15T22:23:48.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:47.996+0000 7f57a2200640 1 -- 172.21.15.1:0/3162990099 wait complete. 2024-09-15T22:23:49.266 INFO:teuthology.orchestra.run.smithi001.stdout:111669149762 2024-09-15T22:23:49.266 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-15T22:23:49.582 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:49 smithi001 ceph-mon[30843]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-15T22:23:49.627 INFO:teuthology.orchestra.run.smithi001.stdout:34359738451 2024-09-15T22:23:49.628 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-15T22:23:49.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:49 smithi012 ceph-mon[34883]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-15T22:23:49.774 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:49.786 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:49.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:49 smithi098 ceph-mon[35514]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-15T22:23:50.748 INFO:teuthology.orchestra.run.smithi001.stdout:296352743454 2024-09-15T22:23:50.748 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-15T22:23:50.749 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:51.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.153+0000 7f7911000640 1 -- 172.21.15.1:0/3421755381 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f790c074ee0 msgr2=0x7f790c10dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:51.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.153+0000 7f7911000640 1 --2- 172.21.15.1:0/3421755381 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f790c074ee0 0x7f790c10dd20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f78f4009900 tx=0x7f78f402a480 comp rx=0 tx=0).stop 2024-09-15T22:23:51.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.153+0000 7f7911000640 1 -- 172.21.15.1:0/3421755381 shutdown_connections 2024-09-15T22:23:51.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.153+0000 7f7911000640 1 --2- 172.21.15.1:0/3421755381 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f790c10e260 0x7f790c110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.153+0000 7f7911000640 1 --2- 172.21.15.1:0/3421755381 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f790c074ee0 0x7f790c10dd20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.153+0000 7f7911000640 1 --2- 172.21.15.1:0/3421755381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f790c0745c0 0x7f790c0749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.153+0000 7f7911000640 1 -- 172.21.15.1:0/3421755381 >> 172.21.15.1:0/3421755381 conn(0x7f790c0fd740 msgr2=0x7f790c0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:51.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.153+0000 7f7911000640 1 -- 172.21.15.1:0/3421755381 shutdown_connections 2024-09-15T22:23:51.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.153+0000 7f7911000640 1 -- 172.21.15.1:0/3421755381 wait complete. 2024-09-15T22:23:51.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.154+0000 7f7911000640 1 Processor -- start 2024-09-15T22:23:51.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.155+0000 7f7911000640 1 -- start start 2024-09-15T22:23:51.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.155+0000 7f7911000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f790c0745c0 0x7f790c19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:51.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.155+0000 7f7911000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f790c074ee0 0x7f790c19a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:51.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.155+0000 7f7911000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f790c10e260 0x7f790c19ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:51.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.155+0000 7f7911000640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f790c114000 con 0x7f790c10e260 2024-09-15T22:23:51.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.155+0000 7f7911000640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f790c113e80 con 0x7f790c0745c0 2024-09-15T22:23:51.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.155+0000 7f7911000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f790c114180 con 0x7f790c074ee0 2024-09-15T22:23:51.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.155+0000 7f790b400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f790c0745c0 0x7f790c19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:51.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.155+0000 7f790b400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f790c0745c0 0x7f790c19a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:36108/0 (socket says 172.21.15.1:36108) 2024-09-15T22:23:51.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.155+0000 7f790be00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f790c10e260 0x7f790c19ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:51.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.155+0000 7f790b400640 1 -- 172.21.15.1:0/141368444 learned_addr learned my addr 172.21.15.1:0/141368444 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:51.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.155+0000 7f7902a00640 1 --2- 172.21.15.1:0/141368444 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f790c074ee0 0x7f790c19a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:51.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.156+0000 7f790b400640 1 -- 172.21.15.1:0/141368444 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f790c074ee0 msgr2=0x7f790c19a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:51.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.156+0000 7f790b400640 1 --2- 172.21.15.1:0/141368444 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f790c074ee0 0x7f790c19a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.156+0000 7f790b400640 1 -- 172.21.15.1:0/141368444 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f790c10e260 msgr2=0x7f790c19ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:51.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.156+0000 7f790b400640 1 --2- 172.21.15.1:0/141368444 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f790c10e260 0x7f790c19ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.156+0000 7f790b400640 1 -- 172.21.15.1:0/141368444 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f790c19f450 con 0x7f790c0745c0 2024-09-15T22:23:51.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.156+0000 7f790be00640 1 --2- 172.21.15.1:0/141368444 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f790c10e260 0x7f790c19ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:23:51.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.156+0000 7f790b400640 1 --2- 172.21.15.1:0/141368444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f790c0745c0 0x7f790c19a4a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00ebc0 tx=0x7f78fc00c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:51.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.156+0000 7f7908c00640 1 -- 172.21.15.1:0/141368444 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc010630 con 0x7f790c0745c0 2024-09-15T22:23:51.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.157+0000 7f7908c00640 1 -- 172.21.15.1:0/141368444 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78fc010cb0 con 0x7f790c0745c0 2024-09-15T22:23:51.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.157+0000 7f7911000640 1 -- 172.21.15.1:0/141368444 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f790c19f740 con 0x7f790c0745c0 2024-09-15T22:23:51.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.157+0000 7f7908c00640 1 -- 172.21.15.1:0/141368444 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc018bd0 con 0x7f790c0745c0 2024-09-15T22:23:51.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.157+0000 7f7911000640 1 -- 172.21.15.1:0/141368444 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f790c1a7020 con 0x7f790c0745c0 2024-09-15T22:23:51.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.157+0000 7f7911000640 1 -- 172.21.15.1:0/141368444 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f790c062980 con 0x7f790c0745c0 2024-09-15T22:23:51.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.160+0000 7f7908c00640 1 -- 172.21.15.1:0/141368444 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f78fc0107d0 con 0x7f790c0745c0 2024-09-15T22:23:51.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.161+0000 7f7908c00640 1 --2- 172.21.15.1:0/141368444 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f78f00a32d0 0x7f78f00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:51.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.161+0000 7f7908c00640 1 -- 172.21.15.1:0/141368444 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f78fc0d0540 con 0x7f790c0745c0 2024-09-15T22:23:51.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.161+0000 7f7902a00640 1 --2- 172.21.15.1:0/141368444 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f78f00a32d0 0x7f78f00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:51.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.161+0000 7f7908c00640 1 --2- 172.21.15.1:0/141368444 >> [v2:172.21.15.98:6808/4043567619,v1:172.21.15.98:6809/4043567619] conn(0x7f78f00acf00 0x7f78f00af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:51.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.161+0000 7f7908c00640 1 -- 172.21.15.1:0/141368444 --> [v2:172.21.15.98:6808/4043567619,v1:172.21.15.98:6809/4043567619] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f78f00afa70 con 0x7f78f00acf00 2024-09-15T22:23:51.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.161+0000 7f7908c00640 1 -- 172.21.15.1:0/141368444 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f78fc0d08f0 con 0x7f790c0745c0 2024-09-15T22:23:51.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.162+0000 7f790be00640 1 --2- 172.21.15.1:0/141368444 >> [v2:172.21.15.98:6808/4043567619,v1:172.21.15.98:6809/4043567619] conn(0x7f78f00acf00 0x7f78f00af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:51.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.162+0000 7f7902a00640 1 --2- 172.21.15.1:0/141368444 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f78f00a32d0 0x7f78f00a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f78f4000c00 tx=0x7f78f4005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:51.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.162+0000 7f790be00640 1 --2- 172.21.15.1:0/141368444 >> [v2:172.21.15.98:6808/4043567619,v1:172.21.15.98:6809/4043567619] conn(0x7f78f00acf00 0x7f78f00af3a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:51.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.163+0000 7f7908c00640 1 -- 172.21.15.1:0/141368444 <== osd.5 v2:172.21.15.98:6808/4043567619 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f78f00afa70 con 0x7f78f00acf00 2024-09-15T22:23:51.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.178+0000 7f7911000640 1 -- 172.21.15.1:0/141368444 --> [v2:172.21.15.98:6808/4043567619,v1:172.21.15.98:6809/4043567619] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f790c062e00 con 0x7f78f00acf00 2024-09-15T22:23:51.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.178+0000 7f7908c00640 1 -- 172.21.15.1:0/141368444 <== osd.5 v2:172.21.15.98:6808/4043567619 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f790c062e00 con 0x7f78f00acf00 2024-09-15T22:23:51.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.179+0000 7f7911000640 1 -- 172.21.15.1:0/141368444 >> [v2:172.21.15.98:6808/4043567619,v1:172.21.15.98:6809/4043567619] conn(0x7f78f00acf00 msgr2=0x7f78f00af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:51.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.179+0000 7f7911000640 1 --2- 172.21.15.1:0/141368444 >> [v2:172.21.15.98:6808/4043567619,v1:172.21.15.98:6809/4043567619] conn(0x7f78f00acf00 0x7f78f00af3a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.179+0000 7f7911000640 1 -- 172.21.15.1:0/141368444 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f78f00a32d0 msgr2=0x7f78f00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:51.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.179+0000 7f7911000640 1 --2- 172.21.15.1:0/141368444 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f78f00a32d0 0x7f78f00a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f78f4000c00 tx=0x7f78f4005b50 comp rx=0 tx=0).stop 2024-09-15T22:23:51.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.179+0000 7f7911000640 1 -- 172.21.15.1:0/141368444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f790c0745c0 msgr2=0x7f790c19a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:51.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.179+0000 7f7911000640 1 --2- 172.21.15.1:0/141368444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f790c0745c0 0x7f790c19a4a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00ebc0 tx=0x7f78fc00c6a0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.179+0000 7f790be00640 1 -- 172.21.15.1:0/141368444 reap_dead start 2024-09-15T22:23:51.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.179+0000 7f7911000640 1 -- 172.21.15.1:0/141368444 shutdown_connections 2024-09-15T22:23:51.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.179+0000 7f7911000640 1 -- 172.21.15.1:0/141368444 >> 172.21.15.1:0/141368444 conn(0x7f790c0fd740 msgr2=0x7f790c0fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:51.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.179+0000 7f7911000640 1 -- 172.21.15.1:0/141368444 shutdown_connections 2024-09-15T22:23:51.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:51.179+0000 7f7911000640 1 -- 172.21.15.1:0/141368444 wait complete. 2024-09-15T22:23:51.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:51 smithi001 ceph-mon[30843]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-15T22:23:51.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:51 smithi012 ceph-mon[34883]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-15T22:23:51.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:51 smithi098 ceph-mon[35514]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-15T22:23:51.993 INFO:teuthology.orchestra.run.smithi001.stdout:163208757306 2024-09-15T22:23:51.993 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-15T22:23:52.338 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:52.339 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:52.372 INFO:teuthology.orchestra.run.smithi001.stdout:77309411401 2024-09-15T22:23:52.373 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-15T22:23:53.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.195+0000 7ff86a600640 1 -- 172.21.15.1:0/1049903657 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff86410e210 msgr2=0x7ff864110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:53.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.195+0000 7ff86a600640 1 --2- 172.21.15.1:0/1049903657 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff86410e210 0x7ff864110660 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff85c009ca0 tx=0x7ff85c02a950 comp rx=0 tx=0).stop 2024-09-15T22:23:53.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.195+0000 7ff86a600640 1 -- 172.21.15.1:0/1049903657 shutdown_connections 2024-09-15T22:23:53.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.195+0000 7ff86a600640 1 --2- 172.21.15.1:0/1049903657 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff86410e210 0x7ff864110660 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:53.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.195+0000 7ff86a600640 1 --2- 172.21.15.1:0/1049903657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff864074f40 0x7ff86410dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:53.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.195+0000 7ff86a600640 1 --2- 172.21.15.1:0/1049903657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff864074620 0x7ff864074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:53.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.195+0000 7ff86a600640 1 -- 172.21.15.1:0/1049903657 >> 172.21.15.1:0/1049903657 conn(0x7ff8640fd710 msgr2=0x7ff8640ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:53.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.196+0000 7ff86a600640 1 -- 172.21.15.1:0/1049903657 shutdown_connections 2024-09-15T22:23:53.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.196+0000 7ff86a600640 1 -- 172.21.15.1:0/1049903657 wait complete. 2024-09-15T22:23:53.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.197+0000 7ff86a600640 1 Processor -- start 2024-09-15T22:23:53.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.197+0000 7ff86a600640 1 -- start start 2024-09-15T22:23:53.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.197+0000 7ff86a600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff864074620 0x7ff86419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:53.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.197+0000 7ff86a600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff864074f40 0x7ff86419aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:53.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.197+0000 7ff86a600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff86410e210 0x7ff86419edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:53.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.197+0000 7ff86a600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff864114010 con 0x7ff86410e210 2024-09-15T22:23:53.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.197+0000 7ff86a600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff864113e90 con 0x7ff864074f40 2024-09-15T22:23:53.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.197+0000 7ff86a600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff864114190 con 0x7ff864074620 2024-09-15T22:23:53.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.198+0000 7ff869200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff864074620 0x7ff86419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:53.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.198+0000 7ff863e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff864074f40 0x7ff86419aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:53.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.198+0000 7ff869c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff86410e210 0x7ff86419edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:53.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.198+0000 7ff869200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff864074620 0x7ff86419a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:55120/0 (socket says 172.21.15.1:55120) 2024-09-15T22:23:53.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.198+0000 7ff869c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff86410e210 0x7ff86419edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48676/0 (socket says 172.21.15.1:48676) 2024-09-15T22:23:53.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.198+0000 7ff869200640 1 -- 172.21.15.1:0/764625392 learned_addr learned my addr 172.21.15.1:0/764625392 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:53.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.198+0000 7ff863e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff864074f40 0x7ff86419aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:36156/0 (socket says 172.21.15.1:36156) 2024-09-15T22:23:53.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.198+0000 7ff863e00640 1 -- 172.21.15.1:0/764625392 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff864074620 msgr2=0x7ff86419a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:53.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.198+0000 7ff863e00640 1 --2- 172.21.15.1:0/764625392 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff864074620 0x7ff86419a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:53.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.198+0000 7ff863e00640 1 -- 172.21.15.1:0/764625392 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff86410e210 msgr2=0x7ff86419edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:53.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.198+0000 7ff863e00640 1 --2- 172.21.15.1:0/764625392 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff86410e210 0x7ff86419edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:53.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.198+0000 7ff863e00640 1 -- 172.21.15.1:0/764625392 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff86419f4a0 con 0x7ff864074f40 2024-09-15T22:23:53.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.199+0000 7ff863e00640 1 --2- 172.21.15.1:0/764625392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff864074f40 0x7ff86419aa30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff85000e9f0 tx=0x7ff85000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:53.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.199+0000 7ff861600640 1 -- 172.21.15.1:0/764625392 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85000cd80 con 0x7ff864074f40 2024-09-15T22:23:53.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.199+0000 7ff861600640 1 -- 172.21.15.1:0/764625392 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8500035f0 con 0x7ff864074f40 2024-09-15T22:23:53.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.199+0000 7ff861600640 1 -- 172.21.15.1:0/764625392 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff850010690 con 0x7ff864074f40 2024-09-15T22:23:53.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.199+0000 7ff86a600640 1 -- 172.21.15.1:0/764625392 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff86419f790 con 0x7ff864074f40 2024-09-15T22:23:53.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.199+0000 7ff86a600640 1 -- 172.21.15.1:0/764625392 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8641a7070 con 0x7ff864074f40 2024-09-15T22:23:53.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.200+0000 7ff86a600640 1 -- 172.21.15.1:0/764625392 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff864074a00 con 0x7ff864074f40 2024-09-15T22:23:53.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.203+0000 7ff861600640 1 -- 172.21.15.1:0/764625392 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7ff850003b30 con 0x7ff864074f40 2024-09-15T22:23:53.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.205+0000 7ff861600640 1 --2- 172.21.15.1:0/764625392 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ff84c0a32d0 0x7ff84c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:53.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.205+0000 7ff861600640 1 -- 172.21.15.1:0/764625392 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ff8500cfe80 con 0x7ff864074f40 2024-09-15T22:23:53.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.205+0000 7ff869200640 1 --2- 172.21.15.1:0/764625392 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ff84c0a32d0 0x7ff84c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:53.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.206+0000 7ff869200640 1 --2- 172.21.15.1:0/764625392 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ff84c0a32d0 0x7ff84c0a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff858009cd0 tx=0x7ff858005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:53.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.206+0000 7ff861600640 1 -- 172.21.15.1:0/764625392 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff85009c9d0 con 0x7ff864074f40 2024-09-15T22:23:53.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.403+0000 7ff86a600640 1 -- 172.21.15.1:0/764625392 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7ff86419b850 con 0x7ff864074f40 2024-09-15T22:23:53.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.403+0000 7ff861600640 1 -- 172.21.15.1:0/764625392 <== mon.2 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff85009c2d0 con 0x7ff864074f40 2024-09-15T22:23:53.405 INFO:teuthology.orchestra.run.smithi001.stdout:193273528371 2024-09-15T22:23:53.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.405+0000 7ff86a600640 1 -- 172.21.15.1:0/764625392 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ff84c0a32d0 msgr2=0x7ff84c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:53.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.405+0000 7ff86a600640 1 --2- 172.21.15.1:0/764625392 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ff84c0a32d0 0x7ff84c0a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff858009cd0 tx=0x7ff858005f90 comp rx=0 tx=0).stop 2024-09-15T22:23:53.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.406+0000 7ff86a600640 1 -- 172.21.15.1:0/764625392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff864074f40 msgr2=0x7ff86419aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:53.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.406+0000 7ff86a600640 1 --2- 172.21.15.1:0/764625392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff864074f40 0x7ff86419aa30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff85000e9f0 tx=0x7ff85000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:23:53.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.406+0000 7ff86a600640 1 -- 172.21.15.1:0/764625392 shutdown_connections 2024-09-15T22:23:53.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.406+0000 7ff86a600640 1 --2- 172.21.15.1:0/764625392 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ff84c0a32d0 0x7ff84c0a5790 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:53.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.406+0000 7ff86a600640 1 --2- 172.21.15.1:0/764625392 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff86410e210 0x7ff86419edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:53.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.406+0000 7ff86a600640 1 --2- 172.21.15.1:0/764625392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff864074f40 0x7ff86419aa30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:53.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.406+0000 7ff86a600640 1 --2- 172.21.15.1:0/764625392 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff864074620 0x7ff86419a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:53.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.406+0000 7ff86a600640 1 -- 172.21.15.1:0/764625392 >> 172.21.15.1:0/764625392 conn(0x7ff8640fd710 msgr2=0x7ff8640fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:53.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.406+0000 7ff86a600640 1 -- 172.21.15.1:0/764625392 shutdown_connections 2024-09-15T22:23:53.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.406+0000 7ff86a600640 1 -- 172.21.15.1:0/764625392 wait complete. 2024-09-15T22:23:53.450 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:53 smithi001 ceph-mon[30843]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-15T22:23:53.450 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:53 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/658924011' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-15T22:23:53.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:53 smithi012 ceph-mon[34883]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-15T22:23:53.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:53 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/658924011' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-15T22:23:53.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:53 smithi098 ceph-mon[35514]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-15T22:23:53.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:53 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/658924011' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-15T22:23:54.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.209+0000 7f2773a00640 1 -- 172.21.15.1:0/3092001150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f276c1049c0 msgr2=0x7f276c108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:54.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.209+0000 7f2773a00640 1 --2- 172.21.15.1:0/3092001150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f276c1049c0 0x7f276c108a10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2758009900 tx=0x7f275802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.209+0000 7f2773a00640 1 -- 172.21.15.1:0/3092001150 shutdown_connections 2024-09-15T22:23:54.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.209+0000 7f2773a00640 1 --2- 172.21.15.1:0/3092001150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f276c109140 0x7f276c110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.209+0000 7f2773a00640 1 --2- 172.21.15.1:0/3092001150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f276c1049c0 0x7f276c108a10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.209+0000 7f2773a00640 1 --2- 172.21.15.1:0/3092001150 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f276c104010 0x7f276c1043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.209+0000 7f2773a00640 1 -- 172.21.15.1:0/3092001150 >> 172.21.15.1:0/3092001150 conn(0x7f276c0ffa50 msgr2=0x7f276c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:54.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.209+0000 7f2773a00640 1 -- 172.21.15.1:0/3092001150 shutdown_connections 2024-09-15T22:23:54.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.209+0000 7f2773a00640 1 -- 172.21.15.1:0/3092001150 wait complete. 2024-09-15T22:23:54.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.211+0000 7f2773a00640 1 Processor -- start 2024-09-15T22:23:54.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.211+0000 7f2773a00640 1 -- start start 2024-09-15T22:23:54.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.211+0000 7f2773a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f276c104010 0x7f276c19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:54.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.211+0000 7f2773a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f276c1049c0 0x7f276c19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:54.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.211+0000 7f2773a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f276c109140 0x7f276c19ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:54.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.211+0000 7f2773a00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f276c114140 con 0x7f276c109140 2024-09-15T22:23:54.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.211+0000 7f2773a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f276c113fc0 con 0x7f276c1049c0 2024-09-15T22:23:54.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.211+0000 7f2773a00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f276c1142c0 con 0x7f276c104010 2024-09-15T22:23:54.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.212+0000 7f276be00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f276c1049c0 0x7f276c19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:54.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.212+0000 7f276be00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f276c1049c0 0x7f276c19ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:36174/0 (socket says 172.21.15.1:36174) 2024-09-15T22:23:54.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.212+0000 7f276be00640 1 -- 172.21.15.1:0/1898216648 learned_addr learned my addr 172.21.15.1:0/1898216648 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:54.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.212+0000 7f2771000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f276c104010 0x7f276c19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:54.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.212+0000 7f2771a00640 1 --2- 172.21.15.1:0/1898216648 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f276c109140 0x7f276c19ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:54.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.212+0000 7f276be00640 1 -- 172.21.15.1:0/1898216648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f276c104010 msgr2=0x7f276c19a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:54.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.212+0000 7f276be00640 1 --2- 172.21.15.1:0/1898216648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f276c104010 0x7f276c19a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.212+0000 7f276be00640 1 -- 172.21.15.1:0/1898216648 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f276c109140 msgr2=0x7f276c19ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:54.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.212+0000 7f276be00640 1 --2- 172.21.15.1:0/1898216648 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f276c109140 0x7f276c19ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.212+0000 7f276be00640 1 -- 172.21.15.1:0/1898216648 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f276c19f5f0 con 0x7f276c1049c0 2024-09-15T22:23:54.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.212+0000 7f2771000640 1 --2- 172.21.15.1:0/1898216648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f276c104010 0x7f276c19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:23:54.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.213+0000 7f276be00640 1 --2- 172.21.15.1:0/1898216648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f276c1049c0 0x7f276c19ab80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2758006010 tx=0x7f27580042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:54.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.213+0000 7f2769600640 1 -- 172.21.15.1:0/1898216648 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275803f030 con 0x7f276c1049c0 2024-09-15T22:23:54.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.213+0000 7f2773a00640 1 -- 172.21.15.1:0/1898216648 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f276c19f880 con 0x7f276c1049c0 2024-09-15T22:23:54.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.213+0000 7f2769600640 1 -- 172.21.15.1:0/1898216648 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2758003ce0 con 0x7f276c1049c0 2024-09-15T22:23:54.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.213+0000 7f2769600640 1 -- 172.21.15.1:0/1898216648 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2758035070 con 0x7f276c1049c0 2024-09-15T22:23:54.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.213+0000 7f2773a00640 1 -- 172.21.15.1:0/1898216648 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f276c1a71c0 con 0x7f276c1049c0 2024-09-15T22:23:54.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.214+0000 7f2773a00640 1 -- 172.21.15.1:0/1898216648 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f276c1054f0 con 0x7f276c1049c0 2024-09-15T22:23:54.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.216+0000 7f2769600640 1 -- 172.21.15.1:0/1898216648 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f2758042030 con 0x7f276c1049c0 2024-09-15T22:23:54.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.217+0000 7f2769600640 1 --2- 172.21.15.1:0/1898216648 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f27540a32d0 0x7f27540a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:54.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.217+0000 7f2769600640 1 -- 172.21.15.1:0/1898216648 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f27580f0400 con 0x7f276c1049c0 2024-09-15T22:23:54.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.218+0000 7f2771000640 1 --2- 172.21.15.1:0/1898216648 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f27540a32d0 0x7f27540a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:54.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.218+0000 7f2771000640 1 --2- 172.21.15.1:0/1898216648 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f27540a32d0 0x7f27540a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2760005d00 tx=0x7f276000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:54.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.219+0000 7f2769600640 1 -- 172.21.15.1:0/1898216648 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f27580bc9c0 con 0x7f276c1049c0 2024-09-15T22:23:54.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.407+0000 7f2773a00640 1 -- 172.21.15.1:0/1898216648 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f276c10c380 con 0x7f276c1049c0 2024-09-15T22:23:54.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.408+0000 7f2769600640 1 -- 172.21.15.1:0/1898216648 <== mon.2 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f27580c0cc0 con 0x7f276c1049c0 2024-09-15T22:23:54.410 INFO:teuthology.orchestra.run.smithi001.stdout:55834574928 2024-09-15T22:23:54.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.411+0000 7f2773a00640 1 -- 172.21.15.1:0/1898216648 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f27540a32d0 msgr2=0x7f27540a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:54.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.411+0000 7f2773a00640 1 --2- 172.21.15.1:0/1898216648 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f27540a32d0 0x7f27540a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2760005d00 tx=0x7f276000b410 comp rx=0 tx=0).stop 2024-09-15T22:23:54.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.411+0000 7f2773a00640 1 -- 172.21.15.1:0/1898216648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f276c1049c0 msgr2=0x7f276c19ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:54.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.411+0000 7f2773a00640 1 --2- 172.21.15.1:0/1898216648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f276c1049c0 0x7f276c19ab80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2758006010 tx=0x7f27580042f0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.411+0000 7f2773a00640 1 -- 172.21.15.1:0/1898216648 shutdown_connections 2024-09-15T22:23:54.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.411+0000 7f2773a00640 1 --2- 172.21.15.1:0/1898216648 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f27540a32d0 0x7f27540a5790 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.411+0000 7f2773a00640 1 --2- 172.21.15.1:0/1898216648 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f276c109140 0x7f276c19ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.411+0000 7f2773a00640 1 --2- 172.21.15.1:0/1898216648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f276c1049c0 0x7f276c19ab80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.411+0000 7f2773a00640 1 --2- 172.21.15.1:0/1898216648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f276c104010 0x7f276c19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.411+0000 7f2773a00640 1 -- 172.21.15.1:0/1898216648 >> 172.21.15.1:0/1898216648 conn(0x7f276c0ffa50 msgr2=0x7f276c100df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:54.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.411+0000 7f2773a00640 1 -- 172.21.15.1:0/1898216648 shutdown_connections 2024-09-15T22:23:54.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.411+0000 7f2773a00640 1 -- 172.21.15.1:0/1898216648 wait complete. 2024-09-15T22:23:54.457 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:54 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/764625392' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-15T22:23:54.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.455+0000 7f886b400640 1 -- 172.21.15.1:0/3249254603 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8864106f20 msgr2=0x7f886410eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:54.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.455+0000 7f886b400640 1 --2- 172.21.15.1:0/3249254603 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8864106f20 0x7f886410eaa0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f885c009ca0 tx=0x7f885c02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.455+0000 7f886b400640 1 -- 172.21.15.1:0/3249254603 shutdown_connections 2024-09-15T22:23:54.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.455+0000 7f886b400640 1 --2- 172.21.15.1:0/3249254603 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8864106f20 0x7f886410eaa0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.455+0000 7f886b400640 1 --2- 172.21.15.1:0/3249254603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88641027a0 0x7f88641067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.455+0000 7f886b400640 1 --2- 172.21.15.1:0/3249254603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8864101df0 0x7f88641021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.455+0000 7f886b400640 1 -- 172.21.15.1:0/3249254603 >> 172.21.15.1:0/3249254603 conn(0x7f88640fd8b0 msgr2=0x7f88640ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:54.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.455+0000 7f886b400640 1 -- 172.21.15.1:0/3249254603 shutdown_connections 2024-09-15T22:23:54.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.455+0000 7f886b400640 1 -- 172.21.15.1:0/3249254603 wait complete. 2024-09-15T22:23:54.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.457+0000 7f886b400640 1 Processor -- start 2024-09-15T22:23:54.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.457+0000 7f886b400640 1 -- start start 2024-09-15T22:23:54.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.457+0000 7f886b400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8864101df0 0x7f88641a4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:54.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.457+0000 7f886b400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88641027a0 0x7f88641a4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:54.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.457+0000 7f886b400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8864106f20 0x7f886410db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:54.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.457+0000 7f886b400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8864111f80 con 0x7f8864101df0 2024-09-15T22:23:54.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.457+0000 7f886b400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8864111e00 con 0x7f8864106f20 2024-09-15T22:23:54.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.457+0000 7f886b400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8864112100 con 0x7f88641027a0 2024-09-15T22:23:54.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.458+0000 7f8863e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88641027a0 0x7f88641a4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:54.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.458+0000 7f8863e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88641027a0 0x7f88641a4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:55158/0 (socket says 172.21.15.1:55158) 2024-09-15T22:23:54.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.458+0000 7f8863e00640 1 -- 172.21.15.1:0/4137543454 learned_addr learned my addr 172.21.15.1:0/4137543454 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:54.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.458+0000 7f8868a00640 1 --2- 172.21.15.1:0/4137543454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8864101df0 0x7f88641a4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:54.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.458+0000 7f8869400640 1 --2- 172.21.15.1:0/4137543454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8864106f20 0x7f886410db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:54.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.459+0000 7f8863e00640 1 -- 172.21.15.1:0/4137543454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8864106f20 msgr2=0x7f886410db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:54.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.459+0000 7f8863e00640 1 --2- 172.21.15.1:0/4137543454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8864106f20 0x7f886410db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.459+0000 7f8863e00640 1 -- 172.21.15.1:0/4137543454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8864101df0 msgr2=0x7f88641a4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:54.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.459+0000 7f8863e00640 1 --2- 172.21.15.1:0/4137543454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8864101df0 0x7f88641a4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.459+0000 7f8863e00640 1 -- 172.21.15.1:0/4137543454 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f886410e320 con 0x7f88641027a0 2024-09-15T22:23:54.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.459+0000 7f8868a00640 1 --2- 172.21.15.1:0/4137543454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8864101df0 0x7f88641a4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:23:54.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.460+0000 7f8863e00640 1 --2- 172.21.15.1:0/4137543454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88641027a0 0x7f88641a4b90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f885000e9f0 tx=0x7f885000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:54.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.460+0000 7f8861600640 1 -- 172.21.15.1:0/4137543454 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f885000cd80 con 0x7f88641027a0 2024-09-15T22:23:54.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.461+0000 7f8861600640 1 -- 172.21.15.1:0/4137543454 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8850010910 con 0x7f88641027a0 2024-09-15T22:23:54.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.461+0000 7f8861600640 1 -- 172.21.15.1:0/4137543454 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8850018990 con 0x7f88641027a0 2024-09-15T22:23:54.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.461+0000 7f886b400640 1 -- 172.21.15.1:0/4137543454 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f886410e610 con 0x7f88641027a0 2024-09-15T22:23:54.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.461+0000 7f886b400640 1 -- 172.21.15.1:0/4137543454 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88641ab4b0 con 0x7f88641027a0 2024-09-15T22:23:54.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.464+0000 7f886b400640 1 -- 172.21.15.1:0/4137543454 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88641032d0 con 0x7f88641027a0 2024-09-15T22:23:54.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.468+0000 7f8861600640 1 -- 172.21.15.1:0/4137543454 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f8850010ac0 con 0x7f88641027a0 2024-09-15T22:23:54.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.469+0000 7f8861600640 1 --2- 172.21.15.1:0/4137543454 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f884c0a3350 0x7f884c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:54.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.470+0000 7f8861600640 1 -- 172.21.15.1:0/4137543454 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f88500cfda0 con 0x7f88641027a0 2024-09-15T22:23:54.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.470+0000 7f8868a00640 1 --2- 172.21.15.1:0/4137543454 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f884c0a3350 0x7f884c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:54.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.471+0000 7f8868a00640 1 --2- 172.21.15.1:0/4137543454 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f884c0a3350 0x7f884c0a5810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8858009c20 tx=0x7f8858005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:54.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.473+0000 7f8861600640 1 -- 172.21.15.1:0/4137543454 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f885009c8f0 con 0x7f88641027a0 2024-09-15T22:23:54.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.690+0000 7f886b400640 1 -- 172.21.15.1:0/4137543454 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f8864105ee0 con 0x7f88641027a0 2024-09-15T22:23:54.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.691+0000 7f8861600640 1 -- 172.21.15.1:0/4137543454 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f885009c1f0 con 0x7f88641027a0 2024-09-15T22:23:54.693 INFO:teuthology.orchestra.run.smithi001.stdout:274877906980 2024-09-15T22:23:54.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.694+0000 7f886b400640 1 -- 172.21.15.1:0/4137543454 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f884c0a3350 msgr2=0x7f884c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:54.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.694+0000 7f886b400640 1 --2- 172.21.15.1:0/4137543454 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f884c0a3350 0x7f884c0a5810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8858009c20 tx=0x7f8858005f90 comp rx=0 tx=0).stop 2024-09-15T22:23:54.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.694+0000 7f886b400640 1 -- 172.21.15.1:0/4137543454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88641027a0 msgr2=0x7f88641a4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:54.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.694+0000 7f886b400640 1 --2- 172.21.15.1:0/4137543454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88641027a0 0x7f88641a4b90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f885000e9f0 tx=0x7f885000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.694+0000 7f886b400640 1 -- 172.21.15.1:0/4137543454 shutdown_connections 2024-09-15T22:23:54.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.694+0000 7f886b400640 1 --2- 172.21.15.1:0/4137543454 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f884c0a3350 0x7f884c0a5810 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.694+0000 7f886b400640 1 --2- 172.21.15.1:0/4137543454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8864106f20 0x7f886410db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.694+0000 7f886b400640 1 --2- 172.21.15.1:0/4137543454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88641027a0 0x7f88641a4b90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.694+0000 7f886b400640 1 --2- 172.21.15.1:0/4137543454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8864101df0 0x7f88641a4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.694+0000 7f886b400640 1 -- 172.21.15.1:0/4137543454 >> 172.21.15.1:0/4137543454 conn(0x7f88640fd8b0 msgr2=0x7f88640fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:54.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.694+0000 7f886b400640 1 -- 172.21.15.1:0/4137543454 shutdown_connections 2024-09-15T22:23:54.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:54.694+0000 7f886b400640 1 -- 172.21.15.1:0/4137543454 wait complete. 2024-09-15T22:23:54.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:54 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/764625392' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-15T22:23:54.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:54 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/764625392' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-15T22:23:55.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.067+0000 7f8bebc00640 1 -- 172.21.15.1:0/2183761775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8be4101df0 msgr2=0x7f8be41021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:55.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.067+0000 7f8bebc00640 1 --2- 172.21.15.1:0/2183761775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8be4101df0 0x7f8be41021d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8009860 tx=0x7f8bd802a340 comp rx=0 tx=0).stop 2024-09-15T22:23:55.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.067+0000 7f8bebc00640 1 -- 172.21.15.1:0/2183761775 shutdown_connections 2024-09-15T22:23:55.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.067+0000 7f8bebc00640 1 --2- 172.21.15.1:0/2183761775 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8be4106f20 0x7f8be410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:55.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.067+0000 7f8bebc00640 1 --2- 172.21.15.1:0/2183761775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8be41027a0 0x7f8be41067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:55.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.067+0000 7f8bebc00640 1 --2- 172.21.15.1:0/2183761775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8be4101df0 0x7f8be41021d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:55.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.067+0000 7f8bebc00640 1 -- 172.21.15.1:0/2183761775 >> 172.21.15.1:0/2183761775 conn(0x7f8be40fd8b0 msgr2=0x7f8be40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:55.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.067+0000 7f8bebc00640 1 -- 172.21.15.1:0/2183761775 shutdown_connections 2024-09-15T22:23:55.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.067+0000 7f8bebc00640 1 -- 172.21.15.1:0/2183761775 wait complete. 2024-09-15T22:23:55.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.068+0000 7f8bebc00640 1 Processor -- start 2024-09-15T22:23:55.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.068+0000 7f8bebc00640 1 -- start start 2024-09-15T22:23:55.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.069+0000 7f8bebc00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8be4101df0 0x7f8be40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:55.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.069+0000 7f8bebc00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8be41027a0 0x7f8be4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:55.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.069+0000 7f8bebc00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8be4106f20 0x7f8be4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:55.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.069+0000 7f8bebc00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8be4111f80 con 0x7f8be4106f20 2024-09-15T22:23:55.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.069+0000 7f8bebc00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8be4111e00 con 0x7f8be4101df0 2024-09-15T22:23:55.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.069+0000 7f8bebc00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8be4112100 con 0x7f8be41027a0 2024-09-15T22:23:55.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.069+0000 7f8be9c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8be4106f20 0x7f8be4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:55.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.069+0000 7f8be9200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8be4101df0 0x7f8be40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:55.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.069+0000 7f8be9200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8be4101df0 0x7f8be40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:36128/0 (socket says 172.21.15.1:36128) 2024-09-15T22:23:55.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.069+0000 7f8be9200640 1 -- 172.21.15.1:0/658924011 learned_addr learned my addr 172.21.15.1:0/658924011 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:55.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.069+0000 7f8be3e00640 1 --2- 172.21.15.1:0/658924011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8be41027a0 0x7f8be4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:55.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.069+0000 7f8be9200640 1 -- 172.21.15.1:0/658924011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8be41027a0 msgr2=0x7f8be4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:55.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.069+0000 7f8be9200640 1 --2- 172.21.15.1:0/658924011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8be41027a0 0x7f8be4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:55.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.069+0000 7f8be9200640 1 -- 172.21.15.1:0/658924011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8be4106f20 msgr2=0x7f8be4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:55.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.069+0000 7f8be9200640 1 --2- 172.21.15.1:0/658924011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8be4106f20 0x7f8be4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:55.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.070+0000 7f8be9200640 1 -- 172.21.15.1:0/658924011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be41a68e0 con 0x7f8be4101df0 2024-09-15T22:23:55.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.070+0000 7f8be9c00640 1 --2- 172.21.15.1:0/658924011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8be4106f20 0x7f8be4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:23:55.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.070+0000 7f8be3e00640 1 --2- 172.21.15.1:0/658924011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8be41027a0 0x7f8be4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:23:55.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.070+0000 7f8be9200640 1 --2- 172.21.15.1:0/658924011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8be4101df0 0x7f8be40744f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8035040 tx=0x7f8bd8033d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:55.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.070+0000 7f8be1600640 1 -- 172.21.15.1:0/658924011 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd803f020 con 0x7f8be4101df0 2024-09-15T22:23:55.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.070+0000 7f8bebc00640 1 -- 172.21.15.1:0/658924011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8be41a6b70 con 0x7f8be4101df0 2024-09-15T22:23:55.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.070+0000 7f8be1600640 1 -- 172.21.15.1:0/658924011 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bd8032770 con 0x7f8be4101df0 2024-09-15T22:23:55.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.070+0000 7f8be1600640 1 -- 172.21.15.1:0/658924011 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd8037040 con 0x7f8be4101df0 2024-09-15T22:23:55.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.070+0000 7f8bebc00640 1 -- 172.21.15.1:0/658924011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8be41a70a0 con 0x7f8be4101df0 2024-09-15T22:23:55.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.071+0000 7f8bebc00640 1 -- 172.21.15.1:0/658924011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8be41021d0 con 0x7f8be4101df0 2024-09-15T22:23:55.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.073+0000 7f8be1600640 1 -- 172.21.15.1:0/658924011 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f8bd8042020 con 0x7f8be4101df0 2024-09-15T22:23:55.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.075+0000 7f8be1600640 1 --2- 172.21.15.1:0/658924011 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f8bcc0a32d0 0x7f8bcc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:55.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.075+0000 7f8be1600640 1 -- 172.21.15.1:0/658924011 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f8bd80effd0 con 0x7f8be4101df0 2024-09-15T22:23:55.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.075+0000 7f8be3e00640 1 --2- 172.21.15.1:0/658924011 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f8bcc0a32d0 0x7f8bcc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:55.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.075+0000 7f8be3e00640 1 --2- 172.21.15.1:0/658924011 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f8bcc0a32d0 0x7f8bcc0a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8be4075f80 tx=0x7f8bd0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:55.130 INFO:teuthology.orchestra.run.smithi001.stdout:214748364846 2024-09-15T22:23:55.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.077+0000 7f8be1600640 1 -- 172.21.15.1:0/658924011 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8bd8049020 con 0x7f8be4101df0 2024-09-15T22:23:55.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.292+0000 7f8bebc00640 1 -- 172.21.15.1:0/658924011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f8be402d7c0 con 0x7f8be4101df0 2024-09-15T22:23:55.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.293+0000 7f8be1600640 1 -- 172.21.15.1:0/658924011 <== mon.2 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f8bd80bcc30 con 0x7f8be4101df0 2024-09-15T22:23:55.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.296+0000 7f8bebc00640 1 -- 172.21.15.1:0/658924011 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f8bcc0a32d0 msgr2=0x7f8bcc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:55.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.296+0000 7f8bebc00640 1 --2- 172.21.15.1:0/658924011 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f8bcc0a32d0 0x7f8bcc0a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8be4075f80 tx=0x7f8bd0005f90 comp rx=0 tx=0).stop 2024-09-15T22:23:55.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.296+0000 7f8bebc00640 1 -- 172.21.15.1:0/658924011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8be4101df0 msgr2=0x7f8be40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:55.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.296+0000 7f8bebc00640 1 --2- 172.21.15.1:0/658924011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8be4101df0 0x7f8be40744f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8035040 tx=0x7f8bd8033d90 comp rx=0 tx=0).stop 2024-09-15T22:23:55.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.296+0000 7f8bebc00640 1 -- 172.21.15.1:0/658924011 shutdown_connections 2024-09-15T22:23:55.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.296+0000 7f8bebc00640 1 --2- 172.21.15.1:0/658924011 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f8bcc0a32d0 0x7f8bcc0a5790 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:55.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.296+0000 7f8bebc00640 1 --2- 172.21.15.1:0/658924011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8be4106f20 0x7f8be4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:55.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.296+0000 7f8bebc00640 1 --2- 172.21.15.1:0/658924011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8be41027a0 0x7f8be4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:55.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.296+0000 7f8bebc00640 1 --2- 172.21.15.1:0/658924011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8be4101df0 0x7f8be40744f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:55.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.296+0000 7f8bebc00640 1 -- 172.21.15.1:0/658924011 >> 172.21.15.1:0/658924011 conn(0x7f8be40fd8b0 msgr2=0x7f8be40fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:55.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.296+0000 7f8bebc00640 1 -- 172.21.15.1:0/658924011 shutdown_connections 2024-09-15T22:23:55.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:53.296+0000 7f8bebc00640 1 -- 172.21.15.1:0/658924011 wait complete. 2024-09-15T22:23:55.414 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:55 smithi001 ceph-mon[30843]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-15T22:23:55.414 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:55 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/1898216648' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-15T22:23:55.414 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:55 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/4137543454' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-15T22:23:55.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:55 smithi012 ceph-mon[34883]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-15T22:23:55.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:55 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/1898216648' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-15T22:23:55.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:55 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/4137543454' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-15T22:23:55.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:55 smithi098 ceph-mon[35514]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-15T22:23:55.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:55 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/1898216648' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-15T22:23:55.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:55 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/4137543454' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-15T22:23:55.928 INFO:tasks.cephadm.ceph_manager.ceph:need seq 214748364843 got 214748364846 for osd.7 2024-09-15T22:23:55.929 DEBUG:teuthology.parallel:result is None 2024-09-15T22:23:56.424 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574925 got 55834574928 for osd.1 2024-09-15T22:23:56.424 DEBUG:teuthology.parallel:result is None 2024-09-15T22:23:56.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.688+0000 7f7ee4800640 1 -- 172.21.15.1:0/1764707439 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7edc109140 msgr2=0x7f7edc110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:56.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.688+0000 7f7ee4800640 1 --2- 172.21.15.1:0/1764707439 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7edc109140 0x7f7edc110cc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8009ca0 tx=0x7f7ed802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:23:56.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.688+0000 7f7ee4800640 1 -- 172.21.15.1:0/1764707439 shutdown_connections 2024-09-15T22:23:56.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.688+0000 7f7ee4800640 1 --2- 172.21.15.1:0/1764707439 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7edc109140 0x7f7edc110cc0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:56.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.688+0000 7f7ee4800640 1 --2- 172.21.15.1:0/1764707439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7edc1049c0 0x7f7edc108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:56.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.688+0000 7f7ee4800640 1 --2- 172.21.15.1:0/1764707439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7edc104010 0x7f7edc1043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:56.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.688+0000 7f7ee4800640 1 -- 172.21.15.1:0/1764707439 >> 172.21.15.1:0/1764707439 conn(0x7f7edc0ffa50 msgr2=0x7f7edc101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:56.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.688+0000 7f7ee4800640 1 -- 172.21.15.1:0/1764707439 shutdown_connections 2024-09-15T22:23:56.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.689+0000 7f7ee4800640 1 -- 172.21.15.1:0/1764707439 wait complete. 2024-09-15T22:23:56.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.689+0000 7f7ee4800640 1 Processor -- start 2024-09-15T22:23:56.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.690+0000 7f7ee4800640 1 -- start start 2024-09-15T22:23:56.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.690+0000 7f7ee4800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7edc104010 0x7f7edc19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:56.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.690+0000 7f7ee4800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7edc1049c0 0x7f7edc19abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:56.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.690+0000 7f7ee4800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7edc109140 0x7f7edc19ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:56.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.690+0000 7f7ee4800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7edc114150 con 0x7f7edc109140 2024-09-15T22:23:56.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.690+0000 7f7ee4800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7edc113fd0 con 0x7f7edc1049c0 2024-09-15T22:23:56.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.690+0000 7f7ee4800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7edc1142d0 con 0x7f7edc104010 2024-09-15T22:23:56.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.690+0000 7f7ee2800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7edc109140 0x7f7edc19ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:56.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.690+0000 7f7ee2800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7edc109140 0x7f7edc19ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48722/0 (socket says 172.21.15.1:48722) 2024-09-15T22:23:56.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.690+0000 7f7ee2800640 1 -- 172.21.15.1:0/1581255969 learned_addr learned my addr 172.21.15.1:0/1581255969 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:56.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.690+0000 7f7ee1400640 1 --2- 172.21.15.1:0/1581255969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7edc1049c0 0x7f7edc19abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:56.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.690+0000 7f7ee1e00640 1 --2- 172.21.15.1:0/1581255969 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7edc104010 0x7f7edc19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:56.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.691+0000 7f7ee2800640 1 -- 172.21.15.1:0/1581255969 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7edc104010 msgr2=0x7f7edc19a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:56.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.691+0000 7f7ee2800640 1 --2- 172.21.15.1:0/1581255969 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7edc104010 0x7f7edc19a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:56.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.691+0000 7f7ee2800640 1 -- 172.21.15.1:0/1581255969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7edc1049c0 msgr2=0x7f7edc19abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:56.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.691+0000 7f7ee2800640 1 --2- 172.21.15.1:0/1581255969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7edc1049c0 0x7f7edc19abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:56.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.691+0000 7f7ee2800640 1 -- 172.21.15.1:0/1581255969 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7edc19f660 con 0x7f7edc109140 2024-09-15T22:23:56.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.691+0000 7f7ee1400640 1 --2- 172.21.15.1:0/1581255969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7edc1049c0 0x7f7edc19abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:23:56.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.691+0000 7f7ee2800640 1 --2- 172.21.15.1:0/1581255969 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7edc109140 0x7f7edc19ef80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8031a20 tx=0x7f7ed8031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:56.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.691+0000 7f7ed6a00640 1 -- 172.21.15.1:0/1581255969 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed8003b70 con 0x7f7edc109140 2024-09-15T22:23:56.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.691+0000 7f7ee4800640 1 -- 172.21.15.1:0/1581255969 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7edc19f8f0 con 0x7f7edc109140 2024-09-15T22:23:56.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.691+0000 7f7ed6a00640 1 -- 172.21.15.1:0/1581255969 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ed8003d10 con 0x7f7edc109140 2024-09-15T22:23:56.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.691+0000 7f7ed6a00640 1 -- 172.21.15.1:0/1581255969 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed802fc40 con 0x7f7edc109140 2024-09-15T22:23:56.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.692+0000 7f7ee4800640 1 -- 172.21.15.1:0/1581255969 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7edc1a7230 con 0x7f7edc109140 2024-09-15T22:23:56.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.693+0000 7f7ee4800640 1 -- 172.21.15.1:0/1581255969 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7edc1043f0 con 0x7f7edc109140 2024-09-15T22:23:56.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.696+0000 7f7ed6a00640 1 -- 172.21.15.1:0/1581255969 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f7ed8004050 con 0x7f7edc109140 2024-09-15T22:23:56.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.697+0000 7f7ed6a00640 1 --2- 172.21.15.1:0/1581255969 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f7ec40a32d0 0x7f7ec40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:56.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.698+0000 7f7ed6a00640 1 -- 172.21.15.1:0/1581255969 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f7ed80f0cf0 con 0x7f7edc109140 2024-09-15T22:23:56.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.698+0000 7f7ee1e00640 1 --2- 172.21.15.1:0/1581255969 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f7ec40a32d0 0x7f7ec40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:56.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.698+0000 7f7ee1e00640 1 --2- 172.21.15.1:0/1581255969 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f7ec40a32d0 0x7f7ec40a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0009bd0 tx=0x7f7ed0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:56.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.706+0000 7f7ed6a00640 1 -- 172.21.15.1:0/1581255969 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7ed80bd9e0 con 0x7f7edc109140 2024-09-15T22:23:56.784 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:56.935 INFO:teuthology.orchestra.run.smithi001.stdout:141733920831 2024-09-15T22:23:56.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.931+0000 7f7ee4800640 1 -- 172.21.15.1:0/1581255969 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f7edc10c380 con 0x7f7edc109140 2024-09-15T22:23:56.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.932+0000 7f7ed6a00640 1 -- 172.21.15.1:0/1581255969 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7ed80bd2e0 con 0x7f7edc109140 2024-09-15T22:23:56.938 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:56.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.935+0000 7f7ee4800640 1 -- 172.21.15.1:0/1581255969 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f7ec40a32d0 msgr2=0x7f7ec40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:56.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.935+0000 7f7ee4800640 1 --2- 172.21.15.1:0/1581255969 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f7ec40a32d0 0x7f7ec40a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0009bd0 tx=0x7f7ed0005f90 comp rx=0 tx=0).stop 2024-09-15T22:23:56.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.936+0000 7f7ee4800640 1 -- 172.21.15.1:0/1581255969 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7edc109140 msgr2=0x7f7edc19ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:56.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.936+0000 7f7ee4800640 1 --2- 172.21.15.1:0/1581255969 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7edc109140 0x7f7edc19ef80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8031a20 tx=0x7f7ed8031a50 comp rx=0 tx=0).stop 2024-09-15T22:23:56.939 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:56.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.936+0000 7f7ee4800640 1 -- 172.21.15.1:0/1581255969 shutdown_connections 2024-09-15T22:23:56.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.936+0000 7f7ee4800640 1 --2- 172.21.15.1:0/1581255969 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f7ec40a32d0 0x7f7ec40a5790 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:56.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.936+0000 7f7ee4800640 1 --2- 172.21.15.1:0/1581255969 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7edc109140 0x7f7edc19ef80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:56.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.936+0000 7f7ee4800640 1 --2- 172.21.15.1:0/1581255969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7edc1049c0 0x7f7edc19abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:56.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.936+0000 7f7ee4800640 1 --2- 172.21.15.1:0/1581255969 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7edc104010 0x7f7edc19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:56.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.936+0000 7f7ee4800640 1 -- 172.21.15.1:0/1581255969 >> 172.21.15.1:0/1581255969 conn(0x7f7edc0ffa50 msgr2=0x7f7edc100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:56.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.937+0000 7f7ee4800640 1 -- 172.21.15.1:0/1581255969 shutdown_connections 2024-09-15T22:23:56.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:56.937+0000 7f7ee4800640 1 -- 172.21.15.1:0/1581255969 wait complete. 2024-09-15T22:23:57.430 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528368 got 193273528371 for osd.6 2024-09-15T22:23:57.430 DEBUG:teuthology.parallel:result is None 2024-09-15T22:23:57.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:57 smithi001 ceph-mon[30843]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-15T22:23:57.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:57 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/1581255969' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-15T22:23:57.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:57 smithi012 ceph-mon[34883]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-15T22:23:57.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:57 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/1581255969' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-15T22:23:57.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:57 smithi098 ceph-mon[35514]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-15T22:23:57.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:57 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/1581255969' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-15T22:23:58.058 INFO:tasks.cephadm.ceph_manager.ceph:need seq 274877906978 got 274877906980 for osd.9 2024-09-15T22:23:58.058 DEBUG:teuthology.parallel:result is None 2024-09-15T22:23:58.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.268+0000 7f2e8e400640 1 -- 172.21.15.1:0/3200403216 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e88102790 msgr2=0x7f2e881067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:58.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.268+0000 7f2e8e400640 1 --2- 172.21.15.1:0/3200403216 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e88102790 0x7f2e881067e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2e70009900 tx=0x7f2e7002a3f0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.268+0000 7f2e8e400640 1 -- 172.21.15.1:0/3200403216 shutdown_connections 2024-09-15T22:23:58.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.268+0000 7f2e8e400640 1 --2- 172.21.15.1:0/3200403216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e88106f10 0x7f2e8810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.268+0000 7f2e8e400640 1 --2- 172.21.15.1:0/3200403216 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e88102790 0x7f2e881067e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.268+0000 7f2e8e400640 1 --2- 172.21.15.1:0/3200403216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e88101de0 0x7f2e881021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.268+0000 7f2e8e400640 1 -- 172.21.15.1:0/3200403216 >> 172.21.15.1:0/3200403216 conn(0x7f2e880fd8c0 msgr2=0x7f2e880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:58.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.268+0000 7f2e8e400640 1 -- 172.21.15.1:0/3200403216 shutdown_connections 2024-09-15T22:23:58.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.268+0000 7f2e8e400640 1 -- 172.21.15.1:0/3200403216 wait complete. 2024-09-15T22:23:58.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.269+0000 7f2e8e400640 1 Processor -- start 2024-09-15T22:23:58.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.270+0000 7f2e8e400640 1 -- start start 2024-09-15T22:23:58.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.270+0000 7f2e8e400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e88101de0 0x7f2e88198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:58.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.270+0000 7f2e8e400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e88102790 0x7f2e88198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:58.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.270+0000 7f2e8e400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e88106f10 0x7f2e8819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:58.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.270+0000 7f2e8e400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2e88111fc0 con 0x7f2e88101de0 2024-09-15T22:23:58.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.270+0000 7f2e8e400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2e88111e40 con 0x7f2e88106f10 2024-09-15T22:23:58.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.270+0000 7f2e8e400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2e88112140 con 0x7f2e88102790 2024-09-15T22:23:58.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.270+0000 7f2e87400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e88101de0 0x7f2e88198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:58.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.270+0000 7f2e7fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e88102790 0x7f2e88198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:58.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.270+0000 7f2e87e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e88106f10 0x7f2e8819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:58.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.270+0000 7f2e87400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e88101de0 0x7f2e88198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54544/0 (socket says 172.21.15.1:54544) 2024-09-15T22:23:58.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.270+0000 7f2e87400640 1 -- 172.21.15.1:0/1864105953 learned_addr learned my addr 172.21.15.1:0/1864105953 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:58.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.271+0000 7f2e87400640 1 -- 172.21.15.1:0/1864105953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e88102790 msgr2=0x7f2e88198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:58.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.271+0000 7f2e87400640 1 --2- 172.21.15.1:0/1864105953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e88102790 0x7f2e88198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.271+0000 7f2e87400640 1 -- 172.21.15.1:0/1864105953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e88106f10 msgr2=0x7f2e8819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:58.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.271+0000 7f2e87400640 1 --2- 172.21.15.1:0/1864105953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e88106f10 0x7f2e8819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.271+0000 7f2e87400640 1 -- 172.21.15.1:0/1864105953 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e8819d3c0 con 0x7f2e88101de0 2024-09-15T22:23:58.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.271+0000 7f2e7fe00640 1 --2- 172.21.15.1:0/1864105953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e88102790 0x7f2e88198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:23:58.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.271+0000 7f2e87400640 1 --2- 172.21.15.1:0/1864105953 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e88101de0 0x7f2e88198410 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2e7800d950 tx=0x7f2e7800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:58.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.272+0000 7f2e84c00640 1 -- 172.21.15.1:0/1864105953 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e78017070 con 0x7f2e88101de0 2024-09-15T22:23:58.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.272+0000 7f2e84c00640 1 -- 172.21.15.1:0/1864105953 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e78009c30 con 0x7f2e88101de0 2024-09-15T22:23:58.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.272+0000 7f2e84c00640 1 -- 172.21.15.1:0/1864105953 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7800f6b0 con 0x7f2e88101de0 2024-09-15T22:23:58.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.272+0000 7f2e8e400640 1 -- 172.21.15.1:0/1864105953 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e8819d6b0 con 0x7f2e88101de0 2024-09-15T22:23:58.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.272+0000 7f2e8e400640 1 -- 172.21.15.1:0/1864105953 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e881a4f90 con 0x7f2e88101de0 2024-09-15T22:23:58.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.273+0000 7f2e8e400640 1 -- 172.21.15.1:0/1864105953 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e881021c0 con 0x7f2e88101de0 2024-09-15T22:23:58.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.275+0000 7f2e84c00640 1 -- 172.21.15.1:0/1864105953 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f2e780109d0 con 0x7f2e88101de0 2024-09-15T22:23:58.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.277+0000 7f2e84c00640 1 --2- 172.21.15.1:0/1864105953 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2e6c0a3350 0x7f2e6c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:58.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.277+0000 7f2e84c00640 1 -- 172.21.15.1:0/1864105953 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f2e780cf650 con 0x7f2e88101de0 2024-09-15T22:23:58.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.277+0000 7f2e7fe00640 1 --2- 172.21.15.1:0/1864105953 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2e6c0a3350 0x7f2e6c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:58.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.278+0000 7f2e7fe00640 1 --2- 172.21.15.1:0/1864105953 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2e6c0a3350 0x7f2e6c0a5810 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2e70000c00 tx=0x7f2e70031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:58.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.281+0000 7f2e84c00640 1 -- 172.21.15.1:0/1864105953 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2e78009de0 con 0x7f2e88101de0 2024-09-15T22:23:58.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.472+0000 7f2e8e400640 1 -- 172.21.15.1:0/1864105953 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f2e8810a0f0 con 0x7f2e88101de0 2024-09-15T22:23:58.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.473+0000 7f2e84c00640 1 -- 172.21.15.1:0/1864105953 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f2e7809bb50 con 0x7f2e88101de0 2024-09-15T22:23:58.475 INFO:teuthology.orchestra.run.smithi001.stdout:326417514523 2024-09-15T22:23:58.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.475+0000 7f2e8e400640 1 -- 172.21.15.1:0/1864105953 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2e6c0a3350 msgr2=0x7f2e6c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:58.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.475+0000 7f2e8e400640 1 --2- 172.21.15.1:0/1864105953 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2e6c0a3350 0x7f2e6c0a5810 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2e70000c00 tx=0x7f2e70031510 comp rx=0 tx=0).stop 2024-09-15T22:23:58.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.475+0000 7f2e8e400640 1 -- 172.21.15.1:0/1864105953 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e88101de0 msgr2=0x7f2e88198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:58.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.475+0000 7f2e8e400640 1 --2- 172.21.15.1:0/1864105953 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e88101de0 0x7f2e88198410 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2e7800d950 tx=0x7f2e7800de10 comp rx=0 tx=0).stop 2024-09-15T22:23:58.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.475+0000 7f2e8e400640 1 -- 172.21.15.1:0/1864105953 shutdown_connections 2024-09-15T22:23:58.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.475+0000 7f2e8e400640 1 --2- 172.21.15.1:0/1864105953 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2e6c0a3350 0x7f2e6c0a5810 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.475+0000 7f2e8e400640 1 --2- 172.21.15.1:0/1864105953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e88106f10 0x7f2e8819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.475+0000 7f2e8e400640 1 --2- 172.21.15.1:0/1864105953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e88102790 0x7f2e88198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.475+0000 7f2e8e400640 1 --2- 172.21.15.1:0/1864105953 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e88101de0 0x7f2e88198410 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.475+0000 7f2e8e400640 1 -- 172.21.15.1:0/1864105953 >> 172.21.15.1:0/1864105953 conn(0x7f2e880fd8c0 msgr2=0x7f2e880feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:58.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.475+0000 7f2e8e400640 1 -- 172.21.15.1:0/1864105953 shutdown_connections 2024-09-15T22:23:58.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:58.475+0000 7f2e8e400640 1 -- 172.21.15.1:0/1864105953 wait complete. 2024-09-15T22:23:58.532 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:58.533 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:58.735 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:59.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.310+0000 7f3e16a00640 1 -- 172.21.15.1:0/1764566564 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e10076720 msgr2=0x7f3e10076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:59.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.310+0000 7f3e16a00640 1 --2- 172.21.15.1:0/1764566564 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e10076720 0x7f3e10076b00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3e00009900 tx=0x7f3e0002a3f0 comp rx=0 tx=0).stop 2024-09-15T22:23:59.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.310+0000 7f3e16a00640 1 -- 172.21.15.1:0/1764566564 shutdown_connections 2024-09-15T22:23:59.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.310+0000 7f3e16a00640 1 --2- 172.21.15.1:0/1764566564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e10112a30 0x7f3e10114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:59.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.310+0000 7f3e16a00640 1 --2- 172.21.15.1:0/1764566564 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e10077040 0x7f3e101124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:59.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.310+0000 7f3e16a00640 1 --2- 172.21.15.1:0/1764566564 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e10076720 0x7f3e10076b00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:59.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.310+0000 7f3e16a00640 1 -- 172.21.15.1:0/1764566564 >> 172.21.15.1:0/1764566564 conn(0x7f3e100ffa90 msgr2=0x7f3e10101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:59.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.310+0000 7f3e16a00640 1 -- 172.21.15.1:0/1764566564 shutdown_connections 2024-09-15T22:23:59.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.310+0000 7f3e16a00640 1 -- 172.21.15.1:0/1764566564 wait complete. 2024-09-15T22:23:59.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.311+0000 7f3e16a00640 1 Processor -- start 2024-09-15T22:23:59.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.311+0000 7f3e16a00640 1 -- start start 2024-09-15T22:23:59.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.312+0000 7f3e16a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e10076720 0x7f3e101a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:59.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.312+0000 7f3e16a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e10077040 0x7f3e101a4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:59.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.312+0000 7f3e16a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e10112a30 0x7f3e1019e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:59.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.312+0000 7f3e16a00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3e101185f0 con 0x7f3e10077040 2024-09-15T22:23:59.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.312+0000 7f3e16a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3e10118470 con 0x7f3e10112a30 2024-09-15T22:23:59.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.312+0000 7f3e16a00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3e10118770 con 0x7f3e10076720 2024-09-15T22:23:59.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.312+0000 7f3e0f400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e10077040 0x7f3e101a4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:59.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.312+0000 7f3e0f400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e10077040 0x7f3e101a4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54558/0 (socket says 172.21.15.1:54558) 2024-09-15T22:23:59.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.312+0000 7f3e0f400640 1 -- 172.21.15.1:0/1748361318 learned_addr learned my addr 172.21.15.1:0/1748361318 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:23:59.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.312+0000 7f3e0fe00640 1 --2- 172.21.15.1:0/1748361318 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e10076720 0x7f3e101a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:59.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.313+0000 7f3e14a00640 1 --2- 172.21.15.1:0/1748361318 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e10112a30 0x7f3e1019e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:59.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.313+0000 7f3e0f400640 1 -- 172.21.15.1:0/1748361318 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e10076720 msgr2=0x7f3e101a46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:59.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.313+0000 7f3e0f400640 1 --2- 172.21.15.1:0/1748361318 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e10076720 0x7f3e101a46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:59.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.313+0000 7f3e0f400640 1 -- 172.21.15.1:0/1748361318 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e10112a30 msgr2=0x7f3e1019e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:59.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.313+0000 7f3e0f400640 1 --2- 172.21.15.1:0/1748361318 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e10112a30 0x7f3e1019e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:59.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.313+0000 7f3e0f400640 1 -- 172.21.15.1:0/1748361318 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1019efb0 con 0x7f3e10077040 2024-09-15T22:23:59.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.313+0000 7f3e0f400640 1 --2- 172.21.15.1:0/1748361318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e10077040 0x7f3e101a4c00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00d950 tx=0x7f3dfc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:59.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.313+0000 7f3e0cc00640 1 -- 172.21.15.1:0/1748361318 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc017030 con 0x7f3e10077040 2024-09-15T22:23:59.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.313+0000 7f3e16a00640 1 -- 172.21.15.1:0/1748361318 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e1019f2a0 con 0x7f3e10077040 2024-09-15T22:23:59.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.313+0000 7f3e0cc00640 1 -- 172.21.15.1:0/1748361318 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dfc004020 con 0x7f3e10077040 2024-09-15T22:23:59.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.314+0000 7f3e0cc00640 1 -- 172.21.15.1:0/1748361318 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc0047a0 con 0x7f3e10077040 2024-09-15T22:23:59.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.314+0000 7f3e16a00640 1 -- 172.21.15.1:0/1748361318 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e101ab590 con 0x7f3e10077040 2024-09-15T22:23:59.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.316+0000 7f3e16a00640 1 -- 172.21.15.1:0/1748361318 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e10076b00 con 0x7f3e10077040 2024-09-15T22:23:59.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.318+0000 7f3e0cc00640 1 -- 172.21.15.1:0/1748361318 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f3dfc0041d0 con 0x7f3e10077040 2024-09-15T22:23:59.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.320+0000 7f3e0cc00640 1 --2- 172.21.15.1:0/1748361318 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3df40a32d0 0x7f3df40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:59.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.320+0000 7f3e0cc00640 1 -- 172.21.15.1:0/1748361318 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f3dfc0cf440 con 0x7f3e10077040 2024-09-15T22:23:59.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.320+0000 7f3e0fe00640 1 --2- 172.21.15.1:0/1748361318 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3df40a32d0 0x7f3df40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:59.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.321+0000 7f3e0fe00640 1 --2- 172.21.15.1:0/1748361318 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3df40a32d0 0x7f3df40a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3e00006010 tx=0x7f3e00000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:59.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.327+0000 7f3e0cc00640 1 -- 172.21.15.1:0/1748361318 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3dfc09bf90 con 0x7f3e10077040 2024-09-15T22:23:59.457 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:59 smithi001 ceph-mon[30843]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-15T22:23:59.457 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:23:59 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/1864105953' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-15T22:23:59.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.518+0000 7f3e16a00640 1 -- 172.21.15.1:0/1748361318 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f3e1019fdb0 con 0x7f3e10077040 2024-09-15T22:23:59.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.518+0000 7f3e0cc00640 1 -- 172.21.15.1:0/1748361318 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3e1019fdb0 con 0x7f3e10077040 2024-09-15T22:23:59.520 INFO:teuthology.orchestra.run.smithi001.stdout:111669149764 2024-09-15T22:23:59.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.521+0000 7f3e16a00640 1 -- 172.21.15.1:0/1748361318 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3df40a32d0 msgr2=0x7f3df40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:59.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.521+0000 7f3e16a00640 1 --2- 172.21.15.1:0/1748361318 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3df40a32d0 0x7f3df40a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3e00006010 tx=0x7f3e00000bc0 comp rx=0 tx=0).stop 2024-09-15T22:23:59.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.521+0000 7f3e16a00640 1 -- 172.21.15.1:0/1748361318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e10077040 msgr2=0x7f3e101a4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:59.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.521+0000 7f3e16a00640 1 --2- 172.21.15.1:0/1748361318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e10077040 0x7f3e101a4c00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00d950 tx=0x7f3dfc00de10 comp rx=0 tx=0).stop 2024-09-15T22:23:59.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.521+0000 7f3e16a00640 1 -- 172.21.15.1:0/1748361318 shutdown_connections 2024-09-15T22:23:59.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.521+0000 7f3e16a00640 1 --2- 172.21.15.1:0/1748361318 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3df40a32d0 0x7f3df40a5790 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:59.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.521+0000 7f3e16a00640 1 --2- 172.21.15.1:0/1748361318 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e10112a30 0x7f3e1019e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:59.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.521+0000 7f3e16a00640 1 --2- 172.21.15.1:0/1748361318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e10077040 0x7f3e101a4c00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:59.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.521+0000 7f3e16a00640 1 --2- 172.21.15.1:0/1748361318 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e10076720 0x7f3e101a46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:59.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.521+0000 7f3e16a00640 1 -- 172.21.15.1:0/1748361318 >> 172.21.15.1:0/1748361318 conn(0x7f3e100ffa90 msgr2=0x7f3e10101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:59.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.521+0000 7f3e16a00640 1 -- 172.21.15.1:0/1748361318 shutdown_connections 2024-09-15T22:23:59.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:23:59.521+0000 7f3e16a00640 1 -- 172.21.15.1:0/1748361318 wait complete. 2024-09-15T22:23:59.560 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:59 smithi098 ceph-mon[35514]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-15T22:23:59.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:23:59 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/1864105953' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-15T22:23:59.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:59 smithi012 ceph-mon[34883]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-15T22:23:59.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:23:59 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/1864105953' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-15T22:24:00.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.308+0000 7f1458c00640 1 -- 172.21.15.1:0/458101255 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1454101df0 msgr2=0x7f14541021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:00.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.308+0000 7f1458c00640 1 --2- 172.21.15.1:0/458101255 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1454101df0 0x7f14541021d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1444009900 tx=0x7f144402a410 comp rx=0 tx=0).stop 2024-09-15T22:24:00.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.309+0000 7f1458c00640 1 -- 172.21.15.1:0/458101255 shutdown_connections 2024-09-15T22:24:00.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.309+0000 7f1458c00640 1 --2- 172.21.15.1:0/458101255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1454106f20 0x7f145410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:00.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.309+0000 7f1458c00640 1 --2- 172.21.15.1:0/458101255 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14541027a0 0x7f14541067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:00.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.309+0000 7f1458c00640 1 --2- 172.21.15.1:0/458101255 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1454101df0 0x7f14541021d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:00.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.309+0000 7f1458c00640 1 -- 172.21.15.1:0/458101255 >> 172.21.15.1:0/458101255 conn(0x7f14540fd8b0 msgr2=0x7f14540ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:00.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.309+0000 7f1458c00640 1 -- 172.21.15.1:0/458101255 shutdown_connections 2024-09-15T22:24:00.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.309+0000 7f1458c00640 1 -- 172.21.15.1:0/458101255 wait complete. 2024-09-15T22:24:00.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.310+0000 7f1458c00640 1 Processor -- start 2024-09-15T22:24:00.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.310+0000 7f1458c00640 1 -- start start 2024-09-15T22:24:00.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.311+0000 7f1458c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1454101df0 0x7f145419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:00.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.311+0000 7f1458c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14541027a0 0x7f145419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:00.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.311+0000 7f1458c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1454106f20 0x7f145419eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:00.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.311+0000 7f1458c00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1454111fd0 con 0x7f1454106f20 2024-09-15T22:24:00.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.311+0000 7f1458c00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1454111e50 con 0x7f14541027a0 2024-09-15T22:24:00.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.311+0000 7f1458c00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1454112150 con 0x7f1454101df0 2024-09-15T22:24:00.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.311+0000 7f1452800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1454106f20 0x7f145419eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:00.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.311+0000 7f1452800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1454106f20 0x7f145419eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54574/0 (socket says 172.21.15.1:54574) 2024-09-15T22:24:00.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.311+0000 7f1451e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1454101df0 0x7f145419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:00.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.311+0000 7f1452800640 1 -- 172.21.15.1:0/2347171335 learned_addr learned my addr 172.21.15.1:0/2347171335 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:00.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.311+0000 7f144be00640 1 --2- 172.21.15.1:0/2347171335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14541027a0 0x7f145419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:00.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.311+0000 7f1452800640 1 -- 172.21.15.1:0/2347171335 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1454101df0 msgr2=0x7f145419a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:00.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.311+0000 7f1452800640 1 --2- 172.21.15.1:0/2347171335 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1454101df0 0x7f145419a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:00.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.311+0000 7f1452800640 1 -- 172.21.15.1:0/2347171335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14541027a0 msgr2=0x7f145419ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:00.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.311+0000 7f1452800640 1 --2- 172.21.15.1:0/2347171335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14541027a0 0x7f145419ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:00.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.311+0000 7f1452800640 1 -- 172.21.15.1:0/2347171335 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f145419f5a0 con 0x7f1454106f20 2024-09-15T22:24:00.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.312+0000 7f1452800640 1 --2- 172.21.15.1:0/2347171335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1454106f20 0x7f145419eec0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f144c009fd0 tx=0x7f144c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:00.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.312+0000 7f144aa00640 1 -- 172.21.15.1:0/2347171335 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144c017070 con 0x7f1454106f20 2024-09-15T22:24:00.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.312+0000 7f1458c00640 1 -- 172.21.15.1:0/2347171335 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f145419f890 con 0x7f1454106f20 2024-09-15T22:24:00.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.312+0000 7f144aa00640 1 -- 172.21.15.1:0/2347171335 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f144c003e50 con 0x7f1454106f20 2024-09-15T22:24:00.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.312+0000 7f144aa00640 1 -- 172.21.15.1:0/2347171335 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144c0106c0 con 0x7f1454106f20 2024-09-15T22:24:00.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.312+0000 7f1458c00640 1 -- 172.21.15.1:0/2347171335 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14541a7170 con 0x7f1454106f20 2024-09-15T22:24:00.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.313+0000 7f1458c00640 1 -- 172.21.15.1:0/2347171335 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14541021d0 con 0x7f1454106f20 2024-09-15T22:24:00.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.315+0000 7f144aa00640 1 -- 172.21.15.1:0/2347171335 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f144c003970 con 0x7f1454106f20 2024-09-15T22:24:00.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.316+0000 7f144aa00640 1 --2- 172.21.15.1:0/2347171335 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f14380a32d0 0x7f14380a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:00.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.317+0000 7f144aa00640 1 -- 172.21.15.1:0/2347171335 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f144c0cf7d0 con 0x7f1454106f20 2024-09-15T22:24:00.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.317+0000 7f1451e00640 1 --2- 172.21.15.1:0/2347171335 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f14380a32d0 0x7f14380a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:00.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.318+0000 7f1451e00640 1 --2- 172.21.15.1:0/2347171335 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f14380a32d0 0x7f14380a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1444000c00 tx=0x7f1444005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:00.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.321+0000 7f144aa00640 1 -- 172.21.15.1:0/2347171335 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f144c09bcd0 con 0x7f1454106f20 2024-09-15T22:24:00.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.514+0000 7f1458c00640 1 -- 172.21.15.1:0/2347171335 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f14541a7410 con 0x7f1454106f20 2024-09-15T22:24:00.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.515+0000 7f144aa00640 1 -- 172.21.15.1:0/2347171335 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f144c09ffd0 con 0x7f1454106f20 2024-09-15T22:24:00.517 INFO:teuthology.orchestra.run.smithi001.stdout:34359738454 2024-09-15T22:24:00.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.517+0000 7f1458c00640 1 -- 172.21.15.1:0/2347171335 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f14380a32d0 msgr2=0x7f14380a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:00.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.517+0000 7f1458c00640 1 --2- 172.21.15.1:0/2347171335 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f14380a32d0 0x7f14380a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1444000c00 tx=0x7f1444005b50 comp rx=0 tx=0).stop 2024-09-15T22:24:00.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.517+0000 7f1458c00640 1 -- 172.21.15.1:0/2347171335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1454106f20 msgr2=0x7f145419eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:00.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.517+0000 7f1458c00640 1 --2- 172.21.15.1:0/2347171335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1454106f20 0x7f145419eec0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f144c009fd0 tx=0x7f144c00b260 comp rx=0 tx=0).stop 2024-09-15T22:24:00.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.517+0000 7f1458c00640 1 -- 172.21.15.1:0/2347171335 shutdown_connections 2024-09-15T22:24:00.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.517+0000 7f1458c00640 1 --2- 172.21.15.1:0/2347171335 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f14380a32d0 0x7f14380a5790 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:00.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.517+0000 7f1458c00640 1 --2- 172.21.15.1:0/2347171335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1454106f20 0x7f145419eec0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:00.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.517+0000 7f1458c00640 1 --2- 172.21.15.1:0/2347171335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14541027a0 0x7f145419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:00.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.517+0000 7f1458c00640 1 --2- 172.21.15.1:0/2347171335 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1454101df0 0x7f145419a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:00.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.517+0000 7f1458c00640 1 -- 172.21.15.1:0/2347171335 >> 172.21.15.1:0/2347171335 conn(0x7f14540fd8b0 msgr2=0x7f14540ffc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:00.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.518+0000 7f1458c00640 1 -- 172.21.15.1:0/2347171335 shutdown_connections 2024-09-15T22:24:00.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:00.518+0000 7f1458c00640 1 -- 172.21.15.1:0/2347171335 wait complete. 2024-09-15T22:24:00.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:00 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/1748361318' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-15T22:24:00.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:00 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/1748361318' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-15T22:24:00.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:00 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/1748361318' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-15T22:24:01.134 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149762 got 111669149764 for osd.3 2024-09-15T22:24:01.135 DEBUG:teuthology.parallel:result is None 2024-09-15T22:24:01.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:01 smithi001 ceph-mon[30843]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-15T22:24:01.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:01 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/2347171335' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-15T22:24:01.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:01 smithi012 ceph-mon[34883]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-15T22:24:01.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:01 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/2347171335' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-15T22:24:01.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:01 smithi098 ceph-mon[35514]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-15T22:24:01.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:01 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/2347171335' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-15T22:24:02.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.085+0000 7f83f0a00640 1 -- 172.21.15.1:0/1325087499 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83ec1079d0 msgr2=0x7f83ec107db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:02.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.085+0000 7f83f0a00640 1 --2- 172.21.15.1:0/1325087499 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83ec1079d0 0x7f83ec107db0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f83dc009cd0 tx=0x7f83dc02a8e0 comp rx=0 tx=0).stop 2024-09-15T22:24:02.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.085+0000 7f83f0a00640 1 -- 172.21.15.1:0/1325087499 shutdown_connections 2024-09-15T22:24:02.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.085+0000 7f83f0a00640 1 --2- 172.21.15.1:0/1325087499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83ec102370 0x7f83ec10e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:02.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.085+0000 7f83f0a00640 1 --2- 172.21.15.1:0/1325087499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83ec1019d0 0x7f83ec101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:02.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.085+0000 7f83f0a00640 1 --2- 172.21.15.1:0/1325087499 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83ec1079d0 0x7f83ec107db0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:02.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.085+0000 7f83f0a00640 1 -- 172.21.15.1:0/1325087499 >> 172.21.15.1:0/1325087499 conn(0x7f83ec0fd710 msgr2=0x7f83ec0ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:02.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.085+0000 7f83f0a00640 1 -- 172.21.15.1:0/1325087499 shutdown_connections 2024-09-15T22:24:02.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.085+0000 7f83f0a00640 1 -- 172.21.15.1:0/1325087499 wait complete. 2024-09-15T22:24:02.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.086+0000 7f83f0a00640 1 Processor -- start 2024-09-15T22:24:02.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.086+0000 7f83f0a00640 1 -- start start 2024-09-15T22:24:02.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.086+0000 7f83f0a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83ec1019d0 0x7f83ec1982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:02.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.087+0000 7f83f0a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83ec102370 0x7f83ec198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:02.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.087+0000 7f83f0a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83ec1079d0 0x7f83ec19cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:02.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.087+0000 7f83f0a00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f83ec111da0 con 0x7f83ec1019d0 2024-09-15T22:24:02.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.087+0000 7f83f0a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f83ec111c20 con 0x7f83ec1079d0 2024-09-15T22:24:02.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.087+0000 7f83f0a00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f83ec111f20 con 0x7f83ec102370 2024-09-15T22:24:02.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.087+0000 7f83ea800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83ec1019d0 0x7f83ec1982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:02.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.087+0000 7f83ea800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83ec1019d0 0x7f83ec1982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54594/0 (socket says 172.21.15.1:54594) 2024-09-15T22:24:02.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.087+0000 7f83ea800640 1 -- 172.21.15.1:0/2233450126 learned_addr learned my addr 172.21.15.1:0/2233450126 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:02.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.087+0000 7f83eb200640 1 --2- 172.21.15.1:0/2233450126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83ec1079d0 0x7f83ec19cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:02.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.087+0000 7f83e9e00640 1 --2- 172.21.15.1:0/2233450126 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83ec102370 0x7f83ec198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:02.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.087+0000 7f83ea800640 1 -- 172.21.15.1:0/2233450126 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83ec102370 msgr2=0x7f83ec198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:02.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.087+0000 7f83ea800640 1 --2- 172.21.15.1:0/2233450126 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83ec102370 0x7f83ec198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:02.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.087+0000 7f83ea800640 1 -- 172.21.15.1:0/2233450126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83ec1079d0 msgr2=0x7f83ec19cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:02.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.087+0000 7f83ea800640 1 --2- 172.21.15.1:0/2233450126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83ec1079d0 0x7f83ec19cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:02.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.087+0000 7f83ea800640 1 -- 172.21.15.1:0/2233450126 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83ec19d290 con 0x7f83ec1019d0 2024-09-15T22:24:02.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.088+0000 7f83ea800640 1 --2- 172.21.15.1:0/2233450126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83ec1019d0 0x7f83ec1982e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f83dc005e30 tx=0x7f83dc032fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:02.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.088+0000 7f83e3400640 1 -- 172.21.15.1:0/2233450126 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83dc004040 con 0x7f83ec1019d0 2024-09-15T22:24:02.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.088+0000 7f83e3400640 1 -- 172.21.15.1:0/2233450126 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83dc0046c0 con 0x7f83ec1019d0 2024-09-15T22:24:02.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.088+0000 7f83e3400640 1 -- 172.21.15.1:0/2233450126 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83dc046480 con 0x7f83ec1019d0 2024-09-15T22:24:02.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.088+0000 7f83f0a00640 1 -- 172.21.15.1:0/2233450126 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83ec19d520 con 0x7f83ec1019d0 2024-09-15T22:24:02.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.088+0000 7f83f0a00640 1 -- 172.21.15.1:0/2233450126 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83ec1a4e60 con 0x7f83ec1019d0 2024-09-15T22:24:02.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.089+0000 7f83f0a00640 1 -- 172.21.15.1:0/2233450126 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83ec103110 con 0x7f83ec1019d0 2024-09-15T22:24:02.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.091+0000 7f83e3400640 1 -- 172.21.15.1:0/2233450126 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f83dc0305a0 con 0x7f83ec1019d0 2024-09-15T22:24:02.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.092+0000 7f83e3400640 1 --2- 172.21.15.1:0/2233450126 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f83d00a32d0 0x7f83d00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:02.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.092+0000 7f83e3400640 1 -- 172.21.15.1:0/2233450126 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f83dc02e030 con 0x7f83ec1019d0 2024-09-15T22:24:02.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.093+0000 7f83e9e00640 1 --2- 172.21.15.1:0/2233450126 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f83d00a32d0 0x7f83d00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:02.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.093+0000 7f83e9e00640 1 --2- 172.21.15.1:0/2233450126 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f83d00a32d0 0x7f83d00a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f83ec0ffd80 tx=0x7f83d8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:02.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.097+0000 7f83e3400640 1 -- 172.21.15.1:0/2233450126 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f83dc04b060 con 0x7f83ec1019d0 2024-09-15T22:24:02.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.287+0000 7f83f0a00640 1 -- 172.21.15.1:0/2233450126 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f83ec109f40 con 0x7f83ec1019d0 2024-09-15T22:24:02.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.288+0000 7f83e3400640 1 -- 172.21.15.1:0/2233450126 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f83dc0bdce0 con 0x7f83ec1019d0 2024-09-15T22:24:02.290 INFO:teuthology.orchestra.run.smithi001.stdout:163208757307 2024-09-15T22:24:02.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.290+0000 7f83f0a00640 1 -- 172.21.15.1:0/2233450126 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f83d00a32d0 msgr2=0x7f83d00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:02.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.290+0000 7f83f0a00640 1 --2- 172.21.15.1:0/2233450126 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f83d00a32d0 0x7f83d00a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f83ec0ffd80 tx=0x7f83d8005f90 comp rx=0 tx=0).stop 2024-09-15T22:24:02.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.290+0000 7f83f0a00640 1 -- 172.21.15.1:0/2233450126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83ec1019d0 msgr2=0x7f83ec1982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:02.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.290+0000 7f83f0a00640 1 --2- 172.21.15.1:0/2233450126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83ec1019d0 0x7f83ec1982e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f83dc005e30 tx=0x7f83dc032fb0 comp rx=0 tx=0).stop 2024-09-15T22:24:02.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.291+0000 7f83f0a00640 1 -- 172.21.15.1:0/2233450126 shutdown_connections 2024-09-15T22:24:02.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.291+0000 7f83f0a00640 1 --2- 172.21.15.1:0/2233450126 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f83d00a32d0 0x7f83d00a5790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:02.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.291+0000 7f83f0a00640 1 --2- 172.21.15.1:0/2233450126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83ec1079d0 0x7f83ec19cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:02.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.291+0000 7f83f0a00640 1 --2- 172.21.15.1:0/2233450126 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83ec102370 0x7f83ec198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:02.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.291+0000 7f83f0a00640 1 --2- 172.21.15.1:0/2233450126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83ec1019d0 0x7f83ec1982e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:02.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.291+0000 7f83f0a00640 1 -- 172.21.15.1:0/2233450126 >> 172.21.15.1:0/2233450126 conn(0x7f83ec0fd710 msgr2=0x7f83ec0fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:02.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.291+0000 7f83f0a00640 1 -- 172.21.15.1:0/2233450126 shutdown_connections 2024-09-15T22:24:02.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:02.291+0000 7f83f0a00640 1 -- 172.21.15.1:0/2233450126 wait complete. 2024-09-15T22:24:02.300 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738451 got 34359738454 for osd.0 2024-09-15T22:24:02.300 DEBUG:teuthology.parallel:result is None 2024-09-15T22:24:02.410 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920828 got 141733920831 for osd.4 2024-09-15T22:24:02.410 DEBUG:teuthology.parallel:result is None 2024-09-15T22:24:02.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:02 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/2233450126' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-15T22:24:02.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:02 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/2233450126' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-15T22:24:02.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:02 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/2233450126' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-15T22:24:03.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:03 smithi012 ceph-mon[34883]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-15T22:24:03.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:03 smithi098 ceph-mon[35514]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-15T22:24:03.838 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:03 smithi001 ceph-mon[30843]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-15T22:24:03.875 INFO:tasks.cephadm.ceph_manager.ceph:need seq 326417514520 got 326417514523 for osd.11 2024-09-15T22:24:03.876 DEBUG:teuthology.parallel:result is None 2024-09-15T22:24:04.249 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757306 got 163208757307 for osd.5 2024-09-15T22:24:04.249 DEBUG:teuthology.parallel:result is None 2024-09-15T22:24:04.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.536+0000 7fbaef200640 1 -- 172.21.15.1:0/3669397743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbaf0074f40 msgr2=0x7fbaf010dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:04.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.536+0000 7fbaef200640 1 --2- 172.21.15.1:0/3669397743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbaf0074f40 0x7fbaf010dcc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbad8009900 tx=0x7fbad802a480 comp rx=0 tx=0).stop 2024-09-15T22:24:04.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.536+0000 7fbaef200640 1 -- 172.21.15.1:0/3669397743 shutdown_connections 2024-09-15T22:24:04.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.536+0000 7fbaef200640 1 --2- 172.21.15.1:0/3669397743 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbaf010e200 0x7fbaf0110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:04.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.536+0000 7fbaef200640 1 --2- 172.21.15.1:0/3669397743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbaf0074f40 0x7fbaf010dcc0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:04.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.536+0000 7fbaef200640 1 --2- 172.21.15.1:0/3669397743 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbaf0074620 0x7fbaf0074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:04.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.536+0000 7fbaef200640 1 -- 172.21.15.1:0/3669397743 >> 172.21.15.1:0/3669397743 conn(0x7fbaf00fd6e0 msgr2=0x7fbaf00ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:04.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.537+0000 7fbaef200640 1 -- 172.21.15.1:0/3669397743 shutdown_connections 2024-09-15T22:24:04.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.537+0000 7fbaef200640 1 -- 172.21.15.1:0/3669397743 wait complete. 2024-09-15T22:24:04.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.538+0000 7fbaef200640 1 Processor -- start 2024-09-15T22:24:04.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.538+0000 7fbaef200640 1 -- start start 2024-09-15T22:24:04.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.538+0000 7fbaef200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbaf0074620 0x7fbaf019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:04.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.538+0000 7fbaef200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbaf0074f40 0x7fbaf019a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:04.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.539+0000 7fbaef200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbaf010e200 0x7fbaf019ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:04.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.539+0000 7fbaef200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf0114000 con 0x7fbaf0074f40 2024-09-15T22:24:04.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.539+0000 7fbaef200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf0113e80 con 0x7fbaf010e200 2024-09-15T22:24:04.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.539+0000 7fbaef200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf0114180 con 0x7fbaf0074620 2024-09-15T22:24:04.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.539+0000 7fbae7e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbaf0074f40 0x7fbaf019a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:04.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.539+0000 7fbae7e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbaf0074f40 0x7fbaf019a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54608/0 (socket says 172.21.15.1:54608) 2024-09-15T22:24:04.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.539+0000 7fbae7e00640 1 -- 172.21.15.1:0/1753205977 learned_addr learned my addr 172.21.15.1:0/1753205977 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:04.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.539+0000 7fbaede00640 1 --2- 172.21.15.1:0/1753205977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbaf0074620 0x7fbaf019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:04.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.539+0000 7fbaee800640 1 --2- 172.21.15.1:0/1753205977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbaf010e200 0x7fbaf019ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:04.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.539+0000 7fbae7e00640 1 -- 172.21.15.1:0/1753205977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbaf0074620 msgr2=0x7fbaf019a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:04.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.539+0000 7fbae7e00640 1 --2- 172.21.15.1:0/1753205977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbaf0074620 0x7fbaf019a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:04.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.539+0000 7fbae7e00640 1 -- 172.21.15.1:0/1753205977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbaf010e200 msgr2=0x7fbaf019ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:04.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.539+0000 7fbae7e00640 1 --2- 172.21.15.1:0/1753205977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbaf010e200 0x7fbaf019ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:04.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.539+0000 7fbae7e00640 1 -- 172.21.15.1:0/1753205977 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf019f450 con 0x7fbaf0074f40 2024-09-15T22:24:04.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.540+0000 7fbae7e00640 1 --2- 172.21.15.1:0/1753205977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbaf0074f40 0x7fbaf019a9e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbad8004770 tx=0x7fbad8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:04.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.540+0000 7fbae6a00640 1 -- 172.21.15.1:0/1753205977 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad803f070 con 0x7fbaf0074f40 2024-09-15T22:24:04.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.540+0000 7fbae6a00640 1 -- 172.21.15.1:0/1753205977 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbad8031ca0 con 0x7fbaf0074f40 2024-09-15T22:24:04.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.540+0000 7fbaef200640 1 -- 172.21.15.1:0/1753205977 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaf019f6e0 con 0x7fbaf0074f40 2024-09-15T22:24:04.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.540+0000 7fbae6a00640 1 -- 172.21.15.1:0/1753205977 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad8035030 con 0x7fbaf0074f40 2024-09-15T22:24:04.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.540+0000 7fbaef200640 1 -- 172.21.15.1:0/1753205977 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaf01a7020 con 0x7fbaf0074f40 2024-09-15T22:24:04.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.541+0000 7fbaef200640 1 -- 172.21.15.1:0/1753205977 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaf0075cd0 con 0x7fbaf0074f40 2024-09-15T22:24:04.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.543+0000 7fbae6a00640 1 -- 172.21.15.1:0/1753205977 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fbad8042070 con 0x7fbaf0074f40 2024-09-15T22:24:04.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.544+0000 7fbae6a00640 1 --2- 172.21.15.1:0/1753205977 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fbad40a32d0 0x7fbad40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:04.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.544+0000 7fbae6a00640 1 -- 172.21.15.1:0/1753205977 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fbad80f0300 con 0x7fbaf0074f40 2024-09-15T22:24:04.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.545+0000 7fbaede00640 1 --2- 172.21.15.1:0/1753205977 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fbad40a32d0 0x7fbad40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:04.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.545+0000 7fbaede00640 1 --2- 172.21.15.1:0/1753205977 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fbad40a32d0 0x7fbad40a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbae00095f0 tx=0x7fbae0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:04.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.546+0000 7fbae6a00640 1 -- 172.21.15.1:0/1753205977 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbad80bc8c0 con 0x7fbaf0074f40 2024-09-15T22:24:04.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.734+0000 7fbaef200640 1 -- 172.21.15.1:0/1753205977 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fbaf0109380 con 0x7fbaf0074f40 2024-09-15T22:24:04.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.734+0000 7fbae6a00640 1 -- 172.21.15.1:0/1753205977 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fbad80c0bc0 con 0x7fbaf0074f40 2024-09-15T22:24:04.737 INFO:teuthology.orchestra.run.smithi001.stdout:296352743457 2024-09-15T22:24:04.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.738+0000 7fbaef200640 1 -- 172.21.15.1:0/1753205977 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fbad40a32d0 msgr2=0x7fbad40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:04.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.738+0000 7fbaef200640 1 --2- 172.21.15.1:0/1753205977 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fbad40a32d0 0x7fbad40a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbae00095f0 tx=0x7fbae0005f90 comp rx=0 tx=0).stop 2024-09-15T22:24:04.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.738+0000 7fbaef200640 1 -- 172.21.15.1:0/1753205977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbaf0074f40 msgr2=0x7fbaf019a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:04.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.738+0000 7fbaef200640 1 --2- 172.21.15.1:0/1753205977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbaf0074f40 0x7fbaf019a9e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbad8004770 tx=0x7fbad8003c10 comp rx=0 tx=0).stop 2024-09-15T22:24:04.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.738+0000 7fbaef200640 1 -- 172.21.15.1:0/1753205977 shutdown_connections 2024-09-15T22:24:04.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.738+0000 7fbaef200640 1 --2- 172.21.15.1:0/1753205977 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fbad40a32d0 0x7fbad40a5790 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:04.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.738+0000 7fbaef200640 1 --2- 172.21.15.1:0/1753205977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbaf010e200 0x7fbaf019ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:04.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.738+0000 7fbaef200640 1 --2- 172.21.15.1:0/1753205977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbaf0074f40 0x7fbaf019a9e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:04.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.738+0000 7fbaef200640 1 --2- 172.21.15.1:0/1753205977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbaf0074620 0x7fbaf019a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:04.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.738+0000 7fbaef200640 1 -- 172.21.15.1:0/1753205977 >> 172.21.15.1:0/1753205977 conn(0x7fbaf00fd6e0 msgr2=0x7fbaf00fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:04.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.738+0000 7fbaef200640 1 -- 172.21.15.1:0/1753205977 shutdown_connections 2024-09-15T22:24:04.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.738+0000 7fbaef200640 1 -- 172.21.15.1:0/1753205977 wait complete. 2024-09-15T22:24:04.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.757+0000 7fb7bd800640 1 -- 172.21.15.1:0/2846834630 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7b8103ff0 msgr2=0x7fb7b81043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:04.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.757+0000 7fb7bd800640 1 --2- 172.21.15.1:0/2846834630 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7b8103ff0 0x7fb7b81043d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8009900 tx=0x7fb7a802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:24:04.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.757+0000 7fb7bd800640 1 -- 172.21.15.1:0/2846834630 shutdown_connections 2024-09-15T22:24:04.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.757+0000 7fb7bd800640 1 --2- 172.21.15.1:0/2846834630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb7b8109120 0x7fb7b8110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:04.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.757+0000 7fb7bd800640 1 --2- 172.21.15.1:0/2846834630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7b81049a0 0x7fb7b81089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:04.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.757+0000 7fb7bd800640 1 --2- 172.21.15.1:0/2846834630 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7b8103ff0 0x7fb7b81043d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:04.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.757+0000 7fb7bd800640 1 -- 172.21.15.1:0/2846834630 >> 172.21.15.1:0/2846834630 conn(0x7fb7b80ffa90 msgr2=0x7fb7b8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:04.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.757+0000 7fb7bd800640 1 -- 172.21.15.1:0/2846834630 shutdown_connections 2024-09-15T22:24:04.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.757+0000 7fb7bd800640 1 -- 172.21.15.1:0/2846834630 wait complete. 2024-09-15T22:24:04.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.758+0000 7fb7bd800640 1 Processor -- start 2024-09-15T22:24:04.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.759+0000 7fb7bd800640 1 -- start start 2024-09-15T22:24:04.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.759+0000 7fb7bd800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7b8103ff0 0x7fb7b819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:04.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.759+0000 7fb7bd800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb7b81049a0 0x7fb7b819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:04.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.759+0000 7fb7bd800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7b8109120 0x7fb7b819eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:04.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.759+0000 7fb7bd800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b8114170 con 0x7fb7b8103ff0 2024-09-15T22:24:04.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.759+0000 7fb7bd800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b8113ff0 con 0x7fb7b8109120 2024-09-15T22:24:04.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.759+0000 7fb7bd800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b81142f0 con 0x7fb7b81049a0 2024-09-15T22:24:04.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.759+0000 7fb7b6a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7b8103ff0 0x7fb7b819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:04.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.759+0000 7fb7b6a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7b8103ff0 0x7fb7b819a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54628/0 (socket says 172.21.15.1:54628) 2024-09-15T22:24:04.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.759+0000 7fb7b6a00640 1 -- 172.21.15.1:0/3227771806 learned_addr learned my addr 172.21.15.1:0/3227771806 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:04.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.759+0000 7fb7b6000640 1 --2- 172.21.15.1:0/3227771806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb7b81049a0 0x7fb7b819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:04.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.760+0000 7fb7b7400640 1 --2- 172.21.15.1:0/3227771806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7b8109120 0x7fb7b819eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:04.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.760+0000 7fb7b6000640 1 -- 172.21.15.1:0/3227771806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7b8109120 msgr2=0x7fb7b819eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:04.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.760+0000 7fb7b6000640 1 --2- 172.21.15.1:0/3227771806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7b8109120 0x7fb7b819eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:04.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.760+0000 7fb7b6000640 1 -- 172.21.15.1:0/3227771806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7b8103ff0 msgr2=0x7fb7b819a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:04.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.760+0000 7fb7b6000640 1 --2- 172.21.15.1:0/3227771806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7b8103ff0 0x7fb7b819a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:04.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.760+0000 7fb7b6000640 1 -- 172.21.15.1:0/3227771806 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7b819f5b0 con 0x7fb7b81049a0 2024-09-15T22:24:04.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.760+0000 7fb7b6a00640 1 --2- 172.21.15.1:0/3227771806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7b8103ff0 0x7fb7b819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:04.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.760+0000 7fb7b6000640 1 --2- 172.21.15.1:0/3227771806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb7b81049a0 0x7fb7b819ab40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb7a400e9f0 tx=0x7fb7a400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:04.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.761+0000 7fb7af400640 1 -- 172.21.15.1:0/3227771806 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a400cd80 con 0x7fb7b81049a0 2024-09-15T22:24:04.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.761+0000 7fb7af400640 1 -- 172.21.15.1:0/3227771806 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7a40035f0 con 0x7fb7b81049a0 2024-09-15T22:24:04.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.761+0000 7fb7af400640 1 -- 172.21.15.1:0/3227771806 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4010690 con 0x7fb7b81049a0 2024-09-15T22:24:04.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.761+0000 7fb7bd800640 1 -- 172.21.15.1:0/3227771806 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7b819f8a0 con 0x7fb7b81049a0 2024-09-15T22:24:04.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.761+0000 7fb7bd800640 1 -- 172.21.15.1:0/3227771806 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7b81a7180 con 0x7fb7b81049a0 2024-09-15T22:24:04.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.762+0000 7fb7bd800640 1 -- 172.21.15.1:0/3227771806 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7b81043d0 con 0x7fb7b81049a0 2024-09-15T22:24:04.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.767+0000 7fb7af400640 1 -- 172.21.15.1:0/3227771806 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fb7a4003b30 con 0x7fb7b81049a0 2024-09-15T22:24:04.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.768+0000 7fb7af400640 1 --2- 172.21.15.1:0/3227771806 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb79c0a3350 0x7fb79c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:04.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.768+0000 7fb7af400640 1 -- 172.21.15.1:0/3227771806 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fb7a40cfda0 con 0x7fb7b81049a0 2024-09-15T22:24:04.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.768+0000 7fb7b6a00640 1 --2- 172.21.15.1:0/3227771806 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb79c0a3350 0x7fb79c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:04.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.769+0000 7fb7b6a00640 1 --2- 172.21.15.1:0/3227771806 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb79c0a3350 0x7fb79c0a5810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb7a80096c0 tx=0x7fb7a80046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:04.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.772+0000 7fb7af400640 1 -- 172.21.15.1:0/3227771806 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb7a409c8f0 con 0x7fb7b81049a0 2024-09-15T22:24:04.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.964+0000 7fb7bd800640 1 -- 172.21.15.1:0/3227771806 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fb7b802d7c0 con 0x7fb7b81049a0 2024-09-15T22:24:04.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.964+0000 7fb7af400640 1 -- 172.21.15.1:0/3227771806 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb7a409c1f0 con 0x7fb7b81049a0 2024-09-15T22:24:04.966 INFO:teuthology.orchestra.run.smithi001.stdout:244813135917 2024-09-15T22:24:04.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.967+0000 7fb7bd800640 1 -- 172.21.15.1:0/3227771806 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb79c0a3350 msgr2=0x7fb79c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:04.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.967+0000 7fb7bd800640 1 --2- 172.21.15.1:0/3227771806 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb79c0a3350 0x7fb79c0a5810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb7a80096c0 tx=0x7fb7a80046c0 comp rx=0 tx=0).stop 2024-09-15T22:24:04.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.967+0000 7fb7bd800640 1 -- 172.21.15.1:0/3227771806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb7b81049a0 msgr2=0x7fb7b819ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:04.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.967+0000 7fb7bd800640 1 --2- 172.21.15.1:0/3227771806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb7b81049a0 0x7fb7b819ab40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb7a400e9f0 tx=0x7fb7a400eeb0 comp rx=0 tx=0).stop 2024-09-15T22:24:04.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.967+0000 7fb7bd800640 1 -- 172.21.15.1:0/3227771806 shutdown_connections 2024-09-15T22:24:04.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.967+0000 7fb7bd800640 1 --2- 172.21.15.1:0/3227771806 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb79c0a3350 0x7fb79c0a5810 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:04.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.967+0000 7fb7bd800640 1 --2- 172.21.15.1:0/3227771806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7b8109120 0x7fb7b819eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:04.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.967+0000 7fb7bd800640 1 --2- 172.21.15.1:0/3227771806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb7b81049a0 0x7fb7b819ab40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:04.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.967+0000 7fb7bd800640 1 --2- 172.21.15.1:0/3227771806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7b8103ff0 0x7fb7b819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:04.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.967+0000 7fb7bd800640 1 -- 172.21.15.1:0/3227771806 >> 172.21.15.1:0/3227771806 conn(0x7fb7b80ffa90 msgr2=0x7fb7b8100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:04.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.967+0000 7fb7bd800640 1 -- 172.21.15.1:0/3227771806 shutdown_connections 2024-09-15T22:24:04.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:04.967+0000 7fb7bd800640 1 -- 172.21.15.1:0/3227771806 wait complete. 2024-09-15T22:24:05.669 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:05.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:05 smithi012 ceph-mon[34883]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-15T22:24:05.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:05 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/1753205977' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-15T22:24:05.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:05 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/3227771806' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-15T22:24:05.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:05 smithi098 ceph-mon[35514]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-15T22:24:05.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:05 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/1753205977' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-15T22:24:05.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:05 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/3227771806' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-15T22:24:05.812 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:05 smithi001 ceph-mon[30843]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-15T22:24:05.812 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:05 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/1753205977' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-15T22:24:05.812 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:05 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/3227771806' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-15T22:24:06.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.221+0000 7f7045000640 1 -- 172.21.15.1:0/584131732 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70401027a0 msgr2=0x7f70401067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:06.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.221+0000 7f7045000640 1 --2- 172.21.15.1:0/584131732 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70401027a0 0x7f70401067f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7028009900 tx=0x7f702802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:24:06.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.221+0000 7f7045000640 1 -- 172.21.15.1:0/584131732 shutdown_connections 2024-09-15T22:24:06.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.221+0000 7f7045000640 1 --2- 172.21.15.1:0/584131732 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7040106f20 0x7f704010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:06.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.221+0000 7f7045000640 1 --2- 172.21.15.1:0/584131732 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70401027a0 0x7f70401067f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:06.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.221+0000 7f7045000640 1 --2- 172.21.15.1:0/584131732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7040101df0 0x7f70401021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:06.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.221+0000 7f7045000640 1 -- 172.21.15.1:0/584131732 >> 172.21.15.1:0/584131732 conn(0x7f70400fd8b0 msgr2=0x7f70400ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:06.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.221+0000 7f7045000640 1 -- 172.21.15.1:0/584131732 shutdown_connections 2024-09-15T22:24:06.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.221+0000 7f7045000640 1 -- 172.21.15.1:0/584131732 wait complete. 2024-09-15T22:24:06.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.222+0000 7f7045000640 1 Processor -- start 2024-09-15T22:24:06.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.222+0000 7f7045000640 1 -- start start 2024-09-15T22:24:06.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.222+0000 7f7045000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7040101df0 0x7f704019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:06.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.222+0000 7f7045000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70401027a0 0x7f704019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:06.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.222+0000 7f7045000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7040106f20 0x7f704019eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:06.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.222+0000 7f7045000640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7040111f80 con 0x7f70401027a0 2024-09-15T22:24:06.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.222+0000 7f7045000640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7040111e00 con 0x7f7040101df0 2024-09-15T22:24:06.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.222+0000 7f7045000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7040112100 con 0x7f7040106f20 2024-09-15T22:24:06.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.222+0000 7f7037e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70401027a0 0x7f704019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:06.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.222+0000 7f7037e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70401027a0 0x7f704019ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54646/0 (socket says 172.21.15.1:54646) 2024-09-15T22:24:06.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.222+0000 7f7037e00640 1 -- 172.21.15.1:0/2160689778 learned_addr learned my addr 172.21.15.1:0/2160689778 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:06.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.222+0000 7f703de00640 1 --2- 172.21.15.1:0/2160689778 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7040101df0 0x7f704019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:06.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.223+0000 7f703e800640 1 --2- 172.21.15.1:0/2160689778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7040106f20 0x7f704019eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:06.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.223+0000 7f7037e00640 1 -- 172.21.15.1:0/2160689778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7040106f20 msgr2=0x7f704019eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:06.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.223+0000 7f7037e00640 1 --2- 172.21.15.1:0/2160689778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7040106f20 0x7f704019eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:06.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.223+0000 7f7037e00640 1 -- 172.21.15.1:0/2160689778 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7040101df0 msgr2=0x7f704019a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:06.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.223+0000 7f7037e00640 1 --2- 172.21.15.1:0/2160689778 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7040101df0 0x7f704019a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:06.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.223+0000 7f7037e00640 1 -- 172.21.15.1:0/2160689778 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f704019f5b0 con 0x7f70401027a0 2024-09-15T22:24:06.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.223+0000 7f7037e00640 1 --2- 172.21.15.1:0/2160689778 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70401027a0 0x7f704019ab40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7028006010 tx=0x7f7028004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:06.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.223+0000 7f7036a00640 1 -- 172.21.15.1:0/2160689778 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702803f030 con 0x7f70401027a0 2024-09-15T22:24:06.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.223+0000 7f7036a00640 1 -- 172.21.15.1:0/2160689778 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7028004440 con 0x7f70401027a0 2024-09-15T22:24:06.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.223+0000 7f7045000640 1 -- 172.21.15.1:0/2160689778 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f704019f840 con 0x7f70401027a0 2024-09-15T22:24:06.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.223+0000 7f7036a00640 1 -- 172.21.15.1:0/2160689778 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7028035070 con 0x7f70401027a0 2024-09-15T22:24:06.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.224+0000 7f7045000640 1 -- 172.21.15.1:0/2160689778 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70401a7180 con 0x7f70401027a0 2024-09-15T22:24:06.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.225+0000 7f7045000640 1 -- 172.21.15.1:0/2160689778 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70401021d0 con 0x7f70401027a0 2024-09-15T22:24:06.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.227+0000 7f7036a00640 1 -- 172.21.15.1:0/2160689778 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f7028042030 con 0x7f70401027a0 2024-09-15T22:24:06.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.228+0000 7f7036a00640 1 --2- 172.21.15.1:0/2160689778 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f70240a3350 0x7f70240a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:06.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.228+0000 7f7036a00640 1 -- 172.21.15.1:0/2160689778 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f70280efde0 con 0x7f70401027a0 2024-09-15T22:24:06.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.228+0000 7f703de00640 1 --2- 172.21.15.1:0/2160689778 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f70240a3350 0x7f70240a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:06.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.229+0000 7f703de00640 1 --2- 172.21.15.1:0/2160689778 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f70240a3350 0x7f70240a5810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f70300095f0 tx=0x7f7030005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:06.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.232+0000 7f7036a00640 1 -- 172.21.15.1:0/2160689778 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f70280bc2e0 con 0x7f70401027a0 2024-09-15T22:24:06.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.425+0000 7f7045000640 1 -- 172.21.15.1:0/2160689778 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f70401a7380 con 0x7f70401027a0 2024-09-15T22:24:06.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.425+0000 7f7036a00640 1 -- 172.21.15.1:0/2160689778 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f70280c05e0 con 0x7f70401027a0 2024-09-15T22:24:06.427 INFO:teuthology.orchestra.run.smithi001.stdout:77309411405 2024-09-15T22:24:06.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.427+0000 7f7045000640 1 -- 172.21.15.1:0/2160689778 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f70240a3350 msgr2=0x7f70240a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:06.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.427+0000 7f7045000640 1 --2- 172.21.15.1:0/2160689778 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f70240a3350 0x7f70240a5810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f70300095f0 tx=0x7f7030005f90 comp rx=0 tx=0).stop 2024-09-15T22:24:06.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.427+0000 7f7045000640 1 -- 172.21.15.1:0/2160689778 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70401027a0 msgr2=0x7f704019ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:06.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.427+0000 7f7045000640 1 --2- 172.21.15.1:0/2160689778 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70401027a0 0x7f704019ab40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7028006010 tx=0x7f7028004040 comp rx=0 tx=0).stop 2024-09-15T22:24:06.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.427+0000 7f7045000640 1 -- 172.21.15.1:0/2160689778 shutdown_connections 2024-09-15T22:24:06.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.427+0000 7f7045000640 1 --2- 172.21.15.1:0/2160689778 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f70240a3350 0x7f70240a5810 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:06.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.427+0000 7f7045000640 1 --2- 172.21.15.1:0/2160689778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7040106f20 0x7f704019eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:06.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.427+0000 7f7045000640 1 --2- 172.21.15.1:0/2160689778 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70401027a0 0x7f704019ab40 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:06.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.427+0000 7f7045000640 1 --2- 172.21.15.1:0/2160689778 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7040101df0 0x7f704019a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:06.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.427+0000 7f7045000640 1 -- 172.21.15.1:0/2160689778 >> 172.21.15.1:0/2160689778 conn(0x7f70400fd8b0 msgr2=0x7f70400feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:06.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.428+0000 7f7045000640 1 -- 172.21.15.1:0/2160689778 shutdown_connections 2024-09-15T22:24:06.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:06.428+0000 7f7045000640 1 -- 172.21.15.1:0/2160689778 wait complete. 2024-09-15T22:24:06.818 INFO:tasks.cephadm.ceph_manager.ceph:need seq 244813135913 got 244813135917 for osd.8 2024-09-15T22:24:06.818 DEBUG:teuthology.parallel:result is None 2024-09-15T22:24:07.573 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:07 smithi001 ceph-mon[30843]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-15T22:24:07.573 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:07 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/2160689778' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-15T22:24:07.618 INFO:tasks.cephadm.ceph_manager.ceph:need seq 296352743454 got 296352743457 for osd.10 2024-09-15T22:24:07.619 DEBUG:teuthology.parallel:result is None 2024-09-15T22:24:07.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:07 smithi012 ceph-mon[34883]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-15T22:24:07.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:07 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/2160689778' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-15T22:24:07.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:07 smithi098 ceph-mon[35514]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-15T22:24:07.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:07 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/2160689778' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-15T22:24:08.122 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411401 got 77309411405 for osd.2 2024-09-15T22:24:08.122 DEBUG:teuthology.parallel:result is None 2024-09-15T22:24:08.123 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-15T22:24:08.123 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T22:24:08.527 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:09.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.076+0000 7f539fe00640 1 -- 172.21.15.1:0/744263242 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53a0102370 msgr2=0x7f53a010e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:09.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.076+0000 7f539fe00640 1 --2- 172.21.15.1:0/744263242 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53a0102370 0x7f53a010e8a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5398009cd0 tx=0x7f539802a8e0 comp rx=0 tx=0).stop 2024-09-15T22:24:09.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.076+0000 7f539fe00640 1 -- 172.21.15.1:0/744263242 shutdown_connections 2024-09-15T22:24:09.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.076+0000 7f539fe00640 1 --2- 172.21.15.1:0/744263242 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53a0102370 0x7f53a010e8a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:09.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.076+0000 7f539fe00640 1 --2- 172.21.15.1:0/744263242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53a01019d0 0x7f53a0101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:09.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.076+0000 7f539fe00640 1 --2- 172.21.15.1:0/744263242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53a01079d0 0x7f53a0107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:09.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.076+0000 7f539fe00640 1 -- 172.21.15.1:0/744263242 >> 172.21.15.1:0/744263242 conn(0x7f53a00fd710 msgr2=0x7f53a00ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:09.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.076+0000 7f539fe00640 1 -- 172.21.15.1:0/744263242 shutdown_connections 2024-09-15T22:24:09.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.076+0000 7f539fe00640 1 -- 172.21.15.1:0/744263242 wait complete. 2024-09-15T22:24:09.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.078+0000 7f539fe00640 1 Processor -- start 2024-09-15T22:24:09.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.078+0000 7f539fe00640 1 -- start start 2024-09-15T22:24:09.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.078+0000 7f539fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53a01019d0 0x7f53a00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:09.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.078+0000 7f539fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53a0102370 0x7f53a0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:09.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.078+0000 7f539fe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53a01079d0 0x7f53a0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:09.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.078+0000 7f539fe00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f53a0111e20 con 0x7f53a01079d0 2024-09-15T22:24:09.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.078+0000 7f539fe00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f53a0111ca0 con 0x7f53a0102370 2024-09-15T22:24:09.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.078+0000 7f539fe00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f53a0111fa0 con 0x7f53a01019d0 2024-09-15T22:24:09.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.079+0000 7f539ea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53a01019d0 0x7f53a00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:09.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.079+0000 7f539ea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53a01019d0 0x7f53a00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:44170/0 (socket says 172.21.15.1:44170) 2024-09-15T22:24:09.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.079+0000 7f539ea00640 1 -- 172.21.15.1:0/458008377 learned_addr learned my addr 172.21.15.1:0/458008377 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:09.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.079+0000 7f539e000640 1 --2- 172.21.15.1:0/458008377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53a0102370 0x7f53a0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:09.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.079+0000 7f539f400640 1 --2- 172.21.15.1:0/458008377 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53a01079d0 0x7f53a0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:09.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.079+0000 7f539ea00640 1 -- 172.21.15.1:0/458008377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53a0102370 msgr2=0x7f53a0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:09.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.079+0000 7f539ea00640 1 --2- 172.21.15.1:0/458008377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53a0102370 0x7f53a0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:09.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.079+0000 7f539ea00640 1 -- 172.21.15.1:0/458008377 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53a01079d0 msgr2=0x7f53a0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:09.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.079+0000 7f539ea00640 1 --2- 172.21.15.1:0/458008377 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53a01079d0 0x7f53a0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:09.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.079+0000 7f539ea00640 1 -- 172.21.15.1:0/458008377 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53a01a6700 con 0x7f53a01019d0 2024-09-15T22:24:09.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.079+0000 7f539f400640 1 --2- 172.21.15.1:0/458008377 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53a01079d0 0x7f53a0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:24:09.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.079+0000 7f539ea00640 1 --2- 172.21.15.1:0/458008377 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53a01019d0 0x7f53a00744f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f539000e9f0 tx=0x7f539000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:09.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.080+0000 7f5397400640 1 -- 172.21.15.1:0/458008377 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539000cd80 con 0x7f53a01019d0 2024-09-15T22:24:09.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.080+0000 7f5397400640 1 -- 172.21.15.1:0/458008377 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5390010910 con 0x7f53a01019d0 2024-09-15T22:24:09.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.080+0000 7f539fe00640 1 -- 172.21.15.1:0/458008377 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53a01a69f0 con 0x7f53a01019d0 2024-09-15T22:24:09.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.080+0000 7f5397400640 1 -- 172.21.15.1:0/458008377 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5390018990 con 0x7f53a01019d0 2024-09-15T22:24:09.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.080+0000 7f539fe00640 1 -- 172.21.15.1:0/458008377 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53a01a6f80 con 0x7f53a01019d0 2024-09-15T22:24:09.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.081+0000 7f539fe00640 1 -- 172.21.15.1:0/458008377 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53a0101e30 con 0x7f53a01019d0 2024-09-15T22:24:09.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.084+0000 7f5397400640 1 -- 172.21.15.1:0/458008377 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f5390010ac0 con 0x7f53a01019d0 2024-09-15T22:24:09.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.086+0000 7f5397400640 1 --2- 172.21.15.1:0/458008377 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f53840a3350 0x7f53840a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:09.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.086+0000 7f5397400640 1 -- 172.21.15.1:0/458008377 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f53900d0200 con 0x7f53a01019d0 2024-09-15T22:24:09.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.086+0000 7f5397400640 1 -- 172.21.15.1:0/458008377 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f539009cd50 con 0x7f53a01019d0 2024-09-15T22:24:09.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.086+0000 7f539e000640 1 --2- 172.21.15.1:0/458008377 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f53840a3350 0x7f53840a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:09.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.087+0000 7f539e000640 1 --2- 172.21.15.1:0/458008377 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f53840a3350 0x7f53840a5810 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f53a0075f80 tx=0x7f538c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:09.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.271+0000 7f539fe00640 1 -- 172.21.15.1:0/458008377 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f53a00fe510 con 0x7f53840a3350 2024-09-15T22:24:09.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.278+0000 7f5397400640 1 -- 172.21.15.1:0/458008377 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258716 (secure 0 0 0) 0x7f53a00fe510 con 0x7f53840a3350 2024-09-15T22:24:09.282 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:24:09.283 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-15T22:24:09.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.282+0000 7f539fe00640 1 -- 172.21.15.1:0/458008377 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f53840a3350 msgr2=0x7f53840a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:09.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.283+0000 7f539fe00640 1 --2- 172.21.15.1:0/458008377 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f53840a3350 0x7f53840a5810 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f53a0075f80 tx=0x7f538c005f90 comp rx=0 tx=0).stop 2024-09-15T22:24:09.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.283+0000 7f539fe00640 1 -- 172.21.15.1:0/458008377 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53a01019d0 msgr2=0x7f53a00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:09.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.283+0000 7f539fe00640 1 --2- 172.21.15.1:0/458008377 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53a01019d0 0x7f53a00744f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f539000e9f0 tx=0x7f539000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:24:09.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.283+0000 7f539fe00640 1 -- 172.21.15.1:0/458008377 shutdown_connections 2024-09-15T22:24:09.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.283+0000 7f539fe00640 1 --2- 172.21.15.1:0/458008377 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f53840a3350 0x7f53840a5810 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:09.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.283+0000 7f539fe00640 1 --2- 172.21.15.1:0/458008377 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53a01079d0 0x7f53a0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:09.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.283+0000 7f539fe00640 1 --2- 172.21.15.1:0/458008377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53a0102370 0x7f53a0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:09.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.283+0000 7f539fe00640 1 --2- 172.21.15.1:0/458008377 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53a01019d0 0x7f53a00744f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:09.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.283+0000 7f539fe00640 1 -- 172.21.15.1:0/458008377 >> 172.21.15.1:0/458008377 conn(0x7f53a00fd710 msgr2=0x7f53a00fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:09.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.283+0000 7f539fe00640 1 -- 172.21.15.1:0/458008377 shutdown_connections 2024-09-15T22:24:09.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:09.283+0000 7f539fe00640 1 -- 172.21.15.1:0/458008377 wait complete. 2024-09-15T22:24:09.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:09 smithi001 ceph-mon[30843]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-15T22:24:09.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:09 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:24:09.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:09 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:24:09.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:09 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:09.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:09 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:24:09.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:09 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:24:09.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:09 smithi012 ceph-mon[34883]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-15T22:24:09.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:09 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:24:09.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:09 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:24:09.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:09 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:09.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:09 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:24:09.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:09 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:24:09.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:09 smithi098 ceph-mon[35514]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-15T22:24:09.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:09 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:24:09.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:09 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:24:09.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:09 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:09.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:09 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:24:09.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:09 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:24:10.056 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":332,"stamp":"2024-09-15T22:24:07.542030+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654762,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":518,"num_read_kb":371,"num_write":348,"num_write_kb":3051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":279,"ondisk_log_size":279,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":358024,"kb_used_data":12876,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124583800,"statfs":{"total":1151940427776,"available":1151573811200,"internally_reserved":0,"allocated":13185024,"data_stored":7244490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":353154361},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002851"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.912577+0000","last_change":"2024-09-15T22:22:50.777000+0000","last_active":"2024-09-15T22:23:32.912577+0000","last_peered":"2024-09-15T22:23:32.912577+0000","last_clean":"2024-09-15T22:23:32.912577+0000","last_became_active":"2024-09-15T22:22:50.776448+0000","last_became_peered":"2024-09-15T22:22:50.776448+0000","last_unstale":"2024-09-15T22:23:32.912577+0000","last_undegraded":"2024-09-15T22:23:32.912577+0000","last_fullsized":"2024-09-15T22:23:32.912577+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:20:09.218864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.911702+0000","last_change":"2024-09-15T22:22:50.772294+0000","last_active":"2024-09-15T22:23:32.911702+0000","last_peered":"2024-09-15T22:23:32.911702+0000","last_clean":"2024-09-15T22:23:32.911702+0000","last_became_active":"2024-09-15T22:22:50.771993+0000","last_became_peered":"2024-09-15T22:22:50.771993+0000","last_unstale":"2024-09-15T22:23:32.911702+0000","last_undegraded":"2024-09-15T22:23:32.911702+0000","last_fullsized":"2024-09-15T22:23:32.911702+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:23.770489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.912020+0000","last_change":"2024-09-15T22:22:50.775717+0000","last_active":"2024-09-15T22:23:32.912020+0000","last_peered":"2024-09-15T22:23:32.912020+0000","last_clean":"2024-09-15T22:23:32.912020+0000","last_became_active":"2024-09-15T22:22:50.775405+0000","last_became_peered":"2024-09-15T22:22:50.775405+0000","last_unstale":"2024-09-15T22:23:32.912020+0000","last_undegraded":"2024-09-15T22:23:32.912020+0000","last_fullsized":"2024-09-15T22:23:32.912020+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:28.765207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:33.381329+0000","last_change":"2024-09-15T22:22:50.786473+0000","last_active":"2024-09-15T22:23:33.381329+0000","last_peered":"2024-09-15T22:23:33.381329+0000","last_clean":"2024-09-15T22:23:33.381329+0000","last_became_active":"2024-09-15T22:22:50.786001+0000","last_became_peered":"2024-09-15T22:22:50.786001+0000","last_unstale":"2024-09-15T22:23:33.381329+0000","last_undegraded":"2024-09-15T22:23:33.381329+0000","last_fullsized":"2024-09-15T22:23:33.381329+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:47.378713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.914623+0000","last_change":"2024-09-15T22:22:50.777784+0000","last_active":"2024-09-15T22:23:32.914623+0000","last_peered":"2024-09-15T22:23:32.914623+0000","last_clean":"2024-09-15T22:23:32.914623+0000","last_became_active":"2024-09-15T22:22:50.777457+0000","last_became_peered":"2024-09-15T22:22:50.777457+0000","last_unstale":"2024-09-15T22:23:32.914623+0000","last_undegraded":"2024-09-15T22:23:32.914623+0000","last_fullsized":"2024-09-15T22:23:32.914623+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:25.106526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.909050+0000","last_change":"2024-09-15T22:22:50.773565+0000","last_active":"2024-09-15T22:23:32.909050+0000","last_peered":"2024-09-15T22:23:32.909050+0000","last_clean":"2024-09-15T22:23:32.909050+0000","last_became_active":"2024-09-15T22:22:50.773208+0000","last_became_peered":"2024-09-15T22:22:50.773208+0000","last_unstale":"2024-09-15T22:23:32.909050+0000","last_undegraded":"2024-09-15T22:23:32.909050+0000","last_fullsized":"2024-09-15T22:23:32.909050+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:07:43.996923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:33.380014+0000","last_change":"2024-09-15T22:22:50.779699+0000","last_active":"2024-09-15T22:23:33.380014+0000","last_peered":"2024-09-15T22:23:33.380014+0000","last_clean":"2024-09-15T22:23:33.380014+0000","last_became_active":"2024-09-15T22:22:50.779290+0000","last_became_peered":"2024-09-15T22:22:50.779290+0000","last_unstale":"2024-09-15T22:23:33.380014+0000","last_undegraded":"2024-09-15T22:23:33.380014+0000","last_fullsized":"2024-09-15T22:23:33.380014+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:41:21.741094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.914820+0000","last_change":"2024-09-15T22:22:50.786051+0000","last_active":"2024-09-15T22:23:32.914820+0000","last_peered":"2024-09-15T22:23:32.914820+0000","last_clean":"2024-09-15T22:23:32.914820+0000","last_became_active":"2024-09-15T22:22:50.785767+0000","last_became_peered":"2024-09-15T22:22:50.785767+0000","last_unstale":"2024-09-15T22:23:32.914820+0000","last_undegraded":"2024-09-15T22:23:32.914820+0000","last_fullsized":"2024-09-15T22:23:32.914820+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:23:09.849960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.914311+0000","last_change":"2024-09-15T22:23:32.914311+0000","last_active":"2024-09-15T22:23:32.914311+0000","last_peered":"2024-09-15T22:23:32.914311+0000","last_clean":"2024-09-15T22:23:32.914311+0000","last_became_active":"2024-09-15T22:23:32.913818+0000","last_became_peered":"2024-09-15T22:23:32.913818+0000","last_unstale":"2024-09-15T22:23:32.914311+0000","last_undegraded":"2024-09-15T22:23:32.914311+0000","last_fullsized":"2024-09-15T22:23:32.914311+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:10:11.932664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,11],"acting":[1,6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.909859+0000","last_change":"2024-09-15T22:22:50.776481+0000","last_active":"2024-09-15T22:23:32.909859+0000","last_peered":"2024-09-15T22:23:32.909859+0000","last_clean":"2024-09-15T22:23:32.909859+0000","last_became_active":"2024-09-15T22:22:50.775915+0000","last_became_peered":"2024-09-15T22:22:50.775915+0000","last_unstale":"2024-09-15T22:23:32.909859+0000","last_undegraded":"2024-09-15T22:23:32.909859+0000","last_fullsized":"2024-09-15T22:23:32.909859+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:35.923867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:33.380707+0000","last_change":"2024-09-15T22:22:50.777986+0000","last_active":"2024-09-15T22:23:33.380707+0000","last_peered":"2024-09-15T22:23:33.380707+0000","last_clean":"2024-09-15T22:23:33.380707+0000","last_became_active":"2024-09-15T22:22:50.777624+0000","last_became_peered":"2024-09-15T22:22:50.777624+0000","last_unstale":"2024-09-15T22:23:33.380707+0000","last_undegraded":"2024-09-15T22:23:33.380707+0000","last_fullsized":"2024-09-15T22:23:33.380707+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:07.135073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.918811+0000","last_change":"2024-09-15T22:23:32.918035+0000","last_active":"2024-09-15T22:23:32.918811+0000","last_peered":"2024-09-15T22:23:32.918811+0000","last_clean":"2024-09-15T22:23:32.918811+0000","last_became_active":"2024-09-15T22:23:32.917216+0000","last_became_peered":"2024-09-15T22:23:32.917216+0000","last_unstale":"2024-09-15T22:23:32.918811+0000","last_undegraded":"2024-09-15T22:23:32.918811+0000","last_fullsized":"2024-09-15T22:23:32.918811+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:09:39.680400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.910430+0000","last_change":"2024-09-15T22:22:50.778817+0000","last_active":"2024-09-15T22:23:32.910430+0000","last_peered":"2024-09-15T22:23:32.910430+0000","last_clean":"2024-09-15T22:23:32.910430+0000","last_became_active":"2024-09-15T22:22:50.776127+0000","last_became_peered":"2024-09-15T22:22:50.776127+0000","last_unstale":"2024-09-15T22:23:32.910430+0000","last_undegraded":"2024-09-15T22:23:32.910430+0000","last_fullsized":"2024-09-15T22:23:32.910430+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:19.233333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.911588+0000","last_change":"2024-09-15T22:22:50.771502+0000","last_active":"2024-09-15T22:23:32.911588+0000","last_peered":"2024-09-15T22:23:32.911588+0000","last_clean":"2024-09-15T22:23:32.911588+0000","last_became_active":"2024-09-15T22:22:50.771201+0000","last_became_peered":"2024-09-15T22:22:50.771201+0000","last_unstale":"2024-09-15T22:23:32.911588+0000","last_undegraded":"2024-09-15T22:23:32.911588+0000","last_fullsized":"2024-09-15T22:23:32.911588+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:24:34.668603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.911575+0000","last_change":"2024-09-15T22:22:50.776677+0000","last_active":"2024-09-15T22:23:32.911575+0000","last_peered":"2024-09-15T22:23:32.911575+0000","last_clean":"2024-09-15T22:23:32.911575+0000","last_became_active":"2024-09-15T22:22:50.774861+0000","last_became_peered":"2024-09-15T22:22:50.774861+0000","last_unstale":"2024-09-15T22:23:32.911575+0000","last_undegraded":"2024-09-15T22:23:32.911575+0000","last_fullsized":"2024-09-15T22:23:32.911575+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:25:00.652606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.910913+0000","last_change":"2024-09-15T22:22:50.784162+0000","last_active":"2024-09-15T22:23:32.910913+0000","last_peered":"2024-09-15T22:23:32.910913+0000","last_clean":"2024-09-15T22:23:32.910913+0000","last_became_active":"2024-09-15T22:22:50.783782+0000","last_became_peered":"2024-09-15T22:22:50.783782+0000","last_unstale":"2024-09-15T22:23:32.910913+0000","last_undegraded":"2024-09-15T22:23:32.910913+0000","last_fullsized":"2024-09-15T22:23:32.910913+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:36:22.785321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.912776+0000","last_change":"2024-09-15T22:22:50.775360+0000","last_active":"2024-09-15T22:23:32.912776+0000","last_peered":"2024-09-15T22:23:32.912776+0000","last_clean":"2024-09-15T22:23:32.912776+0000","last_became_active":"2024-09-15T22:22:50.775075+0000","last_became_peered":"2024-09-15T22:22:50.775075+0000","last_unstale":"2024-09-15T22:23:32.912776+0000","last_undegraded":"2024-09-15T22:23:32.912776+0000","last_fullsized":"2024-09-15T22:23:32.912776+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:25:42.484125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.908137+0000","last_change":"2024-09-15T22:22:50.772497+0000","last_active":"2024-09-15T22:23:32.908137+0000","last_peered":"2024-09-15T22:23:32.908137+0000","last_clean":"2024-09-15T22:23:32.908137+0000","last_became_active":"2024-09-15T22:22:50.770061+0000","last_became_peered":"2024-09-15T22:22:50.770061+0000","last_unstale":"2024-09-15T22:23:32.908137+0000","last_undegraded":"2024-09-15T22:23:32.908137+0000","last_fullsized":"2024-09-15T22:23:32.908137+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:23.420138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.915745+0000","last_change":"2024-09-15T22:22:50.788026+0000","last_active":"2024-09-15T22:23:32.915745+0000","last_peered":"2024-09-15T22:23:32.915745+0000","last_clean":"2024-09-15T22:23:32.915745+0000","last_became_active":"2024-09-15T22:22:50.787247+0000","last_became_peered":"2024-09-15T22:22:50.787247+0000","last_unstale":"2024-09-15T22:23:32.915745+0000","last_undegraded":"2024-09-15T22:23:32.915745+0000","last_fullsized":"2024-09-15T22:23:32.915745+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:52:48.408625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.911788+0000","last_change":"2024-09-15T22:22:50.777295+0000","last_active":"2024-09-15T22:23:32.911788+0000","last_peered":"2024-09-15T22:23:32.911788+0000","last_clean":"2024-09-15T22:23:32.911788+0000","last_became_active":"2024-09-15T22:22:50.776957+0000","last_became_peered":"2024-09-15T22:22:50.776957+0000","last_unstale":"2024-09-15T22:23:32.911788+0000","last_undegraded":"2024-09-15T22:23:32.911788+0000","last_fullsized":"2024-09-15T22:23:32.911788+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:50:45.858031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.910527+0000","last_change":"2024-09-15T22:22:50.778773+0000","last_active":"2024-09-15T22:23:32.910527+0000","last_peered":"2024-09-15T22:23:32.910527+0000","last_clean":"2024-09-15T22:23:32.910527+0000","last_became_active":"2024-09-15T22:22:50.778346+0000","last_became_peered":"2024-09-15T22:22:50.778346+0000","last_unstale":"2024-09-15T22:23:32.910527+0000","last_undegraded":"2024-09-15T22:23:32.910527+0000","last_fullsized":"2024-09-15T22:23:32.910527+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:21:11.785059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.911276+0000","last_change":"2024-09-15T22:22:50.776172+0000","last_active":"2024-09-15T22:23:32.911276+0000","last_peered":"2024-09-15T22:23:32.911276+0000","last_clean":"2024-09-15T22:23:32.911276+0000","last_became_active":"2024-09-15T22:22:50.775838+0000","last_became_peered":"2024-09-15T22:22:50.775838+0000","last_unstale":"2024-09-15T22:23:32.911276+0000","last_undegraded":"2024-09-15T22:23:32.911276+0000","last_fullsized":"2024-09-15T22:23:32.911276+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:16:35.834565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.920056+0000","last_change":"2024-09-15T22:23:32.919723+0000","last_active":"2024-09-15T22:23:32.920056+0000","last_peered":"2024-09-15T22:23:32.920056+0000","last_clean":"2024-09-15T22:23:32.920056+0000","last_became_active":"2024-09-15T22:23:32.919492+0000","last_became_peered":"2024-09-15T22:23:32.919492+0000","last_unstale":"2024-09-15T22:23:32.920056+0000","last_undegraded":"2024-09-15T22:23:32.920056+0000","last_fullsized":"2024-09-15T22:23:32.920056+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:23.554364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.918531+0000","last_change":"2024-09-15T22:23:32.917066+0000","last_active":"2024-09-15T22:23:32.918531+0000","last_peered":"2024-09-15T22:23:32.918531+0000","last_clean":"2024-09-15T22:23:32.918531+0000","last_became_active":"2024-09-15T22:23:32.916602+0000","last_became_peered":"2024-09-15T22:23:32.916602+0000","last_unstale":"2024-09-15T22:23:32.918531+0000","last_undegraded":"2024-09-15T22:23:32.918531+0000","last_fullsized":"2024-09-15T22:23:32.918531+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:54.809986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,3],"acting":[6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.915990+0000","last_change":"2024-09-15T22:22:50.782833+0000","last_active":"2024-09-15T22:23:32.915990+0000","last_peered":"2024-09-15T22:23:32.915990+0000","last_clean":"2024-09-15T22:23:32.915990+0000","last_became_active":"2024-09-15T22:22:50.782450+0000","last_became_peered":"2024-09-15T22:22:50.782450+0000","last_unstale":"2024-09-15T22:23:32.915990+0000","last_undegraded":"2024-09-15T22:23:32.915990+0000","last_fullsized":"2024-09-15T22:23:32.915990+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:32:07.931321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.916232+0000","last_change":"2024-09-15T22:22:50.784199+0000","last_active":"2024-09-15T22:23:32.916232+0000","last_peered":"2024-09-15T22:23:32.916232+0000","last_clean":"2024-09-15T22:23:32.916232+0000","last_became_active":"2024-09-15T22:22:50.783858+0000","last_became_peered":"2024-09-15T22:22:50.783858+0000","last_unstale":"2024-09-15T22:23:32.916232+0000","last_undegraded":"2024-09-15T22:23:32.916232+0000","last_fullsized":"2024-09-15T22:23:32.916232+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:40:01.271188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.912236+0000","last_change":"2024-09-15T22:22:50.772094+0000","last_active":"2024-09-15T22:23:32.912236+0000","last_peered":"2024-09-15T22:23:32.912236+0000","last_clean":"2024-09-15T22:23:32.912236+0000","last_became_active":"2024-09-15T22:22:50.771633+0000","last_became_peered":"2024-09-15T22:22:50.771633+0000","last_unstale":"2024-09-15T22:23:32.912236+0000","last_undegraded":"2024-09-15T22:23:32.912236+0000","last_fullsized":"2024-09-15T22:23:32.912236+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:06:46.194573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.910763+0000","last_change":"2024-09-15T22:22:50.781069+0000","last_active":"2024-09-15T22:23:32.910763+0000","last_peered":"2024-09-15T22:23:32.910763+0000","last_clean":"2024-09-15T22:23:32.910763+0000","last_became_active":"2024-09-15T22:22:50.780742+0000","last_became_peered":"2024-09-15T22:22:50.780742+0000","last_unstale":"2024-09-15T22:23:32.910763+0000","last_undegraded":"2024-09-15T22:23:32.910763+0000","last_fullsized":"2024-09-15T22:23:32.910763+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:21:05.323542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.911853+0000","last_change":"2024-09-15T22:22:50.776252+0000","last_active":"2024-09-15T22:23:32.911853+0000","last_peered":"2024-09-15T22:23:32.911853+0000","last_clean":"2024-09-15T22:23:32.911853+0000","last_became_active":"2024-09-15T22:22:50.775911+0000","last_became_peered":"2024-09-15T22:22:50.775911+0000","last_unstale":"2024-09-15T22:23:32.911853+0000","last_undegraded":"2024-09-15T22:23:32.911853+0000","last_fullsized":"2024-09-15T22:23:32.911853+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:01:43.836637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.918290+0000","last_change":"2024-09-15T22:22:50.775992+0000","last_active":"2024-09-15T22:23:32.918290+0000","last_peered":"2024-09-15T22:23:32.918290+0000","last_clean":"2024-09-15T22:23:32.918290+0000","last_became_active":"2024-09-15T22:22:50.775619+0000","last_became_peered":"2024-09-15T22:22:50.775619+0000","last_unstale":"2024-09-15T22:23:32.918290+0000","last_undegraded":"2024-09-15T22:23:32.918290+0000","last_fullsized":"2024-09-15T22:23:32.918290+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:57.623706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.917013+0000","last_change":"2024-09-15T22:22:50.786376+0000","last_active":"2024-09-15T22:23:32.917013+0000","last_peered":"2024-09-15T22:23:32.917013+0000","last_clean":"2024-09-15T22:23:32.917013+0000","last_became_active":"2024-09-15T22:22:50.786011+0000","last_became_peered":"2024-09-15T22:22:50.786011+0000","last_unstale":"2024-09-15T22:23:32.917013+0000","last_undegraded":"2024-09-15T22:23:32.917013+0000","last_fullsized":"2024-09-15T22:23:32.917013+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:54.492349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.911793+0000","last_change":"2024-09-15T22:22:50.777114+0000","last_active":"2024-09-15T22:23:32.911793+0000","last_peered":"2024-09-15T22:23:32.911793+0000","last_clean":"2024-09-15T22:23:32.911793+0000","last_became_active":"2024-09-15T22:22:50.776756+0000","last_became_peered":"2024-09-15T22:22:50.776756+0000","last_unstale":"2024-09-15T22:23:32.911793+0000","last_undegraded":"2024-09-15T22:23:32.911793+0000","last_fullsized":"2024-09-15T22:23:32.911793+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:51.220074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.915085+0000","last_change":"2024-09-15T22:22:50.777228+0000","last_active":"2024-09-15T22:23:32.915085+0000","last_peered":"2024-09-15T22:23:32.915085+0000","last_clean":"2024-09-15T22:23:32.915085+0000","last_became_active":"2024-09-15T22:22:50.776926+0000","last_became_peered":"2024-09-15T22:22:50.776926+0000","last_unstale":"2024-09-15T22:23:32.915085+0000","last_undegraded":"2024-09-15T22:23:32.915085+0000","last_fullsized":"2024-09-15T22:23:32.915085+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:28:20.346803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":92,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:24:03.929198+0000","last_change":"2024-09-15T22:22:48.333147+0000","last_active":"2024-09-15T22:24:03.929198+0000","last_peered":"2024-09-15T22:24:03.929198+0000","last_clean":"2024-09-15T22:24:03.929198+0000","last_became_active":"2024-09-15T22:22:48.332862+0000","last_became_peered":"2024-09-15T22:22:48.332862+0000","last_unstale":"2024-09-15T22:24:03.929198+0000","last_undegraded":"2024-09-15T22:24:03.929198+0000","last_fullsized":"2024-09-15T22:24:03.929198+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:18:25.043411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.909216+0000","last_change":"2024-09-15T22:22:50.787593+0000","last_active":"2024-09-15T22:23:32.909216+0000","last_peered":"2024-09-15T22:23:32.909216+0000","last_clean":"2024-09-15T22:23:32.909216+0000","last_became_active":"2024-09-15T22:22:50.787262+0000","last_became_peered":"2024-09-15T22:22:50.787262+0000","last_unstale":"2024-09-15T22:23:32.909216+0000","last_undegraded":"2024-09-15T22:23:32.909216+0000","last_fullsized":"2024-09-15T22:23:32.909216+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:40:40.529295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.909048+0000","last_change":"2024-09-15T22:22:48.333060+0000","last_active":"2024-09-15T22:23:32.909048+0000","last_peered":"2024-09-15T22:23:32.909048+0000","last_clean":"2024-09-15T22:23:32.909048+0000","last_became_active":"2024-09-15T22:22:48.332713+0000","last_became_peered":"2024-09-15T22:22:48.332713+0000","last_unstale":"2024-09-15T22:23:32.909048+0000","last_undegraded":"2024-09-15T22:23:32.909048+0000","last_fullsized":"2024-09-15T22:23:32.909048+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:44.664497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.909929+0000","last_change":"2024-09-15T22:22:48.335104+0000","last_active":"2024-09-15T22:23:32.909929+0000","last_peered":"2024-09-15T22:23:32.909929+0000","last_clean":"2024-09-15T22:23:32.909929+0000","last_became_active":"2024-09-15T22:22:48.334276+0000","last_became_peered":"2024-09-15T22:22:48.334276+0000","last_unstale":"2024-09-15T22:23:32.909929+0000","last_undegraded":"2024-09-15T22:23:32.909929+0000","last_fullsized":"2024-09-15T22:23:32.909929+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:49:24.414968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.914919+0000","last_change":"2024-09-15T22:22:50.773324+0000","last_active":"2024-09-15T22:23:32.914919+0000","last_peered":"2024-09-15T22:23:32.914919+0000","last_clean":"2024-09-15T22:23:32.914919+0000","last_became_active":"2024-09-15T22:22:50.773013+0000","last_became_peered":"2024-09-15T22:22:50.773013+0000","last_unstale":"2024-09-15T22:23:32.914919+0000","last_undegraded":"2024-09-15T22:23:32.914919+0000","last_fullsized":"2024-09-15T22:23:32.914919+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:41:06.642144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.908828+0000","last_change":"2024-09-15T22:22:48.334707+0000","last_active":"2024-09-15T22:23:32.908828+0000","last_peered":"2024-09-15T22:23:32.908828+0000","last_clean":"2024-09-15T22:23:32.908828+0000","last_became_active":"2024-09-15T22:22:48.334418+0000","last_became_peered":"2024-09-15T22:22:48.334418+0000","last_unstale":"2024-09-15T22:23:32.908828+0000","last_undegraded":"2024-09-15T22:23:32.908828+0000","last_fullsized":"2024-09-15T22:23:32.908828+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:40.285547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.907994+0000","last_change":"2024-09-15T22:22:50.772760+0000","last_active":"2024-09-15T22:23:32.907994+0000","last_peered":"2024-09-15T22:23:32.907994+0000","last_clean":"2024-09-15T22:23:32.907994+0000","last_became_active":"2024-09-15T22:22:50.772162+0000","last_became_peered":"2024-09-15T22:22:50.772162+0000","last_unstale":"2024-09-15T22:23:32.907994+0000","last_undegraded":"2024-09-15T22:23:32.907994+0000","last_fullsized":"2024-09-15T22:23:32.907994+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:23.368902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":85,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:24:02.927339+0000","last_change":"2024-09-15T22:22:48.336282+0000","last_active":"2024-09-15T22:24:02.927339+0000","last_peered":"2024-09-15T22:24:02.927339+0000","last_clean":"2024-09-15T22:24:02.927339+0000","last_became_active":"2024-09-15T22:22:48.335696+0000","last_became_peered":"2024-09-15T22:22:48.335696+0000","last_unstale":"2024-09-15T22:24:02.927339+0000","last_undegraded":"2024-09-15T22:24:02.927339+0000","last_fullsized":"2024-09-15T22:24:02.927339+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:22.990996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.911300+0000","last_change":"2024-09-15T22:22:50.778166+0000","last_active":"2024-09-15T22:23:32.911300+0000","last_peered":"2024-09-15T22:23:32.911300+0000","last_clean":"2024-09-15T22:23:32.911300+0000","last_became_active":"2024-09-15T22:22:50.777755+0000","last_became_peered":"2024-09-15T22:22:50.777755+0000","last_unstale":"2024-09-15T22:23:32.911300+0000","last_undegraded":"2024-09-15T22:23:32.911300+0000","last_fullsized":"2024-09-15T22:23:32.911300+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:45:50.513358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:33.380640+0000","last_change":"2024-09-15T22:22:48.334952+0000","last_active":"2024-09-15T22:23:33.380640+0000","last_peered":"2024-09-15T22:23:33.380640+0000","last_clean":"2024-09-15T22:23:33.380640+0000","last_became_active":"2024-09-15T22:22:48.332190+0000","last_became_peered":"2024-09-15T22:22:48.332190+0000","last_unstale":"2024-09-15T22:23:33.380640+0000","last_undegraded":"2024-09-15T22:23:33.380640+0000","last_fullsized":"2024-09-15T22:23:33.380640+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:45:14.877713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.917511+0000","last_change":"2024-09-15T22:23:32.917511+0000","last_active":"2024-09-15T22:23:32.917511+0000","last_peered":"2024-09-15T22:23:32.917511+0000","last_clean":"2024-09-15T22:23:32.917511+0000","last_became_active":"2024-09-15T22:23:32.917041+0000","last_became_peered":"2024-09-15T22:23:32.917041+0000","last_unstale":"2024-09-15T22:23:32.917511+0000","last_undegraded":"2024-09-15T22:23:32.917511+0000","last_fullsized":"2024-09-15T22:23:32.917511+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:40:55.934127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.909146+0000","last_change":"2024-09-15T22:22:48.388864+0000","last_active":"2024-09-15T22:23:32.909146+0000","last_peered":"2024-09-15T22:23:32.909146+0000","last_clean":"2024-09-15T22:23:32.909146+0000","last_became_active":"2024-09-15T22:22:48.388576+0000","last_became_peered":"2024-09-15T22:22:48.388576+0000","last_unstale":"2024-09-15T22:23:32.909146+0000","last_undegraded":"2024-09-15T22:23:32.909146+0000","last_fullsized":"2024-09-15T22:23:32.909146+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:19:44.416306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.911293+0000","last_change":"2024-09-15T22:22:50.783189+0000","last_active":"2024-09-15T22:23:32.911293+0000","last_peered":"2024-09-15T22:23:32.911293+0000","last_clean":"2024-09-15T22:23:32.911293+0000","last_became_active":"2024-09-15T22:22:50.782790+0000","last_became_peered":"2024-09-15T22:22:50.782790+0000","last_unstale":"2024-09-15T22:23:32.911293+0000","last_undegraded":"2024-09-15T22:23:32.911293+0000","last_fullsized":"2024-09-15T22:23:32.911293+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:12.650413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'29","reported_seq":180,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:24:03.928880+0000","last_change":"2024-09-15T22:22:48.336216+0000","last_active":"2024-09-15T22:24:03.928880+0000","last_peered":"2024-09-15T22:24:03.928880+0000","last_clean":"2024-09-15T22:24:03.928880+0000","last_became_active":"2024-09-15T22:22:48.334958+0000","last_became_peered":"2024-09-15T22:22:48.334958+0000","last_unstale":"2024-09-15T22:24:03.928880+0000","last_undegraded":"2024-09-15T22:24:03.928880+0000","last_fullsized":"2024-09-15T22:24:03.928880+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:58:31.990060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":129,"num_read_kb":122,"num_write":30,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.915369+0000","last_change":"2024-09-15T22:22:50.773996+0000","last_active":"2024-09-15T22:23:32.915369+0000","last_peered":"2024-09-15T22:23:32.915369+0000","last_clean":"2024-09-15T22:23:32.915369+0000","last_became_active":"2024-09-15T22:22:50.773651+0000","last_became_peered":"2024-09-15T22:22:50.773651+0000","last_unstale":"2024-09-15T22:23:32.915369+0000","last_undegraded":"2024-09-15T22:23:32.915369+0000","last_fullsized":"2024-09-15T22:23:32.915369+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:16.876455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.915126+0000","last_change":"2024-09-15T22:22:48.336138+0000","last_active":"2024-09-15T22:23:32.915126+0000","last_peered":"2024-09-15T22:23:32.915126+0000","last_clean":"2024-09-15T22:23:32.915126+0000","last_became_active":"2024-09-15T22:22:48.335538+0000","last_became_peered":"2024-09-15T22:22:48.335538+0000","last_unstale":"2024-09-15T22:23:32.915126+0000","last_undegraded":"2024-09-15T22:23:32.915126+0000","last_fullsized":"2024-09-15T22:23:32.915126+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:12.917499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.910051+0000","last_change":"2024-09-15T22:22:50.787247+0000","last_active":"2024-09-15T22:23:32.910051+0000","last_peered":"2024-09-15T22:23:32.910051+0000","last_clean":"2024-09-15T22:23:32.910051+0000","last_became_active":"2024-09-15T22:22:50.786880+0000","last_became_peered":"2024-09-15T22:22:50.786880+0000","last_unstale":"2024-09-15T22:23:32.910051+0000","last_undegraded":"2024-09-15T22:23:32.910051+0000","last_fullsized":"2024-09-15T22:23:32.910051+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:02.648581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.908861+0000","last_change":"2024-09-15T22:22:48.335633+0000","last_active":"2024-09-15T22:23:32.908861+0000","last_peered":"2024-09-15T22:23:32.908861+0000","last_clean":"2024-09-15T22:23:32.908861+0000","last_became_active":"2024-09-15T22:22:48.335354+0000","last_became_peered":"2024-09-15T22:22:48.335354+0000","last_unstale":"2024-09-15T22:23:32.908861+0000","last_undegraded":"2024-09-15T22:23:32.908861+0000","last_fullsized":"2024-09-15T22:23:32.908861+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:01:24.009614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:33.380143+0000","last_change":"2024-09-15T22:22:50.777583+0000","last_active":"2024-09-15T22:23:33.380143+0000","last_peered":"2024-09-15T22:23:33.380143+0000","last_clean":"2024-09-15T22:23:33.380143+0000","last_became_active":"2024-09-15T22:22:50.777235+0000","last_became_peered":"2024-09-15T22:22:50.777235+0000","last_unstale":"2024-09-15T22:23:33.380143+0000","last_undegraded":"2024-09-15T22:23:33.380143+0000","last_fullsized":"2024-09-15T22:23:33.380143+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:28:48.449725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'4","reported_seq":91,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:24:04.931402+0000","last_change":"2024-09-15T22:22:48.338517+0000","last_active":"2024-09-15T22:24:04.931402+0000","last_peered":"2024-09-15T22:24:04.931402+0000","last_clean":"2024-09-15T22:24:04.931402+0000","last_became_active":"2024-09-15T22:22:48.338159+0000","last_became_peered":"2024-09-15T22:22:48.338159+0000","last_unstale":"2024-09-15T22:24:04.931402+0000","last_undegraded":"2024-09-15T22:24:04.931402+0000","last_fullsized":"2024-09-15T22:24:04.931402+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:48:14.792180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:33.379668+0000","last_change":"2024-09-15T22:22:50.776455+0000","last_active":"2024-09-15T22:23:33.379668+0000","last_peered":"2024-09-15T22:23:33.379668+0000","last_clean":"2024-09-15T22:23:33.379668+0000","last_became_active":"2024-09-15T22:22:50.776049+0000","last_became_peered":"2024-09-15T22:22:50.776049+0000","last_unstale":"2024-09-15T22:23:33.379668+0000","last_undegraded":"2024-09-15T22:23:33.379668+0000","last_fullsized":"2024-09-15T22:23:33.379668+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:32:01.675470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:33.409981+0000","last_change":"2024-09-15T22:23:33.409514+0000","last_active":"2024-09-15T22:23:33.409981+0000","last_peered":"2024-09-15T22:23:33.409981+0000","last_clean":"2024-09-15T22:23:33.409981+0000","last_became_active":"2024-09-15T22:23:33.381873+0000","last_became_peered":"2024-09-15T22:23:33.381873+0000","last_unstale":"2024-09-15T22:23:33.409981+0000","last_undegraded":"2024-09-15T22:23:33.409981+0000","last_fullsized":"2024-09-15T22:23:33.409981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:14.762596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,4],"acting":[11,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.908822+0000","last_change":"2024-09-15T22:22:50.782530+0000","last_active":"2024-09-15T22:23:32.908822+0000","last_peered":"2024-09-15T22:23:32.908822+0000","last_clean":"2024-09-15T22:23:32.908822+0000","last_became_active":"2024-09-15T22:22:50.782201+0000","last_became_peered":"2024-09-15T22:22:50.782201+0000","last_unstale":"2024-09-15T22:23:32.908822+0000","last_undegraded":"2024-09-15T22:23:32.908822+0000","last_fullsized":"2024-09-15T22:23:32.908822+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:05.652843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.915464+0000","last_change":"2024-09-15T22:22:48.330909+0000","last_active":"2024-09-15T22:23:32.915464+0000","last_peered":"2024-09-15T22:23:32.915464+0000","last_clean":"2024-09-15T22:23:32.915464+0000","last_became_active":"2024-09-15T22:22:48.330603+0000","last_became_peered":"2024-09-15T22:22:48.330603+0000","last_unstale":"2024-09-15T22:23:32.915464+0000","last_undegraded":"2024-09-15T22:23:32.915464+0000","last_fullsized":"2024-09-15T22:23:32.915464+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:32:41.489246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.912231+0000","last_change":"2024-09-15T22:22:50.776404+0000","last_active":"2024-09-15T22:23:32.912231+0000","last_peered":"2024-09-15T22:23:32.912231+0000","last_clean":"2024-09-15T22:23:32.912231+0000","last_became_active":"2024-09-15T22:22:50.776014+0000","last_became_peered":"2024-09-15T22:22:50.776014+0000","last_unstale":"2024-09-15T22:23:32.912231+0000","last_undegraded":"2024-09-15T22:23:32.912231+0000","last_fullsized":"2024-09-15T22:23:32.912231+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:56.644834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.910944+0000","last_change":"2024-09-15T22:22:48.333019+0000","last_active":"2024-09-15T22:23:32.910944+0000","last_peered":"2024-09-15T22:23:32.910944+0000","last_clean":"2024-09-15T22:23:32.910944+0000","last_became_active":"2024-09-15T22:22:48.332669+0000","last_became_peered":"2024-09-15T22:22:48.332669+0000","last_unstale":"2024-09-15T22:23:32.910944+0000","last_undegraded":"2024-09-15T22:23:32.910944+0000","last_fullsized":"2024-09-15T22:23:32.910944+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:36.415483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:33.380954+0000","last_change":"2024-09-15T22:22:50.774131+0000","last_active":"2024-09-15T22:23:33.380954+0000","last_peered":"2024-09-15T22:23:33.380954+0000","last_clean":"2024-09-15T22:23:33.380954+0000","last_became_active":"2024-09-15T22:22:50.773783+0000","last_became_peered":"2024-09-15T22:22:50.773783+0000","last_unstale":"2024-09-15T22:23:33.380954+0000","last_undegraded":"2024-09-15T22:23:33.380954+0000","last_fullsized":"2024-09-15T22:23:33.380954+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:21:57.459883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.909262+0000","last_change":"2024-09-15T22:22:48.337317+0000","last_active":"2024-09-15T22:23:32.909262+0000","last_peered":"2024-09-15T22:23:32.909262+0000","last_clean":"2024-09-15T22:23:32.909262+0000","last_became_active":"2024-09-15T22:22:48.337004+0000","last_became_peered":"2024-09-15T22:22:48.337004+0000","last_unstale":"2024-09-15T22:23:32.909262+0000","last_undegraded":"2024-09-15T22:23:32.909262+0000","last_fullsized":"2024-09-15T22:23:32.909262+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:09.385389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:33.379922+0000","last_change":"2024-09-15T22:22:50.785360+0000","last_active":"2024-09-15T22:23:33.379922+0000","last_peered":"2024-09-15T22:23:33.379922+0000","last_clean":"2024-09-15T22:23:33.379922+0000","last_became_active":"2024-09-15T22:22:50.785041+0000","last_became_peered":"2024-09-15T22:22:50.785041+0000","last_unstale":"2024-09-15T22:23:33.379922+0000","last_undegraded":"2024-09-15T22:23:33.379922+0000","last_fullsized":"2024-09-15T22:23:33.379922+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:18.173219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.915470+0000","last_change":"2024-09-15T22:22:48.387680+0000","last_active":"2024-09-15T22:23:32.915470+0000","last_peered":"2024-09-15T22:23:32.915470+0000","last_clean":"2024-09-15T22:23:32.915470+0000","last_became_active":"2024-09-15T22:22:48.387345+0000","last_became_peered":"2024-09-15T22:22:48.387345+0000","last_unstale":"2024-09-15T22:23:32.915470+0000","last_undegraded":"2024-09-15T22:23:32.915470+0000","last_fullsized":"2024-09-15T22:23:32.915470+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:01:12.814275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:33.380827+0000","last_change":"2024-09-15T22:22:50.781268+0000","last_active":"2024-09-15T22:23:33.380827+0000","last_peered":"2024-09-15T22:23:33.380827+0000","last_clean":"2024-09-15T22:23:33.380827+0000","last_became_active":"2024-09-15T22:22:50.780949+0000","last_became_peered":"2024-09-15T22:22:50.780949+0000","last_unstale":"2024-09-15T22:23:33.380827+0000","last_undegraded":"2024-09-15T22:23:33.380827+0000","last_fullsized":"2024-09-15T22:23:33.380827+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:55:46.107326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":335,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:33.379873+0000","last_change":"2024-09-15T22:21:33.463741+0000","last_active":"2024-09-15T22:23:33.379873+0000","last_peered":"2024-09-15T22:23:33.379873+0000","last_clean":"2024-09-15T22:23:33.379873+0000","last_became_active":"2024-09-15T22:21:33.463177+0000","last_became_peered":"2024-09-15T22:21:33.463177+0000","last_unstale":"2024-09-15T22:23:33.379873+0000","last_undegraded":"2024-09-15T22:23:33.379873+0000","last_fullsized":"2024-09-15T22:23:33.379873+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:17:56.109541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:17:56.109541+0000","last_clean_scrub_stamp":"2024-09-15T22:17:56.109541+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:43.974077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:33.381328+0000","last_change":"2024-09-15T22:22:48.337556+0000","last_active":"2024-09-15T22:23:33.381328+0000","last_peered":"2024-09-15T22:23:33.381328+0000","last_clean":"2024-09-15T22:23:33.381328+0000","last_became_active":"2024-09-15T22:22:48.337163+0000","last_became_peered":"2024-09-15T22:22:48.337163+0000","last_unstale":"2024-09-15T22:23:33.381328+0000","last_undegraded":"2024-09-15T22:23:33.381328+0000","last_fullsized":"2024-09-15T22:23:33.381328+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:57.087797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.914899+0000","last_change":"2024-09-15T22:22:50.778807+0000","last_active":"2024-09-15T22:23:32.914899+0000","last_peered":"2024-09-15T22:23:32.914899+0000","last_clean":"2024-09-15T22:23:32.914899+0000","last_became_active":"2024-09-15T22:22:50.778515+0000","last_became_peered":"2024-09-15T22:22:50.778515+0000","last_unstale":"2024-09-15T22:23:32.914899+0000","last_undegraded":"2024-09-15T22:23:32.914899+0000","last_fullsized":"2024-09-15T22:23:32.914899+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:15:40.969573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:33.379803+0000","last_change":"2024-09-15T22:22:48.332525+0000","last_active":"2024-09-15T22:23:33.379803+0000","last_peered":"2024-09-15T22:23:33.379803+0000","last_clean":"2024-09-15T22:23:33.379803+0000","last_became_active":"2024-09-15T22:22:48.331615+0000","last_became_peered":"2024-09-15T22:22:48.331615+0000","last_unstale":"2024-09-15T22:23:33.379803+0000","last_undegraded":"2024-09-15T22:23:33.379803+0000","last_fullsized":"2024-09-15T22:23:33.379803+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:47:00.012013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.909867+0000","last_change":"2024-09-15T22:22:50.778422+0000","last_active":"2024-09-15T22:23:32.909867+0000","last_peered":"2024-09-15T22:23:32.909867+0000","last_clean":"2024-09-15T22:23:32.909867+0000","last_became_active":"2024-09-15T22:22:50.777549+0000","last_became_peered":"2024-09-15T22:22:50.777549+0000","last_unstale":"2024-09-15T22:23:32.909867+0000","last_undegraded":"2024-09-15T22:23:32.909867+0000","last_fullsized":"2024-09-15T22:23:32.909867+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:30:03.130474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":87,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:24:03.929645+0000","last_change":"2024-09-15T22:22:48.387992+0000","last_active":"2024-09-15T22:24:03.929645+0000","last_peered":"2024-09-15T22:24:03.929645+0000","last_clean":"2024-09-15T22:24:03.929645+0000","last_became_active":"2024-09-15T22:22:48.386645+0000","last_became_peered":"2024-09-15T22:22:48.386645+0000","last_unstale":"2024-09-15T22:24:03.929645+0000","last_undegraded":"2024-09-15T22:24:03.929645+0000","last_fullsized":"2024-09-15T22:24:03.929645+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:00.893946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.920051+0000","last_change":"2024-09-15T22:23:32.920051+0000","last_active":"2024-09-15T22:23:32.920051+0000","last_peered":"2024-09-15T22:23:32.920051+0000","last_clean":"2024-09-15T22:23:32.920051+0000","last_became_active":"2024-09-15T22:23:32.919659+0000","last_became_peered":"2024-09-15T22:23:32.919659+0000","last_unstale":"2024-09-15T22:23:32.920051+0000","last_undegraded":"2024-09-15T22:23:32.920051+0000","last_fullsized":"2024-09-15T22:23:32.920051+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:33:39.320446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:33.380150+0000","last_change":"2024-09-15T22:22:48.334598+0000","last_active":"2024-09-15T22:23:33.380150+0000","last_peered":"2024-09-15T22:23:33.380150+0000","last_clean":"2024-09-15T22:23:33.380150+0000","last_became_active":"2024-09-15T22:22:48.333022+0000","last_became_peered":"2024-09-15T22:22:48.333022+0000","last_unstale":"2024-09-15T22:23:33.380150+0000","last_undegraded":"2024-09-15T22:23:33.380150+0000","last_fullsized":"2024-09-15T22:23:33.380150+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:28.577791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.909239+0000","last_change":"2024-09-15T22:22:50.777045+0000","last_active":"2024-09-15T22:23:32.909239+0000","last_peered":"2024-09-15T22:23:32.909239+0000","last_clean":"2024-09-15T22:23:32.909239+0000","last_became_active":"2024-09-15T22:22:50.776677+0000","last_became_peered":"2024-09-15T22:22:50.776677+0000","last_unstale":"2024-09-15T22:23:32.909239+0000","last_undegraded":"2024-09-15T22:23:32.909239+0000","last_fullsized":"2024-09-15T22:23:32.909239+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:24.946214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.908558+0000","last_change":"2024-09-15T22:22:48.387707+0000","last_active":"2024-09-15T22:23:32.908558+0000","last_peered":"2024-09-15T22:23:32.908558+0000","last_clean":"2024-09-15T22:23:32.908558+0000","last_became_active":"2024-09-15T22:22:48.387323+0000","last_became_peered":"2024-09-15T22:22:48.387323+0000","last_unstale":"2024-09-15T22:23:32.908558+0000","last_undegraded":"2024-09-15T22:23:32.908558+0000","last_fullsized":"2024-09-15T22:23:32.908558+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:43.430648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.909440+0000","last_change":"2024-09-15T22:22:50.775365+0000","last_active":"2024-09-15T22:23:32.909440+0000","last_peered":"2024-09-15T22:23:32.909440+0000","last_clean":"2024-09-15T22:23:32.909440+0000","last_became_active":"2024-09-15T22:22:50.774988+0000","last_became_peered":"2024-09-15T22:22:50.774988+0000","last_unstale":"2024-09-15T22:23:32.909440+0000","last_undegraded":"2024-09-15T22:23:32.909440+0000","last_fullsized":"2024-09-15T22:23:32.909440+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:32:33.268976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.915445+0000","last_change":"2024-09-15T22:22:48.387142+0000","last_active":"2024-09-15T22:23:32.915445+0000","last_peered":"2024-09-15T22:23:32.915445+0000","last_clean":"2024-09-15T22:23:32.915445+0000","last_became_active":"2024-09-15T22:22:48.386669+0000","last_became_peered":"2024-09-15T22:22:48.386669+0000","last_unstale":"2024-09-15T22:23:32.915445+0000","last_undegraded":"2024-09-15T22:23:32.915445+0000","last_fullsized":"2024-09-15T22:23:32.915445+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:01.590592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.910860+0000","last_change":"2024-09-15T22:22:50.788723+0000","last_active":"2024-09-15T22:23:32.910860+0000","last_peered":"2024-09-15T22:23:32.910860+0000","last_clean":"2024-09-15T22:23:32.910860+0000","last_became_active":"2024-09-15T22:22:50.786767+0000","last_became_peered":"2024-09-15T22:22:50.786767+0000","last_unstale":"2024-09-15T22:23:32.910860+0000","last_undegraded":"2024-09-15T22:23:32.910860+0000","last_fullsized":"2024-09-15T22:23:32.910860+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:10:54.859140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'11","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.908292+0000","last_change":"2024-09-15T22:22:48.329971+0000","last_active":"2024-09-15T22:23:32.908292+0000","last_peered":"2024-09-15T22:23:32.908292+0000","last_clean":"2024-09-15T22:23:32.908292+0000","last_became_active":"2024-09-15T22:22:48.329526+0000","last_became_peered":"2024-09-15T22:22:48.329526+0000","last_unstale":"2024-09-15T22:23:32.908292+0000","last_undegraded":"2024-09-15T22:23:32.908292+0000","last_fullsized":"2024-09-15T22:23:32.908292+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:53.665784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.916078+0000","last_change":"2024-09-15T22:22:50.778281+0000","last_active":"2024-09-15T22:23:32.916078+0000","last_peered":"2024-09-15T22:23:32.916078+0000","last_clean":"2024-09-15T22:23:32.916078+0000","last_became_active":"2024-09-15T22:22:50.777969+0000","last_became_peered":"2024-09-15T22:22:50.777969+0000","last_unstale":"2024-09-15T22:23:32.916078+0000","last_undegraded":"2024-09-15T22:23:32.916078+0000","last_fullsized":"2024-09-15T22:23:32.916078+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:25:04.566350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:33.381523+0000","last_change":"2024-09-15T22:22:48.370056+0000","last_active":"2024-09-15T22:23:33.381523+0000","last_peered":"2024-09-15T22:23:33.381523+0000","last_clean":"2024-09-15T22:23:33.381523+0000","last_became_active":"2024-09-15T22:22:48.369729+0000","last_became_peered":"2024-09-15T22:22:48.369729+0000","last_unstale":"2024-09-15T22:23:33.381523+0000","last_undegraded":"2024-09-15T22:23:33.381523+0000","last_fullsized":"2024-09-15T22:23:33.381523+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:43.894706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.911647+0000","last_change":"2024-09-15T22:22:50.785270+0000","last_active":"2024-09-15T22:23:32.911647+0000","last_peered":"2024-09-15T22:23:32.911647+0000","last_clean":"2024-09-15T22:23:32.911647+0000","last_became_active":"2024-09-15T22:22:50.785035+0000","last_became_peered":"2024-09-15T22:22:50.785035+0000","last_unstale":"2024-09-15T22:23:32.911647+0000","last_undegraded":"2024-09-15T22:23:32.911647+0000","last_fullsized":"2024-09-15T22:23:32.911647+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:58.505722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.911044+0000","last_change":"2024-09-15T22:22:48.387181+0000","last_active":"2024-09-15T22:23:32.911044+0000","last_peered":"2024-09-15T22:23:32.911044+0000","last_clean":"2024-09-15T22:23:32.911044+0000","last_became_active":"2024-09-15T22:22:48.386792+0000","last_became_peered":"2024-09-15T22:22:48.386792+0000","last_unstale":"2024-09-15T22:23:32.911044+0000","last_undegraded":"2024-09-15T22:23:32.911044+0000","last_fullsized":"2024-09-15T22:23:32.911044+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:25.362961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.915199+0000","last_change":"2024-09-15T22:22:50.774054+0000","last_active":"2024-09-15T22:23:32.915199+0000","last_peered":"2024-09-15T22:23:32.915199+0000","last_clean":"2024-09-15T22:23:32.915199+0000","last_became_active":"2024-09-15T22:22:50.773686+0000","last_became_peered":"2024-09-15T22:22:50.773686+0000","last_unstale":"2024-09-15T22:23:32.915199+0000","last_undegraded":"2024-09-15T22:23:32.915199+0000","last_fullsized":"2024-09-15T22:23:32.915199+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:34.512814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.915195+0000","last_change":"2024-09-15T22:22:48.337042+0000","last_active":"2024-09-15T22:23:32.915195+0000","last_peered":"2024-09-15T22:23:32.915195+0000","last_clean":"2024-09-15T22:23:32.915195+0000","last_became_active":"2024-09-15T22:22:48.336648+0000","last_became_peered":"2024-09-15T22:22:48.336648+0000","last_unstale":"2024-09-15T22:23:32.915195+0000","last_undegraded":"2024-09-15T22:23:32.915195+0000","last_fullsized":"2024-09-15T22:23:32.915195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:14:09.777606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.912232+0000","last_change":"2024-09-15T22:22:50.774012+0000","last_active":"2024-09-15T22:23:32.912232+0000","last_peered":"2024-09-15T22:23:32.912232+0000","last_clean":"2024-09-15T22:23:32.912232+0000","last_became_active":"2024-09-15T22:22:50.773442+0000","last_became_peered":"2024-09-15T22:22:50.773442+0000","last_unstale":"2024-09-15T22:23:32.912232+0000","last_undegraded":"2024-09-15T22:23:32.912232+0000","last_fullsized":"2024-09-15T22:23:32.912232+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:29.980429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.921838+0000","last_change":"2024-09-15T22:23:32.921434+0000","last_active":"2024-09-15T22:23:32.921838+0000","last_peered":"2024-09-15T22:23:32.921838+0000","last_clean":"2024-09-15T22:23:32.921838+0000","last_became_active":"2024-09-15T22:23:32.916759+0000","last_became_peered":"2024-09-15T22:23:32.916759+0000","last_unstale":"2024-09-15T22:23:32.921838+0000","last_undegraded":"2024-09-15T22:23:32.921838+0000","last_fullsized":"2024-09-15T22:23:32.921838+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:18:30.691925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.914701+0000","last_change":"2024-09-15T22:22:50.782798+0000","last_active":"2024-09-15T22:23:32.914701+0000","last_peered":"2024-09-15T22:23:32.914701+0000","last_clean":"2024-09-15T22:23:32.914701+0000","last_became_active":"2024-09-15T22:22:50.782316+0000","last_became_peered":"2024-09-15T22:22:50.782316+0000","last_unstale":"2024-09-15T22:23:32.914701+0000","last_undegraded":"2024-09-15T22:23:32.914701+0000","last_fullsized":"2024-09-15T22:23:32.914701+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:35:26.104790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.914745+0000","last_change":"2024-09-15T22:22:48.332485+0000","last_active":"2024-09-15T22:23:32.914745+0000","last_peered":"2024-09-15T22:23:32.914745+0000","last_clean":"2024-09-15T22:23:32.914745+0000","last_became_active":"2024-09-15T22:22:48.332158+0000","last_became_peered":"2024-09-15T22:22:48.332158+0000","last_unstale":"2024-09-15T22:23:32.914745+0000","last_undegraded":"2024-09-15T22:23:32.914745+0000","last_fullsized":"2024-09-15T22:23:32.914745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:20.947915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:33.380055+0000","last_change":"2024-09-15T22:22:50.781961+0000","last_active":"2024-09-15T22:23:33.380055+0000","last_peered":"2024-09-15T22:23:33.380055+0000","last_clean":"2024-09-15T22:23:33.380055+0000","last_became_active":"2024-09-15T22:22:50.781622+0000","last_became_peered":"2024-09-15T22:22:50.781622+0000","last_unstale":"2024-09-15T22:23:33.380055+0000","last_undegraded":"2024-09-15T22:23:33.380055+0000","last_fullsized":"2024-09-15T22:23:33.380055+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:57.848953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:33.382353+0000","last_change":"2024-09-15T22:23:33.382353+0000","last_active":"2024-09-15T22:23:33.382353+0000","last_peered":"2024-09-15T22:23:33.382353+0000","last_clean":"2024-09-15T22:23:33.382353+0000","last_became_active":"2024-09-15T22:23:33.381784+0000","last_became_peered":"2024-09-15T22:23:33.381784+0000","last_unstale":"2024-09-15T22:23:33.382353+0000","last_undegraded":"2024-09-15T22:23:33.382353+0000","last_fullsized":"2024-09-15T22:23:33.382353+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:15:06.829850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.915379+0000","last_change":"2024-09-15T22:22:48.329098+0000","last_active":"2024-09-15T22:23:32.915379+0000","last_peered":"2024-09-15T22:23:32.915379+0000","last_clean":"2024-09-15T22:23:32.915379+0000","last_became_active":"2024-09-15T22:22:48.328755+0000","last_became_peered":"2024-09-15T22:22:48.328755+0000","last_unstale":"2024-09-15T22:23:32.915379+0000","last_undegraded":"2024-09-15T22:23:32.915379+0000","last_fullsized":"2024-09-15T22:23:32.915379+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:31.197422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.911163+0000","last_change":"2024-09-15T22:22:50.778437+0000","last_active":"2024-09-15T22:23:32.911163+0000","last_peered":"2024-09-15T22:23:32.911163+0000","last_clean":"2024-09-15T22:23:32.911163+0000","last_became_active":"2024-09-15T22:22:50.776847+0000","last_became_peered":"2024-09-15T22:22:50.776847+0000","last_unstale":"2024-09-15T22:23:32.911163+0000","last_undegraded":"2024-09-15T22:23:32.911163+0000","last_fullsized":"2024-09-15T22:23:32.911163+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:56.740028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.915308+0000","last_change":"2024-09-15T22:22:48.331965+0000","last_active":"2024-09-15T22:23:32.915308+0000","last_peered":"2024-09-15T22:23:32.915308+0000","last_clean":"2024-09-15T22:23:32.915308+0000","last_became_active":"2024-09-15T22:22:48.331652+0000","last_became_peered":"2024-09-15T22:22:48.331652+0000","last_unstale":"2024-09-15T22:23:32.915308+0000","last_undegraded":"2024-09-15T22:23:32.915308+0000","last_fullsized":"2024-09-15T22:23:32.915308+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:39.232097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.911834+0000","last_change":"2024-09-15T22:22:50.778091+0000","last_active":"2024-09-15T22:23:32.911834+0000","last_peered":"2024-09-15T22:23:32.911834+0000","last_clean":"2024-09-15T22:23:32.911834+0000","last_became_active":"2024-09-15T22:22:50.777782+0000","last_became_peered":"2024-09-15T22:22:50.777782+0000","last_unstale":"2024-09-15T22:23:32.911834+0000","last_undegraded":"2024-09-15T22:23:32.911834+0000","last_fullsized":"2024-09-15T22:23:32.911834+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:14:30.221629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.915875+0000","last_change":"2024-09-15T22:22:48.387133+0000","last_active":"2024-09-15T22:23:32.915875+0000","last_peered":"2024-09-15T22:23:32.915875+0000","last_clean":"2024-09-15T22:23:32.915875+0000","last_became_active":"2024-09-15T22:22:48.386796+0000","last_became_peered":"2024-09-15T22:22:48.386796+0000","last_unstale":"2024-09-15T22:23:32.915875+0000","last_undegraded":"2024-09-15T22:23:32.915875+0000","last_fullsized":"2024-09-15T22:23:32.915875+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:18:24.267326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.915604+0000","last_change":"2024-09-15T22:22:50.780869+0000","last_active":"2024-09-15T22:23:32.915604+0000","last_peered":"2024-09-15T22:23:32.915604+0000","last_clean":"2024-09-15T22:23:32.915604+0000","last_became_active":"2024-09-15T22:22:50.780411+0000","last_became_peered":"2024-09-15T22:22:50.780411+0000","last_unstale":"2024-09-15T22:23:32.915604+0000","last_undegraded":"2024-09-15T22:23:32.915604+0000","last_fullsized":"2024-09-15T22:23:32.915604+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:38:05.410234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.908231+0000","last_change":"2024-09-15T22:22:48.332789+0000","last_active":"2024-09-15T22:23:32.908231+0000","last_peered":"2024-09-15T22:23:32.908231+0000","last_clean":"2024-09-15T22:23:32.908231+0000","last_became_active":"2024-09-15T22:22:48.332165+0000","last_became_peered":"2024-09-15T22:22:48.332165+0000","last_unstale":"2024-09-15T22:23:32.908231+0000","last_undegraded":"2024-09-15T22:23:32.908231+0000","last_fullsized":"2024-09-15T22:23:32.908231+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:44:07.190316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":392,"num_read_kb":262,"num_write":165,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":192480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514525,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":440711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743458,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1613824,"data_stored":1092237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906983,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":933888,"data_stored":440835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135918,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":925696,"data_stored":440643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364849,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32684,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712468,"statfs":{"total":95995035648,"available":95961567232,"internally_reserved":0,"allocated":1527808,"data_stored":1033080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528374,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":921600,"data_stored":440224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757309,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28536,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716616,"statfs":{"total":95995035648,"available":95965814784,"internally_reserved":0,"allocated":1540096,"data_stored":1032371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920834,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":933888,"data_stored":441166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149766,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36268,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708884,"statfs":{"total":95995035648,"available":95957897216,"internally_reserved":0,"allocated":937984,"data_stored":440535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411405,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":999424,"data_stored":501412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":983040,"data_stored":499781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":441495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":61395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:24:10.061 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T22:24:10.440 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:10.609 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:10 smithi001 ceph-mon[30843]: from='client.24862 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:24:10.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:10 smithi012 ceph-mon[34883]: from='client.24862 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:24:10.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:10 smithi098 ceph-mon[35514]: from='client.24862 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:24:11.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.010+0000 7f3b01600640 1 -- 172.21.15.1:0/4022621762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3afc1047e0 msgr2=0x7f3afc108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:11.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.010+0000 7f3b01600640 1 --2- 172.21.15.1:0/4022621762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3afc1047e0 0x7f3afc108830 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4009900 tx=0x7f3ae402a400 comp rx=0 tx=0).stop 2024-09-15T22:24:11.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.010+0000 7f3b01600640 1 -- 172.21.15.1:0/4022621762 shutdown_connections 2024-09-15T22:24:11.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.010+0000 7f3b01600640 1 --2- 172.21.15.1:0/4022621762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3afc108f60 0x7f3afc110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:11.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.010+0000 7f3b01600640 1 --2- 172.21.15.1:0/4022621762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3afc1047e0 0x7f3afc108830 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:11.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.010+0000 7f3b01600640 1 --2- 172.21.15.1:0/4022621762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3afc103e30 0x7f3afc104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:11.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.010+0000 7f3b01600640 1 -- 172.21.15.1:0/4022621762 >> 172.21.15.1:0/4022621762 conn(0x7f3afc0ff910 msgr2=0x7f3afc101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:11.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.010+0000 7f3b01600640 1 -- 172.21.15.1:0/4022621762 shutdown_connections 2024-09-15T22:24:11.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.010+0000 7f3b01600640 1 -- 172.21.15.1:0/4022621762 wait complete. 2024-09-15T22:24:11.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.011+0000 7f3b01600640 1 Processor -- start 2024-09-15T22:24:11.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.011+0000 7f3b01600640 1 -- start start 2024-09-15T22:24:11.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.011+0000 7f3b01600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3afc103e30 0x7f3afc19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:11.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.011+0000 7f3b01600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3afc1047e0 0x7f3afc19a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:11.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.011+0000 7f3b01600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3afc108f60 0x7f3afc19ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:11.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.011+0000 7f3b01600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3afc113fc0 con 0x7f3afc103e30 2024-09-15T22:24:11.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.011+0000 7f3b01600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3afc113e40 con 0x7f3afc1047e0 2024-09-15T22:24:11.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.011+0000 7f3b01600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3afc114140 con 0x7f3afc108f60 2024-09-15T22:24:11.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.011+0000 7f3afbe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3afc103e30 0x7f3afc19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:11.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.011+0000 7f3af3400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3afc1047e0 0x7f3afc19a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:11.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.011+0000 7f3af3400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3afc1047e0 0x7f3afc19a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:59868/0 (socket says 172.21.15.1:59868) 2024-09-15T22:24:11.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.011+0000 7f3afbe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3afc103e30 0x7f3afc19a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58174/0 (socket says 172.21.15.1:58174) 2024-09-15T22:24:11.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.011+0000 7f3af3400640 1 -- 172.21.15.1:0/1025420019 learned_addr learned my addr 172.21.15.1:0/1025420019 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:11.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.011+0000 7f3b00c00640 1 --2- 172.21.15.1:0/1025420019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3afc108f60 0x7f3afc19ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:11.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.012+0000 7f3afbe00640 1 -- 172.21.15.1:0/1025420019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3afc108f60 msgr2=0x7f3afc19ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:11.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.012+0000 7f3afbe00640 1 --2- 172.21.15.1:0/1025420019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3afc108f60 0x7f3afc19ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:11.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.012+0000 7f3afbe00640 1 -- 172.21.15.1:0/1025420019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3afc1047e0 msgr2=0x7f3afc19a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:11.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.012+0000 7f3afbe00640 1 --2- 172.21.15.1:0/1025420019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3afc1047e0 0x7f3afc19a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:11.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.012+0000 7f3afbe00640 1 -- 172.21.15.1:0/1025420019 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3afc19f430 con 0x7f3afc103e30 2024-09-15T22:24:11.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.012+0000 7f3afbe00640 1 --2- 172.21.15.1:0/1025420019 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3afc103e30 0x7f3afc19a480 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3aec00d6d0 tx=0x7f3aec00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:11.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.013+0000 7f3af9600640 1 -- 172.21.15.1:0/1025420019 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aec017070 con 0x7f3afc103e30 2024-09-15T22:24:11.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.013+0000 7f3af9600640 1 -- 172.21.15.1:0/1025420019 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3aec009820 con 0x7f3afc103e30 2024-09-15T22:24:11.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.013+0000 7f3af9600640 1 -- 172.21.15.1:0/1025420019 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aec004d00 con 0x7f3afc103e30 2024-09-15T22:24:11.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.013+0000 7f3b01600640 1 -- 172.21.15.1:0/1025420019 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3afc19f720 con 0x7f3afc103e30 2024-09-15T22:24:11.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.013+0000 7f3b01600640 1 -- 172.21.15.1:0/1025420019 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3afc1a7000 con 0x7f3afc103e30 2024-09-15T22:24:11.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.014+0000 7f3b01600640 1 -- 172.21.15.1:0/1025420019 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3afc105310 con 0x7f3afc103e30 2024-09-15T22:24:11.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.016+0000 7f3af9600640 1 -- 172.21.15.1:0/1025420019 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f3aec0099d0 con 0x7f3afc103e30 2024-09-15T22:24:11.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.017+0000 7f3af9600640 1 --2- 172.21.15.1:0/1025420019 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3ae00a3350 0x7f3ae00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:11.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.017+0000 7f3af9600640 1 -- 172.21.15.1:0/1025420019 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f3aec0cf590 con 0x7f3afc103e30 2024-09-15T22:24:11.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.018+0000 7f3af3400640 1 --2- 172.21.15.1:0/1025420019 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3ae00a3350 0x7f3ae00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:11.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.018+0000 7f3af3400640 1 --2- 172.21.15.1:0/1025420019 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3ae00a3350 0x7f3ae00a5810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4031550 tx=0x7f3ae4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:11.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.022+0000 7f3af9600640 1 -- 172.21.15.1:0/1025420019 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3aec09ba90 con 0x7f3afc103e30 2024-09-15T22:24:11.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.202+0000 7f3b01600640 1 -- 172.21.15.1:0/1025420019 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3afc062630 con 0x7f3ae00a3350 2024-09-15T22:24:11.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.208+0000 7f3af9600640 1 -- 172.21.15.1:0/1025420019 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258716 (secure 0 0 0) 0x7f3afc062630 con 0x7f3ae00a3350 2024-09-15T22:24:11.212 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:24:11.213 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-15T22:24:11.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.213+0000 7f3b01600640 1 -- 172.21.15.1:0/1025420019 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3ae00a3350 msgr2=0x7f3ae00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:11.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.213+0000 7f3b01600640 1 --2- 172.21.15.1:0/1025420019 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3ae00a3350 0x7f3ae00a5810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4031550 tx=0x7f3ae4005a20 comp rx=0 tx=0).stop 2024-09-15T22:24:11.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.213+0000 7f3b01600640 1 -- 172.21.15.1:0/1025420019 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3afc103e30 msgr2=0x7f3afc19a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:11.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.213+0000 7f3b01600640 1 --2- 172.21.15.1:0/1025420019 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3afc103e30 0x7f3afc19a480 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3aec00d6d0 tx=0x7f3aec00db90 comp rx=0 tx=0).stop 2024-09-15T22:24:11.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.213+0000 7f3b01600640 1 -- 172.21.15.1:0/1025420019 shutdown_connections 2024-09-15T22:24:11.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.213+0000 7f3b01600640 1 --2- 172.21.15.1:0/1025420019 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3ae00a3350 0x7f3ae00a5810 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:11.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.213+0000 7f3b01600640 1 --2- 172.21.15.1:0/1025420019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3afc108f60 0x7f3afc19ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:11.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.213+0000 7f3b01600640 1 --2- 172.21.15.1:0/1025420019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3afc1047e0 0x7f3afc19a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:11.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.213+0000 7f3b01600640 1 --2- 172.21.15.1:0/1025420019 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3afc103e30 0x7f3afc19a480 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:11.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.213+0000 7f3b01600640 1 -- 172.21.15.1:0/1025420019 >> 172.21.15.1:0/1025420019 conn(0x7f3afc0ff910 msgr2=0x7f3afc100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:11.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.213+0000 7f3b01600640 1 -- 172.21.15.1:0/1025420019 shutdown_connections 2024-09-15T22:24:11.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:11.213+0000 7f3b01600640 1 -- 172.21.15.1:0/1025420019 wait complete. 2024-09-15T22:24:11.607 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:11 smithi001 ceph-mon[30843]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-15T22:24:11.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:11 smithi012 ceph-mon[34883]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-15T22:24:11.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:11 smithi098 ceph-mon[35514]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-15T22:24:12.055 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":333,"stamp":"2024-09-15T22:24:09.542437+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654762,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":533,"num_read_kb":381,"num_write":348,"num_write_kb":3051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":279,"ondisk_log_size":279,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":358024,"kb_used_data":12876,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124583800,"statfs":{"total":1151940427776,"available":1151573811200,"internally_reserved":0,"allocated":13185024,"data_stored":7244490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":353154361},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002693"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.912577+0000","last_change":"2024-09-15T22:22:50.777000+0000","last_active":"2024-09-15T22:23:32.912577+0000","last_peered":"2024-09-15T22:23:32.912577+0000","last_clean":"2024-09-15T22:23:32.912577+0000","last_became_active":"2024-09-15T22:22:50.776448+0000","last_became_peered":"2024-09-15T22:22:50.776448+0000","last_unstale":"2024-09-15T22:23:32.912577+0000","last_undegraded":"2024-09-15T22:23:32.912577+0000","last_fullsized":"2024-09-15T22:23:32.912577+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:20:09.218864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.911702+0000","last_change":"2024-09-15T22:22:50.772294+0000","last_active":"2024-09-15T22:23:32.911702+0000","last_peered":"2024-09-15T22:23:32.911702+0000","last_clean":"2024-09-15T22:23:32.911702+0000","last_became_active":"2024-09-15T22:22:50.771993+0000","last_became_peered":"2024-09-15T22:22:50.771993+0000","last_unstale":"2024-09-15T22:23:32.911702+0000","last_undegraded":"2024-09-15T22:23:32.911702+0000","last_fullsized":"2024-09-15T22:23:32.911702+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:23.770489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.912020+0000","last_change":"2024-09-15T22:22:50.775717+0000","last_active":"2024-09-15T22:23:32.912020+0000","last_peered":"2024-09-15T22:23:32.912020+0000","last_clean":"2024-09-15T22:23:32.912020+0000","last_became_active":"2024-09-15T22:22:50.775405+0000","last_became_peered":"2024-09-15T22:22:50.775405+0000","last_unstale":"2024-09-15T22:23:32.912020+0000","last_undegraded":"2024-09-15T22:23:32.912020+0000","last_fullsized":"2024-09-15T22:23:32.912020+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:28.765207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:33.381329+0000","last_change":"2024-09-15T22:22:50.786473+0000","last_active":"2024-09-15T22:23:33.381329+0000","last_peered":"2024-09-15T22:23:33.381329+0000","last_clean":"2024-09-15T22:23:33.381329+0000","last_became_active":"2024-09-15T22:22:50.786001+0000","last_became_peered":"2024-09-15T22:22:50.786001+0000","last_unstale":"2024-09-15T22:23:33.381329+0000","last_undegraded":"2024-09-15T22:23:33.381329+0000","last_fullsized":"2024-09-15T22:23:33.381329+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:47.378713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.914623+0000","last_change":"2024-09-15T22:22:50.777784+0000","last_active":"2024-09-15T22:23:32.914623+0000","last_peered":"2024-09-15T22:23:32.914623+0000","last_clean":"2024-09-15T22:23:32.914623+0000","last_became_active":"2024-09-15T22:22:50.777457+0000","last_became_peered":"2024-09-15T22:22:50.777457+0000","last_unstale":"2024-09-15T22:23:32.914623+0000","last_undegraded":"2024-09-15T22:23:32.914623+0000","last_fullsized":"2024-09-15T22:23:32.914623+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:25.106526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.909050+0000","last_change":"2024-09-15T22:22:50.773565+0000","last_active":"2024-09-15T22:23:32.909050+0000","last_peered":"2024-09-15T22:23:32.909050+0000","last_clean":"2024-09-15T22:23:32.909050+0000","last_became_active":"2024-09-15T22:22:50.773208+0000","last_became_peered":"2024-09-15T22:22:50.773208+0000","last_unstale":"2024-09-15T22:23:32.909050+0000","last_undegraded":"2024-09-15T22:23:32.909050+0000","last_fullsized":"2024-09-15T22:23:32.909050+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:07:43.996923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:33.380014+0000","last_change":"2024-09-15T22:22:50.779699+0000","last_active":"2024-09-15T22:23:33.380014+0000","last_peered":"2024-09-15T22:23:33.380014+0000","last_clean":"2024-09-15T22:23:33.380014+0000","last_became_active":"2024-09-15T22:22:50.779290+0000","last_became_peered":"2024-09-15T22:22:50.779290+0000","last_unstale":"2024-09-15T22:23:33.380014+0000","last_undegraded":"2024-09-15T22:23:33.380014+0000","last_fullsized":"2024-09-15T22:23:33.380014+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:41:21.741094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.914820+0000","last_change":"2024-09-15T22:22:50.786051+0000","last_active":"2024-09-15T22:23:32.914820+0000","last_peered":"2024-09-15T22:23:32.914820+0000","last_clean":"2024-09-15T22:23:32.914820+0000","last_became_active":"2024-09-15T22:22:50.785767+0000","last_became_peered":"2024-09-15T22:22:50.785767+0000","last_unstale":"2024-09-15T22:23:32.914820+0000","last_undegraded":"2024-09-15T22:23:32.914820+0000","last_fullsized":"2024-09-15T22:23:32.914820+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:23:09.849960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.914311+0000","last_change":"2024-09-15T22:23:32.914311+0000","last_active":"2024-09-15T22:23:32.914311+0000","last_peered":"2024-09-15T22:23:32.914311+0000","last_clean":"2024-09-15T22:23:32.914311+0000","last_became_active":"2024-09-15T22:23:32.913818+0000","last_became_peered":"2024-09-15T22:23:32.913818+0000","last_unstale":"2024-09-15T22:23:32.914311+0000","last_undegraded":"2024-09-15T22:23:32.914311+0000","last_fullsized":"2024-09-15T22:23:32.914311+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:10:11.932664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,11],"acting":[1,6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.909859+0000","last_change":"2024-09-15T22:22:50.776481+0000","last_active":"2024-09-15T22:23:32.909859+0000","last_peered":"2024-09-15T22:23:32.909859+0000","last_clean":"2024-09-15T22:23:32.909859+0000","last_became_active":"2024-09-15T22:22:50.775915+0000","last_became_peered":"2024-09-15T22:22:50.775915+0000","last_unstale":"2024-09-15T22:23:32.909859+0000","last_undegraded":"2024-09-15T22:23:32.909859+0000","last_fullsized":"2024-09-15T22:23:32.909859+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:35.923867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:33.380707+0000","last_change":"2024-09-15T22:22:50.777986+0000","last_active":"2024-09-15T22:23:33.380707+0000","last_peered":"2024-09-15T22:23:33.380707+0000","last_clean":"2024-09-15T22:23:33.380707+0000","last_became_active":"2024-09-15T22:22:50.777624+0000","last_became_peered":"2024-09-15T22:22:50.777624+0000","last_unstale":"2024-09-15T22:23:33.380707+0000","last_undegraded":"2024-09-15T22:23:33.380707+0000","last_fullsized":"2024-09-15T22:23:33.380707+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:07.135073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.918811+0000","last_change":"2024-09-15T22:23:32.918035+0000","last_active":"2024-09-15T22:23:32.918811+0000","last_peered":"2024-09-15T22:23:32.918811+0000","last_clean":"2024-09-15T22:23:32.918811+0000","last_became_active":"2024-09-15T22:23:32.917216+0000","last_became_peered":"2024-09-15T22:23:32.917216+0000","last_unstale":"2024-09-15T22:23:32.918811+0000","last_undegraded":"2024-09-15T22:23:32.918811+0000","last_fullsized":"2024-09-15T22:23:32.918811+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:09:39.680400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.910430+0000","last_change":"2024-09-15T22:22:50.778817+0000","last_active":"2024-09-15T22:23:32.910430+0000","last_peered":"2024-09-15T22:23:32.910430+0000","last_clean":"2024-09-15T22:23:32.910430+0000","last_became_active":"2024-09-15T22:22:50.776127+0000","last_became_peered":"2024-09-15T22:22:50.776127+0000","last_unstale":"2024-09-15T22:23:32.910430+0000","last_undegraded":"2024-09-15T22:23:32.910430+0000","last_fullsized":"2024-09-15T22:23:32.910430+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:19.233333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.911588+0000","last_change":"2024-09-15T22:22:50.771502+0000","last_active":"2024-09-15T22:23:32.911588+0000","last_peered":"2024-09-15T22:23:32.911588+0000","last_clean":"2024-09-15T22:23:32.911588+0000","last_became_active":"2024-09-15T22:22:50.771201+0000","last_became_peered":"2024-09-15T22:22:50.771201+0000","last_unstale":"2024-09-15T22:23:32.911588+0000","last_undegraded":"2024-09-15T22:23:32.911588+0000","last_fullsized":"2024-09-15T22:23:32.911588+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:24:34.668603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.911575+0000","last_change":"2024-09-15T22:22:50.776677+0000","last_active":"2024-09-15T22:23:32.911575+0000","last_peered":"2024-09-15T22:23:32.911575+0000","last_clean":"2024-09-15T22:23:32.911575+0000","last_became_active":"2024-09-15T22:22:50.774861+0000","last_became_peered":"2024-09-15T22:22:50.774861+0000","last_unstale":"2024-09-15T22:23:32.911575+0000","last_undegraded":"2024-09-15T22:23:32.911575+0000","last_fullsized":"2024-09-15T22:23:32.911575+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:25:00.652606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.910913+0000","last_change":"2024-09-15T22:22:50.784162+0000","last_active":"2024-09-15T22:23:32.910913+0000","last_peered":"2024-09-15T22:23:32.910913+0000","last_clean":"2024-09-15T22:23:32.910913+0000","last_became_active":"2024-09-15T22:22:50.783782+0000","last_became_peered":"2024-09-15T22:22:50.783782+0000","last_unstale":"2024-09-15T22:23:32.910913+0000","last_undegraded":"2024-09-15T22:23:32.910913+0000","last_fullsized":"2024-09-15T22:23:32.910913+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:36:22.785321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.912776+0000","last_change":"2024-09-15T22:22:50.775360+0000","last_active":"2024-09-15T22:23:32.912776+0000","last_peered":"2024-09-15T22:23:32.912776+0000","last_clean":"2024-09-15T22:23:32.912776+0000","last_became_active":"2024-09-15T22:22:50.775075+0000","last_became_peered":"2024-09-15T22:22:50.775075+0000","last_unstale":"2024-09-15T22:23:32.912776+0000","last_undegraded":"2024-09-15T22:23:32.912776+0000","last_fullsized":"2024-09-15T22:23:32.912776+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:25:42.484125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.908137+0000","last_change":"2024-09-15T22:22:50.772497+0000","last_active":"2024-09-15T22:23:32.908137+0000","last_peered":"2024-09-15T22:23:32.908137+0000","last_clean":"2024-09-15T22:23:32.908137+0000","last_became_active":"2024-09-15T22:22:50.770061+0000","last_became_peered":"2024-09-15T22:22:50.770061+0000","last_unstale":"2024-09-15T22:23:32.908137+0000","last_undegraded":"2024-09-15T22:23:32.908137+0000","last_fullsized":"2024-09-15T22:23:32.908137+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:23.420138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.915745+0000","last_change":"2024-09-15T22:22:50.788026+0000","last_active":"2024-09-15T22:23:32.915745+0000","last_peered":"2024-09-15T22:23:32.915745+0000","last_clean":"2024-09-15T22:23:32.915745+0000","last_became_active":"2024-09-15T22:22:50.787247+0000","last_became_peered":"2024-09-15T22:22:50.787247+0000","last_unstale":"2024-09-15T22:23:32.915745+0000","last_undegraded":"2024-09-15T22:23:32.915745+0000","last_fullsized":"2024-09-15T22:23:32.915745+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:52:48.408625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.911788+0000","last_change":"2024-09-15T22:22:50.777295+0000","last_active":"2024-09-15T22:23:32.911788+0000","last_peered":"2024-09-15T22:23:32.911788+0000","last_clean":"2024-09-15T22:23:32.911788+0000","last_became_active":"2024-09-15T22:22:50.776957+0000","last_became_peered":"2024-09-15T22:22:50.776957+0000","last_unstale":"2024-09-15T22:23:32.911788+0000","last_undegraded":"2024-09-15T22:23:32.911788+0000","last_fullsized":"2024-09-15T22:23:32.911788+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:50:45.858031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.910527+0000","last_change":"2024-09-15T22:22:50.778773+0000","last_active":"2024-09-15T22:23:32.910527+0000","last_peered":"2024-09-15T22:23:32.910527+0000","last_clean":"2024-09-15T22:23:32.910527+0000","last_became_active":"2024-09-15T22:22:50.778346+0000","last_became_peered":"2024-09-15T22:22:50.778346+0000","last_unstale":"2024-09-15T22:23:32.910527+0000","last_undegraded":"2024-09-15T22:23:32.910527+0000","last_fullsized":"2024-09-15T22:23:32.910527+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:21:11.785059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.911276+0000","last_change":"2024-09-15T22:22:50.776172+0000","last_active":"2024-09-15T22:23:32.911276+0000","last_peered":"2024-09-15T22:23:32.911276+0000","last_clean":"2024-09-15T22:23:32.911276+0000","last_became_active":"2024-09-15T22:22:50.775838+0000","last_became_peered":"2024-09-15T22:22:50.775838+0000","last_unstale":"2024-09-15T22:23:32.911276+0000","last_undegraded":"2024-09-15T22:23:32.911276+0000","last_fullsized":"2024-09-15T22:23:32.911276+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:16:35.834565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.920056+0000","last_change":"2024-09-15T22:23:32.919723+0000","last_active":"2024-09-15T22:23:32.920056+0000","last_peered":"2024-09-15T22:23:32.920056+0000","last_clean":"2024-09-15T22:23:32.920056+0000","last_became_active":"2024-09-15T22:23:32.919492+0000","last_became_peered":"2024-09-15T22:23:32.919492+0000","last_unstale":"2024-09-15T22:23:32.920056+0000","last_undegraded":"2024-09-15T22:23:32.920056+0000","last_fullsized":"2024-09-15T22:23:32.920056+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:23.554364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.918531+0000","last_change":"2024-09-15T22:23:32.917066+0000","last_active":"2024-09-15T22:23:32.918531+0000","last_peered":"2024-09-15T22:23:32.918531+0000","last_clean":"2024-09-15T22:23:32.918531+0000","last_became_active":"2024-09-15T22:23:32.916602+0000","last_became_peered":"2024-09-15T22:23:32.916602+0000","last_unstale":"2024-09-15T22:23:32.918531+0000","last_undegraded":"2024-09-15T22:23:32.918531+0000","last_fullsized":"2024-09-15T22:23:32.918531+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:54.809986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,3],"acting":[6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.915990+0000","last_change":"2024-09-15T22:22:50.782833+0000","last_active":"2024-09-15T22:23:32.915990+0000","last_peered":"2024-09-15T22:23:32.915990+0000","last_clean":"2024-09-15T22:23:32.915990+0000","last_became_active":"2024-09-15T22:22:50.782450+0000","last_became_peered":"2024-09-15T22:22:50.782450+0000","last_unstale":"2024-09-15T22:23:32.915990+0000","last_undegraded":"2024-09-15T22:23:32.915990+0000","last_fullsized":"2024-09-15T22:23:32.915990+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:32:07.931321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.916232+0000","last_change":"2024-09-15T22:22:50.784199+0000","last_active":"2024-09-15T22:23:32.916232+0000","last_peered":"2024-09-15T22:23:32.916232+0000","last_clean":"2024-09-15T22:23:32.916232+0000","last_became_active":"2024-09-15T22:22:50.783858+0000","last_became_peered":"2024-09-15T22:22:50.783858+0000","last_unstale":"2024-09-15T22:23:32.916232+0000","last_undegraded":"2024-09-15T22:23:32.916232+0000","last_fullsized":"2024-09-15T22:23:32.916232+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:40:01.271188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.912236+0000","last_change":"2024-09-15T22:22:50.772094+0000","last_active":"2024-09-15T22:23:32.912236+0000","last_peered":"2024-09-15T22:23:32.912236+0000","last_clean":"2024-09-15T22:23:32.912236+0000","last_became_active":"2024-09-15T22:22:50.771633+0000","last_became_peered":"2024-09-15T22:22:50.771633+0000","last_unstale":"2024-09-15T22:23:32.912236+0000","last_undegraded":"2024-09-15T22:23:32.912236+0000","last_fullsized":"2024-09-15T22:23:32.912236+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:06:46.194573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.910763+0000","last_change":"2024-09-15T22:22:50.781069+0000","last_active":"2024-09-15T22:23:32.910763+0000","last_peered":"2024-09-15T22:23:32.910763+0000","last_clean":"2024-09-15T22:23:32.910763+0000","last_became_active":"2024-09-15T22:22:50.780742+0000","last_became_peered":"2024-09-15T22:22:50.780742+0000","last_unstale":"2024-09-15T22:23:32.910763+0000","last_undegraded":"2024-09-15T22:23:32.910763+0000","last_fullsized":"2024-09-15T22:23:32.910763+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:21:05.323542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.911853+0000","last_change":"2024-09-15T22:22:50.776252+0000","last_active":"2024-09-15T22:23:32.911853+0000","last_peered":"2024-09-15T22:23:32.911853+0000","last_clean":"2024-09-15T22:23:32.911853+0000","last_became_active":"2024-09-15T22:22:50.775911+0000","last_became_peered":"2024-09-15T22:22:50.775911+0000","last_unstale":"2024-09-15T22:23:32.911853+0000","last_undegraded":"2024-09-15T22:23:32.911853+0000","last_fullsized":"2024-09-15T22:23:32.911853+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:01:43.836637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.918290+0000","last_change":"2024-09-15T22:22:50.775992+0000","last_active":"2024-09-15T22:23:32.918290+0000","last_peered":"2024-09-15T22:23:32.918290+0000","last_clean":"2024-09-15T22:23:32.918290+0000","last_became_active":"2024-09-15T22:22:50.775619+0000","last_became_peered":"2024-09-15T22:22:50.775619+0000","last_unstale":"2024-09-15T22:23:32.918290+0000","last_undegraded":"2024-09-15T22:23:32.918290+0000","last_fullsized":"2024-09-15T22:23:32.918290+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:57.623706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.917013+0000","last_change":"2024-09-15T22:22:50.786376+0000","last_active":"2024-09-15T22:23:32.917013+0000","last_peered":"2024-09-15T22:23:32.917013+0000","last_clean":"2024-09-15T22:23:32.917013+0000","last_became_active":"2024-09-15T22:22:50.786011+0000","last_became_peered":"2024-09-15T22:22:50.786011+0000","last_unstale":"2024-09-15T22:23:32.917013+0000","last_undegraded":"2024-09-15T22:23:32.917013+0000","last_fullsized":"2024-09-15T22:23:32.917013+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:54.492349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.911793+0000","last_change":"2024-09-15T22:22:50.777114+0000","last_active":"2024-09-15T22:23:32.911793+0000","last_peered":"2024-09-15T22:23:32.911793+0000","last_clean":"2024-09-15T22:23:32.911793+0000","last_became_active":"2024-09-15T22:22:50.776756+0000","last_became_peered":"2024-09-15T22:22:50.776756+0000","last_unstale":"2024-09-15T22:23:32.911793+0000","last_undegraded":"2024-09-15T22:23:32.911793+0000","last_fullsized":"2024-09-15T22:23:32.911793+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:51.220074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.915085+0000","last_change":"2024-09-15T22:22:50.777228+0000","last_active":"2024-09-15T22:23:32.915085+0000","last_peered":"2024-09-15T22:23:32.915085+0000","last_clean":"2024-09-15T22:23:32.915085+0000","last_became_active":"2024-09-15T22:22:50.776926+0000","last_became_peered":"2024-09-15T22:22:50.776926+0000","last_unstale":"2024-09-15T22:23:32.915085+0000","last_undegraded":"2024-09-15T22:23:32.915085+0000","last_fullsized":"2024-09-15T22:23:32.915085+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:28:20.346803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":92,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:24:03.929198+0000","last_change":"2024-09-15T22:22:48.333147+0000","last_active":"2024-09-15T22:24:03.929198+0000","last_peered":"2024-09-15T22:24:03.929198+0000","last_clean":"2024-09-15T22:24:03.929198+0000","last_became_active":"2024-09-15T22:22:48.332862+0000","last_became_peered":"2024-09-15T22:22:48.332862+0000","last_unstale":"2024-09-15T22:24:03.929198+0000","last_undegraded":"2024-09-15T22:24:03.929198+0000","last_fullsized":"2024-09-15T22:24:03.929198+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:18:25.043411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.909216+0000","last_change":"2024-09-15T22:22:50.787593+0000","last_active":"2024-09-15T22:23:32.909216+0000","last_peered":"2024-09-15T22:23:32.909216+0000","last_clean":"2024-09-15T22:23:32.909216+0000","last_became_active":"2024-09-15T22:22:50.787262+0000","last_became_peered":"2024-09-15T22:22:50.787262+0000","last_unstale":"2024-09-15T22:23:32.909216+0000","last_undegraded":"2024-09-15T22:23:32.909216+0000","last_fullsized":"2024-09-15T22:23:32.909216+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:40:40.529295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.909048+0000","last_change":"2024-09-15T22:22:48.333060+0000","last_active":"2024-09-15T22:23:32.909048+0000","last_peered":"2024-09-15T22:23:32.909048+0000","last_clean":"2024-09-15T22:23:32.909048+0000","last_became_active":"2024-09-15T22:22:48.332713+0000","last_became_peered":"2024-09-15T22:22:48.332713+0000","last_unstale":"2024-09-15T22:23:32.909048+0000","last_undegraded":"2024-09-15T22:23:32.909048+0000","last_fullsized":"2024-09-15T22:23:32.909048+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:44.664497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.909929+0000","last_change":"2024-09-15T22:22:48.335104+0000","last_active":"2024-09-15T22:23:32.909929+0000","last_peered":"2024-09-15T22:23:32.909929+0000","last_clean":"2024-09-15T22:23:32.909929+0000","last_became_active":"2024-09-15T22:22:48.334276+0000","last_became_peered":"2024-09-15T22:22:48.334276+0000","last_unstale":"2024-09-15T22:23:32.909929+0000","last_undegraded":"2024-09-15T22:23:32.909929+0000","last_fullsized":"2024-09-15T22:23:32.909929+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:49:24.414968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.914919+0000","last_change":"2024-09-15T22:22:50.773324+0000","last_active":"2024-09-15T22:23:32.914919+0000","last_peered":"2024-09-15T22:23:32.914919+0000","last_clean":"2024-09-15T22:23:32.914919+0000","last_became_active":"2024-09-15T22:22:50.773013+0000","last_became_peered":"2024-09-15T22:22:50.773013+0000","last_unstale":"2024-09-15T22:23:32.914919+0000","last_undegraded":"2024-09-15T22:23:32.914919+0000","last_fullsized":"2024-09-15T22:23:32.914919+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:41:06.642144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.908828+0000","last_change":"2024-09-15T22:22:48.334707+0000","last_active":"2024-09-15T22:23:32.908828+0000","last_peered":"2024-09-15T22:23:32.908828+0000","last_clean":"2024-09-15T22:23:32.908828+0000","last_became_active":"2024-09-15T22:22:48.334418+0000","last_became_peered":"2024-09-15T22:22:48.334418+0000","last_unstale":"2024-09-15T22:23:32.908828+0000","last_undegraded":"2024-09-15T22:23:32.908828+0000","last_fullsized":"2024-09-15T22:23:32.908828+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:40.285547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.907994+0000","last_change":"2024-09-15T22:22:50.772760+0000","last_active":"2024-09-15T22:23:32.907994+0000","last_peered":"2024-09-15T22:23:32.907994+0000","last_clean":"2024-09-15T22:23:32.907994+0000","last_became_active":"2024-09-15T22:22:50.772162+0000","last_became_peered":"2024-09-15T22:22:50.772162+0000","last_unstale":"2024-09-15T22:23:32.907994+0000","last_undegraded":"2024-09-15T22:23:32.907994+0000","last_fullsized":"2024-09-15T22:23:32.907994+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:23.368902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":90,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:24:07.934175+0000","last_change":"2024-09-15T22:22:48.336282+0000","last_active":"2024-09-15T22:24:07.934175+0000","last_peered":"2024-09-15T22:24:07.934175+0000","last_clean":"2024-09-15T22:24:07.934175+0000","last_became_active":"2024-09-15T22:22:48.335696+0000","last_became_peered":"2024-09-15T22:22:48.335696+0000","last_unstale":"2024-09-15T22:24:07.934175+0000","last_undegraded":"2024-09-15T22:24:07.934175+0000","last_fullsized":"2024-09-15T22:24:07.934175+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:22.990996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":65,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.911300+0000","last_change":"2024-09-15T22:22:50.778166+0000","last_active":"2024-09-15T22:23:32.911300+0000","last_peered":"2024-09-15T22:23:32.911300+0000","last_clean":"2024-09-15T22:23:32.911300+0000","last_became_active":"2024-09-15T22:22:50.777755+0000","last_became_peered":"2024-09-15T22:22:50.777755+0000","last_unstale":"2024-09-15T22:23:32.911300+0000","last_undegraded":"2024-09-15T22:23:32.911300+0000","last_fullsized":"2024-09-15T22:23:32.911300+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:45:50.513358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:33.380640+0000","last_change":"2024-09-15T22:22:48.334952+0000","last_active":"2024-09-15T22:23:33.380640+0000","last_peered":"2024-09-15T22:23:33.380640+0000","last_clean":"2024-09-15T22:23:33.380640+0000","last_became_active":"2024-09-15T22:22:48.332190+0000","last_became_peered":"2024-09-15T22:22:48.332190+0000","last_unstale":"2024-09-15T22:23:33.380640+0000","last_undegraded":"2024-09-15T22:23:33.380640+0000","last_fullsized":"2024-09-15T22:23:33.380640+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:45:14.877713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.917511+0000","last_change":"2024-09-15T22:23:32.917511+0000","last_active":"2024-09-15T22:23:32.917511+0000","last_peered":"2024-09-15T22:23:32.917511+0000","last_clean":"2024-09-15T22:23:32.917511+0000","last_became_active":"2024-09-15T22:23:32.917041+0000","last_became_peered":"2024-09-15T22:23:32.917041+0000","last_unstale":"2024-09-15T22:23:32.917511+0000","last_undegraded":"2024-09-15T22:23:32.917511+0000","last_fullsized":"2024-09-15T22:23:32.917511+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:40:55.934127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.909146+0000","last_change":"2024-09-15T22:22:48.388864+0000","last_active":"2024-09-15T22:23:32.909146+0000","last_peered":"2024-09-15T22:23:32.909146+0000","last_clean":"2024-09-15T22:23:32.909146+0000","last_became_active":"2024-09-15T22:22:48.388576+0000","last_became_peered":"2024-09-15T22:22:48.388576+0000","last_unstale":"2024-09-15T22:23:32.909146+0000","last_undegraded":"2024-09-15T22:23:32.909146+0000","last_fullsized":"2024-09-15T22:23:32.909146+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:19:44.416306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.911293+0000","last_change":"2024-09-15T22:22:50.783189+0000","last_active":"2024-09-15T22:23:32.911293+0000","last_peered":"2024-09-15T22:23:32.911293+0000","last_clean":"2024-09-15T22:23:32.911293+0000","last_became_active":"2024-09-15T22:22:50.782790+0000","last_became_peered":"2024-09-15T22:22:50.782790+0000","last_unstale":"2024-09-15T22:23:32.911293+0000","last_undegraded":"2024-09-15T22:23:32.911293+0000","last_fullsized":"2024-09-15T22:23:32.911293+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:12.650413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'29","reported_seq":190,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:24:08.935635+0000","last_change":"2024-09-15T22:22:48.336216+0000","last_active":"2024-09-15T22:24:08.935635+0000","last_peered":"2024-09-15T22:24:08.935635+0000","last_clean":"2024-09-15T22:24:08.935635+0000","last_became_active":"2024-09-15T22:22:48.334958+0000","last_became_peered":"2024-09-15T22:22:48.334958+0000","last_unstale":"2024-09-15T22:24:08.935635+0000","last_undegraded":"2024-09-15T22:24:08.935635+0000","last_fullsized":"2024-09-15T22:24:08.935635+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:58:31.990060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":127,"num_write":30,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.915369+0000","last_change":"2024-09-15T22:22:50.773996+0000","last_active":"2024-09-15T22:23:32.915369+0000","last_peered":"2024-09-15T22:23:32.915369+0000","last_clean":"2024-09-15T22:23:32.915369+0000","last_became_active":"2024-09-15T22:22:50.773651+0000","last_became_peered":"2024-09-15T22:22:50.773651+0000","last_unstale":"2024-09-15T22:23:32.915369+0000","last_undegraded":"2024-09-15T22:23:32.915369+0000","last_fullsized":"2024-09-15T22:23:32.915369+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:16.876455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.915126+0000","last_change":"2024-09-15T22:22:48.336138+0000","last_active":"2024-09-15T22:23:32.915126+0000","last_peered":"2024-09-15T22:23:32.915126+0000","last_clean":"2024-09-15T22:23:32.915126+0000","last_became_active":"2024-09-15T22:22:48.335538+0000","last_became_peered":"2024-09-15T22:22:48.335538+0000","last_unstale":"2024-09-15T22:23:32.915126+0000","last_undegraded":"2024-09-15T22:23:32.915126+0000","last_fullsized":"2024-09-15T22:23:32.915126+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:12.917499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.910051+0000","last_change":"2024-09-15T22:22:50.787247+0000","last_active":"2024-09-15T22:23:32.910051+0000","last_peered":"2024-09-15T22:23:32.910051+0000","last_clean":"2024-09-15T22:23:32.910051+0000","last_became_active":"2024-09-15T22:22:50.786880+0000","last_became_peered":"2024-09-15T22:22:50.786880+0000","last_unstale":"2024-09-15T22:23:32.910051+0000","last_undegraded":"2024-09-15T22:23:32.910051+0000","last_fullsized":"2024-09-15T22:23:32.910051+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:02.648581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.908861+0000","last_change":"2024-09-15T22:22:48.335633+0000","last_active":"2024-09-15T22:23:32.908861+0000","last_peered":"2024-09-15T22:23:32.908861+0000","last_clean":"2024-09-15T22:23:32.908861+0000","last_became_active":"2024-09-15T22:22:48.335354+0000","last_became_peered":"2024-09-15T22:22:48.335354+0000","last_unstale":"2024-09-15T22:23:32.908861+0000","last_undegraded":"2024-09-15T22:23:32.908861+0000","last_fullsized":"2024-09-15T22:23:32.908861+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:01:24.009614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:33.380143+0000","last_change":"2024-09-15T22:22:50.777583+0000","last_active":"2024-09-15T22:23:33.380143+0000","last_peered":"2024-09-15T22:23:33.380143+0000","last_clean":"2024-09-15T22:23:33.380143+0000","last_became_active":"2024-09-15T22:22:50.777235+0000","last_became_peered":"2024-09-15T22:22:50.777235+0000","last_unstale":"2024-09-15T22:23:33.380143+0000","last_undegraded":"2024-09-15T22:23:33.380143+0000","last_fullsized":"2024-09-15T22:23:33.380143+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:28:48.449725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'4","reported_seq":91,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:24:04.931402+0000","last_change":"2024-09-15T22:22:48.338517+0000","last_active":"2024-09-15T22:24:04.931402+0000","last_peered":"2024-09-15T22:24:04.931402+0000","last_clean":"2024-09-15T22:24:04.931402+0000","last_became_active":"2024-09-15T22:22:48.338159+0000","last_became_peered":"2024-09-15T22:22:48.338159+0000","last_unstale":"2024-09-15T22:24:04.931402+0000","last_undegraded":"2024-09-15T22:24:04.931402+0000","last_fullsized":"2024-09-15T22:24:04.931402+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:48:14.792180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:33.379668+0000","last_change":"2024-09-15T22:22:50.776455+0000","last_active":"2024-09-15T22:23:33.379668+0000","last_peered":"2024-09-15T22:23:33.379668+0000","last_clean":"2024-09-15T22:23:33.379668+0000","last_became_active":"2024-09-15T22:22:50.776049+0000","last_became_peered":"2024-09-15T22:22:50.776049+0000","last_unstale":"2024-09-15T22:23:33.379668+0000","last_undegraded":"2024-09-15T22:23:33.379668+0000","last_fullsized":"2024-09-15T22:23:33.379668+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:32:01.675470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:33.409981+0000","last_change":"2024-09-15T22:23:33.409514+0000","last_active":"2024-09-15T22:23:33.409981+0000","last_peered":"2024-09-15T22:23:33.409981+0000","last_clean":"2024-09-15T22:23:33.409981+0000","last_became_active":"2024-09-15T22:23:33.381873+0000","last_became_peered":"2024-09-15T22:23:33.381873+0000","last_unstale":"2024-09-15T22:23:33.409981+0000","last_undegraded":"2024-09-15T22:23:33.409981+0000","last_fullsized":"2024-09-15T22:23:33.409981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:14.762596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,4],"acting":[11,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.908822+0000","last_change":"2024-09-15T22:22:50.782530+0000","last_active":"2024-09-15T22:23:32.908822+0000","last_peered":"2024-09-15T22:23:32.908822+0000","last_clean":"2024-09-15T22:23:32.908822+0000","last_became_active":"2024-09-15T22:22:50.782201+0000","last_became_peered":"2024-09-15T22:22:50.782201+0000","last_unstale":"2024-09-15T22:23:32.908822+0000","last_undegraded":"2024-09-15T22:23:32.908822+0000","last_fullsized":"2024-09-15T22:23:32.908822+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:05.652843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.915464+0000","last_change":"2024-09-15T22:22:48.330909+0000","last_active":"2024-09-15T22:23:32.915464+0000","last_peered":"2024-09-15T22:23:32.915464+0000","last_clean":"2024-09-15T22:23:32.915464+0000","last_became_active":"2024-09-15T22:22:48.330603+0000","last_became_peered":"2024-09-15T22:22:48.330603+0000","last_unstale":"2024-09-15T22:23:32.915464+0000","last_undegraded":"2024-09-15T22:23:32.915464+0000","last_fullsized":"2024-09-15T22:23:32.915464+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:32:41.489246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.912231+0000","last_change":"2024-09-15T22:22:50.776404+0000","last_active":"2024-09-15T22:23:32.912231+0000","last_peered":"2024-09-15T22:23:32.912231+0000","last_clean":"2024-09-15T22:23:32.912231+0000","last_became_active":"2024-09-15T22:22:50.776014+0000","last_became_peered":"2024-09-15T22:22:50.776014+0000","last_unstale":"2024-09-15T22:23:32.912231+0000","last_undegraded":"2024-09-15T22:23:32.912231+0000","last_fullsized":"2024-09-15T22:23:32.912231+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:56.644834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.910944+0000","last_change":"2024-09-15T22:22:48.333019+0000","last_active":"2024-09-15T22:23:32.910944+0000","last_peered":"2024-09-15T22:23:32.910944+0000","last_clean":"2024-09-15T22:23:32.910944+0000","last_became_active":"2024-09-15T22:22:48.332669+0000","last_became_peered":"2024-09-15T22:22:48.332669+0000","last_unstale":"2024-09-15T22:23:32.910944+0000","last_undegraded":"2024-09-15T22:23:32.910944+0000","last_fullsized":"2024-09-15T22:23:32.910944+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:36.415483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:33.380954+0000","last_change":"2024-09-15T22:22:50.774131+0000","last_active":"2024-09-15T22:23:33.380954+0000","last_peered":"2024-09-15T22:23:33.380954+0000","last_clean":"2024-09-15T22:23:33.380954+0000","last_became_active":"2024-09-15T22:22:50.773783+0000","last_became_peered":"2024-09-15T22:22:50.773783+0000","last_unstale":"2024-09-15T22:23:33.380954+0000","last_undegraded":"2024-09-15T22:23:33.380954+0000","last_fullsized":"2024-09-15T22:23:33.380954+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:21:57.459883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.909262+0000","last_change":"2024-09-15T22:22:48.337317+0000","last_active":"2024-09-15T22:23:32.909262+0000","last_peered":"2024-09-15T22:23:32.909262+0000","last_clean":"2024-09-15T22:23:32.909262+0000","last_became_active":"2024-09-15T22:22:48.337004+0000","last_became_peered":"2024-09-15T22:22:48.337004+0000","last_unstale":"2024-09-15T22:23:32.909262+0000","last_undegraded":"2024-09-15T22:23:32.909262+0000","last_fullsized":"2024-09-15T22:23:32.909262+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:09.385389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:33.379922+0000","last_change":"2024-09-15T22:22:50.785360+0000","last_active":"2024-09-15T22:23:33.379922+0000","last_peered":"2024-09-15T22:23:33.379922+0000","last_clean":"2024-09-15T22:23:33.379922+0000","last_became_active":"2024-09-15T22:22:50.785041+0000","last_became_peered":"2024-09-15T22:22:50.785041+0000","last_unstale":"2024-09-15T22:23:33.379922+0000","last_undegraded":"2024-09-15T22:23:33.379922+0000","last_fullsized":"2024-09-15T22:23:33.379922+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:18.173219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.915470+0000","last_change":"2024-09-15T22:22:48.387680+0000","last_active":"2024-09-15T22:23:32.915470+0000","last_peered":"2024-09-15T22:23:32.915470+0000","last_clean":"2024-09-15T22:23:32.915470+0000","last_became_active":"2024-09-15T22:22:48.387345+0000","last_became_peered":"2024-09-15T22:22:48.387345+0000","last_unstale":"2024-09-15T22:23:32.915470+0000","last_undegraded":"2024-09-15T22:23:32.915470+0000","last_fullsized":"2024-09-15T22:23:32.915470+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:01:12.814275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:33.380827+0000","last_change":"2024-09-15T22:22:50.781268+0000","last_active":"2024-09-15T22:23:33.380827+0000","last_peered":"2024-09-15T22:23:33.380827+0000","last_clean":"2024-09-15T22:23:33.380827+0000","last_became_active":"2024-09-15T22:22:50.780949+0000","last_became_peered":"2024-09-15T22:22:50.780949+0000","last_unstale":"2024-09-15T22:23:33.380827+0000","last_undegraded":"2024-09-15T22:23:33.380827+0000","last_fullsized":"2024-09-15T22:23:33.380827+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:55:46.107326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":335,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:33.379873+0000","last_change":"2024-09-15T22:21:33.463741+0000","last_active":"2024-09-15T22:23:33.379873+0000","last_peered":"2024-09-15T22:23:33.379873+0000","last_clean":"2024-09-15T22:23:33.379873+0000","last_became_active":"2024-09-15T22:21:33.463177+0000","last_became_peered":"2024-09-15T22:21:33.463177+0000","last_unstale":"2024-09-15T22:23:33.379873+0000","last_undegraded":"2024-09-15T22:23:33.379873+0000","last_fullsized":"2024-09-15T22:23:33.379873+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:17:56.109541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:17:56.109541+0000","last_clean_scrub_stamp":"2024-09-15T22:17:56.109541+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:43.974077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:33.381328+0000","last_change":"2024-09-15T22:22:48.337556+0000","last_active":"2024-09-15T22:23:33.381328+0000","last_peered":"2024-09-15T22:23:33.381328+0000","last_clean":"2024-09-15T22:23:33.381328+0000","last_became_active":"2024-09-15T22:22:48.337163+0000","last_became_peered":"2024-09-15T22:22:48.337163+0000","last_unstale":"2024-09-15T22:23:33.381328+0000","last_undegraded":"2024-09-15T22:23:33.381328+0000","last_fullsized":"2024-09-15T22:23:33.381328+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:30:57.087797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.914899+0000","last_change":"2024-09-15T22:22:50.778807+0000","last_active":"2024-09-15T22:23:32.914899+0000","last_peered":"2024-09-15T22:23:32.914899+0000","last_clean":"2024-09-15T22:23:32.914899+0000","last_became_active":"2024-09-15T22:22:50.778515+0000","last_became_peered":"2024-09-15T22:22:50.778515+0000","last_unstale":"2024-09-15T22:23:32.914899+0000","last_undegraded":"2024-09-15T22:23:32.914899+0000","last_fullsized":"2024-09-15T22:23:32.914899+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:15:40.969573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:33.379803+0000","last_change":"2024-09-15T22:22:48.332525+0000","last_active":"2024-09-15T22:23:33.379803+0000","last_peered":"2024-09-15T22:23:33.379803+0000","last_clean":"2024-09-15T22:23:33.379803+0000","last_became_active":"2024-09-15T22:22:48.331615+0000","last_became_peered":"2024-09-15T22:22:48.331615+0000","last_unstale":"2024-09-15T22:23:33.379803+0000","last_undegraded":"2024-09-15T22:23:33.379803+0000","last_fullsized":"2024-09-15T22:23:33.379803+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:47:00.012013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.909867+0000","last_change":"2024-09-15T22:22:50.778422+0000","last_active":"2024-09-15T22:23:32.909867+0000","last_peered":"2024-09-15T22:23:32.909867+0000","last_clean":"2024-09-15T22:23:32.909867+0000","last_became_active":"2024-09-15T22:22:50.777549+0000","last_became_peered":"2024-09-15T22:22:50.777549+0000","last_unstale":"2024-09-15T22:23:32.909867+0000","last_undegraded":"2024-09-15T22:23:32.909867+0000","last_fullsized":"2024-09-15T22:23:32.909867+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:30:03.130474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":87,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:24:03.929645+0000","last_change":"2024-09-15T22:22:48.387992+0000","last_active":"2024-09-15T22:24:03.929645+0000","last_peered":"2024-09-15T22:24:03.929645+0000","last_clean":"2024-09-15T22:24:03.929645+0000","last_became_active":"2024-09-15T22:22:48.386645+0000","last_became_peered":"2024-09-15T22:22:48.386645+0000","last_unstale":"2024-09-15T22:24:03.929645+0000","last_undegraded":"2024-09-15T22:24:03.929645+0000","last_fullsized":"2024-09-15T22:24:03.929645+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:00.893946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.920051+0000","last_change":"2024-09-15T22:23:32.920051+0000","last_active":"2024-09-15T22:23:32.920051+0000","last_peered":"2024-09-15T22:23:32.920051+0000","last_clean":"2024-09-15T22:23:32.920051+0000","last_became_active":"2024-09-15T22:23:32.919659+0000","last_became_peered":"2024-09-15T22:23:32.919659+0000","last_unstale":"2024-09-15T22:23:32.920051+0000","last_undegraded":"2024-09-15T22:23:32.920051+0000","last_fullsized":"2024-09-15T22:23:32.920051+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:33:39.320446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:33.380150+0000","last_change":"2024-09-15T22:22:48.334598+0000","last_active":"2024-09-15T22:23:33.380150+0000","last_peered":"2024-09-15T22:23:33.380150+0000","last_clean":"2024-09-15T22:23:33.380150+0000","last_became_active":"2024-09-15T22:22:48.333022+0000","last_became_peered":"2024-09-15T22:22:48.333022+0000","last_unstale":"2024-09-15T22:23:33.380150+0000","last_undegraded":"2024-09-15T22:23:33.380150+0000","last_fullsized":"2024-09-15T22:23:33.380150+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:28.577791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.909239+0000","last_change":"2024-09-15T22:22:50.777045+0000","last_active":"2024-09-15T22:23:32.909239+0000","last_peered":"2024-09-15T22:23:32.909239+0000","last_clean":"2024-09-15T22:23:32.909239+0000","last_became_active":"2024-09-15T22:22:50.776677+0000","last_became_peered":"2024-09-15T22:22:50.776677+0000","last_unstale":"2024-09-15T22:23:32.909239+0000","last_undegraded":"2024-09-15T22:23:32.909239+0000","last_fullsized":"2024-09-15T22:23:32.909239+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:24.946214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.908558+0000","last_change":"2024-09-15T22:22:48.387707+0000","last_active":"2024-09-15T22:23:32.908558+0000","last_peered":"2024-09-15T22:23:32.908558+0000","last_clean":"2024-09-15T22:23:32.908558+0000","last_became_active":"2024-09-15T22:22:48.387323+0000","last_became_peered":"2024-09-15T22:22:48.387323+0000","last_unstale":"2024-09-15T22:23:32.908558+0000","last_undegraded":"2024-09-15T22:23:32.908558+0000","last_fullsized":"2024-09-15T22:23:32.908558+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:43.430648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.909440+0000","last_change":"2024-09-15T22:22:50.775365+0000","last_active":"2024-09-15T22:23:32.909440+0000","last_peered":"2024-09-15T22:23:32.909440+0000","last_clean":"2024-09-15T22:23:32.909440+0000","last_became_active":"2024-09-15T22:22:50.774988+0000","last_became_peered":"2024-09-15T22:22:50.774988+0000","last_unstale":"2024-09-15T22:23:32.909440+0000","last_undegraded":"2024-09-15T22:23:32.909440+0000","last_fullsized":"2024-09-15T22:23:32.909440+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:32:33.268976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.915445+0000","last_change":"2024-09-15T22:22:48.387142+0000","last_active":"2024-09-15T22:23:32.915445+0000","last_peered":"2024-09-15T22:23:32.915445+0000","last_clean":"2024-09-15T22:23:32.915445+0000","last_became_active":"2024-09-15T22:22:48.386669+0000","last_became_peered":"2024-09-15T22:22:48.386669+0000","last_unstale":"2024-09-15T22:23:32.915445+0000","last_undegraded":"2024-09-15T22:23:32.915445+0000","last_fullsized":"2024-09-15T22:23:32.915445+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:01.590592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.910860+0000","last_change":"2024-09-15T22:22:50.788723+0000","last_active":"2024-09-15T22:23:32.910860+0000","last_peered":"2024-09-15T22:23:32.910860+0000","last_clean":"2024-09-15T22:23:32.910860+0000","last_became_active":"2024-09-15T22:22:50.786767+0000","last_became_peered":"2024-09-15T22:22:50.786767+0000","last_unstale":"2024-09-15T22:23:32.910860+0000","last_undegraded":"2024-09-15T22:23:32.910860+0000","last_fullsized":"2024-09-15T22:23:32.910860+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:10:54.859140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'11","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.908292+0000","last_change":"2024-09-15T22:22:48.329971+0000","last_active":"2024-09-15T22:23:32.908292+0000","last_peered":"2024-09-15T22:23:32.908292+0000","last_clean":"2024-09-15T22:23:32.908292+0000","last_became_active":"2024-09-15T22:22:48.329526+0000","last_became_peered":"2024-09-15T22:22:48.329526+0000","last_unstale":"2024-09-15T22:23:32.908292+0000","last_undegraded":"2024-09-15T22:23:32.908292+0000","last_fullsized":"2024-09-15T22:23:32.908292+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:53.665784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.916078+0000","last_change":"2024-09-15T22:22:50.778281+0000","last_active":"2024-09-15T22:23:32.916078+0000","last_peered":"2024-09-15T22:23:32.916078+0000","last_clean":"2024-09-15T22:23:32.916078+0000","last_became_active":"2024-09-15T22:22:50.777969+0000","last_became_peered":"2024-09-15T22:22:50.777969+0000","last_unstale":"2024-09-15T22:23:32.916078+0000","last_undegraded":"2024-09-15T22:23:32.916078+0000","last_fullsized":"2024-09-15T22:23:32.916078+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:25:04.566350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:33.381523+0000","last_change":"2024-09-15T22:22:48.370056+0000","last_active":"2024-09-15T22:23:33.381523+0000","last_peered":"2024-09-15T22:23:33.381523+0000","last_clean":"2024-09-15T22:23:33.381523+0000","last_became_active":"2024-09-15T22:22:48.369729+0000","last_became_peered":"2024-09-15T22:22:48.369729+0000","last_unstale":"2024-09-15T22:23:33.381523+0000","last_undegraded":"2024-09-15T22:23:33.381523+0000","last_fullsized":"2024-09-15T22:23:33.381523+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:43.894706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.911647+0000","last_change":"2024-09-15T22:22:50.785270+0000","last_active":"2024-09-15T22:23:32.911647+0000","last_peered":"2024-09-15T22:23:32.911647+0000","last_clean":"2024-09-15T22:23:32.911647+0000","last_became_active":"2024-09-15T22:22:50.785035+0000","last_became_peered":"2024-09-15T22:22:50.785035+0000","last_unstale":"2024-09-15T22:23:32.911647+0000","last_undegraded":"2024-09-15T22:23:32.911647+0000","last_fullsized":"2024-09-15T22:23:32.911647+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:58.505722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.911044+0000","last_change":"2024-09-15T22:22:48.387181+0000","last_active":"2024-09-15T22:23:32.911044+0000","last_peered":"2024-09-15T22:23:32.911044+0000","last_clean":"2024-09-15T22:23:32.911044+0000","last_became_active":"2024-09-15T22:22:48.386792+0000","last_became_peered":"2024-09-15T22:22:48.386792+0000","last_unstale":"2024-09-15T22:23:32.911044+0000","last_undegraded":"2024-09-15T22:23:32.911044+0000","last_fullsized":"2024-09-15T22:23:32.911044+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:25.362961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.915199+0000","last_change":"2024-09-15T22:22:50.774054+0000","last_active":"2024-09-15T22:23:32.915199+0000","last_peered":"2024-09-15T22:23:32.915199+0000","last_clean":"2024-09-15T22:23:32.915199+0000","last_became_active":"2024-09-15T22:22:50.773686+0000","last_became_peered":"2024-09-15T22:22:50.773686+0000","last_unstale":"2024-09-15T22:23:32.915199+0000","last_undegraded":"2024-09-15T22:23:32.915199+0000","last_fullsized":"2024-09-15T22:23:32.915199+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:34.512814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.915195+0000","last_change":"2024-09-15T22:22:48.337042+0000","last_active":"2024-09-15T22:23:32.915195+0000","last_peered":"2024-09-15T22:23:32.915195+0000","last_clean":"2024-09-15T22:23:32.915195+0000","last_became_active":"2024-09-15T22:22:48.336648+0000","last_became_peered":"2024-09-15T22:22:48.336648+0000","last_unstale":"2024-09-15T22:23:32.915195+0000","last_undegraded":"2024-09-15T22:23:32.915195+0000","last_fullsized":"2024-09-15T22:23:32.915195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:14:09.777606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.912232+0000","last_change":"2024-09-15T22:22:50.774012+0000","last_active":"2024-09-15T22:23:32.912232+0000","last_peered":"2024-09-15T22:23:32.912232+0000","last_clean":"2024-09-15T22:23:32.912232+0000","last_became_active":"2024-09-15T22:22:50.773442+0000","last_became_peered":"2024-09-15T22:22:50.773442+0000","last_unstale":"2024-09-15T22:23:32.912232+0000","last_undegraded":"2024-09-15T22:23:32.912232+0000","last_fullsized":"2024-09-15T22:23:32.912232+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:29.980429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.921838+0000","last_change":"2024-09-15T22:23:32.921434+0000","last_active":"2024-09-15T22:23:32.921838+0000","last_peered":"2024-09-15T22:23:32.921838+0000","last_clean":"2024-09-15T22:23:32.921838+0000","last_became_active":"2024-09-15T22:23:32.916759+0000","last_became_peered":"2024-09-15T22:23:32.916759+0000","last_unstale":"2024-09-15T22:23:32.921838+0000","last_undegraded":"2024-09-15T22:23:32.921838+0000","last_fullsized":"2024-09-15T22:23:32.921838+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:18:30.691925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.914701+0000","last_change":"2024-09-15T22:22:50.782798+0000","last_active":"2024-09-15T22:23:32.914701+0000","last_peered":"2024-09-15T22:23:32.914701+0000","last_clean":"2024-09-15T22:23:32.914701+0000","last_became_active":"2024-09-15T22:22:50.782316+0000","last_became_peered":"2024-09-15T22:22:50.782316+0000","last_unstale":"2024-09-15T22:23:32.914701+0000","last_undegraded":"2024-09-15T22:23:32.914701+0000","last_fullsized":"2024-09-15T22:23:32.914701+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:35:26.104790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.914745+0000","last_change":"2024-09-15T22:22:48.332485+0000","last_active":"2024-09-15T22:23:32.914745+0000","last_peered":"2024-09-15T22:23:32.914745+0000","last_clean":"2024-09-15T22:23:32.914745+0000","last_became_active":"2024-09-15T22:22:48.332158+0000","last_became_peered":"2024-09-15T22:22:48.332158+0000","last_unstale":"2024-09-15T22:23:32.914745+0000","last_undegraded":"2024-09-15T22:23:32.914745+0000","last_fullsized":"2024-09-15T22:23:32.914745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:20.947915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:33.380055+0000","last_change":"2024-09-15T22:22:50.781961+0000","last_active":"2024-09-15T22:23:33.380055+0000","last_peered":"2024-09-15T22:23:33.380055+0000","last_clean":"2024-09-15T22:23:33.380055+0000","last_became_active":"2024-09-15T22:22:50.781622+0000","last_became_peered":"2024-09-15T22:22:50.781622+0000","last_unstale":"2024-09-15T22:23:33.380055+0000","last_undegraded":"2024-09-15T22:23:33.380055+0000","last_fullsized":"2024-09-15T22:23:33.380055+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:57.848953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:33.382353+0000","last_change":"2024-09-15T22:23:33.382353+0000","last_active":"2024-09-15T22:23:33.382353+0000","last_peered":"2024-09-15T22:23:33.382353+0000","last_clean":"2024-09-15T22:23:33.382353+0000","last_became_active":"2024-09-15T22:23:33.381784+0000","last_became_peered":"2024-09-15T22:23:33.381784+0000","last_unstale":"2024-09-15T22:23:33.382353+0000","last_undegraded":"2024-09-15T22:23:33.382353+0000","last_fullsized":"2024-09-15T22:23:33.382353+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:15:06.829850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.915379+0000","last_change":"2024-09-15T22:22:48.329098+0000","last_active":"2024-09-15T22:23:32.915379+0000","last_peered":"2024-09-15T22:23:32.915379+0000","last_clean":"2024-09-15T22:23:32.915379+0000","last_became_active":"2024-09-15T22:22:48.328755+0000","last_became_peered":"2024-09-15T22:22:48.328755+0000","last_unstale":"2024-09-15T22:23:32.915379+0000","last_undegraded":"2024-09-15T22:23:32.915379+0000","last_fullsized":"2024-09-15T22:23:32.915379+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:31.197422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.911163+0000","last_change":"2024-09-15T22:22:50.778437+0000","last_active":"2024-09-15T22:23:32.911163+0000","last_peered":"2024-09-15T22:23:32.911163+0000","last_clean":"2024-09-15T22:23:32.911163+0000","last_became_active":"2024-09-15T22:22:50.776847+0000","last_became_peered":"2024-09-15T22:22:50.776847+0000","last_unstale":"2024-09-15T22:23:32.911163+0000","last_undegraded":"2024-09-15T22:23:32.911163+0000","last_fullsized":"2024-09-15T22:23:32.911163+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:56.740028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.915308+0000","last_change":"2024-09-15T22:22:48.331965+0000","last_active":"2024-09-15T22:23:32.915308+0000","last_peered":"2024-09-15T22:23:32.915308+0000","last_clean":"2024-09-15T22:23:32.915308+0000","last_became_active":"2024-09-15T22:22:48.331652+0000","last_became_peered":"2024-09-15T22:22:48.331652+0000","last_unstale":"2024-09-15T22:23:32.915308+0000","last_undegraded":"2024-09-15T22:23:32.915308+0000","last_fullsized":"2024-09-15T22:23:32.915308+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:39.232097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.911834+0000","last_change":"2024-09-15T22:22:50.778091+0000","last_active":"2024-09-15T22:23:32.911834+0000","last_peered":"2024-09-15T22:23:32.911834+0000","last_clean":"2024-09-15T22:23:32.911834+0000","last_became_active":"2024-09-15T22:22:50.777782+0000","last_became_peered":"2024-09-15T22:22:50.777782+0000","last_unstale":"2024-09-15T22:23:32.911834+0000","last_undegraded":"2024-09-15T22:23:32.911834+0000","last_fullsized":"2024-09-15T22:23:32.911834+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:14:30.221629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.915875+0000","last_change":"2024-09-15T22:22:48.387133+0000","last_active":"2024-09-15T22:23:32.915875+0000","last_peered":"2024-09-15T22:23:32.915875+0000","last_clean":"2024-09-15T22:23:32.915875+0000","last_became_active":"2024-09-15T22:22:48.386796+0000","last_became_peered":"2024-09-15T22:22:48.386796+0000","last_unstale":"2024-09-15T22:23:32.915875+0000","last_undegraded":"2024-09-15T22:23:32.915875+0000","last_fullsized":"2024-09-15T22:23:32.915875+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:18:24.267326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.915604+0000","last_change":"2024-09-15T22:22:50.780869+0000","last_active":"2024-09-15T22:23:32.915604+0000","last_peered":"2024-09-15T22:23:32.915604+0000","last_clean":"2024-09-15T22:23:32.915604+0000","last_became_active":"2024-09-15T22:22:50.780411+0000","last_became_peered":"2024-09-15T22:22:50.780411+0000","last_unstale":"2024-09-15T22:23:32.915604+0000","last_undegraded":"2024-09-15T22:23:32.915604+0000","last_fullsized":"2024-09-15T22:23:32.915604+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:49.747146+0000","last_clean_scrub_stamp":"2024-09-15T22:22:49.747146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:38:05.410234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-15T22:23:32.908231+0000","last_change":"2024-09-15T22:22:48.332789+0000","last_active":"2024-09-15T22:23:32.908231+0000","last_peered":"2024-09-15T22:23:32.908231+0000","last_clean":"2024-09-15T22:23:32.908231+0000","last_became_active":"2024-09-15T22:22:48.332165+0000","last_became_peered":"2024-09-15T22:22:48.332165+0000","last_unstale":"2024-09-15T22:23:32.908231+0000","last_undegraded":"2024-09-15T22:23:32.908231+0000","last_fullsized":"2024-09-15T22:23:32.908231+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:22:47.312300+0000","last_clean_scrub_stamp":"2024-09-15T22:22:47.312300+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:44:07.190316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":407,"num_read_kb":272,"num_write":165,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":192480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514526,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":440711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743459,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1613824,"data_stored":1092237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906984,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":933888,"data_stored":440835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135918,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":925696,"data_stored":440643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364849,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32684,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712468,"statfs":{"total":95995035648,"available":95961567232,"internally_reserved":0,"allocated":1527808,"data_stored":1033080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528374,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":921600,"data_stored":440224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757309,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28536,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716616,"statfs":{"total":95995035648,"available":95965814784,"internally_reserved":0,"allocated":1540096,"data_stored":1032371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920834,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":933888,"data_stored":441166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149767,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36268,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708884,"statfs":{"total":95995035648,"available":95957897216,"internally_reserved":0,"allocated":937984,"data_stored":440535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411405,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":999424,"data_stored":501412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":983040,"data_stored":499781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":441495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":61395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:24:12.059 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-15T22:24:12.059 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-15T22:24:12.059 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-15T22:24:12.059 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-15T22:24:12.473 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:12.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:12 smithi001 ceph-mon[30843]: from='client.14850 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:24:12.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:12 smithi012 ceph-mon[34883]: from='client.14850 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:24:12.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:12 smithi098 ceph-mon[35514]: from='client.14850 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:24:13.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:12.997+0000 7ff7b5800640 1 -- 172.21.15.1:0/3109452491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7b0106f20 msgr2=0x7ff7b010eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:13.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:12.997+0000 7ff7b5800640 1 --2- 172.21.15.1:0/3109452491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7b0106f20 0x7ff7b010eaa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8009ca0 tx=0x7ff7a802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:24:13.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:12.997+0000 7ff7b5800640 1 -- 172.21.15.1:0/3109452491 shutdown_connections 2024-09-15T22:24:13.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:12.997+0000 7ff7b5800640 1 --2- 172.21.15.1:0/3109452491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7b0106f20 0x7ff7b010eaa0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:13.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:12.997+0000 7ff7b5800640 1 --2- 172.21.15.1:0/3109452491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7b01027a0 0x7ff7b01067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:13.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:12.997+0000 7ff7b5800640 1 --2- 172.21.15.1:0/3109452491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7b0101df0 0x7ff7b01021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:13.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:12.997+0000 7ff7b5800640 1 -- 172.21.15.1:0/3109452491 >> 172.21.15.1:0/3109452491 conn(0x7ff7b00fd8b0 msgr2=0x7ff7b00ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:13.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:12.997+0000 7ff7b5800640 1 -- 172.21.15.1:0/3109452491 shutdown_connections 2024-09-15T22:24:13.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:12.997+0000 7ff7b5800640 1 -- 172.21.15.1:0/3109452491 wait complete. 2024-09-15T22:24:13.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:12.998+0000 7ff7b5800640 1 Processor -- start 2024-09-15T22:24:13.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:12.998+0000 7ff7b5800640 1 -- start start 2024-09-15T22:24:13.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:12.998+0000 7ff7b5800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7b0101df0 0x7ff7b019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:13.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:12.998+0000 7ff7b5800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7b01027a0 0x7ff7b019ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:13.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:12.998+0000 7ff7b5800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7b0106f20 0x7ff7b019ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:13.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:12.998+0000 7ff7b5800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b0111f80 con 0x7ff7b0101df0 2024-09-15T22:24:13.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:12.998+0000 7ff7b5800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b0111e00 con 0x7ff7b01027a0 2024-09-15T22:24:13.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:12.998+0000 7ff7b5800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b0112100 con 0x7ff7b0106f20 2024-09-15T22:24:13.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:12.999+0000 7ff7aea00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7b0101df0 0x7ff7b019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:13.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:12.999+0000 7ff7aea00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7b0101df0 0x7ff7b019a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58186/0 (socket says 172.21.15.1:58186) 2024-09-15T22:24:13.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:12.999+0000 7ff7aea00640 1 -- 172.21.15.1:0/1170632 learned_addr learned my addr 172.21.15.1:0/1170632 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:13.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:12.999+0000 7ff7af400640 1 --2- 172.21.15.1:0/1170632 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7b0106f20 0x7ff7b019ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:13.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:12.999+0000 7ff7a7e00640 1 --2- 172.21.15.1:0/1170632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7b01027a0 0x7ff7b019ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:13.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:12.999+0000 7ff7aea00640 1 -- 172.21.15.1:0/1170632 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7b0106f20 msgr2=0x7ff7b019ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:13.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:12.999+0000 7ff7aea00640 1 --2- 172.21.15.1:0/1170632 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7b0106f20 0x7ff7b019ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:13.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:12.999+0000 7ff7aea00640 1 -- 172.21.15.1:0/1170632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7b01027a0 msgr2=0x7ff7b019ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:13.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:12.999+0000 7ff7aea00640 1 --2- 172.21.15.1:0/1170632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7b01027a0 0x7ff7b019ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:13.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:12.999+0000 7ff7aea00640 1 -- 172.21.15.1:0/1170632 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b019f570 con 0x7ff7b0101df0 2024-09-15T22:24:13.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:12.999+0000 7ff7af400640 1 --2- 172.21.15.1:0/1170632 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7b0106f20 0x7ff7b019ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:13.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:12.999+0000 7ff7aea00640 1 --2- 172.21.15.1:0/1170632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7b0101df0 0x7ff7b019a5c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff7a000e9f0 tx=0x7ff7a000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:13.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:13.000+0000 7ff7a7400640 1 -- 172.21.15.1:0/1170632 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a000cd80 con 0x7ff7b0101df0 2024-09-15T22:24:13.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:13.000+0000 7ff7a7400640 1 -- 172.21.15.1:0/1170632 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7a0010910 con 0x7ff7b0101df0 2024-09-15T22:24:13.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:13.000+0000 7ff7b5800640 1 -- 172.21.15.1:0/1170632 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7b019f860 con 0x7ff7b0101df0 2024-09-15T22:24:13.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:13.000+0000 7ff7a7400640 1 -- 172.21.15.1:0/1170632 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a0018990 con 0x7ff7b0101df0 2024-09-15T22:24:13.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:13.000+0000 7ff7b5800640 1 -- 172.21.15.1:0/1170632 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7b01a7140 con 0x7ff7b0101df0 2024-09-15T22:24:13.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:13.001+0000 7ff7b5800640 1 -- 172.21.15.1:0/1170632 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7b01021d0 con 0x7ff7b0101df0 2024-09-15T22:24:13.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:13.003+0000 7ff7a7400640 1 -- 172.21.15.1:0/1170632 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7ff7a0010ac0 con 0x7ff7b0101df0 2024-09-15T22:24:13.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:13.004+0000 7ff7a7400640 1 --2- 172.21.15.1:0/1170632 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ff7940a32d0 0x7ff7940a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:13.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:13.004+0000 7ff7a7400640 1 -- 172.21.15.1:0/1170632 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ff7a00d0260 con 0x7ff7b0101df0 2024-09-15T22:24:13.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:13.004+0000 7ff7a7e00640 1 --2- 172.21.15.1:0/1170632 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ff7940a32d0 0x7ff7940a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:13.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:13.005+0000 7ff7a7e00640 1 --2- 172.21.15.1:0/1170632 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ff7940a32d0 0x7ff7940a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0076480 tx=0x7ff798005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:13.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:13.006+0000 7ff7a7400640 1 -- 172.21.15.1:0/1170632 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff7a009c760 con 0x7ff7b0101df0 2024-09-15T22:24:13.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:13.232+0000 7ff7b5800640 1 -- 172.21.15.1:0/1170632 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff7b01a73e0 con 0x7ff7b0101df0 2024-09-15T22:24:13.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:13.233+0000 7ff7a7400640 1 -- 172.21.15.1:0/1170632 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7ff7a00a0a60 con 0x7ff7b0101df0 2024-09-15T22:24:13.235 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:24:13.235 INFO:teuthology.orchestra.run.smithi001.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-15T22:24:13.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:13.235+0000 7ff7b5800640 1 -- 172.21.15.1:0/1170632 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ff7940a32d0 msgr2=0x7ff7940a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:13.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:13.235+0000 7ff7b5800640 1 --2- 172.21.15.1:0/1170632 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ff7940a32d0 0x7ff7940a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0076480 tx=0x7ff798005f90 comp rx=0 tx=0).stop 2024-09-15T22:24:13.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:13.235+0000 7ff7b5800640 1 -- 172.21.15.1:0/1170632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7b0101df0 msgr2=0x7ff7b019a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:13.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:13.235+0000 7ff7b5800640 1 --2- 172.21.15.1:0/1170632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7b0101df0 0x7ff7b019a5c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff7a000e9f0 tx=0x7ff7a000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:24:13.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:13.235+0000 7ff7b5800640 1 -- 172.21.15.1:0/1170632 shutdown_connections 2024-09-15T22:24:13.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:13.235+0000 7ff7b5800640 1 --2- 172.21.15.1:0/1170632 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ff7940a32d0 0x7ff7940a5790 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:13.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:13.235+0000 7ff7b5800640 1 --2- 172.21.15.1:0/1170632 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7b0106f20 0x7ff7b019ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:13.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:13.235+0000 7ff7b5800640 1 --2- 172.21.15.1:0/1170632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7b01027a0 0x7ff7b019ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:13.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:13.235+0000 7ff7b5800640 1 --2- 172.21.15.1:0/1170632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7b0101df0 0x7ff7b019a5c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:13.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:13.235+0000 7ff7b5800640 1 -- 172.21.15.1:0/1170632 >> 172.21.15.1:0/1170632 conn(0x7ff7b00fd8b0 msgr2=0x7ff7b00fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:13.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:13.236+0000 7ff7b5800640 1 -- 172.21.15.1:0/1170632 shutdown_connections 2024-09-15T22:24:13.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:13.236+0000 7ff7b5800640 1 -- 172.21.15.1:0/1170632 wait complete. 2024-09-15T22:24:13.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:13 smithi001 ceph-mon[30843]: pgmap v334: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-15T22:24:13.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:13 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/1170632' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-15T22:24:13.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:13 smithi012 ceph-mon[34883]: pgmap v334: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-15T22:24:13.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:13 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/1170632' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-15T22:24:13.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:13 smithi098 ceph-mon[35514]: pgmap v334: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-15T22:24:13.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:13 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/1170632' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-15T22:24:14.162 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-15T22:24:14.163 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:24:14.545 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:15.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.149+0000 7f27f7000640 1 -- 172.21.15.1:0/2449222403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27f0112a30 msgr2=0x7f27f0114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:15.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.149+0000 7f27f7000640 1 --2- 172.21.15.1:0/2449222403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27f0112a30 0x7f27f0114e20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f27e8009be0 tx=0x7f27e802a6c0 comp rx=0 tx=0).stop 2024-09-15T22:24:15.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.149+0000 7f27f7000640 1 -- 172.21.15.1:0/2449222403 shutdown_connections 2024-09-15T22:24:15.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.149+0000 7f27f7000640 1 --2- 172.21.15.1:0/2449222403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27f0112a30 0x7f27f0114e20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:15.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.149+0000 7f27f7000640 1 --2- 172.21.15.1:0/2449222403 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27f0077040 0x7f27f01124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:15.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.149+0000 7f27f7000640 1 --2- 172.21.15.1:0/2449222403 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27f0076720 0x7f27f0076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:15.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.149+0000 7f27f7000640 1 -- 172.21.15.1:0/2449222403 >> 172.21.15.1:0/2449222403 conn(0x7f27f00ffa90 msgr2=0x7f27f0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:15.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.149+0000 7f27f7000640 1 -- 172.21.15.1:0/2449222403 shutdown_connections 2024-09-15T22:24:15.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.149+0000 7f27f7000640 1 -- 172.21.15.1:0/2449222403 wait complete. 2024-09-15T22:24:15.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.150+0000 7f27f7000640 1 Processor -- start 2024-09-15T22:24:15.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.150+0000 7f27f7000640 1 -- start start 2024-09-15T22:24:15.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.150+0000 7f27f7000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27f0076720 0x7f27f019eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:15.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.150+0000 7f27f7000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27f0077040 0x7f27f019f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:15.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.150+0000 7f27f7000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27f0112a30 0x7f27f01a3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:15.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.150+0000 7f27f7000640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f27f0118580 con 0x7f27f0076720 2024-09-15T22:24:15.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.150+0000 7f27f7000640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f27f0118400 con 0x7f27f0112a30 2024-09-15T22:24:15.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.150+0000 7f27f7000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f27f0118700 con 0x7f27f0077040 2024-09-15T22:24:15.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.151+0000 7f27e7e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27f0077040 0x7f27f019f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:15.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.151+0000 7f27efe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27f0076720 0x7f27f019eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:15.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.151+0000 7f27e7e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27f0077040 0x7f27f019f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:44226/0 (socket says 172.21.15.1:44226) 2024-09-15T22:24:15.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.151+0000 7f27e7e00640 1 -- 172.21.15.1:0/4035051433 learned_addr learned my addr 172.21.15.1:0/4035051433 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:15.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.151+0000 7f27f5000640 1 --2- 172.21.15.1:0/4035051433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27f0112a30 0x7f27f01a3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:15.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.151+0000 7f27e7e00640 1 -- 172.21.15.1:0/4035051433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27f0112a30 msgr2=0x7f27f01a3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:15.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.151+0000 7f27e7e00640 1 --2- 172.21.15.1:0/4035051433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27f0112a30 0x7f27f01a3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:15.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.151+0000 7f27e7e00640 1 -- 172.21.15.1:0/4035051433 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27f0076720 msgr2=0x7f27f019eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:15.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.151+0000 7f27e7e00640 1 --2- 172.21.15.1:0/4035051433 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27f0076720 0x7f27f019eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:15.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.151+0000 7f27e7e00640 1 -- 172.21.15.1:0/4035051433 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27f01a3b70 con 0x7f27f0077040 2024-09-15T22:24:15.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.151+0000 7f27e7e00640 1 --2- 172.21.15.1:0/4035051433 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27f0077040 0x7f27f019f080 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f27d800e9c0 tx=0x7f27d800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:15.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.152+0000 7f27ed600640 1 -- 172.21.15.1:0/4035051433 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d800cde0 con 0x7f27f0077040 2024-09-15T22:24:15.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.152+0000 7f27ed600640 1 -- 172.21.15.1:0/4035051433 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27d80035f0 con 0x7f27f0077040 2024-09-15T22:24:15.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.152+0000 7f27ed600640 1 -- 172.21.15.1:0/4035051433 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d8010690 con 0x7f27f0077040 2024-09-15T22:24:15.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.152+0000 7f27f7000640 1 -- 172.21.15.1:0/4035051433 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27f01a3e60 con 0x7f27f0077040 2024-09-15T22:24:15.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.152+0000 7f27f7000640 1 -- 172.21.15.1:0/4035051433 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27f01ab6f0 con 0x7f27f0077040 2024-09-15T22:24:15.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.153+0000 7f27f7000640 1 -- 172.21.15.1:0/4035051433 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27f0076b00 con 0x7f27f0077040 2024-09-15T22:24:15.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.155+0000 7f27ed600640 1 -- 172.21.15.1:0/4035051433 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f27d80037a0 con 0x7f27f0077040 2024-09-15T22:24:15.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.156+0000 7f27ed600640 1 --2- 172.21.15.1:0/4035051433 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f27d40a3350 0x7f27d40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:15.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.157+0000 7f27ed600640 1 -- 172.21.15.1:0/4035051433 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f27d80cfe10 con 0x7f27f0077040 2024-09-15T22:24:15.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.157+0000 7f27efe00640 1 --2- 172.21.15.1:0/4035051433 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f27d40a3350 0x7f27d40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:15.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.157+0000 7f27efe00640 1 --2- 172.21.15.1:0/4035051433 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f27d40a3350 0x7f27d40a5810 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f27e0009bd0 tx=0x7f27e0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:15.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.159+0000 7f27ed600640 1 -- 172.21.15.1:0/4035051433 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f27d809c9f0 con 0x7f27f0077040 2024-09-15T22:24:15.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.380+0000 7f27f7000640 1 -- 172.21.15.1:0/4035051433 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f27f019fea0 con 0x7f27f0077040 2024-09-15T22:24:15.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.381+0000 7f27ed600640 1 -- 172.21.15.1:0/4035051433 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11882 (secure 0 0 0) 0x7f27d809c2f0 con 0x7f27f0077040 2024-09-15T22:24:15.383 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:24:15.383 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":25,"btime":"2024-09-15T22:23:07:844952+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2417768032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2417768032},{"type":"v1","addr":"172.21.15.1:6835","nonce":2417768032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14493,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2957993064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2957993064},{"type":"v1","addr":"172.21.15.1:6837","nonce":2957993064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14529,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3887277479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3887277479},{"type":"v1","addr":"172.21.15.1:6839","nonce":3887277479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14541,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/1674822398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":1674822398},{"type":"v1","addr":"172.21.15.1:6841","nonce":1674822398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3122570659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3122570659},{"type":"v1","addr":"172.21.15.12:6833","nonce":3122570659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2901262900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2901262900},{"type":"v1","addr":"172.21.15.12:6835","nonce":2901262900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:22:51.743282+0000","modified":"2024-09-15T22:23:06.984789+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24538,"mds_1":24524,"mds_2":24520},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/94050093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":94050093},{"type":"v1","addr":"172.21.15.98:6833","nonce":94050093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6837/2378138381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2378138381},{"type":"v1","addr":"172.21.15.12:6837","nonce":2378138381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1848806705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1848806705},{"type":"v1","addr":"172.21.15.98:6835","nonce":1848806705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.98:6837/493594054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":493594054},{"type":"v1","addr":"172.21.15.98:6837","nonce":493594054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.12:6839/1469511155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":1469511155},{"type":"v1","addr":"172.21.15.12:6839","nonce":1469511155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.98:6839/2831161859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2831161859},{"type":"v1","addr":"172.21.15.98:6839","nonce":2831161859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24538,"qdb_cluster":[24538,24524,24520]},"id":1}]} 2024-09-15T22:24:15.383 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 25 2024-09-15T22:24:15.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.384+0000 7f27f7000640 1 -- 172.21.15.1:0/4035051433 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f27d40a3350 msgr2=0x7f27d40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:15.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.384+0000 7f27f7000640 1 --2- 172.21.15.1:0/4035051433 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f27d40a3350 0x7f27d40a5810 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f27e0009bd0 tx=0x7f27e0005f90 comp rx=0 tx=0).stop 2024-09-15T22:24:15.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.384+0000 7f27f7000640 1 -- 172.21.15.1:0/4035051433 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27f0077040 msgr2=0x7f27f019f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:15.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.384+0000 7f27f7000640 1 --2- 172.21.15.1:0/4035051433 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27f0077040 0x7f27f019f080 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f27d800e9c0 tx=0x7f27d800ee80 comp rx=0 tx=0).stop 2024-09-15T22:24:15.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.384+0000 7f27f7000640 1 -- 172.21.15.1:0/4035051433 shutdown_connections 2024-09-15T22:24:15.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.384+0000 7f27f7000640 1 --2- 172.21.15.1:0/4035051433 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f27d40a3350 0x7f27d40a5810 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:15.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.384+0000 7f27f7000640 1 --2- 172.21.15.1:0/4035051433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27f0112a30 0x7f27f01a3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:15.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.384+0000 7f27f7000640 1 --2- 172.21.15.1:0/4035051433 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27f0077040 0x7f27f019f080 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:15.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.384+0000 7f27f7000640 1 --2- 172.21.15.1:0/4035051433 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27f0076720 0x7f27f019eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:15.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.384+0000 7f27f7000640 1 -- 172.21.15.1:0/4035051433 >> 172.21.15.1:0/4035051433 conn(0x7f27f00ffa90 msgr2=0x7f27f0101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:15.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.384+0000 7f27f7000640 1 -- 172.21.15.1:0/4035051433 shutdown_connections 2024-09-15T22:24:15.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:15.384+0000 7f27f7000640 1 -- 172.21.15.1:0/4035051433 wait complete. 2024-09-15T22:24:15.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:15 smithi001 ceph-mon[30843]: pgmap v335: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-15T22:24:15.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:15 smithi012 ceph-mon[34883]: pgmap v335: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-15T22:24:15.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:15 smithi098 ceph-mon[35514]: pgmap v335: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-15T22:24:16.163 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:24:16.545 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:16.625 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:16 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/4035051433' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:24:16.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:16 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/4035051433' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:24:16.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:16 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/4035051433' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:24:17.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.087+0000 7f10f8a00640 1 -- 172.21.15.1:0/4000194402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10f41047e0 msgr2=0x7f10f4108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:17.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.087+0000 7f10f8a00640 1 --2- 172.21.15.1:0/4000194402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10f41047e0 0x7f10f4108830 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f10dc009860 tx=0x7f10dc02a340 comp rx=0 tx=0).stop 2024-09-15T22:24:17.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.087+0000 7f10f8a00640 1 -- 172.21.15.1:0/4000194402 shutdown_connections 2024-09-15T22:24:17.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.087+0000 7f10f8a00640 1 --2- 172.21.15.1:0/4000194402 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10f4108f60 0x7f10f4110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:17.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.087+0000 7f10f8a00640 1 --2- 172.21.15.1:0/4000194402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10f41047e0 0x7f10f4108830 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:17.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.087+0000 7f10f8a00640 1 --2- 172.21.15.1:0/4000194402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10f4103e30 0x7f10f4104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:17.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.087+0000 7f10f8a00640 1 -- 172.21.15.1:0/4000194402 >> 172.21.15.1:0/4000194402 conn(0x7f10f40ff910 msgr2=0x7f10f4101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:17.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.087+0000 7f10f8a00640 1 -- 172.21.15.1:0/4000194402 shutdown_connections 2024-09-15T22:24:17.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.087+0000 7f10f8a00640 1 -- 172.21.15.1:0/4000194402 wait complete. 2024-09-15T22:24:17.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.088+0000 7f10f8a00640 1 Processor -- start 2024-09-15T22:24:17.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.088+0000 7f10f8a00640 1 -- start start 2024-09-15T22:24:17.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.088+0000 7f10f8a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10f4103e30 0x7f10f419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:17.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.088+0000 7f10f8a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10f41047e0 0x7f10f419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:17.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.088+0000 7f10f8a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10f4108f60 0x7f10f419ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:17.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.088+0000 7f10f8a00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f10f4113fc0 con 0x7f10f4108f60 2024-09-15T22:24:17.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.088+0000 7f10f8a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f10f4113e40 con 0x7f10f41047e0 2024-09-15T22:24:17.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.088+0000 7f10f8a00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f10f4114140 con 0x7f10f4103e30 2024-09-15T22:24:17.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.088+0000 7f10f3200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10f4108f60 0x7f10f419ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:17.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.088+0000 7f10e9e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10f41047e0 0x7f10f419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:17.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.088+0000 7f10f3200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10f4108f60 0x7f10f419ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34618/0 (socket says 172.21.15.1:34618) 2024-09-15T22:24:17.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.088+0000 7f10f3200640 1 -- 172.21.15.1:0/1356991556 learned_addr learned my addr 172.21.15.1:0/1356991556 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:17.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.089+0000 7f10f2800640 1 --2- 172.21.15.1:0/1356991556 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10f4103e30 0x7f10f419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:17.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.089+0000 7f10e9e00640 1 -- 172.21.15.1:0/1356991556 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10f4103e30 msgr2=0x7f10f419a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:17.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.089+0000 7f10e9e00640 1 --2- 172.21.15.1:0/1356991556 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10f4103e30 0x7f10f419a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:17.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.089+0000 7f10e9e00640 1 -- 172.21.15.1:0/1356991556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10f4108f60 msgr2=0x7f10f419ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:17.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.089+0000 7f10e9e00640 1 --2- 172.21.15.1:0/1356991556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10f4108f60 0x7f10f419ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:17.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.089+0000 7f10e9e00640 1 -- 172.21.15.1:0/1356991556 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f419f430 con 0x7f10f41047e0 2024-09-15T22:24:17.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.089+0000 7f10f3200640 1 --2- 172.21.15.1:0/1356991556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10f4108f60 0x7f10f419ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:17.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.089+0000 7f10e9e00640 1 --2- 172.21.15.1:0/1356991556 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10f41047e0 0x7f10f419a9c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f10dc02a860 tx=0x7f10dc033b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:17.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.089+0000 7f10ebe00640 1 -- 172.21.15.1:0/1356991556 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10dc037040 con 0x7f10f41047e0 2024-09-15T22:24:17.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.089+0000 7f10ebe00640 1 -- 172.21.15.1:0/1356991556 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10dc033d50 con 0x7f10f41047e0 2024-09-15T22:24:17.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.090+0000 7f10f8a00640 1 -- 172.21.15.1:0/1356991556 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10f419f6c0 con 0x7f10f41047e0 2024-09-15T22:24:17.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.090+0000 7f10ebe00640 1 -- 172.21.15.1:0/1356991556 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10dc003960 con 0x7f10f41047e0 2024-09-15T22:24:17.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.090+0000 7f10f8a00640 1 -- 172.21.15.1:0/1356991556 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10f41a7000 con 0x7f10f41047e0 2024-09-15T22:24:17.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.091+0000 7f10f8a00640 1 -- 172.21.15.1:0/1356991556 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10f4105310 con 0x7f10f41047e0 2024-09-15T22:24:17.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.093+0000 7f10ebe00640 1 -- 172.21.15.1:0/1356991556 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f10dc042020 con 0x7f10f41047e0 2024-09-15T22:24:17.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.094+0000 7f10ebe00640 1 --2- 172.21.15.1:0/1356991556 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f10d80a32d0 0x7f10d80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:17.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.094+0000 7f10ebe00640 1 -- 172.21.15.1:0/1356991556 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f10dc0ef4d0 con 0x7f10f41047e0 2024-09-15T22:24:17.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.094+0000 7f10f2800640 1 --2- 172.21.15.1:0/1356991556 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f10d80a32d0 0x7f10d80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:17.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.095+0000 7f10f2800640 1 --2- 172.21.15.1:0/1356991556 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f10d80a32d0 0x7f10d80a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f10e4009bd0 tx=0x7f10e4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:17.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.096+0000 7f10ebe00640 1 -- 172.21.15.1:0/1356991556 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f10dc049020 con 0x7f10f41047e0 2024-09-15T22:24:17.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.317+0000 7f10f8a00640 1 -- 172.21.15.1:0/1356991556 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10f4104210 con 0x7f10f41047e0 2024-09-15T22:24:17.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.318+0000 7f10ebe00640 1 -- 172.21.15.1:0/1356991556 <== mon.2 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11882 (secure 0 0 0) 0x7f10f4104210 con 0x7f10f41047e0 2024-09-15T22:24:17.319 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:24:17.319 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":25,"btime":"2024-09-15T22:23:07:844952+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2417768032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2417768032},{"type":"v1","addr":"172.21.15.1:6835","nonce":2417768032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14493,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2957993064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2957993064},{"type":"v1","addr":"172.21.15.1:6837","nonce":2957993064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14529,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3887277479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3887277479},{"type":"v1","addr":"172.21.15.1:6839","nonce":3887277479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14541,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/1674822398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":1674822398},{"type":"v1","addr":"172.21.15.1:6841","nonce":1674822398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3122570659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3122570659},{"type":"v1","addr":"172.21.15.12:6833","nonce":3122570659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2901262900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2901262900},{"type":"v1","addr":"172.21.15.12:6835","nonce":2901262900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:22:51.743282+0000","modified":"2024-09-15T22:23:06.984789+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24538,"mds_1":24524,"mds_2":24520},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/94050093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":94050093},{"type":"v1","addr":"172.21.15.98:6833","nonce":94050093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6837/2378138381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2378138381},{"type":"v1","addr":"172.21.15.12:6837","nonce":2378138381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1848806705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1848806705},{"type":"v1","addr":"172.21.15.98:6835","nonce":1848806705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.98:6837/493594054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":493594054},{"type":"v1","addr":"172.21.15.98:6837","nonce":493594054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.12:6839/1469511155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":1469511155},{"type":"v1","addr":"172.21.15.12:6839","nonce":1469511155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.98:6839/2831161859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2831161859},{"type":"v1","addr":"172.21.15.98:6839","nonce":2831161859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24538,"qdb_cluster":[24538,24524,24520]},"id":1}]} 2024-09-15T22:24:17.320 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 25 2024-09-15T22:24:17.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.320+0000 7f10f8a00640 1 -- 172.21.15.1:0/1356991556 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f10d80a32d0 msgr2=0x7f10d80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:17.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.320+0000 7f10f8a00640 1 --2- 172.21.15.1:0/1356991556 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f10d80a32d0 0x7f10d80a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f10e4009bd0 tx=0x7f10e4005f90 comp rx=0 tx=0).stop 2024-09-15T22:24:17.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.320+0000 7f10f8a00640 1 -- 172.21.15.1:0/1356991556 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10f41047e0 msgr2=0x7f10f419a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:17.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.320+0000 7f10f8a00640 1 --2- 172.21.15.1:0/1356991556 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10f41047e0 0x7f10f419a9c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f10dc02a860 tx=0x7f10dc033b60 comp rx=0 tx=0).stop 2024-09-15T22:24:17.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.320+0000 7f10f8a00640 1 -- 172.21.15.1:0/1356991556 shutdown_connections 2024-09-15T22:24:17.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.320+0000 7f10f8a00640 1 --2- 172.21.15.1:0/1356991556 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f10d80a32d0 0x7f10d80a5790 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:17.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.320+0000 7f10f8a00640 1 --2- 172.21.15.1:0/1356991556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10f4108f60 0x7f10f419ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:17.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.320+0000 7f10f8a00640 1 --2- 172.21.15.1:0/1356991556 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10f41047e0 0x7f10f419a9c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:17.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.320+0000 7f10f8a00640 1 --2- 172.21.15.1:0/1356991556 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10f4103e30 0x7f10f419a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:17.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.320+0000 7f10f8a00640 1 -- 172.21.15.1:0/1356991556 >> 172.21.15.1:0/1356991556 conn(0x7f10f40ff910 msgr2=0x7f10f4100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:17.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.321+0000 7f10f8a00640 1 -- 172.21.15.1:0/1356991556 shutdown_connections 2024-09-15T22:24:17.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:17.321+0000 7f10f8a00640 1 -- 172.21.15.1:0/1356991556 wait complete. 2024-09-15T22:24:17.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:17 smithi001 ceph-mon[30843]: pgmap v336: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-15T22:24:17.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:17 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/1356991556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:24:17.647 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:17 smithi012 ceph-mon[34883]: pgmap v336: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-15T22:24:17.647 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:17 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/1356991556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:24:17.712 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:17 smithi098 ceph-mon[35514]: pgmap v336: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-15T22:24:17.712 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:17 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/1356991556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:24:18.254 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:24:18.634 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:19.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.220+0000 7f847d600640 1 -- 172.21.15.1:0/1598264751 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84781049a0 msgr2=0x7f84781089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:19.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.220+0000 7f847d600640 1 --2- 172.21.15.1:0/1598264751 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84781049a0 0x7f84781089f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8464009900 tx=0x7f846402a3f0 comp rx=0 tx=0).stop 2024-09-15T22:24:19.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.220+0000 7f847d600640 1 -- 172.21.15.1:0/1598264751 shutdown_connections 2024-09-15T22:24:19.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.220+0000 7f847d600640 1 --2- 172.21.15.1:0/1598264751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8478109120 0x7f8478110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:19.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.220+0000 7f847d600640 1 --2- 172.21.15.1:0/1598264751 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84781049a0 0x7f84781089f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:19.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.220+0000 7f847d600640 1 --2- 172.21.15.1:0/1598264751 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8478103ff0 0x7f84781043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:19.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.220+0000 7f847d600640 1 -- 172.21.15.1:0/1598264751 >> 172.21.15.1:0/1598264751 conn(0x7f84780ffa90 msgr2=0x7f8478101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:19.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.220+0000 7f847d600640 1 -- 172.21.15.1:0/1598264751 shutdown_connections 2024-09-15T22:24:19.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.220+0000 7f847d600640 1 -- 172.21.15.1:0/1598264751 wait complete. 2024-09-15T22:24:19.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.221+0000 7f847d600640 1 Processor -- start 2024-09-15T22:24:19.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.221+0000 7f847d600640 1 -- start start 2024-09-15T22:24:19.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.222+0000 7f847d600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8478103ff0 0x7f847819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:19.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.222+0000 7f847d600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84781049a0 0x7f847819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:19.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.222+0000 7f847d600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8478109120 0x7f847819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:19.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.222+0000 7f847d600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8478114140 con 0x7f84781049a0 2024-09-15T22:24:19.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.222+0000 7f847d600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8478113fc0 con 0x7f8478109120 2024-09-15T22:24:19.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.222+0000 7f847d600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f84781142c0 con 0x7f8478103ff0 2024-09-15T22:24:19.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.222+0000 7f8476000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84781049a0 0x7f847819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:19.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.222+0000 7f8476000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84781049a0 0x7f847819ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34644/0 (socket says 172.21.15.1:34644) 2024-09-15T22:24:19.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.222+0000 7f8476000640 1 -- 172.21.15.1:0/3433155527 learned_addr learned my addr 172.21.15.1:0/3433155527 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:19.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.222+0000 7f8477400640 1 --2- 172.21.15.1:0/3433155527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8478109120 0x7f847819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:19.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.222+0000 7f8476a00640 1 --2- 172.21.15.1:0/3433155527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8478103ff0 0x7f847819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:19.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.222+0000 7f8476000640 1 -- 172.21.15.1:0/3433155527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8478103ff0 msgr2=0x7f847819a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:19.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.222+0000 7f8476000640 1 --2- 172.21.15.1:0/3433155527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8478103ff0 0x7f847819a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:19.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.222+0000 7f8476000640 1 -- 172.21.15.1:0/3433155527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8478109120 msgr2=0x7f847819eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:19.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.222+0000 7f8476000640 1 --2- 172.21.15.1:0/3433155527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8478109120 0x7f847819eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:19.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.222+0000 7f8476000640 1 -- 172.21.15.1:0/3433155527 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f847819f5d0 con 0x7f84781049a0 2024-09-15T22:24:19.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.223+0000 7f8476000640 1 --2- 172.21.15.1:0/3433155527 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84781049a0 0x7f847819ab60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8464006010 tx=0x7f8464004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:19.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.223+0000 7f846f400640 1 -- 172.21.15.1:0/3433155527 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846403f030 con 0x7f84781049a0 2024-09-15T22:24:19.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.223+0000 7f846f400640 1 -- 172.21.15.1:0/3433155527 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8464004440 con 0x7f84781049a0 2024-09-15T22:24:19.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.223+0000 7f847d600640 1 -- 172.21.15.1:0/3433155527 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f847819f860 con 0x7f84781049a0 2024-09-15T22:24:19.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.223+0000 7f846f400640 1 -- 172.21.15.1:0/3433155527 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8464035070 con 0x7f84781049a0 2024-09-15T22:24:19.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.223+0000 7f847d600640 1 -- 172.21.15.1:0/3433155527 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84781a71a0 con 0x7f84781049a0 2024-09-15T22:24:19.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.224+0000 7f847d600640 1 -- 172.21.15.1:0/3433155527 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84781054d0 con 0x7f84781049a0 2024-09-15T22:24:19.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.226+0000 7f846f400640 1 -- 172.21.15.1:0/3433155527 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f8464042030 con 0x7f84781049a0 2024-09-15T22:24:19.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.228+0000 7f846f400640 1 --2- 172.21.15.1:0/3433155527 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f845c0a32d0 0x7f845c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:19.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.228+0000 7f846f400640 1 -- 172.21.15.1:0/3433155527 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f84640efe50 con 0x7f84781049a0 2024-09-15T22:24:19.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.228+0000 7f8476a00640 1 --2- 172.21.15.1:0/3433155527 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f845c0a32d0 0x7f845c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:19.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.229+0000 7f8476a00640 1 --2- 172.21.15.1:0/3433155527 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f845c0a32d0 0x7f845c0a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8468009bd0 tx=0x7f8468005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:19.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.232+0000 7f846f400640 1 -- 172.21.15.1:0/3433155527 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f84640bc350 con 0x7f84781049a0 2024-09-15T22:24:19.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.420+0000 7f847d600640 1 -- 172.21.15.1:0/3433155527 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f847810c360 con 0x7f84781049a0 2024-09-15T22:24:19.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.421+0000 7f846f400640 1 -- 172.21.15.1:0/3433155527 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22647 (secure 0 0 0) 0x7f84640c0650 con 0x7f84781049a0 2024-09-15T22:24:19.423 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:24:19.423 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":84,"fsid":"c1228c44-73af-11ef-bceb-c7b262605968","created":"2024-09-15T22:14:39.004556+0000","modified":"2024-09-15T22:23:32.904008+0000","last_up_change":"2024-09-15T22:21:53.270221+0000","last_in_change":"2024-09-15T22:21:30.911945+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:17:56.059390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:22:47.262081+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:22:49.746577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28228d47-bbb7-4103-a4fb-3e126769f8bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6803","nonce":3588868833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6805","nonce":3588868833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6809","nonce":3588868833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6807","nonce":3588868833}]},"public_addr":"172.21.15.1:6803/3588868833","cluster_addr":"172.21.15.1:6805/3588868833","heartbeat_back_addr":"172.21.15.1:6809/3588868833","heartbeat_front_addr":"172.21.15.1:6807/3588868833","state":["exists","up"]},{"osd":1,"uuid":"d90dd2c1-2047-4491-8730-30793a354aa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6801","nonce":3951165354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6803","nonce":3951165354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6807","nonce":3951165354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6805","nonce":3951165354}]},"public_addr":"172.21.15.12:6801/3951165354","cluster_addr":"172.21.15.12:6803/3951165354","heartbeat_back_addr":"172.21.15.12:6807/3951165354","heartbeat_front_addr":"172.21.15.12:6805/3951165354","state":["exists","up"]},{"osd":2,"uuid":"22e38f44-88d3-4461-a57e-6dc4857ec48f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6801","nonce":1633982971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6803","nonce":1633982971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6807","nonce":1633982971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6805","nonce":1633982971}]},"public_addr":"172.21.15.98:6801/1633982971","cluster_addr":"172.21.15.98:6803/1633982971","heartbeat_back_addr":"172.21.15.98:6807/1633982971","heartbeat_front_addr":"172.21.15.98:6805/1633982971","state":["exists","up"]},{"osd":3,"uuid":"dd9d6e97-af81-442a-ac0d-543e440a8d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6811","nonce":3706738461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6813","nonce":3706738461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6817","nonce":3706738461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6815","nonce":3706738461}]},"public_addr":"172.21.15.1:6811/3706738461","cluster_addr":"172.21.15.1:6813/3706738461","heartbeat_back_addr":"172.21.15.1:6817/3706738461","heartbeat_front_addr":"172.21.15.1:6815/3706738461","state":["exists","up"]},{"osd":4,"uuid":"50116baa-dd99-4dbb-a7a1-2268f04052f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6809","nonce":4057902964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6811","nonce":4057902964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6815","nonce":4057902964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6813","nonce":4057902964}]},"public_addr":"172.21.15.12:6809/4057902964","cluster_addr":"172.21.15.12:6811/4057902964","heartbeat_back_addr":"172.21.15.12:6815/4057902964","heartbeat_front_addr":"172.21.15.12:6813/4057902964","state":["exists","up"]},{"osd":5,"uuid":"56ab0694-2f21-46c4-a086-44f72c271c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6809","nonce":4043567619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6811","nonce":4043567619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6815","nonce":4043567619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6813","nonce":4043567619}]},"public_addr":"172.21.15.98:6809/4043567619","cluster_addr":"172.21.15.98:6811/4043567619","heartbeat_back_addr":"172.21.15.98:6815/4043567619","heartbeat_front_addr":"172.21.15.98:6813/4043567619","state":["exists","up"]},{"osd":6,"uuid":"5ca0d114-4894-428e-bcd3-2ebd24d10a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6819","nonce":2236861161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6821","nonce":2236861161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6825","nonce":2236861161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6823","nonce":2236861161}]},"public_addr":"172.21.15.1:6819/2236861161","cluster_addr":"172.21.15.1:6821/2236861161","heartbeat_back_addr":"172.21.15.1:6825/2236861161","heartbeat_front_addr":"172.21.15.1:6823/2236861161","state":["exists","up"]},{"osd":7,"uuid":"db99cc6e-1717-4958-bf11-65aca94476b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6817","nonce":133202448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6819","nonce":133202448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6823","nonce":133202448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6821","nonce":133202448}]},"public_addr":"172.21.15.12:6817/133202448","cluster_addr":"172.21.15.12:6819/133202448","heartbeat_back_addr":"172.21.15.12:6823/133202448","heartbeat_front_addr":"172.21.15.12:6821/133202448","state":["exists","up"]},{"osd":8,"uuid":"4d3b6574-49f7-47f6-b36b-4da14ca290f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6817","nonce":3701478409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6819","nonce":3701478409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6823","nonce":3701478409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6821","nonce":3701478409}]},"public_addr":"172.21.15.98:6817/3701478409","cluster_addr":"172.21.15.98:6819/3701478409","heartbeat_back_addr":"172.21.15.98:6823/3701478409","heartbeat_front_addr":"172.21.15.98:6821/3701478409","state":["exists","up"]},{"osd":9,"uuid":"7dd2fe25-1b75-48e5-86c7-c7a3ab85053f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6827","nonce":2580755002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6829","nonce":2580755002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6833","nonce":2580755002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6831","nonce":2580755002}]},"public_addr":"172.21.15.1:6827/2580755002","cluster_addr":"172.21.15.1:6829/2580755002","heartbeat_back_addr":"172.21.15.1:6833/2580755002","heartbeat_front_addr":"172.21.15.1:6831/2580755002","state":["exists","up"]},{"osd":10,"uuid":"fcad11dc-0a1b-44a2-ac32-74100e317255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6825","nonce":3989063573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6827","nonce":3989063573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6831","nonce":3989063573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6829","nonce":3989063573}]},"public_addr":"172.21.15.12:6825/3989063573","cluster_addr":"172.21.15.12:6827/3989063573","heartbeat_back_addr":"172.21.15.12:6831/3989063573","heartbeat_front_addr":"172.21.15.12:6829/3989063573","state":["exists","up"]},{"osd":11,"uuid":"f4e717bb-586d-4fe2-9e6b-f574be4db36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6825","nonce":839956167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6827","nonce":839956167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6831","nonce":839956167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6829","nonce":839956167}]},"public_addr":"172.21.15.98:6825/839956167","cluster_addr":"172.21.15.98:6827/839956167","heartbeat_back_addr":"172.21.15.98:6831/839956167","heartbeat_front_addr":"172.21.15.98:6829/839956167","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:17:01.990618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:17:28.259003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:17:52.825080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:18:22.724038+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:18:48.383663+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:19:13.246563+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:19:42.318469+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:20:08.809160+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:20:32.628925+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:21:02.280217+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:21:27.897758+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:21:52.055015+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6800/3145051160":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/3101438101":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/4159811089":"2024-09-16T22:15:31.433375+0000","172.21.15.1:6801/3145051160":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/2785155592":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/714180295":"2024-09-16T22:15:03.937536+0000","172.21.15.1:6801/215291238":"2024-09-16T22:15:03.937536+0000","172.21.15.1:6800/215291238":"2024-09-16T22:15:03.937536+0000","172.21.15.1:0/1842817732":"2024-09-16T22:15:03.937536+0000","172.21.15.1:0/3888009741":"2024-09-16T22:15:03.937536+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:24:19.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.424+0000 7f847d600640 1 -- 172.21.15.1:0/3433155527 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f845c0a32d0 msgr2=0x7f845c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:19.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.424+0000 7f847d600640 1 --2- 172.21.15.1:0/3433155527 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f845c0a32d0 0x7f845c0a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8468009bd0 tx=0x7f8468005f90 comp rx=0 tx=0).stop 2024-09-15T22:24:19.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.424+0000 7f847d600640 1 -- 172.21.15.1:0/3433155527 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84781049a0 msgr2=0x7f847819ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:19.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.424+0000 7f847d600640 1 --2- 172.21.15.1:0/3433155527 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84781049a0 0x7f847819ab60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8464006010 tx=0x7f8464004040 comp rx=0 tx=0).stop 2024-09-15T22:24:19.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.424+0000 7f847d600640 1 -- 172.21.15.1:0/3433155527 shutdown_connections 2024-09-15T22:24:19.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.424+0000 7f847d600640 1 --2- 172.21.15.1:0/3433155527 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f845c0a32d0 0x7f845c0a5790 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:19.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.424+0000 7f847d600640 1 --2- 172.21.15.1:0/3433155527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8478109120 0x7f847819eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:19.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.424+0000 7f847d600640 1 --2- 172.21.15.1:0/3433155527 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84781049a0 0x7f847819ab60 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:19.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.424+0000 7f847d600640 1 --2- 172.21.15.1:0/3433155527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8478103ff0 0x7f847819a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:19.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.424+0000 7f847d600640 1 -- 172.21.15.1:0/3433155527 >> 172.21.15.1:0/3433155527 conn(0x7f84780ffa90 msgr2=0x7f8478100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:19.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.424+0000 7f847d600640 1 -- 172.21.15.1:0/3433155527 shutdown_connections 2024-09-15T22:24:19.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:19.424+0000 7f847d600640 1 -- 172.21.15.1:0/3433155527 wait complete. 2024-09-15T22:24:19.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:19 smithi012 ceph-mon[34883]: pgmap v337: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-15T22:24:19.796 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:19 smithi001 ceph-mon[30843]: pgmap v337: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-15T22:24:19.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:19 smithi098 ceph-mon[35514]: pgmap v337: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-15T22:24:20.202 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:24:20.579 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:20.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:20 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/3433155527' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:24:20.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:20 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/3433155527' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:24:20.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:20 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/3433155527' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:24:21.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.152+0000 7f79c8200640 1 -- 172.21.15.1:0/866204051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79c0109120 msgr2=0x7f79c0110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:21.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.152+0000 7f79c8200640 1 --2- 172.21.15.1:0/866204051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79c0109120 0x7f79c0110ca0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f79b8009be0 tx=0x7f79b802a6c0 comp rx=0 tx=0).stop 2024-09-15T22:24:21.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.152+0000 7f79c8200640 1 -- 172.21.15.1:0/866204051 shutdown_connections 2024-09-15T22:24:21.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.152+0000 7f79c8200640 1 --2- 172.21.15.1:0/866204051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79c0109120 0x7f79c0110ca0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:21.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.152+0000 7f79c8200640 1 --2- 172.21.15.1:0/866204051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79c01049a0 0x7f79c01089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:21.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.152+0000 7f79c8200640 1 --2- 172.21.15.1:0/866204051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79c0103ff0 0x7f79c01043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:21.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.152+0000 7f79c8200640 1 -- 172.21.15.1:0/866204051 >> 172.21.15.1:0/866204051 conn(0x7f79c00ffa90 msgr2=0x7f79c0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:21.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.152+0000 7f79c8200640 1 -- 172.21.15.1:0/866204051 shutdown_connections 2024-09-15T22:24:21.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.152+0000 7f79c8200640 1 -- 172.21.15.1:0/866204051 wait complete. 2024-09-15T22:24:21.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.153+0000 7f79c8200640 1 Processor -- start 2024-09-15T22:24:21.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.153+0000 7f79c8200640 1 -- start start 2024-09-15T22:24:21.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.154+0000 7f79c8200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79c0103ff0 0x7f79c019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:21.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.154+0000 7f79c8200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79c01049a0 0x7f79c019aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:21.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.154+0000 7f79c8200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79c0109120 0x7f79c019ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:21.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.154+0000 7f79c8200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f79c0114130 con 0x7f79c0103ff0 2024-09-15T22:24:21.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.154+0000 7f79c8200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f79c0113fb0 con 0x7f79c01049a0 2024-09-15T22:24:21.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.154+0000 7f79c8200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f79c01142b0 con 0x7f79c0109120 2024-09-15T22:24:21.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.154+0000 7f79c5800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79c0103ff0 0x7f79c019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:21.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.154+0000 7f79c5800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79c0103ff0 0x7f79c019a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34654/0 (socket says 172.21.15.1:34654) 2024-09-15T22:24:21.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.154+0000 7f79c5800640 1 -- 172.21.15.1:0/519798631 learned_addr learned my addr 172.21.15.1:0/519798631 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:21.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.154+0000 7f79c4e00640 1 --2- 172.21.15.1:0/519798631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79c01049a0 0x7f79c019aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:21.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.154+0000 7f79c6200640 1 --2- 172.21.15.1:0/519798631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79c0109120 0x7f79c019ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:21.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.155+0000 7f79c5800640 1 -- 172.21.15.1:0/519798631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79c0109120 msgr2=0x7f79c019ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:21.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.155+0000 7f79c5800640 1 --2- 172.21.15.1:0/519798631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79c0109120 0x7f79c019ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:21.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.155+0000 7f79c5800640 1 -- 172.21.15.1:0/519798631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79c01049a0 msgr2=0x7f79c019aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:21.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.155+0000 7f79c5800640 1 --2- 172.21.15.1:0/519798631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79c01049a0 0x7f79c019aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:21.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.155+0000 7f79c5800640 1 -- 172.21.15.1:0/519798631 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c019f540 con 0x7f79c0103ff0 2024-09-15T22:24:21.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.155+0000 7f79c5800640 1 --2- 172.21.15.1:0/519798631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79c0103ff0 0x7f79c019a590 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f79b400e9c0 tx=0x7f79b400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:21.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.155+0000 7f79be000640 1 -- 172.21.15.1:0/519798631 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b400ccc0 con 0x7f79c0103ff0 2024-09-15T22:24:21.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.155+0000 7f79c8200640 1 -- 172.21.15.1:0/519798631 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79c019f830 con 0x7f79c0103ff0 2024-09-15T22:24:21.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.155+0000 7f79be000640 1 -- 172.21.15.1:0/519798631 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79b4005500 con 0x7f79c0103ff0 2024-09-15T22:24:21.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.155+0000 7f79be000640 1 -- 172.21.15.1:0/519798631 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b4010430 con 0x7f79c0103ff0 2024-09-15T22:24:21.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.155+0000 7f79c8200640 1 -- 172.21.15.1:0/519798631 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79c01a7110 con 0x7f79c0103ff0 2024-09-15T22:24:21.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.156+0000 7f79c8200640 1 -- 172.21.15.1:0/519798631 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79c01043d0 con 0x7f79c0103ff0 2024-09-15T22:24:21.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.158+0000 7f79be000640 1 -- 172.21.15.1:0/519798631 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f79b40046c0 con 0x7f79c0103ff0 2024-09-15T22:24:21.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.160+0000 7f79be000640 1 --2- 172.21.15.1:0/519798631 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f79a80a32d0 0x7f79a80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:21.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.160+0000 7f79be000640 1 -- 172.21.15.1:0/519798631 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f79b40cffe0 con 0x7f79c0103ff0 2024-09-15T22:24:21.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.160+0000 7f79c4e00640 1 --2- 172.21.15.1:0/519798631 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f79a80a32d0 0x7f79a80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:21.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.161+0000 7f79c4e00640 1 --2- 172.21.15.1:0/519798631 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f79a80a32d0 0x7f79a80a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f79c010aa90 tx=0x7f79ac005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:21.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.162+0000 7f79be000640 1 -- 172.21.15.1:0/519798631 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f79b40541b0 con 0x7f79c0103ff0 2024-09-15T22:24:21.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.384+0000 7f79c8200640 1 -- 172.21.15.1:0/519798631 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79c019b8f0 con 0x7f79c0103ff0 2024-09-15T22:24:21.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.385+0000 7f79be000640 1 -- 172.21.15.1:0/519798631 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11882 (secure 0 0 0) 0x7f79c019b8f0 con 0x7f79c0103ff0 2024-09-15T22:24:21.386 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:24:21.386 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":25,"btime":"2024-09-15T22:23:07:844952+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2417768032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2417768032},{"type":"v1","addr":"172.21.15.1:6835","nonce":2417768032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14493,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2957993064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2957993064},{"type":"v1","addr":"172.21.15.1:6837","nonce":2957993064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14529,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3887277479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3887277479},{"type":"v1","addr":"172.21.15.1:6839","nonce":3887277479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14541,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/1674822398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":1674822398},{"type":"v1","addr":"172.21.15.1:6841","nonce":1674822398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3122570659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3122570659},{"type":"v1","addr":"172.21.15.12:6833","nonce":3122570659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2901262900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2901262900},{"type":"v1","addr":"172.21.15.12:6835","nonce":2901262900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:22:51.743282+0000","modified":"2024-09-15T22:23:06.984789+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24538,"mds_1":24524,"mds_2":24520},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/94050093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":94050093},{"type":"v1","addr":"172.21.15.98:6833","nonce":94050093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6837/2378138381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2378138381},{"type":"v1","addr":"172.21.15.12:6837","nonce":2378138381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1848806705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1848806705},{"type":"v1","addr":"172.21.15.98:6835","nonce":1848806705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.98:6837/493594054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":493594054},{"type":"v1","addr":"172.21.15.98:6837","nonce":493594054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.12:6839/1469511155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":1469511155},{"type":"v1","addr":"172.21.15.12:6839","nonce":1469511155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.98:6839/2831161859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2831161859},{"type":"v1","addr":"172.21.15.98:6839","nonce":2831161859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24538,"qdb_cluster":[24538,24524,24520]},"id":1}]} 2024-09-15T22:24:21.387 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 25 2024-09-15T22:24:21.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.388+0000 7f79c8200640 1 -- 172.21.15.1:0/519798631 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f79a80a32d0 msgr2=0x7f79a80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:21.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.388+0000 7f79c8200640 1 --2- 172.21.15.1:0/519798631 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f79a80a32d0 0x7f79a80a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f79c010aa90 tx=0x7f79ac005f90 comp rx=0 tx=0).stop 2024-09-15T22:24:21.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.388+0000 7f79c8200640 1 -- 172.21.15.1:0/519798631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79c0103ff0 msgr2=0x7f79c019a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:21.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.388+0000 7f79c8200640 1 --2- 172.21.15.1:0/519798631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79c0103ff0 0x7f79c019a590 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f79b400e9c0 tx=0x7f79b400ee80 comp rx=0 tx=0).stop 2024-09-15T22:24:21.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.388+0000 7f79c8200640 1 -- 172.21.15.1:0/519798631 shutdown_connections 2024-09-15T22:24:21.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.388+0000 7f79c8200640 1 --2- 172.21.15.1:0/519798631 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f79a80a32d0 0x7f79a80a5790 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:21.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.388+0000 7f79c8200640 1 --2- 172.21.15.1:0/519798631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79c0109120 0x7f79c019ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:21.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.388+0000 7f79c8200640 1 --2- 172.21.15.1:0/519798631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79c01049a0 0x7f79c019aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:21.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.388+0000 7f79c8200640 1 --2- 172.21.15.1:0/519798631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79c0103ff0 0x7f79c019a590 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:21.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.388+0000 7f79c8200640 1 -- 172.21.15.1:0/519798631 >> 172.21.15.1:0/519798631 conn(0x7f79c00ffa90 msgr2=0x7f79c0101ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:21.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.388+0000 7f79c8200640 1 -- 172.21.15.1:0/519798631 shutdown_connections 2024-09-15T22:24:21.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:21.388+0000 7f79c8200640 1 -- 172.21.15.1:0/519798631 wait complete. 2024-09-15T22:24:21.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:21 smithi012 ceph-mon[34883]: pgmap v338: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-15T22:24:21.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:21 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/519798631' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:24:21.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:21 smithi098 ceph-mon[35514]: pgmap v338: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-15T22:24:21.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:21 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/519798631' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:24:21.817 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:21 smithi001 ceph-mon[30843]: pgmap v338: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-15T22:24:21.817 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:21 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/519798631' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:24:22.168 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-15T22:22:51.743282+0000', 'modified': '2024-09-15T22:23:06.984789+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24538, 'mds_1': 24524, 'mds_2': 24520}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24466': {'gid': 24466, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.98:6833/94050093', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6832', 'nonce': 94050093}, {'type': 'v1', 'addr': '172.21.15.98:6833', 'nonce': 94050093}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24482': {'gid': 24482, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.12:6837/2378138381', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6836', 'nonce': 2378138381}, {'type': 'v1', 'addr': '172.21.15.12:6837', 'nonce': 2378138381}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24514': {'gid': 24514, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.98:6835/1848806705', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6834', 'nonce': 1848806705}, {'type': 'v1', 'addr': '172.21.15.98:6835', 'nonce': 1848806705}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24520': {'gid': 24520, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.98:6837/493594054', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6836', 'nonce': 493594054}, {'type': 'v1', 'addr': '172.21.15.98:6837', 'nonce': 493594054}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24524': {'gid': 24524, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.12:6839/1469511155', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6838', 'nonce': 1469511155}, {'type': 'v1', 'addr': '172.21.15.12:6839', 'nonce': 1469511155}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24538': {'gid': 24538, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.98:6839/2831161859', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6838', 'nonce': 2831161859}, {'type': 'v1', 'addr': '172.21.15.98:6839', 'nonce': 2831161859}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24538, 'qdb_cluster': [24538, 24524, 24520]} 2024-09-15T22:24:22.168 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-15T22:24:22.168 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-15T22:24:22.544 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:23.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.137+0000 7fa0ffe00640 1 -- 172.21.15.1:0/961441050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa100074510 msgr2=0x7fa1000748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:23.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.137+0000 7fa0ffe00640 1 --2- 172.21.15.1:0/961441050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa100074510 0x7fa1000748f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0009900 tx=0x7fa0f002a480 comp rx=0 tx=0).stop 2024-09-15T22:24:23.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.137+0000 7fa0ffe00640 1 -- 172.21.15.1:0/961441050 shutdown_connections 2024-09-15T22:24:23.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.137+0000 7fa0ffe00640 1 --2- 172.21.15.1:0/961441050 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa10010e280 0x7fa100110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:23.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.137+0000 7fa0ffe00640 1 --2- 172.21.15.1:0/961441050 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa100074e30 0x7fa10010dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:23.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.137+0000 7fa0ffe00640 1 --2- 172.21.15.1:0/961441050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa100074510 0x7fa1000748f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:23.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.137+0000 7fa0ffe00640 1 -- 172.21.15.1:0/961441050 >> 172.21.15.1:0/961441050 conn(0x7fa1000fd740 msgr2=0x7fa1000ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:23.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.137+0000 7fa0ffe00640 1 -- 172.21.15.1:0/961441050 shutdown_connections 2024-09-15T22:24:23.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.137+0000 7fa0ffe00640 1 -- 172.21.15.1:0/961441050 wait complete. 2024-09-15T22:24:23.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.138+0000 7fa0ffe00640 1 Processor -- start 2024-09-15T22:24:23.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.138+0000 7fa0ffe00640 1 -- start start 2024-09-15T22:24:23.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.139+0000 7fa0ffe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa100074510 0x7fa10019a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:23.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.139+0000 7fa0ffe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa100074e30 0x7fa10019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:23.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.139+0000 7fa0ffe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa10010e280 0x7fa10019ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:23.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.139+0000 7fa0ffe00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa100113fb0 con 0x7fa100074e30 2024-09-15T22:24:23.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.139+0000 7fa0ffe00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa100113e30 con 0x7fa100074510 2024-09-15T22:24:23.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.139+0000 7fa0ffe00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa100114130 con 0x7fa10010e280 2024-09-15T22:24:23.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.139+0000 7fa0fe000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa100074e30 0x7fa10019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:23.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.139+0000 7fa0fe000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa100074e30 0x7fa10019aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34678/0 (socket says 172.21.15.1:34678) 2024-09-15T22:24:23.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.139+0000 7fa0fe000640 1 -- 172.21.15.1:0/1719549920 learned_addr learned my addr 172.21.15.1:0/1719549920 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:23.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.139+0000 7fa0fea00640 1 --2- 172.21.15.1:0/1719549920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa100074510 0x7fa10019a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:23.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.139+0000 7fa0ff400640 1 --2- 172.21.15.1:0/1719549920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa10010e280 0x7fa10019ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:23.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.140+0000 7fa0fe000640 1 -- 172.21.15.1:0/1719549920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa10010e280 msgr2=0x7fa10019ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:23.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.140+0000 7fa0fe000640 1 --2- 172.21.15.1:0/1719549920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa10010e280 0x7fa10019ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:23.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.140+0000 7fa0fe000640 1 -- 172.21.15.1:0/1719549920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa100074510 msgr2=0x7fa10019a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:23.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.140+0000 7fa0fe000640 1 --2- 172.21.15.1:0/1719549920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa100074510 0x7fa10019a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:23.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.140+0000 7fa0fe000640 1 -- 172.21.15.1:0/1719549920 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa10019f4f0 con 0x7fa100074e30 2024-09-15T22:24:23.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.140+0000 7fa0fea00640 1 --2- 172.21.15.1:0/1719549920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa100074510 0x7fa10019a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:23.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.140+0000 7fa0fe000640 1 --2- 172.21.15.1:0/1719549920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa100074e30 0x7fa10019aa80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec00e9f0 tx=0x7fa0ec00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:23.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.140+0000 7fa0f7400640 1 -- 172.21.15.1:0/1719549920 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec00cd80 con 0x7fa100074e30 2024-09-15T22:24:23.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.140+0000 7fa0ffe00640 1 -- 172.21.15.1:0/1719549920 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa10019f7e0 con 0x7fa100074e30 2024-09-15T22:24:23.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.140+0000 7fa0f7400640 1 -- 172.21.15.1:0/1719549920 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0ec005500 con 0x7fa100074e30 2024-09-15T22:24:23.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.140+0000 7fa0f7400640 1 -- 172.21.15.1:0/1719549920 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec010690 con 0x7fa100074e30 2024-09-15T22:24:23.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.140+0000 7fa0ffe00640 1 -- 172.21.15.1:0/1719549920 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1001a70c0 con 0x7fa100074e30 2024-09-15T22:24:23.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.145+0000 7fa1083cb740 1 Processor -- start 2024-09-15T22:24:23.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.145+0000 7fa1083cb740 1 -- start start 2024-09-15T22:24:23.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.145+0000 7fa1083cb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5652f0bea4e0 0x5652f0bea8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:23.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.145+0000 7fa1083cb740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652f0beae00 0x5652f0bf5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:23.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.146+0000 7fa1083cb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5652f0bf56c0 0x5652f0bf7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:23.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.146+0000 7fa1083cb740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5652f0b500b0 con 0x5652f0beae00 2024-09-15T22:24:23.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.146+0000 7fa1083cb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5652f0af7ab0 con 0x5652f0bea4e0 2024-09-15T22:24:23.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.146+0000 7fa1083cb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5652f0b4c070 con 0x5652f0bf56c0 2024-09-15T22:24:23.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.146+0000 7fa0fea00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652f0beae00 0x5652f0bf5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:23.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.146+0000 7fa0f7400640 1 -- 172.21.15.1:0/1719549920 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fa0ec0046c0 con 0x7fa100074e30 2024-09-15T22:24:23.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.146+0000 7fa0fea00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652f0beae00 0x5652f0bf5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34680/0 (socket says 172.21.15.1:34680) 2024-09-15T22:24:23.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.146+0000 7fa0fea00640 1 -- 172.21.15.1:0/1210488580 learned_addr learned my addr 172.21.15.1:0/1210488580 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:23.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.146+0000 7fa0ff400640 1 --2- 172.21.15.1:0/1210488580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5652f0bea4e0 0x5652f0bea8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:23.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.146+0000 7fa0fea00640 1 -- 172.21.15.1:0/1210488580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5652f0bf56c0 msgr2=0x5652f0bf7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:23.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.146+0000 7fa0fea00640 1 --2- 172.21.15.1:0/1210488580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5652f0bf56c0 0x5652f0bf7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:23.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.146+0000 7fa0fea00640 1 -- 172.21.15.1:0/1210488580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5652f0bea4e0 msgr2=0x5652f0bea8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:23.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.146+0000 7fa0fea00640 1 --2- 172.21.15.1:0/1210488580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5652f0bea4e0 0x5652f0bea8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:23.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.146+0000 7fa0fea00640 1 -- 172.21.15.1:0/1210488580 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652f0b044a0 con 0x5652f0beae00 2024-09-15T22:24:23.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.146+0000 7fa0ff400640 1 --2- 172.21.15.1:0/1210488580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5652f0bea4e0 0x5652f0bea8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:23.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.147+0000 7fa0fea00640 1 --2- 172.21.15.1:0/1210488580 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652f0beae00 0x5652f0bf5180 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0009900 tx=0x7fa0f0005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3acd562612ae20f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:23.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.147+0000 7fa0ebe00640 1 -- 172.21.15.1:0/1210488580 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0035040 con 0x5652f0beae00 2024-09-15T22:24:23.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.147+0000 7fa0ebe00640 1 -- 172.21.15.1:0/1210488580 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0f0031830 con 0x5652f0beae00 2024-09-15T22:24:23.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.147+0000 7fa0ebe00640 1 -- 172.21.15.1:0/1210488580 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f00047a0 con 0x5652f0beae00 2024-09-15T22:24:23.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.148+0000 7fa1083cb740 1 -- 172.21.15.1:0/1210488580 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652f0beae00 msgr2=0x5652f0bf5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:23.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.148+0000 7fa1083cb740 1 --2- 172.21.15.1:0/1210488580 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652f0beae00 0x5652f0bf5180 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0009900 tx=0x7fa0f0005d50 comp rx=0 tx=0).stop 2024-09-15T22:24:23.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.148+0000 7fa1083cb740 1 -- 172.21.15.1:0/1210488580 shutdown_connections 2024-09-15T22:24:23.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.148+0000 7fa1083cb740 1 --2- 172.21.15.1:0/1210488580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5652f0bf56c0 0x5652f0bf7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:23.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.148+0000 7fa1083cb740 1 --2- 172.21.15.1:0/1210488580 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652f0beae00 0x5652f0bf5180 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:23.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.148+0000 7fa1083cb740 1 --2- 172.21.15.1:0/1210488580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5652f0bea4e0 0x5652f0bea8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:23.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.148+0000 7fa1083cb740 1 -- 172.21.15.1:0/1210488580 >> 172.21.15.1:0/1210488580 conn(0x5652f0be6a70 msgr2=0x5652f0be6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:23.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.148+0000 7fa1083cb740 1 -- 172.21.15.1:0/1210488580 shutdown_connections 2024-09-15T22:24:23.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.148+0000 7fa0f7400640 1 --2- 172.21.15.1:0/1719549920 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa0e40a31e0 0x7fa0e40a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:23.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.148+0000 7fa1083cb740 1 -- 172.21.15.1:0/1210488580 wait complete. 2024-09-15T22:24:23.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.148+0000 7fa0f7400640 1 -- 172.21.15.1:0/1719549920 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fa0ec0cfef0 con 0x7fa100074e30 2024-09-15T22:24:23.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.148+0000 7fa0fea00640 1 --2- 172.21.15.1:0/1719549920 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa0e40a31e0 0x7fa0e40a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:23.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.148+0000 7fa1083cb740 1 -- start start 2024-09-15T22:24:23.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.149+0000 7fa1083cb740 1 Processor -- start 2024-09-15T22:24:23.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.149+0000 7fa0fea00640 1 --2- 172.21.15.1:0/1719549920 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa0e40a31e0 0x7fa0e40a56a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0000c00 tx=0x7fa0f002a480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:23.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.149+0000 7fa1083cb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5652f0bea4e0 0x5652f0bf2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:23.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.149+0000 7fa1083cb740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652f0beae00 0x5652f0bf2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:23.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.149+0000 7fa1083cb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5652f0bf56c0 0x5652f0bf3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:23.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.149+0000 7fa1083cb740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5652f0bf8330 con 0x5652f0beae00 2024-09-15T22:24:23.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.149+0000 7fa1083cb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5652f0ad8920 con 0x5652f0bf56c0 2024-09-15T22:24:23.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.149+0000 7fa1083cb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5652f0bf84b0 con 0x5652f0bea4e0 2024-09-15T22:24:23.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.149+0000 7fa1083cb740 10 client.0 _ll_register_callbacks cb 0x5652f0afc8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:24:23.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.150+0000 7fa0fe000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652f0beae00 0x5652f0bf2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:23.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.150+0000 7fa0fea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5652f0bea4e0 0x5652f0bf2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:23.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.150+0000 7fa0fea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5652f0bea4e0 0x5652f0bf2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:39746/0 (socket says 172.21.15.1:39746) 2024-09-15T22:24:23.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.150+0000 7fa0fe000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652f0beae00 0x5652f0bf2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34686/0 (socket says 172.21.15.1:34686) 2024-09-15T22:24:23.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.150+0000 7fa0fea00640 1 -- 172.21.15.1:0/365562765 learned_addr learned my addr 172.21.15.1:0/365562765 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:23.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.150+0000 7fa0ff400640 1 --2- 172.21.15.1:0/365562765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5652f0bf56c0 0x5652f0bf3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:23.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.150+0000 7fa0fe000640 1 -- 172.21.15.1:0/365562765 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5652f0bea4e0 msgr2=0x5652f0bf2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:23.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.150+0000 7fa0fe000640 1 --2- 172.21.15.1:0/365562765 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5652f0bea4e0 0x5652f0bf2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:23.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.150+0000 7fa0fe000640 1 -- 172.21.15.1:0/365562765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5652f0bf56c0 msgr2=0x5652f0bf3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:23.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.150+0000 7fa0fe000640 1 --2- 172.21.15.1:0/365562765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5652f0bf56c0 0x5652f0bf3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:23.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.150+0000 7fa0fe000640 1 -- 172.21.15.1:0/365562765 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652f08c12b0 con 0x5652f0beae00 2024-09-15T22:24:23.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.150+0000 7fa0fea00640 1 --2- 172.21.15.1:0/365562765 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5652f0bea4e0 0x5652f0bf2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:23.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.150+0000 7fa0fe000640 1 --2- 172.21.15.1:0/365562765 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652f0beae00 0x5652f0bf2ac0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec0cd830 tx=0x7fa0ec09bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f4ea1f5a9c3c40 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:23.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.150+0000 7fa0e8c00640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-15T22:24:23.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.151+0000 7fa0e8c00640 1 -- 172.21.15.1:0/365562765 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec0b5060 con 0x5652f0beae00 2024-09-15T22:24:23.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.151+0000 7fa0e8c00640 1 -- 172.21.15.1:0/365562765 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fa0ec0a4b20 con 0x5652f0beae00 2024-09-15T22:24:23.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.151+0000 7fa1083cb740 1 -- 172.21.15.1:0/365562765 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0f0031830 con 0x5652f0beae00 2024-09-15T22:24:23.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.151+0000 7fa0e8c00640 1 -- 172.21.15.1:0/365562765 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa0ec0a06f0 con 0x5652f0beae00 2024-09-15T22:24:23.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.151+0000 7fa1083cb740 10 client.14892 fetch_fsmap learned FSMap version 25 2024-09-15T22:24:23.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.151+0000 7fa1083cb740 1 -- 172.21.15.1:0/365562765 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5652f0c04010 con 0x5652f0beae00 2024-09-15T22:24:23.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.151+0000 7fa0e8c00640 1 -- 172.21.15.1:0/365562765 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0f0031830 con 0x5652f0beae00 2024-09-15T22:24:23.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.151+0000 7fa0e8c00640 1 -- 172.21.15.1:0/365562765 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa0ec0a0170 con 0x5652f0beae00 2024-09-15T22:24:23.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.151+0000 7fa1083cb740 10 client.14892 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:24:23.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.151+0000 7fa1083cb740 10 client.14892 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T22:24:23.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.151+0000 7fa1083cb740 20 client.14892 populate_metadata read hostname 'smithi001' 2024-09-15T22:24:23.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.152+0000 7fa1083cb740 1 --2- 172.21.15.1:0/365562765 >> [v2:172.21.15.98:6836/493594054,v1:172.21.15.98:6837/493594054] conn(0x5652f0c06520 0x5652f0c07990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:23.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.152+0000 7fa1083cb740 4 client.14892 mds_command: new command op to 24520 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:24:23.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.152+0000 7fa1083cb740 1 -- 172.21.15.1:0/365562765 --> [v2:172.21.15.98:6836/493594054,v1:172.21.15.98:6837/493594054] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5652f0b5d620 con 0x5652f0c06520 2024-09-15T22:24:23.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.152+0000 7fa0fea00640 1 --2- 172.21.15.1:0/365562765 >> [v2:172.21.15.98:6836/493594054,v1:172.21.15.98:6837/493594054] conn(0x5652f0c06520 0x5652f0c07990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:23.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.153+0000 7fa0fea00640 1 --2- 172.21.15.1:0/365562765 >> [v2:172.21.15.98:6836/493594054,v1:172.21.15.98:6837/493594054] conn(0x5652f0c06520 0x5652f0c07990 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=228c248733344ac2 server_cookie=b079bed1cfd960ea in_seq=0 out_seq=0 2024-09-15T22:24:23.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.153+0000 7fa0e8c00640 10 client.14892 ms_handle_connect on v2:172.21.15.98:6836/493594054 2024-09-15T22:24:23.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.153+0000 7fa0e8c00640 1 -- 172.21.15.1:0/365562765 <== mds.2 v2:172.21.15.98:6836/493594054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5652f0b5d620 con 0x5652f0c06520 2024-09-15T22:24:23.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.153+0000 7fa0e8c00640 10 client.14892 handle_command_reply: tid=0 2024-09-15T22:24:23.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.153+0000 7fa1083cb740 1 client.14892 shutdown 2024-09-15T22:24:23.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.154+0000 7fa1083cb740 1 -- 172.21.15.1:0/365562765 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652f0beae00 msgr2=0x5652f0bf2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:23.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.154+0000 7fa1083cb740 1 --2- 172.21.15.1:0/365562765 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652f0beae00 0x5652f0bf2ac0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec0cd830 tx=0x7fa0ec09bf40 comp rx=0 tx=0).stop 2024-09-15T22:24:23.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.154+0000 7fa1083cb740 1 -- 172.21.15.1:0/365562765 shutdown_connections 2024-09-15T22:24:23.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.154+0000 7fa1083cb740 1 --2- 172.21.15.1:0/365562765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5652f0bf56c0 0x5652f0bf3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:23.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.154+0000 7fa1083cb740 1 --2- 172.21.15.1:0/365562765 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652f0beae00 0x5652f0bf2ac0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:23.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.154+0000 7fa1083cb740 1 --2- 172.21.15.1:0/365562765 >> [v2:172.21.15.98:6836/493594054,v1:172.21.15.98:6837/493594054] conn(0x5652f0c06520 0x5652f0c07990 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:23.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.154+0000 7fa1083cb740 1 --2- 172.21.15.1:0/365562765 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5652f0bea4e0 0x5652f0bf2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:23.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.154+0000 7fa1083cb740 1 -- 172.21.15.1:0/365562765 >> 172.21.15.1:0/365562765 conn(0x5652f0be6a70 msgr2=0x5652f0bec7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:23.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.154+0000 7fa0e8c00640 0 client.14892 ms_handle_reset on v2:172.21.15.98:6836/493594054 2024-09-15T22:24:23.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.154+0000 7fa1083cb740 1 -- 172.21.15.1:0/365562765 shutdown_connections 2024-09-15T22:24:23.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.154+0000 7fa1083cb740 1 -- 172.21.15.1:0/365562765 wait complete. 2024-09-15T22:24:23.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.154+0000 7fa1083cb740 20 client.14892 trim_cache size 0 max 16384 2024-09-15T22:24:23.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.173+0000 7fa1083cb740 1 Processor -- start 2024-09-15T22:24:23.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.173+0000 7fa1083cb740 1 -- start start 2024-09-15T22:24:23.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.173+0000 7fa1083cb740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652f0bea4e0 0x5652f0bef820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:23.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.173+0000 7fa1083cb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5652f0beae00 0x5652f0befd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:23.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.173+0000 7fa1083cb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5652f0bf56c0 0x5652f0bf0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:23.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.173+0000 7fa1083cb740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5652f0c05cd0 con 0x5652f0bea4e0 2024-09-15T22:24:23.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.173+0000 7fa1083cb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5652f0c063a0 con 0x5652f0beae00 2024-09-15T22:24:23.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.173+0000 7fa1083cb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5652f0c06a70 con 0x5652f0bf56c0 2024-09-15T22:24:23.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.173+0000 7fa0fea00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652f0bea4e0 0x5652f0bef820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:23.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.174+0000 7fa0fea00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652f0bea4e0 0x5652f0bef820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34702/0 (socket says 172.21.15.1:34702) 2024-09-15T22:24:23.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.174+0000 7fa0fea00640 1 -- 172.21.15.1:0/3998709922 learned_addr learned my addr 172.21.15.1:0/3998709922 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:23.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.174+0000 7fa0fe000640 1 --2- 172.21.15.1:0/3998709922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5652f0beae00 0x5652f0befd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:23.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.174+0000 7fa0ff400640 1 --2- 172.21.15.1:0/3998709922 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5652f0bf56c0 0x5652f0bf0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:23.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.174+0000 7fa0fea00640 1 -- 172.21.15.1:0/3998709922 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5652f0bf56c0 msgr2=0x5652f0bf0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:23.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.174+0000 7fa0fea00640 1 --2- 172.21.15.1:0/3998709922 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5652f0bf56c0 0x5652f0bf0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:23.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.174+0000 7fa0fea00640 1 -- 172.21.15.1:0/3998709922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5652f0beae00 msgr2=0x5652f0befd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:23.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.174+0000 7fa0fea00640 1 --2- 172.21.15.1:0/3998709922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5652f0beae00 0x5652f0befd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:23.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.174+0000 7fa0fea00640 1 -- 172.21.15.1:0/3998709922 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652f0be7c00 con 0x5652f0bea4e0 2024-09-15T22:24:23.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.174+0000 7fa0fe000640 1 --2- 172.21.15.1:0/3998709922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5652f0beae00 0x5652f0befd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:23.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.174+0000 7fa0fea00640 1 --2- 172.21.15.1:0/3998709922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652f0bea4e0 0x5652f0bef820 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0005ec0 tx=0x7fa0f00058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d758dbd538313999 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:23.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.174+0000 7fa0eb400640 1 -- 172.21.15.1:0/3998709922 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0035040 con 0x5652f0bea4e0 2024-09-15T22:24:23.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.175+0000 7fa0eb400640 1 -- 172.21.15.1:0/3998709922 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0f0005460 con 0x5652f0bea4e0 2024-09-15T22:24:23.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.175+0000 7fa0eb400640 1 -- 172.21.15.1:0/3998709922 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f00476c0 con 0x5652f0bea4e0 2024-09-15T22:24:23.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.175+0000 7fa1083cb740 1 -- 172.21.15.1:0/3998709922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652f0bea4e0 msgr2=0x5652f0bef820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:23.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.175+0000 7fa1083cb740 1 --2- 172.21.15.1:0/3998709922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652f0bea4e0 0x5652f0bef820 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0005ec0 tx=0x7fa0f00058d0 comp rx=0 tx=0).stop 2024-09-15T22:24:23.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.175+0000 7fa1083cb740 1 -- 172.21.15.1:0/3998709922 shutdown_connections 2024-09-15T22:24:23.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.175+0000 7fa1083cb740 1 --2- 172.21.15.1:0/3998709922 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5652f0bf56c0 0x5652f0bf0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:23.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.175+0000 7fa1083cb740 1 --2- 172.21.15.1:0/3998709922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5652f0beae00 0x5652f0befd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:23.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.175+0000 7fa1083cb740 1 --2- 172.21.15.1:0/3998709922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652f0bea4e0 0x5652f0bef820 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:23.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.175+0000 7fa1083cb740 1 -- 172.21.15.1:0/3998709922 >> 172.21.15.1:0/3998709922 conn(0x5652f0be6a70 msgr2=0x5652f0be6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:23.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.175+0000 7fa1083cb740 1 -- 172.21.15.1:0/3998709922 shutdown_connections 2024-09-15T22:24:23.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.175+0000 7fa1083cb740 1 -- 172.21.15.1:0/3998709922 wait complete. 2024-09-15T22:24:23.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.176+0000 7fa1083cb740 1 -- start start 2024-09-15T22:24:23.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.176+0000 7fa1083cb740 1 Processor -- start 2024-09-15T22:24:23.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.176+0000 7fa1083cb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5652f0bea4e0 0x5652f0beef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:23.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.176+0000 7fa1083cb740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652f0beae00 0x5652f0bef4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:23.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.176+0000 7fa1083cb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5652f0bf56c0 0x5652f0c0ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:23.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.176+0000 7fa1083cb740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5652f0c07810 con 0x5652f0beae00 2024-09-15T22:24:23.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.176+0000 7fa1083cb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5652f0c07140 con 0x5652f0bea4e0 2024-09-15T22:24:23.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.176+0000 7fa1083cb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5652f0c07ee0 con 0x5652f0bf56c0 2024-09-15T22:24:23.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.176+0000 7fa1083cb740 10 client.0 _ll_register_callbacks cb 0x7fa0ec09c110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:24:23.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.177+0000 7fa0fe000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652f0beae00 0x5652f0bef4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:23.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.177+0000 7fa0fea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5652f0bea4e0 0x5652f0beef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:23.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.177+0000 7fa0fea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5652f0bea4e0 0x5652f0beef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:49262/0 (socket says 172.21.15.1:49262) 2024-09-15T22:24:23.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.177+0000 7fa0fea00640 1 -- 172.21.15.1:0/3934823276 learned_addr learned my addr 172.21.15.1:0/3934823276 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:23.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.177+0000 7fa0ff400640 1 --2- 172.21.15.1:0/3934823276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5652f0bf56c0 0x5652f0c0ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:23.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.177+0000 7fa0fea00640 1 -- 172.21.15.1:0/3934823276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5652f0bf56c0 msgr2=0x5652f0c0ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:23.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.177+0000 7fa0fea00640 1 --2- 172.21.15.1:0/3934823276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5652f0bf56c0 0x5652f0c0ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:23.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.177+0000 7fa0fea00640 1 -- 172.21.15.1:0/3934823276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652f0beae00 msgr2=0x5652f0bef4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:23.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.177+0000 7fa0fea00640 1 --2- 172.21.15.1:0/3934823276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652f0beae00 0x5652f0bef4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:23.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.177+0000 7fa0fea00640 1 -- 172.21.15.1:0/3934823276 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652f0c0f1f0 con 0x5652f0bea4e0 2024-09-15T22:24:23.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.177+0000 7fa0fea00640 1 --2- 172.21.15.1:0/3934823276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5652f0bea4e0 0x5652f0beef90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa0f002a9a0 tx=0x7fa0f0009600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4e9cc034efe3ecf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:23.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.177+0000 7fa0e8c00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-15T22:24:23.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.177+0000 7fa0e8c00640 1 -- 172.21.15.1:0/3934823276 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0061020 con 0x5652f0bea4e0 2024-09-15T22:24:23.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.178+0000 7fa1083cb740 1 -- 172.21.15.1:0/3934823276 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0f0005460 con 0x5652f0bea4e0 2024-09-15T22:24:23.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.178+0000 7fa0e8c00640 1 -- 172.21.15.1:0/3934823276 <== mon.2 v2:172.21.15.12:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fa0f0003800 con 0x5652f0bea4e0 2024-09-15T22:24:23.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.178+0000 7fa0e8c00640 1 -- 172.21.15.1:0/3934823276 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa0f0003a00 con 0x5652f0bea4e0 2024-09-15T22:24:23.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.178+0000 7fa1083cb740 10 client.24878 fetch_fsmap learned FSMap version 25 2024-09-15T22:24:23.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.178+0000 7fa1083cb740 1 -- 172.21.15.1:0/3934823276 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5652f0c104b0 con 0x5652f0bea4e0 2024-09-15T22:24:23.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.178+0000 7fa0e8c00640 1 -- 172.21.15.1:0/3934823276 <== mon.2 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0f0005460 con 0x5652f0bea4e0 2024-09-15T22:24:23.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.178+0000 7fa0e8c00640 1 -- 172.21.15.1:0/3934823276 <== mon.2 v2:172.21.15.12:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa0f005d3a0 con 0x5652f0bea4e0 2024-09-15T22:24:23.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.178+0000 7fa1083cb740 10 client.24878 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:24:23.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.178+0000 7fa1083cb740 10 client.24878 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T22:24:23.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.178+0000 7fa1083cb740 20 client.24878 populate_metadata read hostname 'smithi001' 2024-09-15T22:24:23.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.178+0000 7fa1083cb740 1 --2- 172.21.15.1:0/3934823276 >> [v2:172.21.15.98:6836/493594054,v1:172.21.15.98:6837/493594054] conn(0x5652f0c74c80 0x5652f0c73990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:23.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.178+0000 7fa1083cb740 4 client.24878 mds_command: new command op to 24520 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:24:23.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.178+0000 7fa1083cb740 1 -- 172.21.15.1:0/3934823276 --> [v2:172.21.15.98:6836/493594054,v1:172.21.15.98:6837/493594054] -- command(tid 0: {"prefix": "status"}) -- 0x5652f0b57b30 con 0x5652f0c74c80 2024-09-15T22:24:23.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.179+0000 7fa0fe000640 1 --2- 172.21.15.1:0/3934823276 >> [v2:172.21.15.98:6836/493594054,v1:172.21.15.98:6837/493594054] conn(0x5652f0c74c80 0x5652f0c73990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:23.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.179+0000 7fa0fe000640 1 --2- 172.21.15.1:0/3934823276 >> [v2:172.21.15.98:6836/493594054,v1:172.21.15.98:6837/493594054] conn(0x5652f0c74c80 0x5652f0c73990 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c5a50dd597cd9b70 server_cookie=a2391ba59daa61ee in_seq=0 out_seq=0 2024-09-15T22:24:23.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.179+0000 7fa0e8c00640 10 client.24878 ms_handle_connect on v2:172.21.15.98:6836/493594054 2024-09-15T22:24:23.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.179+0000 7fa0e8c00640 1 -- 172.21.15.1:0/3934823276 <== mds.2 v2:172.21.15.98:6836/493594054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5652f0b57b30 con 0x5652f0c74c80 2024-09-15T22:24:23.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.179+0000 7fa0e8c00640 10 client.24878 handle_command_reply: tid=0 2024-09-15T22:24:23.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.179+0000 7fa1083cb740 1 client.24878 shutdown 2024-09-15T22:24:23.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.180+0000 7fa1083cb740 1 -- 172.21.15.1:0/3934823276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5652f0bea4e0 msgr2=0x5652f0beef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:23.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.180+0000 7fa1083cb740 1 --2- 172.21.15.1:0/3934823276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5652f0bea4e0 0x5652f0beef90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa0f002a9a0 tx=0x7fa0f0009600 comp rx=0 tx=0).stop 2024-09-15T22:24:23.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.180+0000 7fa1083cb740 1 -- 172.21.15.1:0/3934823276 shutdown_connections 2024-09-15T22:24:23.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.180+0000 7fa1083cb740 1 --2- 172.21.15.1:0/3934823276 >> [v2:172.21.15.98:6836/493594054,v1:172.21.15.98:6837/493594054] conn(0x5652f0c74c80 0x5652f0c73990 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:23.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.180+0000 7fa1083cb740 1 --2- 172.21.15.1:0/3934823276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5652f0bf56c0 0x5652f0c0ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:23.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.180+0000 7fa1083cb740 1 --2- 172.21.15.1:0/3934823276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652f0beae00 0x5652f0bef4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:23.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.180+0000 7fa1083cb740 1 --2- 172.21.15.1:0/3934823276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5652f0bea4e0 0x5652f0beef90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:23.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.180+0000 7fa0e8c00640 0 client.24878 ms_handle_reset on v2:172.21.15.98:6836/493594054 2024-09-15T22:24:23.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.180+0000 7fa1083cb740 1 -- 172.21.15.1:0/3934823276 >> 172.21.15.1:0/3934823276 conn(0x5652f0be6a70 msgr2=0x5652f0bf0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:23.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.180+0000 7fa1083cb740 1 -- 172.21.15.1:0/3934823276 shutdown_connections 2024-09-15T22:24:23.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.180+0000 7fa1083cb740 1 -- 172.21.15.1:0/3934823276 wait complete. 2024-09-15T22:24:23.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.180+0000 7fa1083cb740 20 client.24878 trim_cache size 0 max 16384 2024-09-15T22:24:23.189 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-15T22:24:23.190 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "c1228c44-73af-11ef-bceb-c7b262605968", 2024-09-15T22:24:23.190 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 2, 2024-09-15T22:24:23.190 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24520, 2024-09-15T22:24:23.190 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-15T22:24:23.190 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-15T22:24:23.190 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-15T22:24:23.190 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 80.353900413000005, 2024-09-15T22:24:23.190 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 25, 2024-09-15T22:24:23.190 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 84, 2024-09-15T22:24:23.190 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 82, 2024-09-15T22:24:23.190 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 119.81991367000001 2024-09-15T22:24:23.190 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-15T22:24:23.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.181+0000 7fa0ffe00640 1 -- 172.21.15.1:0/1719549920 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa0e40a31e0 msgr2=0x7fa0e40a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:23.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.181+0000 7fa0ffe00640 1 --2- 172.21.15.1:0/1719549920 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa0e40a31e0 0x7fa0e40a56a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0000c00 tx=0x7fa0f002a480 comp rx=0 tx=0).stop 2024-09-15T22:24:23.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.181+0000 7fa0ffe00640 1 -- 172.21.15.1:0/1719549920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa100074e30 msgr2=0x7fa10019aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:23.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.181+0000 7fa0ffe00640 1 --2- 172.21.15.1:0/1719549920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa100074e30 0x7fa10019aa80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec00e9f0 tx=0x7fa0ec00edf0 comp rx=0 tx=0).stop 2024-09-15T22:24:23.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.181+0000 7fa0ffe00640 1 -- 172.21.15.1:0/1719549920 shutdown_connections 2024-09-15T22:24:23.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.181+0000 7fa0ffe00640 1 --2- 172.21.15.1:0/1719549920 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa0e40a31e0 0x7fa0e40a56a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:23.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.181+0000 7fa0ffe00640 1 --2- 172.21.15.1:0/1719549920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa10010e280 0x7fa10019ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:23.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.181+0000 7fa0ffe00640 1 --2- 172.21.15.1:0/1719549920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa100074e30 0x7fa10019aa80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:23.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.181+0000 7fa0ffe00640 1 --2- 172.21.15.1:0/1719549920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa100074510 0x7fa10019a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:23.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.181+0000 7fa0ffe00640 1 -- 172.21.15.1:0/1719549920 >> 172.21.15.1:0/1719549920 conn(0x7fa1000fd740 msgr2=0x7fa1000fef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:23.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.181+0000 7fa0ffe00640 1 -- 172.21.15.1:0/1719549920 shutdown_connections 2024-09-15T22:24:23.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:23.181+0000 7fa0ffe00640 1 -- 172.21.15.1:0/1719549920 wait complete. 2024-09-15T22:24:23.642 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:23 smithi001 ceph-mon[30843]: pgmap v339: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-15T22:24:23.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:23 smithi012 ceph-mon[34883]: pgmap v339: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-15T22:24:23.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:23 smithi098 ceph-mon[35514]: pgmap v339: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-15T22:24:24.141 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-15T22:24:24.522 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:25.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.203+0000 7f2de4e00640 1 -- 172.21.15.1:0/1502496595 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2de0109120 msgr2=0x7f2de0110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:25.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.203+0000 7f2de4e00640 1 --2- 172.21.15.1:0/1502496595 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2de0109120 0x7f2de0110ca0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8009ca0 tx=0x7f2dd802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.203+0000 7f2de4e00640 1 -- 172.21.15.1:0/1502496595 shutdown_connections 2024-09-15T22:24:25.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.203+0000 7f2de4e00640 1 --2- 172.21.15.1:0/1502496595 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2de0109120 0x7f2de0110ca0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.203+0000 7f2de4e00640 1 --2- 172.21.15.1:0/1502496595 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2de01049a0 0x7f2de01089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.203+0000 7f2de4e00640 1 --2- 172.21.15.1:0/1502496595 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2de0103ff0 0x7f2de01043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.203+0000 7f2de4e00640 1 -- 172.21.15.1:0/1502496595 >> 172.21.15.1:0/1502496595 conn(0x7f2de00ffa90 msgr2=0x7f2de0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:25.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.203+0000 7f2de4e00640 1 -- 172.21.15.1:0/1502496595 shutdown_connections 2024-09-15T22:24:25.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.203+0000 7f2de4e00640 1 -- 172.21.15.1:0/1502496595 wait complete. 2024-09-15T22:24:25.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.204+0000 7f2de4e00640 1 Processor -- start 2024-09-15T22:24:25.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.204+0000 7f2de4e00640 1 -- start start 2024-09-15T22:24:25.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.204+0000 7f2de4e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2de0103ff0 0x7f2de019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:25.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.204+0000 7f2de4e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2de01049a0 0x7f2de019ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:25.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.204+0000 7f2de4e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2de0109120 0x7f2de019eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:25.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.204+0000 7f2de4e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2de0114150 con 0x7f2de0109120 2024-09-15T22:24:25.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.204+0000 7f2de4e00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2de0113fd0 con 0x7f2de01049a0 2024-09-15T22:24:25.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.204+0000 7f2de4e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2de01142d0 con 0x7f2de0103ff0 2024-09-15T22:24:25.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.205+0000 7f2ddde00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2de0103ff0 0x7f2de019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:25.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.205+0000 7f2dd7e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2de01049a0 0x7f2de019ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:25.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.205+0000 7f2dde800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2de0109120 0x7f2de019eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:25.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.205+0000 7f2ddde00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2de0103ff0 0x7f2de019a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:39776/0 (socket says 172.21.15.1:39776) 2024-09-15T22:24:25.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.205+0000 7f2ddde00640 1 -- 172.21.15.1:0/2589569211 learned_addr learned my addr 172.21.15.1:0/2589569211 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:25.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.205+0000 7f2dde800640 1 -- 172.21.15.1:0/2589569211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2de0103ff0 msgr2=0x7f2de019a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:25.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.205+0000 7f2dde800640 1 --2- 172.21.15.1:0/2589569211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2de0103ff0 0x7f2de019a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.205+0000 7f2dde800640 1 -- 172.21.15.1:0/2589569211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2de01049a0 msgr2=0x7f2de019ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:25.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.205+0000 7f2dde800640 1 --2- 172.21.15.1:0/2589569211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2de01049a0 0x7f2de019ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.205+0000 7f2dde800640 1 -- 172.21.15.1:0/2589569211 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de019f5a0 con 0x7f2de0109120 2024-09-15T22:24:25.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.206+0000 7f2dde800640 1 --2- 172.21.15.1:0/2589569211 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2de0109120 0x7f2de019eec0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2dd802ade0 tx=0x7f2dd80319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:25.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.206+0000 7f2dd6a00640 1 -- 172.21.15.1:0/2589569211 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8003b70 con 0x7f2de0109120 2024-09-15T22:24:25.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.206+0000 7f2dd6a00640 1 -- 172.21.15.1:0/2589569211 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2dd8003d10 con 0x7f2de0109120 2024-09-15T22:24:25.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.206+0000 7f2dd6a00640 1 -- 172.21.15.1:0/2589569211 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd802fcb0 con 0x7f2de0109120 2024-09-15T22:24:25.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.206+0000 7f2de4e00640 1 -- 172.21.15.1:0/2589569211 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2de019f830 con 0x7f2de0109120 2024-09-15T22:24:25.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.206+0000 7f2de4e00640 1 -- 172.21.15.1:0/2589569211 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2de01a7170 con 0x7f2de0109120 2024-09-15T22:24:25.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.209+0000 7f2dd6a00640 1 -- 172.21.15.1:0/2589569211 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f2dd8004050 con 0x7f2de0109120 2024-09-15T22:24:25.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.209+0000 7f2de79d7740 1 Processor -- start 2024-09-15T22:24:25.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.209+0000 7f2de79d7740 1 -- start start 2024-09-15T22:24:25.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.210+0000 7f2de79d7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557cd37f0330 0x557cd37f0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:25.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.210+0000 7f2de79d7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cd37f0c50 0x557cd37fafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:25.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.210+0000 7f2de79d7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd37fb510 0x557cd37fd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:25.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.210+0000 7f2de79d7740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557cd37560b0 con 0x557cd37f0330 2024-09-15T22:24:25.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.210+0000 7f2de79d7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557cd36fdab0 con 0x557cd37f0c50 2024-09-15T22:24:25.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.210+0000 7f2de79d7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557cd3752070 con 0x557cd37fb510 2024-09-15T22:24:25.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.210+0000 7f2dd7e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557cd37f0330 0x557cd37f0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:25.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.210+0000 7f2dd7e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557cd37f0330 0x557cd37f0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34730/0 (socket says 172.21.15.1:34730) 2024-09-15T22:24:25.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.210+0000 7f2dd7e00640 1 -- 172.21.15.1:0/2528105455 learned_addr learned my addr 172.21.15.1:0/2528105455 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:25.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.210+0000 7f2ddde00640 1 --2- 172.21.15.1:0/2528105455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cd37f0c50 0x557cd37fafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:25.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.210+0000 7f2dd7e00640 1 --2- 172.21.15.1:0/2528105455 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd37fb510 0x557cd37fd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:25.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.211+0000 7f2dd7e00640 1 -- 172.21.15.1:0/2528105455 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd37fb510 msgr2=0x557cd37fd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:25.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.211+0000 7f2dd7e00640 1 --2- 172.21.15.1:0/2528105455 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd37fb510 0x557cd37fd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.211+0000 7f2dd7e00640 1 -- 172.21.15.1:0/2528105455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cd37f0c50 msgr2=0x557cd37fafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:25.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.211+0000 7f2dd7e00640 1 --2- 172.21.15.1:0/2528105455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cd37f0c50 0x557cd37fafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.211+0000 7f2dd7e00640 1 -- 172.21.15.1:0/2528105455 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cd370a4a0 con 0x557cd37f0330 2024-09-15T22:24:25.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.211+0000 7f2ddde00640 1 --2- 172.21.15.1:0/2528105455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cd37f0c50 0x557cd37fafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:25.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.211+0000 7f2dd6a00640 1 --2- 172.21.15.1:0/2589569211 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2dc40a32d0 0x7f2dc40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:25.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.211+0000 7f2dd6a00640 1 -- 172.21.15.1:0/2589569211 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f2dd80f0b80 con 0x7f2de0109120 2024-09-15T22:24:25.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.211+0000 7f2dd7e00640 1 --2- 172.21.15.1:0/2528105455 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557cd37f0330 0x557cd37f0710 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8004650 tx=0x7f2dc80041d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569163726bebb5fe server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:25.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.211+0000 7f2ddde00640 1 --2- 172.21.15.1:0/2589569211 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2dc40a32d0 0x7f2dc40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:25.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.211+0000 7f2dcf400640 1 -- 172.21.15.1:0/2528105455 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8005020 con 0x557cd37f0330 2024-09-15T22:24:25.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.211+0000 7f2dcf400640 1 -- 172.21.15.1:0/2528105455 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2dc80056a0 con 0x557cd37f0330 2024-09-15T22:24:25.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.211+0000 7f2dcf400640 1 -- 172.21.15.1:0/2528105455 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc80106c0 con 0x557cd37f0330 2024-09-15T22:24:25.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.212+0000 7f2de79d7740 1 -- 172.21.15.1:0/2528105455 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557cd37f0330 msgr2=0x557cd37f0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:25.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.212+0000 7f2de79d7740 1 --2- 172.21.15.1:0/2528105455 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557cd37f0330 0x557cd37f0710 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8004650 tx=0x7f2dc80041d0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.212+0000 7f2ddde00640 1 --2- 172.21.15.1:0/2589569211 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2dc40a32d0 0x7f2dc40a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x557cd37ed720 tx=0x7f2dd0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:25.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.212+0000 7f2de79d7740 1 -- 172.21.15.1:0/2528105455 shutdown_connections 2024-09-15T22:24:25.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.212+0000 7f2de79d7740 1 --2- 172.21.15.1:0/2528105455 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd37fb510 0x557cd37fd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.212+0000 7f2de79d7740 1 --2- 172.21.15.1:0/2528105455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cd37f0c50 0x557cd37fafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.212+0000 7f2de79d7740 1 --2- 172.21.15.1:0/2528105455 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557cd37f0330 0x557cd37f0710 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.212+0000 7f2de79d7740 1 -- 172.21.15.1:0/2528105455 >> 172.21.15.1:0/2528105455 conn(0x557cd37ec8c0 msgr2=0x557cd37ecca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:25.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.212+0000 7f2de79d7740 1 -- 172.21.15.1:0/2528105455 shutdown_connections 2024-09-15T22:24:25.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.212+0000 7f2de79d7740 1 -- 172.21.15.1:0/2528105455 wait complete. 2024-09-15T22:24:25.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.213+0000 7f2de79d7740 1 -- start start 2024-09-15T22:24:25.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.213+0000 7f2de79d7740 1 Processor -- start 2024-09-15T22:24:25.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.214+0000 7f2de79d7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd37f0330 0x557cd37f8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:25.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.214+0000 7f2de79d7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cd37f0c50 0x557cd37f8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:25.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.214+0000 7f2de79d7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557cd37fb510 0x557cd37f8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:25.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.214+0000 7f2de79d7740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557cd37fe060 con 0x557cd37fb510 2024-09-15T22:24:25.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.214+0000 7f2de79d7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557cd36de920 con 0x557cd37f0c50 2024-09-15T22:24:25.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.214+0000 7f2de79d7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557cd37fe1e0 con 0x557cd37f0330 2024-09-15T22:24:25.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.214+0000 7f2de79d7740 10 client.0 _ll_register_callbacks cb 0x557cd37028a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:24:25.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.214+0000 7f2dd7e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cd37f0c50 0x557cd37f8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:25.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.214+0000 7f2dde800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557cd37fb510 0x557cd37f8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:25.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.214+0000 7f2ddde00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd37f0330 0x557cd37f8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:25.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.214+0000 7f2dd7e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cd37f0c50 0x557cd37f8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:49296/0 (socket says 172.21.15.1:49296) 2024-09-15T22:24:25.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.214+0000 7f2dd7e00640 1 -- 172.21.15.1:0/1768352924 learned_addr learned my addr 172.21.15.1:0/1768352924 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:25.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.214+0000 7f2dd7e00640 1 -- 172.21.15.1:0/1768352924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd37f0330 msgr2=0x557cd37f8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:25.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.214+0000 7f2dd7e00640 1 --2- 172.21.15.1:0/1768352924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd37f0330 0x557cd37f8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.214+0000 7f2dd7e00640 1 -- 172.21.15.1:0/1768352924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557cd37fb510 msgr2=0x557cd37f8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:25.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.214+0000 7f2dd7e00640 1 --2- 172.21.15.1:0/1768352924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557cd37fb510 0x557cd37f8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.214+0000 7f2dd7e00640 1 -- 172.21.15.1:0/1768352924 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cd34c72b0 con 0x557cd37f0c50 2024-09-15T22:24:25.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.215+0000 7f2dde800640 1 --2- 172.21.15.1:0/1768352924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557cd37fb510 0x557cd37f8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:25.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.215+0000 7f2dd7e00640 1 --2- 172.21.15.1:0/1768352924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cd37f0c50 0x557cd37f8a40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2dc800b7b0 tx=0x7f2dc800b7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55f6588a6885d64f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:25.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.215+0000 7f2dc3e00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-15T22:24:25.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.215+0000 7f2dc3e00640 1 -- 172.21.15.1:0/1768352924 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8005020 con 0x557cd37f0c50 2024-09-15T22:24:25.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.215+0000 7f2de79d7740 1 -- 172.21.15.1:0/1768352924 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2dc80056a0 con 0x557cd37f0c50 2024-09-15T22:24:25.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.215+0000 7f2dc3e00640 1 -- 172.21.15.1:0/1768352924 <== mon.2 v2:172.21.15.12:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f2dc80051c0 con 0x557cd37f0c50 2024-09-15T22:24:25.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.216+0000 7f2dc3e00640 1 -- 172.21.15.1:0/1768352924 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2dc80053c0 con 0x557cd37f0c50 2024-09-15T22:24:25.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.216+0000 7f2de79d7740 10 client.24890 fetch_fsmap learned FSMap version 25 2024-09-15T22:24:25.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.216+0000 7f2de79d7740 1 -- 172.21.15.1:0/1768352924 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557cd3809dd0 con 0x557cd37f0c50 2024-09-15T22:24:25.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.216+0000 7f2dc3e00640 1 -- 172.21.15.1:0/1768352924 <== mon.2 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2dc80056a0 con 0x557cd37f0c50 2024-09-15T22:24:25.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.216+0000 7f2dc3e00640 1 -- 172.21.15.1:0/1768352924 <== mon.2 v2:172.21.15.12:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2dc802b4a0 con 0x557cd37f0c50 2024-09-15T22:24:25.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.216+0000 7f2de79d7740 10 client.24890 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:24:25.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.216+0000 7f2de79d7740 10 client.24890 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:24:25.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.216+0000 7f2de79d7740 20 client.24890 populate_metadata read hostname 'smithi001' 2024-09-15T22:24:25.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.216+0000 7f2de79d7740 1 --2- 172.21.15.1:0/1768352924 >> [v2:172.21.15.12:6838/1469511155,v1:172.21.15.12:6839/1469511155] conn(0x557cd380c1e0 0x557cd380d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:25.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.216+0000 7f2de79d7740 4 client.24890 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:24:25.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.216+0000 7f2de79d7740 1 -- 172.21.15.1:0/1768352924 --> [v2:172.21.15.12:6838/1469511155,v1:172.21.15.12:6839/1469511155] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557cd3763620 con 0x557cd380c1e0 2024-09-15T22:24:25.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.217+0000 7f2ddde00640 1 --2- 172.21.15.1:0/1768352924 >> [v2:172.21.15.12:6838/1469511155,v1:172.21.15.12:6839/1469511155] conn(0x557cd380c1e0 0x557cd380d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:25.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.217+0000 7f2ddde00640 1 --2- 172.21.15.1:0/1768352924 >> [v2:172.21.15.12:6838/1469511155,v1:172.21.15.12:6839/1469511155] conn(0x557cd380c1e0 0x557cd380d650 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4190d780122928b server_cookie=de544ce4e7baddbd in_seq=0 out_seq=0 2024-09-15T22:24:25.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.217+0000 7f2dc3e00640 10 client.24890 ms_handle_connect on v2:172.21.15.12:6838/1469511155 2024-09-15T22:24:25.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.218+0000 7f2dc3e00640 1 -- 172.21.15.1:0/1768352924 <== mds.1 v2:172.21.15.12:6838/1469511155 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557cd3763620 con 0x557cd380c1e0 2024-09-15T22:24:25.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.218+0000 7f2dc3e00640 10 client.24890 handle_command_reply: tid=0 2024-09-15T22:24:25.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.218+0000 7f2de79d7740 1 client.24890 shutdown 2024-09-15T22:24:25.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.218+0000 7f2de79d7740 1 -- 172.21.15.1:0/1768352924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cd37f0c50 msgr2=0x557cd37f8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:25.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.218+0000 7f2de79d7740 1 --2- 172.21.15.1:0/1768352924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cd37f0c50 0x557cd37f8a40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2dc800b7b0 tx=0x7f2dc800b7e0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.219+0000 7f2de79d7740 1 -- 172.21.15.1:0/1768352924 shutdown_connections 2024-09-15T22:24:25.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.219+0000 7f2de79d7740 1 --2- 172.21.15.1:0/1768352924 >> [v2:172.21.15.12:6838/1469511155,v1:172.21.15.12:6839/1469511155] conn(0x557cd380c1e0 0x557cd380d650 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.219+0000 7f2de79d7740 1 --2- 172.21.15.1:0/1768352924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557cd37fb510 0x557cd37f8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.219+0000 7f2de79d7740 1 --2- 172.21.15.1:0/1768352924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cd37f0c50 0x557cd37f8a40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.219+0000 7f2dc3e00640 0 client.24890 ms_handle_reset on v2:172.21.15.12:6838/1469511155 2024-09-15T22:24:25.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.219+0000 7f2de79d7740 1 --2- 172.21.15.1:0/1768352924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd37f0330 0x557cd37f8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.219+0000 7f2de79d7740 1 -- 172.21.15.1:0/1768352924 >> 172.21.15.1:0/1768352924 conn(0x557cd37ec8c0 msgr2=0x557cd37f25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:25.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.219+0000 7f2de79d7740 1 -- 172.21.15.1:0/1768352924 shutdown_connections 2024-09-15T22:24:25.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.219+0000 7f2de79d7740 1 -- 172.21.15.1:0/1768352924 wait complete. 2024-09-15T22:24:25.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.219+0000 7f2de79d7740 20 client.24890 trim_cache size 0 max 16384 2024-09-15T22:24:25.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.238+0000 7f2de79d7740 1 Processor -- start 2024-09-15T22:24:25.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.238+0000 7f2de79d7740 1 -- start start 2024-09-15T22:24:25.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.238+0000 7f2de79d7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557cd37f0330 0x557cd37ec210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:25.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.238+0000 7f2de79d7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd37f0c50 0x557cd37f8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:25.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.238+0000 7f2de79d7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cd37fb510 0x557cd37f57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:25.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.238+0000 7f2de79d7740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557cd380b990 con 0x557cd37f0330 2024-09-15T22:24:25.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.238+0000 7f2de79d7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557cd380c060 con 0x557cd37fb510 2024-09-15T22:24:25.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.238+0000 7f2de79d7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557cd380c730 con 0x557cd37f0c50 2024-09-15T22:24:25.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.238+0000 7f2ddde00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557cd37f0330 0x557cd37ec210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:25.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.238+0000 7f2ddde00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557cd37f0330 0x557cd37ec210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34760/0 (socket says 172.21.15.1:34760) 2024-09-15T22:24:25.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.238+0000 7f2ddde00640 1 -- 172.21.15.1:0/1054221032 learned_addr learned my addr 172.21.15.1:0/1054221032 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:25.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.238+0000 7f2dde800640 1 --2- 172.21.15.1:0/1054221032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cd37fb510 0x557cd37f57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:25.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.239+0000 7f2dd7e00640 1 --2- 172.21.15.1:0/1054221032 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd37f0c50 0x557cd37f8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:25.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.239+0000 7f2ddde00640 1 -- 172.21.15.1:0/1054221032 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd37f0c50 msgr2=0x557cd37f8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:25.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.239+0000 7f2ddde00640 1 --2- 172.21.15.1:0/1054221032 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd37f0c50 0x557cd37f8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.239+0000 7f2ddde00640 1 -- 172.21.15.1:0/1054221032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cd37fb510 msgr2=0x557cd37f57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:25.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.239+0000 7f2ddde00640 1 --2- 172.21.15.1:0/1054221032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cd37fb510 0x557cd37f57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.239+0000 7f2ddde00640 1 -- 172.21.15.1:0/1054221032 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cd37f0160 con 0x557cd37f0330 2024-09-15T22:24:25.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.239+0000 7f2dd7e00640 1 --2- 172.21.15.1:0/1054221032 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd37f0c50 0x557cd37f8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:24:25.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.239+0000 7f2ddde00640 1 --2- 172.21.15.1:0/1054221032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557cd37f0330 0x557cd37ec210 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2dd00097f0 tx=0x7f2dd001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48c3d641bf40c4ab server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:25.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.239+0000 7f2dcea00640 1 -- 172.21.15.1:0/1054221032 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd002b420 con 0x557cd37f0330 2024-09-15T22:24:25.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.239+0000 7f2dcea00640 1 -- 172.21.15.1:0/1054221032 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2dd002baa0 con 0x557cd37f0330 2024-09-15T22:24:25.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.239+0000 7f2dcea00640 1 -- 172.21.15.1:0/1054221032 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd000fc10 con 0x557cd37f0330 2024-09-15T22:24:25.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.240+0000 7f2de79d7740 1 -- 172.21.15.1:0/1054221032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557cd37f0330 msgr2=0x557cd37ec210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:25.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.240+0000 7f2de79d7740 1 --2- 172.21.15.1:0/1054221032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557cd37f0330 0x557cd37ec210 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2dd00097f0 tx=0x7f2dd001b000 comp rx=0 tx=0).stop 2024-09-15T22:24:25.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.240+0000 7f2de79d7740 1 -- 172.21.15.1:0/1054221032 shutdown_connections 2024-09-15T22:24:25.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.240+0000 7f2de79d7740 1 --2- 172.21.15.1:0/1054221032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cd37fb510 0x557cd37f57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.240+0000 7f2de79d7740 1 --2- 172.21.15.1:0/1054221032 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd37f0c50 0x557cd37f8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.240+0000 7f2de79d7740 1 --2- 172.21.15.1:0/1054221032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557cd37f0330 0x557cd37ec210 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.240+0000 7f2de79d7740 1 -- 172.21.15.1:0/1054221032 >> 172.21.15.1:0/1054221032 conn(0x557cd37ec8c0 msgr2=0x557cd37f6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:25.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.240+0000 7f2de79d7740 1 -- 172.21.15.1:0/1054221032 shutdown_connections 2024-09-15T22:24:25.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.240+0000 7f2de79d7740 1 -- 172.21.15.1:0/1054221032 wait complete. 2024-09-15T22:24:25.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.241+0000 7f2de79d7740 1 -- start start 2024-09-15T22:24:25.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.241+0000 7f2de79d7740 1 Processor -- start 2024-09-15T22:24:25.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.241+0000 7f2de79d7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cd37f0330 0x557cd3816090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:25.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.241+0000 7f2de79d7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd37f0c50 0x557cd37f52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:25.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.241+0000 7f2de79d7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557cd37fb510 0x557cd37f57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:25.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.241+0000 7f2de79d7740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557cd380d4d0 con 0x557cd37fb510 2024-09-15T22:24:25.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.241+0000 7f2de79d7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557cd380ce00 con 0x557cd37f0330 2024-09-15T22:24:25.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.241+0000 7f2de79d7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557cd380dba0 con 0x557cd37f0c50 2024-09-15T22:24:25.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.242+0000 7f2de79d7740 10 client.0 _ll_register_callbacks cb 0x7f2dc8004260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:24:25.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.242+0000 7f2dde800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557cd37fb510 0x557cd37f57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:25.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.242+0000 7f2ddde00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cd37f0330 0x557cd3816090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:25.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.242+0000 7f2ddde00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cd37f0330 0x557cd3816090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:49306/0 (socket says 172.21.15.1:49306) 2024-09-15T22:24:25.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.242+0000 7f2ddde00640 1 -- 172.21.15.1:0/81453605 learned_addr learned my addr 172.21.15.1:0/81453605 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:25.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.242+0000 7f2dde800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557cd37fb510 0x557cd37f57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34772/0 (socket says 172.21.15.1:34772) 2024-09-15T22:24:25.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.242+0000 7f2dd7e00640 1 --2- 172.21.15.1:0/81453605 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd37f0c50 0x557cd37f52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:25.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.242+0000 7f2ddde00640 1 -- 172.21.15.1:0/81453605 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd37f0c50 msgr2=0x557cd37f52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:25.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.242+0000 7f2ddde00640 1 --2- 172.21.15.1:0/81453605 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd37f0c50 0x557cd37f52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.242+0000 7f2ddde00640 1 -- 172.21.15.1:0/81453605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557cd37fb510 msgr2=0x557cd37f57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:25.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.242+0000 7f2ddde00640 1 --2- 172.21.15.1:0/81453605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557cd37fb510 0x557cd37f57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.242+0000 7f2ddde00640 1 -- 172.21.15.1:0/81453605 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cd37ed970 con 0x557cd37f0330 2024-09-15T22:24:25.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.242+0000 7f2dde800640 1 --2- 172.21.15.1:0/81453605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557cd37fb510 0x557cd37f57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:25.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.243+0000 7f2ddde00640 1 --2- 172.21.15.1:0/81453605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cd37f0330 0x557cd3816090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0009620 tx=0x7f2dd00040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d9e3e7709b69bac server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:25.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.243+0000 7f2dc3e00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-15T22:24:25.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.243+0000 7f2dc3e00640 1 -- 172.21.15.1:0/81453605 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd000f540 con 0x557cd37f0330 2024-09-15T22:24:25.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.243+0000 7f2dc3e00640 1 -- 172.21.15.1:0/81453605 <== mon.2 v2:172.21.15.12:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f2dd002b420 con 0x557cd37f0330 2024-09-15T22:24:25.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.243+0000 7f2de79d7740 1 -- 172.21.15.1:0/81453605 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2dd002baa0 con 0x557cd37f0330 2024-09-15T22:24:25.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.243+0000 7f2dc3e00640 1 -- 172.21.15.1:0/81453605 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2dd002b620 con 0x557cd37f0330 2024-09-15T22:24:25.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.243+0000 7f2de79d7740 10 client.24896 fetch_fsmap learned FSMap version 25 2024-09-15T22:24:25.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.243+0000 7f2de79d7740 1 -- 172.21.15.1:0/81453605 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557cd38768f0 con 0x557cd37f0330 2024-09-15T22:24:25.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.244+0000 7f2dc3e00640 1 -- 172.21.15.1:0/81453605 <== mon.2 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2dd002baa0 con 0x557cd37f0330 2024-09-15T22:24:25.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.244+0000 7f2dc3e00640 1 -- 172.21.15.1:0/81453605 <== mon.2 v2:172.21.15.12:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2dd0005490 con 0x557cd37f0330 2024-09-15T22:24:25.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.244+0000 7f2de79d7740 10 client.24896 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:24:25.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.244+0000 7f2de79d7740 10 client.24896 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:24:25.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.244+0000 7f2de79d7740 20 client.24896 populate_metadata read hostname 'smithi001' 2024-09-15T22:24:25.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.244+0000 7f2de79d7740 1 --2- 172.21.15.1:0/81453605 >> [v2:172.21.15.12:6838/1469511155,v1:172.21.15.12:6839/1469511155] conn(0x557cd387b070 0x557cd3879d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:25.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.244+0000 7f2de79d7740 4 client.24896 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:24:25.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.244+0000 7f2de79d7740 1 -- 172.21.15.1:0/81453605 --> [v2:172.21.15.12:6838/1469511155,v1:172.21.15.12:6839/1469511155] -- command(tid 0: {"prefix": "status"}) -- 0x557cd375db30 con 0x557cd387b070 2024-09-15T22:24:25.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.244+0000 7f2dd7e00640 1 --2- 172.21.15.1:0/81453605 >> [v2:172.21.15.12:6838/1469511155,v1:172.21.15.12:6839/1469511155] conn(0x557cd387b070 0x557cd3879d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:25.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.245+0000 7f2dd7e00640 1 --2- 172.21.15.1:0/81453605 >> [v2:172.21.15.12:6838/1469511155,v1:172.21.15.12:6839/1469511155] conn(0x557cd387b070 0x557cd3879d80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f3fa50959d9b981c server_cookie=fc66acc38019d00c in_seq=0 out_seq=0 2024-09-15T22:24:25.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.245+0000 7f2dc3e00640 10 client.24896 ms_handle_connect on v2:172.21.15.12:6838/1469511155 2024-09-15T22:24:25.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.245+0000 7f2dc3e00640 1 -- 172.21.15.1:0/81453605 <== mds.1 v2:172.21.15.12:6838/1469511155 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x557cd375db30 con 0x557cd387b070 2024-09-15T22:24:25.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.245+0000 7f2dc3e00640 10 client.24896 handle_command_reply: tid=0 2024-09-15T22:24:25.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.245+0000 7f2de79d7740 1 client.24896 shutdown 2024-09-15T22:24:25.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.245+0000 7f2de79d7740 1 -- 172.21.15.1:0/81453605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cd37f0330 msgr2=0x557cd3816090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:25.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.245+0000 7f2de79d7740 1 --2- 172.21.15.1:0/81453605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cd37f0330 0x557cd3816090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0009620 tx=0x7f2dd00040c0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.245+0000 7f2de79d7740 1 -- 172.21.15.1:0/81453605 shutdown_connections 2024-09-15T22:24:25.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.245+0000 7f2de79d7740 1 --2- 172.21.15.1:0/81453605 >> [v2:172.21.15.12:6838/1469511155,v1:172.21.15.12:6839/1469511155] conn(0x557cd387b070 0x557cd3879d80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.245+0000 7f2de79d7740 1 --2- 172.21.15.1:0/81453605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557cd37fb510 0x557cd37f57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.245+0000 7f2de79d7740 1 --2- 172.21.15.1:0/81453605 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd37f0c50 0x557cd37f52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.245+0000 7f2de79d7740 1 --2- 172.21.15.1:0/81453605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cd37f0330 0x557cd3816090 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.245+0000 7f2dc3e00640 0 client.24896 ms_handle_reset on v2:172.21.15.12:6838/1469511155 2024-09-15T22:24:25.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.245+0000 7f2de79d7740 1 -- 172.21.15.1:0/81453605 >> 172.21.15.1:0/81453605 conn(0x557cd37ec8c0 msgr2=0x557cd37f7230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:25.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.246+0000 7f2de79d7740 1 -- 172.21.15.1:0/81453605 shutdown_connections 2024-09-15T22:24:25.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.246+0000 7f2de79d7740 1 -- 172.21.15.1:0/81453605 wait complete. 2024-09-15T22:24:25.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.246+0000 7f2de79d7740 20 client.24896 trim_cache size 0 max 16384 2024-09-15T22:24:25.250 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-15T22:24:25.251 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "c1228c44-73af-11ef-bceb-c7b262605968", 2024-09-15T22:24:25.251 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 1, 2024-09-15T22:24:25.251 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24524, 2024-09-15T22:24:25.251 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-15T22:24:25.251 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-15T22:24:25.251 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-15T22:24:25.251 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 83.429444938000003, 2024-09-15T22:24:25.251 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 25, 2024-09-15T22:24:25.251 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 84, 2024-09-15T22:24:25.251 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 82, 2024-09-15T22:24:25.251 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 106.879736237 2024-09-15T22:24:25.251 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-15T22:24:25.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.246+0000 7f2de4e00640 1 -- 172.21.15.1:0/2589569211 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2dc40a32d0 msgr2=0x7f2dc40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:25.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.246+0000 7f2de4e00640 1 --2- 172.21.15.1:0/2589569211 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2dc40a32d0 0x7f2dc40a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x557cd37ed720 tx=0x7f2dd0005f90 comp rx=0 tx=0).stop 2024-09-15T22:24:25.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.246+0000 7f2de4e00640 1 -- 172.21.15.1:0/2589569211 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2de0109120 msgr2=0x7f2de019eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:25.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.246+0000 7f2de4e00640 1 --2- 172.21.15.1:0/2589569211 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2de0109120 0x7f2de019eec0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2dd802ade0 tx=0x7f2dd80319f0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.247+0000 7f2de4e00640 1 -- 172.21.15.1:0/2589569211 shutdown_connections 2024-09-15T22:24:25.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.247+0000 7f2de4e00640 1 --2- 172.21.15.1:0/2589569211 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2dc40a32d0 0x7f2dc40a5790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.247+0000 7f2de4e00640 1 --2- 172.21.15.1:0/2589569211 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2de0109120 0x7f2de019eec0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.247+0000 7f2de4e00640 1 --2- 172.21.15.1:0/2589569211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2de01049a0 0x7f2de019ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.247+0000 7f2de4e00640 1 --2- 172.21.15.1:0/2589569211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2de0103ff0 0x7f2de019a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:25.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.247+0000 7f2de4e00640 1 -- 172.21.15.1:0/2589569211 >> 172.21.15.1:0/2589569211 conn(0x7f2de00ffa90 msgr2=0x7f2de0100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:25.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.247+0000 7f2de4e00640 1 -- 172.21.15.1:0/2589569211 shutdown_connections 2024-09-15T22:24:25.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:25.247+0000 7f2de4e00640 1 -- 172.21.15.1:0/2589569211 wait complete. 2024-09-15T22:24:25.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:25 smithi001 ceph-mon[30843]: pgmap v340: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-15T22:24:25.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:25 smithi012 ceph-mon[34883]: pgmap v340: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-15T22:24:25.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:25 smithi098 ceph-mon[35514]: pgmap v340: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-15T22:24:26.208 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-15T22:24:26.584 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:27.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.184+0000 7ff6fcc00640 1 -- 172.21.15.1:0/2260947155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6f81079c0 msgr2=0x7ff6f8107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:27.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.184+0000 7ff6fcc00640 1 --2- 172.21.15.1:0/2260947155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6f81079c0 0x7ff6f8107da0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8009900 tx=0x7ff6e802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.184+0000 7ff6fcc00640 1 -- 172.21.15.1:0/2260947155 shutdown_connections 2024-09-15T22:24:27.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.184+0000 7ff6fcc00640 1 --2- 172.21.15.1:0/2260947155 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6f8102360 0x7ff6f810e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.184+0000 7ff6fcc00640 1 --2- 172.21.15.1:0/2260947155 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6f81019c0 0x7ff6f8101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.184+0000 7ff6fcc00640 1 --2- 172.21.15.1:0/2260947155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6f81079c0 0x7ff6f8107da0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.184+0000 7ff6fcc00640 1 -- 172.21.15.1:0/2260947155 >> 172.21.15.1:0/2260947155 conn(0x7ff6f80fd740 msgr2=0x7ff6f80ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:27.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.184+0000 7ff6fcc00640 1 -- 172.21.15.1:0/2260947155 shutdown_connections 2024-09-15T22:24:27.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.184+0000 7ff6fcc00640 1 -- 172.21.15.1:0/2260947155 wait complete. 2024-09-15T22:24:27.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.185+0000 7ff6fcc00640 1 Processor -- start 2024-09-15T22:24:27.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.185+0000 7ff6fcc00640 1 -- start start 2024-09-15T22:24:27.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.186+0000 7ff6fcc00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6f81019c0 0x7ff6f819a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:27.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.186+0000 7ff6fcc00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6f8102360 0x7ff6f819a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:27.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.186+0000 7ff6fcc00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6f81079c0 0x7ff6f819ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:27.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.186+0000 7ff6fcc00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f8111dc0 con 0x7ff6f81079c0 2024-09-15T22:24:27.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.186+0000 7ff6fcc00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f8111c40 con 0x7ff6f81019c0 2024-09-15T22:24:27.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.186+0000 7ff6fcc00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f8111f40 con 0x7ff6f8102360 2024-09-15T22:24:27.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.186+0000 7ff6f7e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6f81079c0 0x7ff6f819ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:27.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.186+0000 7ff6f7400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6f81019c0 0x7ff6f819a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:27.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.186+0000 7ff6f7e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6f81079c0 0x7ff6f819ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55114/0 (socket says 172.21.15.1:55114) 2024-09-15T22:24:27.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.186+0000 7ff6f6a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6f8102360 0x7ff6f819a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:27.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.186+0000 7ff6f7e00640 1 -- 172.21.15.1:0/18270980 learned_addr learned my addr 172.21.15.1:0/18270980 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:27.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.186+0000 7ff6f7400640 1 -- 172.21.15.1:0/18270980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6f8102360 msgr2=0x7ff6f819a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:27.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.186+0000 7ff6f7400640 1 --2- 172.21.15.1:0/18270980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6f8102360 0x7ff6f819a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.186+0000 7ff6f7400640 1 -- 172.21.15.1:0/18270980 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6f81079c0 msgr2=0x7ff6f819ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:27.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.186+0000 7ff6f7400640 1 --2- 172.21.15.1:0/18270980 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6f81079c0 0x7ff6f819ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.186+0000 7ff6f7400640 1 -- 172.21.15.1:0/18270980 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f819f400 con 0x7ff6f81019c0 2024-09-15T22:24:27.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.187+0000 7ff6f7400640 1 --2- 172.21.15.1:0/18270980 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6f81019c0 0x7ff6f819a450 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8005940 tx=0x7ff6e8003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:27.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.187+0000 7ff6efe00640 1 -- 172.21.15.1:0/18270980 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e803f070 con 0x7ff6f81019c0 2024-09-15T22:24:27.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.187+0000 7ff6fcc00640 1 -- 172.21.15.1:0/18270980 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6f819f690 con 0x7ff6f81019c0 2024-09-15T22:24:27.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.187+0000 7ff6efe00640 1 -- 172.21.15.1:0/18270980 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6e8031c30 con 0x7ff6f81019c0 2024-09-15T22:24:27.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.187+0000 7ff6efe00640 1 -- 172.21.15.1:0/18270980 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e8035030 con 0x7ff6f81019c0 2024-09-15T22:24:27.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.187+0000 7ff6fcc00640 1 -- 172.21.15.1:0/18270980 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6f81a6fd0 con 0x7ff6f81019c0 2024-09-15T22:24:27.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.190+0000 7ff700bd3740 1 Processor -- start 2024-09-15T22:24:27.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.190+0000 7ff700bd3740 1 -- start start 2024-09-15T22:24:27.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.190+0000 7ff700bd3740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d56be074e0 0x55d56be078c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:27.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.190+0000 7ff700bd3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d56be07e00 0x55d56be12180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:27.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.190+0000 7ff700bd3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d56be126c0 0x55d56be14ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:27.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.190+0000 7ff700bd3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d56bd6d0b0 con 0x55d56be126c0 2024-09-15T22:24:27.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.190+0000 7ff700bd3740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55d56bd14ab0 con 0x55d56be074e0 2024-09-15T22:24:27.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.190+0000 7ff700bd3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d56bd69070 con 0x55d56be07e00 2024-09-15T22:24:27.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.191+0000 7ff6efe00640 1 -- 172.21.15.1:0/18270980 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7ff6e8042070 con 0x7ff6f81019c0 2024-09-15T22:24:27.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.191+0000 7ff6f7e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d56be074e0 0x55d56be078c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:27.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.191+0000 7ff6f7e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d56be074e0 0x55d56be078c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:49786/0 (socket says 172.21.15.1:49786) 2024-09-15T22:24:27.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.191+0000 7ff6f7e00640 1 -- 172.21.15.1:0/514335210 learned_addr learned my addr 172.21.15.1:0/514335210 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:27.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.191+0000 7ff6f6a00640 1 --2- 172.21.15.1:0/514335210 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d56be126c0 0x55d56be14ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:27.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.191+0000 7ff6f7e00640 1 -- 172.21.15.1:0/514335210 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d56be07e00 msgr2=0x55d56be12180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:27.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.191+0000 7ff6f7e00640 1 --2- 172.21.15.1:0/514335210 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d56be07e00 0x55d56be12180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.191+0000 7ff6f7e00640 1 -- 172.21.15.1:0/514335210 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d56be126c0 msgr2=0x55d56be14ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:27.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.191+0000 7ff6f7e00640 1 --2- 172.21.15.1:0/514335210 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d56be126c0 0x55d56be14ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.191+0000 7ff6f7e00640 1 -- 172.21.15.1:0/514335210 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d56bd214a0 con 0x55d56be074e0 2024-09-15T22:24:27.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.191+0000 7ff6f7e00640 1 --2- 172.21.15.1:0/514335210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d56be074e0 0x55d56be078c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0011470 tx=0x7ff6f0011930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55af1542dc7eccdb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:27.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.192+0000 7ff6e3e00640 1 -- 172.21.15.1:0/514335210 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0004b20 con 0x55d56be074e0 2024-09-15T22:24:27.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.192+0000 7ff6e3e00640 1 -- 172.21.15.1:0/514335210 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6f0004cc0 con 0x55d56be074e0 2024-09-15T22:24:27.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.192+0000 7ff6e3e00640 1 -- 172.21.15.1:0/514335210 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f00053f0 con 0x55d56be074e0 2024-09-15T22:24:27.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.192+0000 7ff6efe00640 1 --2- 172.21.15.1:0/18270980 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ff6dc0a32d0 0x7ff6dc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:27.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.192+0000 7ff700bd3740 1 -- 172.21.15.1:0/514335210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d56be074e0 msgr2=0x55d56be078c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:27.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.192+0000 7ff700bd3740 1 --2- 172.21.15.1:0/514335210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d56be074e0 0x55d56be078c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0011470 tx=0x7ff6f0011930 comp rx=0 tx=0).stop 2024-09-15T22:24:27.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.192+0000 7ff700bd3740 1 -- 172.21.15.1:0/514335210 shutdown_connections 2024-09-15T22:24:27.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.192+0000 7ff700bd3740 1 --2- 172.21.15.1:0/514335210 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d56be126c0 0x55d56be14ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.192+0000 7ff700bd3740 1 --2- 172.21.15.1:0/514335210 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d56be07e00 0x55d56be12180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.192+0000 7ff700bd3740 1 --2- 172.21.15.1:0/514335210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d56be074e0 0x55d56be078c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.192+0000 7ff700bd3740 1 -- 172.21.15.1:0/514335210 >> 172.21.15.1:0/514335210 conn(0x55d56be03a70 msgr2=0x55d56be03e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:27.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.192+0000 7ff6efe00640 1 -- 172.21.15.1:0/18270980 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ff6e80f0070 con 0x7ff6f81019c0 2024-09-15T22:24:27.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.192+0000 7ff6f7400640 1 --2- 172.21.15.1:0/18270980 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ff6dc0a32d0 0x7ff6dc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:27.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.193+0000 7ff700bd3740 1 -- 172.21.15.1:0/514335210 shutdown_connections 2024-09-15T22:24:27.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.193+0000 7ff700bd3740 1 -- 172.21.15.1:0/514335210 wait complete. 2024-09-15T22:24:27.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.193+0000 7ff6f7400640 1 --2- 172.21.15.1:0/18270980 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ff6dc0a32d0 0x7ff6dc0a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff6e80b8f40 tx=0x7ff6e8034000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:27.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.193+0000 7ff700bd3740 1 -- start start 2024-09-15T22:24:27.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.193+0000 7ff700bd3740 1 Processor -- start 2024-09-15T22:24:27.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.194+0000 7ff700bd3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d56be074e0 0x55d56be12170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:27.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.194+0000 7ff700bd3740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d56be07e00 0x55d56be0f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:27.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.194+0000 7ff700bd3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d56be126c0 0x55d56be0fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:27.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.194+0000 7ff700bd3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d56be15330 con 0x55d56be074e0 2024-09-15T22:24:27.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.194+0000 7ff700bd3740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55d56bcf5920 con 0x55d56be07e00 2024-09-15T22:24:27.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.194+0000 7ff700bd3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d56be154b0 con 0x55d56be126c0 2024-09-15T22:24:27.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.194+0000 7ff700bd3740 10 client.0 _ll_register_callbacks cb 0x55d56bd198a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:24:27.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.194+0000 7ff6f7e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d56be074e0 0x55d56be12170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:27.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.194+0000 7ff6f6a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d56be07e00 0x55d56be0f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:27.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.194+0000 7ff6f7e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d56be074e0 0x55d56be12170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55146/0 (socket says 172.21.15.1:55146) 2024-09-15T22:24:27.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.194+0000 7ff6f7e00640 1 -- 172.21.15.1:0/3772358979 learned_addr learned my addr 172.21.15.1:0/3772358979 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:27.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.194+0000 7ff6f7e00640 1 --2- 172.21.15.1:0/3772358979 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d56be126c0 0x55d56be0fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:27.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.195+0000 7ff6f6a00640 1 -- 172.21.15.1:0/3772358979 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d56be126c0 msgr2=0x55d56be0fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:27.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.195+0000 7ff6f6a00640 1 --2- 172.21.15.1:0/3772358979 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d56be126c0 0x55d56be0fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.195+0000 7ff6f6a00640 1 -- 172.21.15.1:0/3772358979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d56be074e0 msgr2=0x55d56be12170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:27.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.195+0000 7ff6f6a00640 1 --2- 172.21.15.1:0/3772358979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d56be074e0 0x55d56be12170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.195+0000 7ff6f6a00640 1 -- 172.21.15.1:0/3772358979 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d56bade2b0 con 0x55d56be07e00 2024-09-15T22:24:27.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.195+0000 7ff6f7e00640 1 --2- 172.21.15.1:0/3772358979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d56be074e0 0x55d56be12170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:27.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.195+0000 7ff6f6a00640 1 --2- 172.21.15.1:0/3772358979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d56be07e00 0x55d56be0f420 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff6f810ea80 tx=0x7ff6e4012b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be22cf87c6456589 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:27.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.195+0000 7ff6e0c00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-15T22:24:27.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.195+0000 7ff6e0c00640 1 -- 172.21.15.1:0/3772358979 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e400f920 con 0x55d56be07e00 2024-09-15T22:24:27.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.195+0000 7ff700bd3740 1 -- 172.21.15.1:0/3772358979 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6f0004cc0 con 0x55d56be07e00 2024-09-15T22:24:27.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.195+0000 7ff6e0c00640 1 -- 172.21.15.1:0/3772358979 <== mon.2 v2:172.21.15.12:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ff6e400fac0 con 0x55d56be07e00 2024-09-15T22:24:27.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.196+0000 7ff6e0c00640 1 -- 172.21.15.1:0/3772358979 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff6e400fcc0 con 0x55d56be07e00 2024-09-15T22:24:27.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.196+0000 7ff700bd3740 10 client.24908 fetch_fsmap learned FSMap version 25 2024-09-15T22:24:27.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.196+0000 7ff700bd3740 1 -- 172.21.15.1:0/3772358979 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d56be20f70 con 0x55d56be07e00 2024-09-15T22:24:27.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.196+0000 7ff6e0c00640 1 -- 172.21.15.1:0/3772358979 <== mon.2 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6f0004cc0 con 0x55d56be07e00 2024-09-15T22:24:27.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.196+0000 7ff6e0c00640 1 -- 172.21.15.1:0/3772358979 <== mon.2 v2:172.21.15.12:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff6e4025050 con 0x55d56be07e00 2024-09-15T22:24:27.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.196+0000 7ff700bd3740 10 client.24908 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:24:27.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.196+0000 7ff700bd3740 10 client.24908 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-15T22:24:27.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.196+0000 7ff700bd3740 20 client.24908 populate_metadata read hostname 'smithi001' 2024-09-15T22:24:27.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.196+0000 7ff700bd3740 1 --2- 172.21.15.1:0/3772358979 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55d56be23580 0x55d56be249f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:27.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.196+0000 7ff700bd3740 4 client.24908 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:24:27.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.196+0000 7ff700bd3740 1 -- 172.21.15.1:0/3772358979 --> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d56bd7a620 con 0x55d56be23580 2024-09-15T22:24:27.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.197+0000 7ff6f7e00640 1 --2- 172.21.15.1:0/3772358979 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55d56be23580 0x55d56be249f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:27.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.197+0000 7ff6f7e00640 1 --2- 172.21.15.1:0/3772358979 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55d56be23580 0x55d56be249f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5490ab5e79b53d1 server_cookie=87e5d4df64603e0c in_seq=0 out_seq=0 2024-09-15T22:24:27.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.197+0000 7ff6e0c00640 10 client.24908 ms_handle_connect on v2:172.21.15.98:6838/2831161859 2024-09-15T22:24:27.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.198+0000 7ff6e0c00640 1 -- 172.21.15.1:0/3772358979 <== mds.0 v2:172.21.15.98:6838/2831161859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d56bd7a620 con 0x55d56be23580 2024-09-15T22:24:27.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.198+0000 7ff6e0c00640 10 client.24908 handle_command_reply: tid=0 2024-09-15T22:24:27.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.198+0000 7ff700bd3740 1 client.24908 shutdown 2024-09-15T22:24:27.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.198+0000 7ff700bd3740 1 -- 172.21.15.1:0/3772358979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d56be07e00 msgr2=0x55d56be0f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:27.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.198+0000 7ff700bd3740 1 --2- 172.21.15.1:0/3772358979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d56be07e00 0x55d56be0f420 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff6f810ea80 tx=0x7ff6e4012b60 comp rx=0 tx=0).stop 2024-09-15T22:24:27.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.198+0000 7ff700bd3740 1 -- 172.21.15.1:0/3772358979 shutdown_connections 2024-09-15T22:24:27.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.198+0000 7ff700bd3740 1 --2- 172.21.15.1:0/3772358979 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d56be126c0 0x55d56be0fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.198+0000 7ff700bd3740 1 --2- 172.21.15.1:0/3772358979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d56be07e00 0x55d56be0f420 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.198+0000 7ff700bd3740 1 --2- 172.21.15.1:0/3772358979 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55d56be23580 0x55d56be249f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.198+0000 7ff700bd3740 1 --2- 172.21.15.1:0/3772358979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d56be074e0 0x55d56be12170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.198+0000 7ff700bd3740 1 -- 172.21.15.1:0/3772358979 >> 172.21.15.1:0/3772358979 conn(0x55d56be03a70 msgr2=0x55d56be09750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:27.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.198+0000 7ff6e0c00640 0 client.24908 ms_handle_reset on v2:172.21.15.98:6838/2831161859 2024-09-15T22:24:27.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.198+0000 7ff700bd3740 1 -- 172.21.15.1:0/3772358979 shutdown_connections 2024-09-15T22:24:27.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.198+0000 7ff700bd3740 1 -- 172.21.15.1:0/3772358979 wait complete. 2024-09-15T22:24:27.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.199+0000 7ff700bd3740 20 client.24908 trim_cache size 0 max 16384 2024-09-15T22:24:27.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.217+0000 7ff700bd3740 1 Processor -- start 2024-09-15T22:24:27.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.217+0000 7ff700bd3740 1 -- start start 2024-09-15T22:24:27.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.218+0000 7ff700bd3740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d56be074e0 0x55d56be249f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:27.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.218+0000 7ff700bd3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d56be07e00 0x55d56be0dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:27.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.218+0000 7ff700bd3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d56be126c0 0x55d56be0e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:27.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.218+0000 7ff700bd3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d56be22d30 con 0x55d56be07e00 2024-09-15T22:24:27.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.218+0000 7ff700bd3740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55d56be23400 con 0x55d56be074e0 2024-09-15T22:24:27.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.218+0000 7ff700bd3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d56be23ad0 con 0x55d56be126c0 2024-09-15T22:24:27.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.218+0000 7ff6f6a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d56be07e00 0x55d56be0dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:27.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.218+0000 7ff6f6a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d56be07e00 0x55d56be0dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55150/0 (socket says 172.21.15.1:55150) 2024-09-15T22:24:27.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.218+0000 7ff6f6a00640 1 -- 172.21.15.1:0/1445119990 learned_addr learned my addr 172.21.15.1:0/1445119990 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:27.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.218+0000 7ff6f7e00640 1 --2- 172.21.15.1:0/1445119990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d56be074e0 0x55d56be249f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:27.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.218+0000 7ff6f7e00640 1 --2- 172.21.15.1:0/1445119990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d56be126c0 0x55d56be0e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:27.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.218+0000 7ff6f6a00640 1 -- 172.21.15.1:0/1445119990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d56be126c0 msgr2=0x55d56be0e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:27.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.218+0000 7ff6f6a00640 1 --2- 172.21.15.1:0/1445119990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d56be126c0 0x55d56be0e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.218+0000 7ff6f6a00640 1 -- 172.21.15.1:0/1445119990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d56be074e0 msgr2=0x55d56be249f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:27.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.218+0000 7ff6f6a00640 1 --2- 172.21.15.1:0/1445119990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d56be074e0 0x55d56be249f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.218+0000 7ff6f6a00640 1 -- 172.21.15.1:0/1445119990 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d56be07c30 con 0x55d56be07e00 2024-09-15T22:24:27.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.219+0000 7ff6f6a00640 1 --2- 172.21.15.1:0/1445119990 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d56be07e00 0x55d56be0dd10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4000c00 tx=0x7ff6e4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=912575759ff174e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:27.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.219+0000 7ff6e3400640 1 -- 172.21.15.1:0/1445119990 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e400f9a0 con 0x55d56be07e00 2024-09-15T22:24:27.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.219+0000 7ff6e3400640 1 -- 172.21.15.1:0/1445119990 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6e4005590 con 0x55d56be07e00 2024-09-15T22:24:27.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.219+0000 7ff6e3400640 1 -- 172.21.15.1:0/1445119990 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e4003850 con 0x55d56be07e00 2024-09-15T22:24:27.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.219+0000 7ff700bd3740 1 -- 172.21.15.1:0/1445119990 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d56be07e00 msgr2=0x55d56be0dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:27.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.220+0000 7ff700bd3740 1 --2- 172.21.15.1:0/1445119990 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d56be07e00 0x55d56be0dd10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4000c00 tx=0x7ff6e4005880 comp rx=0 tx=0).stop 2024-09-15T22:24:27.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.220+0000 7ff700bd3740 1 -- 172.21.15.1:0/1445119990 shutdown_connections 2024-09-15T22:24:27.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.220+0000 7ff700bd3740 1 --2- 172.21.15.1:0/1445119990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d56be126c0 0x55d56be0e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.220+0000 7ff700bd3740 1 --2- 172.21.15.1:0/1445119990 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d56be07e00 0x55d56be0dd10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.220+0000 7ff700bd3740 1 --2- 172.21.15.1:0/1445119990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d56be074e0 0x55d56be249f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.220+0000 7ff700bd3740 1 -- 172.21.15.1:0/1445119990 >> 172.21.15.1:0/1445119990 conn(0x55d56be03a70 msgr2=0x55d56be0a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:27.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.220+0000 7ff700bd3740 1 -- 172.21.15.1:0/1445119990 shutdown_connections 2024-09-15T22:24:27.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.220+0000 7ff700bd3740 1 -- 172.21.15.1:0/1445119990 wait complete. 2024-09-15T22:24:27.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.220+0000 7ff700bd3740 1 -- start start 2024-09-15T22:24:27.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.221+0000 7ff700bd3740 1 Processor -- start 2024-09-15T22:24:27.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.221+0000 7ff700bd3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d56be074e0 0x55d56be0be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:27.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.221+0000 7ff700bd3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d56be07e00 0x55d56be0c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:27.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.221+0000 7ff700bd3740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d56be126c0 0x55d56be2bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:27.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.221+0000 7ff700bd3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d56be24870 con 0x55d56be07e00 2024-09-15T22:24:27.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.221+0000 7ff700bd3740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55d56be241a0 con 0x55d56be126c0 2024-09-15T22:24:27.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.221+0000 7ff700bd3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d56be24f40 con 0x55d56be074e0 2024-09-15T22:24:27.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.221+0000 7ff700bd3740 10 client.0 _ll_register_callbacks cb 0x7ff6e4009d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:24:27.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.221+0000 7ff6f7e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d56be074e0 0x55d56be0be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:27.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.221+0000 7ff6f6a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d56be07e00 0x55d56be0c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:27.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.221+0000 7ff6f7e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d56be074e0 0x55d56be0be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:60050/0 (socket says 172.21.15.1:60050) 2024-09-15T22:24:27.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.221+0000 7ff6f7e00640 1 -- 172.21.15.1:0/163120040 learned_addr learned my addr 172.21.15.1:0/163120040 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:27.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.221+0000 7ff6f7e00640 1 --2- 172.21.15.1:0/163120040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d56be126c0 0x55d56be2bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:27.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.222+0000 7ff6f6a00640 1 -- 172.21.15.1:0/163120040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d56be074e0 msgr2=0x55d56be0be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:27.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.222+0000 7ff6f6a00640 1 --2- 172.21.15.1:0/163120040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d56be074e0 0x55d56be0be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.222+0000 7ff6f6a00640 1 -- 172.21.15.1:0/163120040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d56be126c0 msgr2=0x55d56be2bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:27.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.222+0000 7ff6f6a00640 1 --2- 172.21.15.1:0/163120040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d56be126c0 0x55d56be2bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.222+0000 7ff6f6a00640 1 -- 172.21.15.1:0/163120040 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d56be2c1d0 con 0x55d56be07e00 2024-09-15T22:24:27.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.222+0000 7ff6f7e00640 1 --2- 172.21.15.1:0/163120040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d56be126c0 0x55d56be2bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:27.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.222+0000 7ff6f6a00640 1 --2- 172.21.15.1:0/163120040 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d56be07e00 0x55d56be0c370 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55d56be02350 tx=0x7ff6e4012060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f211b24d875efd57 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:27.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.222+0000 7ff6e0c00640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-15T22:24:27.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.222+0000 7ff6e0c00640 1 -- 172.21.15.1:0/163120040 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e4034060 con 0x55d56be07e00 2024-09-15T22:24:27.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.222+0000 7ff6e0c00640 1 -- 172.21.15.1:0/163120040 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7ff6e401ca20 con 0x55d56be07e00 2024-09-15T22:24:27.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.223+0000 7ff700bd3740 1 -- 172.21.15.1:0/163120040 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6e4005590 con 0x55d56be07e00 2024-09-15T22:24:27.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.223+0000 7ff6e0c00640 1 -- 172.21.15.1:0/163120040 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff6e402b070 con 0x55d56be07e00 2024-09-15T22:24:27.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.223+0000 7ff700bd3740 10 client.14934 fetch_fsmap learned FSMap version 25 2024-09-15T22:24:27.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.223+0000 7ff700bd3740 1 -- 172.21.15.1:0/163120040 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d56be2d4b0 con 0x55d56be07e00 2024-09-15T22:24:27.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.223+0000 7ff6e0c00640 1 -- 172.21.15.1:0/163120040 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6e4005590 con 0x55d56be07e00 2024-09-15T22:24:27.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.223+0000 7ff6e0c00640 1 -- 172.21.15.1:0/163120040 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff6e4025070 con 0x55d56be07e00 2024-09-15T22:24:27.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.223+0000 7ff700bd3740 10 client.14934 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:24:27.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.223+0000 7ff700bd3740 10 client.14934 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-15T22:24:27.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.223+0000 7ff700bd3740 20 client.14934 populate_metadata read hostname 'smithi001' 2024-09-15T22:24:27.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.223+0000 7ff700bd3740 1 --2- 172.21.15.1:0/163120040 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55d56be91f90 0x55d56be90ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:27.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.223+0000 7ff700bd3740 4 client.14934 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:24:27.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.223+0000 7ff700bd3740 1 -- 172.21.15.1:0/163120040 --> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] -- command(tid 0: {"prefix": "status"}) -- 0x55d56bd74b30 con 0x55d56be91f90 2024-09-15T22:24:27.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.224+0000 7ff6f7e00640 1 --2- 172.21.15.1:0/163120040 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55d56be91f90 0x55d56be90ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:27.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.224+0000 7ff6f7e00640 1 --2- 172.21.15.1:0/163120040 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55d56be91f90 0x55d56be90ca0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd936b2e5c792a4d server_cookie=21be422e1cdd5135 in_seq=0 out_seq=0 2024-09-15T22:24:27.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.224+0000 7ff6e0c00640 10 client.14934 ms_handle_connect on v2:172.21.15.98:6838/2831161859 2024-09-15T22:24:27.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.224+0000 7ff6e0c00640 1 -- 172.21.15.1:0/163120040 <== mds.0 v2:172.21.15.98:6838/2831161859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55d56bd74b30 con 0x55d56be91f90 2024-09-15T22:24:27.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.224+0000 7ff6e0c00640 10 client.14934 handle_command_reply: tid=0 2024-09-15T22:24:27.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.225+0000 7ff700bd3740 1 client.14934 shutdown 2024-09-15T22:24:27.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.225+0000 7ff700bd3740 1 -- 172.21.15.1:0/163120040 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d56be07e00 msgr2=0x55d56be0c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:27.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.225+0000 7ff700bd3740 1 --2- 172.21.15.1:0/163120040 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d56be07e00 0x55d56be0c370 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55d56be02350 tx=0x7ff6e4012060 comp rx=0 tx=0).stop 2024-09-15T22:24:27.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.225+0000 7ff700bd3740 1 -- 172.21.15.1:0/163120040 shutdown_connections 2024-09-15T22:24:27.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.225+0000 7ff700bd3740 1 --2- 172.21.15.1:0/163120040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d56be126c0 0x55d56be2bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.225+0000 7ff700bd3740 1 --2- 172.21.15.1:0/163120040 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55d56be91f90 0x55d56be90ca0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.225+0000 7ff700bd3740 1 --2- 172.21.15.1:0/163120040 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d56be07e00 0x55d56be0c370 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.225+0000 7ff700bd3740 1 --2- 172.21.15.1:0/163120040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d56be074e0 0x55d56be0be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.225+0000 7ff700bd3740 1 -- 172.21.15.1:0/163120040 >> 172.21.15.1:0/163120040 conn(0x55d56be03a70 msgr2=0x55d56be0dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:27.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.225+0000 7ff6e0c00640 0 client.14934 ms_handle_reset on v2:172.21.15.98:6838/2831161859 2024-09-15T22:24:27.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.225+0000 7ff700bd3740 1 -- 172.21.15.1:0/163120040 shutdown_connections 2024-09-15T22:24:27.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.225+0000 7ff700bd3740 1 -- 172.21.15.1:0/163120040 wait complete. 2024-09-15T22:24:27.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.225+0000 7ff700bd3740 20 client.14934 trim_cache size 0 max 16384 2024-09-15T22:24:27.243 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-15T22:24:27.243 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "c1228c44-73af-11ef-bceb-c7b262605968", 2024-09-15T22:24:27.244 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2024-09-15T22:24:27.244 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24538, 2024-09-15T22:24:27.244 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-15T22:24:27.244 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-15T22:24:27.244 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-15T22:24:27.244 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 95.451944530000006, 2024-09-15T22:24:27.244 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 25, 2024-09-15T22:24:27.244 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 84, 2024-09-15T22:24:27.244 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 82, 2024-09-15T22:24:27.244 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 118.52823266 2024-09-15T22:24:27.244 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-15T22:24:27.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.226+0000 7ff6fcc00640 1 -- 172.21.15.1:0/18270980 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ff6dc0a32d0 msgr2=0x7ff6dc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:27.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.226+0000 7ff6fcc00640 1 --2- 172.21.15.1:0/18270980 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ff6dc0a32d0 0x7ff6dc0a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff6e80b8f40 tx=0x7ff6e8034000 comp rx=0 tx=0).stop 2024-09-15T22:24:27.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.226+0000 7ff6fcc00640 1 -- 172.21.15.1:0/18270980 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6f81019c0 msgr2=0x7ff6f819a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:27.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.226+0000 7ff6fcc00640 1 --2- 172.21.15.1:0/18270980 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6f81019c0 0x7ff6f819a450 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8005940 tx=0x7ff6e8003c10 comp rx=0 tx=0).stop 2024-09-15T22:24:27.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.226+0000 7ff6fcc00640 1 -- 172.21.15.1:0/18270980 shutdown_connections 2024-09-15T22:24:27.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.226+0000 7ff6fcc00640 1 --2- 172.21.15.1:0/18270980 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ff6dc0a32d0 0x7ff6dc0a5790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.226+0000 7ff6fcc00640 1 --2- 172.21.15.1:0/18270980 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6f81079c0 0x7ff6f819ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.226+0000 7ff6fcc00640 1 --2- 172.21.15.1:0/18270980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6f8102360 0x7ff6f819a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.226+0000 7ff6fcc00640 1 --2- 172.21.15.1:0/18270980 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6f81019c0 0x7ff6f819a450 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.226+0000 7ff6fcc00640 1 -- 172.21.15.1:0/18270980 >> 172.21.15.1:0/18270980 conn(0x7ff6f80fd740 msgr2=0x7ff6f810cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:27.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.226+0000 7ff6fcc00640 1 -- 172.21.15.1:0/18270980 shutdown_connections 2024-09-15T22:24:27.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:27.226+0000 7ff6fcc00640 1 -- 172.21.15.1:0/18270980 wait complete. 2024-09-15T22:24:27.732 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:27 smithi001 ceph-mon[30843]: pgmap v341: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-15T22:24:27.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:27 smithi012 ceph-mon[34883]: pgmap v341: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-15T22:24:27.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:27 smithi098 ceph-mon[35514]: pgmap v341: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-15T22:24:28.231 INFO:tasks.cephadm:Setup complete, yielding 2024-09-15T22:24:28.231 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-15T22:24:28.241 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi001.front.sepia.ceph.com 2024-09-15T22:24:28.242 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-15T22:24:28.632 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:29.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.229+0000 7fcde0a00640 1 -- 172.21.15.1:0/3579984116 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcddc103e00 msgr2=0x7fcddc104200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:29.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.229+0000 7fcde0a00640 1 --2- 172.21.15.1:0/3579984116 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcddc103e00 0x7fcddc104200 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc009900 tx=0x7fcdcc02a3f0 comp rx=0 tx=0).stop 2024-09-15T22:24:29.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.229+0000 7fcde0a00640 1 -- 172.21.15.1:0/3579984116 shutdown_connections 2024-09-15T22:24:29.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.229+0000 7fcde0a00640 1 --2- 172.21.15.1:0/3579984116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcddc105920 0x7fcddc10c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:29.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.229+0000 7fcde0a00640 1 --2- 172.21.15.1:0/3579984116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcddc104f60 0x7fcddc1053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:29.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.229+0000 7fcde0a00640 1 --2- 172.21.15.1:0/3579984116 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcddc103e00 0x7fcddc104200 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:29.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.229+0000 7fcde0a00640 1 -- 172.21.15.1:0/3579984116 >> 172.21.15.1:0/3579984116 conn(0x7fcddc0ff5b0 msgr2=0x7fcddc1019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:29.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.229+0000 7fcde0a00640 1 -- 172.21.15.1:0/3579984116 shutdown_connections 2024-09-15T22:24:29.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.229+0000 7fcde0a00640 1 -- 172.21.15.1:0/3579984116 wait complete. 2024-09-15T22:24:29.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.230+0000 7fcde0a00640 1 Processor -- start 2024-09-15T22:24:29.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.230+0000 7fcde0a00640 1 -- start start 2024-09-15T22:24:29.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.230+0000 7fcde0a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcddc103e00 0x7fcddc19a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:29.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.230+0000 7fcde0a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcddc104f60 0x7fcddc19a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:29.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.230+0000 7fcde0a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcddc105920 0x7fcddc1a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:29.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.230+0000 7fcde0a00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcddc10fae0 con 0x7fcddc104f60 2024-09-15T22:24:29.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.230+0000 7fcde0a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcddc10f960 con 0x7fcddc105920 2024-09-15T22:24:29.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.230+0000 7fcde0a00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcddc10fc60 con 0x7fcddc103e00 2024-09-15T22:24:29.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.230+0000 7fcdd3e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcddc104f60 0x7fcddc19a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:29.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.230+0000 7fcdd3e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcddc104f60 0x7fcddc19a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55176/0 (socket says 172.21.15.1:55176) 2024-09-15T22:24:29.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.230+0000 7fcdd3e00640 1 -- 172.21.15.1:0/287857204 learned_addr learned my addr 172.21.15.1:0/287857204 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:29.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.230+0000 7fcdda800640 1 --2- 172.21.15.1:0/287857204 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcddc105920 0x7fcddc1a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:29.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.230+0000 7fcdd9e00640 1 --2- 172.21.15.1:0/287857204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcddc103e00 0x7fcddc19a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:29.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.231+0000 7fcdd3e00640 1 -- 172.21.15.1:0/287857204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcddc103e00 msgr2=0x7fcddc19a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:29.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.231+0000 7fcdd3e00640 1 --2- 172.21.15.1:0/287857204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcddc103e00 0x7fcddc19a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:29.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.231+0000 7fcdd3e00640 1 -- 172.21.15.1:0/287857204 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcddc105920 msgr2=0x7fcddc1a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:29.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.231+0000 7fcdd3e00640 1 --2- 172.21.15.1:0/287857204 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcddc105920 0x7fcddc1a1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:29.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.231+0000 7fcdd3e00640 1 -- 172.21.15.1:0/287857204 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcddc1a1ce0 con 0x7fcddc104f60 2024-09-15T22:24:29.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.231+0000 7fcdd3e00640 1 --2- 172.21.15.1:0/287857204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcddc104f60 0x7fcddc19a5f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcdc400e9c0 tx=0x7fcdc400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:29.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.231+0000 7fcdd2a00640 1 -- 172.21.15.1:0/287857204 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc400cd80 con 0x7fcddc104f60 2024-09-15T22:24:29.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.231+0000 7fcdd2a00640 1 -- 172.21.15.1:0/287857204 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcdc40035f0 con 0x7fcddc104f60 2024-09-15T22:24:29.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.232+0000 7fcde0a00640 1 -- 172.21.15.1:0/287857204 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcddc1a1fd0 con 0x7fcddc104f60 2024-09-15T22:24:29.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.232+0000 7fcdd2a00640 1 -- 172.21.15.1:0/287857204 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4010690 con 0x7fcddc104f60 2024-09-15T22:24:29.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.232+0000 7fcde0a00640 1 -- 172.21.15.1:0/287857204 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcddc1a24d0 con 0x7fcddc104f60 2024-09-15T22:24:29.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.233+0000 7fcde0a00640 1 -- 172.21.15.1:0/287857204 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcddc10b1a0 con 0x7fcddc104f60 2024-09-15T22:24:29.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.235+0000 7fcdd2a00640 1 -- 172.21.15.1:0/287857204 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fcdc40037a0 con 0x7fcddc104f60 2024-09-15T22:24:29.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.236+0000 7fcdd2a00640 1 --2- 172.21.15.1:0/287857204 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fcdc00a3380 0x7fcdc00a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:29.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.237+0000 7fcdd2a00640 1 -- 172.21.15.1:0/287857204 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7fcdc40cfe10 con 0x7fcddc104f60 2024-09-15T22:24:29.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.237+0000 7fcdd9e00640 1 --2- 172.21.15.1:0/287857204 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fcdc00a3380 0x7fcdc00a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:29.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.237+0000 7fcdd9e00640 1 --2- 172.21.15.1:0/287857204 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fcdc00a3380 0x7fcdc00a5840 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc031440 tx=0x7fcdcc0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:29.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.240+0000 7fcdd2a00640 1 -- 172.21.15.1:0/287857204 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcdc40d3030 con 0x7fcddc104f60 2024-09-15T22:24:29.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.443+0000 7fcde0a00640 1 -- 172.21.15.1:0/287857204 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fcddc062630 con 0x7fcdc00a3380 2024-09-15T22:24:29.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.444+0000 7fcdd2a00640 1 -- 172.21.15.1:0/287857204 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fcddc062630 con 0x7fcdc00a3380 2024-09-15T22:24:29.446 INFO:teuthology.orchestra.run.smithi001.stdout:Backend: cephadm 2024-09-15T22:24:29.446 INFO:teuthology.orchestra.run.smithi001.stdout:Available: Yes 2024-09-15T22:24:29.446 INFO:teuthology.orchestra.run.smithi001.stdout:Paused: No 2024-09-15T22:24:29.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.446+0000 7fcde0a00640 1 -- 172.21.15.1:0/287857204 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fcdc00a3380 msgr2=0x7fcdc00a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:29.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.446+0000 7fcde0a00640 1 --2- 172.21.15.1:0/287857204 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fcdc00a3380 0x7fcdc00a5840 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc031440 tx=0x7fcdcc0315b0 comp rx=0 tx=0).stop 2024-09-15T22:24:29.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.446+0000 7fcde0a00640 1 -- 172.21.15.1:0/287857204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcddc104f60 msgr2=0x7fcddc19a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:29.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.446+0000 7fcde0a00640 1 --2- 172.21.15.1:0/287857204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcddc104f60 0x7fcddc19a5f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcdc400e9c0 tx=0x7fcdc400ee80 comp rx=0 tx=0).stop 2024-09-15T22:24:29.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.446+0000 7fcde0a00640 1 -- 172.21.15.1:0/287857204 shutdown_connections 2024-09-15T22:24:29.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.446+0000 7fcde0a00640 1 --2- 172.21.15.1:0/287857204 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fcdc00a3380 0x7fcdc00a5840 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:29.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.446+0000 7fcde0a00640 1 --2- 172.21.15.1:0/287857204 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcddc105920 0x7fcddc1a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:29.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.446+0000 7fcde0a00640 1 --2- 172.21.15.1:0/287857204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcddc104f60 0x7fcddc19a5f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:29.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.446+0000 7fcde0a00640 1 --2- 172.21.15.1:0/287857204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcddc103e00 0x7fcddc19a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:29.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.446+0000 7fcde0a00640 1 -- 172.21.15.1:0/287857204 >> 172.21.15.1:0/287857204 conn(0x7fcddc0ff5b0 msgr2=0x7fcddc108370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:29.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.446+0000 7fcde0a00640 1 -- 172.21.15.1:0/287857204 shutdown_connections 2024-09-15T22:24:29.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:29.446+0000 7fcde0a00640 1 -- 172.21.15.1:0/287857204 wait complete. 2024-09-15T22:24:29.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:29 smithi012 ceph-mon[34883]: pgmap v342: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-15T22:24:29.792 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:29 smithi001 ceph-mon[30843]: pgmap v342: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-15T22:24:29.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:29 smithi098 ceph-mon[35514]: pgmap v342: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-15T22:24:30.289 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-15T22:24:30.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:30 smithi001 ceph-mon[30843]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:24:30.671 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:30.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:30 smithi012 ceph-mon[34883]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:24:30.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:30 smithi098 ceph-mon[35514]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:24:31.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.212+0000 7f3f81200640 1 -- 172.21.15.1:0/3419198700 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f7c1037c0 msgr2=0x7f3f7c10a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:31.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.212+0000 7f3f81200640 1 --2- 172.21.15.1:0/3419198700 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f7c1037c0 0x7f3f7c10a050 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3f74009ca0 tx=0x7f3f7402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:24:31.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.212+0000 7f3f81200640 1 -- 172.21.15.1:0/3419198700 shutdown_connections 2024-09-15T22:24:31.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.212+0000 7f3f81200640 1 --2- 172.21.15.1:0/3419198700 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f7c1037c0 0x7f3f7c10a050 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:31.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.212+0000 7f3f81200640 1 --2- 172.21.15.1:0/3419198700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f7c102e00 0x7f3f7c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:31.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.212+0000 7f3f81200640 1 --2- 172.21.15.1:0/3419198700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f7c101c00 0x7f3f7c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:31.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.212+0000 7f3f81200640 1 -- 172.21.15.1:0/3419198700 >> 172.21.15.1:0/3419198700 conn(0x7f3f7c0fd390 msgr2=0x7f3f7c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:31.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.212+0000 7f3f81200640 1 -- 172.21.15.1:0/3419198700 shutdown_connections 2024-09-15T22:24:31.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.212+0000 7f3f81200640 1 -- 172.21.15.1:0/3419198700 wait complete. 2024-09-15T22:24:31.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.213+0000 7f3f81200640 1 Processor -- start 2024-09-15T22:24:31.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.213+0000 7f3f81200640 1 -- start start 2024-09-15T22:24:31.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.214+0000 7f3f81200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f7c101c00 0x7f3f7c075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:31.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.214+0000 7f3f81200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f7c102e00 0x7f3f7c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:31.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.214+0000 7f3f81200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f7c1037c0 0x7f3f7c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:31.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.214+0000 7f3f81200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7c10d8d0 con 0x7f3f7c102e00 2024-09-15T22:24:31.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.214+0000 7f3f81200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7c10d750 con 0x7f3f7c1037c0 2024-09-15T22:24:31.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.214+0000 7f3f81200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7c10da50 con 0x7f3f7c101c00 2024-09-15T22:24:31.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.214+0000 7f3f79400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f7c102e00 0x7f3f7c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:31.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.214+0000 7f3f79400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f7c102e00 0x7f3f7c0745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55194/0 (socket says 172.21.15.1:55194) 2024-09-15T22:24:31.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.214+0000 7f3f79400640 1 -- 172.21.15.1:0/2256318581 learned_addr learned my addr 172.21.15.1:0/2256318581 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:31.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.214+0000 7f3f79e00640 1 --2- 172.21.15.1:0/2256318581 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f7c101c00 0x7f3f7c075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:31.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.214+0000 7f3f7a800640 1 --2- 172.21.15.1:0/2256318581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f7c1037c0 0x7f3f7c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:31.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.214+0000 7f3f79400640 1 -- 172.21.15.1:0/2256318581 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f7c101c00 msgr2=0x7f3f7c075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:31.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.214+0000 7f3f79400640 1 --2- 172.21.15.1:0/2256318581 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f7c101c00 0x7f3f7c075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:31.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.214+0000 7f3f79400640 1 -- 172.21.15.1:0/2256318581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f7c1037c0 msgr2=0x7f3f7c074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:31.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.214+0000 7f3f79400640 1 --2- 172.21.15.1:0/2256318581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f7c1037c0 0x7f3f7c074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:31.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.214+0000 7f3f79400640 1 -- 172.21.15.1:0/2256318581 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f7c0753e0 con 0x7f3f7c102e00 2024-09-15T22:24:31.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.215+0000 7f3f79400640 1 --2- 172.21.15.1:0/2256318581 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f7c102e00 0x7f3f7c0745e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3f6800e9f0 tx=0x7f3f6800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:31.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.215+0000 7f3f72a00640 1 -- 172.21.15.1:0/2256318581 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6800cd80 con 0x7f3f7c102e00 2024-09-15T22:24:31.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.215+0000 7f3f72a00640 1 -- 172.21.15.1:0/2256318581 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f68005500 con 0x7f3f7c102e00 2024-09-15T22:24:31.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.215+0000 7f3f81200640 1 -- 172.21.15.1:0/2256318581 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f7c1a1fa0 con 0x7f3f7c102e00 2024-09-15T22:24:31.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.215+0000 7f3f72a00640 1 -- 172.21.15.1:0/2256318581 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f68010690 con 0x7f3f7c102e00 2024-09-15T22:24:31.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.215+0000 7f3f81200640 1 -- 172.21.15.1:0/2256318581 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f7c1a2400 con 0x7f3f7c102e00 2024-09-15T22:24:31.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.216+0000 7f3f81200640 1 -- 172.21.15.1:0/2256318581 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f7c108f30 con 0x7f3f7c102e00 2024-09-15T22:24:31.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.219+0000 7f3f72a00640 1 -- 172.21.15.1:0/2256318581 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f3f680046c0 con 0x7f3f7c102e00 2024-09-15T22:24:31.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.220+0000 7f3f72a00640 1 --2- 172.21.15.1:0/2256318581 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3f600a32d0 0x7f3f600a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:31.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.221+0000 7f3f72a00640 1 -- 172.21.15.1:0/2256318581 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8248+0+0 (secure 0 0 0) 0x7f3f680cfee0 con 0x7f3f7c102e00 2024-09-15T22:24:31.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.221+0000 7f3f79e00640 1 --2- 172.21.15.1:0/2256318581 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3f600a32d0 0x7f3f600a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:31.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.221+0000 7f3f79e00640 1 --2- 172.21.15.1:0/2256318581 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3f600a32d0 0x7f3f600a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c102c60 tx=0x7f3f6c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:31.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.225+0000 7f3f72a00640 1 -- 172.21.15.1:0/2256318581 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3f6809ca30 con 0x7f3f7c102e00 2024-09-15T22:24:31.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.420+0000 7f3f81200640 1 -- 172.21.15.1:0/2256318581 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f3f7c062630 con 0x7f3f600a32d0 2024-09-15T22:24:31.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.432+0000 7f3f72a00640 1 -- 172.21.15.1:0/2256318581 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7f3f7c062630 con 0x7f3f600a32d0 2024-09-15T22:24:31.435 INFO:teuthology.orchestra.run.smithi001.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-15T22:24:31.435 INFO:teuthology.orchestra.run.smithi001.stdout:mds.a smithi001 running (116s) 23s ago 115s 12.5M - 19.1.1-326-g8921c8ef f1455bd0219c b0beb6cadcb1 2024-09-15T22:24:31.435 INFO:teuthology.orchestra.run.smithi001.stdout:mds.b smithi012 running (113s) 44s ago 112s 17.3M - 19.1.1-326-g8921c8ef f1455bd0219c 13ce424b84e7 2024-09-15T22:24:31.435 INFO:teuthology.orchestra.run.smithi001.stdout:mds.c smithi098 running (2m) 45s ago 2m 17.9M - 19.1.1-326-g8921c8ef f1455bd0219c c58abb493dbd 2024-09-15T22:24:31.435 INFO:teuthology.orchestra.run.smithi001.stdout:mds.d smithi001 running (2m) 23s ago 2m 12.7M - 19.1.1-326-g8921c8ef f1455bd0219c 7fb50fc7f87a 2024-09-15T22:24:31.435 INFO:teuthology.orchestra.run.smithi001.stdout:mds.e smithi012 running (2m) 44s ago 2m 15.8M - 19.1.1-326-g8921c8ef f1455bd0219c 9e02fdcc515d 2024-09-15T22:24:31.435 INFO:teuthology.orchestra.run.smithi001.stdout:mds.f smithi098 running (2m) 45s ago 2m 16.8M - 19.1.1-326-g8921c8ef f1455bd0219c fd056ace14ba 2024-09-15T22:24:31.435 INFO:teuthology.orchestra.run.smithi001.stdout:mds.g smithi001 running (119s) 23s ago 119s 12.6M - 19.1.1-326-g8921c8ef f1455bd0219c 400c8e3d39df 2024-09-15T22:24:31.435 INFO:teuthology.orchestra.run.smithi001.stdout:mds.h smithi012 running (2m) 44s ago 2m 16.0M - 19.1.1-326-g8921c8ef f1455bd0219c cb5a0e662b65 2024-09-15T22:24:31.436 INFO:teuthology.orchestra.run.smithi001.stdout:mds.i smithi098 running (2m) 45s ago 2m 26.1M - 19.1.1-326-g8921c8ef f1455bd0219c e2fb1c79b33c 2024-09-15T22:24:31.436 INFO:teuthology.orchestra.run.smithi001.stdout:mds.j smithi001 running (2m) 23s ago 2m 12.8M - 19.1.1-326-g8921c8ef f1455bd0219c 39779d0cb834 2024-09-15T22:24:31.436 INFO:teuthology.orchestra.run.smithi001.stdout:mds.k smithi012 running (2m) 44s ago 2m 16.8M - 19.1.1-326-g8921c8ef f1455bd0219c df95c7b72bee 2024-09-15T22:24:31.436 INFO:teuthology.orchestra.run.smithi001.stdout:mds.l smithi098 running (2m) 45s ago 2m 19.0M - 19.1.1-326-g8921c8ef f1455bd0219c 7f597d21822d 2024-09-15T22:24:31.436 INFO:teuthology.orchestra.run.smithi001.stdout:mgr.x smithi001 *:9283,8765 running (9m) 23s ago 9m 508M - 19.1.1-326-g8921c8ef f1455bd0219c 3c111bd85901 2024-09-15T22:24:31.436 INFO:teuthology.orchestra.run.smithi001.stdout:mgr.y smithi012 *:8443,8765 running (7m) 44s ago 7m 442M - 19.1.1-326-g8921c8ef f1455bd0219c 6f9a44e75bf6 2024-09-15T22:24:31.436 INFO:teuthology.orchestra.run.smithi001.stdout:mgr.z smithi098 *:8443,8765 running (7m) 45s ago 7m 442M - 19.1.1-326-g8921c8ef f1455bd0219c a9d1b7bf2db1 2024-09-15T22:24:31.436 INFO:teuthology.orchestra.run.smithi001.stdout:mon.a smithi001 running (9m) 23s ago 9m 47.9M 2048M 19.1.1-326-g8921c8ef f1455bd0219c 93496c21faa2 2024-09-15T22:24:31.436 INFO:teuthology.orchestra.run.smithi001.stdout:mon.b smithi012 running (8m) 44s ago 8m 40.5M 2048M 19.1.1-326-g8921c8ef f1455bd0219c 1137457537d6 2024-09-15T22:24:31.436 INFO:teuthology.orchestra.run.smithi001.stdout:mon.c smithi098 running (8m) 45s ago 8m 41.1M 2048M 19.1.1-326-g8921c8ef f1455bd0219c bf69844b3137 2024-09-15T22:24:31.436 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0 smithi001 running (7m) 23s ago 7m 47.0M 4273M 19.1.1-326-g8921c8ef f1455bd0219c 1a95f53f08ad 2024-09-15T22:24:31.436 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1 smithi012 running (7m) 44s ago 7m 59.0M 4273M 19.1.1-326-g8921c8ef f1455bd0219c f1c81fa06c80 2024-09-15T22:24:31.436 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2 smithi098 running (6m) 45s ago 6m 50.3M 4272M 19.1.1-326-g8921c8ef f1455bd0219c f7d62e81ad6e 2024-09-15T22:24:31.437 INFO:teuthology.orchestra.run.smithi001.stdout:osd.3 smithi001 running (6m) 23s ago 6m 50.7M 4273M 19.1.1-326-g8921c8ef f1455bd0219c c48da10274ef 2024-09-15T22:24:31.437 INFO:teuthology.orchestra.run.smithi001.stdout:osd.4 smithi012 running (5m) 44s ago 5m 54.2M 4273M 19.1.1-326-g8921c8ef f1455bd0219c 9d21040d36e1 2024-09-15T22:24:31.437 INFO:teuthology.orchestra.run.smithi001.stdout:osd.5 smithi098 running (5m) 45s ago 5m 47.1M 4272M 19.1.1-326-g8921c8ef f1455bd0219c e086eae72b1b 2024-09-15T22:24:31.437 INFO:teuthology.orchestra.run.smithi001.stdout:osd.6 smithi001 running (4m) 23s ago 4m 43.3M 4273M 19.1.1-326-g8921c8ef f1455bd0219c d5601d38dfd2 2024-09-15T22:24:31.437 INFO:teuthology.orchestra.run.smithi001.stdout:osd.7 smithi012 running (4m) 44s ago 4m 55.0M 4273M 19.1.1-326-g8921c8ef f1455bd0219c 773167e2435d 2024-09-15T22:24:31.437 INFO:teuthology.orchestra.run.smithi001.stdout:osd.8 smithi098 running (4m) 45s ago 4m 50.7M 4272M 19.1.1-326-g8921c8ef f1455bd0219c be459cf384d7 2024-09-15T22:24:31.437 INFO:teuthology.orchestra.run.smithi001.stdout:osd.9 smithi001 running (3m) 23s ago 3m 42.3M 4273M 19.1.1-326-g8921c8ef f1455bd0219c 757de75ff925 2024-09-15T22:24:31.437 INFO:teuthology.orchestra.run.smithi001.stdout:osd.10 smithi012 running (3m) 44s ago 3m 47.1M 4273M 19.1.1-326-g8921c8ef f1455bd0219c a96ab2f21028 2024-09-15T22:24:31.437 INFO:teuthology.orchestra.run.smithi001.stdout:osd.11 smithi098 running (2m) 45s ago 2m 46.2M 4272M 19.1.1-326-g8921c8ef f1455bd0219c d54278b5aeb3 2024-09-15T22:24:31.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.435+0000 7f3f81200640 1 -- 172.21.15.1:0/2256318581 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3f600a32d0 msgr2=0x7f3f600a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:31.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.435+0000 7f3f81200640 1 --2- 172.21.15.1:0/2256318581 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3f600a32d0 0x7f3f600a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c102c60 tx=0x7f3f6c005f90 comp rx=0 tx=0).stop 2024-09-15T22:24:31.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.435+0000 7f3f81200640 1 -- 172.21.15.1:0/2256318581 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f7c102e00 msgr2=0x7f3f7c0745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:31.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.435+0000 7f3f81200640 1 --2- 172.21.15.1:0/2256318581 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f7c102e00 0x7f3f7c0745e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3f6800e9f0 tx=0x7f3f6800edf0 comp rx=0 tx=0).stop 2024-09-15T22:24:31.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.435+0000 7f3f81200640 1 -- 172.21.15.1:0/2256318581 shutdown_connections 2024-09-15T22:24:31.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.435+0000 7f3f81200640 1 --2- 172.21.15.1:0/2256318581 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3f600a32d0 0x7f3f600a5790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:31.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.435+0000 7f3f81200640 1 --2- 172.21.15.1:0/2256318581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f7c1037c0 0x7f3f7c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:31.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.435+0000 7f3f81200640 1 --2- 172.21.15.1:0/2256318581 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f7c102e00 0x7f3f7c0745e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:31.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.435+0000 7f3f81200640 1 --2- 172.21.15.1:0/2256318581 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f7c101c00 0x7f3f7c075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:31.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.435+0000 7f3f81200640 1 -- 172.21.15.1:0/2256318581 >> 172.21.15.1:0/2256318581 conn(0x7f3f7c0fd390 msgr2=0x7f3f7c106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:31.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.435+0000 7f3f81200640 1 -- 172.21.15.1:0/2256318581 shutdown_connections 2024-09-15T22:24:31.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:31.435+0000 7f3f81200640 1 -- 172.21.15.1:0/2256318581 wait complete. 2024-09-15T22:24:31.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:31 smithi012 ceph-mon[34883]: pgmap v343: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-15T22:24:31.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:31 smithi098 ceph-mon[35514]: pgmap v343: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-15T22:24:31.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:31 smithi001 ceph-mon[30843]: pgmap v343: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-15T22:24:32.333 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-15T22:24:32.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:32 smithi001 ceph-mon[30843]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:24:32.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:32 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 7]}]: dispatch 2024-09-15T22:24:32.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:32 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-09-15T22:24:32.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:32 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [1, 2]}]: dispatch 2024-09-15T22:24:32.716 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:32.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:32 smithi012 ceph-mon[34883]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:24:32.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:32 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 7]}]: dispatch 2024-09-15T22:24:32.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:32 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-09-15T22:24:32.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:32 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [1, 2]}]: dispatch 2024-09-15T22:24:32.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:32 smithi098 ceph-mon[35514]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:24:32.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:32 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 7]}]: dispatch 2024-09-15T22:24:32.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:32 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-09-15T22:24:32.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:32 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [1, 2]}]: dispatch 2024-09-15T22:24:33.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.352+0000 7f841f600640 1 -- 172.21.15.1:0/2547522997 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8418105920 msgr2=0x7f841810c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:33.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.352+0000 7f841f600640 1 --2- 172.21.15.1:0/2547522997 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8418105920 0x7f841810c240 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8410009ca0 tx=0x7f841002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:24:33.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.352+0000 7f841f600640 1 -- 172.21.15.1:0/2547522997 shutdown_connections 2024-09-15T22:24:33.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.352+0000 7f841f600640 1 --2- 172.21.15.1:0/2547522997 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8418105920 0x7f841810c240 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:33.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.352+0000 7f841f600640 1 --2- 172.21.15.1:0/2547522997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8418104f60 0x7f84181053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:33.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.352+0000 7f841f600640 1 --2- 172.21.15.1:0/2547522997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8418103e00 0x7f8418104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:33.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.352+0000 7f841f600640 1 -- 172.21.15.1:0/2547522997 >> 172.21.15.1:0/2547522997 conn(0x7f84180ff5b0 msgr2=0x7f84181019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:33.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.352+0000 7f841f600640 1 -- 172.21.15.1:0/2547522997 shutdown_connections 2024-09-15T22:24:33.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.352+0000 7f841f600640 1 -- 172.21.15.1:0/2547522997 wait complete. 2024-09-15T22:24:33.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.353+0000 7f841f600640 1 Processor -- start 2024-09-15T22:24:33.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.353+0000 7f841f600640 1 -- start start 2024-09-15T22:24:33.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.354+0000 7f841f600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8418103e00 0x7f841819a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:33.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.354+0000 7f841f600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8418104f60 0x7f841819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:33.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.354+0000 7f841f600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8418105920 0x7f84181a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:33.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.354+0000 7f841f600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f841810fab0 con 0x7f8418104f60 2024-09-15T22:24:33.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.354+0000 7f841f600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f841810f930 con 0x7f8418103e00 2024-09-15T22:24:33.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.354+0000 7f841f600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f841810fc30 con 0x7f8418105920 2024-09-15T22:24:33.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.354+0000 7f8417e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8418104f60 0x7f841819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:33.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.354+0000 7f8417e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8418104f60 0x7f841819a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55218/0 (socket says 172.21.15.1:55218) 2024-09-15T22:24:33.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.354+0000 7f8417e00640 1 -- 172.21.15.1:0/1461632564 learned_addr learned my addr 172.21.15.1:0/1461632564 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:33.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.354+0000 7f841d600640 1 --2- 172.21.15.1:0/1461632564 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8418105920 0x7f84181a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:33.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.354+0000 7f841cc00640 1 --2- 172.21.15.1:0/1461632564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8418103e00 0x7f841819a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:33.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.354+0000 7f8417e00640 1 -- 172.21.15.1:0/1461632564 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8418105920 msgr2=0x7f84181a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:33.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.354+0000 7f8417e00640 1 --2- 172.21.15.1:0/1461632564 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8418105920 0x7f84181a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:33.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.354+0000 7f8417e00640 1 -- 172.21.15.1:0/1461632564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8418103e00 msgr2=0x7f841819a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:33.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.354+0000 7f8417e00640 1 --2- 172.21.15.1:0/1461632564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8418103e00 0x7f841819a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:33.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.354+0000 7f8417e00640 1 -- 172.21.15.1:0/1461632564 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84181a1cb0 con 0x7f8418104f60 2024-09-15T22:24:33.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.355+0000 7f8417e00640 1 --2- 172.21.15.1:0/1461632564 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8418104f60 0x7f841819a5c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f840400e9c0 tx=0x7f840400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:33.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.355+0000 7f8415600640 1 -- 172.21.15.1:0/1461632564 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840400cd80 con 0x7f8418104f60 2024-09-15T22:24:33.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.355+0000 7f8415600640 1 -- 172.21.15.1:0/1461632564 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84040035f0 con 0x7f8418104f60 2024-09-15T22:24:33.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.355+0000 7f8415600640 1 -- 172.21.15.1:0/1461632564 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8404010690 con 0x7f8418104f60 2024-09-15T22:24:33.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.355+0000 7f841f600640 1 -- 172.21.15.1:0/1461632564 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84181a1fa0 con 0x7f8418104f60 2024-09-15T22:24:33.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.355+0000 7f841f600640 1 -- 172.21.15.1:0/1461632564 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84181a2400 con 0x7f8418104f60 2024-09-15T22:24:33.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.356+0000 7f841f600640 1 -- 172.21.15.1:0/1461632564 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f841810b120 con 0x7f8418104f60 2024-09-15T22:24:33.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.359+0000 7f8415600640 1 -- 172.21.15.1:0/1461632564 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f84040037a0 con 0x7f8418104f60 2024-09-15T22:24:33.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.360+0000 7f8415600640 1 --2- 172.21.15.1:0/1461632564 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f84000a3270 0x7f84000a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:33.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.360+0000 7f8415600640 1 -- 172.21.15.1:0/1461632564 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8335+0+0 (secure 0 0 0) 0x7f84040cfce0 con 0x7f8418104f60 2024-09-15T22:24:33.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.360+0000 7f841cc00640 1 --2- 172.21.15.1:0/1461632564 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f84000a3270 0x7f84000a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:33.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.361+0000 7f841cc00640 1 --2- 172.21.15.1:0/1461632564 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f84000a3270 0x7f84000a5730 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f840c009bd0 tx=0x7f840c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:33.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.364+0000 7f8415600640 1 -- 172.21.15.1:0/1461632564 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f840409c940 con 0x7f8418104f60 2024-09-15T22:24:33.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.560+0000 7f841f600640 1 -- 172.21.15.1:0/1461632564 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f8418062630 con 0x7f84000a3270 2024-09-15T22:24:33.563 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:33 smithi001 ceph-mon[30843]: pgmap v344: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-15T22:24:33.563 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:33 smithi001 ceph-mon[30843]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-15T22:24:33.563 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:33 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 7]}]': finished 2024-09-15T22:24:33.563 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:33 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-09-15T22:24:33.563 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:33 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [1, 2]}]': finished 2024-09-15T22:24:33.563 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:33 smithi001 ceph-mon[30843]: osdmap e85: 12 total, 12 up, 12 in 2024-09-15T22:24:33.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.566+0000 7f8415600640 1 -- 172.21.15.1:0/1461632564 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f8418062630 con 0x7f84000a3270 2024-09-15T22:24:33.568 INFO:teuthology.orchestra.run.smithi001.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-15T22:24:33.569 INFO:teuthology.orchestra.run.smithi001.stdout:mds.all 12/12 47s ago 2m smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi012=b;smithi012=e;smithi012=h;smithi012=k;smithi098=c;smithi098=f;smithi098=i;smithi098=l;count:12 2024-09-15T22:24:33.569 INFO:teuthology.orchestra.run.smithi001.stdout:mgr 3/3 47s ago 8m smithi001=x;smithi012=y;smithi098=z;count:3 2024-09-15T22:24:33.569 INFO:teuthology.orchestra.run.smithi001.stdout:mon 3/3 47s ago 8m smithi001:172.21.15.1=a;smithi012:172.21.15.12=b;smithi098:172.21.15.98=c;count:3 2024-09-15T22:24:33.569 INFO:teuthology.orchestra.run.smithi001.stdout:osd 12 47s ago - 2024-09-15T22:24:33.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.569+0000 7f841f600640 1 -- 172.21.15.1:0/1461632564 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f84000a3270 msgr2=0x7f84000a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:33.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.569+0000 7f841f600640 1 --2- 172.21.15.1:0/1461632564 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f84000a3270 0x7f84000a5730 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f840c009bd0 tx=0x7f840c005f90 comp rx=0 tx=0).stop 2024-09-15T22:24:33.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.569+0000 7f841f600640 1 -- 172.21.15.1:0/1461632564 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8418104f60 msgr2=0x7f841819a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:33.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.569+0000 7f841f600640 1 --2- 172.21.15.1:0/1461632564 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8418104f60 0x7f841819a5c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f840400e9c0 tx=0x7f840400ee80 comp rx=0 tx=0).stop 2024-09-15T22:24:33.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.569+0000 7f841f600640 1 -- 172.21.15.1:0/1461632564 shutdown_connections 2024-09-15T22:24:33.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.569+0000 7f841f600640 1 --2- 172.21.15.1:0/1461632564 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f84000a3270 0x7f84000a5730 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:33.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.569+0000 7f841f600640 1 --2- 172.21.15.1:0/1461632564 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8418105920 0x7f84181a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:33.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.569+0000 7f841f600640 1 --2- 172.21.15.1:0/1461632564 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8418104f60 0x7f841819a5c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:33.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.569+0000 7f841f600640 1 --2- 172.21.15.1:0/1461632564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8418103e00 0x7f841819a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:33.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.569+0000 7f841f600640 1 -- 172.21.15.1:0/1461632564 >> 172.21.15.1:0/1461632564 conn(0x7f84180ff5b0 msgr2=0x7f84181082f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:33.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.569+0000 7f841f600640 1 -- 172.21.15.1:0/1461632564 shutdown_connections 2024-09-15T22:24:33.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:33.569+0000 7f841f600640 1 -- 172.21.15.1:0/1461632564 wait complete. 2024-09-15T22:24:33.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:33 smithi012 ceph-mon[34883]: pgmap v344: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-15T22:24:33.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:33 smithi012 ceph-mon[34883]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-15T22:24:33.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:33 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 7]}]': finished 2024-09-15T22:24:33.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:33 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-09-15T22:24:33.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:33 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [1, 2]}]': finished 2024-09-15T22:24:33.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:33 smithi012 ceph-mon[34883]: osdmap e85: 12 total, 12 up, 12 in 2024-09-15T22:24:33.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:33 smithi098 ceph-mon[35514]: pgmap v344: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-15T22:24:33.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:33 smithi098 ceph-mon[35514]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-15T22:24:33.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:33 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 7]}]': finished 2024-09-15T22:24:33.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:33 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-09-15T22:24:33.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:33 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [1, 2]}]': finished 2024-09-15T22:24:33.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:33 smithi098 ceph-mon[35514]: osdmap e85: 12 total, 12 up, 12 in 2024-09-15T22:24:34.553 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-15T22:24:34.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:34 smithi012 ceph-mon[34883]: osdmap e86: 12 total, 12 up, 12 in 2024-09-15T22:24:34.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:34 smithi098 ceph-mon[35514]: osdmap e86: 12 total, 12 up, 12 in 2024-09-15T22:24:34.875 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:34 smithi001 ceph-mon[30843]: osdmap e86: 12 total, 12 up, 12 in 2024-09-15T22:24:34.935 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:35.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.505+0000 7fabf2400640 1 -- 172.21.15.1:0/1837481663 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fabec103e00 msgr2=0x7fabec104200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:35.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.505+0000 7fabf2400640 1 --2- 172.21.15.1:0/1837481663 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fabec103e00 0x7fabec104200 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fabdc009900 tx=0x7fabdc02a3f0 comp rx=0 tx=0).stop 2024-09-15T22:24:35.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.505+0000 7fabf2400640 1 -- 172.21.15.1:0/1837481663 shutdown_connections 2024-09-15T22:24:35.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.505+0000 7fabf2400640 1 --2- 172.21.15.1:0/1837481663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabec105920 0x7fabec10c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:35.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.505+0000 7fabf2400640 1 --2- 172.21.15.1:0/1837481663 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fabec104f60 0x7fabec1053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:35.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.505+0000 7fabf2400640 1 --2- 172.21.15.1:0/1837481663 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fabec103e00 0x7fabec104200 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:35.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.505+0000 7fabf2400640 1 -- 172.21.15.1:0/1837481663 >> 172.21.15.1:0/1837481663 conn(0x7fabec0ff5b0 msgr2=0x7fabec1019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:35.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.505+0000 7fabf2400640 1 -- 172.21.15.1:0/1837481663 shutdown_connections 2024-09-15T22:24:35.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.505+0000 7fabf2400640 1 -- 172.21.15.1:0/1837481663 wait complete. 2024-09-15T22:24:35.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.506+0000 7fabf2400640 1 Processor -- start 2024-09-15T22:24:35.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.507+0000 7fabf2400640 1 -- start start 2024-09-15T22:24:35.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.507+0000 7fabf2400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fabec103e00 0x7fabec19a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:35.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.507+0000 7fabf2400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabec104f60 0x7fabec19a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:35.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.507+0000 7fabf2400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fabec105920 0x7fabec1a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:35.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.507+0000 7fabf2400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fabec10fa90 con 0x7fabec105920 2024-09-15T22:24:35.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.507+0000 7fabf2400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fabec10f910 con 0x7fabec104f60 2024-09-15T22:24:35.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.507+0000 7fabf2400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fabec10fc10 con 0x7fabec103e00 2024-09-15T22:24:35.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.507+0000 7fabebe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fabec105920 0x7fabec1a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:35.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.507+0000 7fabebe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fabec105920 0x7fabec1a1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55238/0 (socket says 172.21.15.1:55238) 2024-09-15T22:24:35.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.507+0000 7fabebe00640 1 -- 172.21.15.1:0/1571452303 learned_addr learned my addr 172.21.15.1:0/1571452303 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:35.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.507+0000 7fabeaa00640 1 --2- 172.21.15.1:0/1571452303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabec104f60 0x7fabec19a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:35.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.507+0000 7fabeb400640 1 --2- 172.21.15.1:0/1571452303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fabec103e00 0x7fabec19a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:35.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.508+0000 7fabebe00640 1 -- 172.21.15.1:0/1571452303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fabec103e00 msgr2=0x7fabec19a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:35.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.508+0000 7fabebe00640 1 --2- 172.21.15.1:0/1571452303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fabec103e00 0x7fabec19a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:35.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.508+0000 7fabebe00640 1 -- 172.21.15.1:0/1571452303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabec104f60 msgr2=0x7fabec19a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:35.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.508+0000 7fabebe00640 1 --2- 172.21.15.1:0/1571452303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabec104f60 0x7fabec19a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:35.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.508+0000 7fabebe00640 1 -- 172.21.15.1:0/1571452303 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabec1a1ce0 con 0x7fabec105920 2024-09-15T22:24:35.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.508+0000 7fabebe00640 1 --2- 172.21.15.1:0/1571452303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fabec105920 0x7fabec1a1670 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fabe400eb10 tx=0x7fabe400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:35.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.508+0000 7fabe3e00640 1 -- 172.21.15.1:0/1571452303 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe4004b20 con 0x7fabec105920 2024-09-15T22:24:35.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.508+0000 7fabe3e00640 1 -- 172.21.15.1:0/1571452303 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabe4004cc0 con 0x7fabec105920 2024-09-15T22:24:35.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.508+0000 7fabf2400640 1 -- 172.21.15.1:0/1571452303 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabec1a1fd0 con 0x7fabec105920 2024-09-15T22:24:35.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.508+0000 7fabe3e00640 1 -- 172.21.15.1:0/1571452303 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe4010760 con 0x7fabec105920 2024-09-15T22:24:35.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.508+0000 7fabf2400640 1 -- 172.21.15.1:0/1571452303 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabec1a2430 con 0x7fabec105920 2024-09-15T22:24:35.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.509+0000 7fabf2400640 1 -- 172.21.15.1:0/1571452303 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabec10b1c0 con 0x7fabec105920 2024-09-15T22:24:35.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.511+0000 7fabe3e00640 1 -- 172.21.15.1:0/1571452303 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fabe4004fe0 con 0x7fabec105920 2024-09-15T22:24:35.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.513+0000 7fabe3e00640 1 --2- 172.21.15.1:0/1571452303 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fabd00a3270 0x7fabd00a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:35.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.514+0000 7fabe3e00640 1 -- 172.21.15.1:0/1571452303 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7fabe40cfeb0 con 0x7fabec105920 2024-09-15T22:24:35.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.514+0000 7fabeb400640 1 --2- 172.21.15.1:0/1571452303 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fabd00a3270 0x7fabd00a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:35.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.514+0000 7fabeb400640 1 --2- 172.21.15.1:0/1571452303 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fabd00a3270 0x7fabd00a5730 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fabdc0314e0 tx=0x7fabdc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:35.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.518+0000 7fabe3e00640 1 -- 172.21.15.1:0/1571452303 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fabe409cb10 con 0x7fabec105920 2024-09-15T22:24:35.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:35 smithi001 ceph-mon[30843]: pgmap v347: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-09-15T22:24:35.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:35 smithi001 ceph-mon[30843]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:24:35.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.707+0000 7fabf2400640 1 -- 172.21.15.1:0/1571452303 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fabec062630 con 0x7fabd00a3270 2024-09-15T22:24:35.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.709+0000 7fabe3e00640 1 -- 172.21.15.1:0/1571452303 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+187 (secure 0 0 0) 0x7fabec062630 con 0x7fabd00a3270 2024-09-15T22:24:35.711 INFO:teuthology.orchestra.run.smithi001.stdout:HOST ADDR LABELS STATUS 2024-09-15T22:24:35.711 INFO:teuthology.orchestra.run.smithi001.stdout:smithi001 172.21.15.1 2024-09-15T22:24:35.711 INFO:teuthology.orchestra.run.smithi001.stdout:smithi012 172.21.15.12 2024-09-15T22:24:35.711 INFO:teuthology.orchestra.run.smithi001.stdout:smithi098 172.21.15.98 2024-09-15T22:24:35.711 INFO:teuthology.orchestra.run.smithi001.stdout:3 hosts in cluster 2024-09-15T22:24:35.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.711+0000 7fabf2400640 1 -- 172.21.15.1:0/1571452303 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fabd00a3270 msgr2=0x7fabd00a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:35.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.711+0000 7fabf2400640 1 --2- 172.21.15.1:0/1571452303 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fabd00a3270 0x7fabd00a5730 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fabdc0314e0 tx=0x7fabdc000bc0 comp rx=0 tx=0).stop 2024-09-15T22:24:35.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.711+0000 7fabf2400640 1 -- 172.21.15.1:0/1571452303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fabec105920 msgr2=0x7fabec1a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:35.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.711+0000 7fabf2400640 1 --2- 172.21.15.1:0/1571452303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fabec105920 0x7fabec1a1670 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fabe400eb10 tx=0x7fabe400c2d0 comp rx=0 tx=0).stop 2024-09-15T22:24:35.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.712+0000 7fabf2400640 1 -- 172.21.15.1:0/1571452303 shutdown_connections 2024-09-15T22:24:35.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.712+0000 7fabf2400640 1 --2- 172.21.15.1:0/1571452303 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fabd00a3270 0x7fabd00a5730 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:35.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.712+0000 7fabf2400640 1 --2- 172.21.15.1:0/1571452303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fabec105920 0x7fabec1a1670 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:35.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.712+0000 7fabf2400640 1 --2- 172.21.15.1:0/1571452303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabec104f60 0x7fabec19a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:35.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.712+0000 7fabf2400640 1 --2- 172.21.15.1:0/1571452303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fabec103e00 0x7fabec19a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:35.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.712+0000 7fabf2400640 1 -- 172.21.15.1:0/1571452303 >> 172.21.15.1:0/1571452303 conn(0x7fabec0ff5b0 msgr2=0x7fabec108390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:35.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.712+0000 7fabf2400640 1 -- 172.21.15.1:0/1571452303 shutdown_connections 2024-09-15T22:24:35.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:35.712+0000 7fabf2400640 1 -- 172.21.15.1:0/1571452303 wait complete. 2024-09-15T22:24:35.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:35 smithi012 ceph-mon[34883]: pgmap v347: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-09-15T22:24:35.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:35 smithi012 ceph-mon[34883]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:24:35.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:35 smithi098 ceph-mon[35514]: pgmap v347: 97 pgs: 97 active+clean; 639 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-09-15T22:24:35.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:35 smithi098 ceph-mon[35514]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:24:36.586 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-15T22:24:36.962 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:37.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.513+0000 7fd047200640 1 -- 172.21.15.1:0/389340347 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd048104e50 msgr2=0x7fd0481052d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:37.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.513+0000 7fd047200640 1 --2- 172.21.15.1:0/389340347 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd048104e50 0x7fd0481052d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd034009900 tx=0x7fd03402a410 comp rx=0 tx=0).stop 2024-09-15T22:24:37.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.513+0000 7fd047200640 1 -- 172.21.15.1:0/389340347 shutdown_connections 2024-09-15T22:24:37.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.513+0000 7fd047200640 1 --2- 172.21.15.1:0/389340347 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd048105810 0x7fd04810c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:37.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.513+0000 7fd047200640 1 --2- 172.21.15.1:0/389340347 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd048104e50 0x7fd0481052d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:37.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.513+0000 7fd047200640 1 --2- 172.21.15.1:0/389340347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd048103c50 0x7fd048104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:37.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.513+0000 7fd047200640 1 -- 172.21.15.1:0/389340347 >> 172.21.15.1:0/389340347 conn(0x7fd0480ff3e0 msgr2=0x7fd048101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:37.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.513+0000 7fd047200640 1 -- 172.21.15.1:0/389340347 shutdown_connections 2024-09-15T22:24:37.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.513+0000 7fd047200640 1 -- 172.21.15.1:0/389340347 wait complete. 2024-09-15T22:24:37.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.514+0000 7fd047200640 1 Processor -- start 2024-09-15T22:24:37.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.514+0000 7fd047200640 1 -- start start 2024-09-15T22:24:37.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.515+0000 7fd047200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd048103c50 0x7fd048199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:37.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.515+0000 7fd047200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd048104e50 0x7fd04819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:37.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.515+0000 7fd047200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd048105810 0x7fd0481a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:37.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.515+0000 7fd047200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd04810f920 con 0x7fd048103c50 2024-09-15T22:24:37.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.515+0000 7fd047200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd04810f7a0 con 0x7fd048105810 2024-09-15T22:24:37.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.515+0000 7fd047200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd04810faa0 con 0x7fd048104e50 2024-09-15T22:24:37.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.515+0000 7fd045e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd048103c50 0x7fd048199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:37.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.515+0000 7fd045400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd048104e50 0x7fd04819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:37.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.515+0000 7fd045e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd048103c50 0x7fd048199f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50916/0 (socket says 172.21.15.1:50916) 2024-09-15T22:24:37.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.515+0000 7fd045e00640 1 -- 172.21.15.1:0/1906282425 learned_addr learned my addr 172.21.15.1:0/1906282425 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:37.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.515+0000 7fd045400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd048104e50 0x7fd04819a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:33186/0 (socket says 172.21.15.1:33186) 2024-09-15T22:24:37.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.515+0000 7fd046800640 1 --2- 172.21.15.1:0/1906282425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd048105810 0x7fd0481a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:37.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.516+0000 7fd045e00640 1 -- 172.21.15.1:0/1906282425 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd048104e50 msgr2=0x7fd04819a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:37.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.516+0000 7fd045e00640 1 --2- 172.21.15.1:0/1906282425 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd048104e50 0x7fd04819a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:37.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.516+0000 7fd045e00640 1 -- 172.21.15.1:0/1906282425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd048105810 msgr2=0x7fd0481a1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:37.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.516+0000 7fd045e00640 1 --2- 172.21.15.1:0/1906282425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd048105810 0x7fd0481a1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:37.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.516+0000 7fd045e00640 1 -- 172.21.15.1:0/1906282425 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0481a1b70 con 0x7fd048103c50 2024-09-15T22:24:37.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.516+0000 7fd045e00640 1 --2- 172.21.15.1:0/1906282425 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd048103c50 0x7fd048199f40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd03800e9c0 tx=0x7fd03800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:37.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.516+0000 7fd03ea00640 1 -- 172.21.15.1:0/1906282425 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd03800cd80 con 0x7fd048103c50 2024-09-15T22:24:37.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.516+0000 7fd03ea00640 1 -- 172.21.15.1:0/1906282425 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0380035f0 con 0x7fd048103c50 2024-09-15T22:24:37.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.516+0000 7fd03ea00640 1 -- 172.21.15.1:0/1906282425 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd038010690 con 0x7fd048103c50 2024-09-15T22:24:37.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.516+0000 7fd047200640 1 -- 172.21.15.1:0/1906282425 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0481a1e60 con 0x7fd048103c50 2024-09-15T22:24:37.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.516+0000 7fd047200640 1 -- 172.21.15.1:0/1906282425 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0481a2260 con 0x7fd048103c50 2024-09-15T22:24:37.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.518+0000 7fd047200640 1 -- 172.21.15.1:0/1906282425 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd04810b050 con 0x7fd048103c50 2024-09-15T22:24:37.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.519+0000 7fd03ea00640 1 -- 172.21.15.1:0/1906282425 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fd0380037a0 con 0x7fd048103c50 2024-09-15T22:24:37.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.521+0000 7fd03ea00640 1 --2- 172.21.15.1:0/1906282425 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fd02c0a32f0 0x7fd02c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:37.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.521+0000 7fd03ea00640 1 -- 172.21.15.1:0/1906282425 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7fd0380cfcd0 con 0x7fd048103c50 2024-09-15T22:24:37.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.521+0000 7fd045400640 1 --2- 172.21.15.1:0/1906282425 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fd02c0a32f0 0x7fd02c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:37.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.522+0000 7fd045400640 1 --2- 172.21.15.1:0/1906282425 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fd02c0a32f0 0x7fd02c0a57b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd034031440 tx=0x7fd0340315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:37.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.525+0000 7fd03ea00640 1 -- 172.21.15.1:0/1906282425 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd03809c930 con 0x7fd048103c50 2024-09-15T22:24:37.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.718+0000 7fd047200640 1 -- 172.21.15.1:0/1906282425 --> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fd048062630 con 0x7fd02c0a32f0 2024-09-15T22:24:37.721 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:37 smithi001 ceph-mon[30843]: pgmap v348: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-15T22:24:37.721 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:37 smithi001 ceph-mon[30843]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:24:37.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.720+0000 7fd03ea00640 1 -- 172.21.15.1:0/1906282425 <== mgr.14150 v2:172.21.15.1:6800/3816767836 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fd048062630 con 0x7fd02c0a32f0 2024-09-15T22:24:37.722 INFO:teuthology.orchestra.run.smithi001.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-15T22:24:37.722 INFO:teuthology.orchestra.run.smithi001.stdout:smithi001 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7513000D480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-15T22:24:37.722 INFO:teuthology.orchestra.run.smithi001.stdout:smithi012 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5331005J400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-15T22:24:37.723 INFO:teuthology.orchestra.run.smithi001.stdout:smithi098 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204010H400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-15T22:24:37.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.722+0000 7fd047200640 1 -- 172.21.15.1:0/1906282425 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fd02c0a32f0 msgr2=0x7fd02c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:37.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.722+0000 7fd047200640 1 --2- 172.21.15.1:0/1906282425 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fd02c0a32f0 0x7fd02c0a57b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd034031440 tx=0x7fd0340315b0 comp rx=0 tx=0).stop 2024-09-15T22:24:37.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.722+0000 7fd047200640 1 -- 172.21.15.1:0/1906282425 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd048103c50 msgr2=0x7fd048199f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:37.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.722+0000 7fd047200640 1 --2- 172.21.15.1:0/1906282425 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd048103c50 0x7fd048199f40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd03800e9c0 tx=0x7fd03800ee80 comp rx=0 tx=0).stop 2024-09-15T22:24:37.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.722+0000 7fd047200640 1 -- 172.21.15.1:0/1906282425 shutdown_connections 2024-09-15T22:24:37.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.722+0000 7fd047200640 1 --2- 172.21.15.1:0/1906282425 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fd02c0a32f0 0x7fd02c0a57b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:37.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.722+0000 7fd047200640 1 --2- 172.21.15.1:0/1906282425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd048105810 0x7fd0481a1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:37.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.722+0000 7fd047200640 1 --2- 172.21.15.1:0/1906282425 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd048104e50 0x7fd04819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:37.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.722+0000 7fd047200640 1 --2- 172.21.15.1:0/1906282425 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd048103c50 0x7fd048199f40 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:37.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.722+0000 7fd047200640 1 -- 172.21.15.1:0/1906282425 >> 172.21.15.1:0/1906282425 conn(0x7fd0480ff3e0 msgr2=0x7fd048108220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:37.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.722+0000 7fd047200640 1 -- 172.21.15.1:0/1906282425 shutdown_connections 2024-09-15T22:24:37.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:37.723+0000 7fd047200640 1 -- 172.21.15.1:0/1906282425 wait complete. 2024-09-15T22:24:37.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:37 smithi012 ceph-mon[34883]: pgmap v348: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-15T22:24:37.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:37 smithi012 ceph-mon[34883]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:24:37.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:37 smithi098 ceph-mon[35514]: pgmap v348: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-15T22:24:37.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:37 smithi098 ceph-mon[35514]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:24:38.557 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-15T22:24:38.567 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi001.front.sepia.ceph.com 2024-09-15T22:24:38.567 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-15T22:24:38.944 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:39.545 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:39 smithi001 ceph-mon[30843]: pgmap v349: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 895 B/s wr, 7 op/s 2024-09-15T22:24:39.545 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:39 smithi001 ceph-mon[30843]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:24:39.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.549+0000 7fa3b7200640 1 -- 172.21.15.1:0/2104742904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3b8105800 msgr2=0x7fa3b810c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:39.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.549+0000 7fa3b7200640 1 --2- 172.21.15.1:0/2104742904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3b8105800 0x7fa3b810c090 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0009ca0 tx=0x7fa3b002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:24:39.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.549+0000 7fa3b7200640 1 -- 172.21.15.1:0/2104742904 shutdown_connections 2024-09-15T22:24:39.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.549+0000 7fa3b7200640 1 --2- 172.21.15.1:0/2104742904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3b8105800 0x7fa3b810c090 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:39.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.549+0000 7fa3b7200640 1 --2- 172.21.15.1:0/2104742904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3b8104e40 0x7fa3b81052c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:39.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.549+0000 7fa3b7200640 1 --2- 172.21.15.1:0/2104742904 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3b8103c40 0x7fa3b8104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:39.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.549+0000 7fa3b7200640 1 -- 172.21.15.1:0/2104742904 >> 172.21.15.1:0/2104742904 conn(0x7fa3b80ff3d0 msgr2=0x7fa3b8101810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:39.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.550+0000 7fa3b7200640 1 -- 172.21.15.1:0/2104742904 shutdown_connections 2024-09-15T22:24:39.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.550+0000 7fa3b7200640 1 -- 172.21.15.1:0/2104742904 wait complete. 2024-09-15T22:24:39.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.551+0000 7fa3b7200640 1 Processor -- start 2024-09-15T22:24:39.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.551+0000 7fa3b7200640 1 -- start start 2024-09-15T22:24:39.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.551+0000 7fa3b7200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3b8103c40 0x7fa3b8199e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:39.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.551+0000 7fa3b7200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3b8104e40 0x7fa3b819a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:39.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.551+0000 7fa3b7200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3b8105800 0x7fa3b81a1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:39.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.551+0000 7fa3b7200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b810f8c0 con 0x7fa3b8103c40 2024-09-15T22:24:39.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.551+0000 7fa3b7200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b810f740 con 0x7fa3b8105800 2024-09-15T22:24:39.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.551+0000 7fa3b7200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b810fa40 con 0x7fa3b8104e40 2024-09-15T22:24:39.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.551+0000 7fa3b5e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3b8103c40 0x7fa3b8199e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:39.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.551+0000 7fa3b5e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3b8103c40 0x7fa3b8199e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50938/0 (socket says 172.21.15.1:50938) 2024-09-15T22:24:39.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.551+0000 7fa3b5e00640 1 -- 172.21.15.1:0/3298868569 learned_addr learned my addr 172.21.15.1:0/3298868569 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:39.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.551+0000 7fa3b5400640 1 --2- 172.21.15.1:0/3298868569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3b8104e40 0x7fa3b819a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:39.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.552+0000 7fa3b6800640 1 --2- 172.21.15.1:0/3298868569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3b8105800 0x7fa3b81a1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:39.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.552+0000 7fa3b5e00640 1 -- 172.21.15.1:0/3298868569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3b8104e40 msgr2=0x7fa3b819a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:39.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.552+0000 7fa3b5e00640 1 --2- 172.21.15.1:0/3298868569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3b8104e40 0x7fa3b819a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:39.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.552+0000 7fa3b5e00640 1 -- 172.21.15.1:0/3298868569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3b8105800 msgr2=0x7fa3b81a1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:39.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.552+0000 7fa3b5e00640 1 --2- 172.21.15.1:0/3298868569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3b8105800 0x7fa3b81a1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:39.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.552+0000 7fa3b5e00640 1 -- 172.21.15.1:0/3298868569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b81a1ac0 con 0x7fa3b8103c40 2024-09-15T22:24:39.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.552+0000 7fa3b5400640 1 --2- 172.21.15.1:0/3298868569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3b8104e40 0x7fa3b819a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:39.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.552+0000 7fa3b5e00640 1 --2- 172.21.15.1:0/3298868569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3b8103c40 0x7fa3b8199e90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa3a800e9c0 tx=0x7fa3a800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:39.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.552+0000 7fa3aea00640 1 -- 172.21.15.1:0/3298868569 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a800cd80 con 0x7fa3b8103c40 2024-09-15T22:24:39.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.552+0000 7fa3aea00640 1 -- 172.21.15.1:0/3298868569 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3a80035f0 con 0x7fa3b8103c40 2024-09-15T22:24:39.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.552+0000 7fa3aea00640 1 -- 172.21.15.1:0/3298868569 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8010690 con 0x7fa3b8103c40 2024-09-15T22:24:39.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.552+0000 7fa3b7200640 1 -- 172.21.15.1:0/3298868569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3b81a1db0 con 0x7fa3b8103c40 2024-09-15T22:24:39.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.553+0000 7fa3b7200640 1 -- 172.21.15.1:0/3298868569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3b81a2210 con 0x7fa3b8103c40 2024-09-15T22:24:39.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.554+0000 7fa3b7200640 1 -- 172.21.15.1:0/3298868569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3b810af70 con 0x7fa3b8103c40 2024-09-15T22:24:39.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.556+0000 7fa3aea00640 1 -- 172.21.15.1:0/3298868569 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fa3a80037a0 con 0x7fa3b8103c40 2024-09-15T22:24:39.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.557+0000 7fa3aea00640 1 --2- 172.21.15.1:0/3298868569 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa39c0a32f0 0x7fa39c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:39.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.557+0000 7fa3aea00640 1 -- 172.21.15.1:0/3298868569 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7fa3a80cfc70 con 0x7fa3b8103c40 2024-09-15T22:24:39.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.557+0000 7fa3b5400640 1 --2- 172.21.15.1:0/3298868569 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa39c0a32f0 0x7fa39c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:39.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.558+0000 7fa3b5400640 1 --2- 172.21.15.1:0/3298868569 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa39c0a32f0 0x7fa39c0a57b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa3b819b3b0 tx=0x7fa3a4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:39.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.561+0000 7fa3aea00640 1 -- 172.21.15.1:0/3298868569 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa3a809c8d0 con 0x7fa3b8103c40 2024-09-15T22:24:39.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:39 smithi012 ceph-mon[34883]: pgmap v349: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 895 B/s wr, 7 op/s 2024-09-15T22:24:39.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:39 smithi012 ceph-mon[34883]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:24:39.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.782+0000 7fa3b7200640 1 -- 172.21.15.1:0/3298868569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fa3b802d7c0 con 0x7fa3b8103c40 2024-09-15T22:24:39.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.782+0000 7fa3aea00640 1 -- 172.21.15.1:0/3298868569 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+3067 (secure 0 0 0) 0x7fa3a809c1d0 con 0x7fa3b8103c40 2024-09-15T22:24:39.785 INFO:teuthology.orchestra.run.smithi001.stdout:e25 2024-09-15T22:24:39.785 INFO:teuthology.orchestra.run.smithi001.stdout:btime 2024-09-15T22:23:07:844952+0000 2024-09-15T22:24:39.785 INFO:teuthology.orchestra.run.smithi001.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-15T22:24:39.785 INFO:teuthology.orchestra.run.smithi001.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-15T22:24:39.785 INFO:teuthology.orchestra.run.smithi001.stdout:legacy client fscid: 1 2024-09-15T22:24:39.785 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:24:39.785 INFO:teuthology.orchestra.run.smithi001.stdout:Filesystem 'cephfs' (1) 2024-09-15T22:24:39.786 INFO:teuthology.orchestra.run.smithi001.stdout:fs_name cephfs 2024-09-15T22:24:39.786 INFO:teuthology.orchestra.run.smithi001.stdout:epoch 25 2024-09-15T22:24:39.786 INFO:teuthology.orchestra.run.smithi001.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-15T22:24:39.786 INFO:teuthology.orchestra.run.smithi001.stdout:created 2024-09-15T22:22:51.743282+0000 2024-09-15T22:24:39.786 INFO:teuthology.orchestra.run.smithi001.stdout:modified 2024-09-15T22:23:06.984789+0000 2024-09-15T22:24:39.786 INFO:teuthology.orchestra.run.smithi001.stdout:tableserver 0 2024-09-15T22:24:39.786 INFO:teuthology.orchestra.run.smithi001.stdout:root 0 2024-09-15T22:24:39.786 INFO:teuthology.orchestra.run.smithi001.stdout:session_timeout 300 2024-09-15T22:24:39.786 INFO:teuthology.orchestra.run.smithi001.stdout:session_autoclose 300 2024-09-15T22:24:39.786 INFO:teuthology.orchestra.run.smithi001.stdout:max_file_size 1099511627776 2024-09-15T22:24:39.786 INFO:teuthology.orchestra.run.smithi001.stdout:max_xattr_size 65536 2024-09-15T22:24:39.786 INFO:teuthology.orchestra.run.smithi001.stdout:required_client_features {} 2024-09-15T22:24:39.787 INFO:teuthology.orchestra.run.smithi001.stdout:last_failure 0 2024-09-15T22:24:39.787 INFO:teuthology.orchestra.run.smithi001.stdout:last_failure_osd_epoch 0 2024-09-15T22:24:39.787 INFO:teuthology.orchestra.run.smithi001.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-15T22:24:39.787 INFO:teuthology.orchestra.run.smithi001.stdout:max_mds 3 2024-09-15T22:24:39.787 INFO:teuthology.orchestra.run.smithi001.stdout:in 0,1,2 2024-09-15T22:24:39.787 INFO:teuthology.orchestra.run.smithi001.stdout:up {0=24538,1=24524,2=24520} 2024-09-15T22:24:39.787 INFO:teuthology.orchestra.run.smithi001.stdout:failed 2024-09-15T22:24:39.787 INFO:teuthology.orchestra.run.smithi001.stdout:damaged 2024-09-15T22:24:39.787 INFO:teuthology.orchestra.run.smithi001.stdout:stopped 2024-09-15T22:24:39.787 INFO:teuthology.orchestra.run.smithi001.stdout:data_pools [3] 2024-09-15T22:24:39.787 INFO:teuthology.orchestra.run.smithi001.stdout:metadata_pool 2 2024-09-15T22:24:39.787 INFO:teuthology.orchestra.run.smithi001.stdout:inline_data disabled 2024-09-15T22:24:39.787 INFO:teuthology.orchestra.run.smithi001.stdout:balancer 2024-09-15T22:24:39.788 INFO:teuthology.orchestra.run.smithi001.stdout:bal_rank_mask -1 2024-09-15T22:24:39.788 INFO:teuthology.orchestra.run.smithi001.stdout:standby_count_wanted 0 2024-09-15T22:24:39.788 INFO:teuthology.orchestra.run.smithi001.stdout:qdb_cluster leader: 24538 members: 24538,24524,24520 2024-09-15T22:24:39.788 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.i{0:24538} state up:active seq 7 addr [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:24:39.788 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.f{0:24514} state up:standby-replay seq 1 addr [v2:172.21.15.98:6834/1848806705,v1:172.21.15.98:6835/1848806705] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:24:39.788 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.b{1:24524} state up:active seq 7 addr [v2:172.21.15.12:6838/1469511155,v1:172.21.15.12:6839/1469511155] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:24:39.788 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.h{1:24482} state up:standby-replay seq 1 addr [v2:172.21.15.12:6836/2378138381,v1:172.21.15.12:6837/2378138381] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:24:39.788 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.c{2:24520} state up:active seq 11 addr [v2:172.21.15.98:6836/493594054,v1:172.21.15.98:6837/493594054] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:24:39.789 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.l{2:24466} state up:standby-replay seq 1 addr [v2:172.21.15.98:6832/94050093,v1:172.21.15.98:6833/94050093] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:24:39.789 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:24:39.789 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:24:39.789 INFO:teuthology.orchestra.run.smithi001.stdout:Standby daemons: 2024-09-15T22:24:39.789 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:24:39.789 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.j{-1:14481} state up:standby seq 1 addr [v2:172.21.15.1:6834/2417768032,v1:172.21.15.1:6835/2417768032] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:24:39.789 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.d{-1:14493} state up:standby seq 1 addr [v2:172.21.15.1:6836/2957993064,v1:172.21.15.1:6837/2957993064] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:24:39.789 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.g{-1:14529} state up:standby seq 1 addr [v2:172.21.15.1:6838/3887277479,v1:172.21.15.1:6839/3887277479] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:24:39.789 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.a{-1:14541} state up:standby seq 1 addr [v2:172.21.15.1:6840/1674822398,v1:172.21.15.1:6841/1674822398] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:24:39.789 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.k{-1:24428} state up:standby seq 1 addr [v2:172.21.15.12:6832/3122570659,v1:172.21.15.12:6833/3122570659] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:24:39.789 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.e{-1:24458} state up:standby seq 1 addr [v2:172.21.15.12:6834/2901262900,v1:172.21.15.12:6835/2901262900] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:24:39.790 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 25 2024-09-15T22:24:39.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.784+0000 7fa3b7200640 1 -- 172.21.15.1:0/3298868569 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa39c0a32f0 msgr2=0x7fa39c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:39.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.784+0000 7fa3b7200640 1 --2- 172.21.15.1:0/3298868569 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa39c0a32f0 0x7fa39c0a57b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa3b819b3b0 tx=0x7fa3a4005f90 comp rx=0 tx=0).stop 2024-09-15T22:24:39.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.784+0000 7fa3b7200640 1 -- 172.21.15.1:0/3298868569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3b8103c40 msgr2=0x7fa3b8199e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:39.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.784+0000 7fa3b7200640 1 --2- 172.21.15.1:0/3298868569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3b8103c40 0x7fa3b8199e90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa3a800e9c0 tx=0x7fa3a800ee80 comp rx=0 tx=0).stop 2024-09-15T22:24:39.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.785+0000 7fa3b7200640 1 -- 172.21.15.1:0/3298868569 shutdown_connections 2024-09-15T22:24:39.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.785+0000 7fa3b7200640 1 --2- 172.21.15.1:0/3298868569 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa39c0a32f0 0x7fa39c0a57b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:39.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.785+0000 7fa3b7200640 1 --2- 172.21.15.1:0/3298868569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3b8105800 0x7fa3b81a1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:39.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.785+0000 7fa3b7200640 1 --2- 172.21.15.1:0/3298868569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3b8104e40 0x7fa3b819a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:39.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.785+0000 7fa3b7200640 1 --2- 172.21.15.1:0/3298868569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3b8103c40 0x7fa3b8199e90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:39.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.785+0000 7fa3b7200640 1 -- 172.21.15.1:0/3298868569 >> 172.21.15.1:0/3298868569 conn(0x7fa3b80ff3d0 msgr2=0x7fa3b8108140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:39.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.785+0000 7fa3b7200640 1 -- 172.21.15.1:0/3298868569 shutdown_connections 2024-09-15T22:24:39.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:39.785+0000 7fa3b7200640 1 -- 172.21.15.1:0/3298868569 wait complete. 2024-09-15T22:24:39.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:39 smithi098 ceph-mon[35514]: pgmap v349: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 895 B/s wr, 7 op/s 2024-09-15T22:24:39.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:39 smithi098 ceph-mon[35514]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:24:40.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:40 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/3298868569' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-15T22:24:40.715 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-15T22:24:40.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:40 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/3298868569' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-15T22:24:40.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:40 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/3298868569' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-15T22:24:41.093 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:41.541 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:41 smithi001 ceph-mon[30843]: pgmap v350: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 895 B/s wr, 7 op/s 2024-09-15T22:24:41.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.653+0000 7f41e3e00640 1 -- 172.21.15.1:0/1690506382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41e4077df0 msgr2=0x7f41e4078250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:41.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.653+0000 7f41e3e00640 1 --2- 172.21.15.1:0/1690506382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41e4077df0 0x7f41e4078250 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f41cc009900 tx=0x7f41cc02a410 comp rx=0 tx=0).stop 2024-09-15T22:24:41.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.653+0000 7f41e3e00640 1 -- 172.21.15.1:0/1690506382 shutdown_connections 2024-09-15T22:24:41.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.653+0000 7f41e3e00640 1 --2- 172.21.15.1:0/1690506382 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41e4078790 0x7f41e4079030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.653+0000 7f41e3e00640 1 --2- 172.21.15.1:0/1690506382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41e4077df0 0x7f41e4078250 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.653+0000 7f41e3e00640 1 --2- 172.21.15.1:0/1690506382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41e4076ba0 0x7f41e4076fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.653+0000 7f41e3e00640 1 -- 172.21.15.1:0/1690506382 >> 172.21.15.1:0/1690506382 conn(0x7f41e40ff3e0 msgr2=0x7f41e4101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:41.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.653+0000 7f41e3e00640 1 -- 172.21.15.1:0/1690506382 shutdown_connections 2024-09-15T22:24:41.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.653+0000 7f41e3e00640 1 -- 172.21.15.1:0/1690506382 wait complete. 2024-09-15T22:24:41.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.654+0000 7f41e3e00640 1 Processor -- start 2024-09-15T22:24:41.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.654+0000 7f41e3e00640 1 -- start start 2024-09-15T22:24:41.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.654+0000 7f41e3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41e4076ba0 0x7f41e419e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:41.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.654+0000 7f41e3e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41e4077df0 0x7f41e419e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:41.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.654+0000 7f41e3e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41e4078790 0x7f41e41a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:41.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.654+0000 7f41e3e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f41e4113d60 con 0x7f41e4077df0 2024-09-15T22:24:41.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.655+0000 7f41e3e00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f41e4113be0 con 0x7f41e4076ba0 2024-09-15T22:24:41.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.655+0000 7f41e3e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f41e4113ee0 con 0x7f41e4078790 2024-09-15T22:24:41.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.655+0000 7f41dbe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41e4077df0 0x7f41e419e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:41.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.655+0000 7f41e2a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41e4076ba0 0x7f41e419e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:41.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.655+0000 7f41dbe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41e4077df0 0x7f41e419e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50962/0 (socket says 172.21.15.1:50962) 2024-09-15T22:24:41.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.655+0000 7f41e2a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41e4076ba0 0x7f41e419e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:48658/0 (socket says 172.21.15.1:48658) 2024-09-15T22:24:41.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.655+0000 7f41dbe00640 1 -- 172.21.15.1:0/1088859922 learned_addr learned my addr 172.21.15.1:0/1088859922 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:41.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.655+0000 7f41e3400640 1 --2- 172.21.15.1:0/1088859922 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41e4078790 0x7f41e41a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:41.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.655+0000 7f41e2a00640 1 -- 172.21.15.1:0/1088859922 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41e4078790 msgr2=0x7f41e41a5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:41.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.655+0000 7f41e2a00640 1 --2- 172.21.15.1:0/1088859922 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41e4078790 0x7f41e41a5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.655+0000 7f41e2a00640 1 -- 172.21.15.1:0/1088859922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41e4077df0 msgr2=0x7f41e419e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:41.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.655+0000 7f41e2a00640 1 --2- 172.21.15.1:0/1088859922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41e4077df0 0x7f41e419e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.655+0000 7f41e2a00640 1 -- 172.21.15.1:0/1088859922 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e41a5ef0 con 0x7f41e4076ba0 2024-09-15T22:24:41.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.655+0000 7f41e2a00640 1 --2- 172.21.15.1:0/1088859922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41e4076ba0 0x7f41e419e2c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f41d400e9f0 tx=0x7f41d400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:41.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.656+0000 7f41e8a00640 1 -- 172.21.15.1:0/1088859922 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d400ccc0 con 0x7f41e4076ba0 2024-09-15T22:24:41.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.656+0000 7f41e8a00640 1 -- 172.21.15.1:0/1088859922 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41d4010910 con 0x7f41e4076ba0 2024-09-15T22:24:41.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.656+0000 7f41e3e00640 1 -- 172.21.15.1:0/1088859922 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41e41a61e0 con 0x7f41e4076ba0 2024-09-15T22:24:41.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.656+0000 7f41e8a00640 1 -- 172.21.15.1:0/1088859922 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d4018960 con 0x7f41e4076ba0 2024-09-15T22:24:41.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.656+0000 7f41e3e00640 1 -- 172.21.15.1:0/1088859922 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41e41a6720 con 0x7f41e4076ba0 2024-09-15T22:24:41.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.657+0000 7f41e3e00640 1 -- 172.21.15.1:0/1088859922 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41e41105d0 con 0x7f41e4076ba0 2024-09-15T22:24:41.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.659+0000 7f41e8a00640 1 -- 172.21.15.1:0/1088859922 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f41d4010ac0 con 0x7f41e4076ba0 2024-09-15T22:24:41.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.660+0000 7f41e8a00640 1 --2- 172.21.15.1:0/1088859922 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f41c80a3270 0x7f41c80a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:41.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.660+0000 7f41e8a00640 1 -- 172.21.15.1:0/1088859922 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f41d40cfde0 con 0x7f41e4076ba0 2024-09-15T22:24:41.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.660+0000 7f41dbe00640 1 --2- 172.21.15.1:0/1088859922 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f41c80a3270 0x7f41c80a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:41.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.661+0000 7f41dbe00640 1 --2- 172.21.15.1:0/1088859922 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f41c80a3270 0x7f41c80a5730 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f41e419f7e0 tx=0x7f41cc0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:41.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.664+0000 7f41e8a00640 1 -- 172.21.15.1:0/1088859922 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f41d409ca40 con 0x7f41e4076ba0 2024-09-15T22:24:41.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:41 smithi012 ceph-mon[34883]: pgmap v350: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 895 B/s wr, 7 op/s 2024-09-15T22:24:41.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:41 smithi098 ceph-mon[35514]: pgmap v350: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 895 B/s wr, 7 op/s 2024-09-15T22:24:41.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.850+0000 7f41e3e00640 1 -- 172.21.15.1:0/1088859922 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f41e4062df0 con 0x7f41e4076ba0 2024-09-15T22:24:41.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.851+0000 7f41e8a00640 1 -- 172.21.15.1:0/1088859922 <== mon.2 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v86) ==== 56+0+5336 (secure 0 0 0) 0x7f41d409c340 con 0x7f41e4076ba0 2024-09-15T22:24:41.853 INFO:teuthology.orchestra.run.smithi001.stdout:epoch 86 2024-09-15T22:24:41.853 INFO:teuthology.orchestra.run.smithi001.stdout:fsid c1228c44-73af-11ef-bceb-c7b262605968 2024-09-15T22:24:41.853 INFO:teuthology.orchestra.run.smithi001.stdout:created 2024-09-15T22:14:39.004556+0000 2024-09-15T22:24:41.853 INFO:teuthology.orchestra.run.smithi001.stdout:modified 2024-09-15T22:24:33.423260+0000 2024-09-15T22:24:41.854 INFO:teuthology.orchestra.run.smithi001.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-15T22:24:41.854 INFO:teuthology.orchestra.run.smithi001.stdout:crush_version 26 2024-09-15T22:24:41.854 INFO:teuthology.orchestra.run.smithi001.stdout:full_ratio 0.95 2024-09-15T22:24:41.854 INFO:teuthology.orchestra.run.smithi001.stdout:backfillfull_ratio 0.9 2024-09-15T22:24:41.854 INFO:teuthology.orchestra.run.smithi001.stdout:nearfull_ratio 0.85 2024-09-15T22:24:41.854 INFO:teuthology.orchestra.run.smithi001.stdout:require_min_compat_client luminous 2024-09-15T22:24:41.854 INFO:teuthology.orchestra.run.smithi001.stdout:min_compat_client luminous 2024-09-15T22:24:41.854 INFO:teuthology.orchestra.run.smithi001.stdout:require_osd_release squid 2024-09-15T22:24:41.854 INFO:teuthology.orchestra.run.smithi001.stdout:stretch_mode_enabled false 2024-09-15T22:24:41.854 INFO:teuthology.orchestra.run.smithi001.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-15T22:24:41.854 INFO:teuthology.orchestra.run.smithi001.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 82 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-15T22:24:41.854 INFO:teuthology.orchestra.run.smithi001.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 82 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-15T22:24:41.855 INFO:teuthology.orchestra.run.smithi001.stdout:max_osd 12 2024-09-15T22:24:41.855 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0 up in weight 1 up_from 8 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.1:6802/3588868833,v1:172.21.15.1:6803/3588868833] [v2:172.21.15.1:6804/3588868833,v1:172.21.15.1:6805/3588868833] exists,up 28228d47-bbb7-4103-a4fb-3e126769f8bd 2024-09-15T22:24:41.855 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1 up in weight 1 up_from 13 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.12:6800/3951165354,v1:172.21.15.12:6801/3951165354] [v2:172.21.15.12:6802/3951165354,v1:172.21.15.12:6803/3951165354] exists,up d90dd2c1-2047-4491-8730-30793a354aa4 2024-09-15T22:24:41.855 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2 up in weight 1 up_from 18 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6800/1633982971,v1:172.21.15.98:6801/1633982971] [v2:172.21.15.98:6802/1633982971,v1:172.21.15.98:6803/1633982971] exists,up 22e38f44-88d3-4461-a57e-6dc4857ec48f 2024-09-15T22:24:41.855 INFO:teuthology.orchestra.run.smithi001.stdout:osd.3 up in weight 1 up_from 26 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.1:6810/3706738461,v1:172.21.15.1:6811/3706738461] [v2:172.21.15.1:6812/3706738461,v1:172.21.15.1:6813/3706738461] exists,up dd9d6e97-af81-442a-ac0d-543e440a8d7f 2024-09-15T22:24:41.855 INFO:teuthology.orchestra.run.smithi001.stdout:osd.4 up in weight 1 up_from 33 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.12:6808/4057902964,v1:172.21.15.12:6809/4057902964] [v2:172.21.15.12:6810/4057902964,v1:172.21.15.12:6811/4057902964] exists,up 50116baa-dd99-4dbb-a7a1-2268f04052f4 2024-09-15T22:24:41.855 INFO:teuthology.orchestra.run.smithi001.stdout:osd.5 up in weight 1 up_from 38 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6808/4043567619,v1:172.21.15.98:6809/4043567619] [v2:172.21.15.98:6810/4043567619,v1:172.21.15.98:6811/4043567619] exists,up 56ab0694-2f21-46c4-a086-44f72c271c56 2024-09-15T22:24:41.855 INFO:teuthology.orchestra.run.smithi001.stdout:osd.6 up in weight 1 up_from 45 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.1:6818/2236861161,v1:172.21.15.1:6819/2236861161] [v2:172.21.15.1:6820/2236861161,v1:172.21.15.1:6821/2236861161] exists,up 5ca0d114-4894-428e-bcd3-2ebd24d10a86 2024-09-15T22:24:41.855 INFO:teuthology.orchestra.run.smithi001.stdout:osd.7 up in weight 1 up_from 50 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.12:6816/133202448,v1:172.21.15.12:6817/133202448] [v2:172.21.15.12:6818/133202448,v1:172.21.15.12:6819/133202448] exists,up db99cc6e-1717-4958-bf11-65aca94476b5 2024-09-15T22:24:41.855 INFO:teuthology.orchestra.run.smithi001.stdout:osd.8 up in weight 1 up_from 57 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6816/3701478409,v1:172.21.15.98:6817/3701478409] [v2:172.21.15.98:6818/3701478409,v1:172.21.15.98:6819/3701478409] exists,up 4d3b6574-49f7-47f6-b36b-4da14ca290f2 2024-09-15T22:24:41.855 INFO:teuthology.orchestra.run.smithi001.stdout:osd.9 up in weight 1 up_from 64 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.1:6826/2580755002,v1:172.21.15.1:6827/2580755002] [v2:172.21.15.1:6828/2580755002,v1:172.21.15.1:6829/2580755002] exists,up 7dd2fe25-1b75-48e5-86c7-c7a3ab85053f 2024-09-15T22:24:41.855 INFO:teuthology.orchestra.run.smithi001.stdout:osd.10 up in weight 1 up_from 69 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.12:6824/3989063573,v1:172.21.15.12:6825/3989063573] [v2:172.21.15.12:6826/3989063573,v1:172.21.15.12:6827/3989063573] exists,up fcad11dc-0a1b-44a2-ac32-74100e317255 2024-09-15T22:24:41.855 INFO:teuthology.orchestra.run.smithi001.stdout:osd.11 up in weight 1 up_from 76 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6824/839956167,v1:172.21.15.98:6825/839956167] [v2:172.21.15.98:6826/839956167,v1:172.21.15.98:6827/839956167] exists,up f4e717bb-586d-4fe2-9e6b-f574be4db36c 2024-09-15T22:24:41.855 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 2.a [2,11] 2024-09-15T22:24:41.856 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 2.10 [2,4,8,11] 2024-09-15T22:24:41.856 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.0 [4,8] 2024-09-15T22:24:41.856 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.6 [3,7] 2024-09-15T22:24:41.856 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.10 [5,9] 2024-09-15T22:24:41.856 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.11 [1,2] 2024-09-15T22:24:41.856 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.17 [4,8] 2024-09-15T22:24:41.856 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.1d [4,7] 2024-09-15T22:24:41.856 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.28 [5,6] 2024-09-15T22:24:41.856 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.29 [3,9] 2024-09-15T22:24:41.856 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.34 [4,9] 2024-09-15T22:24:41.856 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.37 [5,6] 2024-09-15T22:24:41.856 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:6800/3145051160 expires 2024-09-16T22:15:31.433375+0000 2024-09-15T22:24:41.856 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/3101438101 expires 2024-09-16T22:15:31.433375+0000 2024-09-15T22:24:41.856 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/4159811089 expires 2024-09-16T22:15:31.433375+0000 2024-09-15T22:24:41.856 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:6801/3145051160 expires 2024-09-16T22:15:31.433375+0000 2024-09-15T22:24:41.857 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/2785155592 expires 2024-09-16T22:15:31.433375+0000 2024-09-15T22:24:41.857 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/714180295 expires 2024-09-16T22:15:03.937536+0000 2024-09-15T22:24:41.857 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:6801/215291238 expires 2024-09-16T22:15:03.937536+0000 2024-09-15T22:24:41.857 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:6800/215291238 expires 2024-09-16T22:15:03.937536+0000 2024-09-15T22:24:41.857 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/1842817732 expires 2024-09-16T22:15:03.937536+0000 2024-09-15T22:24:41.857 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/3888009741 expires 2024-09-16T22:15:03.937536+0000 2024-09-15T22:24:41.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.853+0000 7f41e3e00640 1 -- 172.21.15.1:0/1088859922 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f41c80a3270 msgr2=0x7f41c80a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:41.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.853+0000 7f41e3e00640 1 --2- 172.21.15.1:0/1088859922 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f41c80a3270 0x7f41c80a5730 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f41e419f7e0 tx=0x7f41cc0315b0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.853+0000 7f41e3e00640 1 -- 172.21.15.1:0/1088859922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41e4076ba0 msgr2=0x7f41e419e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:41.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.853+0000 7f41e3e00640 1 --2- 172.21.15.1:0/1088859922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41e4076ba0 0x7f41e419e2c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f41d400e9f0 tx=0x7f41d400eeb0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.853+0000 7f41e3e00640 1 -- 172.21.15.1:0/1088859922 shutdown_connections 2024-09-15T22:24:41.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.853+0000 7f41e3e00640 1 --2- 172.21.15.1:0/1088859922 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f41c80a3270 0x7f41c80a5730 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.853+0000 7f41e3e00640 1 --2- 172.21.15.1:0/1088859922 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41e4078790 0x7f41e41a5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.853+0000 7f41e3e00640 1 --2- 172.21.15.1:0/1088859922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41e4077df0 0x7f41e419e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.853+0000 7f41e3e00640 1 --2- 172.21.15.1:0/1088859922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41e4076ba0 0x7f41e419e2c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.853+0000 7f41e3e00640 1 -- 172.21.15.1:0/1088859922 >> 172.21.15.1:0/1088859922 conn(0x7f41e40ff3e0 msgr2=0x7f41e4100e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:41.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.853+0000 7f41e3e00640 1 -- 172.21.15.1:0/1088859922 shutdown_connections 2024-09-15T22:24:41.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:41.853+0000 7f41e3e00640 1 -- 172.21.15.1:0/1088859922 wait complete. 2024-09-15T22:24:42.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:42 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/1088859922' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-15T22:24:42.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:42 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/1088859922' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-15T22:24:42.771 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-15T22:24:42.785 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:24:42.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:42 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/1088859922' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-15T22:24:43.168 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:43.709 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:43 smithi001 ceph-mon[30843]: pgmap v351: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 785 B/s wr, 7 op/s 2024-09-15T22:24:43.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.707+0000 7f0dc1600640 1 -- 172.21.15.1:0/2364867933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0dbc077040 msgr2=0x7f0dbc112330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:43.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.707+0000 7f0dc1600640 1 --2- 172.21.15.1:0/2364867933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0dbc077040 0x7f0dbc112330 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0da8009900 tx=0x7f0da802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:24:43.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.707+0000 7f0dc1600640 1 -- 172.21.15.1:0/2364867933 shutdown_connections 2024-09-15T22:24:43.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.707+0000 7f0dc1600640 1 --2- 172.21.15.1:0/2364867933 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0dbc112870 0x7f0dbc114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:43.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.707+0000 7f0dc1600640 1 --2- 172.21.15.1:0/2364867933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0dbc077040 0x7f0dbc112330 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:43.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.707+0000 7f0dc1600640 1 --2- 172.21.15.1:0/2364867933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dbc076720 0x7f0dbc076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:43.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.707+0000 7f0dc1600640 1 -- 172.21.15.1:0/2364867933 >> 172.21.15.1:0/2364867933 conn(0x7f0dbc0ff910 msgr2=0x7f0dbc101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:43.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.707+0000 7f0dc1600640 1 -- 172.21.15.1:0/2364867933 shutdown_connections 2024-09-15T22:24:43.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.707+0000 7f0dc1600640 1 -- 172.21.15.1:0/2364867933 wait complete. 2024-09-15T22:24:43.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.708+0000 7f0dc1600640 1 Processor -- start 2024-09-15T22:24:43.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.708+0000 7f0dc1600640 1 -- start start 2024-09-15T22:24:43.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.709+0000 7f0dc1600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0dbc076720 0x7f0dbc1a4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:43.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.709+0000 7f0dc1600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dbc077040 0x7f0dbc1a4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:43.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.709+0000 7f0dc1600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0dbc112870 0x7f0dbc19e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:43.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.709+0000 7f0dc1600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0dbc118430 con 0x7f0dbc112870 2024-09-15T22:24:43.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.709+0000 7f0dc1600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0dbc1182b0 con 0x7f0dbc077040 2024-09-15T22:24:43.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.709+0000 7f0dc1600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0dbc1185b0 con 0x7f0dbc076720 2024-09-15T22:24:43.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.709+0000 7f0dbb400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dbc077040 0x7f0dbc1a4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:43.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.709+0000 7f0dbb400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dbc077040 0x7f0dbc1a4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:48678/0 (socket says 172.21.15.1:48678) 2024-09-15T22:24:43.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.709+0000 7f0dbb400640 1 -- 172.21.15.1:0/2424696773 learned_addr learned my addr 172.21.15.1:0/2424696773 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:43.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.709+0000 7f0dc0c00640 1 --2- 172.21.15.1:0/2424696773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0dbc112870 0x7f0dbc19e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:43.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.709+0000 7f0dbbe00640 1 --2- 172.21.15.1:0/2424696773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0dbc076720 0x7f0dbc1a4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:43.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.710+0000 7f0dbb400640 1 -- 172.21.15.1:0/2424696773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0dbc076720 msgr2=0x7f0dbc1a4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:43.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.710+0000 7f0dbb400640 1 --2- 172.21.15.1:0/2424696773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0dbc076720 0x7f0dbc1a4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:43.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.710+0000 7f0dbb400640 1 -- 172.21.15.1:0/2424696773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0dbc112870 msgr2=0x7f0dbc19e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:43.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.710+0000 7f0dbb400640 1 --2- 172.21.15.1:0/2424696773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0dbc112870 0x7f0dbc19e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:43.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.710+0000 7f0dbb400640 1 -- 172.21.15.1:0/2424696773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dbc19efb0 con 0x7f0dbc077040 2024-09-15T22:24:43.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.710+0000 7f0dbb400640 1 --2- 172.21.15.1:0/2424696773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dbc077040 0x7f0dbc1a4bb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0da8004770 tx=0x7f0da8003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:43.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.710+0000 7f0db8c00640 1 -- 172.21.15.1:0/2424696773 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da803f070 con 0x7f0dbc077040 2024-09-15T22:24:43.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.710+0000 7f0dc1600640 1 -- 172.21.15.1:0/2424696773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dbc19f240 con 0x7f0dbc077040 2024-09-15T22:24:43.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.710+0000 7f0db8c00640 1 -- 172.21.15.1:0/2424696773 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0da8031ca0 con 0x7f0dbc077040 2024-09-15T22:24:43.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.710+0000 7f0db8c00640 1 -- 172.21.15.1:0/2424696773 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da8035030 con 0x7f0dbc077040 2024-09-15T22:24:43.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.711+0000 7f0dc1600640 1 -- 172.21.15.1:0/2424696773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dbc1ab420 con 0x7f0dbc077040 2024-09-15T22:24:43.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.712+0000 7f0dc1600640 1 -- 172.21.15.1:0/2424696773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dbc077e60 con 0x7f0dbc077040 2024-09-15T22:24:43.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.715+0000 7f0db8c00640 1 -- 172.21.15.1:0/2424696773 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f0da8042070 con 0x7f0dbc077040 2024-09-15T22:24:43.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.718+0000 7f0db8c00640 1 --2- 172.21.15.1:0/2424696773 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f0da00a3240 0x7f0da00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:43.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.718+0000 7f0db8c00640 1 -- 172.21.15.1:0/2424696773 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f0da80efff0 con 0x7f0dbc077040 2024-09-15T22:24:43.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.718+0000 7f0dbbe00640 1 --2- 172.21.15.1:0/2424696773 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f0da00a3240 0x7f0da00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:43.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.718+0000 7f0db8c00640 1 -- 172.21.15.1:0/2424696773 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0da80bc620 con 0x7f0dbc077040 2024-09-15T22:24:43.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.719+0000 7f0dbbe00640 1 --2- 172.21.15.1:0/2424696773 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f0da00a3240 0x7f0da00a5700 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0dac009bd0 tx=0x7f0dac005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:43.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:43 smithi012 ceph-mon[34883]: pgmap v351: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 785 B/s wr, 7 op/s 2024-09-15T22:24:43.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:43 smithi098 ceph-mon[35514]: pgmap v351: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 785 B/s wr, 7 op/s 2024-09-15T22:24:43.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.950+0000 7f0dc1600640 1 -- 172.21.15.1:0/2424696773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0dbc076b00 con 0x7f0dbc077040 2024-09-15T22:24:43.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.951+0000 7f0db8c00640 1 -- 172.21.15.1:0/2424696773 <== mon.2 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11882 (secure 0 0 0) 0x7f0da80c0920 con 0x7f0dbc077040 2024-09-15T22:24:43.953 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:24:43.953 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":25,"btime":"2024-09-15T22:23:07:844952+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2417768032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2417768032},{"type":"v1","addr":"172.21.15.1:6835","nonce":2417768032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14493,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2957993064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2957993064},{"type":"v1","addr":"172.21.15.1:6837","nonce":2957993064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14529,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3887277479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3887277479},{"type":"v1","addr":"172.21.15.1:6839","nonce":3887277479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14541,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/1674822398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":1674822398},{"type":"v1","addr":"172.21.15.1:6841","nonce":1674822398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3122570659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3122570659},{"type":"v1","addr":"172.21.15.12:6833","nonce":3122570659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2901262900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2901262900},{"type":"v1","addr":"172.21.15.12:6835","nonce":2901262900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:22:51.743282+0000","modified":"2024-09-15T22:23:06.984789+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24538,"mds_1":24524,"mds_2":24520},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/94050093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":94050093},{"type":"v1","addr":"172.21.15.98:6833","nonce":94050093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6837/2378138381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2378138381},{"type":"v1","addr":"172.21.15.12:6837","nonce":2378138381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1848806705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1848806705},{"type":"v1","addr":"172.21.15.98:6835","nonce":1848806705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.98:6837/493594054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":493594054},{"type":"v1","addr":"172.21.15.98:6837","nonce":493594054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.12:6839/1469511155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":1469511155},{"type":"v1","addr":"172.21.15.12:6839","nonce":1469511155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.98:6839/2831161859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2831161859},{"type":"v1","addr":"172.21.15.98:6839","nonce":2831161859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24538,"qdb_cluster":[24538,24524,24520]},"id":1}]} 2024-09-15T22:24:43.954 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 25 2024-09-15T22:24:43.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.954+0000 7f0dc1600640 1 -- 172.21.15.1:0/2424696773 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f0da00a3240 msgr2=0x7f0da00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:43.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.954+0000 7f0dc1600640 1 --2- 172.21.15.1:0/2424696773 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f0da00a3240 0x7f0da00a5700 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0dac009bd0 tx=0x7f0dac005f90 comp rx=0 tx=0).stop 2024-09-15T22:24:43.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.954+0000 7f0dc1600640 1 -- 172.21.15.1:0/2424696773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dbc077040 msgr2=0x7f0dbc1a4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:43.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.954+0000 7f0dc1600640 1 --2- 172.21.15.1:0/2424696773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dbc077040 0x7f0dbc1a4bb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0da8004770 tx=0x7f0da8003c10 comp rx=0 tx=0).stop 2024-09-15T22:24:43.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.954+0000 7f0dc1600640 1 -- 172.21.15.1:0/2424696773 shutdown_connections 2024-09-15T22:24:43.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.954+0000 7f0dc1600640 1 --2- 172.21.15.1:0/2424696773 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f0da00a3240 0x7f0da00a5700 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:43.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.954+0000 7f0dc1600640 1 --2- 172.21.15.1:0/2424696773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0dbc112870 0x7f0dbc19e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:43.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.954+0000 7f0dc1600640 1 --2- 172.21.15.1:0/2424696773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dbc077040 0x7f0dbc1a4bb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:43.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.954+0000 7f0dc1600640 1 --2- 172.21.15.1:0/2424696773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0dbc076720 0x7f0dbc1a4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:43.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.954+0000 7f0dc1600640 1 -- 172.21.15.1:0/2424696773 >> 172.21.15.1:0/2424696773 conn(0x7f0dbc0ff910 msgr2=0x7f0dbc101d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:43.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.954+0000 7f0dc1600640 1 -- 172.21.15.1:0/2424696773 shutdown_connections 2024-09-15T22:24:43.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:43.954+0000 7f0dc1600640 1 -- 172.21.15.1:0/2424696773 wait complete. 2024-09-15T22:24:44.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:44 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/2424696773' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:24:44.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:44 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/2424696773' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:24:44.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:44 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/2424696773' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:24:44.924 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:24:45.302 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:45.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:45 smithi012 ceph-mon[34883]: pgmap v352: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 708 B/s wr, 7 op/s 2024-09-15T22:24:45.785 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:45 smithi001 ceph-mon[30843]: pgmap v352: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 708 B/s wr, 7 op/s 2024-09-15T22:24:45.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:45 smithi098 ceph-mon[35514]: pgmap v352: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 708 B/s wr, 7 op/s 2024-09-15T22:24:45.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.898+0000 7f7c73a00640 1 -- 172.21.15.1:0/2202374909 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c6c103660 msgr2=0x7f7c6c10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:45.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.898+0000 7f7c73a00640 1 --2- 172.21.15.1:0/2202374909 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c6c103660 0x7f7c6c10bb50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009900 tx=0x7f7c5402a480 comp rx=0 tx=0).stop 2024-09-15T22:24:45.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.898+0000 7f7c73a00640 1 -- 172.21.15.1:0/2202374909 shutdown_connections 2024-09-15T22:24:45.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.898+0000 7f7c73a00640 1 --2- 172.21.15.1:0/2202374909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c6c10c170 0x7f7c6c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.898+0000 7f7c73a00640 1 --2- 172.21.15.1:0/2202374909 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c6c103660 0x7f7c6c10bb50 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.898+0000 7f7c73a00640 1 --2- 172.21.15.1:0/2202374909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c6c102d40 0x7f7c6c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.898+0000 7f7c73a00640 1 -- 172.21.15.1:0/2202374909 >> 172.21.15.1:0/2202374909 conn(0x7f7c6c0fc780 msgr2=0x7f7c6c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:45.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.898+0000 7f7c73a00640 1 -- 172.21.15.1:0/2202374909 shutdown_connections 2024-09-15T22:24:45.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.898+0000 7f7c73a00640 1 -- 172.21.15.1:0/2202374909 wait complete. 2024-09-15T22:24:45.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.899+0000 7f7c73a00640 1 Processor -- start 2024-09-15T22:24:45.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.899+0000 7f7c73a00640 1 -- start start 2024-09-15T22:24:45.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.899+0000 7f7c73a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c6c102d40 0x7f7c6c19a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:45.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.899+0000 7f7c73a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c6c103660 0x7f7c6c19aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:45.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.899+0000 7f7c73a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c6c10c170 0x7f7c6c19ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:45.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.899+0000 7f7c73a00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6c111f70 con 0x7f7c6c10c170 2024-09-15T22:24:45.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.899+0000 7f7c73a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6c111df0 con 0x7f7c6c103660 2024-09-15T22:24:45.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.899+0000 7f7c73a00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6c1120f0 con 0x7f7c6c102d40 2024-09-15T22:24:45.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.900+0000 7f7c71000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c6c102d40 0x7f7c6c19a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:45.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.900+0000 7f7c71000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c6c102d40 0x7f7c6c19a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:33254/0 (socket says 172.21.15.1:33254) 2024-09-15T22:24:45.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.900+0000 7f7c71000640 1 -- 172.21.15.1:0/2524517471 learned_addr learned my addr 172.21.15.1:0/2524517471 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:45.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.900+0000 7f7c63e00640 1 --2- 172.21.15.1:0/2524517471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c6c103660 0x7f7c6c19aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:45.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.900+0000 7f7c71a00640 1 --2- 172.21.15.1:0/2524517471 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c6c10c170 0x7f7c6c19ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:45.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.900+0000 7f7c71000640 1 -- 172.21.15.1:0/2524517471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c6c103660 msgr2=0x7f7c6c19aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:45.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.900+0000 7f7c71000640 1 --2- 172.21.15.1:0/2524517471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c6c103660 0x7f7c6c19aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.900+0000 7f7c71000640 1 -- 172.21.15.1:0/2524517471 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c6c10c170 msgr2=0x7f7c6c19ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:45.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.900+0000 7f7c71000640 1 --2- 172.21.15.1:0/2524517471 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c6c10c170 0x7f7c6c19ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.900+0000 7f7c71000640 1 -- 172.21.15.1:0/2524517471 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c6c19f610 con 0x7f7c6c102d40 2024-09-15T22:24:45.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.900+0000 7f7c71000640 1 --2- 172.21.15.1:0/2524517471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c6c102d40 0x7f7c6c19a660 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c00ea60 tx=0x7f7c5c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:45.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.901+0000 7f7c6a000640 1 -- 172.21.15.1:0/2524517471 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c00cde0 con 0x7f7c6c102d40 2024-09-15T22:24:45.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.901+0000 7f7c6a000640 1 -- 172.21.15.1:0/2524517471 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c5c0035f0 con 0x7f7c6c102d40 2024-09-15T22:24:45.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.901+0000 7f7c73a00640 1 -- 172.21.15.1:0/2524517471 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c6c19f900 con 0x7f7c6c102d40 2024-09-15T22:24:45.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.901+0000 7f7c6a000640 1 -- 172.21.15.1:0/2524517471 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c010670 con 0x7f7c6c102d40 2024-09-15T22:24:45.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.901+0000 7f7c73a00640 1 -- 172.21.15.1:0/2524517471 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c6c1a71e0 con 0x7f7c6c102d40 2024-09-15T22:24:45.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.902+0000 7f7c73a00640 1 -- 172.21.15.1:0/2524517471 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c6c103120 con 0x7f7c6c102d40 2024-09-15T22:24:45.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.904+0000 7f7c6a000640 1 -- 172.21.15.1:0/2524517471 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f7c5c0037a0 con 0x7f7c6c102d40 2024-09-15T22:24:45.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.905+0000 7f7c6a000640 1 --2- 172.21.15.1:0/2524517471 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f7c500a3240 0x7f7c500a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:45.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.905+0000 7f7c6a000640 1 -- 172.21.15.1:0/2524517471 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f7c5c0cffa0 con 0x7f7c6c102d40 2024-09-15T22:24:45.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.905+0000 7f7c63e00640 1 --2- 172.21.15.1:0/2524517471 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f7c500a3240 0x7f7c500a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:45.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.906+0000 7f7c63e00640 1 --2- 172.21.15.1:0/2524517471 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f7c500a3240 0x7f7c500a5700 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009230 tx=0x7f7c540058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:45.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:45.907+0000 7f7c6a000640 1 -- 172.21.15.1:0/2524517471 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7c5c09cc00 con 0x7f7c6c102d40 2024-09-15T22:24:46.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:46.130+0000 7f7c73a00640 1 -- 172.21.15.1:0/2524517471 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c6c19b9c0 con 0x7f7c6c102d40 2024-09-15T22:24:46.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:46.131+0000 7f7c6a000640 1 -- 172.21.15.1:0/2524517471 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11882 (secure 0 0 0) 0x7f7c5c09c500 con 0x7f7c6c102d40 2024-09-15T22:24:46.134 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:24:46.134 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":25,"btime":"2024-09-15T22:23:07:844952+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2417768032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2417768032},{"type":"v1","addr":"172.21.15.1:6835","nonce":2417768032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14493,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2957993064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2957993064},{"type":"v1","addr":"172.21.15.1:6837","nonce":2957993064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14529,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3887277479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3887277479},{"type":"v1","addr":"172.21.15.1:6839","nonce":3887277479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14541,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/1674822398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":1674822398},{"type":"v1","addr":"172.21.15.1:6841","nonce":1674822398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3122570659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3122570659},{"type":"v1","addr":"172.21.15.12:6833","nonce":3122570659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2901262900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2901262900},{"type":"v1","addr":"172.21.15.12:6835","nonce":2901262900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:22:51.743282+0000","modified":"2024-09-15T22:23:06.984789+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24538,"mds_1":24524,"mds_2":24520},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/94050093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":94050093},{"type":"v1","addr":"172.21.15.98:6833","nonce":94050093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6837/2378138381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2378138381},{"type":"v1","addr":"172.21.15.12:6837","nonce":2378138381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1848806705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1848806705},{"type":"v1","addr":"172.21.15.98:6835","nonce":1848806705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.98:6837/493594054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":493594054},{"type":"v1","addr":"172.21.15.98:6837","nonce":493594054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.12:6839/1469511155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":1469511155},{"type":"v1","addr":"172.21.15.12:6839","nonce":1469511155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.98:6839/2831161859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2831161859},{"type":"v1","addr":"172.21.15.98:6839","nonce":2831161859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24538,"qdb_cluster":[24538,24524,24520]},"id":1}]} 2024-09-15T22:24:46.134 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 25 2024-09-15T22:24:46.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:46.133+0000 7f7c73a00640 1 -- 172.21.15.1:0/2524517471 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f7c500a3240 msgr2=0x7f7c500a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:46.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:46.133+0000 7f7c73a00640 1 --2- 172.21.15.1:0/2524517471 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f7c500a3240 0x7f7c500a5700 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009230 tx=0x7f7c540058d0 comp rx=0 tx=0).stop 2024-09-15T22:24:46.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:46.134+0000 7f7c73a00640 1 -- 172.21.15.1:0/2524517471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c6c102d40 msgr2=0x7f7c6c19a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:46.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:46.134+0000 7f7c73a00640 1 --2- 172.21.15.1:0/2524517471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c6c102d40 0x7f7c6c19a660 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c00ea60 tx=0x7f7c5c00ef20 comp rx=0 tx=0).stop 2024-09-15T22:24:46.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:46.134+0000 7f7c73a00640 1 -- 172.21.15.1:0/2524517471 shutdown_connections 2024-09-15T22:24:46.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:46.134+0000 7f7c73a00640 1 --2- 172.21.15.1:0/2524517471 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f7c500a3240 0x7f7c500a5700 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:46.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:46.134+0000 7f7c73a00640 1 --2- 172.21.15.1:0/2524517471 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c6c10c170 0x7f7c6c19ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:46.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:46.134+0000 7f7c73a00640 1 --2- 172.21.15.1:0/2524517471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c6c103660 0x7f7c6c19aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:46.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:46.134+0000 7f7c73a00640 1 --2- 172.21.15.1:0/2524517471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c6c102d40 0x7f7c6c19a660 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:46.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:46.134+0000 7f7c73a00640 1 -- 172.21.15.1:0/2524517471 >> 172.21.15.1:0/2524517471 conn(0x7f7c6c0fc780 msgr2=0x7f7c6c100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:46.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:46.134+0000 7f7c73a00640 1 -- 172.21.15.1:0/2524517471 shutdown_connections 2024-09-15T22:24:46.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:46.134+0000 7f7c73a00640 1 -- 172.21.15.1:0/2524517471 wait complete. 2024-09-15T22:24:46.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:46 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/2524517471' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:24:46.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:46 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/2524517471' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:24:46.875 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:46 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/2524517471' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:24:46.960 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:24:47.337 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:47.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:47 smithi012 ceph-mon[34883]: pgmap v353: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-15T22:24:47.783 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:47 smithi001 ceph-mon[30843]: pgmap v353: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-15T22:24:47.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:47 smithi098 ceph-mon[35514]: pgmap v353: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-15T22:24:47.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.894+0000 7efd82e00640 1 -- 172.21.15.1:0/2994871448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd7c1047e0 msgr2=0x7efd7c108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:47.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.894+0000 7efd82e00640 1 --2- 172.21.15.1:0/2994871448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd7c1047e0 0x7efd7c108830 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efd68009900 tx=0x7efd6802a410 comp rx=0 tx=0).stop 2024-09-15T22:24:47.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.894+0000 7efd82e00640 1 -- 172.21.15.1:0/2994871448 shutdown_connections 2024-09-15T22:24:47.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.894+0000 7efd82e00640 1 --2- 172.21.15.1:0/2994871448 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd7c108f60 0x7efd7c110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:47.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.894+0000 7efd82e00640 1 --2- 172.21.15.1:0/2994871448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd7c1047e0 0x7efd7c108830 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:47.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.894+0000 7efd82e00640 1 --2- 172.21.15.1:0/2994871448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd7c103e30 0x7efd7c104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:47.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.894+0000 7efd82e00640 1 -- 172.21.15.1:0/2994871448 >> 172.21.15.1:0/2994871448 conn(0x7efd7c0ff8d0 msgr2=0x7efd7c101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:47.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.894+0000 7efd82e00640 1 -- 172.21.15.1:0/2994871448 shutdown_connections 2024-09-15T22:24:47.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.894+0000 7efd82e00640 1 -- 172.21.15.1:0/2994871448 wait complete. 2024-09-15T22:24:47.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.895+0000 7efd82e00640 1 Processor -- start 2024-09-15T22:24:47.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.895+0000 7efd82e00640 1 -- start start 2024-09-15T22:24:47.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.895+0000 7efd82e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd7c103e30 0x7efd7c19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:47.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.895+0000 7efd82e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd7c1047e0 0x7efd7c19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:47.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.895+0000 7efd82e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd7c108f60 0x7efd7c19ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:47.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.895+0000 7efd82e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efd7c114010 con 0x7efd7c108f60 2024-09-15T22:24:47.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.895+0000 7efd82e00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efd7c113e90 con 0x7efd7c103e30 2024-09-15T22:24:47.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.895+0000 7efd82e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efd7c114190 con 0x7efd7c1047e0 2024-09-15T22:24:47.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.895+0000 7efd82400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd7c108f60 0x7efd7c19ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:47.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.895+0000 7efd81a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd7c103e30 0x7efd7c19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:47.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.896+0000 7efd82400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd7c108f60 0x7efd7c19ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42996/0 (socket says 172.21.15.1:42996) 2024-09-15T22:24:47.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.896+0000 7efd82400640 1 -- 172.21.15.1:0/2907484821 learned_addr learned my addr 172.21.15.1:0/2907484821 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:47.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.896+0000 7efd81000640 1 --2- 172.21.15.1:0/2907484821 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd7c1047e0 0x7efd7c19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:47.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.896+0000 7efd82400640 1 -- 172.21.15.1:0/2907484821 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd7c1047e0 msgr2=0x7efd7c19a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:47.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.896+0000 7efd82400640 1 --2- 172.21.15.1:0/2907484821 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd7c1047e0 0x7efd7c19a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:47.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.896+0000 7efd82400640 1 -- 172.21.15.1:0/2907484821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd7c103e30 msgr2=0x7efd7c19a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:47.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.896+0000 7efd82400640 1 --2- 172.21.15.1:0/2907484821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd7c103e30 0x7efd7c19a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:47.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.896+0000 7efd82400640 1 -- 172.21.15.1:0/2907484821 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd7c19f440 con 0x7efd7c108f60 2024-09-15T22:24:47.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.896+0000 7efd81a00640 1 --2- 172.21.15.1:0/2907484821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd7c103e30 0x7efd7c19a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:47.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.896+0000 7efd82400640 1 --2- 172.21.15.1:0/2907484821 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd7c108f60 0x7efd7c19ed60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efd7400eb10 tx=0x7efd7400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:47.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.897+0000 7efd7a000640 1 -- 172.21.15.1:0/2907484821 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd74004b20 con 0x7efd7c108f60 2024-09-15T22:24:47.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.897+0000 7efd82e00640 1 -- 172.21.15.1:0/2907484821 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd7c19f730 con 0x7efd7c108f60 2024-09-15T22:24:47.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.897+0000 7efd7a000640 1 -- 172.21.15.1:0/2907484821 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd74004cc0 con 0x7efd7c108f60 2024-09-15T22:24:47.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.897+0000 7efd7a000640 1 -- 172.21.15.1:0/2907484821 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd74010700 con 0x7efd7c108f60 2024-09-15T22:24:47.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.897+0000 7efd82e00640 1 -- 172.21.15.1:0/2907484821 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd7c1a7010 con 0x7efd7c108f60 2024-09-15T22:24:47.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.898+0000 7efd82e00640 1 -- 172.21.15.1:0/2907484821 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd7c104210 con 0x7efd7c108f60 2024-09-15T22:24:47.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.900+0000 7efd7a000640 1 -- 172.21.15.1:0/2907484821 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7efd74005020 con 0x7efd7c108f60 2024-09-15T22:24:47.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.901+0000 7efd7a000640 1 --2- 172.21.15.1:0/2907484821 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7efd640a3240 0x7efd640a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:47.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.901+0000 7efd7a000640 1 -- 172.21.15.1:0/2907484821 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7efd740cffc0 con 0x7efd7c108f60 2024-09-15T22:24:47.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.901+0000 7efd81a00640 1 --2- 172.21.15.1:0/2907484821 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7efd640a3240 0x7efd640a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:47.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.902+0000 7efd81a00640 1 --2- 172.21.15.1:0/2907484821 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7efd640a3240 0x7efd640a5700 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efd70009fc0 tx=0x7efd70005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:47.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:47.905+0000 7efd7a000640 1 -- 172.21.15.1:0/2907484821 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efd7409cc20 con 0x7efd7c108f60 2024-09-15T22:24:48.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:48.090+0000 7efd82e00640 1 -- 172.21.15.1:0/2907484821 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd7c10bbb0 con 0x7efd7c108f60 2024-09-15T22:24:48.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:48.092+0000 7efd7a000640 1 -- 172.21.15.1:0/2907484821 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+22787 (secure 0 0 0) 0x7efd7409c520 con 0x7efd7c108f60 2024-09-15T22:24:48.094 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:24:48.095 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":86,"fsid":"c1228c44-73af-11ef-bceb-c7b262605968","created":"2024-09-15T22:14:39.004556+0000","modified":"2024-09-15T22:24:33.423260+0000","last_up_change":"2024-09-15T22:21:53.270221+0000","last_in_change":"2024-09-15T22:21:30.911945+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:17:56.059390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:22:47.262081+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:22:49.746577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28228d47-bbb7-4103-a4fb-3e126769f8bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6803","nonce":3588868833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6805","nonce":3588868833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6809","nonce":3588868833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6807","nonce":3588868833}]},"public_addr":"172.21.15.1:6803/3588868833","cluster_addr":"172.21.15.1:6805/3588868833","heartbeat_back_addr":"172.21.15.1:6809/3588868833","heartbeat_front_addr":"172.21.15.1:6807/3588868833","state":["exists","up"]},{"osd":1,"uuid":"d90dd2c1-2047-4491-8730-30793a354aa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6801","nonce":3951165354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6803","nonce":3951165354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6807","nonce":3951165354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6805","nonce":3951165354}]},"public_addr":"172.21.15.12:6801/3951165354","cluster_addr":"172.21.15.12:6803/3951165354","heartbeat_back_addr":"172.21.15.12:6807/3951165354","heartbeat_front_addr":"172.21.15.12:6805/3951165354","state":["exists","up"]},{"osd":2,"uuid":"22e38f44-88d3-4461-a57e-6dc4857ec48f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6801","nonce":1633982971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6803","nonce":1633982971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6807","nonce":1633982971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6805","nonce":1633982971}]},"public_addr":"172.21.15.98:6801/1633982971","cluster_addr":"172.21.15.98:6803/1633982971","heartbeat_back_addr":"172.21.15.98:6807/1633982971","heartbeat_front_addr":"172.21.15.98:6805/1633982971","state":["exists","up"]},{"osd":3,"uuid":"dd9d6e97-af81-442a-ac0d-543e440a8d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6811","nonce":3706738461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6813","nonce":3706738461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6817","nonce":3706738461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6815","nonce":3706738461}]},"public_addr":"172.21.15.1:6811/3706738461","cluster_addr":"172.21.15.1:6813/3706738461","heartbeat_back_addr":"172.21.15.1:6817/3706738461","heartbeat_front_addr":"172.21.15.1:6815/3706738461","state":["exists","up"]},{"osd":4,"uuid":"50116baa-dd99-4dbb-a7a1-2268f04052f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6809","nonce":4057902964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6811","nonce":4057902964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6815","nonce":4057902964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6813","nonce":4057902964}]},"public_addr":"172.21.15.12:6809/4057902964","cluster_addr":"172.21.15.12:6811/4057902964","heartbeat_back_addr":"172.21.15.12:6815/4057902964","heartbeat_front_addr":"172.21.15.12:6813/4057902964","state":["exists","up"]},{"osd":5,"uuid":"56ab0694-2f21-46c4-a086-44f72c271c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6809","nonce":4043567619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6811","nonce":4043567619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6815","nonce":4043567619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6813","nonce":4043567619}]},"public_addr":"172.21.15.98:6809/4043567619","cluster_addr":"172.21.15.98:6811/4043567619","heartbeat_back_addr":"172.21.15.98:6815/4043567619","heartbeat_front_addr":"172.21.15.98:6813/4043567619","state":["exists","up"]},{"osd":6,"uuid":"5ca0d114-4894-428e-bcd3-2ebd24d10a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6819","nonce":2236861161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6821","nonce":2236861161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6825","nonce":2236861161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6823","nonce":2236861161}]},"public_addr":"172.21.15.1:6819/2236861161","cluster_addr":"172.21.15.1:6821/2236861161","heartbeat_back_addr":"172.21.15.1:6825/2236861161","heartbeat_front_addr":"172.21.15.1:6823/2236861161","state":["exists","up"]},{"osd":7,"uuid":"db99cc6e-1717-4958-bf11-65aca94476b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6817","nonce":133202448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6819","nonce":133202448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6823","nonce":133202448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6821","nonce":133202448}]},"public_addr":"172.21.15.12:6817/133202448","cluster_addr":"172.21.15.12:6819/133202448","heartbeat_back_addr":"172.21.15.12:6823/133202448","heartbeat_front_addr":"172.21.15.12:6821/133202448","state":["exists","up"]},{"osd":8,"uuid":"4d3b6574-49f7-47f6-b36b-4da14ca290f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6817","nonce":3701478409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6819","nonce":3701478409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6823","nonce":3701478409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6821","nonce":3701478409}]},"public_addr":"172.21.15.98:6817/3701478409","cluster_addr":"172.21.15.98:6819/3701478409","heartbeat_back_addr":"172.21.15.98:6823/3701478409","heartbeat_front_addr":"172.21.15.98:6821/3701478409","state":["exists","up"]},{"osd":9,"uuid":"7dd2fe25-1b75-48e5-86c7-c7a3ab85053f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6827","nonce":2580755002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6829","nonce":2580755002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6833","nonce":2580755002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6831","nonce":2580755002}]},"public_addr":"172.21.15.1:6827/2580755002","cluster_addr":"172.21.15.1:6829/2580755002","heartbeat_back_addr":"172.21.15.1:6833/2580755002","heartbeat_front_addr":"172.21.15.1:6831/2580755002","state":["exists","up"]},{"osd":10,"uuid":"fcad11dc-0a1b-44a2-ac32-74100e317255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6825","nonce":3989063573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6827","nonce":3989063573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6831","nonce":3989063573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6829","nonce":3989063573}]},"public_addr":"172.21.15.12:6825/3989063573","cluster_addr":"172.21.15.12:6827/3989063573","heartbeat_back_addr":"172.21.15.12:6831/3989063573","heartbeat_front_addr":"172.21.15.12:6829/3989063573","state":["exists","up"]},{"osd":11,"uuid":"f4e717bb-586d-4fe2-9e6b-f574be4db36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6825","nonce":839956167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6827","nonce":839956167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6831","nonce":839956167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6829","nonce":839956167}]},"public_addr":"172.21.15.98:6825/839956167","cluster_addr":"172.21.15.98:6827/839956167","heartbeat_back_addr":"172.21.15.98:6831/839956167","heartbeat_front_addr":"172.21.15.98:6829/839956167","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:17:01.990618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:17:28.259003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:17:52.825080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:18:22.724038+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:18:48.383663+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:19:13.246563+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:19:42.318469+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:20:08.809160+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:20:32.628925+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:21:02.280217+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:21:27.897758+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:21:52.055015+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":1,"to":2}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6800/3145051160":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/3101438101":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/4159811089":"2024-09-16T22:15:31.433375+0000","172.21.15.1:6801/3145051160":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/2785155592":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/714180295":"2024-09-16T22:15:03.937536+0000","172.21.15.1:6801/215291238":"2024-09-16T22:15:03.937536+0000","172.21.15.1:6800/215291238":"2024-09-16T22:15:03.937536+0000","172.21.15.1:0/1842817732":"2024-09-16T22:15:03.937536+0000","172.21.15.1:0/3888009741":"2024-09-16T22:15:03.937536+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:24:48.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:48.095+0000 7efd82e00640 1 -- 172.21.15.1:0/2907484821 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7efd640a3240 msgr2=0x7efd640a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:48.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:48.095+0000 7efd82e00640 1 --2- 172.21.15.1:0/2907484821 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7efd640a3240 0x7efd640a5700 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efd70009fc0 tx=0x7efd70005f90 comp rx=0 tx=0).stop 2024-09-15T22:24:48.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:48.095+0000 7efd82e00640 1 -- 172.21.15.1:0/2907484821 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd7c108f60 msgr2=0x7efd7c19ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:48.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:48.095+0000 7efd82e00640 1 --2- 172.21.15.1:0/2907484821 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd7c108f60 0x7efd7c19ed60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efd7400eb10 tx=0x7efd7400c2d0 comp rx=0 tx=0).stop 2024-09-15T22:24:48.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:48.095+0000 7efd82e00640 1 -- 172.21.15.1:0/2907484821 shutdown_connections 2024-09-15T22:24:48.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:48.095+0000 7efd82e00640 1 --2- 172.21.15.1:0/2907484821 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7efd640a3240 0x7efd640a5700 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:48.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:48.095+0000 7efd82e00640 1 --2- 172.21.15.1:0/2907484821 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd7c108f60 0x7efd7c19ed60 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:48.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:48.095+0000 7efd82e00640 1 --2- 172.21.15.1:0/2907484821 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd7c1047e0 0x7efd7c19a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:48.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:48.095+0000 7efd82e00640 1 --2- 172.21.15.1:0/2907484821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd7c103e30 0x7efd7c19a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:48.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:48.095+0000 7efd82e00640 1 -- 172.21.15.1:0/2907484821 >> 172.21.15.1:0/2907484821 conn(0x7efd7c0ff8d0 msgr2=0x7efd7c100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:48.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:48.095+0000 7efd82e00640 1 -- 172.21.15.1:0/2907484821 shutdown_connections 2024-09-15T22:24:48.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:48.095+0000 7efd82e00640 1 -- 172.21.15.1:0/2907484821 wait complete. 2024-09-15T22:24:48.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:48 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/2907484821' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:24:48.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:48 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/2907484821' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:24:48.872 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:48 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/2907484821' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:24:48.910 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-15T22:22:51.743282+0000', 'modified': '2024-09-15T22:23:06.984789+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24538, 'mds_1': 24524, 'mds_2': 24520}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24466': {'gid': 24466, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.98:6833/94050093', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6832', 'nonce': 94050093}, {'type': 'v1', 'addr': '172.21.15.98:6833', 'nonce': 94050093}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24482': {'gid': 24482, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.12:6837/2378138381', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6836', 'nonce': 2378138381}, {'type': 'v1', 'addr': '172.21.15.12:6837', 'nonce': 2378138381}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24514': {'gid': 24514, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.98:6835/1848806705', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6834', 'nonce': 1848806705}, {'type': 'v1', 'addr': '172.21.15.98:6835', 'nonce': 1848806705}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24520': {'gid': 24520, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.98:6837/493594054', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6836', 'nonce': 493594054}, {'type': 'v1', 'addr': '172.21.15.98:6837', 'nonce': 493594054}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24524': {'gid': 24524, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.12:6839/1469511155', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6838', 'nonce': 1469511155}, {'type': 'v1', 'addr': '172.21.15.12:6839', 'nonce': 1469511155}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24538': {'gid': 24538, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.98:6839/2831161859', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6838', 'nonce': 2831161859}, {'type': 'v1', 'addr': '172.21.15.98:6839', 'nonce': 2831161859}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24538, 'qdb_cluster': [24538, 24524, 24520]} 2024-09-15T22:24:48.910 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-15T22:24:48.910 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-15T22:24:49.290 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:49.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:49 smithi012 ceph-mon[34883]: pgmap v354: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-15T22:24:49.786 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:49 smithi001 ceph-mon[30843]: pgmap v354: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-15T22:24:49.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:49 smithi098 ceph-mon[35514]: pgmap v354: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-15T22:24:49.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.897+0000 7f547b800640 1 -- 172.21.15.1:0/3884575163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5474109120 msgr2=0x7f5474110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:49.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.897+0000 7f547b800640 1 --2- 172.21.15.1:0/3884575163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5474109120 0x7f5474110ca0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f546c009ca0 tx=0x7f546c02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.897+0000 7f547b800640 1 -- 172.21.15.1:0/3884575163 shutdown_connections 2024-09-15T22:24:49.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.897+0000 7f547b800640 1 --2- 172.21.15.1:0/3884575163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5474109120 0x7f5474110ca0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.897+0000 7f547b800640 1 --2- 172.21.15.1:0/3884575163 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54741049a0 0x7f54741089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.897+0000 7f547b800640 1 --2- 172.21.15.1:0/3884575163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5474103ff0 0x7f54741043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.897+0000 7f547b800640 1 -- 172.21.15.1:0/3884575163 >> 172.21.15.1:0/3884575163 conn(0x7f54740ffa90 msgr2=0x7f5474101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:49.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.897+0000 7f547b800640 1 -- 172.21.15.1:0/3884575163 shutdown_connections 2024-09-15T22:24:49.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.897+0000 7f547b800640 1 -- 172.21.15.1:0/3884575163 wait complete. 2024-09-15T22:24:49.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.898+0000 7f547b800640 1 Processor -- start 2024-09-15T22:24:49.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.898+0000 7f547b800640 1 -- start start 2024-09-15T22:24:49.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.899+0000 7f547b800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5474103ff0 0x7f547419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:49.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.899+0000 7f547b800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54741049a0 0x7f547419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:49.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.899+0000 7f547b800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5474109120 0x7f547419eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:49.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.899+0000 7f547b800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5474114150 con 0x7f5474109120 2024-09-15T22:24:49.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.899+0000 7f547b800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5474113fd0 con 0x7f5474103ff0 2024-09-15T22:24:49.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.899+0000 7f547b800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f54741142d0 con 0x7f54741049a0 2024-09-15T22:24:49.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.899+0000 7f5479800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5474109120 0x7f547419eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:49.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.899+0000 7f5479800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5474109120 0x7f547419eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43012/0 (socket says 172.21.15.1:43012) 2024-09-15T22:24:49.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.899+0000 7f5479800640 1 -- 172.21.15.1:0/3402894302 learned_addr learned my addr 172.21.15.1:0/3402894302 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:49.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.899+0000 7f5478e00640 1 --2- 172.21.15.1:0/3402894302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5474103ff0 0x7f547419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:49.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.899+0000 7f546be00640 1 --2- 172.21.15.1:0/3402894302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54741049a0 0x7f547419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:49.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.899+0000 7f5478e00640 1 -- 172.21.15.1:0/3402894302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54741049a0 msgr2=0x7f547419ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:49.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.899+0000 7f5478e00640 1 --2- 172.21.15.1:0/3402894302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54741049a0 0x7f547419ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.899+0000 7f5478e00640 1 -- 172.21.15.1:0/3402894302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5474109120 msgr2=0x7f547419eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:49.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.899+0000 7f5478e00640 1 --2- 172.21.15.1:0/3402894302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5474109120 0x7f547419eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.900+0000 7f5478e00640 1 -- 172.21.15.1:0/3402894302 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f547419f5a0 con 0x7f5474103ff0 2024-09-15T22:24:49.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.900+0000 7f5479800640 1 --2- 172.21.15.1:0/3402894302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5474109120 0x7f547419eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:49.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.900+0000 7f5478e00640 1 --2- 172.21.15.1:0/3402894302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5474103ff0 0x7f547419a5f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f546400e9f0 tx=0x7f546400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:49.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.900+0000 7f5472000640 1 -- 172.21.15.1:0/3402894302 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546400ccc0 con 0x7f5474103ff0 2024-09-15T22:24:49.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.900+0000 7f547b800640 1 -- 172.21.15.1:0/3402894302 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f547419f890 con 0x7f5474103ff0 2024-09-15T22:24:49.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.900+0000 7f5472000640 1 -- 172.21.15.1:0/3402894302 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5464010910 con 0x7f5474103ff0 2024-09-15T22:24:49.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.900+0000 7f5472000640 1 -- 172.21.15.1:0/3402894302 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5464018960 con 0x7f5474103ff0 2024-09-15T22:24:49.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.900+0000 7f547b800640 1 -- 172.21.15.1:0/3402894302 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54741a7170 con 0x7f5474103ff0 2024-09-15T22:24:49.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.903+0000 7f547e1ea740 1 Processor -- start 2024-09-15T22:24:49.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.903+0000 7f547e1ea740 1 -- start start 2024-09-15T22:24:49.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.903+0000 7f5472000640 1 -- 172.21.15.1:0/3402894302 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f5464010ac0 con 0x7f5474103ff0 2024-09-15T22:24:49.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.904+0000 7f547e1ea740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d573d8330 0x564d573d8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:49.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.904+0000 7f547e1ea740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d573d8c50 0x564d573e2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:49.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.904+0000 7f547e1ea740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564d573e3510 0x564d573e5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:49.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.904+0000 7f547e1ea740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564d5733e0b0 con 0x564d573e3510 2024-09-15T22:24:49.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.904+0000 7f547e1ea740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564d572e5ab0 con 0x564d573d8c50 2024-09-15T22:24:49.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.904+0000 7f547e1ea740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564d5733a070 con 0x564d573d8330 2024-09-15T22:24:49.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.904+0000 7f546be00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564d573e3510 0x564d573e5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:49.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.904+0000 7f5479800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d573d8330 0x564d573d8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:49.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.904+0000 7f5479800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d573d8330 0x564d573d8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:43314/0 (socket says 172.21.15.1:43314) 2024-09-15T22:24:49.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.904+0000 7f5479800640 1 -- 172.21.15.1:0/2076783602 learned_addr learned my addr 172.21.15.1:0/2076783602 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:49.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.904+0000 7f5478e00640 1 --2- 172.21.15.1:0/2076783602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d573d8c50 0x564d573e2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:49.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.905+0000 7f5479800640 1 -- 172.21.15.1:0/2076783602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d573d8c50 msgr2=0x564d573e2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:49.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.905+0000 7f5479800640 1 --2- 172.21.15.1:0/2076783602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d573d8c50 0x564d573e2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.905+0000 7f5479800640 1 -- 172.21.15.1:0/2076783602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564d573e3510 msgr2=0x564d573e5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:49.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.905+0000 7f5479800640 1 --2- 172.21.15.1:0/2076783602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564d573e3510 0x564d573e5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.905+0000 7f5479800640 1 -- 172.21.15.1:0/2076783602 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d572f24a0 con 0x564d573d8330 2024-09-15T22:24:49.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.905+0000 7f5479800640 1 --2- 172.21.15.1:0/2076783602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d573d8330 0x564d573d8710 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f546c031f80 tx=0x7f546c005f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7313d3f0695a9e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:49.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.905+0000 7f5472000640 1 --2- 172.21.15.1:0/3402894302 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f54580a3240 0x7f54580a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:49.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.905+0000 7f546a000640 1 -- 172.21.15.1:0/2076783602 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c003b70 con 0x564d573d8330 2024-09-15T22:24:49.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.905+0000 7f546a000640 1 -- 172.21.15.1:0/2076783602 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f546c036040 con 0x564d573d8330 2024-09-15T22:24:49.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.905+0000 7f546a000640 1 -- 172.21.15.1:0/2076783602 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c004650 con 0x564d573d8330 2024-09-15T22:24:49.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.905+0000 7f5472000640 1 -- 172.21.15.1:0/3402894302 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f54640cfd00 con 0x7f5474103ff0 2024-09-15T22:24:49.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.906+0000 7f5478e00640 1 --2- 172.21.15.1:0/3402894302 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f54580a3240 0x7f54580a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:49.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.906+0000 7f547e1ea740 1 -- 172.21.15.1:0/2076783602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d573d8330 msgr2=0x564d573d8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:49.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.906+0000 7f547e1ea740 1 --2- 172.21.15.1:0/2076783602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d573d8330 0x564d573d8710 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f546c031f80 tx=0x7f546c005f70 comp rx=0 tx=0).stop 2024-09-15T22:24:49.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.906+0000 7f5478e00640 1 --2- 172.21.15.1:0/3402894302 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f54580a3240 0x7f54580a5700 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f546409c300 tx=0x7f54640d37d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:49.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.906+0000 7f547e1ea740 1 -- 172.21.15.1:0/2076783602 shutdown_connections 2024-09-15T22:24:49.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.906+0000 7f547e1ea740 1 --2- 172.21.15.1:0/2076783602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564d573e3510 0x564d573e5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.906+0000 7f547e1ea740 1 --2- 172.21.15.1:0/2076783602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d573d8c50 0x564d573e2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.906+0000 7f547e1ea740 1 --2- 172.21.15.1:0/2076783602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d573d8330 0x564d573d8710 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.906+0000 7f547e1ea740 1 -- 172.21.15.1:0/2076783602 >> 172.21.15.1:0/2076783602 conn(0x564d573d48c0 msgr2=0x564d573d4ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:49.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.906+0000 7f547e1ea740 1 -- 172.21.15.1:0/2076783602 shutdown_connections 2024-09-15T22:24:49.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.906+0000 7f547e1ea740 1 -- 172.21.15.1:0/2076783602 wait complete. 2024-09-15T22:24:49.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.907+0000 7f547e1ea740 1 -- start start 2024-09-15T22:24:49.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.907+0000 7f547e1ea740 1 Processor -- start 2024-09-15T22:24:49.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.907+0000 7f547e1ea740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d573d8330 0x564d573e04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:49.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.907+0000 7f547e1ea740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d573d8c50 0x564d573e0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:49.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.907+0000 7f547e1ea740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564d573e3510 0x564d573e0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:49.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.907+0000 7f547e1ea740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564d573e6000 con 0x564d573e3510 2024-09-15T22:24:49.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.907+0000 7f547e1ea740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564d572c6920 con 0x564d573d8330 2024-09-15T22:24:49.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.907+0000 7f547e1ea740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564d573e6180 con 0x564d573d8c50 2024-09-15T22:24:49.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.907+0000 7f547e1ea740 10 client.0 _ll_register_callbacks cb 0x564d572ea8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:24:49.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.908+0000 7f5479800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d573d8330 0x564d573e04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:49.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.908+0000 7f5479800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564d573e3510 0x564d573e0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:49.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.908+0000 7f546be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d573d8c50 0x564d573e0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:49.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.908+0000 7f5479800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564d573e3510 0x564d573e0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43022/0 (socket says 172.21.15.1:43022) 2024-09-15T22:24:49.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.908+0000 7f5479800640 1 -- 172.21.15.1:0/349005677 learned_addr learned my addr 172.21.15.1:0/349005677 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:49.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.908+0000 7f5479800640 1 -- 172.21.15.1:0/349005677 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d573d8c50 msgr2=0x564d573e0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:49.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.908+0000 7f5479800640 1 --2- 172.21.15.1:0/349005677 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d573d8c50 0x564d573e0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.908+0000 7f5479800640 1 -- 172.21.15.1:0/349005677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d573d8330 msgr2=0x564d573e04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:49.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.908+0000 7f5479800640 1 --2- 172.21.15.1:0/349005677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d573d8330 0x564d573e04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.908+0000 7f5479800640 1 -- 172.21.15.1:0/349005677 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d570af2b0 con 0x564d573e3510 2024-09-15T22:24:49.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.908+0000 7f5479800640 1 --2- 172.21.15.1:0/349005677 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564d573e3510 0x564d573e0f40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f546c003ed0 tx=0x7f546c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=587c8500cc0f56a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:49.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.908+0000 7f5462a00640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-15T22:24:49.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.909+0000 7f5462a00640 1 -- 172.21.15.1:0/349005677 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c031650 con 0x564d573e3510 2024-09-15T22:24:49.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.909+0000 7f5462a00640 1 -- 172.21.15.1:0/349005677 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f546c0317f0 con 0x564d573e3510 2024-09-15T22:24:49.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.909+0000 7f547e1ea740 1 -- 172.21.15.1:0/349005677 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f546c036040 con 0x564d573e3510 2024-09-15T22:24:49.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.909+0000 7f5462a00640 1 -- 172.21.15.1:0/349005677 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f546c004b40 con 0x564d573e3510 2024-09-15T22:24:49.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.909+0000 7f547e1ea740 10 client.15006 fetch_fsmap learned FSMap version 25 2024-09-15T22:24:49.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.909+0000 7f547e1ea740 1 -- 172.21.15.1:0/349005677 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564d573e6000 con 0x564d573e3510 2024-09-15T22:24:49.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.910+0000 7f5462a00640 1 -- 172.21.15.1:0/349005677 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f546c036040 con 0x564d573e3510 2024-09-15T22:24:49.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.910+0000 7f5462a00640 1 -- 172.21.15.1:0/349005677 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f546c043070 con 0x564d573e3510 2024-09-15T22:24:49.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.910+0000 7f547e1ea740 10 client.15006 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:24:49.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.910+0000 7f547e1ea740 10 client.15006 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T22:24:49.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.910+0000 7f547e1ea740 20 client.15006 populate_metadata read hostname 'smithi001' 2024-09-15T22:24:49.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.910+0000 7f547e1ea740 1 --2- 172.21.15.1:0/349005677 >> [v2:172.21.15.98:6836/493594054,v1:172.21.15.98:6837/493594054] conn(0x564d573f3f50 0x564d573f53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:49.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.910+0000 7f547e1ea740 4 client.15006 mds_command: new command op to 24520 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:24:49.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.910+0000 7f547e1ea740 1 -- 172.21.15.1:0/349005677 --> [v2:172.21.15.98:6836/493594054,v1:172.21.15.98:6837/493594054] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d5734b620 con 0x564d573f3f50 2024-09-15T22:24:49.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.910+0000 7f546be00640 1 --2- 172.21.15.1:0/349005677 >> [v2:172.21.15.98:6836/493594054,v1:172.21.15.98:6837/493594054] conn(0x564d573f3f50 0x564d573f53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:49.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.911+0000 7f546be00640 1 --2- 172.21.15.1:0/349005677 >> [v2:172.21.15.98:6836/493594054,v1:172.21.15.98:6837/493594054] conn(0x564d573f3f50 0x564d573f53c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4eee8ffae4a5f11 server_cookie=2ef0631e9435f5c3 in_seq=0 out_seq=0 2024-09-15T22:24:49.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.911+0000 7f5462a00640 10 client.15006 ms_handle_connect on v2:172.21.15.98:6836/493594054 2024-09-15T22:24:49.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.912+0000 7f5462a00640 1 -- 172.21.15.1:0/349005677 <== mds.2 v2:172.21.15.98:6836/493594054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564d5734b620 con 0x564d573f3f50 2024-09-15T22:24:49.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.912+0000 7f5462a00640 10 client.15006 handle_command_reply: tid=0 2024-09-15T22:24:49.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.912+0000 7f547e1ea740 1 client.15006 shutdown 2024-09-15T22:24:49.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.912+0000 7f547e1ea740 1 -- 172.21.15.1:0/349005677 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564d573e3510 msgr2=0x564d573e0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:49.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.912+0000 7f547e1ea740 1 --2- 172.21.15.1:0/349005677 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564d573e3510 0x564d573e0f40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f546c003ed0 tx=0x7f546c02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.912+0000 7f547e1ea740 1 -- 172.21.15.1:0/349005677 shutdown_connections 2024-09-15T22:24:49.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.912+0000 7f547e1ea740 1 --2- 172.21.15.1:0/349005677 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564d573e3510 0x564d573e0f40 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.912+0000 7f547e1ea740 1 --2- 172.21.15.1:0/349005677 >> [v2:172.21.15.98:6836/493594054,v1:172.21.15.98:6837/493594054] conn(0x564d573f3f50 0x564d573f53c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.912+0000 7f547e1ea740 1 --2- 172.21.15.1:0/349005677 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d573d8c50 0x564d573e0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.912+0000 7f547e1ea740 1 --2- 172.21.15.1:0/349005677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d573d8330 0x564d573e04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.912+0000 7f547e1ea740 1 -- 172.21.15.1:0/349005677 >> 172.21.15.1:0/349005677 conn(0x564d573d48c0 msgr2=0x564d573da5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:49.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.912+0000 7f5462a00640 0 client.15006 ms_handle_reset on v2:172.21.15.98:6836/493594054 2024-09-15T22:24:49.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.912+0000 7f547e1ea740 1 -- 172.21.15.1:0/349005677 shutdown_connections 2024-09-15T22:24:49.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.912+0000 7f547e1ea740 1 -- 172.21.15.1:0/349005677 wait complete. 2024-09-15T22:24:49.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.913+0000 7f547e1ea740 20 client.15006 trim_cache size 0 max 16384 2024-09-15T22:24:49.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.932+0000 7f547e1ea740 1 Processor -- start 2024-09-15T22:24:49.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.932+0000 7f547e1ea740 1 -- start start 2024-09-15T22:24:49.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.932+0000 7f547e1ea740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d573d8330 0x564d573dd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:49.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.932+0000 7f547e1ea740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564d573d8c50 0x564d573ddc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:49.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.932+0000 7f547e1ea740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d573e3510 0x564d573e0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:49.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.932+0000 7f547e1ea740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564d573f3700 con 0x564d573d8c50 2024-09-15T22:24:49.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.932+0000 7f547e1ea740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564d573f3dd0 con 0x564d573e3510 2024-09-15T22:24:49.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.932+0000 7f547e1ea740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564d573f44a0 con 0x564d573d8330 2024-09-15T22:24:49.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.932+0000 7f546be00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564d573d8c50 0x564d573ddc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:49.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.932+0000 7f546be00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564d573d8c50 0x564d573ddc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43034/0 (socket says 172.21.15.1:43034) 2024-09-15T22:24:49.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.932+0000 7f546be00640 1 -- 172.21.15.1:0/1039057310 learned_addr learned my addr 172.21.15.1:0/1039057310 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:49.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.932+0000 7f5479800640 1 --2- 172.21.15.1:0/1039057310 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d573d8330 0x564d573dd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:49.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.933+0000 7f5479800640 1 --2- 172.21.15.1:0/1039057310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d573e3510 0x564d573e0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:49.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.933+0000 7f546be00640 1 -- 172.21.15.1:0/1039057310 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d573d8330 msgr2=0x564d573dd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:49.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.933+0000 7f546be00640 1 --2- 172.21.15.1:0/1039057310 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d573d8330 0x564d573dd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.933+0000 7f546be00640 1 -- 172.21.15.1:0/1039057310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d573e3510 msgr2=0x564d573e0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:49.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.933+0000 7f546be00640 1 --2- 172.21.15.1:0/1039057310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d573e3510 0x564d573e0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.933+0000 7f546be00640 1 -- 172.21.15.1:0/1039057310 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d573d54c0 con 0x564d573d8c50 2024-09-15T22:24:49.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.933+0000 7f546be00640 1 --2- 172.21.15.1:0/1039057310 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564d573d8c50 0x564d573ddc80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x564d573dfd50 tx=0x7f545c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84248e956789c928 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:49.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.933+0000 7f5469600640 1 -- 172.21.15.1:0/1039057310 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545c010430 con 0x564d573d8c50 2024-09-15T22:24:49.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.933+0000 7f5469600640 1 -- 172.21.15.1:0/1039057310 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f545c010ab0 con 0x564d573d8c50 2024-09-15T22:24:49.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.933+0000 7f5469600640 1 -- 172.21.15.1:0/1039057310 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545c026ad0 con 0x564d573d8c50 2024-09-15T22:24:49.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.934+0000 7f547e1ea740 1 -- 172.21.15.1:0/1039057310 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564d573d8c50 msgr2=0x564d573ddc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:49.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.934+0000 7f547e1ea740 1 --2- 172.21.15.1:0/1039057310 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564d573d8c50 0x564d573ddc80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x564d573dfd50 tx=0x7f545c005f90 comp rx=0 tx=0).stop 2024-09-15T22:24:49.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.934+0000 7f547e1ea740 1 -- 172.21.15.1:0/1039057310 shutdown_connections 2024-09-15T22:24:49.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.934+0000 7f547e1ea740 1 --2- 172.21.15.1:0/1039057310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d573e3510 0x564d573e0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.934+0000 7f547e1ea740 1 --2- 172.21.15.1:0/1039057310 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564d573d8c50 0x564d573ddc80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.934+0000 7f547e1ea740 1 --2- 172.21.15.1:0/1039057310 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d573d8330 0x564d573dd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.934+0000 7f547e1ea740 1 -- 172.21.15.1:0/1039057310 >> 172.21.15.1:0/1039057310 conn(0x564d573d48c0 msgr2=0x564d573db850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:49.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.934+0000 7f547e1ea740 1 -- 172.21.15.1:0/1039057310 shutdown_connections 2024-09-15T22:24:49.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.935+0000 7f547e1ea740 1 -- 172.21.15.1:0/1039057310 wait complete. 2024-09-15T22:24:49.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.935+0000 7f547e1ea740 1 -- start start 2024-09-15T22:24:49.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.935+0000 7f547e1ea740 1 Processor -- start 2024-09-15T22:24:49.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.935+0000 7f547e1ea740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d573d8330 0x564d573fdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:49.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.935+0000 7f547e1ea740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564d573d8c50 0x564d573dcf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:49.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.936+0000 7f547e1ea740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d573e3510 0x564d573dd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:49.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.936+0000 7f547e1ea740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564d573f5240 con 0x564d573d8c50 2024-09-15T22:24:49.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.936+0000 7f547e1ea740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564d573f4b70 con 0x564d573d8330 2024-09-15T22:24:49.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.936+0000 7f547e1ea740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564d573f5910 con 0x564d573e3510 2024-09-15T22:24:49.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.936+0000 7f547e1ea740 10 client.0 _ll_register_callbacks cb 0x7f546c003e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:24:49.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.936+0000 7f546be00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564d573d8c50 0x564d573dcf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:49.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.936+0000 7f546be00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564d573d8c50 0x564d573dcf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43040/0 (socket says 172.21.15.1:43040) 2024-09-15T22:24:49.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.936+0000 7f546be00640 1 -- 172.21.15.1:0/3749612107 learned_addr learned my addr 172.21.15.1:0/3749612107 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:49.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.936+0000 7f5479800640 1 --2- 172.21.15.1:0/3749612107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d573d8330 0x564d573fdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:49.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.936+0000 7f5479800640 1 --2- 172.21.15.1:0/3749612107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d573e3510 0x564d573dd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:49.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.936+0000 7f546be00640 1 -- 172.21.15.1:0/3749612107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d573e3510 msgr2=0x564d573dd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:49.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.936+0000 7f546be00640 1 --2- 172.21.15.1:0/3749612107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d573e3510 0x564d573dd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.936+0000 7f546be00640 1 -- 172.21.15.1:0/3749612107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d573d8330 msgr2=0x564d573fdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:49.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.936+0000 7f546be00640 1 --2- 172.21.15.1:0/3749612107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d573d8330 0x564d573fdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.936+0000 7f546be00640 1 -- 172.21.15.1:0/3749612107 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d573dda20 con 0x564d573d8c50 2024-09-15T22:24:49.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.936+0000 7f5479800640 1 --2- 172.21.15.1:0/3749612107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d573e3510 0x564d573dd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:24:49.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.937+0000 7f546be00640 1 --2- 172.21.15.1:0/3749612107 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564d573d8c50 0x564d573dcf20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f545c009be0 tx=0x7f545c009c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8685b4fd4e77189 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:49.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.937+0000 7f5462a00640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-15T22:24:49.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.937+0000 7f5462a00640 1 -- 172.21.15.1:0/3749612107 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545c026570 con 0x564d573d8c50 2024-09-15T22:24:49.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.937+0000 7f5462a00640 1 -- 172.21.15.1:0/3749612107 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f545c010430 con 0x564d573d8c50 2024-09-15T22:24:49.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.937+0000 7f547e1ea740 1 -- 172.21.15.1:0/3749612107 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f545c010ab0 con 0x564d573d8c50 2024-09-15T22:24:49.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.937+0000 7f5462a00640 1 -- 172.21.15.1:0/3749612107 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f545c038050 con 0x564d573d8c50 2024-09-15T22:24:49.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.937+0000 7f547e1ea740 10 client.15012 fetch_fsmap learned FSMap version 25 2024-09-15T22:24:49.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.937+0000 7f547e1ea740 1 -- 172.21.15.1:0/3749612107 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564d573fc450 con 0x564d573d8c50 2024-09-15T22:24:49.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.937+0000 7f5462a00640 1 -- 172.21.15.1:0/3749612107 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f545c010ab0 con 0x564d573d8c50 2024-09-15T22:24:49.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.938+0000 7f5462a00640 1 -- 172.21.15.1:0/3749612107 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f545c025030 con 0x564d573d8c50 2024-09-15T22:24:49.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.938+0000 7f547e1ea740 10 client.15012 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:24:49.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.938+0000 7f547e1ea740 10 client.15012 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T22:24:49.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.938+0000 7f547e1ea740 20 client.15012 populate_metadata read hostname 'smithi001' 2024-09-15T22:24:49.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.938+0000 7f547e1ea740 1 --2- 172.21.15.1:0/3749612107 >> [v2:172.21.15.98:6836/493594054,v1:172.21.15.98:6837/493594054] conn(0x564d57462f00 0x564d57461c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:49.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.938+0000 7f547e1ea740 4 client.15012 mds_command: new command op to 24520 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:24:49.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.938+0000 7f547e1ea740 1 -- 172.21.15.1:0/3749612107 --> [v2:172.21.15.98:6836/493594054,v1:172.21.15.98:6837/493594054] -- command(tid 0: {"prefix": "status"}) -- 0x564d57345b30 con 0x564d57462f00 2024-09-15T22:24:49.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.938+0000 7f5479800640 1 --2- 172.21.15.1:0/3749612107 >> [v2:172.21.15.98:6836/493594054,v1:172.21.15.98:6837/493594054] conn(0x564d57462f00 0x564d57461c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:49.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.939+0000 7f5479800640 1 --2- 172.21.15.1:0/3749612107 >> [v2:172.21.15.98:6836/493594054,v1:172.21.15.98:6837/493594054] conn(0x564d57462f00 0x564d57461c10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=84f72333e675db51 server_cookie=1b59551a9e5fc883 in_seq=0 out_seq=0 2024-09-15T22:24:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.939+0000 7f5462a00640 10 client.15012 ms_handle_connect on v2:172.21.15.98:6836/493594054 2024-09-15T22:24:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.939+0000 7f5462a00640 1 -- 172.21.15.1:0/3749612107 <== mds.2 v2:172.21.15.98:6836/493594054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x564d57345b30 con 0x564d57462f00 2024-09-15T22:24:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.939+0000 7f5462a00640 10 client.15012 handle_command_reply: tid=0 2024-09-15T22:24:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.939+0000 7f547e1ea740 1 client.15012 shutdown 2024-09-15T22:24:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.939+0000 7f547e1ea740 1 -- 172.21.15.1:0/3749612107 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564d573d8c50 msgr2=0x564d573dcf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.939+0000 7f547e1ea740 1 --2- 172.21.15.1:0/3749612107 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564d573d8c50 0x564d573dcf20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f545c009be0 tx=0x7f545c009c10 comp rx=0 tx=0).stop 2024-09-15T22:24:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.939+0000 7f547e1ea740 1 -- 172.21.15.1:0/3749612107 shutdown_connections 2024-09-15T22:24:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.939+0000 7f547e1ea740 1 --2- 172.21.15.1:0/3749612107 >> [v2:172.21.15.98:6836/493594054,v1:172.21.15.98:6837/493594054] conn(0x564d57462f00 0x564d57461c10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.939+0000 7f547e1ea740 1 --2- 172.21.15.1:0/3749612107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d573e3510 0x564d573dd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.939+0000 7f547e1ea740 1 --2- 172.21.15.1:0/3749612107 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564d573d8c50 0x564d573dcf20 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.939+0000 7f547e1ea740 1 --2- 172.21.15.1:0/3749612107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d573d8330 0x564d573fdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.939+0000 7f547e1ea740 1 -- 172.21.15.1:0/3749612107 >> 172.21.15.1:0/3749612107 conn(0x564d573d48c0 msgr2=0x564d573e0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.939+0000 7f5462a00640 0 client.15012 ms_handle_reset on v2:172.21.15.98:6836/493594054 2024-09-15T22:24:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.939+0000 7f547e1ea740 1 -- 172.21.15.1:0/3749612107 shutdown_connections 2024-09-15T22:24:49.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.939+0000 7f547e1ea740 1 -- 172.21.15.1:0/3749612107 wait complete. 2024-09-15T22:24:49.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.940+0000 7f547e1ea740 20 client.15012 trim_cache size 0 max 16384 2024-09-15T22:24:49.946 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-15T22:24:49.946 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "c1228c44-73af-11ef-bceb-c7b262605968", 2024-09-15T22:24:49.946 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 2, 2024-09-15T22:24:49.946 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24520, 2024-09-15T22:24:49.946 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-15T22:24:49.946 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-15T22:24:49.946 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-15T22:24:49.946 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 107.11447078099999, 2024-09-15T22:24:49.946 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 25, 2024-09-15T22:24:49.947 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 86, 2024-09-15T22:24:49.947 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 82, 2024-09-15T22:24:49.947 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 146.58048363200001 2024-09-15T22:24:49.947 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-15T22:24:49.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.940+0000 7f547b800640 1 -- 172.21.15.1:0/3402894302 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f54580a3240 msgr2=0x7f54580a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:49.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.940+0000 7f547b800640 1 --2- 172.21.15.1:0/3402894302 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f54580a3240 0x7f54580a5700 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f546409c300 tx=0x7f54640d37d0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.940+0000 7f547b800640 1 -- 172.21.15.1:0/3402894302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5474103ff0 msgr2=0x7f547419a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:49.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.940+0000 7f547b800640 1 --2- 172.21.15.1:0/3402894302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5474103ff0 0x7f547419a5f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f546400e9f0 tx=0x7f546400eeb0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.940+0000 7f547b800640 1 -- 172.21.15.1:0/3402894302 shutdown_connections 2024-09-15T22:24:49.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.940+0000 7f547b800640 1 --2- 172.21.15.1:0/3402894302 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f54580a3240 0x7f54580a5700 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.940+0000 7f547b800640 1 --2- 172.21.15.1:0/3402894302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5474109120 0x7f547419eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.940+0000 7f547b800640 1 --2- 172.21.15.1:0/3402894302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54741049a0 0x7f547419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.940+0000 7f547b800640 1 --2- 172.21.15.1:0/3402894302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5474103ff0 0x7f547419a5f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:49.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.940+0000 7f547b800640 1 -- 172.21.15.1:0/3402894302 >> 172.21.15.1:0/3402894302 conn(0x7f54740ffa90 msgr2=0x7f5474100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:49.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.940+0000 7f547b800640 1 -- 172.21.15.1:0/3402894302 shutdown_connections 2024-09-15T22:24:49.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:49.940+0000 7f547b800640 1 -- 172.21.15.1:0/3402894302 wait complete. 2024-09-15T22:24:50.702 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-15T22:24:51.080 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:51.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:51 smithi012 ceph-mon[34883]: pgmap v355: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-15T22:24:51.757 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:51 smithi001 ceph-mon[30843]: pgmap v355: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-15T22:24:51.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.754+0000 7f14f4400640 1 -- 172.21.15.1:0/3826036659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14ec106f10 msgr2=0x7f14ec10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:51.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.754+0000 7f14f4400640 1 --2- 172.21.15.1:0/3826036659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14ec106f10 0x7f14ec10ea90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f14e4009900 tx=0x7f14e402a3f0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.754+0000 7f14f4400640 1 -- 172.21.15.1:0/3826036659 shutdown_connections 2024-09-15T22:24:51.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.754+0000 7f14f4400640 1 --2- 172.21.15.1:0/3826036659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14ec106f10 0x7f14ec10ea90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.754+0000 7f14f4400640 1 --2- 172.21.15.1:0/3826036659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14ec102790 0x7f14ec1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.754+0000 7f14f4400640 1 --2- 172.21.15.1:0/3826036659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14ec101de0 0x7f14ec1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.754+0000 7f14f4400640 1 -- 172.21.15.1:0/3826036659 >> 172.21.15.1:0/3826036659 conn(0x7f14ec0fd8c0 msgr2=0x7f14ec0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:51.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.754+0000 7f14f4400640 1 -- 172.21.15.1:0/3826036659 shutdown_connections 2024-09-15T22:24:51.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.754+0000 7f14f4400640 1 -- 172.21.15.1:0/3826036659 wait complete. 2024-09-15T22:24:51.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.756+0000 7f14f4400640 1 Processor -- start 2024-09-15T22:24:51.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.756+0000 7f14f4400640 1 -- start start 2024-09-15T22:24:51.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.756+0000 7f14f4400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14ec101de0 0x7f14ec0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:51.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.756+0000 7f14f4400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14ec102790 0x7f14ec074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:51.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.756+0000 7f14f4400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14ec106f10 0x7f14ec074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:51.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.756+0000 7f14f4400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f14ec111fc0 con 0x7f14ec101de0 2024-09-15T22:24:51.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.756+0000 7f14f4400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f14ec111e40 con 0x7f14ec106f10 2024-09-15T22:24:51.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.756+0000 7f14f4400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f14ec112140 con 0x7f14ec102790 2024-09-15T22:24:51.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.757+0000 7f14f1a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14ec101de0 0x7f14ec0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:51.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.757+0000 7f14f1a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14ec101de0 0x7f14ec0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43064/0 (socket says 172.21.15.1:43064) 2024-09-15T22:24:51.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.757+0000 7f14f1a00640 1 -- 172.21.15.1:0/1057626819 learned_addr learned my addr 172.21.15.1:0/1057626819 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:51.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.757+0000 7f14f1000640 1 --2- 172.21.15.1:0/1057626819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14ec102790 0x7f14ec074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:51.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.757+0000 7f14f2400640 1 --2- 172.21.15.1:0/1057626819 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14ec106f10 0x7f14ec074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:51.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.757+0000 7f14f1a00640 1 -- 172.21.15.1:0/1057626819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14ec102790 msgr2=0x7f14ec074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:51.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.757+0000 7f14f1a00640 1 --2- 172.21.15.1:0/1057626819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14ec102790 0x7f14ec074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.757+0000 7f14f1a00640 1 -- 172.21.15.1:0/1057626819 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14ec106f10 msgr2=0x7f14ec074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:51.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.757+0000 7f14f1a00640 1 --2- 172.21.15.1:0/1057626819 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14ec106f10 0x7f14ec074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.757+0000 7f14f1a00640 1 -- 172.21.15.1:0/1057626819 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14ec1a6880 con 0x7f14ec101de0 2024-09-15T22:24:51.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.757+0000 7f14f1000640 1 --2- 172.21.15.1:0/1057626819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14ec102790 0x7f14ec074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:51.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.758+0000 7f14f1a00640 1 --2- 172.21.15.1:0/1057626819 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14ec101de0 0x7f14ec0744f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f14e000ebc0 tx=0x7f14e000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:51.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.758+0000 7f14ea000640 1 -- 172.21.15.1:0/1057626819 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e0010630 con 0x7f14ec101de0 2024-09-15T22:24:51.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.758+0000 7f14f4400640 1 -- 172.21.15.1:0/1057626819 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14ec1a6b70 con 0x7f14ec101de0 2024-09-15T22:24:51.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.758+0000 7f14f4400640 1 -- 172.21.15.1:0/1057626819 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14ec1a7100 con 0x7f14ec101de0 2024-09-15T22:24:51.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.758+0000 7f14ea000640 1 -- 172.21.15.1:0/1057626819 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14e0010cb0 con 0x7f14ec101de0 2024-09-15T22:24:51.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.758+0000 7f14ea000640 1 -- 172.21.15.1:0/1057626819 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e0018bd0 con 0x7f14ec101de0 2024-09-15T22:24:51.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.761+0000 7f14ea000640 1 -- 172.21.15.1:0/1057626819 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f14e00107d0 con 0x7f14ec101de0 2024-09-15T22:24:51.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.761+0000 7f14f6e8d740 1 Processor -- start 2024-09-15T22:24:51.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.761+0000 7f14f6e8d740 1 -- start start 2024-09-15T22:24:51.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.762+0000 7f14f6e8d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560eb1616330 0x560eb1616710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:51.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.762+0000 7f14f6e8d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb1616c50 0x560eb1620fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:51.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.762+0000 7f14f6e8d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560eb1621510 0x560eb1623900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:51.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.762+0000 7f14f6e8d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560eb157c0b0 con 0x560eb1616c50 2024-09-15T22:24:51.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.762+0000 7f14f6e8d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560eb1523ab0 con 0x560eb1621510 2024-09-15T22:24:51.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.762+0000 7f14f6e8d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560eb1578070 con 0x560eb1616330 2024-09-15T22:24:51.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.762+0000 7f14f1a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb1616c50 0x560eb1620fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:51.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.762+0000 7f14f1a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb1616c50 0x560eb1620fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43074/0 (socket says 172.21.15.1:43074) 2024-09-15T22:24:51.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.762+0000 7f14f1a00640 1 -- 172.21.15.1:0/854409476 learned_addr learned my addr 172.21.15.1:0/854409476 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:51.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.762+0000 7f14f2400640 1 --2- 172.21.15.1:0/854409476 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560eb1616330 0x560eb1616710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:51.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.762+0000 7f14f1000640 1 --2- 172.21.15.1:0/854409476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560eb1621510 0x560eb1623900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:51.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.763+0000 7f14f1a00640 1 -- 172.21.15.1:0/854409476 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560eb1616330 msgr2=0x560eb1616710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:51.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.763+0000 7f14f1a00640 1 --2- 172.21.15.1:0/854409476 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560eb1616330 0x560eb1616710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.763+0000 7f14f1a00640 1 -- 172.21.15.1:0/854409476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560eb1621510 msgr2=0x560eb1623900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:51.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.763+0000 7f14f1a00640 1 --2- 172.21.15.1:0/854409476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560eb1621510 0x560eb1623900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.763+0000 7f14ea000640 1 --2- 172.21.15.1:0/1057626819 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f14d40a32c0 0x7f14d40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:51.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.763+0000 7f14f1a00640 1 -- 172.21.15.1:0/854409476 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eb15304a0 con 0x560eb1616c50 2024-09-15T22:24:51.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.763+0000 7f14f1000640 1 --2- 172.21.15.1:0/854409476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560eb1621510 0x560eb1623900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:51.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.763+0000 7f14f2400640 1 --2- 172.21.15.1:0/1057626819 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f14d40a32c0 0x7f14d40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:51.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.763+0000 7f14ea000640 1 -- 172.21.15.1:0/1057626819 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f14e00cff70 con 0x7f14ec101de0 2024-09-15T22:24:51.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.763+0000 7f14f1a00640 1 --2- 172.21.15.1:0/854409476 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb1616c50 0x560eb1620fd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f14e00ad690 tx=0x7f14e00d84e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=812a47c378f3d766 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:51.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.763+0000 7f14dea00640 1 -- 172.21.15.1:0/854409476 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e0010e60 con 0x560eb1616c50 2024-09-15T22:24:51.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.764+0000 7f14dea00640 1 -- 172.21.15.1:0/854409476 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14e009c580 con 0x560eb1616c50 2024-09-15T22:24:51.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.764+0000 7f14dea00640 1 -- 172.21.15.1:0/854409476 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e0026030 con 0x560eb1616c50 2024-09-15T22:24:51.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.764+0000 7f14f6e8d740 1 -- 172.21.15.1:0/854409476 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb1616c50 msgr2=0x560eb1620fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:51.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.764+0000 7f14f6e8d740 1 --2- 172.21.15.1:0/854409476 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb1616c50 0x560eb1620fd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f14e00ad690 tx=0x7f14e00d84e0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.764+0000 7f14f2400640 1 --2- 172.21.15.1:0/1057626819 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f14d40a32c0 0x7f14d40a5780 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f14e4031550 tx=0x7f14e40046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:51.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.764+0000 7f14f6e8d740 1 -- 172.21.15.1:0/854409476 shutdown_connections 2024-09-15T22:24:51.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.764+0000 7f14f6e8d740 1 --2- 172.21.15.1:0/854409476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560eb1621510 0x560eb1623900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.764+0000 7f14f6e8d740 1 --2- 172.21.15.1:0/854409476 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb1616c50 0x560eb1620fd0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.764+0000 7f14f6e8d740 1 --2- 172.21.15.1:0/854409476 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560eb1616330 0x560eb1616710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.765+0000 7f14f6e8d740 1 -- 172.21.15.1:0/854409476 >> 172.21.15.1:0/854409476 conn(0x560eb16128c0 msgr2=0x560eb1612ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:51.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.765+0000 7f14f6e8d740 1 -- 172.21.15.1:0/854409476 shutdown_connections 2024-09-15T22:24:51.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.765+0000 7f14f6e8d740 1 -- 172.21.15.1:0/854409476 wait complete. 2024-09-15T22:24:51.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.765+0000 7f14f6e8d740 1 -- start start 2024-09-15T22:24:51.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.765+0000 7f14f6e8d740 1 Processor -- start 2024-09-15T22:24:51.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.766+0000 7f14f6e8d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560eb1616330 0x560eb161e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:51.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.766+0000 7f14f6e8d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb1616c50 0x560eb161eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:51.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.766+0000 7f14f6e8d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560eb1621510 0x560eb161f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:51.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.766+0000 7f14f6e8d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560eb1624060 con 0x560eb1616c50 2024-09-15T22:24:51.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.766+0000 7f14f6e8d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560eb1504920 con 0x560eb1621510 2024-09-15T22:24:51.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.766+0000 7f14f6e8d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560eb16241e0 con 0x560eb1616330 2024-09-15T22:24:51.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.766+0000 7f14f6e8d740 10 client.0 _ll_register_callbacks cb 0x560eb15288a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:24:51.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.766+0000 7f14f1000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb1616c50 0x560eb161eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:51.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.766+0000 7f14f2400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560eb1621510 0x560eb161f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:51.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.766+0000 7f14f1000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb1616c50 0x560eb161eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43084/0 (socket says 172.21.15.1:43084) 2024-09-15T22:24:51.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.766+0000 7f14f1000640 1 -- 172.21.15.1:0/1763073345 learned_addr learned my addr 172.21.15.1:0/1763073345 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:51.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.766+0000 7f14f1a00640 1 --2- 172.21.15.1:0/1763073345 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560eb1616330 0x560eb161e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:51.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.767+0000 7f14f1000640 1 -- 172.21.15.1:0/1763073345 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560eb1616330 msgr2=0x560eb161e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:51.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.767+0000 7f14f1000640 1 --2- 172.21.15.1:0/1763073345 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560eb1616330 0x560eb161e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.767+0000 7f14f1000640 1 -- 172.21.15.1:0/1763073345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560eb1621510 msgr2=0x560eb161f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:51.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.767+0000 7f14f1000640 1 --2- 172.21.15.1:0/1763073345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560eb1621510 0x560eb161f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.767+0000 7f14f1000640 1 -- 172.21.15.1:0/1763073345 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560eb12ed2b0 con 0x560eb1616c50 2024-09-15T22:24:51.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.767+0000 7f14f1000640 1 --2- 172.21.15.1:0/1763073345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb1616c50 0x560eb161eaf0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f14d8012d20 tx=0x7f14d800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f772f29b5bb3e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:51.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.767+0000 7f14d3400640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-15T22:24:51.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.767+0000 7f14d3400640 1 -- 172.21.15.1:0/1763073345 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d80120d0 con 0x560eb1616c50 2024-09-15T22:24:51.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.767+0000 7f14f6e8d740 1 -- 172.21.15.1:0/1763073345 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560eb1589620 con 0x560eb1616c50 2024-09-15T22:24:51.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.767+0000 7f14d3400640 1 -- 172.21.15.1:0/1763073345 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f14d8010430 con 0x560eb1616c50 2024-09-15T22:24:51.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.767+0000 7f14d3400640 1 -- 172.21.15.1:0/1763073345 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f14d8012270 con 0x560eb1616c50 2024-09-15T22:24:51.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.767+0000 7f14f6e8d740 10 client.15024 fetch_fsmap learned FSMap version 25 2024-09-15T22:24:51.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.768+0000 7f14f6e8d740 1 -- 172.21.15.1:0/1763073345 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560eb162ff40 con 0x560eb1616c50 2024-09-15T22:24:51.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.768+0000 7f14d3400640 1 -- 172.21.15.1:0/1763073345 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x560eb1589620 con 0x560eb1616c50 2024-09-15T22:24:51.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.768+0000 7f14d3400640 1 -- 172.21.15.1:0/1763073345 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f14d8024020 con 0x560eb1616c50 2024-09-15T22:24:51.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.768+0000 7f14f6e8d740 10 client.15024 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:24:51.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.768+0000 7f14f6e8d740 10 client.15024 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:24:51.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.768+0000 7f14f6e8d740 20 client.15024 populate_metadata read hostname 'smithi001' 2024-09-15T22:24:51.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.768+0000 7f14f6e8d740 1 --2- 172.21.15.1:0/1763073345 >> [v2:172.21.15.12:6838/1469511155,v1:172.21.15.12:6839/1469511155] conn(0x560eb1632590 0x560eb1633a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:51.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.768+0000 7f14f6e8d740 4 client.15024 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:24:51.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.768+0000 7f14f6e8d740 1 -- 172.21.15.1:0/1763073345 --> [v2:172.21.15.12:6838/1469511155,v1:172.21.15.12:6839/1469511155] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560eb1583b30 con 0x560eb1632590 2024-09-15T22:24:51.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.769+0000 7f14f1a00640 1 --2- 172.21.15.1:0/1763073345 >> [v2:172.21.15.12:6838/1469511155,v1:172.21.15.12:6839/1469511155] conn(0x560eb1632590 0x560eb1633a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:51.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.769+0000 7f14f1a00640 1 --2- 172.21.15.1:0/1763073345 >> [v2:172.21.15.12:6838/1469511155,v1:172.21.15.12:6839/1469511155] conn(0x560eb1632590 0x560eb1633a00 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2b1646875a88692a server_cookie=91b27a40722ac66 in_seq=0 out_seq=0 2024-09-15T22:24:51.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.769+0000 7f14d3400640 10 client.15024 ms_handle_connect on v2:172.21.15.12:6838/1469511155 2024-09-15T22:24:51.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.770+0000 7f14d3400640 1 -- 172.21.15.1:0/1763073345 <== mds.1 v2:172.21.15.12:6838/1469511155 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560eb1583b30 con 0x560eb1632590 2024-09-15T22:24:51.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.770+0000 7f14d3400640 10 client.15024 handle_command_reply: tid=0 2024-09-15T22:24:51.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.770+0000 7f14f6e8d740 1 client.15024 shutdown 2024-09-15T22:24:51.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.770+0000 7f14f6e8d740 1 -- 172.21.15.1:0/1763073345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb1616c50 msgr2=0x560eb161eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:51.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.770+0000 7f14f6e8d740 1 --2- 172.21.15.1:0/1763073345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb1616c50 0x560eb161eaf0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f14d8012d20 tx=0x7f14d800f790 comp rx=0 tx=0).stop 2024-09-15T22:24:51.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.770+0000 7f14f6e8d740 1 -- 172.21.15.1:0/1763073345 shutdown_connections 2024-09-15T22:24:51.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.770+0000 7f14f6e8d740 1 --2- 172.21.15.1:0/1763073345 >> [v2:172.21.15.12:6838/1469511155,v1:172.21.15.12:6839/1469511155] conn(0x560eb1632590 0x560eb1633a00 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.770+0000 7f14f6e8d740 1 --2- 172.21.15.1:0/1763073345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560eb1621510 0x560eb161f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.770+0000 7f14f6e8d740 1 --2- 172.21.15.1:0/1763073345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb1616c50 0x560eb161eaf0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.770+0000 7f14f6e8d740 1 --2- 172.21.15.1:0/1763073345 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560eb1616330 0x560eb161e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.770+0000 7f14f6e8d740 1 -- 172.21.15.1:0/1763073345 >> 172.21.15.1:0/1763073345 conn(0x560eb16128c0 msgr2=0x560eb16185a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:51.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.770+0000 7f14d3400640 0 client.15024 ms_handle_reset on v2:172.21.15.12:6838/1469511155 2024-09-15T22:24:51.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.770+0000 7f14f6e8d740 1 -- 172.21.15.1:0/1763073345 shutdown_connections 2024-09-15T22:24:51.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.770+0000 7f14f6e8d740 1 -- 172.21.15.1:0/1763073345 wait complete. 2024-09-15T22:24:51.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.771+0000 7f14f6e8d740 20 client.15024 trim_cache size 0 max 16384 2024-09-15T22:24:51.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.789+0000 7f14f6e8d740 1 Processor -- start 2024-09-15T22:24:51.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.789+0000 7f14f6e8d740 1 -- start start 2024-09-15T22:24:51.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.790+0000 7f14f6e8d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560eb1616330 0x560eb1633a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:51.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.790+0000 7f14f6e8d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb1616c50 0x560eb1620520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:51.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.790+0000 7f14f6e8d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560eb1621510 0x560eb161ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:51.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.790+0000 7f14f6e8d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560eb1631d40 con 0x560eb1616c50 2024-09-15T22:24:51.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.790+0000 7f14f6e8d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560eb1632410 con 0x560eb1616330 2024-09-15T22:24:51.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.790+0000 7f14f6e8d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560eb1632ae0 con 0x560eb1621510 2024-09-15T22:24:51.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.790+0000 7f14f1000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb1616c50 0x560eb1620520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:51.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.790+0000 7f14f1000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb1616c50 0x560eb1620520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43086/0 (socket says 172.21.15.1:43086) 2024-09-15T22:24:51.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.790+0000 7f14f1000640 1 -- 172.21.15.1:0/1268178079 learned_addr learned my addr 172.21.15.1:0/1268178079 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:51.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.790+0000 7f14f1a00640 1 --2- 172.21.15.1:0/1268178079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560eb1616330 0x560eb1633a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:51.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.790+0000 7f14f2400640 1 --2- 172.21.15.1:0/1268178079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560eb1621510 0x560eb161ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:51.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.790+0000 7f14f1000640 1 -- 172.21.15.1:0/1268178079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560eb1621510 msgr2=0x560eb161ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:51.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.790+0000 7f14f1000640 1 --2- 172.21.15.1:0/1268178079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560eb1621510 0x560eb161ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.790+0000 7f14f1000640 1 -- 172.21.15.1:0/1268178079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560eb1616330 msgr2=0x560eb1633a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:51.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.790+0000 7f14f1000640 1 --2- 172.21.15.1:0/1268178079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560eb1616330 0x560eb1633a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.790+0000 7f14f1000640 1 -- 172.21.15.1:0/1268178079 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eb16178b0 con 0x560eb1616c50 2024-09-15T22:24:51.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.790+0000 7f14f1a00640 1 --2- 172.21.15.1:0/1268178079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560eb1616330 0x560eb1633a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:51.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.791+0000 7f14f1000640 1 --2- 172.21.15.1:0/1268178079 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb1616c50 0x560eb1620520 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f14d8026a30 tx=0x7f14d80059b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2fcada509ed033 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:51.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.791+0000 7f14de000640 1 -- 172.21.15.1:0/1268178079 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d802b070 con 0x560eb1616c50 2024-09-15T22:24:51.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.791+0000 7f14de000640 1 -- 172.21.15.1:0/1268178079 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14d8026520 con 0x560eb1616c50 2024-09-15T22:24:51.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.791+0000 7f14de000640 1 -- 172.21.15.1:0/1268178079 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d80049c0 con 0x560eb1616c50 2024-09-15T22:24:51.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.792+0000 7f14f6e8d740 1 -- 172.21.15.1:0/1268178079 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb1616c50 msgr2=0x560eb1620520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:51.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.792+0000 7f14f6e8d740 1 --2- 172.21.15.1:0/1268178079 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb1616c50 0x560eb1620520 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f14d8026a30 tx=0x7f14d80059b0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.792+0000 7f14f6e8d740 1 -- 172.21.15.1:0/1268178079 shutdown_connections 2024-09-15T22:24:51.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.792+0000 7f14f6e8d740 1 --2- 172.21.15.1:0/1268178079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560eb1621510 0x560eb161ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.792+0000 7f14f6e8d740 1 --2- 172.21.15.1:0/1268178079 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb1616c50 0x560eb1620520 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.792+0000 7f14f6e8d740 1 --2- 172.21.15.1:0/1268178079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560eb1616330 0x560eb1633a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.792+0000 7f14f6e8d740 1 -- 172.21.15.1:0/1268178079 >> 172.21.15.1:0/1268178079 conn(0x560eb16128c0 msgr2=0x560eb161fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:51.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.792+0000 7f14f6e8d740 1 -- 172.21.15.1:0/1268178079 shutdown_connections 2024-09-15T22:24:51.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.792+0000 7f14f6e8d740 1 -- 172.21.15.1:0/1268178079 wait complete. 2024-09-15T22:24:51.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.792+0000 7f14f6e8d740 1 -- start start 2024-09-15T22:24:51.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.793+0000 7f14f6e8d740 1 Processor -- start 2024-09-15T22:24:51.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.793+0000 7f14f6e8d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560eb1616330 0x560eb163c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:51.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.793+0000 7f14f6e8d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb1616c50 0x560eb1635530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:51.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.793+0000 7f14f6e8d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560eb1621510 0x560eb1635a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:51.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.793+0000 7f14f6e8d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560eb1633880 con 0x560eb1616c50 2024-09-15T22:24:51.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.793+0000 7f14f6e8d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560eb16331b0 con 0x560eb1616330 2024-09-15T22:24:51.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.793+0000 7f14f6e8d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560eb1633f50 con 0x560eb1621510 2024-09-15T22:24:51.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.793+0000 7f14f6e8d740 10 client.0 _ll_register_callbacks cb 0x7f14d8012930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:24:51.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.793+0000 7f14f1000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb1616c50 0x560eb1635530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:51.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.793+0000 7f14f2400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560eb1621510 0x560eb1635a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:51.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.793+0000 7f14f2400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560eb1621510 0x560eb1635a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:43402/0 (socket says 172.21.15.1:43402) 2024-09-15T22:24:51.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.793+0000 7f14f2400640 1 -- 172.21.15.1:0/1394561860 learned_addr learned my addr 172.21.15.1:0/1394561860 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:51.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.793+0000 7f14f1000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb1616c50 0x560eb1635530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43102/0 (socket says 172.21.15.1:43102) 2024-09-15T22:24:51.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.793+0000 7f14f1a00640 1 --2- 172.21.15.1:0/1394561860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560eb1616330 0x560eb163c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:51.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.794+0000 7f14f2400640 1 -- 172.21.15.1:0/1394561860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560eb1616330 msgr2=0x560eb163c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:51.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.794+0000 7f14f2400640 1 --2- 172.21.15.1:0/1394561860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560eb1616330 0x560eb163c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.794+0000 7f14f2400640 1 -- 172.21.15.1:0/1394561860 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb1616c50 msgr2=0x560eb1635530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:51.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.794+0000 7f14f2400640 1 --2- 172.21.15.1:0/1394561860 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb1616c50 0x560eb1635530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.794+0000 7f14f2400640 1 -- 172.21.15.1:0/1394561860 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560eb16360b0 con 0x560eb1621510 2024-09-15T22:24:51.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.794+0000 7f14f1000640 1 --2- 172.21.15.1:0/1394561860 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb1616c50 0x560eb1635530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:51.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.794+0000 7f14f2400640 1 --2- 172.21.15.1:0/1394561860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560eb1621510 0x560eb1635a70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f14e4009900 tx=0x7f14e4009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb104fc94b8eae5a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:51.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.794+0000 7f14d3400640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-15T22:24:51.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.794+0000 7f14d3400640 1 -- 172.21.15.1:0/1394561860 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e4035040 con 0x560eb1621510 2024-09-15T22:24:51.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.794+0000 7f14f6e8d740 1 -- 172.21.15.1:0/1394561860 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14d8026520 con 0x560eb1621510 2024-09-15T22:24:51.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.794+0000 7f14d3400640 1 -- 172.21.15.1:0/1394561860 <== mon.1 v2:172.21.15.98:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f14e4003800 con 0x560eb1621510 2024-09-15T22:24:51.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.795+0000 7f14d3400640 1 -- 172.21.15.1:0/1394561860 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f14e4003a40 con 0x560eb1621510 2024-09-15T22:24:51.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.795+0000 7f14f6e8d740 10 client.25039 fetch_fsmap learned FSMap version 25 2024-09-15T22:24:51.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.795+0000 7f14f6e8d740 1 -- 172.21.15.1:0/1394561860 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560eb169cca0 con 0x560eb1621510 2024-09-15T22:24:51.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.795+0000 7f14d3400640 1 -- 172.21.15.1:0/1394561860 <== mon.1 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14d8026520 con 0x560eb1621510 2024-09-15T22:24:51.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.795+0000 7f14d3400640 1 -- 172.21.15.1:0/1394561860 <== mon.1 v2:172.21.15.98:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f14e405c020 con 0x560eb1621510 2024-09-15T22:24:51.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.795+0000 7f14f6e8d740 10 client.25039 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:24:51.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.795+0000 7f14f6e8d740 10 client.25039 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:24:51.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.795+0000 7f14f6e8d740 20 client.25039 populate_metadata read hostname 'smithi001' 2024-09-15T22:24:51.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.795+0000 7f14f6e8d740 1 --2- 172.21.15.1:0/1394561860 >> [v2:172.21.15.12:6838/1469511155,v1:172.21.15.12:6839/1469511155] conn(0x560eb16a1760 0x560eb16a0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:51.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.795+0000 7f14f6e8d740 4 client.25039 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:24:51.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.795+0000 7f14f6e8d740 1 -- 172.21.15.1:0/1394561860 --> [v2:172.21.15.12:6838/1469511155,v1:172.21.15.12:6839/1469511155] -- command(tid 0: {"prefix": "status"}) -- 0x560eb14fff80 con 0x560eb16a1760 2024-09-15T22:24:51.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.796+0000 7f14f1a00640 1 --2- 172.21.15.1:0/1394561860 >> [v2:172.21.15.12:6838/1469511155,v1:172.21.15.12:6839/1469511155] conn(0x560eb16a1760 0x560eb16a0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:51.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.796+0000 7f14f1a00640 1 --2- 172.21.15.1:0/1394561860 >> [v2:172.21.15.12:6838/1469511155,v1:172.21.15.12:6839/1469511155] conn(0x560eb16a1760 0x560eb16a0470 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=499dd8cd8d932603 server_cookie=84200f4619178f4e in_seq=0 out_seq=0 2024-09-15T22:24:51.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.796+0000 7f14d3400640 10 client.25039 ms_handle_connect on v2:172.21.15.12:6838/1469511155 2024-09-15T22:24:51.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.796+0000 7f14d3400640 1 -- 172.21.15.1:0/1394561860 <== mds.1 v2:172.21.15.12:6838/1469511155 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x560eb14fff80 con 0x560eb16a1760 2024-09-15T22:24:51.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.796+0000 7f14d3400640 10 client.25039 handle_command_reply: tid=0 2024-09-15T22:24:51.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.796+0000 7f14f6e8d740 1 client.25039 shutdown 2024-09-15T22:24:51.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.797+0000 7f14f6e8d740 1 -- 172.21.15.1:0/1394561860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560eb1621510 msgr2=0x560eb1635a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:51.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.797+0000 7f14f6e8d740 1 --2- 172.21.15.1:0/1394561860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560eb1621510 0x560eb1635a70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f14e4009900 tx=0x7f14e4009260 comp rx=0 tx=0).stop 2024-09-15T22:24:51.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.797+0000 7f14f6e8d740 1 -- 172.21.15.1:0/1394561860 shutdown_connections 2024-09-15T22:24:51.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.797+0000 7f14f6e8d740 1 --2- 172.21.15.1:0/1394561860 >> [v2:172.21.15.12:6838/1469511155,v1:172.21.15.12:6839/1469511155] conn(0x560eb16a1760 0x560eb16a0470 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.797+0000 7f14f6e8d740 1 --2- 172.21.15.1:0/1394561860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560eb1621510 0x560eb1635a70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.797+0000 7f14f6e8d740 1 --2- 172.21.15.1:0/1394561860 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb1616c50 0x560eb1635530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.797+0000 7f14f6e8d740 1 --2- 172.21.15.1:0/1394561860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560eb1616330 0x560eb163c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.797+0000 7f14f6e8d740 1 -- 172.21.15.1:0/1394561860 >> 172.21.15.1:0/1394561860 conn(0x560eb16128c0 msgr2=0x560eb162ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:51.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.797+0000 7f14d3400640 0 client.25039 ms_handle_reset on v2:172.21.15.12:6838/1469511155 2024-09-15T22:24:51.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.797+0000 7f14f6e8d740 1 -- 172.21.15.1:0/1394561860 shutdown_connections 2024-09-15T22:24:51.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.797+0000 7f14f6e8d740 1 -- 172.21.15.1:0/1394561860 wait complete. 2024-09-15T22:24:51.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.797+0000 7f14f6e8d740 20 client.25039 trim_cache size 0 max 16384 2024-09-15T22:24:51.804 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-15T22:24:51.804 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "c1228c44-73af-11ef-bceb-c7b262605968", 2024-09-15T22:24:51.804 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 1, 2024-09-15T22:24:51.804 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24524, 2024-09-15T22:24:51.804 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-15T22:24:51.804 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-15T22:24:51.804 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-15T22:24:51.804 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 109.98159189499999, 2024-09-15T22:24:51.804 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 25, 2024-09-15T22:24:51.804 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 86, 2024-09-15T22:24:51.804 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 82, 2024-09-15T22:24:51.804 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 133.43189445499999 2024-09-15T22:24:51.804 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-15T22:24:51.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.798+0000 7f14f4400640 1 -- 172.21.15.1:0/1057626819 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f14d40a32c0 msgr2=0x7f14d40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:51.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.798+0000 7f14f4400640 1 --2- 172.21.15.1:0/1057626819 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f14d40a32c0 0x7f14d40a5780 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f14e4031550 tx=0x7f14e40046c0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.798+0000 7f14f4400640 1 -- 172.21.15.1:0/1057626819 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14ec101de0 msgr2=0x7f14ec0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:51.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.798+0000 7f14f4400640 1 --2- 172.21.15.1:0/1057626819 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14ec101de0 0x7f14ec0744f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f14e000ebc0 tx=0x7f14e000c6a0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.798+0000 7f14f4400640 1 -- 172.21.15.1:0/1057626819 shutdown_connections 2024-09-15T22:24:51.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.798+0000 7f14f4400640 1 --2- 172.21.15.1:0/1057626819 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f14d40a32c0 0x7f14d40a5780 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.798+0000 7f14f4400640 1 --2- 172.21.15.1:0/1057626819 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14ec106f10 0x7f14ec074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.798+0000 7f14f4400640 1 --2- 172.21.15.1:0/1057626819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14ec102790 0x7f14ec074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.798+0000 7f14f4400640 1 --2- 172.21.15.1:0/1057626819 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14ec101de0 0x7f14ec0744f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:51.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.798+0000 7f14f4400640 1 -- 172.21.15.1:0/1057626819 >> 172.21.15.1:0/1057626819 conn(0x7f14ec0fd8c0 msgr2=0x7f14ec0fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:51.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.798+0000 7f14f4400640 1 -- 172.21.15.1:0/1057626819 shutdown_connections 2024-09-15T22:24:51.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:51.798+0000 7f14f4400640 1 -- 172.21.15.1:0/1057626819 wait complete. 2024-09-15T22:24:51.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:51 smithi098 ceph-mon[35514]: pgmap v355: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-15T22:24:52.602 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-15T22:24:52.979 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:53.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.579+0000 7fa779600640 1 -- 172.21.15.1:0/2247528491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa774109120 msgr2=0x7fa774110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:53.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.579+0000 7fa779600640 1 --2- 172.21.15.1:0/2247528491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa774109120 0x7fa774110ca0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa76c009ca0 tx=0x7fa76c02a8b0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.580+0000 7fa779600640 1 -- 172.21.15.1:0/2247528491 shutdown_connections 2024-09-15T22:24:53.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.580+0000 7fa779600640 1 --2- 172.21.15.1:0/2247528491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa774109120 0x7fa774110ca0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.580+0000 7fa779600640 1 --2- 172.21.15.1:0/2247528491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7741049a0 0x7fa7741089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.580+0000 7fa779600640 1 --2- 172.21.15.1:0/2247528491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa774103ff0 0x7fa7741043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.580+0000 7fa779600640 1 -- 172.21.15.1:0/2247528491 >> 172.21.15.1:0/2247528491 conn(0x7fa7740ffa90 msgr2=0x7fa774101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:53.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.580+0000 7fa779600640 1 -- 172.21.15.1:0/2247528491 shutdown_connections 2024-09-15T22:24:53.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.580+0000 7fa779600640 1 -- 172.21.15.1:0/2247528491 wait complete. 2024-09-15T22:24:53.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.581+0000 7fa779600640 1 Processor -- start 2024-09-15T22:24:53.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.581+0000 7fa779600640 1 -- start start 2024-09-15T22:24:53.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.581+0000 7fa779600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa774103ff0 0x7fa77419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:53.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.581+0000 7fa779600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7741049a0 0x7fa77419ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:53.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.581+0000 7fa779600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa774109120 0x7fa77419eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:53.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.581+0000 7fa779600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa774114130 con 0x7fa774109120 2024-09-15T22:24:53.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.581+0000 7fa779600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa774113fb0 con 0x7fa774103ff0 2024-09-15T22:24:53.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.581+0000 7fa779600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa7741142b0 con 0x7fa7741049a0 2024-09-15T22:24:53.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.581+0000 7fa773400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa774109120 0x7fa77419eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:53.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.581+0000 7fa76be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7741049a0 0x7fa77419ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:53.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.581+0000 7fa772a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa774103ff0 0x7fa77419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:53.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.582+0000 7fa76be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7741049a0 0x7fa77419ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:43408/0 (socket says 172.21.15.1:43408) 2024-09-15T22:24:53.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.582+0000 7fa76be00640 1 -- 172.21.15.1:0/61243272 learned_addr learned my addr 172.21.15.1:0/61243272 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:53.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.582+0000 7fa76be00640 1 -- 172.21.15.1:0/61243272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa774103ff0 msgr2=0x7fa77419a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:53.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.582+0000 7fa76be00640 1 --2- 172.21.15.1:0/61243272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa774103ff0 0x7fa77419a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.582+0000 7fa76be00640 1 -- 172.21.15.1:0/61243272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa774109120 msgr2=0x7fa77419eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:53.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.582+0000 7fa76be00640 1 --2- 172.21.15.1:0/61243272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa774109120 0x7fa77419eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.582+0000 7fa76be00640 1 -- 172.21.15.1:0/61243272 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa77419f580 con 0x7fa7741049a0 2024-09-15T22:24:53.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.582+0000 7fa76be00640 1 --2- 172.21.15.1:0/61243272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7741049a0 0x7fa77419ab10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00e9f0 tx=0x7fa75c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:53.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.582+0000 7fa76b400640 1 -- 172.21.15.1:0/61243272 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c00cd80 con 0x7fa7741049a0 2024-09-15T22:24:53.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.582+0000 7fa76b400640 1 -- 172.21.15.1:0/61243272 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa75c010910 con 0x7fa7741049a0 2024-09-15T22:24:53.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.582+0000 7fa779600640 1 -- 172.21.15.1:0/61243272 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa77419f870 con 0x7fa7741049a0 2024-09-15T22:24:53.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.583+0000 7fa76b400640 1 -- 172.21.15.1:0/61243272 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c018990 con 0x7fa7741049a0 2024-09-15T22:24:53.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.583+0000 7fa779600640 1 -- 172.21.15.1:0/61243272 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7741a7150 con 0x7fa7741049a0 2024-09-15T22:24:53.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.587+0000 7fa77c073740 1 Processor -- start 2024-09-15T22:24:53.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.587+0000 7fa77c073740 1 -- start start 2024-09-15T22:24:53.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.587+0000 7fa77c073740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564926e44330 0x564926e44710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:53.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.587+0000 7fa76b400640 1 -- 172.21.15.1:0/61243272 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fa75c010ac0 con 0x7fa7741049a0 2024-09-15T22:24:53.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.587+0000 7fa77c073740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564926e44c50 0x564926e4efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:53.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.587+0000 7fa77c073740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564926e4f510 0x564926e51900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:53.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.587+0000 7fa77c073740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564926daa0b0 con 0x564926e44330 2024-09-15T22:24:53.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.587+0000 7fa77c073740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564926d51ab0 con 0x564926e4f510 2024-09-15T22:24:53.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.587+0000 7fa77c073740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564926da6070 con 0x564926e44c50 2024-09-15T22:24:53.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.588+0000 7fa773400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564926e44330 0x564926e44710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:53.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.588+0000 7fa773400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564926e44330 0x564926e44710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43116/0 (socket says 172.21.15.1:43116) 2024-09-15T22:24:53.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.588+0000 7fa773400640 1 -- 172.21.15.1:0/4083013577 learned_addr learned my addr 172.21.15.1:0/4083013577 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:53.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.588+0000 7fa76be00640 1 --2- 172.21.15.1:0/4083013577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564926e4f510 0x564926e51900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:53.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.588+0000 7fa772a00640 1 --2- 172.21.15.1:0/4083013577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564926e44c50 0x564926e4efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:53.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.588+0000 7fa773400640 1 -- 172.21.15.1:0/4083013577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564926e44c50 msgr2=0x564926e4efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:53.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.588+0000 7fa773400640 1 --2- 172.21.15.1:0/4083013577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564926e44c50 0x564926e4efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.588+0000 7fa773400640 1 -- 172.21.15.1:0/4083013577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564926e4f510 msgr2=0x564926e51900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:53.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.588+0000 7fa773400640 1 --2- 172.21.15.1:0/4083013577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564926e4f510 0x564926e51900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.588+0000 7fa773400640 1 -- 172.21.15.1:0/4083013577 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564926d5e4a0 con 0x564926e44330 2024-09-15T22:24:53.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.588+0000 7fa772a00640 1 --2- 172.21.15.1:0/4083013577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564926e44c50 0x564926e4efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:53.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.588+0000 7fa773400640 1 --2- 172.21.15.1:0/4083013577 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564926e44330 0x564926e44710 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa76c004ad0 tx=0x7fa76c009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=375d57b144dbe9e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:53.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.589+0000 7fa763400640 1 -- 172.21.15.1:0/4083013577 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76c030660 con 0x564926e44330 2024-09-15T22:24:53.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.589+0000 7fa763400640 1 -- 172.21.15.1:0/4083013577 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa76c036030 con 0x564926e44330 2024-09-15T22:24:53.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.589+0000 7fa763400640 1 -- 172.21.15.1:0/4083013577 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76c004440 con 0x564926e44330 2024-09-15T22:24:53.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.589+0000 7fa76b400640 1 --2- 172.21.15.1:0/61243272 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa7580a3240 0x7fa7580a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:53.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.589+0000 7fa76b400640 1 -- 172.21.15.1:0/61243272 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7fa75c0cfc00 con 0x7fa7741049a0 2024-09-15T22:24:53.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.589+0000 7fa772a00640 1 --2- 172.21.15.1:0/61243272 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa7580a3240 0x7fa7580a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:53.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.589+0000 7fa77c073740 1 -- 172.21.15.1:0/4083013577 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564926e44330 msgr2=0x564926e44710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:53.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.589+0000 7fa77c073740 1 --2- 172.21.15.1:0/4083013577 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564926e44330 0x564926e44710 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa76c004ad0 tx=0x7fa76c009360 comp rx=0 tx=0).stop 2024-09-15T22:24:53.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.590+0000 7fa77c073740 1 -- 172.21.15.1:0/4083013577 shutdown_connections 2024-09-15T22:24:53.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.590+0000 7fa77c073740 1 --2- 172.21.15.1:0/4083013577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564926e4f510 0x564926e51900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.590+0000 7fa77c073740 1 --2- 172.21.15.1:0/4083013577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564926e44c50 0x564926e4efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.590+0000 7fa77c073740 1 --2- 172.21.15.1:0/4083013577 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564926e44330 0x564926e44710 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.590+0000 7fa77c073740 1 -- 172.21.15.1:0/4083013577 >> 172.21.15.1:0/4083013577 conn(0x564926e408c0 msgr2=0x564926e40ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:53.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.590+0000 7fa77c073740 1 -- 172.21.15.1:0/4083013577 shutdown_connections 2024-09-15T22:24:53.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.590+0000 7fa77c073740 1 -- 172.21.15.1:0/4083013577 wait complete. 2024-09-15T22:24:53.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.590+0000 7fa772a00640 1 --2- 172.21.15.1:0/61243272 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa7580a3240 0x7fa7580a5700 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa7640099b0 tx=0x7fa764005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:53.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.590+0000 7fa77c073740 1 -- start start 2024-09-15T22:24:53.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.591+0000 7fa77c073740 1 Processor -- start 2024-09-15T22:24:53.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.591+0000 7fa77c073740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564926e44330 0x564926e4c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:53.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.591+0000 7fa77c073740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564926e44c50 0x564926e4ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:53.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.591+0000 7fa77c073740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564926e4f510 0x564926e4cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:53.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.591+0000 7fa77c073740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564926e52060 con 0x564926e4f510 2024-09-15T22:24:53.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.591+0000 7fa77c073740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564926d32920 con 0x564926e44330 2024-09-15T22:24:53.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.591+0000 7fa77c073740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564926e521e0 con 0x564926e44c50 2024-09-15T22:24:53.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.591+0000 7fa77c073740 10 client.0 _ll_register_callbacks cb 0x564926d568a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:24:53.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.591+0000 7fa773400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564926e4f510 0x564926e4cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:53.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.591+0000 7fa772a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564926e44330 0x564926e4c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:53.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.591+0000 7fa772a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564926e44330 0x564926e4c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:33484/0 (socket says 172.21.15.1:33484) 2024-09-15T22:24:53.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.591+0000 7fa773400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564926e4f510 0x564926e4cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43130/0 (socket says 172.21.15.1:43130) 2024-09-15T22:24:53.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.591+0000 7fa772a00640 1 -- 172.21.15.1:0/2858166594 learned_addr learned my addr 172.21.15.1:0/2858166594 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:53.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.591+0000 7fa76be00640 1 --2- 172.21.15.1:0/2858166594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564926e44c50 0x564926e4ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:53.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.592+0000 7fa772a00640 1 -- 172.21.15.1:0/2858166594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564926e44c50 msgr2=0x564926e4ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:53.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.592+0000 7fa772a00640 1 --2- 172.21.15.1:0/2858166594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564926e44c50 0x564926e4ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.592+0000 7fa772a00640 1 -- 172.21.15.1:0/2858166594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564926e4f510 msgr2=0x564926e4cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:53.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.592+0000 7fa772a00640 1 --2- 172.21.15.1:0/2858166594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564926e4f510 0x564926e4cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.592+0000 7fa772a00640 1 -- 172.21.15.1:0/2858166594 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564926b1b2b0 con 0x564926e44330 2024-09-15T22:24:53.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.592+0000 7fa76be00640 1 --2- 172.21.15.1:0/2858166594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564926e44c50 0x564926e4ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:53.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.592+0000 7fa773400640 1 --2- 172.21.15.1:0/2858166594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564926e4f510 0x564926e4cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:53.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.592+0000 7fa772a00640 1 --2- 172.21.15.1:0/2858166594 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564926e44330 0x564926e4c520 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa764012e50 tx=0x7fa764004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=489d23f0e6d207bf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:53.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.592+0000 7fa757e00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-15T22:24:53.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.592+0000 7fa757e00640 1 -- 172.21.15.1:0/2858166594 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76401f6f0 con 0x564926e44330 2024-09-15T22:24:53.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.593+0000 7fa77c073740 1 -- 172.21.15.1:0/2858166594 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa76c036030 con 0x564926e44330 2024-09-15T22:24:53.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.593+0000 7fa757e00640 1 -- 172.21.15.1:0/2858166594 <== mon.2 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7fa76401f890 con 0x564926e44330 2024-09-15T22:24:53.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.593+0000 7fa757e00640 1 -- 172.21.15.1:0/2858166594 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa76401fa90 con 0x564926e44330 2024-09-15T22:24:53.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.593+0000 7fa77c073740 10 client.25022 fetch_fsmap learned FSMap version 25 2024-09-15T22:24:53.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.593+0000 7fa77c073740 1 -- 172.21.15.1:0/2858166594 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564926e5de60 con 0x564926e44330 2024-09-15T22:24:53.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.593+0000 7fa757e00640 1 -- 172.21.15.1:0/2858166594 <== mon.2 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa76c036030 con 0x564926e44330 2024-09-15T22:24:53.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.593+0000 7fa757e00640 1 -- 172.21.15.1:0/2858166594 <== mon.2 v2:172.21.15.12:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa764027020 con 0x564926e44330 2024-09-15T22:24:53.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.593+0000 7fa77c073740 10 client.25022 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:24:53.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.593+0000 7fa77c073740 10 client.25022 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-15T22:24:53.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.594+0000 7fa77c073740 20 client.25022 populate_metadata read hostname 'smithi001' 2024-09-15T22:24:53.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.594+0000 7fa77c073740 1 --2- 172.21.15.1:0/2858166594 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x564926e60420 0x564926e61890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:53.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.594+0000 7fa77c073740 4 client.25022 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:24:53.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.594+0000 7fa77c073740 1 -- 172.21.15.1:0/2858166594 --> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564926db7620 con 0x564926e60420 2024-09-15T22:24:53.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.594+0000 7fa76be00640 1 --2- 172.21.15.1:0/2858166594 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x564926e60420 0x564926e61890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:53.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.594+0000 7fa76be00640 1 --2- 172.21.15.1:0/2858166594 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x564926e60420 0x564926e61890 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2a94c96e7247f2a server_cookie=1872b4f9c3c498ff in_seq=0 out_seq=0 2024-09-15T22:24:53.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.594+0000 7fa757e00640 10 client.25022 ms_handle_connect on v2:172.21.15.98:6838/2831161859 2024-09-15T22:24:53.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.595+0000 7fa757e00640 1 -- 172.21.15.1:0/2858166594 <== mds.0 v2:172.21.15.98:6838/2831161859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564926db7620 con 0x564926e60420 2024-09-15T22:24:53.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.595+0000 7fa757e00640 10 client.25022 handle_command_reply: tid=0 2024-09-15T22:24:53.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.595+0000 7fa77c073740 1 client.25022 shutdown 2024-09-15T22:24:53.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.596+0000 7fa77c073740 1 -- 172.21.15.1:0/2858166594 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564926e44330 msgr2=0x564926e4c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:53.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.596+0000 7fa77c073740 1 --2- 172.21.15.1:0/2858166594 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564926e44330 0x564926e4c520 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa764012e50 tx=0x7fa764004730 comp rx=0 tx=0).stop 2024-09-15T22:24:53.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.596+0000 7fa77c073740 1 -- 172.21.15.1:0/2858166594 shutdown_connections 2024-09-15T22:24:53.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.596+0000 7fa77c073740 1 --2- 172.21.15.1:0/2858166594 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x564926e60420 0x564926e61890 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.596+0000 7fa77c073740 1 --2- 172.21.15.1:0/2858166594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564926e4f510 0x564926e4cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.596+0000 7fa77c073740 1 --2- 172.21.15.1:0/2858166594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564926e44c50 0x564926e4ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.596+0000 7fa77c073740 1 --2- 172.21.15.1:0/2858166594 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564926e44330 0x564926e4c520 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.596+0000 7fa757e00640 0 client.25022 ms_handle_reset on v2:172.21.15.98:6838/2831161859 2024-09-15T22:24:53.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.596+0000 7fa77c073740 1 -- 172.21.15.1:0/2858166594 >> 172.21.15.1:0/2858166594 conn(0x564926e408c0 msgr2=0x564926e465a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:53.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.596+0000 7fa77c073740 1 -- 172.21.15.1:0/2858166594 shutdown_connections 2024-09-15T22:24:53.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.596+0000 7fa77c073740 1 -- 172.21.15.1:0/2858166594 wait complete. 2024-09-15T22:24:53.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.596+0000 7fa77c073740 20 client.25022 trim_cache size 0 max 16384 2024-09-15T22:24:53.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.615+0000 7fa77c073740 1 Processor -- start 2024-09-15T22:24:53.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.615+0000 7fa77c073740 1 -- start start 2024-09-15T22:24:53.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.615+0000 7fa77c073740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564926e44330 0x564926e47880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:53.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.615+0000 7fa77c073740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564926e44c50 0x564926e4cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:53.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.615+0000 7fa77c073740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564926e4f510 0x564926e4cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:53.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.615+0000 7fa77c073740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564926e5fbd0 con 0x564926e4f510 2024-09-15T22:24:53.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.615+0000 7fa77c073740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564926e602a0 con 0x564926e44330 2024-09-15T22:24:53.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.615+0000 7fa77c073740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564926e60970 con 0x564926e44c50 2024-09-15T22:24:53.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.615+0000 7fa773400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564926e4f510 0x564926e4cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:53.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.615+0000 7fa772a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564926e44330 0x564926e47880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:53.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.615+0000 7fa772a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564926e44330 0x564926e47880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:33498/0 (socket says 172.21.15.1:33498) 2024-09-15T22:24:53.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.615+0000 7fa772a00640 1 -- 172.21.15.1:0/1792702558 learned_addr learned my addr 172.21.15.1:0/1792702558 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:53.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.615+0000 7fa76be00640 1 --2- 172.21.15.1:0/1792702558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564926e44c50 0x564926e4cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:53.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.616+0000 7fa772a00640 1 -- 172.21.15.1:0/1792702558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564926e44c50 msgr2=0x564926e4cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:53.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.616+0000 7fa772a00640 1 --2- 172.21.15.1:0/1792702558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564926e44c50 0x564926e4cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.616+0000 7fa772a00640 1 -- 172.21.15.1:0/1792702558 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564926e4f510 msgr2=0x564926e4cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:53.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.616+0000 7fa772a00640 1 --2- 172.21.15.1:0/1792702558 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564926e4f510 0x564926e4cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.616+0000 7fa772a00640 1 -- 172.21.15.1:0/1792702558 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564926e4aab0 con 0x564926e44330 2024-09-15T22:24:53.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.616+0000 7fa772a00640 1 --2- 172.21.15.1:0/1792702558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564926e44330 0x564926e47880 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa764009b50 tx=0x7fa764003fe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dd7b90c640e398f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:53.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.616+0000 7fa762a00640 1 -- 172.21.15.1:0/1792702558 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76401f8f0 con 0x564926e44330 2024-09-15T22:24:53.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.616+0000 7fa762a00640 1 -- 172.21.15.1:0/1792702558 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa764004c80 con 0x564926e44330 2024-09-15T22:24:53.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.616+0000 7fa762a00640 1 -- 172.21.15.1:0/1792702558 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7640296a0 con 0x564926e44330 2024-09-15T22:24:53.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.617+0000 7fa77c073740 1 -- 172.21.15.1:0/1792702558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564926e44330 msgr2=0x564926e47880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:53.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.617+0000 7fa77c073740 1 --2- 172.21.15.1:0/1792702558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564926e44330 0x564926e47880 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa764009b50 tx=0x7fa764003fe0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.617+0000 7fa77c073740 1 -- 172.21.15.1:0/1792702558 shutdown_connections 2024-09-15T22:24:53.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.617+0000 7fa77c073740 1 --2- 172.21.15.1:0/1792702558 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564926e4f510 0x564926e4cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.617+0000 7fa77c073740 1 --2- 172.21.15.1:0/1792702558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564926e44c50 0x564926e4cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.617+0000 7fa77c073740 1 --2- 172.21.15.1:0/1792702558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564926e44330 0x564926e47880 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.617+0000 7fa77c073740 1 -- 172.21.15.1:0/1792702558 >> 172.21.15.1:0/1792702558 conn(0x564926e408c0 msgr2=0x564926e4ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:53.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.617+0000 7fa77c073740 1 -- 172.21.15.1:0/1792702558 shutdown_connections 2024-09-15T22:24:53.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.617+0000 7fa77c073740 1 -- 172.21.15.1:0/1792702558 wait complete. 2024-09-15T22:24:53.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.617+0000 7fa77c073740 1 -- start start 2024-09-15T22:24:53.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.618+0000 7fa77c073740 1 Processor -- start 2024-09-15T22:24:53.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.618+0000 7fa77c073740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564926e44330 0x564926e49680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:53.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.618+0000 7fa77c073740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564926e44c50 0x564926e49bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:53.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.618+0000 7fa77c073740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564926e4f510 0x564926e4a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:53.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.618+0000 7fa77c073740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564926e61710 con 0x564926e44330 2024-09-15T22:24:53.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.618+0000 7fa77c073740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564926e61040 con 0x564926e4f510 2024-09-15T22:24:53.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.618+0000 7fa77c073740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564926e61de0 con 0x564926e44c50 2024-09-15T22:24:53.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.618+0000 7fa77c073740 10 client.0 _ll_register_callbacks cb 0x7fa7640044c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:24:53.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.618+0000 7fa772a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564926e44330 0x564926e49680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:53.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.618+0000 7fa76be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564926e44c50 0x564926e49bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:53.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.618+0000 7fa76be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564926e44c50 0x564926e49bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:43428/0 (socket says 172.21.15.1:43428) 2024-09-15T22:24:53.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.618+0000 7fa76be00640 1 -- 172.21.15.1:0/867193215 learned_addr learned my addr 172.21.15.1:0/867193215 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:53.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.618+0000 7fa773400640 1 --2- 172.21.15.1:0/867193215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564926e4f510 0x564926e4a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:53.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.619+0000 7fa772a00640 1 -- 172.21.15.1:0/867193215 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564926e44c50 msgr2=0x564926e49bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:53.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.619+0000 7fa772a00640 1 --2- 172.21.15.1:0/867193215 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564926e44c50 0x564926e49bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.619+0000 7fa772a00640 1 -- 172.21.15.1:0/867193215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564926e4f510 msgr2=0x564926e4a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:53.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.619+0000 7fa772a00640 1 --2- 172.21.15.1:0/867193215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564926e4f510 0x564926e4a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.619+0000 7fa772a00640 1 -- 172.21.15.1:0/867193215 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564926e68000 con 0x564926e44330 2024-09-15T22:24:53.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.619+0000 7fa773400640 1 --2- 172.21.15.1:0/867193215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564926e4f510 0x564926e4a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:53.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.619+0000 7fa772a00640 1 --2- 172.21.15.1:0/867193215 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564926e44330 0x564926e49680 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa764019040 tx=0x7fa7640096f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c18147f297333a93 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:53.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.619+0000 7fa757e00640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-15T22:24:53.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.620+0000 7fa757e00640 1 -- 172.21.15.1:0/867193215 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76403f070 con 0x564926e44330 2024-09-15T22:24:53.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.620+0000 7fa77c073740 1 -- 172.21.15.1:0/867193215 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa764004c80 con 0x564926e44330 2024-09-15T22:24:53.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.620+0000 7fa757e00640 1 -- 172.21.15.1:0/867193215 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7fa764005240 con 0x564926e44330 2024-09-15T22:24:53.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.620+0000 7fa757e00640 1 -- 172.21.15.1:0/867193215 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa76404d050 con 0x564926e44330 2024-09-15T22:24:53.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.620+0000 7fa77c073740 10 client.15048 fetch_fsmap learned FSMap version 25 2024-09-15T22:24:53.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.620+0000 7fa77c073740 1 -- 172.21.15.1:0/867193215 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564926ecade0 con 0x564926e44330 2024-09-15T22:24:53.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.620+0000 7fa757e00640 1 -- 172.21.15.1:0/867193215 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa764004c80 con 0x564926e44330 2024-09-15T22:24:53.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.620+0000 7fa757e00640 1 -- 172.21.15.1:0/867193215 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa764027040 con 0x564926e44330 2024-09-15T22:24:53.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.620+0000 7fa77c073740 10 client.15048 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:24:53.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.620+0000 7fa77c073740 10 client.15048 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-15T22:24:53.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.620+0000 7fa77c073740 20 client.15048 populate_metadata read hostname 'smithi001' 2024-09-15T22:24:53.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.621+0000 7fa77c073740 1 --2- 172.21.15.1:0/867193215 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x564926ecf700 0x564926ece410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:53.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.621+0000 7fa77c073740 4 client.15048 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:24:53.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.621+0000 7fa77c073740 1 -- 172.21.15.1:0/867193215 --> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] -- command(tid 0: {"prefix": "status"}) -- 0x564926db1b30 con 0x564926ecf700 2024-09-15T22:24:53.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.621+0000 7fa76be00640 1 --2- 172.21.15.1:0/867193215 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x564926ecf700 0x564926ece410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:53.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.621+0000 7fa76be00640 1 --2- 172.21.15.1:0/867193215 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x564926ecf700 0x564926ece410 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d85fccfd91a4688 server_cookie=a497e7cb4f8897b3 in_seq=0 out_seq=0 2024-09-15T22:24:53.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.621+0000 7fa757e00640 10 client.15048 ms_handle_connect on v2:172.21.15.98:6838/2831161859 2024-09-15T22:24:53.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.622+0000 7fa757e00640 1 -- 172.21.15.1:0/867193215 <== mds.0 v2:172.21.15.98:6838/2831161859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x564926db1b30 con 0x564926ecf700 2024-09-15T22:24:53.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.622+0000 7fa757e00640 10 client.15048 handle_command_reply: tid=0 2024-09-15T22:24:53.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.622+0000 7fa77c073740 1 client.15048 shutdown 2024-09-15T22:24:53.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.622+0000 7fa77c073740 1 -- 172.21.15.1:0/867193215 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564926e44330 msgr2=0x564926e49680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:53.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.622+0000 7fa77c073740 1 --2- 172.21.15.1:0/867193215 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564926e44330 0x564926e49680 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa764019040 tx=0x7fa7640096f0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.622+0000 7fa77c073740 1 -- 172.21.15.1:0/867193215 shutdown_connections 2024-09-15T22:24:53.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.622+0000 7fa77c073740 1 --2- 172.21.15.1:0/867193215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564926e4f510 0x564926e4a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.622+0000 7fa77c073740 1 --2- 172.21.15.1:0/867193215 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564926e44c50 0x564926e49bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.622+0000 7fa77c073740 1 --2- 172.21.15.1:0/867193215 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x564926ecf700 0x564926ece410 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.622+0000 7fa77c073740 1 --2- 172.21.15.1:0/867193215 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564926e44330 0x564926e49680 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.622+0000 7fa77c073740 1 -- 172.21.15.1:0/867193215 >> 172.21.15.1:0/867193215 conn(0x564926e408c0 msgr2=0x564926e45d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:53.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.622+0000 7fa757e00640 0 client.15048 ms_handle_reset on v2:172.21.15.98:6838/2831161859 2024-09-15T22:24:53.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.622+0000 7fa77c073740 1 -- 172.21.15.1:0/867193215 shutdown_connections 2024-09-15T22:24:53.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.622+0000 7fa77c073740 1 -- 172.21.15.1:0/867193215 wait complete. 2024-09-15T22:24:53.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.622+0000 7fa77c073740 20 client.15048 trim_cache size 0 max 16384 2024-09-15T22:24:53.632 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-15T22:24:53.632 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "c1228c44-73af-11ef-bceb-c7b262605968", 2024-09-15T22:24:53.632 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2024-09-15T22:24:53.632 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24538, 2024-09-15T22:24:53.632 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-15T22:24:53.633 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-15T22:24:53.633 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-15T22:24:53.633 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 121.84909983599999, 2024-09-15T22:24:53.633 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 25, 2024-09-15T22:24:53.633 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 86, 2024-09-15T22:24:53.633 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 82, 2024-09-15T22:24:53.633 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 144.92538835799999 2024-09-15T22:24:53.633 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-15T22:24:53.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.623+0000 7fa779600640 1 -- 172.21.15.1:0/61243272 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa7580a3240 msgr2=0x7fa7580a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:53.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.623+0000 7fa779600640 1 --2- 172.21.15.1:0/61243272 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa7580a3240 0x7fa7580a5700 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa7640099b0 tx=0x7fa764005f90 comp rx=0 tx=0).stop 2024-09-15T22:24:53.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.623+0000 7fa779600640 1 -- 172.21.15.1:0/61243272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7741049a0 msgr2=0x7fa77419ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:53.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.623+0000 7fa779600640 1 --2- 172.21.15.1:0/61243272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7741049a0 0x7fa77419ab10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00e9f0 tx=0x7fa75c00eeb0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.623+0000 7fa779600640 1 -- 172.21.15.1:0/61243272 shutdown_connections 2024-09-15T22:24:53.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.623+0000 7fa779600640 1 --2- 172.21.15.1:0/61243272 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fa7580a3240 0x7fa7580a5700 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.623+0000 7fa779600640 1 --2- 172.21.15.1:0/61243272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa774109120 0x7fa77419eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.623+0000 7fa779600640 1 --2- 172.21.15.1:0/61243272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7741049a0 0x7fa77419ab10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.623+0000 7fa779600640 1 --2- 172.21.15.1:0/61243272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa774103ff0 0x7fa77419a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:53.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.623+0000 7fa779600640 1 -- 172.21.15.1:0/61243272 >> 172.21.15.1:0/61243272 conn(0x7fa7740ffa90 msgr2=0x7fa774100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:53.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.623+0000 7fa779600640 1 -- 172.21.15.1:0/61243272 shutdown_connections 2024-09-15T22:24:53.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:53.623+0000 7fa779600640 1 -- 172.21.15.1:0/61243272 wait complete. 2024-09-15T22:24:53.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:53 smithi012 ceph-mon[34883]: pgmap v356: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-15T22:24:53.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:53 smithi098 ceph-mon[35514]: pgmap v356: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-15T22:24:53.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:53 smithi001 ceph-mon[30843]: pgmap v356: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-15T22:24:54.376 INFO:teuthology.run_tasks:Running task sequential... 2024-09-15T22:24:54.387 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-15T22:24:54.388 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-15T22:24:54.388 INFO:teuthology.task.print:Enabling mgr modules 2024-09-15T22:24:54.388 INFO:teuthology.run_tasks:Running task kclient... 2024-09-15T22:24:54.424 INFO:tasks.kclient:Mounting kernel clients... 2024-09-15T22:24:54.424 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-15T22:24:54.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:24:54.425 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2024-09-15T22:24:54.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:24:54.462 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link delete ceph-brx 2024-09-15T22:24:54.561 INFO:teuthology.orchestra.run.smithi001.stderr:Cannot find device "ceph-brx" 2024-09-15T22:24:54.564 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:24:54.564 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'nowsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-15T22:24:54.565 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T22:24:54.565 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:24:54.565 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-15T22:24:54.946 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:55.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.504+0000 7f0f24600640 1 -- 172.21.15.1:0/1672005116 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f1c077040 msgr2=0x7f0f1c1124f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:55.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.504+0000 7f0f24600640 1 --2- 172.21.15.1:0/1672005116 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f1c077040 0x7f0f1c1124f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0f08009900 tx=0x7f0f0802a410 comp rx=0 tx=0).stop 2024-09-15T22:24:55.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.504+0000 7f0f24600640 1 -- 172.21.15.1:0/1672005116 shutdown_connections 2024-09-15T22:24:55.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.504+0000 7f0f24600640 1 --2- 172.21.15.1:0/1672005116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f1c112a30 0x7f0f1c114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:55.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.504+0000 7f0f24600640 1 --2- 172.21.15.1:0/1672005116 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f1c077040 0x7f0f1c1124f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:55.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.504+0000 7f0f24600640 1 --2- 172.21.15.1:0/1672005116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f1c076720 0x7f0f1c076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:55.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.504+0000 7f0f24600640 1 -- 172.21.15.1:0/1672005116 >> 172.21.15.1:0/1672005116 conn(0x7f0f1c0ffa90 msgr2=0x7f0f1c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:55.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.504+0000 7f0f24600640 1 -- 172.21.15.1:0/1672005116 shutdown_connections 2024-09-15T22:24:55.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.504+0000 7f0f24600640 1 -- 172.21.15.1:0/1672005116 wait complete. 2024-09-15T22:24:55.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.505+0000 7f0f24600640 1 Processor -- start 2024-09-15T22:24:55.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.505+0000 7f0f24600640 1 -- start start 2024-09-15T22:24:55.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.506+0000 7f0f24600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f1c076720 0x7f0f1c1a4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:55.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.506+0000 7f0f24600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f1c077040 0x7f0f1c1a4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:55.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.506+0000 7f0f24600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f1c112a30 0x7f0f1c19e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:55.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.506+0000 7f0f24600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1c1185f0 con 0x7f0f1c112a30 2024-09-15T22:24:55.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.506+0000 7f0f24600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1c118470 con 0x7f0f1c077040 2024-09-15T22:24:55.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.506+0000 7f0f24600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1c118770 con 0x7f0f1c076720 2024-09-15T22:24:55.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.506+0000 7f0f22600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f1c112a30 0x7f0f1c19e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:55.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.506+0000 7f0f22600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f1c112a30 0x7f0f1c19e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43164/0 (socket says 172.21.15.1:43164) 2024-09-15T22:24:55.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.506+0000 7f0f22600640 1 -- 172.21.15.1:0/1307596997 learned_addr learned my addr 172.21.15.1:0/1307596997 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:24:55.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.506+0000 7f0f21200640 1 --2- 172.21.15.1:0/1307596997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f1c077040 0x7f0f1c1a4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:55.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.506+0000 7f0f21c00640 1 --2- 172.21.15.1:0/1307596997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f1c076720 0x7f0f1c1a4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:55.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.507+0000 7f0f21200640 1 -- 172.21.15.1:0/1307596997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f1c076720 msgr2=0x7f0f1c1a4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:55.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.507+0000 7f0f21200640 1 --2- 172.21.15.1:0/1307596997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f1c076720 0x7f0f1c1a4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:55.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.507+0000 7f0f21200640 1 -- 172.21.15.1:0/1307596997 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f1c112a30 msgr2=0x7f0f1c19e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:55.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.507+0000 7f0f21200640 1 --2- 172.21.15.1:0/1307596997 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f1c112a30 0x7f0f1c19e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:55.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.507+0000 7f0f21200640 1 -- 172.21.15.1:0/1307596997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1c19f030 con 0x7f0f1c077040 2024-09-15T22:24:55.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.507+0000 7f0f21200640 1 --2- 172.21.15.1:0/1307596997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f1c077040 0x7f0f1c1a4c80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0f0802a930 tx=0x7f0f08003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:55.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.507+0000 7f0f1a000640 1 -- 172.21.15.1:0/1307596997 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0803f070 con 0x7f0f1c077040 2024-09-15T22:24:55.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.508+0000 7f0f1a000640 1 -- 172.21.15.1:0/1307596997 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f08031c90 con 0x7f0f1c077040 2024-09-15T22:24:55.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.508+0000 7f0f1a000640 1 -- 172.21.15.1:0/1307596997 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f08035030 con 0x7f0f1c077040 2024-09-15T22:24:55.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.508+0000 7f0f24600640 1 -- 172.21.15.1:0/1307596997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f1c19f2c0 con 0x7f0f1c077040 2024-09-15T22:24:55.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.508+0000 7f0f24600640 1 -- 172.21.15.1:0/1307596997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f1c1ab610 con 0x7f0f1c077040 2024-09-15T22:24:55.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.509+0000 7f0f24600640 1 -- 172.21.15.1:0/1307596997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f1c077e60 con 0x7f0f1c077040 2024-09-15T22:24:55.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.511+0000 7f0f1a000640 1 -- 172.21.15.1:0/1307596997 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f0f08042070 con 0x7f0f1c077040 2024-09-15T22:24:55.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.512+0000 7f0f1a000640 1 --2- 172.21.15.1:0/1307596997 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f0f040a32c0 0x7f0f040a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:55.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.512+0000 7f0f1a000640 1 -- 172.21.15.1:0/1307596997 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f0f080f0500 con 0x7f0f1c077040 2024-09-15T22:24:55.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.512+0000 7f0f21c00640 1 --2- 172.21.15.1:0/1307596997 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f0f040a32c0 0x7f0f040a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:55.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.513+0000 7f0f21c00640 1 --2- 172.21.15.1:0/1307596997 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f0f040a32c0 0x7f0f040a5780 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c19fa40 tx=0x7f0f1000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:55.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.514+0000 7f0f1a000640 1 -- 172.21.15.1:0/1307596997 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0f080bcb10 con 0x7f0f1c077040 2024-09-15T22:24:55.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.736+0000 7f0f24600640 1 -- 172.21.15.1:0/1307596997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0f1c076b00 con 0x7f0f1c077040 2024-09-15T22:24:55.738 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:55 smithi001 ceph-mon[30843]: pgmap v357: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-15T22:24:55.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.736+0000 7f0f1a000640 1 -- 172.21.15.1:0/1307596997 <== mon.2 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+73 (secure 0 0 0) 0x7f0f080c0e10 con 0x7f0f1c077040 2024-09-15T22:24:55.739 INFO:teuthology.orchestra.run.smithi001.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:24:55.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.739+0000 7f0f24600640 1 -- 172.21.15.1:0/1307596997 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f0f040a32c0 msgr2=0x7f0f040a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:55.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.739+0000 7f0f24600640 1 --2- 172.21.15.1:0/1307596997 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f0f040a32c0 0x7f0f040a5780 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c19fa40 tx=0x7f0f1000b410 comp rx=0 tx=0).stop 2024-09-15T22:24:55.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.739+0000 7f0f24600640 1 -- 172.21.15.1:0/1307596997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f1c077040 msgr2=0x7f0f1c1a4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:55.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.739+0000 7f0f24600640 1 --2- 172.21.15.1:0/1307596997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f1c077040 0x7f0f1c1a4c80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0f0802a930 tx=0x7f0f08003b90 comp rx=0 tx=0).stop 2024-09-15T22:24:55.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.739+0000 7f0f24600640 1 -- 172.21.15.1:0/1307596997 shutdown_connections 2024-09-15T22:24:55.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.739+0000 7f0f24600640 1 --2- 172.21.15.1:0/1307596997 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f0f040a32c0 0x7f0f040a5780 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:55.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.739+0000 7f0f24600640 1 --2- 172.21.15.1:0/1307596997 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f1c112a30 0x7f0f1c19e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:55.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.739+0000 7f0f24600640 1 --2- 172.21.15.1:0/1307596997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f1c077040 0x7f0f1c1a4c80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:55.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.739+0000 7f0f24600640 1 --2- 172.21.15.1:0/1307596997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f1c076720 0x7f0f1c1a4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:55.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.739+0000 7f0f24600640 1 -- 172.21.15.1:0/1307596997 >> 172.21.15.1:0/1307596997 conn(0x7f0f1c0ffa90 msgr2=0x7f0f1c101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:55.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.739+0000 7f0f24600640 1 -- 172.21.15.1:0/1307596997 shutdown_connections 2024-09-15T22:24:55.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:55.739+0000 7f0f24600640 1 -- 172.21.15.1:0/1307596997 wait complete. 2024-09-15T22:24:55.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:55 smithi012 ceph-mon[34883]: pgmap v357: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-15T22:24:55.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:55 smithi098 ceph-mon[35514]: pgmap v357: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-15T22:24:56.436 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T22:24:56.437 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:24:56.437 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi001.front.sepia.ceph.com 2024-09-15T22:24:56.437 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T22:24:56.437 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:24:56.437 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T22:24:56.437 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T22:24:56.437 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:24:56.437 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:24:56.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:24:56.437 DEBUG:teuthology.orchestra.run.smithi001:> ip addr 2024-09-15T22:24:56.474 INFO:teuthology.orchestra.run.smithi001.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:24:56.474 INFO:teuthology.orchestra.run.smithi001.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:24:56.474 INFO:teuthology.orchestra.run.smithi001.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:24:56.474 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:24:56.474 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 ::1/128 scope host 2024-09-15T22:24:56.474 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:24:56.475 INFO:teuthology.orchestra.run.smithi001.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:24:56.475 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7a brd ff:ff:ff:ff:ff:ff 2024-09-15T22:24:56.475 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f0 2024-09-15T22:24:56.475 INFO:teuthology.orchestra.run.smithi001.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:24:56.475 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7b brd ff:ff:ff:ff:ff:ff 2024-09-15T22:24:56.475 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f1 2024-09-15T22:24:56.475 INFO:teuthology.orchestra.run.smithi001.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:24:56.475 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e8 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:24:56.475 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f0 2024-09-15T22:24:56.475 INFO:teuthology.orchestra.run.smithi001.stdout: inet 172.21.15.1/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-15T22:24:56.475 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft 42117sec preferred_lft 42117sec 2024-09-15T22:24:56.475 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::ec4:7aff:febd:15e8/64 scope link 2024-09-15T22:24:56.475 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:24:56.476 INFO:teuthology.orchestra.run.smithi001.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:24:56.476 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e9 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:24:56.476 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f1 2024-09-15T22:24:56.476 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-15T22:24:56.476 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:24:56.476 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-15T22:24:56.476 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link add name ceph-brx type bridge 2024-09-15T22:24:56.477 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip addr flush dev ceph-brx 2024-09-15T22:24:56.477 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set ceph-brx up 2024-09-15T22:24:56.477 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-15T22:24:56.477 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-15T22:24:56.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:24:56.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:56 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/1307596997' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-15T22:24:56.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:56 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/1307596997' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-15T22:24:56.818 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:56 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/1307596997' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-15T22:24:56.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:24:56.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:24:56.905 DEBUG:teuthology.orchestra.run.smithi001:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:24:56.962 INFO:teuthology.orchestra.run.smithi001.stdout:1 2024-09-15T22:24:56.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:24:56.965 DEBUG:teuthology.orchestra.run.smithi001:> route 2024-09-15T22:24:57.011 INFO:teuthology.orchestra.run.smithi001.stdout:Kernel IP routing table 2024-09-15T22:24:57.012 INFO:teuthology.orchestra.run.smithi001.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:24:57.012 INFO:teuthology.orchestra.run.smithi001.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-15T22:24:57.012 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-15T22:24:57.012 INFO:teuthology.orchestra.run.smithi001.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:24:57.012 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:24:57.012 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-15T22:24:57.012 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-15T22:24:57.013 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-15T22:24:57.013 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-15T22:24:57.013 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-15T22:24:57.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:24:57.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:24:57.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:24:57.662 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2024-09-15T22:24:57.694 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:57 smithi001 ceph-mon[30843]: pgmap v358: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-15T22:24:57.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:24:57.699 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list-id 2024-09-15T22:24:57.775 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:24:57.775 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-15T22:24:57.775 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:24:57.775 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-15T22:24:57.775 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-15T22:24:57.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:57 smithi098 ceph-mon[35514]: pgmap v358: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-15T22:24:57.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:24:57.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:24:57.957 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-15T22:24:57.957 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:24:57.957 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-15T22:24:57.957 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-15T22:24:57.957 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-15T22:24:57.957 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-15T22:24:57.957 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-15T22:24:57.957 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-15T22:24:57.958 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-15T22:24:57.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:57 smithi012 ceph-mon[34883]: pgmap v358: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-15T22:24:58.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:24:58.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:24:58.201 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:24:58.201 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-15T22:24:58.201 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set brx.0 up 2024-09-15T22:24:58.202 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set dev brx.0 master ceph-brx 2024-09-15T22:24:58.202 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-15T22:24:58.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:24:58.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:24:58.377 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:24:58.377 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T22:24:58.412 INFO:teuthology.orchestra.run.smithi001.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:24:58.412 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:24:58.413 DEBUG:teuthology.orchestra.run.smithi001:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:24:58.487 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-15T22:24:58.487 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-15T22:24:58.487 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/5d0e9612-686f-45ae-8040-b496e57d08ba 2024-09-15T22:24:58.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:24:58.488 DEBUG:teuthology.orchestra.run.smithi001:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/5d0e9612-686f-45ae-8040-b496e57d08ba /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,nowsync,nofallback 2024-09-15T22:24:58.634 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,nowsync,nofallback 2024-09-15T22:24:58.634 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,nowsync". 2024-09-15T22:24:59.282 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,nowsync,nofallback 2024-09-15T22:24:59.282 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,nowsync". 2024-09-15T22:24:59.283 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: resolved to: "172.21.15.1:6789,172.21.15.12:6789,172.21.15.98:6789" 2024-09-15T22:24:59.283 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: trying mount with new device syntax: 0@c1228c44-73af-11ef-bceb-c7b262605968.cephfs=/volumes/qa/sv_1/5d0e9612-686f-45ae-8040-b496e57d08ba 2024-09-15T22:24:59.283 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,nowsync,name=0,key=0,mon_addr=172.21.15.1:6789/172.21.15.12:6789/172.21.15.98:6789" will pass to kernel 2024-09-15T22:24:59.285 INFO:teuthology.orchestra.run.smithi001.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-15T22:24:59.285 INFO:teuthology.orchestra.run.smithi001.stdout: You just mounted a file system that supports labels which does not 2024-09-15T22:24:59.285 INFO:teuthology.orchestra.run.smithi001.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T22:24:59.285 INFO:teuthology.orchestra.run.smithi001.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T22:24:59.285 INFO:teuthology.orchestra.run.smithi001.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T22:24:59.288 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:24:59.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:24:59.288 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:24:59.346 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:24:59.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:24:59.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:24:59.439 INFO:teuthology.orchestra.run.smithi001.stdout:client25066 2024-09-15T22:24:59.439 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T22:24:59.440 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:24:59.477 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:24:59.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:24:59.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:24:59.608 INFO:teuthology.orchestra.run.smithi001.stdout:client25066 2024-09-15T22:24:59.609 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:24:59.625 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:24:59 smithi001 ceph-mon[30843]: pgmap v359: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-15T22:24:59.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:24:59.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:24:59.699 INFO:teuthology.orchestra.run.smithi001.stdout:client25066 2024-09-15T22:24:59.699 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/c1228c44-73af-11ef-bceb-c7b262605968.client25066/status') 2024-09-15T22:24:59.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:24:59 smithi098 ceph-mon[35514]: pgmap v359: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-15T22:24:59.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:24:59.840 INFO:teuthology.orchestra.run.smithi001.stdout:instance: client.25066 (3)172.21.15.1:0/562633468 2024-09-15T22:24:59.840 INFO:teuthology.orchestra.run.smithi001.stdout:blocklisted: false 2024-09-15T22:24:59.841 INFO:teuthology.orchestra.run.smithi001.stderr:0+1 records in 2024-09-15T22:24:59.841 INFO:teuthology.orchestra.run.smithi001.stderr:0+1 records out 2024-09-15T22:24:59.841 INFO:teuthology.orchestra.run.smithi001.stderr:69 bytes copied, 5.6598e-05 s, 1.2 MB/s 2024-09-15T22:24:59.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:24:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:24:59.851 INFO:teuthology.run_tasks:Running task exec... 2024-09-15T22:24:59.861 INFO:teuthology.task.exec:Executing custom commands... 2024-09-15T22:24:59.861 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi001.front.sepia.ceph.com 2024-09-15T22:24:59.861 DEBUG:teuthology.orchestra.run.smithi001:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-15T22:24:59.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:24:59 smithi012 ceph-mon[34883]: pgmap v359: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-15T22:25:00.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.014+0000 7f1c73e00640 1 -- 172.21.15.1:0/3623027403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c74104da0 msgr2=0x7f1c74105220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:00.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.014+0000 7f1c73e00640 1 --2- 172.21.15.1:0/3623027403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c74104da0 0x7f1c74105220 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1c60009900 tx=0x7f1c6002a400 comp rx=0 tx=0).stop 2024-09-15T22:25:00.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.014+0000 7f1c73e00640 1 -- 172.21.15.1:0/3623027403 shutdown_connections 2024-09-15T22:25:00.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.014+0000 7f1c73e00640 1 --2- 172.21.15.1:0/3623027403 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c74105760 0x7f1c7410bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:00.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.014+0000 7f1c73e00640 1 --2- 172.21.15.1:0/3623027403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c74104da0 0x7f1c74105220 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:00.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.014+0000 7f1c73e00640 1 --2- 172.21.15.1:0/3623027403 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c74103bb0 0x7f1c74103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:00.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.014+0000 7f1c73e00640 1 -- 172.21.15.1:0/3623027403 >> 172.21.15.1:0/3623027403 conn(0x7f1c740ff310 msgr2=0x7f1c74101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:00.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.014+0000 7f1c73e00640 1 -- 172.21.15.1:0/3623027403 shutdown_connections 2024-09-15T22:25:00.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.014+0000 7f1c73e00640 1 -- 172.21.15.1:0/3623027403 wait complete. 2024-09-15T22:25:00.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.015+0000 7f1c73e00640 1 Processor -- start 2024-09-15T22:25:00.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.015+0000 7f1c73e00640 1 -- start start 2024-09-15T22:25:00.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.015+0000 7f1c73e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c74103bb0 0x7f1c74199ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:00.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.015+0000 7f1c73e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c74104da0 0x7f1c7419a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:00.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.015+0000 7f1c73e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c74105760 0x7f1c741a1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:00.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.015+0000 7f1c73e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1c7410f880 con 0x7f1c74105760 2024-09-15T22:25:00.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.015+0000 7f1c73e00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1c7410f700 con 0x7f1c74103bb0 2024-09-15T22:25:00.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.015+0000 7f1c73e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1c7410fa00 con 0x7f1c74104da0 2024-09-15T22:25:00.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.016+0000 7f1c72a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c74103bb0 0x7f1c74199ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:00.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.016+0000 7f1c72000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c74104da0 0x7f1c7419a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:00.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.016+0000 7f1c72a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c74103bb0 0x7f1c74199ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:35464/0 (socket says 172.21.15.1:35464) 2024-09-15T22:25:00.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.016+0000 7f1c72000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c74104da0 0x7f1c7419a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:60950/0 (socket says 172.21.15.1:60950) 2024-09-15T22:25:00.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.016+0000 7f1c72a00640 1 -- 172.21.15.1:0/1784923253 learned_addr learned my addr 172.21.15.1:0/1784923253 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:25:00.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.016+0000 7f1c73400640 1 --2- 172.21.15.1:0/1784923253 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c74105760 0x7f1c741a1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:00.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.016+0000 7f1c72a00640 1 -- 172.21.15.1:0/1784923253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c74104da0 msgr2=0x7f1c7419a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:00.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.016+0000 7f1c72a00640 1 --2- 172.21.15.1:0/1784923253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c74104da0 0x7f1c7419a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:00.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.016+0000 7f1c72a00640 1 -- 172.21.15.1:0/1784923253 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c74105760 msgr2=0x7f1c741a1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:00.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.016+0000 7f1c72a00640 1 --2- 172.21.15.1:0/1784923253 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c74105760 0x7f1c741a1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:00.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.016+0000 7f1c72a00640 1 -- 172.21.15.1:0/1784923253 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c741a1af0 con 0x7f1c74103bb0 2024-09-15T22:25:00.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.016+0000 7f1c72000640 1 --2- 172.21.15.1:0/1784923253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c74104da0 0x7f1c7419a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:25:00.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.016+0000 7f1c73400640 1 --2- 172.21.15.1:0/1784923253 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c74105760 0x7f1c741a1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:25:00.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.016+0000 7f1c72a00640 1 --2- 172.21.15.1:0/1784923253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c74103bb0 0x7f1c74199ed0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1c6400e9c0 tx=0x7f1c6400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:00.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.017+0000 7f1c78a00640 1 -- 172.21.15.1:0/1784923253 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c6400cde0 con 0x7f1c74103bb0 2024-09-15T22:25:00.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.017+0000 7f1c78a00640 1 -- 172.21.15.1:0/1784923253 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c64010910 con 0x7f1c74103bb0 2024-09-15T22:25:00.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.017+0000 7f1c73e00640 1 -- 172.21.15.1:0/1784923253 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c741a1de0 con 0x7f1c74103bb0 2024-09-15T22:25:00.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.017+0000 7f1c78a00640 1 -- 172.21.15.1:0/1784923253 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c64018a10 con 0x7f1c74103bb0 2024-09-15T22:25:00.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.017+0000 7f1c73e00640 1 -- 172.21.15.1:0/1784923253 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c741a2250 con 0x7f1c74103bb0 2024-09-15T22:25:00.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.018+0000 7f1c73e00640 1 -- 172.21.15.1:0/1784923253 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c7410af40 con 0x7f1c74103bb0 2024-09-15T22:25:00.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.020+0000 7f1c78a00640 1 -- 172.21.15.1:0/1784923253 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f1c6401f020 con 0x7f1c74103bb0 2024-09-15T22:25:00.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.021+0000 7f1c78a00640 1 --2- 172.21.15.1:0/1784923253 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f1c580a32b0 0x7f1c580a5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:00.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.021+0000 7f1c78a00640 1 -- 172.21.15.1:0/1784923253 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f1c640cfb70 con 0x7f1c74103bb0 2024-09-15T22:25:00.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.021+0000 7f1c72000640 1 --2- 172.21.15.1:0/1784923253 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f1c580a32b0 0x7f1c580a5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:00.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.022+0000 7f1c72000640 1 --2- 172.21.15.1:0/1784923253 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f1c580a32b0 0x7f1c580a5770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1c60031440 tx=0x7f1c600315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:00.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.025+0000 7f1c78a00640 1 -- 172.21.15.1:0/1784923253 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1c6409c7d0 con 0x7f1c74103bb0 2024-09-15T22:25:00.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.249+0000 7f1c73e00640 1 -- 172.21.15.1:0/1784923253 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f1c74062ef0 con 0x7f1c74103bb0 2024-09-15T22:25:00.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.508+0000 7f1c78a00640 1 -- 172.21.15.1:0/1784923253 <== mon.2 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v26) ==== 117+0+0 (secure 0 0 0) 0x7f1c6409c0d0 con 0x7f1c74103bb0 2024-09-15T22:25:00.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.510+0000 7f1c73e00640 1 -- 172.21.15.1:0/1784923253 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f1c580a32b0 msgr2=0x7f1c580a5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:00.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.510+0000 7f1c73e00640 1 --2- 172.21.15.1:0/1784923253 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f1c580a32b0 0x7f1c580a5770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1c60031440 tx=0x7f1c600315b0 comp rx=0 tx=0).stop 2024-09-15T22:25:00.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.510+0000 7f1c73e00640 1 -- 172.21.15.1:0/1784923253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c74103bb0 msgr2=0x7f1c74199ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:00.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.510+0000 7f1c73e00640 1 --2- 172.21.15.1:0/1784923253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c74103bb0 0x7f1c74199ed0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1c6400e9c0 tx=0x7f1c6400ee80 comp rx=0 tx=0).stop 2024-09-15T22:25:00.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.510+0000 7f1c73e00640 1 -- 172.21.15.1:0/1784923253 shutdown_connections 2024-09-15T22:25:00.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.510+0000 7f1c73e00640 1 --2- 172.21.15.1:0/1784923253 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f1c580a32b0 0x7f1c580a5770 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:00.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.510+0000 7f1c73e00640 1 --2- 172.21.15.1:0/1784923253 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c74105760 0x7f1c741a1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:00.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.510+0000 7f1c73e00640 1 --2- 172.21.15.1:0/1784923253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c74104da0 0x7f1c7419a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:00.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.510+0000 7f1c73e00640 1 --2- 172.21.15.1:0/1784923253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c74103bb0 0x7f1c74199ed0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:00.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.510+0000 7f1c73e00640 1 -- 172.21.15.1:0/1784923253 >> 172.21.15.1:0/1784923253 conn(0x7f1c740ff310 msgr2=0x7f1c74108110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:00.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.511+0000 7f1c73e00640 1 -- 172.21.15.1:0/1784923253 shutdown_connections 2024-09-15T22:25:00.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:25:00.511+0000 7f1c73e00640 1 -- 172.21.15.1:0/1784923253 wait complete. 2024-09-15T22:25:00.528 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-15T22:25:00.539 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-15T22:25:00.550 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi001.front.sepia.ceph.com 2024-09-15T22:25:00.550 DEBUG:teuthology.orchestra.run.smithi001:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-15T22:25:00.554 INFO:teuthology.run_tasks:Running task workunit... 2024-09-15T22:25:00.567 INFO:tasks.workunit:Pulling workunits from ref ad35db06e8924912f01e32b35576297c0f1352b4 2024-09-15T22:25:00.568 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-15T22:25:00.568 INFO:tasks.workunit:timeout=6h 2024-09-15T22:25:00.568 INFO:tasks.workunit:cleanup=True 2024-09-15T22:25:00.568 DEBUG:teuthology.orchestra.run.smithi001:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-15T22:25:00.603 INFO:teuthology.orchestra.run.smithi001.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-15T22:25:00.604 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-15T22:25:00.604 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-15T22:25:00.604 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:25:00.604 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-15T22:25:00.604 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-09-15 22:23:15.934885637 +0000 2024-09-15T22:25:00.604 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-09-15 22:23:15.934885637 +0000 2024-09-15T22:25:00.604 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-09-15 22:24:59.339593894 +0000 2024-09-15T22:25:00.604 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-09-15 22:23:15.934885637 +0000 2024-09-15T22:25:00.604 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-15T22:25:00.605 DEBUG:teuthology.orchestra.run.smithi001:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-15T22:25:00.711 DEBUG:teuthology.orchestra.run.smithi001:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ad35db06e8924912f01e32b35576297c0f1352b4 2024-09-15T22:25:00.749 INFO:tasks.workunit.client.0.smithi001.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-15T22:25:00.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:00 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/1784923253' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-15T22:25:00.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:00 smithi098 ceph-mon[35514]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-15T22:25:00.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:00 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/1784923253' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-15T22:25:00.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:00 smithi001 ceph-mon[30843]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-15T22:25:00.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:00 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/1784923253' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-15T22:25:00.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:00 smithi012 ceph-mon[34883]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-15T22:25:01.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:01 smithi098 ceph-mon[35514]: pgmap v360: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-15T22:25:01.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:01 smithi098 ceph-mon[35514]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-15T22:25:01.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:01 smithi098 ceph-mon[35514]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-15T22:25:01.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:01 smithi001 ceph-mon[30843]: pgmap v360: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-15T22:25:01.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:01 smithi001 ceph-mon[30843]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-15T22:25:01.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:01 smithi001 ceph-mon[30843]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-15T22:25:01.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:01 smithi012 ceph-mon[34883]: pgmap v360: 97 pgs: 97 active+clean; 640 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-15T22:25:01.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:01 smithi012 ceph-mon[34883]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-15T22:25:01.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:01 smithi012 ceph-mon[34883]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-15T22:25:03.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:03 smithi098 ceph-mon[35514]: pgmap v361: 97 pgs: 97 active+clean; 641 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-15T22:25:03.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:03 smithi001 ceph-mon[30843]: pgmap v361: 97 pgs: 97 active+clean; 641 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-15T22:25:03.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:03 smithi012 ceph-mon[34883]: pgmap v361: 97 pgs: 97 active+clean; 641 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-15T22:25:05.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:05 smithi098 ceph-mon[35514]: pgmap v362: 97 pgs: 97 active+clean; 641 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-15T22:25:05.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:05 smithi001 ceph-mon[30843]: pgmap v362: 97 pgs: 97 active+clean; 641 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-15T22:25:05.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:05 smithi012 ceph-mon[34883]: pgmap v362: 97 pgs: 97 active+clean; 641 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-15T22:25:07.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:07 smithi098 ceph-mon[35514]: pgmap v363: 97 pgs: 97 active+clean; 652 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-15T22:25:07.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:07 smithi001 ceph-mon[30843]: pgmap v363: 97 pgs: 97 active+clean; 652 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-15T22:25:07.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:07 smithi012 ceph-mon[34883]: pgmap v363: 97 pgs: 97 active+clean; 652 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-15T22:25:09.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:09 smithi098 ceph-mon[35514]: pgmap v364: 97 pgs: 97 active+clean; 652 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-15T22:25:09.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:09 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:25:09.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:09 smithi001 ceph-mon[30843]: pgmap v364: 97 pgs: 97 active+clean; 652 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-15T22:25:09.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:09 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:25:09.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:09 smithi012 ceph-mon[34883]: pgmap v364: 97 pgs: 97 active+clean; 652 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-15T22:25:09.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:09 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:25:11.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:11 smithi098 ceph-mon[35514]: pgmap v365: 97 pgs: 97 active+clean; 652 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-15T22:25:11.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:11 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:25:11.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:11 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:25:11.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:11 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:25:11.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:11 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:25:11.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:11 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:25:11.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:11 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:25:11.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:11 smithi001 ceph-mon[30843]: pgmap v365: 97 pgs: 97 active+clean; 652 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-15T22:25:11.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:11 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:25:11.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:11 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:25:11.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:11 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:25:11.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:11 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:25:11.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:11 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:25:11.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:11 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:25:11.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:11 smithi012 ceph-mon[34883]: pgmap v365: 97 pgs: 97 active+clean; 652 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-15T22:25:11.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:11 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:25:11.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:11 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:25:11.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:11 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:25:11.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:11 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:25:11.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:11 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:25:11.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:11 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:25:12.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:12 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:25:12.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:12 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:25:12.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:12 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:25:12.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:12 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:25:12.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:12 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:25:12.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:12 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:25:12.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:12 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:25:12.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:12 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:25:12.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:12 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:25:13.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.755+0000 7f6397200640 1 -- 172.21.15.1:0/209169591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6398102420 msgr2=0x7f6398104810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:13.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.755+0000 7f6397200640 1 --2- 172.21.15.1:0/209169591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6398102420 0x7f6398104810 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6388009900 tx=0x7f638802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.755+0000 7f6397200640 1 -- 172.21.15.1:0/209169591 shutdown_connections 2024-09-15T22:25:13.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.755+0000 7f6397200640 1 --2- 172.21.15.1:0/209169591 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6398107680 0x7f6398109af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.755+0000 7f6397200640 1 --2- 172.21.15.1:0/209169591 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6398104d50 0x7f6398107140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.755+0000 7f6397200640 1 --2- 172.21.15.1:0/209169591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6398102420 0x7f6398104810 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.755+0000 7f6397200640 1 -- 172.21.15.1:0/209169591 >> 172.21.15.1:0/209169591 conn(0x7f63980fc040 msgr2=0x7f63980fe460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:13.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.755+0000 7f6397200640 1 -- 172.21.15.1:0/209169591 shutdown_connections 2024-09-15T22:25:13.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.755+0000 7f6397200640 1 -- 172.21.15.1:0/209169591 wait complete. 2024-09-15T22:25:13.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.756+0000 7f6397200640 1 Processor -- start 2024-09-15T22:25:13.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.756+0000 7f6397200640 1 -- start start 2024-09-15T22:25:13.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.757+0000 7f6397200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6398102420 0x7f6398199ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:13.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.757+0000 7f6397200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6398104d50 0x7f639819a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:13.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.757+0000 7f6397200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6398107680 0x7f63981a1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:13.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.757+0000 7f6397200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f639810d660 con 0x7f6398104d50 2024-09-15T22:25:13.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.757+0000 7f6397200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f639810d4e0 con 0x7f6398107680 2024-09-15T22:25:13.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.757+0000 7f6397200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f639810d7e0 con 0x7f6398102420 2024-09-15T22:25:13.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.757+0000 7f6395400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6398104d50 0x7f639819a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:13.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.757+0000 7f6395400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6398104d50 0x7f639819a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53752/0 (socket says 172.21.15.1:53752) 2024-09-15T22:25:13.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.757+0000 7f6395400640 1 -- 172.21.15.1:0/1384923167 learned_addr learned my addr 172.21.15.1:0/1384923167 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:25:13.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.757+0000 7f6395e00640 1 --2- 172.21.15.1:0/1384923167 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6398102420 0x7f6398199ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:13.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.757+0000 7f6396800640 1 --2- 172.21.15.1:0/1384923167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6398107680 0x7f63981a1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:13.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.757+0000 7f6395400640 1 -- 172.21.15.1:0/1384923167 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6398102420 msgr2=0x7f6398199ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:13.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.757+0000 7f6395400640 1 --2- 172.21.15.1:0/1384923167 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6398102420 0x7f6398199ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.757+0000 7f6395400640 1 -- 172.21.15.1:0/1384923167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6398107680 msgr2=0x7f63981a1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:13.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.757+0000 7f6395400640 1 --2- 172.21.15.1:0/1384923167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6398107680 0x7f63981a1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.757+0000 7f6395400640 1 -- 172.21.15.1:0/1384923167 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63981a1b00 con 0x7f6398104d50 2024-09-15T22:25:13.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.758+0000 7f6395400640 1 --2- 172.21.15.1:0/1384923167 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6398104d50 0x7f639819a420 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f638400e9c0 tx=0x7f638400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:13.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.758+0000 7f638ea00640 1 -- 172.21.15.1:0/1384923167 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638400cd80 con 0x7f6398104d50 2024-09-15T22:25:13.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.758+0000 7f638ea00640 1 -- 172.21.15.1:0/1384923167 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6384005500 con 0x7f6398104d50 2024-09-15T22:25:13.762 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.758+0000 7f638ea00640 1 -- 172.21.15.1:0/1384923167 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6384010690 con 0x7f6398104d50 2024-09-15T22:25:13.762 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.758+0000 7f6397200640 1 -- 172.21.15.1:0/1384923167 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63981a1df0 con 0x7f6398104d50 2024-09-15T22:25:13.762 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.758+0000 7f6397200640 1 -- 172.21.15.1:0/1384923167 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63981a2300 con 0x7f6398104d50 2024-09-15T22:25:13.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.761+0000 7f639fc8b740 1 Processor -- start 2024-09-15T22:25:13.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.761+0000 7f639fc8b740 1 -- start start 2024-09-15T22:25:13.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.762+0000 7f639fc8b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4f29260 0x562cc4f29660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:13.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.762+0000 7f639fc8b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562cc4f29ba0 0x562cc4f2e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:13.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.762+0000 7f639fc8b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562cc4f2ec30 0x562cc4f310f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:13.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.762+0000 7f639fc8b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562cc4e8e100 con 0x562cc4f29260 2024-09-15T22:25:13.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.762+0000 7f639fc8b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x562cc4e361b0 con 0x562cc4f29ba0 2024-09-15T22:25:13.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.762+0000 7f639fc8b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562cc4e8a0c0 con 0x562cc4f2ec30 2024-09-15T22:25:13.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.762+0000 7f638ea00640 1 -- 172.21.15.1:0/1384923167 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f63840046c0 con 0x7f6398104d50 2024-09-15T22:25:13.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.762+0000 7f6396800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4f29260 0x562cc4f29660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:13.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.762+0000 7f6396800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4f29260 0x562cc4f29660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53766/0 (socket says 172.21.15.1:53766) 2024-09-15T22:25:13.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.762+0000 7f6395e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562cc4f29ba0 0x562cc4f2e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:13.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.762+0000 7f6396800640 1 -- 172.21.15.1:0/2599128506 learned_addr learned my addr 172.21.15.1:0/2599128506 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:25:13.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.762+0000 7f6395400640 1 --2- 172.21.15.1:0/2599128506 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562cc4f2ec30 0x562cc4f310f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:13.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.763+0000 7f6396800640 1 -- 172.21.15.1:0/2599128506 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562cc4f2ec30 msgr2=0x562cc4f310f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:13.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.763+0000 7f6396800640 1 --2- 172.21.15.1:0/2599128506 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562cc4f2ec30 0x562cc4f310f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.763+0000 7f6396800640 1 -- 172.21.15.1:0/2599128506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562cc4f29ba0 msgr2=0x562cc4f2e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:13.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.763+0000 7f6396800640 1 --2- 172.21.15.1:0/2599128506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562cc4f29ba0 0x562cc4f2e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.763+0000 7f6396800640 1 -- 172.21.15.1:0/2599128506 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cc4ba1210 con 0x562cc4f29260 2024-09-15T22:25:13.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.763+0000 7f6395e00640 1 --2- 172.21.15.1:0/2599128506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562cc4f29ba0 0x562cc4f2e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:25:13.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.763+0000 7f6396800640 1 --2- 172.21.15.1:0/2599128506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4f29260 0x562cc4f29660 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6390009f90 tx=0x7f63900118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98eb270a88f610ef server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:13.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.763+0000 7f6383400640 1 -- 172.21.15.1:0/2599128506 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6390004d20 con 0x562cc4f29260 2024-09-15T22:25:13.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.763+0000 7f6383400640 1 -- 172.21.15.1:0/2599128506 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6390004050 con 0x562cc4f29260 2024-09-15T22:25:13.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.763+0000 7f6383400640 1 -- 172.21.15.1:0/2599128506 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6390005240 con 0x562cc4f29260 2024-09-15T22:25:13.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.763+0000 7f638ea00640 1 --2- 172.21.15.1:0/1384923167 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f637c0a32b0 0x7f637c0a5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:13.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.764+0000 7f638ea00640 1 -- 172.21.15.1:0/1384923167 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f63840cfc60 con 0x7f6398104d50 2024-09-15T22:25:13.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.764+0000 7f6395e00640 1 --2- 172.21.15.1:0/1384923167 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f637c0a32b0 0x7f637c0a5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:13.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.764+0000 7f639fc8b740 1 -- 172.21.15.1:0/2599128506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4f29260 msgr2=0x562cc4f29660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:13.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.764+0000 7f639fc8b740 1 --2- 172.21.15.1:0/2599128506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4f29260 0x562cc4f29660 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6390009f90 tx=0x7f63900118d0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.764+0000 7f639fc8b740 1 -- 172.21.15.1:0/2599128506 shutdown_connections 2024-09-15T22:25:13.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.764+0000 7f639fc8b740 1 --2- 172.21.15.1:0/2599128506 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562cc4f2ec30 0x562cc4f310f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.764+0000 7f639fc8b740 1 --2- 172.21.15.1:0/2599128506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562cc4f29ba0 0x562cc4f2e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.764+0000 7f639fc8b740 1 --2- 172.21.15.1:0/2599128506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4f29260 0x562cc4f29660 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.764+0000 7f639fc8b740 1 -- 172.21.15.1:0/2599128506 >> 172.21.15.1:0/2599128506 conn(0x562cc4f248d0 msgr2=0x562cc4f24cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:13.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.764+0000 7f639fc8b740 1 -- 172.21.15.1:0/2599128506 shutdown_connections 2024-09-15T22:25:13.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.764+0000 7f639fc8b740 1 -- 172.21.15.1:0/2599128506 wait complete. 2024-09-15T22:25:13.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.764+0000 7f6395e00640 1 --2- 172.21.15.1:0/1384923167 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f637c0a32b0 0x7f637c0a5770 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f63880314e0 tx=0x7f6388005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:13.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.765+0000 7f639fc8b740 1 -- start start 2024-09-15T22:25:13.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.765+0000 7f639fc8b740 1 Processor -- start 2024-09-15T22:25:13.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.765+0000 7f639fc8b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562cc4f29260 0x562cc4f33350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:13.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.765+0000 7f639fc8b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562cc4f29ba0 0x562cc4f33890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:13.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.765+0000 7f639fc8b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4f2ec30 0x562cc4f3a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:13.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.765+0000 7f639fc8b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562cc4f31c00 con 0x562cc4f2ec30 2024-09-15T22:25:13.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.765+0000 7f639fc8b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x562cc4e17090 con 0x562cc4f29260 2024-09-15T22:25:13.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.765+0000 7f639fc8b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562cc4f31d80 con 0x562cc4f29ba0 2024-09-15T22:25:13.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.766+0000 7f639fc8b740 10 client.0 _ll_register_callbacks cb 0x562cc4e6bf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:25:13.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.766+0000 7f6395e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562cc4f29260 0x562cc4f33350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:13.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.766+0000 7f6395e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562cc4f29260 0x562cc4f33350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:53490/0 (socket says 172.21.15.1:53490) 2024-09-15T22:25:13.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.766+0000 7f6395e00640 1 -- 172.21.15.1:0/3487407883 learned_addr learned my addr 172.21.15.1:0/3487407883 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:25:13.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.766+0000 7f6396800640 1 --2- 172.21.15.1:0/3487407883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4f2ec30 0x562cc4f3a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:13.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.766+0000 7f6395400640 1 --2- 172.21.15.1:0/3487407883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562cc4f29ba0 0x562cc4f33890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:13.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.766+0000 7f6395e00640 1 -- 172.21.15.1:0/3487407883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562cc4f29ba0 msgr2=0x562cc4f33890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:13.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.766+0000 7f6395e00640 1 --2- 172.21.15.1:0/3487407883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562cc4f29ba0 0x562cc4f33890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.766+0000 7f6395e00640 1 -- 172.21.15.1:0/3487407883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4f2ec30 msgr2=0x562cc4f3a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:13.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.766+0000 7f6395e00640 1 --2- 172.21.15.1:0/3487407883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4f2ec30 0x562cc4f3a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.766+0000 7f6395e00640 1 -- 172.21.15.1:0/3487407883 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cc4c6d620 con 0x562cc4f29260 2024-09-15T22:25:13.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.766+0000 7f6395400640 1 --2- 172.21.15.1:0/3487407883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562cc4f29ba0 0x562cc4f33890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:25:13.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.767+0000 7f6395e00640 1 --2- 172.21.15.1:0/3487407883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562cc4f29260 0x562cc4f33350 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6388033000 tx=0x7f6388009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcde57b85f2b93c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:13.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.767+0000 7f6377e00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-15T22:25:13.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.767+0000 7f6377e00640 1 -- 172.21.15.1:0/3487407883 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638804d030 con 0x562cc4f29260 2024-09-15T22:25:13.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.767+0000 7f639fc8b740 1 -- 172.21.15.1:0/3487407883 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6390004050 con 0x562cc4f29260 2024-09-15T22:25:13.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.767+0000 7f6377e00640 1 -- 172.21.15.1:0/3487407883 <== mon.2 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f6388004990 con 0x562cc4f29260 2024-09-15T22:25:13.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.767+0000 7f6377e00640 1 -- 172.21.15.1:0/3487407883 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6388035040 con 0x562cc4f29260 2024-09-15T22:25:13.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.767+0000 7f639fc8b740 10 client.25052 fetch_fsmap learned FSMap version 26 2024-09-15T22:25:13.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.767+0000 7f639fc8b740 1 -- 172.21.15.1:0/3487407883 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562cc4f3d780 con 0x562cc4f29260 2024-09-15T22:25:13.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.768+0000 7f6377e00640 1 -- 172.21.15.1:0/3487407883 <== mon.2 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6390004050 con 0x562cc4f29260 2024-09-15T22:25:13.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.768+0000 7f6377e00640 1 -- 172.21.15.1:0/3487407883 <== mon.2 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f638803db90 con 0x562cc4f29260 2024-09-15T22:25:13.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.768+0000 7f639fc8b740 10 client.25052 fetch_fsmap finished waiting for FSMap version 26 2024-09-15T22:25:13.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.768+0000 7f639fc8b740 10 client.25052 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T22:25:13.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.768+0000 7f639fc8b740 20 client.25052 populate_metadata read hostname 'smithi001' 2024-09-15T22:25:13.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.768+0000 7f639fc8b740 1 --2- 172.21.15.1:0/3487407883 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x562cc4f3ee50 0x562cc4f412c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:13.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.768+0000 7f639fc8b740 4 client.25052 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:25:13.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.768+0000 7f639fc8b740 1 -- 172.21.15.1:0/3487407883 --> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562cc4e9b830 con 0x562cc4f3ee50 2024-09-15T22:25:13.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.768+0000 7f6395400640 1 --2- 172.21.15.1:0/3487407883 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x562cc4f3ee50 0x562cc4f412c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:13.775 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.769+0000 7f6395400640 1 --2- 172.21.15.1:0/3487407883 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x562cc4f3ee50 0x562cc4f412c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c93731d9689bac4 server_cookie=c5f9ccec8e159d6d in_seq=0 out_seq=0 2024-09-15T22:25:13.775 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.769+0000 7f6377e00640 10 client.25052 ms_handle_connect on v2:172.21.15.98:6838/2831161859 2024-09-15T22:25:13.775 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.770+0000 7f6377e00640 1 -- 172.21.15.1:0/3487407883 <== mds.0 v2:172.21.15.98:6838/2831161859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f638407ae50 con 0x562cc4f3ee50 2024-09-15T22:25:13.775 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.770+0000 7f6377e00640 10 client.25052 handle_command_reply: tid=0 2024-09-15T22:25:13.775 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.770+0000 7f639fc8b740 1 client.25052 shutdown 2024-09-15T22:25:13.775 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.770+0000 7f639fc8b740 1 -- 172.21.15.1:0/3487407883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562cc4f29260 msgr2=0x562cc4f33350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:13.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.770+0000 7f639fc8b740 1 --2- 172.21.15.1:0/3487407883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562cc4f29260 0x562cc4f33350 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6388033000 tx=0x7f6388009260 comp rx=0 tx=0).stop 2024-09-15T22:25:13.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.770+0000 7f639fc8b740 1 -- 172.21.15.1:0/3487407883 shutdown_connections 2024-09-15T22:25:13.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.770+0000 7f639fc8b740 1 --2- 172.21.15.1:0/3487407883 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x562cc4f3ee50 0x562cc4f412c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.770+0000 7f639fc8b740 1 --2- 172.21.15.1:0/3487407883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4f2ec30 0x562cc4f3a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.770+0000 7f639fc8b740 1 --2- 172.21.15.1:0/3487407883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562cc4f29ba0 0x562cc4f33890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.770+0000 7f639fc8b740 1 --2- 172.21.15.1:0/3487407883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562cc4f29260 0x562cc4f33350 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.770+0000 7f6377e00640 0 client.25052 ms_handle_reset on v2:172.21.15.98:6838/2831161859 2024-09-15T22:25:13.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.770+0000 7f639fc8b740 1 -- 172.21.15.1:0/3487407883 >> 172.21.15.1:0/3487407883 conn(0x562cc4f248d0 msgr2=0x562cc4f260e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:13.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.770+0000 7f639fc8b740 1 -- 172.21.15.1:0/3487407883 shutdown_connections 2024-09-15T22:25:13.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.770+0000 7f639fc8b740 1 -- 172.21.15.1:0/3487407883 wait complete. 2024-09-15T22:25:13.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.770+0000 7f639fc8b740 20 client.25052 trim_cache size 0 max 16384 2024-09-15T22:25:13.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.786+0000 7f639fc8b740 1 Processor -- start 2024-09-15T22:25:13.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.786+0000 7f639fc8b740 1 -- start start 2024-09-15T22:25:13.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.786+0000 7f639fc8b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562cc4f29260 0x562cc4f33920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:13.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.786+0000 7f639fc8b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562cc4f29ba0 0x562cc4f3a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:13.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.786+0000 7f639fc8b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4f2ec30 0x562cc4f25ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:13.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.786+0000 7f639fc8b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f63981adb40 con 0x562cc4f2ec30 2024-09-15T22:25:13.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.786+0000 7f639fc8b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f63981ab410 con 0x562cc4f29ba0 2024-09-15T22:25:13.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.786+0000 7f639fc8b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f63981a9260 con 0x562cc4f29260 2024-09-15T22:25:13.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.786+0000 7f6396800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4f2ec30 0x562cc4f25ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:13.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.786+0000 7f6396800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4f2ec30 0x562cc4f25ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53776/0 (socket says 172.21.15.1:53776) 2024-09-15T22:25:13.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.786+0000 7f6396800640 1 -- 172.21.15.1:0/3802069305 learned_addr learned my addr 172.21.15.1:0/3802069305 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:25:13.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.786+0000 7f6395e00640 1 --2- 172.21.15.1:0/3802069305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562cc4f29260 0x562cc4f33920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:13.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.786+0000 7f6395400640 1 --2- 172.21.15.1:0/3802069305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562cc4f29ba0 0x562cc4f3a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:13.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.787+0000 7f6395e00640 1 -- 172.21.15.1:0/3802069305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562cc4f29ba0 msgr2=0x562cc4f3a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:13.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.787+0000 7f6395e00640 1 --2- 172.21.15.1:0/3802069305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562cc4f29ba0 0x562cc4f3a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.787+0000 7f6395e00640 1 -- 172.21.15.1:0/3802069305 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4f2ec30 msgr2=0x562cc4f25ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:13.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.787+0000 7f6395e00640 1 --2- 172.21.15.1:0/3802069305 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4f2ec30 0x562cc4f25ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.787+0000 7f6395e00640 1 -- 172.21.15.1:0/3802069305 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cc4f2a080 con 0x562cc4f29260 2024-09-15T22:25:13.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.787+0000 7f6396800640 1 --2- 172.21.15.1:0/3802069305 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4f2ec30 0x562cc4f25ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:25:13.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.787+0000 7f6395e00640 1 --2- 172.21.15.1:0/3802069305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562cc4f29260 0x562cc4f33920 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6388049440 tx=0x7f638802a3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba30d0adcce82879 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:13.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.787+0000 7f6382a00640 1 -- 172.21.15.1:0/3802069305 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638804d070 con 0x562cc4f29260 2024-09-15T22:25:13.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.787+0000 7f6382a00640 1 -- 172.21.15.1:0/3802069305 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6388005600 con 0x562cc4f29260 2024-09-15T22:25:13.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.787+0000 7f6382a00640 1 -- 172.21.15.1:0/3802069305 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6388004990 con 0x562cc4f29260 2024-09-15T22:25:13.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.788+0000 7f639fc8b740 1 -- 172.21.15.1:0/3802069305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562cc4f29260 msgr2=0x562cc4f33920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:13.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.788+0000 7f639fc8b740 1 --2- 172.21.15.1:0/3802069305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562cc4f29260 0x562cc4f33920 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6388049440 tx=0x7f638802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.788+0000 7f639fc8b740 1 -- 172.21.15.1:0/3802069305 shutdown_connections 2024-09-15T22:25:13.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.788+0000 7f639fc8b740 1 --2- 172.21.15.1:0/3802069305 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4f2ec30 0x562cc4f25ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.788+0000 7f639fc8b740 1 --2- 172.21.15.1:0/3802069305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562cc4f29ba0 0x562cc4f3a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.788+0000 7f639fc8b740 1 --2- 172.21.15.1:0/3802069305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562cc4f29260 0x562cc4f33920 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.788+0000 7f639fc8b740 1 -- 172.21.15.1:0/3802069305 >> 172.21.15.1:0/3802069305 conn(0x562cc4f248d0 msgr2=0x562cc4f257e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:13.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.788+0000 7f639fc8b740 1 -- 172.21.15.1:0/3802069305 shutdown_connections 2024-09-15T22:25:13.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.788+0000 7f639fc8b740 1 -- 172.21.15.1:0/3802069305 wait complete. 2024-09-15T22:25:13.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.789+0000 7f639fc8b740 1 -- start start 2024-09-15T22:25:13.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.789+0000 7f639fc8b740 1 Processor -- start 2024-09-15T22:25:13.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.789+0000 7f639fc8b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562cc4f29260 0x562cc4f382a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:13.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.789+0000 7f639fc8b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4f29ba0 0x562cc4f387e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:13.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.789+0000 7f639fc8b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562cc4f2ec30 0x562cc4f397f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:13.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.789+0000 7f639fc8b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f63981a98d0 con 0x562cc4f29ba0 2024-09-15T22:25:13.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.789+0000 7f639fc8b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f63981aad40 con 0x562cc4f2ec30 2024-09-15T22:25:13.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.789+0000 7f639fc8b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f63981a9fa0 con 0x562cc4f29260 2024-09-15T22:25:13.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.789+0000 7f639fc8b740 10 client.0 _ll_register_callbacks cb 0x7f6388009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:25:13.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.789+0000 7f6395e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562cc4f29260 0x562cc4f382a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:13.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.789+0000 7f6395e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562cc4f29260 0x562cc4f382a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:49918/0 (socket says 172.21.15.1:49918) 2024-09-15T22:25:13.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.789+0000 7f6395e00640 1 -- 172.21.15.1:0/4129898401 learned_addr learned my addr 172.21.15.1:0/4129898401 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:25:13.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.789+0000 7f6396800640 1 --2- 172.21.15.1:0/4129898401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562cc4f2ec30 0x562cc4f397f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:13.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.790+0000 7f6395400640 1 --2- 172.21.15.1:0/4129898401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4f29ba0 0x562cc4f387e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:13.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.790+0000 7f6395e00640 1 -- 172.21.15.1:0/4129898401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562cc4f2ec30 msgr2=0x562cc4f397f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:13.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.790+0000 7f6395e00640 1 --2- 172.21.15.1:0/4129898401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562cc4f2ec30 0x562cc4f397f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.790+0000 7f6395e00640 1 -- 172.21.15.1:0/4129898401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4f29ba0 msgr2=0x562cc4f387e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:13.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.790+0000 7f6395e00640 1 --2- 172.21.15.1:0/4129898401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4f29ba0 0x562cc4f387e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.790+0000 7f6395e00640 1 -- 172.21.15.1:0/4129898401 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cc4f39e00 con 0x562cc4f29260 2024-09-15T22:25:13.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.790+0000 7f6395400640 1 --2- 172.21.15.1:0/4129898401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4f29ba0 0x562cc4f387e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:25:13.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.790+0000 7f6395e00640 1 --2- 172.21.15.1:0/4129898401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562cc4f29260 0x562cc4f382a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6388033000 tx=0x7f6388004bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ccb453cb7314e5b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:13.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.790+0000 7f6377e00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-15T22:25:13.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.790+0000 7f6377e00640 1 -- 172.21.15.1:0/4129898401 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638806a060 con 0x562cc4f29260 2024-09-15T22:25:13.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.790+0000 7f639fc8b740 1 -- 172.21.15.1:0/4129898401 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6388005600 con 0x562cc4f29260 2024-09-15T22:25:13.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.790+0000 7f6377e00640 1 -- 172.21.15.1:0/4129898401 <== mon.1 v2:172.21.15.98:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f63880497f0 con 0x562cc4f29260 2024-09-15T22:25:13.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.791+0000 7f6377e00640 1 -- 172.21.15.1:0/4129898401 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f638804d040 con 0x562cc4f29260 2024-09-15T22:25:13.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.791+0000 7f639fc8b740 10 client.25090 fetch_fsmap learned FSMap version 26 2024-09-15T22:25:13.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.791+0000 7f639fc8b740 1 -- 172.21.15.1:0/4129898401 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562cc4fa9de0 con 0x562cc4f29260 2024-09-15T22:25:13.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.791+0000 7f6377e00640 1 -- 172.21.15.1:0/4129898401 <== mon.1 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6388005600 con 0x562cc4f29260 2024-09-15T22:25:13.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.791+0000 7f6377e00640 1 -- 172.21.15.1:0/4129898401 <== mon.1 v2:172.21.15.98:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f6388003ce0 con 0x562cc4f29260 2024-09-15T22:25:13.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.791+0000 7f639fc8b740 10 client.25090 fetch_fsmap finished waiting for FSMap version 26 2024-09-15T22:25:13.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.791+0000 7f639fc8b740 10 client.25090 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T22:25:13.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.791+0000 7f639fc8b740 20 client.25090 populate_metadata read hostname 'smithi001' 2024-09-15T22:25:13.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.791+0000 7f639fc8b740 1 --2- 172.21.15.1:0/4129898401 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x562cc4faa680 0x562cc4facaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:13.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.791+0000 7f639fc8b740 4 client.25090 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:25:13.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.791+0000 7f639fc8b740 1 -- 172.21.15.1:0/4129898401 --> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562cc4e95b80 con 0x562cc4faa680 2024-09-15T22:25:13.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.792+0000 7f6395400640 1 --2- 172.21.15.1:0/4129898401 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x562cc4faa680 0x562cc4facaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:13.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.792+0000 7f6395400640 1 --2- 172.21.15.1:0/4129898401 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x562cc4faa680 0x562cc4facaa0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90c9d42321e79b2d server_cookie=e40dcf717d28c75f in_seq=0 out_seq=0 2024-09-15T22:25:13.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.792+0000 7f6377e00640 10 client.25090 ms_handle_connect on v2:172.21.15.98:6838/2831161859 2024-09-15T22:25:13.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.804+0000 7f6377e00640 1 -- 172.21.15.1:0/4129898401 <== mds.0 v2:172.21.15.98:6838/2831161859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562cc4e95b80 con 0x562cc4faa680 2024-09-15T22:25:13.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.804+0000 7f6377e00640 10 client.25090 handle_command_reply: tid=0 2024-09-15T22:25:13.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.804+0000 7f639fc8b740 1 client.25090 shutdown 2024-09-15T22:25:13.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.804+0000 7f639fc8b740 1 -- 172.21.15.1:0/4129898401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562cc4f29260 msgr2=0x562cc4f382a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:13.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.804+0000 7f639fc8b740 1 --2- 172.21.15.1:0/4129898401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562cc4f29260 0x562cc4f382a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6388033000 tx=0x7f6388004bc0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.804+0000 7f639fc8b740 1 -- 172.21.15.1:0/4129898401 shutdown_connections 2024-09-15T22:25:13.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.804+0000 7f639fc8b740 1 --2- 172.21.15.1:0/4129898401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562cc4f2ec30 0x562cc4f397f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.804+0000 7f639fc8b740 1 --2- 172.21.15.1:0/4129898401 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x562cc4faa680 0x562cc4facaa0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.804+0000 7f639fc8b740 1 --2- 172.21.15.1:0/4129898401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4f29ba0 0x562cc4f387e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.804+0000 7f639fc8b740 1 --2- 172.21.15.1:0/4129898401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562cc4f29260 0x562cc4f382a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.804+0000 7f6377e00640 0 client.25090 ms_handle_reset on v2:172.21.15.98:6838/2831161859 2024-09-15T22:25:13.808 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.804+0000 7f639fc8b740 1 -- 172.21.15.1:0/4129898401 >> 172.21.15.1:0/4129898401 conn(0x562cc4f248d0 msgr2=0x562cc4f23a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:13.808 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.804+0000 7f639fc8b740 1 -- 172.21.15.1:0/4129898401 shutdown_connections 2024-09-15T22:25:13.808 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.804+0000 7f639fc8b740 1 -- 172.21.15.1:0/4129898401 wait complete. 2024-09-15T22:25:13.808 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.805+0000 7f639fc8b740 20 client.25090 trim_cache size 0 max 16384 2024-09-15T22:25:13.808 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-15T22:25:13.808 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-15T22:25:13.808 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-15T22:25:13.808 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-15T22:25:13.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.805+0000 7f6397200640 1 -- 172.21.15.1:0/1384923167 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f637c0a32b0 msgr2=0x7f637c0a5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:13.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.805+0000 7f6397200640 1 --2- 172.21.15.1:0/1384923167 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f637c0a32b0 0x7f637c0a5770 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f63880314e0 tx=0x7f6388005fd0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.805+0000 7f6397200640 1 -- 172.21.15.1:0/1384923167 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6398104d50 msgr2=0x7f639819a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:13.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.805+0000 7f6397200640 1 --2- 172.21.15.1:0/1384923167 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6398104d50 0x7f639819a420 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f638400e9c0 tx=0x7f638400ee80 comp rx=0 tx=0).stop 2024-09-15T22:25:13.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.805+0000 7f6397200640 1 -- 172.21.15.1:0/1384923167 shutdown_connections 2024-09-15T22:25:13.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.805+0000 7f6397200640 1 --2- 172.21.15.1:0/1384923167 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f637c0a32b0 0x7f637c0a5770 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.805+0000 7f6397200640 1 --2- 172.21.15.1:0/1384923167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6398107680 0x7f63981a1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.805+0000 7f6397200640 1 --2- 172.21.15.1:0/1384923167 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6398104d50 0x7f639819a420 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.805+0000 7f6397200640 1 --2- 172.21.15.1:0/1384923167 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6398102420 0x7f6398199ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:13.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.805+0000 7f6397200640 1 -- 172.21.15.1:0/1384923167 >> 172.21.15.1:0/1384923167 conn(0x7f63980fc040 msgr2=0x7f6398101b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:13.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.805+0000 7f6397200640 1 -- 172.21.15.1:0/1384923167 shutdown_connections 2024-09-15T22:25:13.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:13.805+0000 7f6397200640 1 -- 172.21.15.1:0/1384923167 wait complete. 2024-09-15T22:25:13.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:13 smithi098 ceph-mon[35514]: pgmap v366: 97 pgs: 97 active+clean; 652 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-15T22:25:13.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:13 smithi001 ceph-mon[30843]: pgmap v366: 97 pgs: 97 active+clean; 652 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-15T22:25:13.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:13 smithi012 ceph-mon[34883]: pgmap v366: 97 pgs: 97 active+clean; 652 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-15T22:25:14.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:14 smithi001 ceph-mon[30843]: pgmap v367: 97 pgs: 97 active+clean; 652 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-15T22:25:14.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:14 smithi012 ceph-mon[34883]: pgmap v367: 97 pgs: 97 active+clean; 652 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-15T22:25:15.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:14 smithi098 ceph-mon[35514]: pgmap v367: 97 pgs: 97 active+clean; 652 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-15T22:25:16.875 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:16 smithi001 ceph-mon[30843]: pgmap v368: 97 pgs: 97 active+clean; 657 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2024-09-15T22:25:16.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:16 smithi012 ceph-mon[34883]: pgmap v368: 97 pgs: 97 active+clean; 657 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2024-09-15T22:25:17.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:16 smithi098 ceph-mon[35514]: pgmap v368: 97 pgs: 97 active+clean; 657 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2024-09-15T22:25:18.863 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:18 smithi098 ceph-mon[35514]: pgmap v369: 97 pgs: 97 active+clean; 657 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-15T22:25:18.875 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:18 smithi001 ceph-mon[30843]: pgmap v369: 97 pgs: 97 active+clean; 657 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-15T22:25:18.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:18 smithi012 ceph-mon[34883]: pgmap v369: 97 pgs: 97 active+clean; 657 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-15T22:25:20.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:20 smithi001 ceph-mon[30843]: pgmap v370: 97 pgs: 97 active+clean; 657 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-09-15T22:25:20.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:20 smithi012 ceph-mon[34883]: pgmap v370: 97 pgs: 97 active+clean; 657 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-09-15T22:25:21.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:20 smithi098 ceph-mon[35514]: pgmap v370: 97 pgs: 97 active+clean; 657 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-09-15T22:25:22.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:22 smithi001 ceph-mon[30843]: pgmap v371: 97 pgs: 97 active+clean; 657 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-09-15T22:25:22.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:22 smithi012 ceph-mon[34883]: pgmap v371: 97 pgs: 97 active+clean; 657 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-09-15T22:25:23.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:22 smithi098 ceph-mon[35514]: pgmap v371: 97 pgs: 97 active+clean; 657 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-09-15T22:25:24.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:24 smithi001 ceph-mon[30843]: pgmap v372: 97 pgs: 97 active+clean; 657 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-15T22:25:24.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:24 smithi012 ceph-mon[34883]: pgmap v372: 97 pgs: 97 active+clean; 657 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-15T22:25:25.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:24 smithi098 ceph-mon[35514]: pgmap v372: 97 pgs: 97 active+clean; 657 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-15T22:25:26.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:26 smithi001 ceph-mon[30843]: pgmap v373: 97 pgs: 97 active+clean; 657 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-15T22:25:26.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.924+0000 7f91b3200640 1 -- 172.21.15.1:0/3617248401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91b4074c50 msgr2=0x7f91b40750b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:26.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.924+0000 7f91b3200640 1 --2- 172.21.15.1:0/3617248401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91b4074c50 0x7f91b40750b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f91a0009900 tx=0x7f91a002a410 comp rx=0 tx=0).stop 2024-09-15T22:25:26.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.924+0000 7f91b3200640 1 -- 172.21.15.1:0/3617248401 shutdown_connections 2024-09-15T22:25:26.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.924+0000 7f91b3200640 1 --2- 172.21.15.1:0/3617248401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91b4109820 0x7f91b410bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:26.927 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.924+0000 7f91b3200640 1 --2- 172.21.15.1:0/3617248401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91b4074c50 0x7f91b40750b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:26.927 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.924+0000 7f91b3200640 1 --2- 172.21.15.1:0/3617248401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91b4076230 0x7f91b4074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:26.927 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.924+0000 7f91b3200640 1 -- 172.21.15.1:0/3617248401 >> 172.21.15.1:0/3617248401 conn(0x7f91b40fd130 msgr2=0x7f91b40ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:26.927 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.924+0000 7f91b3200640 1 -- 172.21.15.1:0/3617248401 shutdown_connections 2024-09-15T22:25:26.927 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.924+0000 7f91b3200640 1 -- 172.21.15.1:0/3617248401 wait complete. 2024-09-15T22:25:26.929 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.925+0000 7f91b3200640 1 Processor -- start 2024-09-15T22:25:26.929 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.926+0000 7f91b3200640 1 -- start start 2024-09-15T22:25:26.929 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.926+0000 7f91b3200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91b4074c50 0x7f91b4199e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:26.930 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.926+0000 7f91b3200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91b4076230 0x7f91b419a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:26.930 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.926+0000 7f91b3200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91b4109820 0x7f91b41a1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:26.930 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.926+0000 7f91b3200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f91b410f870 con 0x7f91b4074c50 2024-09-15T22:25:26.930 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.926+0000 7f91b3200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f91b410f6f0 con 0x7f91b4076230 2024-09-15T22:25:26.930 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.926+0000 7f91b3200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f91b410f9f0 con 0x7f91b4109820 2024-09-15T22:25:26.930 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.926+0000 7f91b1e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91b4074c50 0x7f91b4199e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:26.930 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.926+0000 7f91b1e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91b4074c50 0x7f91b4199e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44662/0 (socket says 172.21.15.1:44662) 2024-09-15T22:25:26.930 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.926+0000 7f91b1e00640 1 -- 172.21.15.1:0/874860353 learned_addr learned my addr 172.21.15.1:0/874860353 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:25:26.931 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.926+0000 7f91b2800640 1 --2- 172.21.15.1:0/874860353 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91b4109820 0x7f91b41a1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:26.931 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.926+0000 7f91b1400640 1 --2- 172.21.15.1:0/874860353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91b4076230 0x7f91b419a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:26.931 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.927+0000 7f91b1e00640 1 -- 172.21.15.1:0/874860353 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91b4109820 msgr2=0x7f91b41a1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:26.931 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.927+0000 7f91b1e00640 1 --2- 172.21.15.1:0/874860353 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91b4109820 0x7f91b41a1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:26.931 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.927+0000 7f91b1e00640 1 -- 172.21.15.1:0/874860353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91b4076230 msgr2=0x7f91b419a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:26.931 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.927+0000 7f91b1e00640 1 --2- 172.21.15.1:0/874860353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91b4076230 0x7f91b419a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:26.931 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.927+0000 7f91b1e00640 1 -- 172.21.15.1:0/874860353 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b41a1ab0 con 0x7f91b4074c50 2024-09-15T22:25:26.931 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.927+0000 7f91b1e00640 1 --2- 172.21.15.1:0/874860353 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91b4074c50 0x7f91b4199e90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f91a400d950 tx=0x7f91a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:26.931 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.927+0000 7f91aaa00640 1 -- 172.21.15.1:0/874860353 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a4017070 con 0x7f91b4074c50 2024-09-15T22:25:26.931 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.927+0000 7f91aaa00640 1 -- 172.21.15.1:0/874860353 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91a4009c30 con 0x7f91b4074c50 2024-09-15T22:25:26.931 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.927+0000 7f91b3200640 1 -- 172.21.15.1:0/874860353 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91b41a1da0 con 0x7f91b4074c50 2024-09-15T22:25:26.932 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.927+0000 7f91aaa00640 1 -- 172.21.15.1:0/874860353 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a400f6b0 con 0x7f91b4074c50 2024-09-15T22:25:26.932 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.928+0000 7f91b3200640 1 -- 172.21.15.1:0/874860353 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91b41a2200 con 0x7f91b4074c50 2024-09-15T22:25:26.932 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.931+0000 7f91bbe88740 1 Processor -- start 2024-09-15T22:25:26.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.931+0000 7f91aaa00640 1 -- 172.21.15.1:0/874860353 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f91a40109d0 con 0x7f91b4074c50 2024-09-15T22:25:26.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.931+0000 7f91bbe88740 1 -- start start 2024-09-15T22:25:26.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.931+0000 7f91bbe88740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564788d1a260 0x564788d1a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:26.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.931+0000 7f91bbe88740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564788d1aba0 0x564788d1f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:26.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.931+0000 7f91bbe88740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564788d1fc30 0x564788d220f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:26.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.931+0000 7f91bbe88740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564788c7f100 con 0x564788d1aba0 2024-09-15T22:25:26.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.931+0000 7f91bbe88740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564788c271b0 con 0x564788d1fc30 2024-09-15T22:25:26.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.931+0000 7f91bbe88740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564788c7b0c0 con 0x564788d1a260 2024-09-15T22:25:26.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.931+0000 7f91b1e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564788d1aba0 0x564788d1f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:26.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.931+0000 7f91b2800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564788d1a260 0x564788d1a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:26.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.932+0000 7f91b2800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564788d1a260 0x564788d1a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:39954/0 (socket says 172.21.15.1:39954) 2024-09-15T22:25:26.937 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.932+0000 7f91b2800640 1 -- 172.21.15.1:0/1416983781 learned_addr learned my addr 172.21.15.1:0/1416983781 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:25:26.937 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.932+0000 7f91b1400640 1 --2- 172.21.15.1:0/1416983781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564788d1fc30 0x564788d220f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:26.937 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.932+0000 7f91b1400640 1 -- 172.21.15.1:0/1416983781 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564788d1a260 msgr2=0x564788d1a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:26.937 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.932+0000 7f91b1400640 1 --2- 172.21.15.1:0/1416983781 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564788d1a260 0x564788d1a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:26.937 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.932+0000 7f91b1400640 1 -- 172.21.15.1:0/1416983781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564788d1aba0 msgr2=0x564788d1f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:26.937 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.932+0000 7f91b1400640 1 --2- 172.21.15.1:0/1416983781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564788d1aba0 0x564788d1f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:26.937 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.932+0000 7f91b1400640 1 -- 172.21.15.1:0/1416983781 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564788992210 con 0x564788d1fc30 2024-09-15T22:25:26.937 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.932+0000 7f91b1400640 1 --2- 172.21.15.1:0/1416983781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564788d1fc30 0x564788d220f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f91a002a930 tx=0x7f91a0004190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a8213da19c39e0a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:26.937 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.933+0000 7f919f400640 1 -- 172.21.15.1:0/1416983781 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a0035040 con 0x564788d1fc30 2024-09-15T22:25:26.937 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.933+0000 7f919f400640 1 -- 172.21.15.1:0/1416983781 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91a0005520 con 0x564788d1fc30 2024-09-15T22:25:26.937 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.933+0000 7f919f400640 1 -- 172.21.15.1:0/1416983781 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a0031910 con 0x564788d1fc30 2024-09-15T22:25:26.937 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.933+0000 7f91aaa00640 1 --2- 172.21.15.1:0/874860353 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f91980a3230 0x7f91980a56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:26.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.933+0000 7f91aaa00640 1 -- 172.21.15.1:0/874860353 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f91a40cf570 con 0x7f91b4074c50 2024-09-15T22:25:26.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.933+0000 7f91b2800640 1 --2- 172.21.15.1:0/874860353 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f91980a3230 0x7f91980a56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:26.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.933+0000 7f91bbe88740 1 -- 172.21.15.1:0/1416983781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564788d1fc30 msgr2=0x564788d220f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:26.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.933+0000 7f91bbe88740 1 --2- 172.21.15.1:0/1416983781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564788d1fc30 0x564788d220f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f91a002a930 tx=0x7f91a0004190 comp rx=0 tx=0).stop 2024-09-15T22:25:26.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.934+0000 7f91bbe88740 1 -- 172.21.15.1:0/1416983781 shutdown_connections 2024-09-15T22:25:26.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.934+0000 7f91bbe88740 1 --2- 172.21.15.1:0/1416983781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564788d1fc30 0x564788d220f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:26.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.934+0000 7f91bbe88740 1 --2- 172.21.15.1:0/1416983781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564788d1aba0 0x564788d1f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:26.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.934+0000 7f91bbe88740 1 --2- 172.21.15.1:0/1416983781 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564788d1a260 0x564788d1a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:26.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.934+0000 7f91bbe88740 1 -- 172.21.15.1:0/1416983781 >> 172.21.15.1:0/1416983781 conn(0x564788d158d0 msgr2=0x564788d15cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:26.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.934+0000 7f91bbe88740 1 -- 172.21.15.1:0/1416983781 shutdown_connections 2024-09-15T22:25:26.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.934+0000 7f91b2800640 1 --2- 172.21.15.1:0/874860353 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f91980a3230 0x7f91980a56f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f91ac0116b0 tx=0x7f91ac009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:26.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.934+0000 7f91bbe88740 1 -- 172.21.15.1:0/1416983781 wait complete. 2024-09-15T22:25:26.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.934+0000 7f91bbe88740 1 -- start start 2024-09-15T22:25:26.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.935+0000 7f91bbe88740 1 Processor -- start 2024-09-15T22:25:26.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.935+0000 7f91bbe88740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564788d1a260 0x564788d243b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:26.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.935+0000 7f91bbe88740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564788d1aba0 0x564788d248f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:26.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.935+0000 7f91bbe88740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564788d1fc30 0x564788d2b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:26.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.935+0000 7f91bbe88740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564788d22ba0 con 0x564788d1a260 2024-09-15T22:25:26.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.935+0000 7f91bbe88740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564788c08090 con 0x564788d1aba0 2024-09-15T22:25:26.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.935+0000 7f91bbe88740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564788d22d20 con 0x564788d1fc30 2024-09-15T22:25:26.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.935+0000 7f91bbe88740 10 client.0 _ll_register_callbacks cb 0x564788c5cf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:25:26.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.936+0000 7f91b1e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564788d1a260 0x564788d243b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:26.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.936+0000 7f91b1e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564788d1a260 0x564788d243b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44680/0 (socket says 172.21.15.1:44680) 2024-09-15T22:25:26.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.936+0000 7f91b1e00640 1 -- 172.21.15.1:0/2310655605 learned_addr learned my addr 172.21.15.1:0/2310655605 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:25:26.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.936+0000 7f91b1400640 1 --2- 172.21.15.1:0/2310655605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564788d1aba0 0x564788d248f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:26.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.936+0000 7f91b2800640 1 --2- 172.21.15.1:0/2310655605 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564788d1fc30 0x564788d2b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:26.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.936+0000 7f91b1e00640 1 -- 172.21.15.1:0/2310655605 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564788d1fc30 msgr2=0x564788d2b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:26.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.936+0000 7f91b1e00640 1 --2- 172.21.15.1:0/2310655605 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564788d1fc30 0x564788d2b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:26.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.936+0000 7f91b1e00640 1 -- 172.21.15.1:0/2310655605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564788d1aba0 msgr2=0x564788d248f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:26.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.936+0000 7f91b1e00640 1 --2- 172.21.15.1:0/2310655605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564788d1aba0 0x564788d248f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:26.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.936+0000 7f91b1e00640 1 -- 172.21.15.1:0/2310655605 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564788a5e620 con 0x564788d1a260 2024-09-15T22:25:26.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.936+0000 7f91b1e00640 1 --2- 172.21.15.1:0/2310655605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564788d1a260 0x564788d243b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f91a4009610 tx=0x7f91a4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51f4609fbe1728ea server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:26.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.936+0000 7f9193e00640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-15T22:25:26.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.937+0000 7f9193e00640 1 -- 172.21.15.1:0/2310655605 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a4020070 con 0x564788d1a260 2024-09-15T22:25:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.937+0000 7f9193e00640 1 -- 172.21.15.1:0/2310655605 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f91a40cf0c0 con 0x564788d1a260 2024-09-15T22:25:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.937+0000 7f91bbe88740 1 -- 172.21.15.1:0/2310655605 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91a0005520 con 0x564788d1a260 2024-09-15T22:25:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.937+0000 7f9193e00640 1 -- 172.21.15.1:0/2310655605 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f91a409b4e0 con 0x564788d1a260 2024-09-15T22:25:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.937+0000 7f91bbe88740 10 client.15090 fetch_fsmap learned FSMap version 26 2024-09-15T22:25:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.937+0000 7f91bbe88740 1 -- 172.21.15.1:0/2310655605 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564788d2e7f0 con 0x564788d1a260 2024-09-15T22:25:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.937+0000 7f9193e00640 1 -- 172.21.15.1:0/2310655605 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91a0005520 con 0x564788d1a260 2024-09-15T22:25:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.937+0000 7f9193e00640 1 -- 172.21.15.1:0/2310655605 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f91a40860b0 con 0x564788d1a260 2024-09-15T22:25:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.937+0000 7f91bbe88740 10 client.15090 fetch_fsmap finished waiting for FSMap version 26 2024-09-15T22:25:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.937+0000 7f91bbe88740 10 client.15090 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T22:25:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.937+0000 7f91bbe88740 20 client.15090 populate_metadata read hostname 'smithi001' 2024-09-15T22:25:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.938+0000 7f91bbe88740 1 --2- 172.21.15.1:0/2310655605 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x564788d2fe70 0x564788d32260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.938+0000 7f91bbe88740 4 client.15090 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:25:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.938+0000 7f91bbe88740 1 -- 172.21.15.1:0/2310655605 --> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564788c8c830 con 0x564788d2fe70 2024-09-15T22:25:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.938+0000 7f91b1400640 1 --2- 172.21.15.1:0/2310655605 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x564788d2fe70 0x564788d32260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.939+0000 7f91b1400640 1 --2- 172.21.15.1:0/2310655605 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x564788d2fe70 0x564788d32260 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e232825b3b67425 server_cookie=717b6b29f58534ca in_seq=0 out_seq=0 2024-09-15T22:25:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.939+0000 7f9193e00640 10 client.15090 ms_handle_connect on v2:172.21.15.98:6838/2831161859 2024-09-15T22:25:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.939+0000 7f9193e00640 1 -- 172.21.15.1:0/2310655605 <== mds.0 v2:172.21.15.98:6838/2831161859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564788c8c830 con 0x564788d2fe70 2024-09-15T22:25:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.939+0000 7f9193e00640 10 client.15090 handle_command_reply: tid=0 2024-09-15T22:25:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.939+0000 7f91bbe88740 1 client.15090 shutdown 2024-09-15T22:25:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.940+0000 7f91bbe88740 1 -- 172.21.15.1:0/2310655605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564788d1a260 msgr2=0x564788d243b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.940+0000 7f91bbe88740 1 --2- 172.21.15.1:0/2310655605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564788d1a260 0x564788d243b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f91a4009610 tx=0x7f91a4000bc0 comp rx=0 tx=0).stop 2024-09-15T22:25:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.940+0000 7f91bbe88740 1 -- 172.21.15.1:0/2310655605 shutdown_connections 2024-09-15T22:25:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.940+0000 7f91bbe88740 1 --2- 172.21.15.1:0/2310655605 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564788d1fc30 0x564788d2b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.940+0000 7f91bbe88740 1 --2- 172.21.15.1:0/2310655605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564788d1aba0 0x564788d248f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.940+0000 7f91bbe88740 1 --2- 172.21.15.1:0/2310655605 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x564788d2fe70 0x564788d32260 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.940+0000 7f91bbe88740 1 --2- 172.21.15.1:0/2310655605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564788d1a260 0x564788d243b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:26.947 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.940+0000 7f91bbe88740 1 -- 172.21.15.1:0/2310655605 >> 172.21.15.1:0/2310655605 conn(0x564788d158d0 msgr2=0x564788d170e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:26.947 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.940+0000 7f9193e00640 0 client.15090 ms_handle_reset on v2:172.21.15.98:6838/2831161859 2024-09-15T22:25:26.947 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.940+0000 7f91bbe88740 1 -- 172.21.15.1:0/2310655605 shutdown_connections 2024-09-15T22:25:26.947 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.940+0000 7f91bbe88740 1 -- 172.21.15.1:0/2310655605 wait complete. 2024-09-15T22:25:26.947 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.940+0000 7f91bbe88740 20 client.15090 trim_cache size 0 max 16384 2024-09-15T22:25:26.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.955+0000 7f91bbe88740 1 Processor -- start 2024-09-15T22:25:26.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.955+0000 7f91bbe88740 1 -- start start 2024-09-15T22:25:26.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.955+0000 7f91bbe88740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564788d1a260 0x564788d23f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:26.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.955+0000 7f91bbe88740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564788d1aba0 0x564788d2b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:26.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.955+0000 7f91bbe88740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564788d1fc30 0x564788d244d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:26.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.955+0000 7f91bbe88740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f91b41adaa0 con 0x564788d1aba0 2024-09-15T22:25:26.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.955+0000 7f91bbe88740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f91b41ab370 con 0x564788d1a260 2024-09-15T22:25:26.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.955+0000 7f91bbe88740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f91b41a91c0 con 0x564788d1fc30 2024-09-15T22:25:26.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.956+0000 7f91b1e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564788d1a260 0x564788d23f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:26.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.956+0000 7f91b1e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564788d1a260 0x564788d23f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:47048/0 (socket says 172.21.15.1:47048) 2024-09-15T22:25:26.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.956+0000 7f91b1e00640 1 -- 172.21.15.1:0/3925714324 learned_addr learned my addr 172.21.15.1:0/3925714324 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:25:26.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.956+0000 7f91b1400640 1 --2- 172.21.15.1:0/3925714324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564788d1aba0 0x564788d2b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:26.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.956+0000 7f91b2800640 1 --2- 172.21.15.1:0/3925714324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564788d1fc30 0x564788d244d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:26.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.956+0000 7f91b1e00640 1 -- 172.21.15.1:0/3925714324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564788d1fc30 msgr2=0x564788d244d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:26.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.956+0000 7f91b1e00640 1 --2- 172.21.15.1:0/3925714324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564788d1fc30 0x564788d244d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:26.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.956+0000 7f91b1e00640 1 -- 172.21.15.1:0/3925714324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564788d1aba0 msgr2=0x564788d2b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:26.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.956+0000 7f91b1e00640 1 --2- 172.21.15.1:0/3925714324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564788d1aba0 0x564788d2b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:26.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.956+0000 7f91b1e00640 1 -- 172.21.15.1:0/3925714324 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564788d156f0 con 0x564788d1a260 2024-09-15T22:25:26.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.956+0000 7f91b1400640 1 --2- 172.21.15.1:0/3925714324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564788d1aba0 0x564788d2b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:25:26.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.957+0000 7f91b1e00640 1 --2- 172.21.15.1:0/3925714324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564788d1a260 0x564788d23f90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f91a4010fd0 tx=0x7f91a40cf310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc6a693c6aa0360a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:26.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.957+0000 7f919ea00640 1 -- 172.21.15.1:0/3925714324 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a4020040 con 0x564788d1a260 2024-09-15T22:25:26.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.957+0000 7f919ea00640 1 -- 172.21.15.1:0/3925714324 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91a4009de0 con 0x564788d1a260 2024-09-15T22:25:26.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.957+0000 7f919ea00640 1 -- 172.21.15.1:0/3925714324 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a4086070 con 0x564788d1a260 2024-09-15T22:25:26.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.958+0000 7f91bbe88740 1 -- 172.21.15.1:0/3925714324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564788d1a260 msgr2=0x564788d23f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:26.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.958+0000 7f91bbe88740 1 --2- 172.21.15.1:0/3925714324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564788d1a260 0x564788d23f90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f91a4010fd0 tx=0x7f91a40cf310 comp rx=0 tx=0).stop 2024-09-15T22:25:26.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.958+0000 7f91bbe88740 1 -- 172.21.15.1:0/3925714324 shutdown_connections 2024-09-15T22:25:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.958+0000 7f91bbe88740 1 --2- 172.21.15.1:0/3925714324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564788d1fc30 0x564788d244d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.958+0000 7f91bbe88740 1 --2- 172.21.15.1:0/3925714324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564788d1aba0 0x564788d2b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.958+0000 7f91bbe88740 1 --2- 172.21.15.1:0/3925714324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564788d1a260 0x564788d23f90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.958+0000 7f91bbe88740 1 -- 172.21.15.1:0/3925714324 >> 172.21.15.1:0/3925714324 conn(0x564788d158d0 msgr2=0x564788d1bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.958+0000 7f91bbe88740 1 -- 172.21.15.1:0/3925714324 shutdown_connections 2024-09-15T22:25:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.958+0000 7f91bbe88740 1 -- 172.21.15.1:0/3925714324 wait complete. 2024-09-15T22:25:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.958+0000 7f91bbe88740 1 -- start start 2024-09-15T22:25:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.958+0000 7f91bbe88740 1 Processor -- start 2024-09-15T22:25:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.959+0000 7f91bbe88740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564788d1a260 0x564788d285a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.959+0000 7f91bbe88740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564788d1aba0 0x564788d28ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.959+0000 7f91bbe88740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564788d1fc30 0x564788d98b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.959+0000 7f91bbe88740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f91b41a9830 con 0x564788d1aba0 2024-09-15T22:25:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.959+0000 7f91bbe88740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f91b41aaca0 con 0x564788d1a260 2024-09-15T22:25:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.959+0000 7f91bbe88740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f91b41a9f00 con 0x564788d1fc30 2024-09-15T22:25:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.959+0000 7f91bbe88740 10 client.0 _ll_register_callbacks cb 0x7f91a40d2ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:25:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.959+0000 7f91b1e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564788d1a260 0x564788d285a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.959+0000 7f91b1400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564788d1aba0 0x564788d28ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.959+0000 7f91b1e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564788d1a260 0x564788d285a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:47054/0 (socket says 172.21.15.1:47054) 2024-09-15T22:25:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.959+0000 7f91b1e00640 1 -- 172.21.15.1:0/3359551760 learned_addr learned my addr 172.21.15.1:0/3359551760 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:25:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.959+0000 7f91b2800640 1 --2- 172.21.15.1:0/3359551760 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564788d1fc30 0x564788d98b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.959+0000 7f91b1e00640 1 -- 172.21.15.1:0/3359551760 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564788d1fc30 msgr2=0x564788d98b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.959+0000 7f91b1e00640 1 --2- 172.21.15.1:0/3359551760 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564788d1fc30 0x564788d98b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.959+0000 7f91b1e00640 1 -- 172.21.15.1:0/3359551760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564788d1aba0 msgr2=0x564788d28ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.959+0000 7f91b1e00640 1 --2- 172.21.15.1:0/3359551760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564788d1aba0 0x564788d28ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.960+0000 7f91b1e00640 1 -- 172.21.15.1:0/3359551760 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564788d2bb10 con 0x564788d1a260 2024-09-15T22:25:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.960+0000 7f91b1400640 1 --2- 172.21.15.1:0/3359551760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564788d1aba0 0x564788d28ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:25:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.960+0000 7f91b1e00640 1 --2- 172.21.15.1:0/3359551760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564788d1a260 0x564788d285a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f91a4099e30 tx=0x7f91a409b280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8314473c44529d57 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.960+0000 7f9193e00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-15T22:25:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.960+0000 7f9193e00640 1 -- 172.21.15.1:0/3359551760 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a4020070 con 0x564788d1a260 2024-09-15T22:25:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.960+0000 7f9193e00640 1 -- 172.21.15.1:0/3359551760 <== mon.2 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f91a40978d0 con 0x564788d1a260 2024-09-15T22:25:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.960+0000 7f91bbe88740 1 -- 172.21.15.1:0/3359551760 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91a4009de0 con 0x564788d1a260 2024-09-15T22:25:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.960+0000 7f9193e00640 1 -- 172.21.15.1:0/3359551760 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f91a409bb80 con 0x564788d1a260 2024-09-15T22:25:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.960+0000 7f91bbe88740 10 client.25076 fetch_fsmap learned FSMap version 26 2024-09-15T22:25:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.960+0000 7f91bbe88740 1 -- 172.21.15.1:0/3359551760 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564788d99f50 con 0x564788d1a260 2024-09-15T22:25:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.961+0000 7f9193e00640 1 -- 172.21.15.1:0/3359551760 <== mon.2 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91a4009de0 con 0x564788d1a260 2024-09-15T22:25:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.961+0000 7f9193e00640 1 -- 172.21.15.1:0/3359551760 <== mon.2 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f91a40ba270 con 0x564788d1a260 2024-09-15T22:25:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.961+0000 7f91bbe88740 10 client.25076 fetch_fsmap finished waiting for FSMap version 26 2024-09-15T22:25:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.961+0000 7f91bbe88740 10 client.25076 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T22:25:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.961+0000 7f91bbe88740 20 client.25076 populate_metadata read hostname 'smithi001' 2024-09-15T22:25:26.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.961+0000 7f91bbe88740 1 --2- 172.21.15.1:0/3359551760 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x564788d9a820 0x564788d9cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:26.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.961+0000 7f91bbe88740 4 client.25076 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:25:26.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.961+0000 7f91bbe88740 1 -- 172.21.15.1:0/3359551760 --> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564788c86b80 con 0x564788d9a820 2024-09-15T22:25:26.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.961+0000 7f91b1400640 1 --2- 172.21.15.1:0/3359551760 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x564788d9a820 0x564788d9cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:26.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.962+0000 7f9193e00640 10 client.25076 ms_handle_connect on v2:172.21.15.98:6838/2831161859 2024-09-15T22:25:26.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.962+0000 7f91b1400640 1 --2- 172.21.15.1:0/3359551760 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x564788d9a820 0x564788d9cc40 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86d1038e6d3f4886 server_cookie=574e3e5946873286 in_seq=0 out_seq=0 2024-09-15T22:25:26.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.969+0000 7f9193e00640 1 -- 172.21.15.1:0/3359551760 <== mds.0 v2:172.21.15.98:6838/2831161859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564788c86b80 con 0x564788d9a820 2024-09-15T22:25:26.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.969+0000 7f9193e00640 10 client.25076 handle_command_reply: tid=0 2024-09-15T22:25:26.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.969+0000 7f91bbe88740 1 client.25076 shutdown 2024-09-15T22:25:26.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.970+0000 7f91bbe88740 1 -- 172.21.15.1:0/3359551760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564788d1a260 msgr2=0x564788d285a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:26.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.970+0000 7f91bbe88740 1 --2- 172.21.15.1:0/3359551760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564788d1a260 0x564788d285a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f91a4099e30 tx=0x7f91a409b280 comp rx=0 tx=0).stop 2024-09-15T22:25:26.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.970+0000 7f91bbe88740 1 -- 172.21.15.1:0/3359551760 shutdown_connections 2024-09-15T22:25:26.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.970+0000 7f91bbe88740 1 --2- 172.21.15.1:0/3359551760 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564788d1fc30 0x564788d98b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:26.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.970+0000 7f91bbe88740 1 --2- 172.21.15.1:0/3359551760 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x564788d9a820 0x564788d9cc40 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:26.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.970+0000 7f91bbe88740 1 --2- 172.21.15.1:0/3359551760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564788d1aba0 0x564788d28ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:26.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.970+0000 7f91bbe88740 1 --2- 172.21.15.1:0/3359551760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564788d1a260 0x564788d285a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:26.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.970+0000 7f91bbe88740 1 -- 172.21.15.1:0/3359551760 >> 172.21.15.1:0/3359551760 conn(0x564788d158d0 msgr2=0x564788d23f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:26.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.970+0000 7f9193e00640 0 client.25076 ms_handle_reset on v2:172.21.15.98:6838/2831161859 2024-09-15T22:25:26.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.970+0000 7f91bbe88740 1 -- 172.21.15.1:0/3359551760 shutdown_connections 2024-09-15T22:25:26.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.970+0000 7f91bbe88740 1 -- 172.21.15.1:0/3359551760 wait complete. 2024-09-15T22:25:26.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.970+0000 7f91bbe88740 20 client.25076 trim_cache size 0 max 16384 2024-09-15T22:25:26.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-15T22:25:26.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-15T22:25:26.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-15T22:25:26.974 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-15T22:25:26.974 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.971+0000 7f91b3200640 1 -- 172.21.15.1:0/874860353 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f91980a3230 msgr2=0x7f91980a56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:26.974 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.971+0000 7f91b3200640 1 --2- 172.21.15.1:0/874860353 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f91980a3230 0x7f91980a56f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f91ac0116b0 tx=0x7f91ac009500 comp rx=0 tx=0).stop 2024-09-15T22:25:26.974 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.971+0000 7f91b3200640 1 -- 172.21.15.1:0/874860353 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91b4074c50 msgr2=0x7f91b4199e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:26.974 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.971+0000 7f91b3200640 1 --2- 172.21.15.1:0/874860353 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91b4074c50 0x7f91b4199e90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f91a400d950 tx=0x7f91a400de10 comp rx=0 tx=0).stop 2024-09-15T22:25:26.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.971+0000 7f91b3200640 1 -- 172.21.15.1:0/874860353 shutdown_connections 2024-09-15T22:25:26.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.971+0000 7f91b3200640 1 --2- 172.21.15.1:0/874860353 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f91980a3230 0x7f91980a56f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:26.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.971+0000 7f91b3200640 1 --2- 172.21.15.1:0/874860353 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91b4109820 0x7f91b41a1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:26.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.971+0000 7f91b3200640 1 --2- 172.21.15.1:0/874860353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91b4076230 0x7f91b419a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:26.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.971+0000 7f91b3200640 1 --2- 172.21.15.1:0/874860353 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91b4074c50 0x7f91b4199e90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:26.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.971+0000 7f91b3200640 1 -- 172.21.15.1:0/874860353 >> 172.21.15.1:0/874860353 conn(0x7f91b40fd130 msgr2=0x7f91b4105770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:26.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.971+0000 7f91b3200640 1 -- 172.21.15.1:0/874860353 shutdown_connections 2024-09-15T22:25:26.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:26.971+0000 7f91b3200640 1 -- 172.21.15.1:0/874860353 wait complete. 2024-09-15T22:25:26.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:26 smithi012 ceph-mon[34883]: pgmap v373: 97 pgs: 97 active+clean; 657 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-15T22:25:27.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:26 smithi098 ceph-mon[35514]: pgmap v373: 97 pgs: 97 active+clean; 657 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-15T22:25:28.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:28 smithi001 ceph-mon[30843]: pgmap v374: 97 pgs: 97 active+clean; 657 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-15T22:25:28.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:28 smithi012 ceph-mon[34883]: pgmap v374: 97 pgs: 97 active+clean; 657 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-15T22:25:29.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:28 smithi098 ceph-mon[35514]: pgmap v374: 97 pgs: 97 active+clean; 657 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-15T22:25:30.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:30 smithi001 ceph-mon[30843]: pgmap v375: 97 pgs: 97 active+clean; 660 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-15T22:25:30.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:30 smithi012 ceph-mon[34883]: pgmap v375: 97 pgs: 97 active+clean; 660 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-15T22:25:31.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:30 smithi098 ceph-mon[35514]: pgmap v375: 97 pgs: 97 active+clean; 660 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-15T22:25:32.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:32 smithi001 ceph-mon[30843]: pgmap v376: 97 pgs: 97 active+clean; 660 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-15T22:25:32.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:32 smithi012 ceph-mon[34883]: pgmap v376: 97 pgs: 97 active+clean; 660 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-15T22:25:33.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:32 smithi098 ceph-mon[35514]: pgmap v376: 97 pgs: 97 active+clean; 660 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-15T22:25:34.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:34 smithi001 ceph-mon[30843]: pgmap v377: 97 pgs: 97 active+clean; 660 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-15T22:25:34.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:34 smithi012 ceph-mon[34883]: pgmap v377: 97 pgs: 97 active+clean; 660 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-15T22:25:35.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:34 smithi098 ceph-mon[35514]: pgmap v377: 97 pgs: 97 active+clean; 660 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-15T22:25:36.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:36 smithi001 ceph-mon[30843]: pgmap v378: 97 pgs: 97 active+clean; 669 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-09-15T22:25:36.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:36 smithi012 ceph-mon[34883]: pgmap v378: 97 pgs: 97 active+clean; 669 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-09-15T22:25:37.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:36 smithi098 ceph-mon[35514]: pgmap v378: 97 pgs: 97 active+clean; 669 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-09-15T22:25:38.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:38 smithi001 ceph-mon[30843]: pgmap v379: 97 pgs: 97 active+clean; 669 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-09-15T22:25:38.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:38 smithi012 ceph-mon[34883]: pgmap v379: 97 pgs: 97 active+clean; 669 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-09-15T22:25:39.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:38 smithi098 ceph-mon[35514]: pgmap v379: 97 pgs: 97 active+clean; 669 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-09-15T22:25:40.147 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.145+0000 7f5f2a400640 1 -- 172.21.15.1:0/4171768053 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f24074bd0 msgr2=0x7f5f24075030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:40.147 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.145+0000 7f5f2a400640 1 --2- 172.21.15.1:0/4171768053 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f24074bd0 0x7f5f24075030 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5f10009860 tx=0x7f5f1002a3d0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.147 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.146+0000 7f5f2a400640 1 -- 172.21.15.1:0/4171768053 shutdown_connections 2024-09-15T22:25:40.147 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.146+0000 7f5f2a400640 1 --2- 172.21.15.1:0/4171768053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f24109860 0x7f5f2410bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.147 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.146+0000 7f5f2a400640 1 --2- 172.21.15.1:0/4171768053 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f24074bd0 0x7f5f24075030 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.147 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.146+0000 7f5f2a400640 1 --2- 172.21.15.1:0/4171768053 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f240761b0 0x7f5f24074600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.146+0000 7f5f2a400640 1 -- 172.21.15.1:0/4171768053 >> 172.21.15.1:0/4171768053 conn(0x7f5f240fd130 msgr2=0x7f5f240ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:40.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.146+0000 7f5f2a400640 1 -- 172.21.15.1:0/4171768053 shutdown_connections 2024-09-15T22:25:40.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.146+0000 7f5f2a400640 1 -- 172.21.15.1:0/4171768053 wait complete. 2024-09-15T22:25:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.147+0000 7f5f2a400640 1 Processor -- start 2024-09-15T22:25:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.147+0000 7f5f2a400640 1 -- start start 2024-09-15T22:25:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.147+0000 7f5f2a400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f24074bd0 0x7f5f24199e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.147+0000 7f5f2a400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f240761b0 0x7f5f2419a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.147+0000 7f5f2a400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f24109860 0x7f5f241a1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.147+0000 7f5f2a400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2410f860 con 0x7f5f240761b0 2024-09-15T22:25:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.147+0000 7f5f2a400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2410f6e0 con 0x7f5f24074bd0 2024-09-15T22:25:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.147+0000 7f5f2a400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2410f9e0 con 0x7f5f24109860 2024-09-15T22:25:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.148+0000 7f5f29000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f24074bd0 0x7f5f24199e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.148+0000 7f5f29000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f24074bd0 0x7f5f24199e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:38546/0 (socket says 172.21.15.1:38546) 2024-09-15T22:25:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.148+0000 7f5f29000640 1 -- 172.21.15.1:0/1118354082 learned_addr learned my addr 172.21.15.1:0/1118354082 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:25:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.148+0000 7f5f29a00640 1 --2- 172.21.15.1:0/1118354082 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f24109860 0x7f5f241a1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.148+0000 7f5f23e00640 1 --2- 172.21.15.1:0/1118354082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f240761b0 0x7f5f2419a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.148+0000 7f5f29000640 1 -- 172.21.15.1:0/1118354082 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f24109860 msgr2=0x7f5f241a1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.148+0000 7f5f29000640 1 --2- 172.21.15.1:0/1118354082 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f24109860 0x7f5f241a1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.148+0000 7f5f29000640 1 -- 172.21.15.1:0/1118354082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f240761b0 msgr2=0x7f5f2419a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.148+0000 7f5f29000640 1 --2- 172.21.15.1:0/1118354082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f240761b0 0x7f5f2419a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.148+0000 7f5f29000640 1 -- 172.21.15.1:0/1118354082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f241a1aa0 con 0x7f5f24074bd0 2024-09-15T22:25:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.148+0000 7f5f29a00640 1 --2- 172.21.15.1:0/1118354082 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f24109860 0x7f5f241a1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:25:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.148+0000 7f5f23e00640 1 --2- 172.21.15.1:0/1118354082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f240761b0 0x7f5f2419a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:25:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.148+0000 7f5f29000640 1 --2- 172.21.15.1:0/1118354082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f24074bd0 0x7f5f24199e80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5f1800e9c0 tx=0x7f5f1800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.149+0000 7f5f21600640 1 -- 172.21.15.1:0/1118354082 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1800ccc0 con 0x7f5f24074bd0 2024-09-15T22:25:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.149+0000 7f5f21600640 1 -- 172.21.15.1:0/1118354082 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f18005500 con 0x7f5f24074bd0 2024-09-15T22:25:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.149+0000 7f5f2a400640 1 -- 172.21.15.1:0/1118354082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f241a1d90 con 0x7f5f24074bd0 2024-09-15T22:25:40.152 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.149+0000 7f5f21600640 1 -- 172.21.15.1:0/1118354082 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f18010430 con 0x7f5f24074bd0 2024-09-15T22:25:40.152 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.149+0000 7f5f2a400640 1 -- 172.21.15.1:0/1118354082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f241a2250 con 0x7f5f24074bd0 2024-09-15T22:25:40.153 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.153+0000 7f5f2e9ee740 1 Processor -- start 2024-09-15T22:25:40.154 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.153+0000 7f5f2e9ee740 1 -- start start 2024-09-15T22:25:40.154 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.153+0000 7f5f2e9ee740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558061090a70 0x558061090e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:40.154 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.154+0000 7f5f2e9ee740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5580610913b0 0x558061095e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:40.154 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.154+0000 7f5f2e9ee740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558061096440 0x558061098900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:40.154 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.154+0000 7f5f2e9ee740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558060fed100 con 0x5580610913b0 2024-09-15T22:25:40.155 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.154+0000 7f5f2e9ee740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558060f951b0 con 0x558061090a70 2024-09-15T22:25:40.155 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.154+0000 7f5f2e9ee740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558060fe90c0 con 0x558061096440 2024-09-15T22:25:40.156 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.154+0000 7f5f21600640 1 -- 172.21.15.1:0/1118354082 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f5f180046c0 con 0x7f5f24074bd0 2024-09-15T22:25:40.156 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.154+0000 7f5f29a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558061090a70 0x558061090e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:40.156 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.154+0000 7f5f29a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558061090a70 0x558061090e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:38552/0 (socket says 172.21.15.1:38552) 2024-09-15T22:25:40.156 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.154+0000 7f5f29a00640 1 -- 172.21.15.1:0/485552711 learned_addr learned my addr 172.21.15.1:0/485552711 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:25:40.156 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.154+0000 7f5f23e00640 1 --2- 172.21.15.1:0/485552711 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558061096440 0x558061098900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:40.156 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.154+0000 7f5f29000640 1 --2- 172.21.15.1:0/485552711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5580610913b0 0x558061095e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:40.156 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.154+0000 7f5f29a00640 1 -- 172.21.15.1:0/485552711 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558061096440 msgr2=0x558061098900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:40.156 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.154+0000 7f5f29a00640 1 --2- 172.21.15.1:0/485552711 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558061096440 0x558061098900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.156 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.154+0000 7f5f29a00640 1 -- 172.21.15.1:0/485552711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5580610913b0 msgr2=0x558061095e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.154+0000 7f5f29a00640 1 --2- 172.21.15.1:0/485552711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5580610913b0 0x558061095e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.154+0000 7f5f29a00640 1 -- 172.21.15.1:0/485552711 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558060d00210 con 0x558061090a70 2024-09-15T22:25:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.154+0000 7f5f29000640 1 --2- 172.21.15.1:0/485552711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5580610913b0 0x558061095e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:25:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.155+0000 7f5f29a00640 1 --2- 172.21.15.1:0/485552711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558061090a70 0x558061090e70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c009fd0 tx=0x7f5f1c0108e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8c3d9bba10aef0f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.155+0000 7f5f16000640 1 -- 172.21.15.1:0/485552711 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c011760 con 0x558061090a70 2024-09-15T22:25:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.155+0000 7f5f16000640 1 -- 172.21.15.1:0/485552711 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f1c011de0 con 0x558061090a70 2024-09-15T22:25:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.155+0000 7f5f16000640 1 -- 172.21.15.1:0/485552711 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c00e3c0 con 0x558061090a70 2024-09-15T22:25:40.158 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.156+0000 7f5f2e9ee740 1 -- 172.21.15.1:0/485552711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558061090a70 msgr2=0x558061090e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:40.158 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.156+0000 7f5f2e9ee740 1 --2- 172.21.15.1:0/485552711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558061090a70 0x558061090e70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c009fd0 tx=0x7f5f1c0108e0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.156+0000 7f5f2e9ee740 1 -- 172.21.15.1:0/485552711 shutdown_connections 2024-09-15T22:25:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.156+0000 7f5f2e9ee740 1 --2- 172.21.15.1:0/485552711 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558061096440 0x558061098900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.156+0000 7f5f2e9ee740 1 --2- 172.21.15.1:0/485552711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5580610913b0 0x558061095e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.156+0000 7f5f2e9ee740 1 --2- 172.21.15.1:0/485552711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558061090a70 0x558061090e70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.156+0000 7f5f2e9ee740 1 -- 172.21.15.1:0/485552711 >> 172.21.15.1:0/485552711 conn(0x5580610838d0 msgr2=0x558061083cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.157+0000 7f5f21600640 1 --2- 172.21.15.1:0/1118354082 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f5f0c0a31c0 0x7f5f0c0a5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.157+0000 7f5f21600640 1 -- 172.21.15.1:0/1118354082 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f5f180cfda0 con 0x7f5f24074bd0 2024-09-15T22:25:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.157+0000 7f5f23e00640 1 --2- 172.21.15.1:0/1118354082 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f5f0c0a31c0 0x7f5f0c0a5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.157+0000 7f5f2e9ee740 1 -- 172.21.15.1:0/485552711 shutdown_connections 2024-09-15T22:25:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.157+0000 7f5f2e9ee740 1 -- 172.21.15.1:0/485552711 wait complete. 2024-09-15T22:25:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.158+0000 7f5f2e9ee740 1 -- start start 2024-09-15T22:25:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.158+0000 7f5f2e9ee740 1 Processor -- start 2024-09-15T22:25:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.158+0000 7f5f23e00640 1 --2- 172.21.15.1:0/1118354082 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f5f0c0a31c0 0x7f5f0c0a5680 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5f10000c00 tx=0x7f5f100094e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.159+0000 7f5f2e9ee740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558061090a70 0x55806109abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.159+0000 7f5f2e9ee740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5580610913b0 0x55806109b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.159+0000 7f5f2e9ee740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558061096440 0x5580610a2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.159+0000 7f5f2e9ee740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558061099410 con 0x558061096440 2024-09-15T22:25:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.159+0000 7f5f2e9ee740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558060f76090 con 0x5580610913b0 2024-09-15T22:25:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.159+0000 7f5f2e9ee740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558061099590 con 0x558061090a70 2024-09-15T22:25:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.159+0000 7f5f2e9ee740 10 client.0 _ll_register_callbacks cb 0x558060fcaf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:25:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.159+0000 7f5f23e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5580610913b0 0x55806109b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.159+0000 7f5f23e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5580610913b0 0x55806109b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:38564/0 (socket says 172.21.15.1:38564) 2024-09-15T22:25:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.159+0000 7f5f23e00640 1 -- 172.21.15.1:0/175607552 learned_addr learned my addr 172.21.15.1:0/175607552 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:25:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.159+0000 7f5f29a00640 1 --2- 172.21.15.1:0/175607552 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558061096440 0x5580610a2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.160+0000 7f5f29000640 1 --2- 172.21.15.1:0/175607552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558061090a70 0x55806109abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.160+0000 7f5f23e00640 1 -- 172.21.15.1:0/175607552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558061090a70 msgr2=0x55806109abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.160+0000 7f5f23e00640 1 --2- 172.21.15.1:0/175607552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558061090a70 0x55806109abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.160+0000 7f5f23e00640 1 -- 172.21.15.1:0/175607552 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558061096440 msgr2=0x5580610a2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:40.163 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.160+0000 7f5f23e00640 1 --2- 172.21.15.1:0/175607552 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558061096440 0x5580610a2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.163 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.160+0000 7f5f23e00640 1 -- 172.21.15.1:0/175607552 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558060dcc620 con 0x5580610913b0 2024-09-15T22:25:40.163 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.160+0000 7f5f23e00640 1 --2- 172.21.15.1:0/175607552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5580610913b0 0x55806109b100 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5f10034000 tx=0x7f5f10005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef3e2aaa77d15c53 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:40.163 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.160+0000 7f5f0aa00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-15T22:25:40.163 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.160+0000 7f5f0aa00640 1 -- 172.21.15.1:0/175607552 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1004d070 con 0x5580610913b0 2024-09-15T22:25:40.163 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.160+0000 7f5f2e9ee740 1 -- 172.21.15.1:0/175607552 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f1c011de0 con 0x5580610913b0 2024-09-15T22:25:40.163 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.160+0000 7f5f0aa00640 1 -- 172.21.15.1:0/175607552 <== mon.2 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f5f10049440 con 0x5580610913b0 2024-09-15T22:25:40.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.161+0000 7f5f0aa00640 1 -- 172.21.15.1:0/175607552 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5f10059050 con 0x5580610913b0 2024-09-15T22:25:40.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.161+0000 7f5f2e9ee740 10 client.25088 fetch_fsmap learned FSMap version 26 2024-09-15T22:25:40.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.161+0000 7f5f2e9ee740 1 -- 172.21.15.1:0/175607552 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5580610a4f10 con 0x5580610913b0 2024-09-15T22:25:40.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.161+0000 7f5f0aa00640 1 -- 172.21.15.1:0/175607552 <== mon.2 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f1c011de0 con 0x5580610913b0 2024-09-15T22:25:40.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.161+0000 7f5f0aa00640 1 -- 172.21.15.1:0/175607552 <== mon.2 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f5f1003d430 con 0x5580610913b0 2024-09-15T22:25:40.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.162+0000 7f5f2e9ee740 10 client.25088 fetch_fsmap finished waiting for FSMap version 26 2024-09-15T22:25:40.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.162+0000 7f5f2e9ee740 10 client.25088 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T22:25:40.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.162+0000 7f5f2e9ee740 20 client.25088 populate_metadata read hostname 'smithi001' 2024-09-15T22:25:40.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.162+0000 7f5f2e9ee740 1 --2- 172.21.15.1:0/175607552 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x5580610a6600 0x5580610a8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:40.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.162+0000 7f5f2e9ee740 4 client.25088 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:25:40.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.162+0000 7f5f2e9ee740 1 -- 172.21.15.1:0/175607552 --> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558060ffa830 con 0x5580610a6600 2024-09-15T22:25:40.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.162+0000 7f5f29000640 1 --2- 172.21.15.1:0/175607552 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x5580610a6600 0x5580610a8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.163+0000 7f5f29000640 1 --2- 172.21.15.1:0/175607552 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x5580610a6600 0x5580610a8aa0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22f3e22d673d0f28 server_cookie=7898cc138c9abc15 in_seq=0 out_seq=0 2024-09-15T22:25:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.163+0000 7f5f0aa00640 10 client.25088 ms_handle_connect on v2:172.21.15.98:6838/2831161859 2024-09-15T22:25:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.163+0000 7f5f0aa00640 1 -- 172.21.15.1:0/175607552 <== mds.0 v2:172.21.15.98:6838/2831161859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558060ffa830 con 0x5580610a6600 2024-09-15T22:25:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.163+0000 7f5f0aa00640 10 client.25088 handle_command_reply: tid=0 2024-09-15T22:25:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.163+0000 7f5f2e9ee740 1 client.25088 shutdown 2024-09-15T22:25:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.164+0000 7f5f2e9ee740 1 -- 172.21.15.1:0/175607552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5580610913b0 msgr2=0x55806109b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.164+0000 7f5f2e9ee740 1 --2- 172.21.15.1:0/175607552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5580610913b0 0x55806109b100 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5f10034000 tx=0x7f5f10005f90 comp rx=0 tx=0).stop 2024-09-15T22:25:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.164+0000 7f5f2e9ee740 1 -- 172.21.15.1:0/175607552 shutdown_connections 2024-09-15T22:25:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.164+0000 7f5f2e9ee740 1 --2- 172.21.15.1:0/175607552 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x5580610a6600 0x5580610a8aa0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.164+0000 7f5f2e9ee740 1 --2- 172.21.15.1:0/175607552 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558061096440 0x5580610a2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.164+0000 7f5f2e9ee740 1 --2- 172.21.15.1:0/175607552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5580610913b0 0x55806109b100 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.164+0000 7f5f2e9ee740 1 --2- 172.21.15.1:0/175607552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558061090a70 0x55806109abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.164+0000 7f5f2e9ee740 1 -- 172.21.15.1:0/175607552 >> 172.21.15.1:0/175607552 conn(0x5580610838d0 msgr2=0x5580610850e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.164+0000 7f5f0aa00640 0 client.25088 ms_handle_reset on v2:172.21.15.98:6838/2831161859 2024-09-15T22:25:40.167 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.164+0000 7f5f2e9ee740 1 -- 172.21.15.1:0/175607552 shutdown_connections 2024-09-15T22:25:40.167 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.164+0000 7f5f2e9ee740 1 -- 172.21.15.1:0/175607552 wait complete. 2024-09-15T22:25:40.167 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.165+0000 7f5f2e9ee740 20 client.25088 trim_cache size 0 max 16384 2024-09-15T22:25:40.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.194+0000 7f5f2e9ee740 1 Processor -- start 2024-09-15T22:25:40.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.195+0000 7f5f2e9ee740 1 -- start start 2024-09-15T22:25:40.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.195+0000 7f5f2e9ee740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558061090a70 0x55806109abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:40.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.195+0000 7f5f2e9ee740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5580610913b0 0x5580610a2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:40.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.195+0000 7f5f2e9ee740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558061096440 0x55806109b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:40.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.195+0000 7f5f2e9ee740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5f241a97b0 con 0x5580610913b0 2024-09-15T22:25:40.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.195+0000 7f5f2e9ee740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5f241a7080 con 0x558061096440 2024-09-15T22:25:40.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.195+0000 7f5f2e9ee740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5f241a4ed0 con 0x558061090a70 2024-09-15T22:25:40.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.195+0000 7f5f29000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558061090a70 0x55806109abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:40.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.195+0000 7f5f29a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558061096440 0x55806109b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:40.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.195+0000 7f5f29000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558061090a70 0x55806109abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:41678/0 (socket says 172.21.15.1:41678) 2024-09-15T22:25:40.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.195+0000 7f5f29a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558061096440 0x55806109b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:38570/0 (socket says 172.21.15.1:38570) 2024-09-15T22:25:40.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.195+0000 7f5f29000640 1 -- 172.21.15.1:0/2856940401 learned_addr learned my addr 172.21.15.1:0/2856940401 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:25:40.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.196+0000 7f5f23e00640 1 --2- 172.21.15.1:0/2856940401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5580610913b0 0x5580610a2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:40.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.196+0000 7f5f29a00640 1 -- 172.21.15.1:0/2856940401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558061090a70 msgr2=0x55806109abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:40.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.196+0000 7f5f29a00640 1 --2- 172.21.15.1:0/2856940401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558061090a70 0x55806109abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.196+0000 7f5f29a00640 1 -- 172.21.15.1:0/2856940401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5580610913b0 msgr2=0x5580610a2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:40.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.196+0000 7f5f29a00640 1 --2- 172.21.15.1:0/2856940401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5580610913b0 0x5580610a2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.196+0000 7f5f29a00640 1 -- 172.21.15.1:0/2856940401 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558061091890 con 0x558061096440 2024-09-15T22:25:40.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.196+0000 7f5f23e00640 1 --2- 172.21.15.1:0/2856940401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5580610913b0 0x5580610a2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:25:40.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.196+0000 7f5f29a00640 1 --2- 172.21.15.1:0/2856940401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558061096440 0x55806109b100 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c006010 tx=0x7f5f1c009d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3645a99956171a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:40.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.197+0000 7f5f15600640 1 -- 172.21.15.1:0/2856940401 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c0049c0 con 0x558061096440 2024-09-15T22:25:40.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.197+0000 7f5f15600640 1 -- 172.21.15.1:0/2856940401 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f1c004b60 con 0x558061096440 2024-09-15T22:25:40.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.197+0000 7f5f15600640 1 -- 172.21.15.1:0/2856940401 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c0052a0 con 0x558061096440 2024-09-15T22:25:40.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.198+0000 7f5f2e9ee740 1 -- 172.21.15.1:0/2856940401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558061096440 msgr2=0x55806109b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:40.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.198+0000 7f5f2e9ee740 1 --2- 172.21.15.1:0/2856940401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558061096440 0x55806109b100 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c006010 tx=0x7f5f1c009d60 comp rx=0 tx=0).stop 2024-09-15T22:25:40.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.198+0000 7f5f2e9ee740 1 -- 172.21.15.1:0/2856940401 shutdown_connections 2024-09-15T22:25:40.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.198+0000 7f5f2e9ee740 1 --2- 172.21.15.1:0/2856940401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558061096440 0x55806109b100 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.198+0000 7f5f2e9ee740 1 --2- 172.21.15.1:0/2856940401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5580610913b0 0x5580610a2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.198+0000 7f5f2e9ee740 1 --2- 172.21.15.1:0/2856940401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558061090a70 0x55806109abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.198+0000 7f5f2e9ee740 1 -- 172.21.15.1:0/2856940401 >> 172.21.15.1:0/2856940401 conn(0x5580610838d0 msgr2=0x55806107e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:40.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.198+0000 7f5f2e9ee740 1 -- 172.21.15.1:0/2856940401 shutdown_connections 2024-09-15T22:25:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.198+0000 7f5f2e9ee740 1 -- 172.21.15.1:0/2856940401 wait complete. 2024-09-15T22:25:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.198+0000 7f5f2e9ee740 1 -- start start 2024-09-15T22:25:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.199+0000 7f5f2e9ee740 1 Processor -- start 2024-09-15T22:25:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.199+0000 7f5f2e9ee740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558061090a70 0x55806109f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.199+0000 7f5f2e9ee740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5580610913b0 0x55806109fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.199+0000 7f5f2e9ee740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558061096440 0x5580610a0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.199+0000 7f5f2e9ee740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5f241a5540 con 0x558061096440 2024-09-15T22:25:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.199+0000 7f5f2e9ee740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5f241a69b0 con 0x558061090a70 2024-09-15T22:25:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.199+0000 7f5f2e9ee740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5f241a5c10 con 0x5580610913b0 2024-09-15T22:25:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.199+0000 7f5f2e9ee740 10 client.0 _ll_register_callbacks cb 0x7f5f18005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:25:40.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.200+0000 7f5f29000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558061090a70 0x55806109f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:40.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.200+0000 7f5f29000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558061090a70 0x55806109f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:38584/0 (socket says 172.21.15.1:38584) 2024-09-15T22:25:40.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.200+0000 7f5f29000640 1 -- 172.21.15.1:0/1360558046 learned_addr learned my addr 172.21.15.1:0/1360558046 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:25:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.200+0000 7f5f23e00640 1 --2- 172.21.15.1:0/1360558046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5580610913b0 0x55806109fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.200+0000 7f5f29a00640 1 --2- 172.21.15.1:0/1360558046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558061096440 0x5580610a0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.200+0000 7f5f29000640 1 -- 172.21.15.1:0/1360558046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5580610913b0 msgr2=0x55806109fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.200+0000 7f5f29000640 1 --2- 172.21.15.1:0/1360558046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5580610913b0 0x55806109fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.200+0000 7f5f29000640 1 -- 172.21.15.1:0/1360558046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558061096440 msgr2=0x5580610a0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.200+0000 7f5f29000640 1 --2- 172.21.15.1:0/1360558046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558061096440 0x5580610a0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.200+0000 7f5f29000640 1 -- 172.21.15.1:0/1360558046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580610a1310 con 0x558061090a70 2024-09-15T22:25:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.200+0000 7f5f23e00640 1 --2- 172.21.15.1:0/1360558046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5580610913b0 0x55806109fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:25:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.201+0000 7f5f29000640 1 --2- 172.21.15.1:0/1360558046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558061090a70 0x55806109f7b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5f1809c290 tx=0x7f5f180986c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9c2e7e34f02ebf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.201+0000 7f5f0aa00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-15T22:25:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.201+0000 7f5f0aa00640 1 -- 172.21.15.1:0/1360558046 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f180a06b0 con 0x558061090a70 2024-09-15T22:25:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.201+0000 7f5f2e9ee740 1 -- 172.21.15.1:0/1360558046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f1c004b60 con 0x558061090a70 2024-09-15T22:25:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.201+0000 7f5f0aa00640 1 -- 172.21.15.1:0/1360558046 <== mon.2 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f5f18016dd0 con 0x558061090a70 2024-09-15T22:25:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.201+0000 7f5f0aa00640 1 -- 172.21.15.1:0/1360558046 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5f180a4f70 con 0x558061090a70 2024-09-15T22:25:40.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.202+0000 7f5f2e9ee740 10 client.25094 fetch_fsmap learned FSMap version 26 2024-09-15T22:25:40.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.202+0000 7f5f2e9ee740 1 -- 172.21.15.1:0/1360558046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558061111450 con 0x558061090a70 2024-09-15T22:25:40.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.202+0000 7f5f0aa00640 1 -- 172.21.15.1:0/1360558046 <== mon.2 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f180b9030 con 0x558061090a70 2024-09-15T22:25:40.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.202+0000 7f5f0aa00640 1 -- 172.21.15.1:0/1360558046 <== mon.2 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f5f180a4b70 con 0x558061090a70 2024-09-15T22:25:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.202+0000 7f5f2e9ee740 10 client.25094 fetch_fsmap finished waiting for FSMap version 26 2024-09-15T22:25:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.202+0000 7f5f2e9ee740 10 client.25094 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T22:25:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.202+0000 7f5f2e9ee740 20 client.25094 populate_metadata read hostname 'smithi001' 2024-09-15T22:25:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.202+0000 7f5f2e9ee740 1 --2- 172.21.15.1:0/1360558046 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x558061111d30 0x558061114150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.202+0000 7f5f2e9ee740 4 client.25094 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:25:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.202+0000 7f5f2e9ee740 1 -- 172.21.15.1:0/1360558046 --> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558060ff4b80 con 0x558061111d30 2024-09-15T22:25:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.203+0000 7f5f23e00640 1 --2- 172.21.15.1:0/1360558046 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x558061111d30 0x558061114150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.203+0000 7f5f23e00640 1 --2- 172.21.15.1:0/1360558046 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x558061111d30 0x558061114150 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d6da2a9fbef5929 server_cookie=e17d6cfddd0af335 in_seq=0 out_seq=0 2024-09-15T22:25:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.203+0000 7f5f0aa00640 10 client.25094 ms_handle_connect on v2:172.21.15.98:6838/2831161859 2024-09-15T22:25:40.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.211+0000 7f5f0aa00640 1 -- 172.21.15.1:0/1360558046 <== mds.0 v2:172.21.15.98:6838/2831161859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558060ff4b80 con 0x558061111d30 2024-09-15T22:25:40.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.211+0000 7f5f0aa00640 10 client.25094 handle_command_reply: tid=0 2024-09-15T22:25:40.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.211+0000 7f5f2e9ee740 1 client.25094 shutdown 2024-09-15T22:25:40.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.211+0000 7f5f2e9ee740 1 -- 172.21.15.1:0/1360558046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558061090a70 msgr2=0x55806109f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:40.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.211+0000 7f5f2e9ee740 1 --2- 172.21.15.1:0/1360558046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558061090a70 0x55806109f7b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5f1809c290 tx=0x7f5f180986c0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.211+0000 7f5f2e9ee740 1 -- 172.21.15.1:0/1360558046 shutdown_connections 2024-09-15T22:25:40.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.211+0000 7f5f2e9ee740 1 --2- 172.21.15.1:0/1360558046 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x558061111d30 0x558061114150 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.211+0000 7f5f2e9ee740 1 --2- 172.21.15.1:0/1360558046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558061096440 0x5580610a0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.211+0000 7f5f2e9ee740 1 --2- 172.21.15.1:0/1360558046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5580610913b0 0x55806109fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.211+0000 7f5f2e9ee740 1 --2- 172.21.15.1:0/1360558046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558061090a70 0x55806109f7b0 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5f1809c290 tx=0x7f5f180986c0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.211+0000 7f5f2e9ee740 1 -- 172.21.15.1:0/1360558046 >> 172.21.15.1:0/1360558046 conn(0x5580610838d0 msgr2=0x558061092550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:40.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.211+0000 7f5f0aa00640 0 client.25094 ms_handle_reset on v2:172.21.15.98:6838/2831161859 2024-09-15T22:25:40.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.212+0000 7f5f2e9ee740 1 -- 172.21.15.1:0/1360558046 shutdown_connections 2024-09-15T22:25:40.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.212+0000 7f5f2e9ee740 1 -- 172.21.15.1:0/1360558046 wait complete. 2024-09-15T22:25:40.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.212+0000 7f5f2e9ee740 20 client.25094 trim_cache size 0 max 16384 2024-09-15T22:25:40.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-15T22:25:40.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-15T22:25:40.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-15T22:25:40.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-15T22:25:40.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.213+0000 7f5f2a400640 1 -- 172.21.15.1:0/1118354082 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f5f0c0a31c0 msgr2=0x7f5f0c0a5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:40.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.213+0000 7f5f2a400640 1 --2- 172.21.15.1:0/1118354082 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f5f0c0a31c0 0x7f5f0c0a5680 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5f10000c00 tx=0x7f5f100094e0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.213+0000 7f5f2a400640 1 -- 172.21.15.1:0/1118354082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f24074bd0 msgr2=0x7f5f24199e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:40.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.213+0000 7f5f2a400640 1 --2- 172.21.15.1:0/1118354082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f24074bd0 0x7f5f24199e80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5f1800e9c0 tx=0x7f5f1800ee80 comp rx=0 tx=0).stop 2024-09-15T22:25:40.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.213+0000 7f5f2a400640 1 -- 172.21.15.1:0/1118354082 shutdown_connections 2024-09-15T22:25:40.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.213+0000 7f5f2a400640 1 --2- 172.21.15.1:0/1118354082 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f5f0c0a31c0 0x7f5f0c0a5680 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.213+0000 7f5f2a400640 1 --2- 172.21.15.1:0/1118354082 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f24109860 0x7f5f241a1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.213+0000 7f5f2a400640 1 --2- 172.21.15.1:0/1118354082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f240761b0 0x7f5f2419a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.213+0000 7f5f2a400640 1 --2- 172.21.15.1:0/1118354082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f24074bd0 0x7f5f24199e80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:40.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.213+0000 7f5f2a400640 1 -- 172.21.15.1:0/1118354082 >> 172.21.15.1:0/1118354082 conn(0x7f5f240fd130 msgr2=0x7f5f241057f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:40.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.213+0000 7f5f2a400640 1 -- 172.21.15.1:0/1118354082 shutdown_connections 2024-09-15T22:25:40.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:40.213+0000 7f5f2a400640 1 -- 172.21.15.1:0/1118354082 wait complete. 2024-09-15T22:25:40.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:40 smithi001 ceph-mon[30843]: pgmap v380: 97 pgs: 97 active+clean; 669 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-15T22:25:40.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:40 smithi012 ceph-mon[34883]: pgmap v380: 97 pgs: 97 active+clean; 669 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-15T22:25:41.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:40 smithi098 ceph-mon[35514]: pgmap v380: 97 pgs: 97 active+clean; 669 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-15T22:25:42.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:42 smithi001 ceph-mon[30843]: pgmap v381: 97 pgs: 97 active+clean; 669 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-15T22:25:42.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:42 smithi012 ceph-mon[34883]: pgmap v381: 97 pgs: 97 active+clean; 669 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-15T22:25:43.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:42 smithi098 ceph-mon[35514]: pgmap v381: 97 pgs: 97 active+clean; 669 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-15T22:25:44.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:44 smithi012 ceph-mon[34883]: pgmap v382: 97 pgs: 97 active+clean; 669 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-15T22:25:45.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:44 smithi098 ceph-mon[35514]: pgmap v382: 97 pgs: 97 active+clean; 669 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-15T22:25:45.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:44 smithi001 ceph-mon[30843]: pgmap v382: 97 pgs: 97 active+clean; 669 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-15T22:25:46.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:46 smithi001 ceph-mon[30843]: pgmap v383: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-09-15T22:25:46.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:46 smithi012 ceph-mon[34883]: pgmap v383: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-09-15T22:25:47.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:46 smithi098 ceph-mon[35514]: pgmap v383: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-09-15T22:25:48.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:48 smithi012 ceph-mon[34883]: pgmap v384: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-15T22:25:49.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:48 smithi098 ceph-mon[35514]: pgmap v384: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-15T22:25:49.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:48 smithi001 ceph-mon[30843]: pgmap v384: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-15T22:25:50.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:50 smithi012 ceph-mon[34883]: pgmap v385: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-15T22:25:51.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:50 smithi098 ceph-mon[35514]: pgmap v385: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-15T22:25:51.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:50 smithi001 ceph-mon[30843]: pgmap v385: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-15T22:25:52.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:52 smithi012 ceph-mon[34883]: pgmap v386: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-15T22:25:53.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:52 smithi098 ceph-mon[35514]: pgmap v386: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-15T22:25:53.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:52 smithi001 ceph-mon[30843]: pgmap v386: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-15T22:25:53.397 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.395+0000 7ffb87200640 1 -- 172.21.15.1:0/3506893209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb88102ba0 msgr2=0x7ffb88103020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:53.398 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.395+0000 7ffb87200640 1 --2- 172.21.15.1:0/3506893209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb88102ba0 0x7ffb88103020 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009900 tx=0x7ffb7402a400 comp rx=0 tx=0).stop 2024-09-15T22:25:53.398 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.395+0000 7ffb87200640 1 -- 172.21.15.1:0/3506893209 shutdown_connections 2024-09-15T22:25:53.398 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.395+0000 7ffb87200640 1 --2- 172.21.15.1:0/3506893209 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb88103560 0x7ffb88109df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:53.398 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.395+0000 7ffb87200640 1 --2- 172.21.15.1:0/3506893209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb88102ba0 0x7ffb88103020 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:53.398 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.395+0000 7ffb87200640 1 --2- 172.21.15.1:0/3506893209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb881019b0 0x7ffb88101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:53.398 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.395+0000 7ffb87200640 1 -- 172.21.15.1:0/3506893209 >> 172.21.15.1:0/3506893209 conn(0x7ffb880fd130 msgr2=0x7ffb880ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:53.398 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.395+0000 7ffb87200640 1 -- 172.21.15.1:0/3506893209 shutdown_connections 2024-09-15T22:25:53.398 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.396+0000 7ffb87200640 1 -- 172.21.15.1:0/3506893209 wait complete. 2024-09-15T22:25:53.399 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.397+0000 7ffb87200640 1 Processor -- start 2024-09-15T22:25:53.399 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.397+0000 7ffb87200640 1 -- start start 2024-09-15T22:25:53.399 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.397+0000 7ffb87200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb881019b0 0x7ffb88195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:53.399 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.397+0000 7ffb87200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb88102ba0 0x7ffb88196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:53.399 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.397+0000 7ffb87200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb88103560 0x7ffb8819d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:53.399 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.398+0000 7ffb87200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8810b4b0 con 0x7ffb88103560 2024-09-15T22:25:53.399 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.398+0000 7ffb87200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8810b330 con 0x7ffb88102ba0 2024-09-15T22:25:53.400 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.398+0000 7ffb87200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8810b630 con 0x7ffb881019b0 2024-09-15T22:25:53.400 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.398+0000 7ffb85400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb88102ba0 0x7ffb88196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:53.400 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.398+0000 7ffb85400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb88102ba0 0x7ffb88196010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:46968/0 (socket says 172.21.15.1:46968) 2024-09-15T22:25:53.400 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.398+0000 7ffb85400640 1 -- 172.21.15.1:0/716927 learned_addr learned my addr 172.21.15.1:0/716927 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:25:53.401 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.398+0000 7ffb86800640 1 --2- 172.21.15.1:0/716927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb88103560 0x7ffb8819d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:53.401 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.398+0000 7ffb85e00640 1 --2- 172.21.15.1:0/716927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb881019b0 0x7ffb88195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:53.401 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.399+0000 7ffb85400640 1 -- 172.21.15.1:0/716927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb881019b0 msgr2=0x7ffb88195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:53.401 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.399+0000 7ffb85400640 1 --2- 172.21.15.1:0/716927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb881019b0 0x7ffb88195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:53.401 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.399+0000 7ffb85400640 1 -- 172.21.15.1:0/716927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb88103560 msgr2=0x7ffb8819d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:53.401 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.399+0000 7ffb85400640 1 --2- 172.21.15.1:0/716927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb88103560 0x7ffb8819d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:53.401 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.399+0000 7ffb85400640 1 -- 172.21.15.1:0/716927 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb8819d6f0 con 0x7ffb88102ba0 2024-09-15T22:25:53.402 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.399+0000 7ffb85400640 1 --2- 172.21.15.1:0/716927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb88102ba0 0x7ffb88196010 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffb74031440 tx=0x7ffb74032ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:53.402 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.399+0000 7ffb7ea00640 1 -- 172.21.15.1:0/716927 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7403f030 con 0x7ffb88102ba0 2024-09-15T22:25:53.402 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.399+0000 7ffb7ea00640 1 -- 172.21.15.1:0/716927 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb74003ce0 con 0x7ffb88102ba0 2024-09-15T22:25:53.402 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.399+0000 7ffb7ea00640 1 -- 172.21.15.1:0/716927 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb74035070 con 0x7ffb88102ba0 2024-09-15T22:25:53.402 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.399+0000 7ffb87200640 1 -- 172.21.15.1:0/716927 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb8819d980 con 0x7ffb88102ba0 2024-09-15T22:25:53.402 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.400+0000 7ffb85e00640 1 --2- 172.21.15.1:0/716927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb881019b0 0x7ffb88195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:25:53.402 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.400+0000 7ffb87200640 1 -- 172.21.15.1:0/716927 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb8819dec0 con 0x7ffb88102ba0 2024-09-15T22:25:53.405 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.403+0000 7ffb7ea00640 1 -- 172.21.15.1:0/716927 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7ffb74042030 con 0x7ffb88102ba0 2024-09-15T22:25:53.406 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.404+0000 7ffb90259740 1 Processor -- start 2024-09-15T22:25:53.408 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.404+0000 7ffb90259740 1 -- start start 2024-09-15T22:25:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.404+0000 7ffb90259740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55883ea40260 0x55883ea40660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.405+0000 7ffb90259740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55883ea40ba0 0x55883ea45660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.405+0000 7ffb90259740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55883ea45c30 0x55883ea480f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.405+0000 7ffb90259740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55883e9a5100 con 0x55883ea45c30 2024-09-15T22:25:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.405+0000 7ffb90259740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55883e94d1b0 con 0x55883ea40ba0 2024-09-15T22:25:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.405+0000 7ffb90259740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55883e9a10c0 con 0x55883ea40260 2024-09-15T22:25:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.405+0000 7ffb7ea00640 1 --2- 172.21.15.1:0/716927 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ffb6c0a3330 0x7ffb6c0a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.405+0000 7ffb7ea00640 1 -- 172.21.15.1:0/716927 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7ffb740ef7b0 con 0x7ffb88102ba0 2024-09-15T22:25:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.405+0000 7ffb85e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55883ea40ba0 0x55883ea45660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.405+0000 7ffb85e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55883ea40ba0 0x55883ea45660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:46970/0 (socket says 172.21.15.1:46970) 2024-09-15T22:25:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.405+0000 7ffb85e00640 1 -- 172.21.15.1:0/2013572286 learned_addr learned my addr 172.21.15.1:0/2013572286 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:25:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.405+0000 7ffb86800640 1 --2- 172.21.15.1:0/2013572286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55883ea40260 0x55883ea40660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.406+0000 7ffb85400640 1 --2- 172.21.15.1:0/2013572286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55883ea45c30 0x55883ea480f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.406+0000 7ffb85e00640 1 -- 172.21.15.1:0/2013572286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55883ea40260 msgr2=0x55883ea40660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.406+0000 7ffb85e00640 1 --2- 172.21.15.1:0/2013572286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55883ea40260 0x55883ea40660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.406+0000 7ffb85e00640 1 -- 172.21.15.1:0/2013572286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55883ea45c30 msgr2=0x55883ea480f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.406+0000 7ffb85e00640 1 --2- 172.21.15.1:0/2013572286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55883ea45c30 0x55883ea480f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.406+0000 7ffb85e00640 1 -- 172.21.15.1:0/2013572286 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55883e6b8210 con 0x55883ea40ba0 2024-09-15T22:25:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.406+0000 7ffb86800640 1 --2- 172.21.15.1:0/2013572286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55883ea40260 0x55883ea40660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:25:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.406+0000 7ffb86800640 1 --2- 172.21.15.1:0/716927 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ffb6c0a3330 0x7ffb6c0a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.407+0000 7ffb85e00640 1 --2- 172.21.15.1:0/2013572286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55883ea40ba0 0x55883ea45660 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffb78004250 tx=0x7ffb78005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e41aa0138f9ffc40 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.407+0000 7ffb73400640 1 -- 172.21.15.1:0/2013572286 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb780044c0 con 0x55883ea40ba0 2024-09-15T22:25:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.407+0000 7ffb73400640 1 -- 172.21.15.1:0/2013572286 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb78005500 con 0x55883ea40ba0 2024-09-15T22:25:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.407+0000 7ffb73400640 1 -- 172.21.15.1:0/2013572286 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb78015560 con 0x55883ea40ba0 2024-09-15T22:25:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.408+0000 7ffb90259740 1 -- 172.21.15.1:0/2013572286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55883ea40ba0 msgr2=0x55883ea45660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.408+0000 7ffb86800640 1 --2- 172.21.15.1:0/716927 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ffb6c0a3330 0x7ffb6c0a57f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ffb80013fd0 tx=0x7ffb80004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.408+0000 7ffb90259740 1 --2- 172.21.15.1:0/2013572286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55883ea40ba0 0x55883ea45660 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffb78004250 tx=0x7ffb78005f90 comp rx=0 tx=0).stop 2024-09-15T22:25:53.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.408+0000 7ffb90259740 1 -- 172.21.15.1:0/2013572286 shutdown_connections 2024-09-15T22:25:53.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.408+0000 7ffb90259740 1 --2- 172.21.15.1:0/2013572286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55883ea45c30 0x55883ea480f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:53.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.408+0000 7ffb90259740 1 --2- 172.21.15.1:0/2013572286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55883ea40ba0 0x55883ea45660 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:53.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.408+0000 7ffb90259740 1 --2- 172.21.15.1:0/2013572286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55883ea40260 0x55883ea40660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:53.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.408+0000 7ffb90259740 1 -- 172.21.15.1:0/2013572286 >> 172.21.15.1:0/2013572286 conn(0x55883ea3b8d0 msgr2=0x55883ea3bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:53.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.408+0000 7ffb90259740 1 -- 172.21.15.1:0/2013572286 shutdown_connections 2024-09-15T22:25:53.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.409+0000 7ffb90259740 1 -- 172.21.15.1:0/2013572286 wait complete. 2024-09-15T22:25:53.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.409+0000 7ffb90259740 1 -- start start 2024-09-15T22:25:53.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.409+0000 7ffb90259740 1 Processor -- start 2024-09-15T22:25:53.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.410+0000 7ffb90259740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55883ea40260 0x55883ea4a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:53.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.410+0000 7ffb90259740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55883ea40ba0 0x55883ea4a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:53.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.410+0000 7ffb90259740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55883ea45c30 0x55883ea519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:53.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.410+0000 7ffb90259740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55883ea48c00 con 0x55883ea40ba0 2024-09-15T22:25:53.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.410+0000 7ffb90259740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55883e92e090 con 0x55883ea40260 2024-09-15T22:25:53.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.410+0000 7ffb90259740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55883ea48d80 con 0x55883ea45c30 2024-09-15T22:25:53.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.410+0000 7ffb90259740 10 client.0 _ll_register_callbacks cb 0x55883e982f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:25:53.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.410+0000 7ffb85e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55883ea40260 0x55883ea4a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:53.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.410+0000 7ffb85e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55883ea40260 0x55883ea4a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:46982/0 (socket says 172.21.15.1:46982) 2024-09-15T22:25:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.410+0000 7ffb85e00640 1 -- 172.21.15.1:0/890795436 learned_addr learned my addr 172.21.15.1:0/890795436 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:25:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.410+0000 7ffb85400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55883ea40ba0 0x55883ea4a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.411+0000 7ffb86800640 1 --2- 172.21.15.1:0/890795436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55883ea45c30 0x55883ea519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.411+0000 7ffb85e00640 1 -- 172.21.15.1:0/890795436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55883ea45c30 msgr2=0x55883ea519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.411+0000 7ffb85e00640 1 --2- 172.21.15.1:0/890795436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55883ea45c30 0x55883ea519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.411+0000 7ffb85e00640 1 -- 172.21.15.1:0/890795436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55883ea40ba0 msgr2=0x55883ea4a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.411+0000 7ffb85e00640 1 --2- 172.21.15.1:0/890795436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55883ea40ba0 0x55883ea4a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.411+0000 7ffb85e00640 1 -- 172.21.15.1:0/890795436 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55883e784620 con 0x55883ea40260 2024-09-15T22:25:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.411+0000 7ffb85400640 1 --2- 172.21.15.1:0/890795436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55883ea40ba0 0x55883ea4a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:25:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.412+0000 7ffb85e00640 1 --2- 172.21.15.1:0/890795436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55883ea40260 0x55883ea4a440 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ffb78004920 tx=0x7ffb78004950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8faa67aaba5095b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.412+0000 7ffb67e00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-15T22:25:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.412+0000 7ffb67e00640 1 -- 172.21.15.1:0/890795436 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb78024030 con 0x55883ea40260 2024-09-15T22:25:53.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.412+0000 7ffb90259740 1 -- 172.21.15.1:0/890795436 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb78005500 con 0x55883ea40260 2024-09-15T22:25:53.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.412+0000 7ffb67e00640 1 -- 172.21.15.1:0/890795436 <== mon.2 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7ffb7801b040 con 0x55883ea40260 2024-09-15T22:25:53.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.412+0000 7ffb67e00640 1 -- 172.21.15.1:0/890795436 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ffb7800d440 con 0x55883ea40260 2024-09-15T22:25:53.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.412+0000 7ffb90259740 10 client.25106 fetch_fsmap learned FSMap version 26 2024-09-15T22:25:53.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.412+0000 7ffb90259740 1 -- 172.21.15.1:0/890795436 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55883ea547b0 con 0x55883ea40260 2024-09-15T22:25:53.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.413+0000 7ffb67e00640 1 -- 172.21.15.1:0/890795436 <== mon.2 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb78005500 con 0x55883ea40260 2024-09-15T22:25:53.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.413+0000 7ffb67e00640 1 -- 172.21.15.1:0/890795436 <== mon.2 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7ffb780205e0 con 0x55883ea40260 2024-09-15T22:25:53.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.413+0000 7ffb90259740 10 client.25106 fetch_fsmap finished waiting for FSMap version 26 2024-09-15T22:25:53.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.413+0000 7ffb90259740 10 client.25106 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T22:25:53.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.413+0000 7ffb90259740 20 client.25106 populate_metadata read hostname 'smithi001' 2024-09-15T22:25:53.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.413+0000 7ffb90259740 1 --2- 172.21.15.1:0/890795436 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55883ea55c30 0x55883ea58020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:53.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.413+0000 7ffb90259740 4 client.25106 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:25:53.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.413+0000 7ffb90259740 1 -- 172.21.15.1:0/890795436 --> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55883e9b2830 con 0x55883ea55c30 2024-09-15T22:25:53.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.414+0000 7ffb85400640 1 --2- 172.21.15.1:0/890795436 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55883ea55c30 0x55883ea58020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:53.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.414+0000 7ffb85400640 1 --2- 172.21.15.1:0/890795436 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55883ea55c30 0x55883ea58020 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb7953b046e9569b server_cookie=a0160f1a101d5cea in_seq=0 out_seq=0 2024-09-15T22:25:53.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.414+0000 7ffb67e00640 10 client.25106 ms_handle_connect on v2:172.21.15.98:6838/2831161859 2024-09-15T22:25:53.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.415+0000 7ffb67e00640 1 -- 172.21.15.1:0/890795436 <== mds.0 v2:172.21.15.98:6838/2831161859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55883e9b2830 con 0x55883ea55c30 2024-09-15T22:25:53.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.415+0000 7ffb67e00640 10 client.25106 handle_command_reply: tid=0 2024-09-15T22:25:53.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.415+0000 7ffb90259740 1 client.25106 shutdown 2024-09-15T22:25:53.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.415+0000 7ffb90259740 1 -- 172.21.15.1:0/890795436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55883ea40260 msgr2=0x55883ea4a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:53.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.415+0000 7ffb90259740 1 --2- 172.21.15.1:0/890795436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55883ea40260 0x55883ea4a440 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ffb78004920 tx=0x7ffb78004950 comp rx=0 tx=0).stop 2024-09-15T22:25:53.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.415+0000 7ffb90259740 1 -- 172.21.15.1:0/890795436 shutdown_connections 2024-09-15T22:25:53.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.415+0000 7ffb90259740 1 --2- 172.21.15.1:0/890795436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55883ea45c30 0x55883ea519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:53.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.415+0000 7ffb90259740 1 --2- 172.21.15.1:0/890795436 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55883ea55c30 0x55883ea58020 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:53.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.415+0000 7ffb90259740 1 --2- 172.21.15.1:0/890795436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55883ea40ba0 0x55883ea4a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:53.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.415+0000 7ffb90259740 1 --2- 172.21.15.1:0/890795436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55883ea40260 0x55883ea4a440 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:53.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.415+0000 7ffb90259740 1 -- 172.21.15.1:0/890795436 >> 172.21.15.1:0/890795436 conn(0x55883ea3b8d0 msgr2=0x55883ea3d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:53.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.415+0000 7ffb67e00640 0 client.25106 ms_handle_reset on v2:172.21.15.98:6838/2831161859 2024-09-15T22:25:53.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.416+0000 7ffb90259740 1 -- 172.21.15.1:0/890795436 shutdown_connections 2024-09-15T22:25:53.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.416+0000 7ffb90259740 1 -- 172.21.15.1:0/890795436 wait complete. 2024-09-15T22:25:53.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.416+0000 7ffb90259740 20 client.25106 trim_cache size 0 max 16384 2024-09-15T22:25:53.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.446+0000 7ffb90259740 1 Processor -- start 2024-09-15T22:25:53.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.446+0000 7ffb90259740 1 -- start start 2024-09-15T22:25:53.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.446+0000 7ffb90259740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55883ea40260 0x55883ea4aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:53.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.446+0000 7ffb90259740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55883ea40ba0 0x55883ea51980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.446+0000 7ffb90259740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55883ea45c30 0x55883ea3a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.446+0000 7ffb90259740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffb881a9730 con 0x55883ea40260 2024-09-15T22:25:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.446+0000 7ffb90259740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ffb881a7000 con 0x55883ea45c30 2024-09-15T22:25:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.446+0000 7ffb90259740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ffb881a4e50 con 0x55883ea40ba0 2024-09-15T22:25:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.447+0000 7ffb85400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55883ea40ba0 0x55883ea51980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.447+0000 7ffb85e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55883ea40260 0x55883ea4aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.447+0000 7ffb85400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55883ea40ba0 0x55883ea51980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:56020/0 (socket says 172.21.15.1:56020) 2024-09-15T22:25:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.447+0000 7ffb85400640 1 -- 172.21.15.1:0/1970175506 learned_addr learned my addr 172.21.15.1:0/1970175506 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:25:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.447+0000 7ffb86800640 1 --2- 172.21.15.1:0/1970175506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55883ea45c30 0x55883ea3a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.447+0000 7ffb85400640 1 -- 172.21.15.1:0/1970175506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55883ea45c30 msgr2=0x55883ea3a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.447+0000 7ffb85400640 1 --2- 172.21.15.1:0/1970175506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55883ea45c30 0x55883ea3a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.447+0000 7ffb85400640 1 -- 172.21.15.1:0/1970175506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55883ea40260 msgr2=0x55883ea4aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.447+0000 7ffb85400640 1 --2- 172.21.15.1:0/1970175506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55883ea40260 0x55883ea4aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.448+0000 7ffb85400640 1 -- 172.21.15.1:0/1970175506 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55883ea3b6f0 con 0x55883ea40ba0 2024-09-15T22:25:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.448+0000 7ffb85e00640 1 --2- 172.21.15.1:0/1970175506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55883ea40260 0x55883ea4aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:25:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.448+0000 7ffb85400640 1 --2- 172.21.15.1:0/1970175506 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55883ea40ba0 0x55883ea51980 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffb740b8790 tx=0x7ffb7402a400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6d7f37d5c096a1d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.448+0000 7ffb72a00640 1 -- 172.21.15.1:0/1970175506 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb74049040 con 0x55883ea40ba0 2024-09-15T22:25:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.448+0000 7ffb72a00640 1 -- 172.21.15.1:0/1970175506 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb740c00c0 con 0x55883ea40ba0 2024-09-15T22:25:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.448+0000 7ffb72a00640 1 -- 172.21.15.1:0/1970175506 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb74003800 con 0x55883ea40ba0 2024-09-15T22:25:53.454 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.449+0000 7ffb90259740 1 -- 172.21.15.1:0/1970175506 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55883ea40ba0 msgr2=0x55883ea51980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:53.454 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.449+0000 7ffb90259740 1 --2- 172.21.15.1:0/1970175506 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55883ea40ba0 0x55883ea51980 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffb740b8790 tx=0x7ffb7402a400 comp rx=0 tx=0).stop 2024-09-15T22:25:53.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.449+0000 7ffb90259740 1 -- 172.21.15.1:0/1970175506 shutdown_connections 2024-09-15T22:25:53.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.449+0000 7ffb90259740 1 --2- 172.21.15.1:0/1970175506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55883ea45c30 0x55883ea3a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:53.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.449+0000 7ffb90259740 1 --2- 172.21.15.1:0/1970175506 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55883ea40ba0 0x55883ea51980 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:53.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.449+0000 7ffb90259740 1 --2- 172.21.15.1:0/1970175506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55883ea40260 0x55883ea4aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:53.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.449+0000 7ffb90259740 1 -- 172.21.15.1:0/1970175506 >> 172.21.15.1:0/1970175506 conn(0x55883ea3b8d0 msgr2=0x55883ea3a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:53.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.449+0000 7ffb90259740 1 -- 172.21.15.1:0/1970175506 shutdown_connections 2024-09-15T22:25:53.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.450+0000 7ffb90259740 1 -- 172.21.15.1:0/1970175506 wait complete. 2024-09-15T22:25:53.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.450+0000 7ffb90259740 1 -- start start 2024-09-15T22:25:53.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.450+0000 7ffb90259740 1 Processor -- start 2024-09-15T22:25:53.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.451+0000 7ffb90259740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55883ea40260 0x55883ea519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:53.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.451+0000 7ffb90259740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55883ea40ba0 0x55883ea4e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:53.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.451+0000 7ffb90259740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55883ea45c30 0x55883ea4eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:53.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.451+0000 7ffb90259740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffb881a54c0 con 0x55883ea40ba0 2024-09-15T22:25:53.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.451+0000 7ffb90259740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ffb881a6930 con 0x55883ea40260 2024-09-15T22:25:53.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.451+0000 7ffb90259740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ffb881a5b90 con 0x55883ea45c30 2024-09-15T22:25:53.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.451+0000 7ffb90259740 10 client.0 _ll_register_callbacks cb 0x7ffb780040d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:25:53.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.451+0000 7ffb85400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55883ea40ba0 0x55883ea4e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:53.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.451+0000 7ffb85400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55883ea40ba0 0x55883ea4e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55966/0 (socket says 172.21.15.1:55966) 2024-09-15T22:25:53.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.451+0000 7ffb85400640 1 -- 172.21.15.1:0/3035292285 learned_addr learned my addr 172.21.15.1:0/3035292285 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:25:53.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.451+0000 7ffb86800640 1 --2- 172.21.15.1:0/3035292285 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55883ea45c30 0x55883ea4eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:53.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.451+0000 7ffb85e00640 1 --2- 172.21.15.1:0/3035292285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55883ea40260 0x55883ea519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:53.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.452+0000 7ffb85e00640 1 -- 172.21.15.1:0/3035292285 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55883ea45c30 msgr2=0x55883ea4eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:53.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.452+0000 7ffb85e00640 1 --2- 172.21.15.1:0/3035292285 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55883ea45c30 0x55883ea4eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:53.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.452+0000 7ffb85e00640 1 -- 172.21.15.1:0/3035292285 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55883ea40ba0 msgr2=0x55883ea4e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:53.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.452+0000 7ffb85e00640 1 --2- 172.21.15.1:0/3035292285 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55883ea40ba0 0x55883ea4e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:53.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.452+0000 7ffb85e00640 1 -- 172.21.15.1:0/3035292285 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55883eabe970 con 0x55883ea40260 2024-09-15T22:25:53.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.452+0000 7ffb85400640 1 --2- 172.21.15.1:0/3035292285 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55883ea40ba0 0x55883ea4e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:25:53.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.452+0000 7ffb85e00640 1 --2- 172.21.15.1:0/3035292285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55883ea40260 0x55883ea519c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffb78020a30 tx=0x7ffb7802b270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a1283a3c2b7b846 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:53.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.452+0000 7ffb67e00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-15T22:25:53.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.453+0000 7ffb67e00640 1 -- 172.21.15.1:0/3035292285 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7800d400 con 0x55883ea40260 2024-09-15T22:25:53.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.453+0000 7ffb67e00640 1 -- 172.21.15.1:0/3035292285 <== mon.2 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7ffb78025050 con 0x55883ea40260 2024-09-15T22:25:53.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.453+0000 7ffb90259740 1 -- 172.21.15.1:0/3035292285 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb740c00c0 con 0x55883ea40260 2024-09-15T22:25:53.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.453+0000 7ffb67e00640 1 -- 172.21.15.1:0/3035292285 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ffb78044050 con 0x55883ea40260 2024-09-15T22:25:53.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.453+0000 7ffb90259740 10 client.25112 fetch_fsmap learned FSMap version 26 2024-09-15T22:25:53.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.453+0000 7ffb90259740 1 -- 172.21.15.1:0/3035292285 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55883eabfc80 con 0x55883ea40260 2024-09-15T22:25:53.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.453+0000 7ffb67e00640 1 -- 172.21.15.1:0/3035292285 <== mon.2 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb740c00c0 con 0x55883ea40260 2024-09-15T22:25:53.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.454+0000 7ffb67e00640 1 -- 172.21.15.1:0/3035292285 <== mon.2 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7ffb78015890 con 0x55883ea40260 2024-09-15T22:25:53.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.454+0000 7ffb90259740 10 client.25112 fetch_fsmap finished waiting for FSMap version 26 2024-09-15T22:25:53.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.454+0000 7ffb90259740 10 client.25112 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T22:25:53.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.454+0000 7ffb90259740 20 client.25112 populate_metadata read hostname 'smithi001' 2024-09-15T22:25:53.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.454+0000 7ffb90259740 1 --2- 172.21.15.1:0/3035292285 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55883eac05d0 0x55883eac29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:53.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.454+0000 7ffb90259740 4 client.25112 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:25:53.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.454+0000 7ffb90259740 1 -- 172.21.15.1:0/3035292285 --> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55883e9acb80 con 0x55883eac05d0 2024-09-15T22:25:53.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.455+0000 7ffb85400640 1 --2- 172.21.15.1:0/3035292285 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55883eac05d0 0x55883eac29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:53.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.455+0000 7ffb85400640 1 --2- 172.21.15.1:0/3035292285 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55883eac05d0 0x55883eac29c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd3241a0681ee927 server_cookie=c433b7b72dfb26e in_seq=0 out_seq=0 2024-09-15T22:25:53.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.455+0000 7ffb67e00640 10 client.25112 ms_handle_connect on v2:172.21.15.98:6838/2831161859 2024-09-15T22:25:53.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.459+0000 7ffb67e00640 1 -- 172.21.15.1:0/3035292285 <== mds.0 v2:172.21.15.98:6838/2831161859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55883e9acb80 con 0x55883eac05d0 2024-09-15T22:25:53.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.459+0000 7ffb67e00640 10 client.25112 handle_command_reply: tid=0 2024-09-15T22:25:53.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.459+0000 7ffb90259740 1 client.25112 shutdown 2024-09-15T22:25:53.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.459+0000 7ffb90259740 1 -- 172.21.15.1:0/3035292285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55883ea40260 msgr2=0x55883ea519c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:53.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.459+0000 7ffb90259740 1 --2- 172.21.15.1:0/3035292285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55883ea40260 0x55883ea519c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffb78020a30 tx=0x7ffb7802b270 comp rx=0 tx=0).stop 2024-09-15T22:25:53.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.459+0000 7ffb90259740 1 -- 172.21.15.1:0/3035292285 shutdown_connections 2024-09-15T22:25:53.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.459+0000 7ffb90259740 1 --2- 172.21.15.1:0/3035292285 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55883ea45c30 0x55883ea4eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:53.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.459+0000 7ffb90259740 1 --2- 172.21.15.1:0/3035292285 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55883eac05d0 0x55883eac29c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:53.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.459+0000 7ffb90259740 1 --2- 172.21.15.1:0/3035292285 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55883ea40ba0 0x55883ea4e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:53.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.459+0000 7ffb67e00640 0 client.25112 ms_handle_reset on v2:172.21.15.98:6838/2831161859 2024-09-15T22:25:53.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.459+0000 7ffb90259740 1 --2- 172.21.15.1:0/3035292285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55883ea40260 0x55883ea519c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:53.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.459+0000 7ffb90259740 1 -- 172.21.15.1:0/3035292285 >> 172.21.15.1:0/3035292285 conn(0x55883ea3b8d0 msgr2=0x55883ea3aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:53.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.459+0000 7ffb90259740 1 -- 172.21.15.1:0/3035292285 shutdown_connections 2024-09-15T22:25:53.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.459+0000 7ffb90259740 1 -- 172.21.15.1:0/3035292285 wait complete. 2024-09-15T22:25:53.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.459+0000 7ffb90259740 20 client.25112 trim_cache size 0 max 16384 2024-09-15T22:25:53.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-15T22:25:53.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-15T22:25:53.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-15T22:25:53.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-15T22:25:53.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.460+0000 7ffb87200640 1 -- 172.21.15.1:0/716927 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ffb6c0a3330 msgr2=0x7ffb6c0a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:53.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.460+0000 7ffb87200640 1 --2- 172.21.15.1:0/716927 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ffb6c0a3330 0x7ffb6c0a57f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ffb80013fd0 tx=0x7ffb80004ab0 comp rx=0 tx=0).stop 2024-09-15T22:25:53.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.460+0000 7ffb87200640 1 -- 172.21.15.1:0/716927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb88102ba0 msgr2=0x7ffb88196010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:53.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.460+0000 7ffb87200640 1 --2- 172.21.15.1:0/716927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb88102ba0 0x7ffb88196010 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffb74031440 tx=0x7ffb74032ce0 comp rx=0 tx=0).stop 2024-09-15T22:25:53.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.460+0000 7ffb87200640 1 -- 172.21.15.1:0/716927 shutdown_connections 2024-09-15T22:25:53.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.460+0000 7ffb87200640 1 --2- 172.21.15.1:0/716927 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7ffb6c0a3330 0x7ffb6c0a57f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:53.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.460+0000 7ffb87200640 1 --2- 172.21.15.1:0/716927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb88103560 0x7ffb8819d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:53.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.460+0000 7ffb87200640 1 --2- 172.21.15.1:0/716927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb88102ba0 0x7ffb88196010 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:53.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.460+0000 7ffb87200640 1 --2- 172.21.15.1:0/716927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb881019b0 0x7ffb88195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:53.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.460+0000 7ffb87200640 1 -- 172.21.15.1:0/716927 >> 172.21.15.1:0/716927 conn(0x7ffb880fd130 msgr2=0x7ffb88105f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:53.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.461+0000 7ffb87200640 1 -- 172.21.15.1:0/716927 shutdown_connections 2024-09-15T22:25:53.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:25:53.461+0000 7ffb87200640 1 -- 172.21.15.1:0/716927 wait complete. 2024-09-15T22:25:54.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:54 smithi012 ceph-mon[34883]: pgmap v387: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-15T22:25:55.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:54 smithi098 ceph-mon[35514]: pgmap v387: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-15T22:25:55.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:54 smithi001 ceph-mon[30843]: pgmap v387: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-15T22:25:56.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:56 smithi012 ceph-mon[34883]: pgmap v388: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-15T22:25:57.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:56 smithi098 ceph-mon[35514]: pgmap v388: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-15T22:25:57.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:56 smithi001 ceph-mon[30843]: pgmap v388: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-15T22:25:58.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:25:58 smithi012 ceph-mon[34883]: pgmap v389: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-15T22:25:59.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:25:58 smithi098 ceph-mon[35514]: pgmap v389: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-15T22:25:59.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:25:58 smithi001 ceph-mon[30843]: pgmap v389: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-15T22:26:00.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:00 smithi012 ceph-mon[34883]: pgmap v390: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-15T22:26:01.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:00 smithi098 ceph-mon[35514]: pgmap v390: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-15T22:26:01.125 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:00 smithi001 ceph-mon[30843]: pgmap v390: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-15T22:26:02.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:02 smithi012 ceph-mon[34883]: pgmap v391: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-15T22:26:03.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:02 smithi098 ceph-mon[35514]: pgmap v391: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-15T22:26:03.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:02 smithi001 ceph-mon[30843]: pgmap v391: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-15T22:26:04.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:04 smithi012 ceph-mon[34883]: pgmap v392: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-15T22:26:05.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:04 smithi098 ceph-mon[35514]: pgmap v392: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-15T22:26:05.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:04 smithi001 ceph-mon[30843]: pgmap v392: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-15T22:26:06.405 INFO:tasks.workunit.client.0.smithi001.stderr:Updating files: 62% (8093/12889) Updating files: 63% (8121/12889) Updating files: 64% (8249/12889) Updating files: 65% (8378/12889) Updating files: 66% (8507/12889) Updating files: 67% (8636/12889) Updating files: 68% (8765/12889) Updating files: 69% (8894/12889) Updating files: 70% (9023/12889) Updating files: 71% (9152/12889) Updating files: 72% (9281/12889) Updating files: 73% (9409/12889) Updating files: 74% (9538/12889) Updating files: 75% (9667/12889) Updating files: 76% (9796/12889) Updating files: 77% (9925/12889) Updating files: 78% (10054/12889) Updating files: 79% (10183/12889) Updating files: 80% (10312/12889) Updating files: 81% (10441/12889) Updating files: 82% (10569/12889) Updating files: 83% (10698/12889) Updating files: 84% (10827/12889) Updating files: 85% (10956/12889) Updating files: 86% (11085/12889) Updating files: 87% (11214/12889) Updating files: 88% (11343/12889) Updating files: 89% (11472/12889) Updating files: 90% (11601/12889) Updating files: 91% (11729/12889) Updating files: 92% (11858/12889) Updating files: 93% (11987/12889) Updating files: 94% (12116/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 99% (12775/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-15T22:26:06.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.578+0000 7fe807e00640 1 -- 172.21.15.1:0/1099054358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe808102b60 msgr2=0x7fe808104fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:06.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.578+0000 7fe807e00640 1 --2- 172.21.15.1:0/1099054358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe808102b60 0x7fe808104fd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0009900 tx=0x7fe7f002a3f0 comp rx=0 tx=0).stop 2024-09-15T22:26:06.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.578+0000 7fe807e00640 1 -- 172.21.15.1:0/1099054358 shutdown_connections 2024-09-15T22:26:06.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.578+0000 7fe807e00640 1 --2- 172.21.15.1:0/1099054358 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe808105510 0x7fe8081059c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:06.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.578+0000 7fe807e00640 1 --2- 172.21.15.1:0/1099054358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe808102b60 0x7fe808104fd0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:06.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.578+0000 7fe807e00640 1 --2- 172.21.15.1:0/1099054358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe808100210 0x7fe808102620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:06.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.578+0000 7fe807e00640 1 -- 172.21.15.1:0/1099054358 >> 172.21.15.1:0/1099054358 conn(0x7fe8080fc040 msgr2=0x7fe8080fe460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:06.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.578+0000 7fe807e00640 1 -- 172.21.15.1:0/1099054358 shutdown_connections 2024-09-15T22:26:06.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.578+0000 7fe807e00640 1 -- 172.21.15.1:0/1099054358 wait complete. 2024-09-15T22:26:06.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.579+0000 7fe807e00640 1 Processor -- start 2024-09-15T22:26:06.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.579+0000 7fe807e00640 1 -- start start 2024-09-15T22:26:06.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.579+0000 7fe807e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe808100210 0x7fe80819e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:06.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.580+0000 7fe807e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe808102b60 0x7fe80819e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:06.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.580+0000 7fe807e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe808105510 0x7fe8081a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:06.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.580+0000 7fe807e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe808113c60 con 0x7fe808105510 2024-09-15T22:26:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.580+0000 7fe807e00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe808113ae0 con 0x7fe808102b60 2024-09-15T22:26:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.580+0000 7fe807e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe808113de0 con 0x7fe808100210 2024-09-15T22:26:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.580+0000 7fe807400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe808105510 0x7fe8081a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.580+0000 7fe807400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe808105510 0x7fe8081a5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49448/0 (socket says 172.21.15.1:49448) 2024-09-15T22:26:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.580+0000 7fe807400640 1 -- 172.21.15.1:0/2189637524 learned_addr learned my addr 172.21.15.1:0/2189637524 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:26:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.580+0000 7fe7ffe00640 1 --2- 172.21.15.1:0/2189637524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe808102b60 0x7fe80819e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.580+0000 7fe806a00640 1 --2- 172.21.15.1:0/2189637524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe808100210 0x7fe80819e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.580+0000 7fe806a00640 1 -- 172.21.15.1:0/2189637524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe808102b60 msgr2=0x7fe80819e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.580+0000 7fe806a00640 1 --2- 172.21.15.1:0/2189637524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe808102b60 0x7fe80819e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.580+0000 7fe806a00640 1 -- 172.21.15.1:0/2189637524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe808105510 msgr2=0x7fe8081a5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.580+0000 7fe806a00640 1 --2- 172.21.15.1:0/2189637524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe808105510 0x7fe8081a5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.580+0000 7fe806a00640 1 -- 172.21.15.1:0/2189637524 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8081a5ec0 con 0x7fe808100210 2024-09-15T22:26:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.580+0000 7fe807400640 1 --2- 172.21.15.1:0/2189637524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe808105510 0x7fe8081a5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:26:06.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.581+0000 7fe806a00640 1 --2- 172.21.15.1:0/2189637524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe808100210 0x7fe80819e2a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe7f800e9f0 tx=0x7fe7f800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:06.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.581+0000 7fe7ff400640 1 -- 172.21.15.1:0/2189637524 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f800ccc0 con 0x7fe808100210 2024-09-15T22:26:06.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.581+0000 7fe807e00640 1 -- 172.21.15.1:0/2189637524 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8081a61b0 con 0x7fe808100210 2024-09-15T22:26:06.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.581+0000 7fe7ff400640 1 -- 172.21.15.1:0/2189637524 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7f8010910 con 0x7fe808100210 2024-09-15T22:26:06.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.581+0000 7fe7ff400640 1 -- 172.21.15.1:0/2189637524 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8018960 con 0x7fe808100210 2024-09-15T22:26:06.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.581+0000 7fe807e00640 1 -- 172.21.15.1:0/2189637524 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8081a66d0 con 0x7fe808100210 2024-09-15T22:26:06.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.584+0000 7fe810bdf740 1 Processor -- start 2024-09-15T22:26:06.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.584+0000 7fe810bdf740 1 -- start start 2024-09-15T22:26:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.584+0000 7fe810bdf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afee3bf260 0x55afee3bf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.584+0000 7fe7ff400640 1 -- 172.21.15.1:0/2189637524 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fe7f8010ac0 con 0x7fe808100210 2024-09-15T22:26:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.584+0000 7fe810bdf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afee3bfba0 0x55afee3c4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.584+0000 7fe810bdf740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afee3c4c30 0x55afee3c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.584+0000 7fe810bdf740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55afee324100 con 0x55afee3c4c30 2024-09-15T22:26:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.584+0000 7fe810bdf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55afee2cc1b0 con 0x55afee3bfba0 2024-09-15T22:26:06.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.584+0000 7fe810bdf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55afee3200c0 con 0x55afee3bf260 2024-09-15T22:26:06.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.585+0000 7fe7ffe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afee3c4c30 0x55afee3c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:06.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.585+0000 7fe807400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afee3bf260 0x55afee3bf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:06.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.585+0000 7fe806a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afee3bfba0 0x55afee3c4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:06.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.585+0000 7fe7ffe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afee3c4c30 0x55afee3c70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49456/0 (socket says 172.21.15.1:49456) 2024-09-15T22:26:06.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.585+0000 7fe807400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afee3bf260 0x55afee3bf660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:48834/0 (socket says 172.21.15.1:48834) 2024-09-15T22:26:06.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.585+0000 7fe7ffe00640 1 -- 172.21.15.1:0/304600967 learned_addr learned my addr 172.21.15.1:0/304600967 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:26:06.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.585+0000 7fe7ffe00640 1 -- 172.21.15.1:0/304600967 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afee3bf260 msgr2=0x55afee3bf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:06.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.585+0000 7fe7ffe00640 1 --2- 172.21.15.1:0/304600967 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afee3bf260 0x55afee3bf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:06.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.585+0000 7fe7ffe00640 1 -- 172.21.15.1:0/304600967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afee3bfba0 msgr2=0x55afee3c4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:06.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.585+0000 7fe7ffe00640 1 --2- 172.21.15.1:0/304600967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afee3bfba0 0x55afee3c4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:06.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.585+0000 7fe7ffe00640 1 -- 172.21.15.1:0/304600967 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afee037210 con 0x55afee3c4c30 2024-09-15T22:26:06.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.585+0000 7fe806a00640 1 --2- 172.21.15.1:0/304600967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afee3bfba0 0x55afee3c4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:26:06.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.586+0000 7fe7ffe00640 1 --2- 172.21.15.1:0/304600967 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afee3c4c30 0x55afee3c70f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0000c00 tx=0x7fe7f0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18439b859c209fa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:06.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.586+0000 7fe7ff400640 1 --2- 172.21.15.1:0/2189637524 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe7ec0a3230 0x7fe7ec0a56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:06.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.586+0000 7fe7f7e00640 1 -- 172.21.15.1:0/304600967 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f0035040 con 0x55afee3c4c30 2024-09-15T22:26:06.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.586+0000 7fe7f7e00640 1 -- 172.21.15.1:0/304600967 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7f0004430 con 0x55afee3c4c30 2024-09-15T22:26:06.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.586+0000 7fe7f7e00640 1 -- 172.21.15.1:0/304600967 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f00316b0 con 0x55afee3c4c30 2024-09-15T22:26:06.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.586+0000 7fe7ff400640 1 -- 172.21.15.1:0/2189637524 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7fe7f80cfd60 con 0x7fe808100210 2024-09-15T22:26:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.586+0000 7fe807400640 1 --2- 172.21.15.1:0/2189637524 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe7ec0a3230 0x7fe7ec0a56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.587+0000 7fe810bdf740 1 -- 172.21.15.1:0/304600967 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afee3c4c30 msgr2=0x55afee3c70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.587+0000 7fe810bdf740 1 --2- 172.21.15.1:0/304600967 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afee3c4c30 0x55afee3c70f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0000c00 tx=0x7fe7f0004040 comp rx=0 tx=0).stop 2024-09-15T22:26:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.587+0000 7fe810bdf740 1 -- 172.21.15.1:0/304600967 shutdown_connections 2024-09-15T22:26:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.587+0000 7fe810bdf740 1 --2- 172.21.15.1:0/304600967 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afee3c4c30 0x55afee3c70f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.587+0000 7fe810bdf740 1 --2- 172.21.15.1:0/304600967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afee3bfba0 0x55afee3c4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.587+0000 7fe810bdf740 1 --2- 172.21.15.1:0/304600967 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afee3bf260 0x55afee3bf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.587+0000 7fe810bdf740 1 -- 172.21.15.1:0/304600967 >> 172.21.15.1:0/304600967 conn(0x55afee3ba8d0 msgr2=0x55afee3bacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.587+0000 7fe810bdf740 1 -- 172.21.15.1:0/304600967 shutdown_connections 2024-09-15T22:26:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.587+0000 7fe807400640 1 --2- 172.21.15.1:0/2189637524 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe7ec0a3230 0x7fe7ec0a56f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe8000049d0 tx=0x7fe800009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.587+0000 7fe810bdf740 1 -- 172.21.15.1:0/304600967 wait complete. 2024-09-15T22:26:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.588+0000 7fe810bdf740 1 -- start start 2024-09-15T22:26:06.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.588+0000 7fe810bdf740 1 Processor -- start 2024-09-15T22:26:06.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.588+0000 7fe810bdf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afee3bf260 0x55afee3c9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:06.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.588+0000 7fe810bdf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afee3bfba0 0x55afee3c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:06.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.588+0000 7fe810bdf740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afee3c4c30 0x55afee3d0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:06.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.588+0000 7fe810bdf740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55afee3c7ba0 con 0x55afee3c4c30 2024-09-15T22:26:06.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.588+0000 7fe810bdf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55afee2ad090 con 0x55afee3bf260 2024-09-15T22:26:06.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.588+0000 7fe810bdf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55afee3c7d20 con 0x55afee3bfba0 2024-09-15T22:26:06.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.588+0000 7fe810bdf740 10 client.0 _ll_register_callbacks cb 0x55afee301f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:26:06.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.589+0000 7fe806a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afee3bf260 0x55afee3c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:06.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.589+0000 7fe7ffe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afee3bfba0 0x55afee3c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:06.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.589+0000 7fe806a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afee3bf260 0x55afee3c9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:48712/0 (socket says 172.21.15.1:48712) 2024-09-15T22:26:06.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.589+0000 7fe7ffe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afee3bfba0 0x55afee3c98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:48836/0 (socket says 172.21.15.1:48836) 2024-09-15T22:26:06.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.589+0000 7fe806a00640 1 -- 172.21.15.1:0/3813267903 learned_addr learned my addr 172.21.15.1:0/3813267903 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:26:06.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.589+0000 7fe807400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afee3c4c30 0x55afee3d0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:06.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.589+0000 7fe806a00640 1 -- 172.21.15.1:0/3813267903 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afee3bfba0 msgr2=0x55afee3c98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:06.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.589+0000 7fe806a00640 1 --2- 172.21.15.1:0/3813267903 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afee3bfba0 0x55afee3c98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:06.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.589+0000 7fe806a00640 1 -- 172.21.15.1:0/3813267903 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afee3c4c30 msgr2=0x55afee3d0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:06.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.589+0000 7fe806a00640 1 --2- 172.21.15.1:0/3813267903 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afee3c4c30 0x55afee3d0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:06.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.589+0000 7fe806a00640 1 -- 172.21.15.1:0/3813267903 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afee103620 con 0x55afee3bf260 2024-09-15T22:26:06.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.589+0000 7fe807400640 1 --2- 172.21.15.1:0/3813267903 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afee3c4c30 0x55afee3d0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:26:06.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.589+0000 7fe806a00640 1 --2- 172.21.15.1:0/3813267903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afee3bf260 0x55afee3c9380 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe7f809c070 tx=0x7fe7f80d3310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4de2a0f67be2013e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:06.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.589+0000 7fe7f4c00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-15T22:26:06.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.589+0000 7fe7f4c00640 1 -- 172.21.15.1:0/3813267903 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f809bcd0 con 0x55afee3bf260 2024-09-15T22:26:06.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.590+0000 7fe7f4c00640 1 -- 172.21.15.1:0/3813267903 <== mon.2 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7fe7f80bc2b0 con 0x55afee3bf260 2024-09-15T22:26:06.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.590+0000 7fe810bdf740 1 -- 172.21.15.1:0/3813267903 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7f0004430 con 0x55afee3bf260 2024-09-15T22:26:06.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.590+0000 7fe7f4c00640 1 -- 172.21.15.1:0/3813267903 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe7f809c370 con 0x55afee3bf260 2024-09-15T22:26:06.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.590+0000 7fe810bdf740 10 client.25124 fetch_fsmap learned FSMap version 26 2024-09-15T22:26:06.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.590+0000 7fe810bdf740 1 -- 172.21.15.1:0/3813267903 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55afee3d3760 con 0x55afee3bf260 2024-09-15T22:26:06.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.590+0000 7fe7f4c00640 1 -- 172.21.15.1:0/3813267903 <== mon.2 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7f0004430 con 0x55afee3bf260 2024-09-15T22:26:06.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.590+0000 7fe7f4c00640 1 -- 172.21.15.1:0/3813267903 <== mon.2 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fe7f8018b00 con 0x55afee3bf260 2024-09-15T22:26:06.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.590+0000 7fe810bdf740 10 client.25124 fetch_fsmap finished waiting for FSMap version 26 2024-09-15T22:26:06.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.590+0000 7fe810bdf740 10 client.25124 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T22:26:06.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.590+0000 7fe810bdf740 20 client.25124 populate_metadata read hostname 'smithi001' 2024-09-15T22:26:06.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.590+0000 7fe810bdf740 1 --2- 172.21.15.1:0/3813267903 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55afee3d4de0 0x55afee3d71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:06.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.590+0000 7fe810bdf740 4 client.25124 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:26:06.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.590+0000 7fe810bdf740 1 -- 172.21.15.1:0/3813267903 --> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55afee331830 con 0x55afee3d4de0 2024-09-15T22:26:06.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.591+0000 7fe7ffe00640 1 --2- 172.21.15.1:0/3813267903 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55afee3d4de0 0x55afee3d71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:06.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.591+0000 7fe7ffe00640 1 --2- 172.21.15.1:0/3813267903 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55afee3d4de0 0x55afee3d71d0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59b5b356e94cbec4 server_cookie=1fdcc1662cc7bd77 in_seq=0 out_seq=0 2024-09-15T22:26:06.598 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.591+0000 7fe7f4c00640 10 client.25124 ms_handle_connect on v2:172.21.15.98:6838/2831161859 2024-09-15T22:26:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.592+0000 7fe7f4c00640 1 -- 172.21.15.1:0/3813267903 <== mds.0 v2:172.21.15.98:6838/2831161859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55afee331830 con 0x55afee3d4de0 2024-09-15T22:26:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.592+0000 7fe7f4c00640 10 client.25124 handle_command_reply: tid=0 2024-09-15T22:26:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.592+0000 7fe810bdf740 1 client.25124 shutdown 2024-09-15T22:26:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.592+0000 7fe810bdf740 1 -- 172.21.15.1:0/3813267903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afee3bf260 msgr2=0x55afee3c9380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.592+0000 7fe810bdf740 1 --2- 172.21.15.1:0/3813267903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afee3bf260 0x55afee3c9380 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe7f809c070 tx=0x7fe7f80d3310 comp rx=0 tx=0).stop 2024-09-15T22:26:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.592+0000 7fe810bdf740 1 -- 172.21.15.1:0/3813267903 shutdown_connections 2024-09-15T22:26:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.592+0000 7fe810bdf740 1 --2- 172.21.15.1:0/3813267903 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55afee3d4de0 0x55afee3d71d0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.592+0000 7fe810bdf740 1 --2- 172.21.15.1:0/3813267903 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afee3c4c30 0x55afee3d0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.592+0000 7fe810bdf740 1 --2- 172.21.15.1:0/3813267903 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afee3bfba0 0x55afee3c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.592+0000 7fe7f4c00640 0 client.25124 ms_handle_reset on v2:172.21.15.98:6838/2831161859 2024-09-15T22:26:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.592+0000 7fe810bdf740 1 --2- 172.21.15.1:0/3813267903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afee3bf260 0x55afee3c9380 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.592+0000 7fe810bdf740 1 -- 172.21.15.1:0/3813267903 >> 172.21.15.1:0/3813267903 conn(0x55afee3ba8d0 msgr2=0x55afee3bc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.592+0000 7fe810bdf740 1 -- 172.21.15.1:0/3813267903 shutdown_connections 2024-09-15T22:26:06.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.592+0000 7fe810bdf740 1 -- 172.21.15.1:0/3813267903 wait complete. 2024-09-15T22:26:06.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.592+0000 7fe810bdf740 20 client.25124 trim_cache size 0 max 16384 2024-09-15T22:26:06.609 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.607+0000 7fe810bdf740 1 Processor -- start 2024-09-15T22:26:06.609 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.608+0000 7fe810bdf740 1 -- start start 2024-09-15T22:26:06.610 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.608+0000 7fe810bdf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afee3bf260 0x55afee3b9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:06.610 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.608+0000 7fe810bdf740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afee3bfba0 0x55afee3b9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:06.610 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.608+0000 7fe810bdf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afee3c4c30 0x55afee3d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:06.610 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.608+0000 7fe810bdf740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe8081b1f20 con 0x55afee3bfba0 2024-09-15T22:26:06.610 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.608+0000 7fe810bdf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe8081af7f0 con 0x55afee3c4c30 2024-09-15T22:26:06.610 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.608+0000 7fe810bdf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe8081ad640 con 0x55afee3bf260 2024-09-15T22:26:06.611 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.608+0000 7fe7ffe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afee3bfba0 0x55afee3b9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:06.611 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.608+0000 7fe7ffe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afee3bfba0 0x55afee3b9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49472/0 (socket says 172.21.15.1:49472) 2024-09-15T22:26:06.611 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.608+0000 7fe7ffe00640 1 -- 172.21.15.1:0/2995803786 learned_addr learned my addr 172.21.15.1:0/2995803786 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:26:06.611 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.608+0000 7fe806a00640 1 --2- 172.21.15.1:0/2995803786 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afee3bf260 0x55afee3b9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:06.611 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.608+0000 7fe807400640 1 --2- 172.21.15.1:0/2995803786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afee3c4c30 0x55afee3d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:06.611 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.609+0000 7fe7ffe00640 1 -- 172.21.15.1:0/2995803786 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afee3bf260 msgr2=0x55afee3b9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:06.611 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.609+0000 7fe7ffe00640 1 --2- 172.21.15.1:0/2995803786 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afee3bf260 0x55afee3b9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:06.611 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.609+0000 7fe7ffe00640 1 -- 172.21.15.1:0/2995803786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afee3c4c30 msgr2=0x55afee3d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:06.611 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.609+0000 7fe7ffe00640 1 --2- 172.21.15.1:0/2995803786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afee3c4c30 0x55afee3d08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:06.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.609+0000 7fe7ffe00640 1 -- 172.21.15.1:0/2995803786 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afee3d7540 con 0x55afee3bfba0 2024-09-15T22:26:06.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.609+0000 7fe7ffe00640 1 --2- 172.21.15.1:0/2995803786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afee3bfba0 0x55afee3b9e40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0004650 tx=0x7fe7f00315b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5468749ad9de62fc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:06.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.609+0000 7fe7f7400640 1 -- 172.21.15.1:0/2995803786 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f0035040 con 0x55afee3bfba0 2024-09-15T22:26:06.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.609+0000 7fe7f7400640 1 -- 172.21.15.1:0/2995803786 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7f0005500 con 0x55afee3bfba0 2024-09-15T22:26:06.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.609+0000 7fe7f7400640 1 -- 172.21.15.1:0/2995803786 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f0031910 con 0x55afee3bfba0 2024-09-15T22:26:06.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.610+0000 7fe810bdf740 1 -- 172.21.15.1:0/2995803786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afee3bfba0 msgr2=0x55afee3b9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:06.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.610+0000 7fe810bdf740 1 --2- 172.21.15.1:0/2995803786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afee3bfba0 0x55afee3b9e40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0004650 tx=0x7fe7f00315b0 comp rx=0 tx=0).stop 2024-09-15T22:26:06.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.610+0000 7fe810bdf740 1 -- 172.21.15.1:0/2995803786 shutdown_connections 2024-09-15T22:26:06.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.610+0000 7fe810bdf740 1 --2- 172.21.15.1:0/2995803786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afee3c4c30 0x55afee3d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:06.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.610+0000 7fe810bdf740 1 --2- 172.21.15.1:0/2995803786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afee3bfba0 0x55afee3b9e40 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:06.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.610+0000 7fe810bdf740 1 --2- 172.21.15.1:0/2995803786 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afee3bf260 0x55afee3b9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:06.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.610+0000 7fe810bdf740 1 -- 172.21.15.1:0/2995803786 >> 172.21.15.1:0/2995803786 conn(0x55afee3ba8d0 msgr2=0x55afee3b91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:06.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.610+0000 7fe810bdf740 1 -- 172.21.15.1:0/2995803786 shutdown_connections 2024-09-15T22:26:06.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.610+0000 7fe810bdf740 1 -- 172.21.15.1:0/2995803786 wait complete. 2024-09-15T22:26:06.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.611+0000 7fe810bdf740 1 -- start start 2024-09-15T22:26:06.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.611+0000 7fe810bdf740 1 Processor -- start 2024-09-15T22:26:06.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.611+0000 7fe810bdf740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afee3bf260 0x55afee3cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:06.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.612+0000 7fe810bdf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afee3bfba0 0x55afee3cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:06.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.612+0000 7fe810bdf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afee3c4c30 0x55afee43daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:06.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.612+0000 7fe810bdf740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe8081adcb0 con 0x55afee3bf260 2024-09-15T22:26:06.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.612+0000 7fe810bdf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe8081af120 con 0x55afee3bfba0 2024-09-15T22:26:06.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.612+0000 7fe810bdf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe8081ae380 con 0x55afee3c4c30 2024-09-15T22:26:06.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.612+0000 7fe810bdf740 10 client.0 _ll_register_callbacks cb 0x7fe7f80d3490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:26:06.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.612+0000 7fe806a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afee3bf260 0x55afee3cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:06.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.612+0000 7fe806a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afee3bf260 0x55afee3cd7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49480/0 (socket says 172.21.15.1:49480) 2024-09-15T22:26:06.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.612+0000 7fe806a00640 1 -- 172.21.15.1:0/3574257003 learned_addr learned my addr 172.21.15.1:0/3574257003 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:26:06.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.612+0000 7fe7ffe00640 1 --2- 172.21.15.1:0/3574257003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afee3bfba0 0x55afee3cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:06.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.612+0000 7fe807400640 1 --2- 172.21.15.1:0/3574257003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afee3c4c30 0x55afee43daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:06.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.612+0000 7fe806a00640 1 -- 172.21.15.1:0/3574257003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afee3c4c30 msgr2=0x55afee43daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:06.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.612+0000 7fe806a00640 1 --2- 172.21.15.1:0/3574257003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afee3c4c30 0x55afee43daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.612+0000 7fe806a00640 1 -- 172.21.15.1:0/3574257003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afee3bfba0 msgr2=0x55afee3cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.612+0000 7fe806a00640 1 --2- 172.21.15.1:0/3574257003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afee3bfba0 0x55afee3cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.612+0000 7fe806a00640 1 -- 172.21.15.1:0/3574257003 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afee43e010 con 0x55afee3bf260 2024-09-15T22:26:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.613+0000 7fe806a00640 1 --2- 172.21.15.1:0/3574257003 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afee3bf260 0x55afee3cd7d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8098050 tx=0x7fe7f80d3540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9a77da8dfbba012 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.613+0000 7fe7f4c00640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-15T22:26:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.613+0000 7fe7f4c00640 1 -- 172.21.15.1:0/3574257003 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f80a0670 con 0x55afee3bf260 2024-09-15T22:26:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.613+0000 7fe7f4c00640 1 -- 172.21.15.1:0/3574257003 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7fe7f80bc0b0 con 0x55afee3bf260 2024-09-15T22:26:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.613+0000 7fe810bdf740 1 -- 172.21.15.1:0/3574257003 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7f0005500 con 0x55afee3bf260 2024-09-15T22:26:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.613+0000 7fe7f4c00640 1 -- 172.21.15.1:0/3574257003 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe7f80a4f30 con 0x55afee3bf260 2024-09-15T22:26:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.613+0000 7fe810bdf740 10 client.15141 fetch_fsmap learned FSMap version 26 2024-09-15T22:26:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.613+0000 7fe810bdf740 1 -- 172.21.15.1:0/3574257003 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55afee43f370 con 0x55afee3bf260 2024-09-15T22:26:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.613+0000 7fe7f4c00640 1 -- 172.21.15.1:0/3574257003 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7f0005500 con 0x55afee3bf260 2024-09-15T22:26:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.613+0000 7fe7f4c00640 1 -- 172.21.15.1:0/3574257003 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fe7f80a00f0 con 0x55afee3bf260 2024-09-15T22:26:06.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.614+0000 7fe810bdf740 10 client.15141 fetch_fsmap finished waiting for FSMap version 26 2024-09-15T22:26:06.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.614+0000 7fe810bdf740 10 client.15141 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T22:26:06.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.614+0000 7fe810bdf740 20 client.15141 populate_metadata read hostname 'smithi001' 2024-09-15T22:26:06.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.614+0000 7fe810bdf740 1 --2- 172.21.15.1:0/3574257003 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55afee43fb90 0x55afee441fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:06.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.614+0000 7fe810bdf740 4 client.15141 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:26:06.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.614+0000 7fe810bdf740 1 -- 172.21.15.1:0/3574257003 --> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55afee32bb80 con 0x55afee43fb90 2024-09-15T22:26:06.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.614+0000 7fe7ffe00640 1 --2- 172.21.15.1:0/3574257003 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55afee43fb90 0x55afee441fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:06.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.614+0000 7fe7ffe00640 1 --2- 172.21.15.1:0/3574257003 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55afee43fb90 0x55afee441fb0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b37b70920c4c057f server_cookie=8cc56dfb385b977e in_seq=0 out_seq=0 2024-09-15T22:26:06.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.614+0000 7fe7f4c00640 10 client.15141 ms_handle_connect on v2:172.21.15.98:6838/2831161859 2024-09-15T22:26:06.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.618+0000 7fe7f4c00640 1 -- 172.21.15.1:0/3574257003 <== mds.0 v2:172.21.15.98:6838/2831161859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55afee32bb80 con 0x55afee43fb90 2024-09-15T22:26:06.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.618+0000 7fe7f4c00640 10 client.15141 handle_command_reply: tid=0 2024-09-15T22:26:06.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.618+0000 7fe810bdf740 1 client.15141 shutdown 2024-09-15T22:26:06.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.619+0000 7fe810bdf740 1 -- 172.21.15.1:0/3574257003 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afee3bf260 msgr2=0x55afee3cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:06.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.619+0000 7fe810bdf740 1 --2- 172.21.15.1:0/3574257003 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afee3bf260 0x55afee3cd7d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8098050 tx=0x7fe7f80d3540 comp rx=0 tx=0).stop 2024-09-15T22:26:06.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.619+0000 7fe810bdf740 1 -- 172.21.15.1:0/3574257003 shutdown_connections 2024-09-15T22:26:06.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.619+0000 7fe810bdf740 1 --2- 172.21.15.1:0/3574257003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afee3c4c30 0x55afee43daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:06.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.619+0000 7fe810bdf740 1 --2- 172.21.15.1:0/3574257003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afee3bfba0 0x55afee3cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:06.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.619+0000 7fe810bdf740 1 --2- 172.21.15.1:0/3574257003 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55afee43fb90 0x55afee441fb0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:06.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.619+0000 7fe810bdf740 1 --2- 172.21.15.1:0/3574257003 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55afee3bf260 0x55afee3cd7d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:06.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.619+0000 7fe7f4c00640 0 client.15141 ms_handle_reset on v2:172.21.15.98:6838/2831161859 2024-09-15T22:26:06.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.619+0000 7fe810bdf740 1 -- 172.21.15.1:0/3574257003 >> 172.21.15.1:0/3574257003 conn(0x55afee3ba8d0 msgr2=0x55afee3b9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:06.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.619+0000 7fe810bdf740 1 -- 172.21.15.1:0/3574257003 shutdown_connections 2024-09-15T22:26:06.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.619+0000 7fe810bdf740 1 -- 172.21.15.1:0/3574257003 wait complete. 2024-09-15T22:26:06.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.619+0000 7fe810bdf740 20 client.15141 trim_cache size 0 max 16384 2024-09-15T22:26:06.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-15T22:26:06.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-15T22:26:06.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-15T22:26:06.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-15T22:26:06.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.620+0000 7fe807e00640 1 -- 172.21.15.1:0/2189637524 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe7ec0a3230 msgr2=0x7fe7ec0a56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:06.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.620+0000 7fe807e00640 1 --2- 172.21.15.1:0/2189637524 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe7ec0a3230 0x7fe7ec0a56f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe8000049d0 tx=0x7fe800009500 comp rx=0 tx=0).stop 2024-09-15T22:26:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.620+0000 7fe807e00640 1 -- 172.21.15.1:0/2189637524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe808100210 msgr2=0x7fe80819e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.620+0000 7fe807e00640 1 --2- 172.21.15.1:0/2189637524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe808100210 0x7fe80819e2a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe7f800e9f0 tx=0x7fe7f800eeb0 comp rx=0 tx=0).stop 2024-09-15T22:26:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.620+0000 7fe807e00640 1 -- 172.21.15.1:0/2189637524 shutdown_connections 2024-09-15T22:26:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.620+0000 7fe807e00640 1 --2- 172.21.15.1:0/2189637524 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fe7ec0a3230 0x7fe7ec0a56f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.620+0000 7fe807e00640 1 --2- 172.21.15.1:0/2189637524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe808105510 0x7fe8081a5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.620+0000 7fe807e00640 1 --2- 172.21.15.1:0/2189637524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe808102b60 0x7fe80819e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.620+0000 7fe807e00640 1 --2- 172.21.15.1:0/2189637524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe808100210 0x7fe80819e2a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.620+0000 7fe807e00640 1 -- 172.21.15.1:0/2189637524 >> 172.21.15.1:0/2189637524 conn(0x7fe8080fc040 msgr2=0x7fe808100ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.620+0000 7fe807e00640 1 -- 172.21.15.1:0/2189637524 shutdown_connections 2024-09-15T22:26:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:06.620+0000 7fe807e00640 1 -- 172.21.15.1:0/2189637524 wait complete. 2024-09-15T22:26:06.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:06 smithi012 ceph-mon[34883]: pgmap v393: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-15T22:26:07.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:06 smithi098 ceph-mon[35514]: pgmap v393: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-15T22:26:07.125 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:06 smithi001 ceph-mon[30843]: pgmap v393: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-15T22:26:07.222 INFO:tasks.workunit.client.0.smithi001.stderr:Note: switching to 'ad35db06e8924912f01e32b35576297c0f1352b4'. 2024-09-15T22:26:07.222 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-15T22:26:07.222 INFO:tasks.workunit.client.0.smithi001.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-15T22:26:07.222 INFO:tasks.workunit.client.0.smithi001.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-15T22:26:07.222 INFO:tasks.workunit.client.0.smithi001.stderr:state without impacting any branches by switching back to a branch. 2024-09-15T22:26:07.222 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-15T22:26:07.223 INFO:tasks.workunit.client.0.smithi001.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-15T22:26:07.223 INFO:tasks.workunit.client.0.smithi001.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-15T22:26:07.223 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-15T22:26:07.223 INFO:tasks.workunit.client.0.smithi001.stderr: git switch -c 2024-09-15T22:26:07.223 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-15T22:26:07.223 INFO:tasks.workunit.client.0.smithi001.stderr:Or undo this operation with: 2024-09-15T22:26:07.223 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-15T22:26:07.223 INFO:tasks.workunit.client.0.smithi001.stderr: git switch - 2024-09-15T22:26:07.223 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-15T22:26:07.223 INFO:tasks.workunit.client.0.smithi001.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-15T22:26:07.223 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-15T22:26:07.223 INFO:tasks.workunit.client.0.smithi001.stderr:HEAD is now at ad35db06e89 Merge pull request #59794 from zdover23/wip-doc-2024-09-15-backport-59613-to-squid 2024-09-15T22:26:07.236 DEBUG:teuthology.orchestra.run.smithi001:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-15T22:26:07.325 INFO:tasks.workunit.client.0.smithi001.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-15T22:26:07.330 INFO:tasks.workunit.client.0.smithi001.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-15T22:26:07.330 INFO:tasks.workunit.client.0.smithi001.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-15T22:26:08.023 INFO:tasks.workunit.client.0.smithi001.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-15T22:26:08.118 INFO:tasks.workunit.client.0.smithi001.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-15T22:26:08.185 INFO:tasks.workunit.client.0.smithi001.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-15T22:26:08.188 INFO:tasks.workunit.client.0.smithi001.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-15T22:26:08.188 INFO:tasks.workunit.client.0.smithi001.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-15T22:26:08.253 INFO:tasks.workunit.client.0.smithi001.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-15T22:26:08.261 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T22:26:08.261 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-15T22:26:08.298 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-15T22:26:08.299 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-15T22:26:08.299 DEBUG:teuthology.orchestra.run.smithi001:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ad35db06e8924912f01e32b35576297c0f1352b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-15T22:26:08.386 INFO:tasks.workunit.client.0.smithi001.stderr:+ mkdir -p fsstress 2024-09-15T22:26:08.389 INFO:tasks.workunit.client.0.smithi001.stderr:+ pushd fsstress 2024-09-15T22:26:08.390 INFO:tasks.workunit.client.0.smithi001.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-15T22:26:08.390 INFO:tasks.workunit.client.0.smithi001.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-15T22:26:08.902 INFO:tasks.workunit.client.0.smithi001.stderr:+ tar xzf ltp-full.tgz 2024-09-15T22:26:08.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:08 smithi012 ceph-mon[34883]: pgmap v394: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-15T22:26:09.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:08 smithi098 ceph-mon[35514]: pgmap v394: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-15T22:26:09.125 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:08 smithi001 ceph-mon[30843]: pgmap v394: 97 pgs: 97 active+clean; 670 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-15T22:26:10.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:10 smithi012 ceph-mon[34883]: pgmap v395: 97 pgs: 97 active+clean; 688 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-09-15T22:26:11.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:10 smithi098 ceph-mon[35514]: pgmap v395: 97 pgs: 97 active+clean; 688 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-09-15T22:26:11.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:10 smithi001 ceph-mon[30843]: pgmap v395: 97 pgs: 97 active+clean; 688 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-09-15T22:26:12.685 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:12 smithi001 ceph-mon[30843]: pgmap v396: 97 pgs: 97 active+clean; 688 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-09-15T22:26:12.686 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:12 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:26:12.686 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:12 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:26:12.686 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:12 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:26:12.686 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:12 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:26:12.686 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:12 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:26:12.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:12 smithi012 ceph-mon[34883]: pgmap v396: 97 pgs: 97 active+clean; 688 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-09-15T22:26:12.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:12 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:26:12.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:12 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:26:12.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:12 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:26:12.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:12 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:26:12.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:12 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:26:13.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:12 smithi098 ceph-mon[35514]: pgmap v396: 97 pgs: 97 active+clean; 688 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-09-15T22:26:13.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:12 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:26:13.060 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:12 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:26:13.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:12 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:26:13.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:12 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:26:13.061 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:12 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:26:14.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:13 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:26:14.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:13 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:26:14.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:13 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:14.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:13 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:26:14.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:13 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:26:14.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:13 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:26:14.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:13 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:26:14.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:13 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:14.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:13 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:26:14.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:13 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:26:14.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:13 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:26:14.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:13 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:26:14.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:13 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:14.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:13 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:26:14.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:13 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:26:15.125 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:14 smithi001 ceph-mon[30843]: pgmap v397: 97 pgs: 97 active+clean; 688 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.9 KiB/s wr, 5 op/s 2024-09-15T22:26:15.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:14 smithi012 ceph-mon[34883]: pgmap v397: 97 pgs: 97 active+clean; 688 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.9 KiB/s wr, 5 op/s 2024-09-15T22:26:15.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:14 smithi098 ceph-mon[35514]: pgmap v397: 97 pgs: 97 active+clean; 688 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.9 KiB/s wr, 5 op/s 2024-09-15T22:26:17.125 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:16 smithi001 ceph-mon[30843]: pgmap v398: 97 pgs: 97 active+clean; 17 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 1.4 MiB/s wr, 61 op/s 2024-09-15T22:26:17.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:16 smithi012 ceph-mon[34883]: pgmap v398: 97 pgs: 97 active+clean; 17 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 1.4 MiB/s wr, 61 op/s 2024-09-15T22:26:17.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:16 smithi098 ceph-mon[35514]: pgmap v398: 97 pgs: 97 active+clean; 17 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 1.4 MiB/s wr, 61 op/s 2024-09-15T22:26:19.112 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:18 smithi098 ceph-mon[35514]: pgmap v399: 97 pgs: 97 active+clean; 21 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 1.8 MiB/s wr, 65 op/s 2024-09-15T22:26:19.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:18 smithi001 ceph-mon[30843]: pgmap v399: 97 pgs: 97 active+clean; 21 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 1.8 MiB/s wr, 65 op/s 2024-09-15T22:26:19.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:18 smithi012 ceph-mon[34883]: pgmap v399: 97 pgs: 97 active+clean; 21 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 1.8 MiB/s wr, 65 op/s 2024-09-15T22:26:19.754 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.751+0000 7fdeaa000640 1 -- 172.21.15.1:0/1978387388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdea410d730 msgr2=0x7fdea410dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:19.754 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.751+0000 7fdeaa000640 1 --2- 172.21.15.1:0/1978387388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdea410d730 0x7fdea410dbb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fde8c009900 tx=0x7fde8c02a3f0 comp rx=0 tx=0).stop 2024-09-15T22:26:19.754 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.751+0000 7fdeaa000640 1 -- 172.21.15.1:0/1978387388 shutdown_connections 2024-09-15T22:26:19.754 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.751+0000 7fdeaa000640 1 --2- 172.21.15.1:0/1978387388 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdea410e0f0 0x7fdea4114980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:19.754 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.751+0000 7fdeaa000640 1 --2- 172.21.15.1:0/1978387388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdea410d730 0x7fdea410dbb0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:19.754 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.751+0000 7fdeaa000640 1 --2- 172.21.15.1:0/1978387388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdea410c570 0x7fdea410c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:19.754 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.751+0000 7fdeaa000640 1 -- 172.21.15.1:0/1978387388 >> 172.21.15.1:0/1978387388 conn(0x7fdea406c2b0 msgr2=0x7fdea406c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:19.754 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.752+0000 7fdeaa000640 1 -- 172.21.15.1:0/1978387388 shutdown_connections 2024-09-15T22:26:19.754 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.752+0000 7fdeaa000640 1 -- 172.21.15.1:0/1978387388 wait complete. 2024-09-15T22:26:19.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.752+0000 7fdeaa000640 1 Processor -- start 2024-09-15T22:26:19.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.753+0000 7fdeaa000640 1 -- start start 2024-09-15T22:26:19.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.753+0000 7fdeaa000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdea410c570 0x7fdea41a28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:19.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.753+0000 7fdeaa000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdea410d730 0x7fdea41a2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:19.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.753+0000 7fdeaa000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdea410e0f0 0x7fdea41a9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:19.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.753+0000 7fdeaa000640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdea4118220 con 0x7fdea410e0f0 2024-09-15T22:26:19.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.753+0000 7fdeaa000640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdea41180a0 con 0x7fdea410d730 2024-09-15T22:26:19.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.753+0000 7fdeaa000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdea41183a0 con 0x7fdea410c570 2024-09-15T22:26:19.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.753+0000 7fdea3400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdea410c570 0x7fdea41a28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:19.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.753+0000 7fdea3400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdea410c570 0x7fdea41a28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:53644/0 (socket says 172.21.15.1:53644) 2024-09-15T22:26:19.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.753+0000 7fdea3400640 1 -- 172.21.15.1:0/863826119 learned_addr learned my addr 172.21.15.1:0/863826119 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:26:19.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.753+0000 7fde9be00640 1 --2- 172.21.15.1:0/863826119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdea410d730 0x7fdea41a2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:19.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.753+0000 7fdea3e00640 1 --2- 172.21.15.1:0/863826119 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdea410e0f0 0x7fdea41a9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:19.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.754+0000 7fdea3400640 1 -- 172.21.15.1:0/863826119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdea410d730 msgr2=0x7fdea41a2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:19.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.754+0000 7fdea3400640 1 --2- 172.21.15.1:0/863826119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdea410d730 0x7fdea41a2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:19.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.754+0000 7fdea3400640 1 -- 172.21.15.1:0/863826119 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdea410e0f0 msgr2=0x7fdea41a9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:19.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.754+0000 7fdea3400640 1 --2- 172.21.15.1:0/863826119 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdea410e0f0 0x7fdea41a9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:19.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.754+0000 7fdea3400640 1 -- 172.21.15.1:0/863826119 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdea41aa4d0 con 0x7fdea410c570 2024-09-15T22:26:19.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.754+0000 7fdea3400640 1 --2- 172.21.15.1:0/863826119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdea410c570 0x7fdea41a28b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fde9400e9c0 tx=0x7fde9400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:19.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.754+0000 7fdea0c00640 1 -- 172.21.15.1:0/863826119 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9400cd80 con 0x7fdea410c570 2024-09-15T22:26:19.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.754+0000 7fdea0c00640 1 -- 172.21.15.1:0/863826119 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde940035f0 con 0x7fdea410c570 2024-09-15T22:26:19.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.754+0000 7fdeaa000640 1 -- 172.21.15.1:0/863826119 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdea41aa7c0 con 0x7fdea410c570 2024-09-15T22:26:19.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.754+0000 7fdea0c00640 1 -- 172.21.15.1:0/863826119 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde94010690 con 0x7fdea410c570 2024-09-15T22:26:19.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.754+0000 7fdeaa000640 1 -- 172.21.15.1:0/863826119 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdea41aac90 con 0x7fdea410c570 2024-09-15T22:26:19.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.757+0000 7fdeace57740 1 Processor -- start 2024-09-15T22:26:19.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.757+0000 7fdeace57740 1 -- start start 2024-09-15T22:26:19.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.757+0000 7fdea0c00640 1 -- 172.21.15.1:0/863826119 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fde940037a0 con 0x7fdea410c570 2024-09-15T22:26:19.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.757+0000 7fdeace57740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556deab9f090 0x556deab9f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:19.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.758+0000 7fdeace57740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556deab9f9d0 0x556deaba4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:19.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.758+0000 7fdeace57740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556deaba4a60 0x556deaba6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:19.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.758+0000 7fdeace57740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556deab04100 con 0x556deab9f9d0 2024-09-15T22:26:19.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.758+0000 7fdeace57740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556deaaac1b0 con 0x556deab9f090 2024-09-15T22:26:19.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.758+0000 7fdeace57740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556deab000c0 con 0x556deaba4a60 2024-09-15T22:26:19.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.758+0000 7fdea3400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556deab9f9d0 0x556deaba4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:19.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.758+0000 7fde9be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556deaba4a60 0x556deaba6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:19.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.758+0000 7fdea3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556deab9f090 0x556deab9f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:19.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.758+0000 7fde9be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556deaba4a60 0x556deaba6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:53652/0 (socket says 172.21.15.1:53652) 2024-09-15T22:26:19.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.758+0000 7fdea3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556deab9f090 0x556deab9f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:33460/0 (socket says 172.21.15.1:33460) 2024-09-15T22:26:19.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.758+0000 7fde9be00640 1 -- 172.21.15.1:0/1381551674 learned_addr learned my addr 172.21.15.1:0/1381551674 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:26:19.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.758+0000 7fde9be00640 1 -- 172.21.15.1:0/1381551674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556deab9f090 msgr2=0x556deab9f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:19.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.758+0000 7fde9be00640 1 --2- 172.21.15.1:0/1381551674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556deab9f090 0x556deab9f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:19.762 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.758+0000 7fde9be00640 1 -- 172.21.15.1:0/1381551674 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556deab9f9d0 msgr2=0x556deaba4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:19.762 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.758+0000 7fde9be00640 1 --2- 172.21.15.1:0/1381551674 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556deab9f9d0 0x556deaba4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:19.762 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.758+0000 7fde9be00640 1 -- 172.21.15.1:0/1381551674 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dea817210 con 0x556deaba4a60 2024-09-15T22:26:19.762 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.758+0000 7fdea3e00640 1 --2- 172.21.15.1:0/1381551674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556deab9f090 0x556deab9f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:26:19.762 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.759+0000 7fde9be00640 1 --2- 172.21.15.1:0/1381551674 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556deaba4a60 0x556deaba6f20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fde8c000c00 tx=0x7fde8c004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d6fcef159381837 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:19.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.759+0000 7fde93e00640 1 -- 172.21.15.1:0/1381551674 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8c035040 con 0x556deaba4a60 2024-09-15T22:26:19.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.759+0000 7fde93e00640 1 -- 172.21.15.1:0/1381551674 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde8c005520 con 0x556deaba4a60 2024-09-15T22:26:19.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.759+0000 7fde93e00640 1 -- 172.21.15.1:0/1381551674 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8c031910 con 0x556deaba4a60 2024-09-15T22:26:19.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.759+0000 7fdea0c00640 1 --2- 172.21.15.1:0/863826119 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fde880a3240 0x7fde880a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:19.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.759+0000 7fdea3e00640 1 --2- 172.21.15.1:0/863826119 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fde880a3240 0x7fde880a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:19.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.760+0000 7fdea0c00640 1 -- 172.21.15.1:0/863826119 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7fde940cfdd0 con 0x7fdea410c570 2024-09-15T22:26:19.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.760+0000 7fdeace57740 1 -- 172.21.15.1:0/1381551674 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556deaba4a60 msgr2=0x556deaba6f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:19.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.760+0000 7fdeace57740 1 --2- 172.21.15.1:0/1381551674 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556deaba4a60 0x556deaba6f20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fde8c000c00 tx=0x7fde8c004040 comp rx=0 tx=0).stop 2024-09-15T22:26:19.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.760+0000 7fdeace57740 1 -- 172.21.15.1:0/1381551674 shutdown_connections 2024-09-15T22:26:19.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.760+0000 7fdeace57740 1 --2- 172.21.15.1:0/1381551674 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556deaba4a60 0x556deaba6f20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:19.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.760+0000 7fdeace57740 1 --2- 172.21.15.1:0/1381551674 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556deab9f9d0 0x556deaba4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:19.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.760+0000 7fdeace57740 1 --2- 172.21.15.1:0/1381551674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556deab9f090 0x556deab9f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:19.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.760+0000 7fdeace57740 1 -- 172.21.15.1:0/1381551674 >> 172.21.15.1:0/1381551674 conn(0x556deab9a700 msgr2=0x556deab9ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:19.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.760+0000 7fdeace57740 1 -- 172.21.15.1:0/1381551674 shutdown_connections 2024-09-15T22:26:19.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.760+0000 7fdeace57740 1 -- 172.21.15.1:0/1381551674 wait complete. 2024-09-15T22:26:19.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.760+0000 7fdea3e00640 1 --2- 172.21.15.1:0/863826119 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fde880a3240 0x7fde880a5700 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fde9c005fd0 tx=0x7fde9c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:19.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.761+0000 7fdeace57740 1 -- start start 2024-09-15T22:26:19.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.761+0000 7fdeace57740 1 Processor -- start 2024-09-15T22:26:19.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.761+0000 7fdeace57740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556deab9f090 0x556deaba9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:19.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.761+0000 7fdeace57740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556deab9f9d0 0x556deaba9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:19.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.761+0000 7fdeace57740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556deaba4a60 0x556deabb0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:19.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.761+0000 7fdeace57740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556deaba79d0 con 0x556deab9f090 2024-09-15T22:26:19.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.761+0000 7fdeace57740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556deaa8d090 con 0x556deab9f9d0 2024-09-15T22:26:19.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.761+0000 7fdeace57740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556deaba7b50 con 0x556deaba4a60 2024-09-15T22:26:19.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.761+0000 7fdeace57740 10 client.0 _ll_register_callbacks cb 0x556deaae1f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:26:19.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.761+0000 7fdea3400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556deab9f090 0x556deaba9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:19.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.761+0000 7fdea3e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556deaba4a60 0x556deabb0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:19.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.762+0000 7fdea3e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556deaba4a60 0x556deabb0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:53664/0 (socket says 172.21.15.1:53664) 2024-09-15T22:26:19.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.762+0000 7fdea3e00640 1 -- 172.21.15.1:0/2637594354 learned_addr learned my addr 172.21.15.1:0/2637594354 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:26:19.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.762+0000 7fde9be00640 1 --2- 172.21.15.1:0/2637594354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556deab9f9d0 0x556deaba9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:19.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.762+0000 7fdea3e00640 1 -- 172.21.15.1:0/2637594354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556deab9f9d0 msgr2=0x556deaba9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:19.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.762+0000 7fdea3e00640 1 --2- 172.21.15.1:0/2637594354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556deab9f9d0 0x556deaba9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:19.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.762+0000 7fdea3e00640 1 -- 172.21.15.1:0/2637594354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556deab9f090 msgr2=0x556deaba9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:19.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.762+0000 7fdea3e00640 1 --2- 172.21.15.1:0/2637594354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556deab9f090 0x556deaba9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:19.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.762+0000 7fdea3e00640 1 -- 172.21.15.1:0/2637594354 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556dea8e3620 con 0x556deaba4a60 2024-09-15T22:26:19.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.762+0000 7fdea3400640 1 --2- 172.21.15.1:0/2637594354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556deab9f090 0x556deaba9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:26:19.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.762+0000 7fdea3e00640 1 --2- 172.21.15.1:0/2637594354 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556deaba4a60 0x556deabb0790 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fde9c010bf0 tx=0x7fde9c004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fe9ca409c15853e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:19.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.762+0000 7fde90c00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-15T22:26:19.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.762+0000 7fde90c00640 1 -- 172.21.15.1:0/2637594354 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9c02c060 con 0x556deaba4a60 2024-09-15T22:26:19.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.763+0000 7fde90c00640 1 -- 172.21.15.1:0/2637594354 <== mon.1 v2:172.21.15.98:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7fde9c017030 con 0x556deaba4a60 2024-09-15T22:26:19.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.763+0000 7fdeace57740 1 -- 172.21.15.1:0/2637594354 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde8c005520 con 0x556deaba4a60 2024-09-15T22:26:19.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.763+0000 7fde90c00640 1 -- 172.21.15.1:0/2637594354 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fde9c01fc00 con 0x556deaba4a60 2024-09-15T22:26:19.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.763+0000 7fdeace57740 10 client.25174 fetch_fsmap learned FSMap version 26 2024-09-15T22:26:19.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.763+0000 7fdeace57740 1 -- 172.21.15.1:0/2637594354 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556deabb3650 con 0x556deaba4a60 2024-09-15T22:26:19.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.763+0000 7fde90c00640 1 -- 172.21.15.1:0/2637594354 <== mon.1 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde8c005520 con 0x556deaba4a60 2024-09-15T22:26:19.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.763+0000 7fde90c00640 1 -- 172.21.15.1:0/2637594354 <== mon.1 v2:172.21.15.98:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fde9c030030 con 0x556deaba4a60 2024-09-15T22:26:19.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.763+0000 7fdeace57740 10 client.25174 fetch_fsmap finished waiting for FSMap version 26 2024-09-15T22:26:19.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.763+0000 7fdeace57740 10 client.25174 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T22:26:19.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.763+0000 7fdeace57740 20 client.25174 populate_metadata read hostname 'smithi001' 2024-09-15T22:26:19.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.763+0000 7fdeace57740 1 --2- 172.21.15.1:0/2637594354 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x556deabb4d20 0x556deabb7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:19.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.763+0000 7fdeace57740 4 client.25174 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:26:19.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.763+0000 7fdeace57740 1 -- 172.21.15.1:0/2637594354 --> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556deab11830 con 0x556deabb4d20 2024-09-15T22:26:19.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.764+0000 7fdea3400640 1 --2- 172.21.15.1:0/2637594354 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x556deabb4d20 0x556deabb7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:19.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.764+0000 7fdea3400640 1 --2- 172.21.15.1:0/2637594354 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x556deabb4d20 0x556deabb7130 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52c7ddefb459113d server_cookie=f48ccd8dbde6e208 in_seq=0 out_seq=0 2024-09-15T22:26:19.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.764+0000 7fde90c00640 10 client.25174 ms_handle_connect on v2:172.21.15.98:6838/2831161859 2024-09-15T22:26:19.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.767+0000 7fde90c00640 1 -- 172.21.15.1:0/2637594354 <== mds.0 v2:172.21.15.98:6838/2831161859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556deab11830 con 0x556deabb4d20 2024-09-15T22:26:19.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.767+0000 7fde90c00640 10 client.25174 handle_command_reply: tid=0 2024-09-15T22:26:19.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.767+0000 7fdeace57740 1 client.25174 shutdown 2024-09-15T22:26:19.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.767+0000 7fdeace57740 1 -- 172.21.15.1:0/2637594354 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556deaba4a60 msgr2=0x556deabb0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:19.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.767+0000 7fdeace57740 1 --2- 172.21.15.1:0/2637594354 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556deaba4a60 0x556deabb0790 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fde9c010bf0 tx=0x7fde9c004ab0 comp rx=0 tx=0).stop 2024-09-15T22:26:19.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.767+0000 7fdeace57740 1 -- 172.21.15.1:0/2637594354 shutdown_connections 2024-09-15T22:26:19.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.767+0000 7fdeace57740 1 --2- 172.21.15.1:0/2637594354 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556deaba4a60 0x556deabb0790 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:19.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.767+0000 7fdeace57740 1 --2- 172.21.15.1:0/2637594354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556deab9f9d0 0x556deaba9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:19.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.767+0000 7fdeace57740 1 --2- 172.21.15.1:0/2637594354 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x556deabb4d20 0x556deabb7130 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:19.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.767+0000 7fdeace57740 1 --2- 172.21.15.1:0/2637594354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556deab9f090 0x556deaba9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:19.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.767+0000 7fdeace57740 1 -- 172.21.15.1:0/2637594354 >> 172.21.15.1:0/2637594354 conn(0x556deab9a700 msgr2=0x556deab9bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:19.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.767+0000 7fde90c00640 0 client.25174 ms_handle_reset on v2:172.21.15.98:6838/2831161859 2024-09-15T22:26:19.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.767+0000 7fdeace57740 1 -- 172.21.15.1:0/2637594354 shutdown_connections 2024-09-15T22:26:19.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.767+0000 7fdeace57740 1 -- 172.21.15.1:0/2637594354 wait complete. 2024-09-15T22:26:19.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.768+0000 7fdeace57740 20 client.25174 trim_cache size 0 max 16384 2024-09-15T22:26:19.785 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.782+0000 7fdeace57740 1 Processor -- start 2024-09-15T22:26:19.785 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.782+0000 7fdeace57740 1 -- start start 2024-09-15T22:26:19.785 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.783+0000 7fdeace57740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556deab9f090 0x556deab99770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:19.785 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.783+0000 7fdeace57740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556deab9f9d0 0x556deabb06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:19.785 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.783+0000 7fdeace57740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556deaba4a60 0x556deabbba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:19.785 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.783+0000 7fdeace57740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdea41b64c0 con 0x556deaba4a60 2024-09-15T22:26:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.783+0000 7fdeace57740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdea41b3d90 con 0x556deab9f9d0 2024-09-15T22:26:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.783+0000 7fdeace57740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdea41b1be0 con 0x556deab9f090 2024-09-15T22:26:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.783+0000 7fdea3e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556deaba4a60 0x556deabbba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.783+0000 7fdea3400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556deab9f090 0x556deab99770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.783+0000 7fdea3e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556deaba4a60 0x556deabbba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44158/0 (socket says 172.21.15.1:44158) 2024-09-15T22:26:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.783+0000 7fdea3e00640 1 -- 172.21.15.1:0/2352559783 learned_addr learned my addr 172.21.15.1:0/2352559783 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:26:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.783+0000 7fde9be00640 1 --2- 172.21.15.1:0/2352559783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556deab9f9d0 0x556deabb06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.783+0000 7fdea3e00640 1 -- 172.21.15.1:0/2352559783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556deab9f090 msgr2=0x556deab99770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.783+0000 7fdea3e00640 1 --2- 172.21.15.1:0/2352559783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556deab9f090 0x556deab99770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.783+0000 7fdea3e00640 1 -- 172.21.15.1:0/2352559783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556deab9f9d0 msgr2=0x556deabb06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.783+0000 7fdea3e00640 1 --2- 172.21.15.1:0/2352559783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556deab9f9d0 0x556deabb06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.783+0000 7fdea3e00640 1 -- 172.21.15.1:0/2352559783 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556deab95d60 con 0x556deaba4a60 2024-09-15T22:26:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.784+0000 7fdea3e00640 1 --2- 172.21.15.1:0/2352559783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556deaba4a60 0x556deabbba30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fde9c018040 tx=0x7fde9c000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d44a84987f67c7d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:19.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.784+0000 7fde93400640 1 -- 172.21.15.1:0/2352559783 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9c01c910 con 0x556deaba4a60 2024-09-15T22:26:19.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.784+0000 7fde93400640 1 -- 172.21.15.1:0/2352559783 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde9c0273f0 con 0x556deaba4a60 2024-09-15T22:26:19.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.784+0000 7fde93400640 1 -- 172.21.15.1:0/2352559783 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9c03a650 con 0x556deaba4a60 2024-09-15T22:26:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.784+0000 7fdeace57740 1 -- 172.21.15.1:0/2352559783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556deaba4a60 msgr2=0x556deabbba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.784+0000 7fdeace57740 1 --2- 172.21.15.1:0/2352559783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556deaba4a60 0x556deabbba30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fde9c018040 tx=0x7fde9c000f40 comp rx=0 tx=0).stop 2024-09-15T22:26:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.785+0000 7fdeace57740 1 -- 172.21.15.1:0/2352559783 shutdown_connections 2024-09-15T22:26:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.785+0000 7fdeace57740 1 --2- 172.21.15.1:0/2352559783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556deaba4a60 0x556deabbba30 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.785+0000 7fdeace57740 1 --2- 172.21.15.1:0/2352559783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556deab9f9d0 0x556deabb06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.785+0000 7fdeace57740 1 --2- 172.21.15.1:0/2352559783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556deab9f090 0x556deab99770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.785+0000 7fdeace57740 1 -- 172.21.15.1:0/2352559783 >> 172.21.15.1:0/2352559783 conn(0x556deab9a700 msgr2=0x556deab99060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.785+0000 7fdeace57740 1 -- 172.21.15.1:0/2352559783 shutdown_connections 2024-09-15T22:26:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.785+0000 7fdeace57740 1 -- 172.21.15.1:0/2352559783 wait complete. 2024-09-15T22:26:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.785+0000 7fdeace57740 1 -- start start 2024-09-15T22:26:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.785+0000 7fdeace57740 1 Processor -- start 2024-09-15T22:26:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.786+0000 7fdeace57740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556deab9f090 0x556deabae150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.786+0000 7fdeace57740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556deab9f9d0 0x556deabae690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.786+0000 7fdeace57740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556deaba4a60 0x556deabaf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.786+0000 7fdeace57740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdea41b2250 con 0x556deab9f090 2024-09-15T22:26:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.786+0000 7fdeace57740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdea41b36c0 con 0x556deab9f9d0 2024-09-15T22:26:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.786+0000 7fdeace57740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdea41b2920 con 0x556deaba4a60 2024-09-15T22:26:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.786+0000 7fdeace57740 10 client.0 _ll_register_callbacks cb 0x7fde9c009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:26:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.786+0000 7fdea3400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556deab9f090 0x556deabae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.786+0000 7fdea3e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556deaba4a60 0x556deabaf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.786+0000 7fdea3400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556deab9f090 0x556deabae150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44174/0 (socket says 172.21.15.1:44174) 2024-09-15T22:26:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.786+0000 7fdea3400640 1 -- 172.21.15.1:0/3328549172 learned_addr learned my addr 172.21.15.1:0/3328549172 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:26:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.786+0000 7fdea3e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556deaba4a60 0x556deabaf6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:53670/0 (socket says 172.21.15.1:53670) 2024-09-15T22:26:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.786+0000 7fde9be00640 1 --2- 172.21.15.1:0/3328549172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556deab9f9d0 0x556deabae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:19.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.786+0000 7fdea3400640 1 -- 172.21.15.1:0/3328549172 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556deaba4a60 msgr2=0x556deabaf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:19.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.786+0000 7fdea3400640 1 --2- 172.21.15.1:0/3328549172 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556deaba4a60 0x556deabaf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:19.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.786+0000 7fdea3400640 1 -- 172.21.15.1:0/3328549172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556deab9f9d0 msgr2=0x556deabae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:19.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.786+0000 7fdea3400640 1 --2- 172.21.15.1:0/3328549172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556deab9f9d0 0x556deabae690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:19.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.786+0000 7fdea3400640 1 -- 172.21.15.1:0/3328549172 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556deabafcb0 con 0x556deab9f090 2024-09-15T22:26:19.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.786+0000 7fdea3e00640 1 --2- 172.21.15.1:0/3328549172 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556deaba4a60 0x556deabaf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:26:19.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.787+0000 7fdea3400640 1 --2- 172.21.15.1:0/3328549172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556deab9f090 0x556deabae150 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fde940cd810 tx=0x7fde940d3810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=376d901316661aa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:19.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.787+0000 7fde90c00640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-15T22:26:19.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.787+0000 7fde90c00640 1 -- 172.21.15.1:0/3328549172 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9409bc90 con 0x556deab9f090 2024-09-15T22:26:19.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.787+0000 7fde90c00640 1 -- 172.21.15.1:0/3328549172 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7fde94003b10 con 0x556deab9f090 2024-09-15T22:26:19.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.787+0000 7fdeace57740 1 -- 172.21.15.1:0/3328549172 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde9c0273f0 con 0x556deab9f090 2024-09-15T22:26:19.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.787+0000 7fde90c00640 1 -- 172.21.15.1:0/3328549172 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fde9409ca30 con 0x556deab9f090 2024-09-15T22:26:19.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.787+0000 7fdeace57740 10 client.15159 fetch_fsmap learned FSMap version 26 2024-09-15T22:26:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.787+0000 7fdeace57740 1 -- 172.21.15.1:0/3328549172 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556deac1fe10 con 0x556deab9f090 2024-09-15T22:26:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.787+0000 7fde90c00640 1 -- 172.21.15.1:0/3328549172 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde9c0273f0 con 0x556deab9f090 2024-09-15T22:26:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.787+0000 7fde90c00640 1 -- 172.21.15.1:0/3328549172 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fde940a4b10 con 0x556deab9f090 2024-09-15T22:26:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.788+0000 7fdeace57740 10 client.15159 fetch_fsmap finished waiting for FSMap version 26 2024-09-15T22:26:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.788+0000 7fdeace57740 10 client.15159 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T22:26:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.788+0000 7fdeace57740 20 client.15159 populate_metadata read hostname 'smithi001' 2024-09-15T22:26:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.788+0000 7fdeace57740 1 --2- 172.21.15.1:0/3328549172 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x556deac20790 0x556deac22bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.788+0000 7fdeace57740 4 client.15159 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:26:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.788+0000 7fdeace57740 1 -- 172.21.15.1:0/3328549172 --> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556deab0bb80 con 0x556deac20790 2024-09-15T22:26:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.788+0000 7fde9be00640 1 --2- 172.21.15.1:0/3328549172 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x556deac20790 0x556deac22bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.788+0000 7fde9be00640 1 --2- 172.21.15.1:0/3328549172 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x556deac20790 0x556deac22bb0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc9e4869c4d29f6e server_cookie=62b261be4f962867 in_seq=0 out_seq=0 2024-09-15T22:26:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:19.788+0000 7fde90c00640 10 client.15159 ms_handle_connect on v2:172.21.15.98:6838/2831161859 2024-09-15T22:26:21.125 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:20 smithi001 ceph-mon[30843]: pgmap v400: 97 pgs: 97 active+clean; 26 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 2.2 MiB/s wr, 140 op/s 2024-09-15T22:26:21.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:20 smithi012 ceph-mon[34883]: pgmap v400: 97 pgs: 97 active+clean; 26 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 2.2 MiB/s wr, 140 op/s 2024-09-15T22:26:21.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:20 smithi098 ceph-mon[35514]: pgmap v400: 97 pgs: 97 active+clean; 26 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 2.2 MiB/s wr, 140 op/s 2024-09-15T22:26:22.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:22.794+0000 7fde90c00640 1 -- 172.21.15.1:0/3328549172 <== mds.0 v2:172.21.15.98:6838/2831161859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556deab0bb80 con 0x556deac20790 2024-09-15T22:26:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:22.794+0000 7fde90c00640 10 client.15159 handle_command_reply: tid=0 2024-09-15T22:26:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:22.794+0000 7fdeace57740 1 client.15159 shutdown 2024-09-15T22:26:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:22.794+0000 7fdeace57740 1 -- 172.21.15.1:0/3328549172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556deab9f090 msgr2=0x556deabae150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:22.794+0000 7fdeace57740 1 --2- 172.21.15.1:0/3328549172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556deab9f090 0x556deabae150 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fde940cd810 tx=0x7fde940d3810 comp rx=0 tx=0).stop 2024-09-15T22:26:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:22.794+0000 7fdeace57740 1 -- 172.21.15.1:0/3328549172 shutdown_connections 2024-09-15T22:26:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:22.794+0000 7fdeace57740 1 --2- 172.21.15.1:0/3328549172 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556deaba4a60 0x556deabaf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:22.794+0000 7fdeace57740 1 --2- 172.21.15.1:0/3328549172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556deab9f9d0 0x556deabae690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:22.794+0000 7fdeace57740 1 --2- 172.21.15.1:0/3328549172 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x556deac20790 0x556deac22bb0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:22.794+0000 7fdeace57740 1 --2- 172.21.15.1:0/3328549172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556deab9f090 0x556deabae150 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:22.794+0000 7fdeace57740 1 -- 172.21.15.1:0/3328549172 >> 172.21.15.1:0/3328549172 conn(0x556deab9a700 msgr2=0x556deab99880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:22.794+0000 7fde90c00640 0 client.15159 ms_handle_reset on v2:172.21.15.98:6838/2831161859 2024-09-15T22:26:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:22.794+0000 7fdeace57740 1 -- 172.21.15.1:0/3328549172 shutdown_connections 2024-09-15T22:26:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:22.794+0000 7fdeace57740 1 -- 172.21.15.1:0/3328549172 wait complete. 2024-09-15T22:26:22.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:22.795+0000 7fdeace57740 20 client.15159 trim_cache size 0 max 16384 2024-09-15T22:26:22.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-15T22:26:22.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-15T22:26:22.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-15T22:26:22.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-15T22:26:22.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:22.795+0000 7fdeaa000640 1 -- 172.21.15.1:0/863826119 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fde880a3240 msgr2=0x7fde880a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:22.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:22.795+0000 7fdeaa000640 1 --2- 172.21.15.1:0/863826119 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fde880a3240 0x7fde880a5700 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fde9c005fd0 tx=0x7fde9c009500 comp rx=0 tx=0).stop 2024-09-15T22:26:22.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:22.795+0000 7fdeaa000640 1 -- 172.21.15.1:0/863826119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdea410c570 msgr2=0x7fdea41a28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:22.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:22.795+0000 7fdeaa000640 1 --2- 172.21.15.1:0/863826119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdea410c570 0x7fdea41a28b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fde9400e9c0 tx=0x7fde9400ee80 comp rx=0 tx=0).stop 2024-09-15T22:26:22.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:22.795+0000 7fdeaa000640 1 -- 172.21.15.1:0/863826119 shutdown_connections 2024-09-15T22:26:22.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:22.795+0000 7fdeaa000640 1 --2- 172.21.15.1:0/863826119 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fde880a3240 0x7fde880a5700 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:22.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:22.795+0000 7fdeaa000640 1 --2- 172.21.15.1:0/863826119 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdea410e0f0 0x7fdea41a9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:22.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:22.795+0000 7fdeaa000640 1 --2- 172.21.15.1:0/863826119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdea410d730 0x7fdea41a2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:22.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:22.795+0000 7fdeaa000640 1 --2- 172.21.15.1:0/863826119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdea410c570 0x7fdea41a28b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:22.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:22.795+0000 7fdeaa000640 1 -- 172.21.15.1:0/863826119 >> 172.21.15.1:0/863826119 conn(0x7fdea406c2b0 msgr2=0x7fdea4110b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:22.800 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:22.796+0000 7fdeaa000640 1 -- 172.21.15.1:0/863826119 shutdown_connections 2024-09-15T22:26:22.800 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:22.796+0000 7fdeaa000640 1 -- 172.21.15.1:0/863826119 wait complete. 2024-09-15T22:26:23.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:22 smithi001 ceph-mon[30843]: pgmap v401: 97 pgs: 97 active+clean; 33 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1018 KiB/s rd, 2.9 MiB/s wr, 228 op/s 2024-09-15T22:26:23.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:22 smithi012 ceph-mon[34883]: pgmap v401: 97 pgs: 97 active+clean; 33 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1018 KiB/s rd, 2.9 MiB/s wr, 228 op/s 2024-09-15T22:26:23.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:22 smithi098 ceph-mon[35514]: pgmap v401: 97 pgs: 97 active+clean; 33 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1018 KiB/s rd, 2.9 MiB/s wr, 228 op/s 2024-09-15T22:26:25.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:24 smithi001 ceph-mon[30843]: pgmap v402: 97 pgs: 97 active+clean; 33 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1018 KiB/s rd, 2.9 MiB/s wr, 226 op/s 2024-09-15T22:26:25.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:24 smithi012 ceph-mon[34883]: pgmap v402: 97 pgs: 97 active+clean; 33 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1018 KiB/s rd, 2.9 MiB/s wr, 226 op/s 2024-09-15T22:26:25.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:24 smithi098 ceph-mon[35514]: pgmap v402: 97 pgs: 97 active+clean; 33 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1018 KiB/s rd, 2.9 MiB/s wr, 226 op/s 2024-09-15T22:26:27.125 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:26 smithi001 ceph-mon[30843]: pgmap v403: 97 pgs: 97 active+clean; 24 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.8 MiB/s wr, 1.29k op/s 2024-09-15T22:26:27.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:26 smithi012 ceph-mon[34883]: pgmap v403: 97 pgs: 97 active+clean; 24 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.8 MiB/s wr, 1.29k op/s 2024-09-15T22:26:27.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:26 smithi098 ceph-mon[35514]: pgmap v403: 97 pgs: 97 active+clean; 24 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.8 MiB/s wr, 1.29k op/s 2024-09-15T22:26:29.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:28 smithi001 ceph-mon[30843]: pgmap v404: 97 pgs: 97 active+clean; 24 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.4 MiB/s wr, 1.37k op/s 2024-09-15T22:26:29.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:28 smithi012 ceph-mon[34883]: pgmap v404: 97 pgs: 97 active+clean; 24 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.4 MiB/s wr, 1.37k op/s 2024-09-15T22:26:29.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:28 smithi098 ceph-mon[35514]: pgmap v404: 97 pgs: 97 active+clean; 24 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.4 MiB/s wr, 1.37k op/s 2024-09-15T22:26:30.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:29 smithi001 ceph-mon[30843]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-15T22:26:30.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:29 smithi012 ceph-mon[34883]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-15T22:26:30.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:29 smithi098 ceph-mon[35514]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-15T22:26:31.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:30 smithi001 ceph-mon[30843]: pgmap v405: 97 pgs: 97 active+clean; 28 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 1.37k op/s 2024-09-15T22:26:31.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:30 smithi012 ceph-mon[34883]: pgmap v405: 97 pgs: 97 active+clean; 28 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 1.37k op/s 2024-09-15T22:26:31.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:30 smithi098 ceph-mon[35514]: pgmap v405: 97 pgs: 97 active+clean; 28 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 1.37k op/s 2024-09-15T22:26:31.775 INFO:tasks.workunit.client.0.smithi001.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-15T22:26:31.775 INFO:tasks.workunit.client.0.smithi001.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-15T22:26:31.775 INFO:tasks.workunit.client.0.smithi001.stderr:+ make 2024-09-15T22:26:31.937 INFO:tasks.workunit.client.0.smithi001.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-15T22:26:32.257 INFO:tasks.workunit.client.0.smithi001.stderr:++ readlink -f fsstress 2024-09-15T22:26:32.259 INFO:tasks.workunit.client.0.smithi001.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-15T22:26:32.259 INFO:tasks.workunit.client.0.smithi001.stderr:+ popd 2024-09-15T22:26:32.259 INFO:tasks.workunit.client.0.smithi001.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-15T22:26:32.259 INFO:tasks.workunit.client.0.smithi001.stderr:+ popd 2024-09-15T22:26:32.260 INFO:tasks.workunit.client.0.smithi001.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-15T22:26:32.260 INFO:tasks.workunit.client.0.smithi001.stderr:++ mktemp -d -p . 2024-09-15T22:26:32.262 INFO:tasks.workunit.client.0.smithi001.stderr:+ T=./tmp.oyij8MkDJS 2024-09-15T22:26:32.262 INFO:tasks.workunit.client.0.smithi001.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.oyij8MkDJS -l 1 -n 1000 -p 10 -v 2024-09-15T22:26:32.265 INFO:tasks.workunit.client.0.smithi001.stdout:seed = 1726174543 2024-09-15T22:26:32.268 INFO:tasks.workunit.client.0.smithi001.stdout:0/0: stat - no entries 2024-09-15T22:26:32.268 INFO:tasks.workunit.client.0.smithi001.stdout:0/1: dread - no filename 2024-09-15T22:26:32.268 INFO:tasks.workunit.client.0.smithi001.stdout:0/2: dwrite - no filename 2024-09-15T22:26:32.268 INFO:tasks.workunit.client.0.smithi001.stdout:0/3: dread - no filename 2024-09-15T22:26:32.268 INFO:tasks.workunit.client.0.smithi001.stdout:0/4: dread - no filename 2024-09-15T22:26:32.269 INFO:tasks.workunit.client.0.smithi001.stdout:0/5: write - no filename 2024-09-15T22:26:32.269 INFO:tasks.workunit.client.0.smithi001.stdout:0/6: truncate - no filename 2024-09-15T22:26:32.269 INFO:tasks.workunit.client.0.smithi001.stdout:0/7: link - no file 2024-09-15T22:26:32.269 INFO:tasks.workunit.client.0.smithi001.stdout:0/8: getdents . 0 2024-09-15T22:26:32.269 INFO:tasks.workunit.client.0.smithi001.stdout:0/9: write - no filename 2024-09-15T22:26:32.269 INFO:tasks.workunit.client.0.smithi001.stdout:1/0: dwrite - no filename 2024-09-15T22:26:32.270 INFO:tasks.workunit.client.0.smithi001.stdout:1/1: stat - no entries 2024-09-15T22:26:32.270 INFO:tasks.workunit.client.0.smithi001.stdout:1/2: readlink - no filename 2024-09-15T22:26:32.270 INFO:tasks.workunit.client.0.smithi001.stdout:1/3: link - no file 2024-09-15T22:26:32.270 INFO:tasks.workunit.client.0.smithi001.stdout:0/10: mkdir d0 0 2024-09-15T22:26:32.270 INFO:tasks.workunit.client.0.smithi001.stdout:0/11: dwrite - no filename 2024-09-15T22:26:32.270 INFO:tasks.workunit.client.0.smithi001.stdout:0/12: readlink - no filename 2024-09-15T22:26:32.270 INFO:tasks.workunit.client.0.smithi001.stdout:0/13: write - no filename 2024-09-15T22:26:32.270 INFO:tasks.workunit.client.0.smithi001.stdout:0/14: rename d0 to d0/d1 22 2024-09-15T22:26:32.271 INFO:tasks.workunit.client.0.smithi001.stdout:1/4: mknod c0 0 2024-09-15T22:26:32.271 INFO:tasks.workunit.client.0.smithi001.stdout:1/5: rmdir - no directory 2024-09-15T22:26:32.271 INFO:tasks.workunit.client.0.smithi001.stdout:1/6: truncate - no filename 2024-09-15T22:26:32.271 INFO:tasks.workunit.client.0.smithi001.stdout:1/7: stat c0 0 2024-09-15T22:26:32.271 INFO:tasks.workunit.client.0.smithi001.stdout:1/8: dread - no filename 2024-09-15T22:26:32.271 INFO:tasks.workunit.client.0.smithi001.stdout:1/9: dwrite - no filename 2024-09-15T22:26:32.271 INFO:tasks.workunit.client.0.smithi001.stdout:1/10: write - no filename 2024-09-15T22:26:32.272 INFO:tasks.workunit.client.0.smithi001.stdout:1/11: write - no filename 2024-09-15T22:26:32.272 INFO:tasks.workunit.client.0.smithi001.stdout:0/15: creat d0/f2 x:0 0 0 2024-09-15T22:26:32.272 INFO:tasks.workunit.client.0.smithi001.stdout:0/16: read - d0/f2 zero size 2024-09-15T22:26:32.272 INFO:tasks.workunit.client.0.smithi001.stdout:3/0: read - no filename 2024-09-15T22:26:32.272 INFO:tasks.workunit.client.0.smithi001.stdout:3/1: write - no filename 2024-09-15T22:26:32.272 INFO:tasks.workunit.client.0.smithi001.stdout:3/2: truncate - no filename 2024-09-15T22:26:32.272 INFO:tasks.workunit.client.0.smithi001.stdout:3/3: dwrite - no filename 2024-09-15T22:26:32.273 INFO:tasks.workunit.client.0.smithi001.stdout:2/0: creat f0 x:0 0 0 2024-09-15T22:26:32.273 INFO:tasks.workunit.client.0.smithi001.stdout:1/12: symlink l1 0 2024-09-15T22:26:32.273 INFO:tasks.workunit.client.0.smithi001.stdout:1/13: dread - no filename 2024-09-15T22:26:32.273 INFO:tasks.workunit.client.0.smithi001.stdout:1/14: chown c0 315563 1 2024-09-15T22:26:32.273 INFO:tasks.workunit.client.0.smithi001.stdout:0/17: creat d0/f3 x:0 0 0 2024-09-15T22:26:32.273 INFO:tasks.workunit.client.0.smithi001.stdout:3/4: mknod c0 0 2024-09-15T22:26:32.274 INFO:tasks.workunit.client.0.smithi001.stdout:3/5: chown c0 488699150 1 2024-09-15T22:26:32.275 INFO:tasks.workunit.client.0.smithi001.stdout:2/1: rename f0 to f1 0 2024-09-15T22:26:32.275 INFO:tasks.workunit.client.0.smithi001.stdout:1/15: symlink l2 0 2024-09-15T22:26:32.275 INFO:tasks.workunit.client.0.smithi001.stdout:1/16: readlink l2 0 2024-09-15T22:26:32.275 INFO:tasks.workunit.client.0.smithi001.stdout:1/17: write - no filename 2024-09-15T22:26:32.275 INFO:tasks.workunit.client.0.smithi001.stdout:1/18: dread - no filename 2024-09-15T22:26:32.277 INFO:tasks.workunit.client.0.smithi001.stdout:5/0: dread - no filename 2024-09-15T22:26:32.277 INFO:tasks.workunit.client.0.smithi001.stdout:5/1: chown . 9 1 2024-09-15T22:26:32.277 INFO:tasks.workunit.client.0.smithi001.stdout:5/2: rename - no filename 2024-09-15T22:26:32.277 INFO:tasks.workunit.client.0.smithi001.stdout:5/3: write - no filename 2024-09-15T22:26:32.277 INFO:tasks.workunit.client.0.smithi001.stdout:5/4: dread - no filename 2024-09-15T22:26:32.277 INFO:tasks.workunit.client.0.smithi001.stdout:5/5: write - no filename 2024-09-15T22:26:32.277 INFO:tasks.workunit.client.0.smithi001.stdout:5/6: rename - no filename 2024-09-15T22:26:32.277 INFO:tasks.workunit.client.0.smithi001.stdout:5/7: getdents . 0 2024-09-15T22:26:32.277 INFO:tasks.workunit.client.0.smithi001.stdout:5/8: getdents . 0 2024-09-15T22:26:32.277 INFO:tasks.workunit.client.0.smithi001.stdout:4/0: mkdir d0 0 2024-09-15T22:26:32.277 INFO:tasks.workunit.client.0.smithi001.stdout:4/1: readlink - no filename 2024-09-15T22:26:32.278 INFO:tasks.workunit.client.0.smithi001.stdout:4/2: chown d0 761 1 2024-09-15T22:26:32.278 INFO:tasks.workunit.client.0.smithi001.stdout:4/3: write - no filename 2024-09-15T22:26:32.278 INFO:tasks.workunit.client.0.smithi001.stdout:4/4: dread - no filename 2024-09-15T22:26:32.278 INFO:tasks.workunit.client.0.smithi001.stdout:4/5: chown d0 56973 1 2024-09-15T22:26:32.278 INFO:tasks.workunit.client.0.smithi001.stdout:4/6: write - no filename 2024-09-15T22:26:32.281 INFO:tasks.workunit.client.0.smithi001.stdout:3/6: symlink l1 0 2024-09-15T22:26:32.281 INFO:tasks.workunit.client.0.smithi001.stdout:3/7: readlink l1 0 2024-09-15T22:26:32.281 INFO:tasks.workunit.client.0.smithi001.stdout:3/8: dwrite - no filename 2024-09-15T22:26:32.282 INFO:tasks.workunit.client.0.smithi001.stdout:1/19: mkdir d3 0 2024-09-15T22:26:32.282 INFO:tasks.workunit.client.0.smithi001.stdout:1/20: fsync - no filename 2024-09-15T22:26:32.282 INFO:tasks.workunit.client.0.smithi001.stdout:4/7: mkdir d0/d1 0 2024-09-15T22:26:32.282 INFO:tasks.workunit.client.0.smithi001.stdout:4/8: fdatasync - no filename 2024-09-15T22:26:32.283 INFO:tasks.workunit.client.0.smithi001.stdout:6/0: truncate - no filename 2024-09-15T22:26:32.283 INFO:tasks.workunit.client.0.smithi001.stdout:6/1: write - no filename 2024-09-15T22:26:32.283 INFO:tasks.workunit.client.0.smithi001.stdout:6/2: dread - no filename 2024-09-15T22:26:32.284 INFO:tasks.workunit.client.0.smithi001.stdout:3/9: creat f2 x:0 0 0 2024-09-15T22:26:32.285 INFO:tasks.workunit.client.0.smithi001.stdout:1/21: creat d3/f4 x:0 0 0 2024-09-15T22:26:32.286 INFO:tasks.workunit.client.0.smithi001.stdout:1/22: dread - d3/f4 zero size 2024-09-15T22:26:32.287 INFO:tasks.workunit.client.0.smithi001.stdout:4/9: rename d0/d1 to d0/d2 0 2024-09-15T22:26:32.322 INFO:tasks.workunit.client.0.smithi001.stdout:3/10: mknod c3 0 2024-09-15T22:26:32.322 INFO:tasks.workunit.client.0.smithi001.stdout:7/0: rmdir - no directory 2024-09-15T22:26:32.324 INFO:tasks.workunit.client.0.smithi001.stdout:2/2: getdents . 0 2024-09-15T22:26:32.324 INFO:tasks.workunit.client.0.smithi001.stdout:2/3: dread - f1 zero size 2024-09-15T22:26:32.325 INFO:tasks.workunit.client.0.smithi001.stdout:2/4: fdatasync f1 0 2024-09-15T22:26:32.325 INFO:tasks.workunit.client.0.smithi001.stdout:6/3: mkdir d0 0 2024-09-15T22:26:32.325 INFO:tasks.workunit.client.0.smithi001.stdout:6/4: write - no filename 2024-09-15T22:26:32.325 INFO:tasks.workunit.client.0.smithi001.stdout:1/23: creat d3/f5 x:0 0 0 2024-09-15T22:26:32.325 INFO:tasks.workunit.client.0.smithi001.stdout:1/24: rename d3 to d3/d6 22 2024-09-15T22:26:32.326 INFO:tasks.workunit.client.0.smithi001.stdout:0/18: getdents d0 0 2024-09-15T22:26:32.326 INFO:tasks.workunit.client.0.smithi001.stdout:0/19: write d0/f3 [318485,24383] 0 2024-09-15T22:26:32.359 INFO:tasks.workunit.client.0.smithi001.stdout:3/11: unlink l1 0 2024-09-15T22:26:32.360 INFO:tasks.workunit.client.0.smithi001.stdout:3/12: truncate f2 643027 0 2024-09-15T22:26:32.360 INFO:tasks.workunit.client.0.smithi001.stdout:4/10: rmdir d0/d2 0 2024-09-15T22:26:32.365 INFO:tasks.workunit.client.0.smithi001.stdout:7/1: mkdir d0 0 2024-09-15T22:26:32.365 INFO:tasks.workunit.client.0.smithi001.stdout:7/2: fdatasync - no filename 2024-09-15T22:26:32.379 INFO:tasks.workunit.client.0.smithi001.stdout:6/5: mknod d0/c1 0 2024-09-15T22:26:32.386 INFO:tasks.workunit.client.0.smithi001.stdout:2/5: mkdir d2 0 2024-09-15T22:26:32.386 INFO:tasks.workunit.client.0.smithi001.stdout:2/6: dread - f1 zero size 2024-09-15T22:26:32.386 INFO:tasks.workunit.client.0.smithi001.stdout:2/7: fsync f1 0 2024-09-15T22:26:32.386 INFO:tasks.workunit.client.0.smithi001.stdout:2/8: getdents d2 0 2024-09-15T22:26:32.411 INFO:tasks.workunit.client.0.smithi001.stdout:3/13: write f2 [611871,66423] 0 2024-09-15T22:26:32.519 INFO:tasks.workunit.client.0.smithi001.stdout:4/11: symlink d0/l3 0 2024-09-15T22:26:32.519 INFO:tasks.workunit.client.0.smithi001.stdout:4/12: write - no filename 2024-09-15T22:26:32.519 INFO:tasks.workunit.client.0.smithi001.stdout:4/13: fdatasync - no filename 2024-09-15T22:26:32.519 INFO:tasks.workunit.client.0.smithi001.stdout:4/14: dwrite - no filename 2024-09-15T22:26:32.519 INFO:tasks.workunit.client.0.smithi001.stdout:4/15: truncate - no filename 2024-09-15T22:26:32.519 INFO:tasks.workunit.client.0.smithi001.stdout:7/3: mknod d0/c1 0 2024-09-15T22:26:32.519 INFO:tasks.workunit.client.0.smithi001.stdout:7/4: dwrite - no filename 2024-09-15T22:26:32.519 INFO:tasks.workunit.client.0.smithi001.stdout:7/5: write - no filename 2024-09-15T22:26:32.519 INFO:tasks.workunit.client.0.smithi001.stdout:7/6: chown d0 6 1 2024-09-15T22:26:32.559 INFO:tasks.workunit.client.0.smithi001.stdout:1/25: link d3/f4 d3/f7 0 2024-09-15T22:26:32.559 INFO:tasks.workunit.client.0.smithi001.stdout:1/26: fdatasync d3/f5 0 2024-09-15T22:26:32.559 INFO:tasks.workunit.client.0.smithi001.stdout:6/6: creat d0/f2 x:0 0 0 2024-09-15T22:26:32.559 INFO:tasks.workunit.client.0.smithi001.stdout:6/7: dread - d0/f2 zero size 2024-09-15T22:26:32.567 INFO:tasks.workunit.client.0.smithi001.stdout:8/0: symlink l0 0 2024-09-15T22:26:32.567 INFO:tasks.workunit.client.0.smithi001.stdout:8/1: rmdir - no directory 2024-09-15T22:26:32.578 INFO:tasks.workunit.client.0.smithi001.stdout:2/9: creat d2/f3 x:0 0 0 2024-09-15T22:26:32.595 INFO:tasks.workunit.client.0.smithi001.stdout:9/0: fdatasync - no filename 2024-09-15T22:26:32.595 INFO:tasks.workunit.client.0.smithi001.stdout:9/1: rmdir - no directory 2024-09-15T22:26:32.595 INFO:tasks.workunit.client.0.smithi001.stdout:9/2: read - no filename 2024-09-15T22:26:32.595 INFO:tasks.workunit.client.0.smithi001.stdout:9/3: dread - no filename 2024-09-15T22:26:32.595 INFO:tasks.workunit.client.0.smithi001.stdout:9/4: dread - no filename 2024-09-15T22:26:32.595 INFO:tasks.workunit.client.0.smithi001.stdout:9/5: truncate - no filename 2024-09-15T22:26:32.596 INFO:tasks.workunit.client.0.smithi001.stdout:9/6: dread - no filename 2024-09-15T22:26:32.596 INFO:tasks.workunit.client.0.smithi001.stdout:9/7: link - no file 2024-09-15T22:26:32.596 INFO:tasks.workunit.client.0.smithi001.stdout:9/8: rmdir - no directory 2024-09-15T22:26:32.596 INFO:tasks.workunit.client.0.smithi001.stdout:9/9: read - no filename 2024-09-15T22:26:32.596 INFO:tasks.workunit.client.0.smithi001.stdout:9/10: dread - no filename 2024-09-15T22:26:32.820 INFO:tasks.workunit.client.0.smithi001.stdout:2/10: dwrite f1 [0,4194304] 0 2024-09-15T22:26:32.847 INFO:tasks.workunit.client.0.smithi001.stdout:4/16: mknod d0/c4 0 2024-09-15T22:26:32.853 INFO:tasks.workunit.client.0.smithi001.stdout:7/7: creat d0/f2 x:0 0 0 2024-09-15T22:26:32.854 INFO:tasks.workunit.client.0.smithi001.stdout:7/8: stat d0/c1 0 2024-09-15T22:26:32.958 INFO:tasks.workunit.client.0.smithi001.stdout:3/14: dwrite f2 [0,4194304] 0 2024-09-15T22:26:32.958 INFO:tasks.workunit.client.0.smithi001.stdout:3/15: fsync f2 0 2024-09-15T22:26:33.014 INFO:tasks.workunit.client.0.smithi001.stdout:1/27: dwrite d3/f7 [0,4194304] 0 2024-09-15T22:26:33.128 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:32 smithi001 ceph-mon[30843]: pgmap v406: 97 pgs: 97 active+clean; 34 MiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.5 MiB/s wr, 1.30k op/s 2024-09-15T22:26:33.238 INFO:tasks.workunit.client.0.smithi001.stdout:0/20: dwrite d0/f2 [0,4194304] 0 2024-09-15T22:26:33.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:32 smithi012 ceph-mon[34883]: pgmap v406: 97 pgs: 97 active+clean; 34 MiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.5 MiB/s wr, 1.30k op/s 2024-09-15T22:26:33.288 INFO:tasks.workunit.client.0.smithi001.stdout:3/16: dwrite f2 [0,4194304] 0 2024-09-15T22:26:33.310 INFO:tasks.workunit.client.0.smithi001.stdout:3/17: read f2 [3198956,30610] 0 2024-09-15T22:26:33.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:32 smithi098 ceph-mon[35514]: pgmap v406: 97 pgs: 97 active+clean; 34 MiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.5 MiB/s wr, 1.30k op/s 2024-09-15T22:26:33.378 INFO:tasks.workunit.client.0.smithi001.stdout:6/8: getdents d0 0 2024-09-15T22:26:33.378 INFO:tasks.workunit.client.0.smithi001.stdout:6/9: write d0/f2 [966515,6310] 0 2024-09-15T22:26:33.379 INFO:tasks.workunit.client.0.smithi001.stdout:6/10: write d0/f2 [1451877,44753] 0 2024-09-15T22:26:33.379 INFO:tasks.workunit.client.0.smithi001.stdout:6/11: chown d0/f2 17 1 2024-09-15T22:26:33.379 INFO:tasks.workunit.client.0.smithi001.stdout:6/12: truncate d0/f2 1955699 0 2024-09-15T22:26:33.386 INFO:tasks.workunit.client.0.smithi001.stdout:4/17: unlink d0/c4 0 2024-09-15T22:26:33.394 INFO:tasks.workunit.client.0.smithi001.stdout:8/2: getdents . 0 2024-09-15T22:26:33.394 INFO:tasks.workunit.client.0.smithi001.stdout:8/3: dread - no filename 2024-09-15T22:26:33.604 INFO:tasks.workunit.client.0.smithi001.stdout:7/9: dwrite d0/f2 [0,4194304] 0 2024-09-15T22:26:33.604 INFO:tasks.workunit.client.0.smithi001.stdout:7/10: stat d0/f2 0 2024-09-15T22:26:33.692 INFO:tasks.workunit.client.0.smithi001.stdout:1/28: creat d3/f8 x:0 0 0 2024-09-15T22:26:33.993 INFO:tasks.workunit.client.0.smithi001.stdout:2/11: write f1 [5052608,114013] 0 2024-09-15T22:26:34.624 INFO:tasks.workunit.client.0.smithi001.stdout:0/21: rmdir d0 39 2024-09-15T22:26:34.837 INFO:tasks.workunit.client.0.smithi001.stdout:3/18: rename c3 to c4 0 2024-09-15T22:26:34.850 INFO:tasks.workunit.client.0.smithi001.stdout:3/19: dread f2 [0,4194304] 0 2024-09-15T22:26:34.850 INFO:tasks.workunit.client.0.smithi001.stdout:3/20: chown c4 7 1 2024-09-15T22:26:34.850 INFO:tasks.workunit.client.0.smithi001.stdout:3/21: read f2 [2184461,40452] 0 2024-09-15T22:26:34.986 INFO:tasks.workunit.client.0.smithi001.stdout:6/13: link d0/f2 d0/f3 0 2024-09-15T22:26:34.986 INFO:tasks.workunit.client.0.smithi001.stdout:6/14: fdatasync d0/f3 0 2024-09-15T22:26:35.007 INFO:tasks.workunit.client.0.smithi001.stdout:4/18: creat d0/f5 x:0 0 0 2024-09-15T22:26:35.024 INFO:tasks.workunit.client.0.smithi001.stdout:8/4: symlink l1 0 2024-09-15T22:26:35.125 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:34 smithi001 ceph-mon[30843]: pgmap v407: 97 pgs: 97 active+clean; 34 MiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 1.21k op/s 2024-09-15T22:26:35.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:34 smithi012 ceph-mon[34883]: pgmap v407: 97 pgs: 97 active+clean; 34 MiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 1.21k op/s 2024-09-15T22:26:35.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:34 smithi098 ceph-mon[35514]: pgmap v407: 97 pgs: 97 active+clean; 34 MiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 1.21k op/s 2024-09-15T22:26:35.524 INFO:tasks.workunit.client.0.smithi001.stdout:7/11: mkdir d0/d3 0 2024-09-15T22:26:35.538 INFO:tasks.workunit.client.0.smithi001.stdout:7/12: dread d0/f2 [0,4194304] 0 2024-09-15T22:26:35.575 INFO:tasks.workunit.client.0.smithi001.stdout:7/13: dwrite d0/f2 [0,4194304] 0 2024-09-15T22:26:35.585 INFO:tasks.workunit.client.0.smithi001.stdout:4/19: fsync d0/f5 0 2024-09-15T22:26:35.585 INFO:tasks.workunit.client.0.smithi001.stdout:4/20: rename d0 to d0/d6 22 2024-09-15T22:26:35.586 INFO:tasks.workunit.client.0.smithi001.stdout:4/21: dread - d0/f5 zero size 2024-09-15T22:26:35.744 INFO:tasks.workunit.client.0.smithi001.stdout:2/12: link f1 d2/f4 0 2024-09-15T22:26:35.747 INFO:tasks.workunit.client.0.smithi001.stdout:0/22: creat d0/f4 x:0 0 0 2024-09-15T22:26:35.748 INFO:tasks.workunit.client.0.smithi001.stdout:0/23: write d0/f4 [515992,9283] 0 2024-09-15T22:26:35.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.916+0000 7f3076c00640 1 -- 172.21.15.1:0/3249025419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3070103d60 msgr2=0x7f3070104160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:35.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.916+0000 7f3076c00640 1 --2- 172.21.15.1:0/3249025419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3070103d60 0x7f3070104160 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3068009900 tx=0x7f306802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.917+0000 7f3076c00640 1 -- 172.21.15.1:0/3249025419 shutdown_connections 2024-09-15T22:26:35.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.917+0000 7f3076c00640 1 --2- 172.21.15.1:0/3249025419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3070105910 0x7f307010c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.917+0000 7f3076c00640 1 --2- 172.21.15.1:0/3249025419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3070104f50 0x7f30701053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.917+0000 7f3076c00640 1 --2- 172.21.15.1:0/3249025419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3070103d60 0x7f3070104160 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.917+0000 7f3076c00640 1 -- 172.21.15.1:0/3249025419 >> 172.21.15.1:0/3249025419 conn(0x7f30700ff4e0 msgr2=0x7f3070101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:35.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.917+0000 7f3076c00640 1 -- 172.21.15.1:0/3249025419 shutdown_connections 2024-09-15T22:26:35.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.917+0000 7f3076c00640 1 -- 172.21.15.1:0/3249025419 wait complete. 2024-09-15T22:26:35.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.918+0000 7f3076c00640 1 Processor -- start 2024-09-15T22:26:35.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.918+0000 7f3076c00640 1 -- start start 2024-09-15T22:26:35.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.918+0000 7f3076c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3070103d60 0x7f307019a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.918+0000 7f3076c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3070104f50 0x7f307019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.918+0000 7f3076c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3070105910 0x7f30701a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.918+0000 7f3076c00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f307010fa30 con 0x7f3070104f50 2024-09-15T22:26:35.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.918+0000 7f3076c00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f307010f8b0 con 0x7f3070103d60 2024-09-15T22:26:35.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.918+0000 7f3076c00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f307010fbb0 con 0x7f3070105910 2024-09-15T22:26:35.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.918+0000 7f3074c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3070105910 0x7f30701a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.918+0000 7f306fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3070103d60 0x7f307019a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.919+0000 7f306fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3070103d60 0x7f307019a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:44388/0 (socket says 172.21.15.1:44388) 2024-09-15T22:26:35.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.919+0000 7f306fe00640 1 -- 172.21.15.1:0/2741331314 learned_addr learned my addr 172.21.15.1:0/2741331314 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:26:35.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.919+0000 7f3074c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3070105910 0x7f30701a1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:49648/0 (socket says 172.21.15.1:49648) 2024-09-15T22:26:35.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.919+0000 7f306f400640 1 --2- 172.21.15.1:0/2741331314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3070104f50 0x7f307019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.919+0000 7f306fe00640 1 -- 172.21.15.1:0/2741331314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3070105910 msgr2=0x7f30701a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:35.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.919+0000 7f306fe00640 1 --2- 172.21.15.1:0/2741331314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3070105910 0x7f30701a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.919+0000 7f306fe00640 1 -- 172.21.15.1:0/2741331314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3070104f50 msgr2=0x7f307019a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:35.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.919+0000 7f306fe00640 1 --2- 172.21.15.1:0/2741331314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3070104f50 0x7f307019a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.919+0000 7f306fe00640 1 -- 172.21.15.1:0/2741331314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30701a1ca0 con 0x7f3070103d60 2024-09-15T22:26:35.924 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.919+0000 7f306f400640 1 --2- 172.21.15.1:0/2741331314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3070104f50 0x7f307019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:26:35.924 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.919+0000 7f3074c00640 1 --2- 172.21.15.1:0/2741331314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3070105910 0x7f30701a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:26:35.924 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.919+0000 7f306fe00640 1 --2- 172.21.15.1:0/2741331314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3070103d60 0x7f307019a080 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3068031440 tx=0x7f3068032ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:35.924 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.919+0000 7f306cc00640 1 -- 172.21.15.1:0/2741331314 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306803f030 con 0x7f3070103d60 2024-09-15T22:26:35.924 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.919+0000 7f306cc00640 1 -- 172.21.15.1:0/2741331314 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3068003ce0 con 0x7f3070103d60 2024-09-15T22:26:35.924 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.919+0000 7f306cc00640 1 -- 172.21.15.1:0/2741331314 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3068035070 con 0x7f3070103d60 2024-09-15T22:26:35.924 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.920+0000 7f3076c00640 1 -- 172.21.15.1:0/2741331314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30701a1f30 con 0x7f3070103d60 2024-09-15T22:26:35.924 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.920+0000 7f3076c00640 1 -- 172.21.15.1:0/2741331314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30701a2340 con 0x7f3070103d60 2024-09-15T22:26:35.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.922+0000 7f3079a6a740 1 Processor -- start 2024-09-15T22:26:35.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.923+0000 7f3079a6a740 1 -- start start 2024-09-15T22:26:35.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.923+0000 7f306cc00640 1 -- 172.21.15.1:0/2741331314 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f3068042030 con 0x7f3070103d60 2024-09-15T22:26:35.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.923+0000 7f3079a6a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c597684090 0x55c597684490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.923+0000 7f3079a6a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5976849d0 0x55c597689490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.923+0000 7f3079a6a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c597689a60 0x55c59768bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.923+0000 7f3079a6a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c5975e9100 con 0x55c5976849d0 2024-09-15T22:26:35.927 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.923+0000 7f3079a6a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c5975911b0 con 0x55c597689a60 2024-09-15T22:26:35.927 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.923+0000 7f3079a6a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c5975e50c0 con 0x55c597684090 2024-09-15T22:26:35.927 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.923+0000 7f3074c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c597684090 0x55c597684490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.927 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.923+0000 7f3074c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c597684090 0x55c597684490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:49660/0 (socket says 172.21.15.1:49660) 2024-09-15T22:26:35.927 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.923+0000 7f3074c00640 1 -- 172.21.15.1:0/3517045841 learned_addr learned my addr 172.21.15.1:0/3517045841 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:26:35.927 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.923+0000 7f306f400640 1 --2- 172.21.15.1:0/3517045841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c597689a60 0x55c59768bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.927 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.923+0000 7f306fe00640 1 --2- 172.21.15.1:0/3517045841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5976849d0 0x55c597689490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.927 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.923+0000 7f3074c00640 1 -- 172.21.15.1:0/3517045841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c597689a60 msgr2=0x55c59768bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:35.927 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.924+0000 7f3074c00640 1 --2- 172.21.15.1:0/3517045841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c597689a60 0x55c59768bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.927 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.924+0000 7f3074c00640 1 -- 172.21.15.1:0/3517045841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5976849d0 msgr2=0x55c597689490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:35.928 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.924+0000 7f3074c00640 1 --2- 172.21.15.1:0/3517045841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5976849d0 0x55c597689490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.928 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.924+0000 7f3074c00640 1 -- 172.21.15.1:0/3517045841 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5972fc210 con 0x55c597684090 2024-09-15T22:26:35.928 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.924+0000 7f3074c00640 1 --2- 172.21.15.1:0/3517045841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c597684090 0x55c597684490 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f30600117e0 tx=0x7f3060011ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93d014f034df822f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:35.928 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.924+0000 7f3065200640 1 -- 172.21.15.1:0/3517045841 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3060011310 con 0x55c597684090 2024-09-15T22:26:35.928 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.924+0000 7f3065200640 1 -- 172.21.15.1:0/3517045841 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3060003e50 con 0x55c597684090 2024-09-15T22:26:35.928 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.924+0000 7f3065200640 1 -- 172.21.15.1:0/3517045841 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3060004590 con 0x55c597684090 2024-09-15T22:26:35.928 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.924+0000 7f306cc00640 1 --2- 172.21.15.1:0/2741331314 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f30540a3240 0x7f30540a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.925+0000 7f306cc00640 1 -- 172.21.15.1:0/2741331314 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f30680eff10 con 0x7f3070103d60 2024-09-15T22:26:35.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.925+0000 7f306fe00640 1 --2- 172.21.15.1:0/2741331314 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f30540a3240 0x7f30540a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.925+0000 7f3079a6a740 1 -- 172.21.15.1:0/3517045841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c597684090 msgr2=0x55c597684490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:35.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.925+0000 7f3079a6a740 1 --2- 172.21.15.1:0/3517045841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c597684090 0x55c597684490 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f30600117e0 tx=0x7f3060011ca0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.925+0000 7f3079a6a740 1 -- 172.21.15.1:0/3517045841 shutdown_connections 2024-09-15T22:26:35.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.925+0000 7f3079a6a740 1 --2- 172.21.15.1:0/3517045841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c597689a60 0x55c59768bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.925+0000 7f3079a6a740 1 --2- 172.21.15.1:0/3517045841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c5976849d0 0x55c597689490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.925+0000 7f3079a6a740 1 --2- 172.21.15.1:0/3517045841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c597684090 0x55c597684490 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.925+0000 7f3079a6a740 1 -- 172.21.15.1:0/3517045841 >> 172.21.15.1:0/3517045841 conn(0x55c59767f700 msgr2=0x55c59767fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:35.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.925+0000 7f3079a6a740 1 -- 172.21.15.1:0/3517045841 shutdown_connections 2024-09-15T22:26:35.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.925+0000 7f3079a6a740 1 -- 172.21.15.1:0/3517045841 wait complete. 2024-09-15T22:26:35.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.925+0000 7f306fe00640 1 --2- 172.21.15.1:0/2741331314 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f30540a3240 0x7f30540a5700 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f30680b88d0 tx=0x7f30680b8040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:35.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.926+0000 7f3079a6a740 1 -- start start 2024-09-15T22:26:35.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.926+0000 7f3079a6a740 1 Processor -- start 2024-09-15T22:26:35.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.926+0000 7f3079a6a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c597684090 0x55c597696a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.926+0000 7f3079a6a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5976849d0 0x55c597696fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.926+0000 7f3079a6a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c597689a60 0x55c59769dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.926+0000 7f3079a6a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c59768ca30 con 0x55c597689a60 2024-09-15T22:26:35.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.926+0000 7f3079a6a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c597572090 con 0x55c5976849d0 2024-09-15T22:26:35.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.926+0000 7f3079a6a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c59768cbb0 con 0x55c597684090 2024-09-15T22:26:35.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.927+0000 7f3079a6a740 10 client.0 _ll_register_callbacks cb 0x55c5975c6f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:26:35.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.927+0000 7f3074c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c597684090 0x55c597696a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.927+0000 7f306f400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5976849d0 0x55c597696fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.927+0000 7f3074c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c597684090 0x55c597696a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:49666/0 (socket says 172.21.15.1:49666) 2024-09-15T22:26:35.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.927+0000 7f306f400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5976849d0 0x55c597696fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:44408/0 (socket says 172.21.15.1:44408) 2024-09-15T22:26:35.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.927+0000 7f3074c00640 1 -- 172.21.15.1:0/924406706 learned_addr learned my addr 172.21.15.1:0/924406706 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:26:35.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.927+0000 7f3074c00640 1 --2- 172.21.15.1:0/924406706 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c597689a60 0x55c59769dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.927+0000 7f306f400640 1 -- 172.21.15.1:0/924406706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c597684090 msgr2=0x55c597696a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:35.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.927+0000 7f306f400640 1 --2- 172.21.15.1:0/924406706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c597684090 0x55c597696a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.927+0000 7f306f400640 1 -- 172.21.15.1:0/924406706 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c597689a60 msgr2=0x55c59769dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:35.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.927+0000 7f306f400640 1 --2- 172.21.15.1:0/924406706 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c597689a60 0x55c59769dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.927+0000 7f306f400640 1 -- 172.21.15.1:0/924406706 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5973c8620 con 0x55c5976849d0 2024-09-15T22:26:35.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.928+0000 7f306f400640 1 --2- 172.21.15.1:0/924406706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5976849d0 0x55c597696fd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f307019b590 tx=0x7f305c012b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f48a0d26d4a68f3f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:35.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.928+0000 7f3059600640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-15T22:26:35.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.928+0000 7f3059600640 1 -- 172.21.15.1:0/924406706 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c011c70 con 0x55c5976849d0 2024-09-15T22:26:35.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.928+0000 7f3059600640 1 -- 172.21.15.1:0/924406706 <== mon.2 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f305c011e10 con 0x55c5976849d0 2024-09-15T22:26:35.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.928+0000 7f3079a6a740 1 -- 172.21.15.1:0/924406706 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3060003e50 con 0x55c5976849d0 2024-09-15T22:26:35.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.928+0000 7f3059600640 1 -- 172.21.15.1:0/924406706 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f305c005020 con 0x55c5976849d0 2024-09-15T22:26:35.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.928+0000 7f3079a6a740 10 client.25160 fetch_fsmap learned FSMap version 27 2024-09-15T22:26:35.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.928+0000 7f3079a6a740 1 -- 172.21.15.1:0/924406706 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c5976a0eb0 con 0x55c5976849d0 2024-09-15T22:26:35.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.929+0000 7f3059600640 1 -- 172.21.15.1:0/924406706 <== mon.2 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3060003e50 con 0x55c5976849d0 2024-09-15T22:26:35.937 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.929+0000 7f3059600640 1 -- 172.21.15.1:0/924406706 <== mon.2 v2:172.21.15.12:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f305c01c470 con 0x55c5976849d0 2024-09-15T22:26:35.937 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.929+0000 7f3079a6a740 10 client.25160 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:26:35.937 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.929+0000 7f3079a6a740 10 client.25160 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T22:26:35.937 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.929+0000 7f3079a6a740 20 client.25160 populate_metadata read hostname 'smithi001' 2024-09-15T22:26:35.937 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.929+0000 7f3079a6a740 1 --2- 172.21.15.1:0/924406706 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55c5976a25f0 0x55c5976a4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.937 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.929+0000 7f3079a6a740 4 client.25160 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:26:35.937 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.929+0000 7f3079a6a740 1 -- 172.21.15.1:0/924406706 --> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c5975f6830 con 0x55c5976a25f0 2024-09-15T22:26:35.937 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.929+0000 7f3074c00640 1 --2- 172.21.15.1:0/924406706 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55c5976a25f0 0x55c5976a4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.937 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.930+0000 7f3074c00640 1 --2- 172.21.15.1:0/924406706 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55c5976a25f0 0x55c5976a4a10 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6352e989237a4aba server_cookie=9e111bc7722b8bd9 in_seq=0 out_seq=0 2024-09-15T22:26:35.937 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.930+0000 7f3059600640 10 client.25160 ms_handle_connect on v2:172.21.15.98:6838/2831161859 2024-09-15T22:26:35.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.932+0000 7f3059600640 1 -- 172.21.15.1:0/924406706 <== mds.0 v2:172.21.15.98:6838/2831161859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c5975f6830 con 0x55c5976a25f0 2024-09-15T22:26:35.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.932+0000 7f3059600640 10 client.25160 handle_command_reply: tid=0 2024-09-15T22:26:35.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.932+0000 7f3079a6a740 1 client.25160 shutdown 2024-09-15T22:26:35.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.932+0000 7f3079a6a740 1 -- 172.21.15.1:0/924406706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5976849d0 msgr2=0x55c597696fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:35.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.932+0000 7f3079a6a740 1 --2- 172.21.15.1:0/924406706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5976849d0 0x55c597696fd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f307019b590 tx=0x7f305c012b60 comp rx=0 tx=0).stop 2024-09-15T22:26:35.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.932+0000 7f3079a6a740 1 -- 172.21.15.1:0/924406706 shutdown_connections 2024-09-15T22:26:35.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.932+0000 7f3079a6a740 1 --2- 172.21.15.1:0/924406706 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55c5976a25f0 0x55c5976a4a10 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.932+0000 7f3079a6a740 1 --2- 172.21.15.1:0/924406706 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c597689a60 0x55c59769dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.932+0000 7f3079a6a740 1 --2- 172.21.15.1:0/924406706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5976849d0 0x55c597696fd0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.932+0000 7f3079a6a740 1 --2- 172.21.15.1:0/924406706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c597684090 0x55c597696a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.932+0000 7f3059600640 0 client.25160 ms_handle_reset on v2:172.21.15.98:6838/2831161859 2024-09-15T22:26:35.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.932+0000 7f3079a6a740 1 -- 172.21.15.1:0/924406706 >> 172.21.15.1:0/924406706 conn(0x55c59767f700 msgr2=0x55c597680f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:35.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.932+0000 7f3079a6a740 1 -- 172.21.15.1:0/924406706 shutdown_connections 2024-09-15T22:26:35.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.932+0000 7f3079a6a740 1 -- 172.21.15.1:0/924406706 wait complete. 2024-09-15T22:26:35.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.933+0000 7f3079a6a740 20 client.25160 trim_cache size 0 max 16384 2024-09-15T22:26:35.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.948+0000 7f3079a6a740 1 Processor -- start 2024-09-15T22:26:35.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.948+0000 7f3079a6a740 1 -- start start 2024-09-15T22:26:35.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.948+0000 7f3079a6a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c597684090 0x55c597684470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.948+0000 7f3079a6a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c5976849d0 0x55c59769df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.948+0000 7f3079a6a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c597689a60 0x55c597680430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.948+0000 7f3079a6a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f30701a9820 con 0x55c597684090 2024-09-15T22:26:35.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.948+0000 7f3079a6a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f30701a70f0 con 0x55c597689a60 2024-09-15T22:26:35.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.948+0000 7f3079a6a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f30701a4f40 con 0x55c5976849d0 2024-09-15T22:26:35.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.949+0000 7f306f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c5976849d0 0x55c59769df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.949+0000 7f3074c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c597684090 0x55c597684470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.949+0000 7f306f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c5976849d0 0x55c59769df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:49680/0 (socket says 172.21.15.1:49680) 2024-09-15T22:26:35.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.949+0000 7f306f400640 1 -- 172.21.15.1:0/747119974 learned_addr learned my addr 172.21.15.1:0/747119974 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:26:35.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.949+0000 7f3074c00640 1 --2- 172.21.15.1:0/747119974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c597689a60 0x55c597680430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.949+0000 7f306f400640 1 -- 172.21.15.1:0/747119974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c597689a60 msgr2=0x55c597680430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:35.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.949+0000 7f306f400640 1 --2- 172.21.15.1:0/747119974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c597689a60 0x55c597680430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.949+0000 7f306f400640 1 -- 172.21.15.1:0/747119974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c597684090 msgr2=0x55c597684470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:35.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.949+0000 7f306f400640 1 --2- 172.21.15.1:0/747119974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c597684090 0x55c597684470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.949+0000 7f306f400640 1 -- 172.21.15.1:0/747119974 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c59767f520 con 0x55c5976849d0 2024-09-15T22:26:35.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.949+0000 7f3074c00640 1 --2- 172.21.15.1:0/747119974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c597684090 0x55c597684470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:26:35.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.949+0000 7f306f400640 1 --2- 172.21.15.1:0/747119974 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c5976849d0 0x55c59769df60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f305c009e50 tx=0x7f305c009f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d407593f0cd1870 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:35.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.949+0000 7f305be00640 1 -- 172.21.15.1:0/747119974 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c02b070 con 0x55c5976849d0 2024-09-15T22:26:35.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.950+0000 7f305be00640 1 -- 172.21.15.1:0/747119974 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f305c01c470 con 0x55c5976849d0 2024-09-15T22:26:35.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.950+0000 7f305be00640 1 -- 172.21.15.1:0/747119974 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c004660 con 0x55c5976849d0 2024-09-15T22:26:35.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.950+0000 7f3079a6a740 1 -- 172.21.15.1:0/747119974 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c5976849d0 msgr2=0x55c59769df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:35.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.950+0000 7f3079a6a740 1 --2- 172.21.15.1:0/747119974 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c5976849d0 0x55c59769df60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f305c009e50 tx=0x7f305c009f30 comp rx=0 tx=0).stop 2024-09-15T22:26:35.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.950+0000 7f3079a6a740 1 -- 172.21.15.1:0/747119974 shutdown_connections 2024-09-15T22:26:35.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.950+0000 7f3079a6a740 1 --2- 172.21.15.1:0/747119974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c597689a60 0x55c597680430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.950+0000 7f3079a6a740 1 --2- 172.21.15.1:0/747119974 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c5976849d0 0x55c59769df60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.950+0000 7f3079a6a740 1 --2- 172.21.15.1:0/747119974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c597684090 0x55c597684470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.950+0000 7f3079a6a740 1 -- 172.21.15.1:0/747119974 >> 172.21.15.1:0/747119974 conn(0x55c59767f700 msgr2=0x55c597685c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:35.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.950+0000 7f3079a6a740 1 -- 172.21.15.1:0/747119974 shutdown_connections 2024-09-15T22:26:35.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.950+0000 7f3079a6a740 1 -- 172.21.15.1:0/747119974 wait complete. 2024-09-15T22:26:35.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.951+0000 7f3079a6a740 1 -- start start 2024-09-15T22:26:35.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.951+0000 7f3079a6a740 1 Processor -- start 2024-09-15T22:26:35.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.951+0000 7f3079a6a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c597684090 0x55c59769b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.951+0000 7f3079a6a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5976849d0 0x55c59769b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.951+0000 7f3079a6a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c597689a60 0x55c59769c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.951+0000 7f3079a6a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f30701a55b0 con 0x55c597689a60 2024-09-15T22:26:35.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.951+0000 7f3079a6a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f30701a6a20 con 0x55c5976849d0 2024-09-15T22:26:35.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.951+0000 7f3079a6a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f30701a5c80 con 0x55c597684090 2024-09-15T22:26:35.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.951+0000 7f3079a6a740 10 client.0 _ll_register_callbacks cb 0x7f305c009860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:26:35.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.951+0000 7f3074c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c597684090 0x55c59769b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.951+0000 7f3074c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c597684090 0x55c59769b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:49696/0 (socket says 172.21.15.1:49696) 2024-09-15T22:26:35.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.951+0000 7f3074c00640 1 -- 172.21.15.1:0/2397797838 learned_addr learned my addr 172.21.15.1:0/2397797838 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:26:35.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.952+0000 7f306f400640 1 --2- 172.21.15.1:0/2397797838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5976849d0 0x55c59769b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.952+0000 7f3074c00640 1 --2- 172.21.15.1:0/2397797838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c597689a60 0x55c59769c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.952+0000 7f3074c00640 1 -- 172.21.15.1:0/2397797838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5976849d0 msgr2=0x55c59769b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:35.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.952+0000 7f3074c00640 1 --2- 172.21.15.1:0/2397797838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5976849d0 0x55c59769b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.952+0000 7f3074c00640 1 -- 172.21.15.1:0/2397797838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c597689a60 msgr2=0x55c59769c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:35.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.952+0000 7f3074c00640 1 --2- 172.21.15.1:0/2397797838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c597689a60 0x55c59769c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.952+0000 7f3074c00640 1 -- 172.21.15.1:0/2397797838 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c59769cea0 con 0x55c597684090 2024-09-15T22:26:35.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.952+0000 7f306f400640 1 --2- 172.21.15.1:0/2397797838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5976849d0 0x55c59769b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:26:35.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.952+0000 7f3074c00640 1 --2- 172.21.15.1:0/2397797838 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c597684090 0x55c59769b390 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3060000f80 tx=0x7f306001c040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=776a5005ebafb4e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:35.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.952+0000 7f3059600640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-15T22:26:35.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.952+0000 7f3059600640 1 -- 172.21.15.1:0/2397797838 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3060025040 con 0x55c597684090 2024-09-15T22:26:35.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.952+0000 7f3079a6a740 1 -- 172.21.15.1:0/2397797838 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f305c01c470 con 0x55c597684090 2024-09-15T22:26:35.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.952+0000 7f3059600640 1 -- 172.21.15.1:0/2397797838 <== mon.1 v2:172.21.15.98:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f306000fba0 con 0x55c597684090 2024-09-15T22:26:35.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.953+0000 7f3059600640 1 -- 172.21.15.1:0/2397797838 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f306000fda0 con 0x55c597684090 2024-09-15T22:26:35.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.953+0000 7f3079a6a740 10 client.25198 fetch_fsmap learned FSMap version 27 2024-09-15T22:26:35.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.953+0000 7f3079a6a740 1 -- 172.21.15.1:0/2397797838 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c59769e210 con 0x55c597684090 2024-09-15T22:26:35.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.953+0000 7f3059600640 1 -- 172.21.15.1:0/2397797838 <== mon.1 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f305c01c470 con 0x55c597684090 2024-09-15T22:26:35.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.953+0000 7f3059600640 1 -- 172.21.15.1:0/2397797838 <== mon.1 v2:172.21.15.98:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f306002b040 con 0x55c597684090 2024-09-15T22:26:35.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.953+0000 7f3079a6a740 10 client.25198 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:26:35.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.953+0000 7f3079a6a740 10 client.25198 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T22:26:35.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.953+0000 7f3079a6a740 20 client.25198 populate_metadata read hostname 'smithi001' 2024-09-15T22:26:35.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.953+0000 7f3079a6a740 1 --2- 172.21.15.1:0/2397797838 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55c59770d820 0x55c59770fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.953+0000 7f3079a6a740 4 client.25198 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:26:35.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.953+0000 7f3079a6a740 1 -- 172.21.15.1:0/2397797838 --> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c5975f0b80 con 0x55c59770d820 2024-09-15T22:26:35.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.953+0000 7f306f400640 1 --2- 172.21.15.1:0/2397797838 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55c59770d820 0x55c59770fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.954+0000 7f306f400640 1 --2- 172.21.15.1:0/2397797838 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55c59770d820 0x55c59770fc40 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4433188adc554416 server_cookie=f0b999cd8f5e66f6 in_seq=0 out_seq=0 2024-09-15T22:26:35.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:35.954+0000 7f3059600640 10 client.25198 ms_handle_connect on v2:172.21.15.98:6838/2831161859 2024-09-15T22:26:36.226 INFO:tasks.workunit.client.0.smithi001.stdout:6/15: link d0/f3 d0/f4 0 2024-09-15T22:26:36.227 INFO:tasks.workunit.client.0.smithi001.stdout:8/5: rename l0 to l2 0 2024-09-15T22:26:36.227 INFO:tasks.workunit.client.0.smithi001.stdout:8/6: write - no filename 2024-09-15T22:26:36.227 INFO:tasks.workunit.client.0.smithi001.stdout:8/7: dwrite - no filename 2024-09-15T22:26:36.227 INFO:tasks.workunit.client.0.smithi001.stdout:8/8: dread - no filename 2024-09-15T22:26:36.230 INFO:tasks.workunit.client.0.smithi001.stdout:7/14: unlink d0/c1 0 2024-09-15T22:26:36.231 INFO:tasks.workunit.client.0.smithi001.stdout:4/22: creat d0/f7 x:0 0 0 2024-09-15T22:26:36.232 INFO:tasks.workunit.client.0.smithi001.stdout:1/29: truncate d3/f7 528681 0 2024-09-15T22:26:36.232 INFO:tasks.workunit.client.0.smithi001.stdout:1/30: write d3/f8 [630992,7541] 0 2024-09-15T22:26:36.244 INFO:tasks.workunit.client.0.smithi001.stdout:0/24: mknod d0/c5 0 2024-09-15T22:26:36.247 INFO:tasks.workunit.client.0.smithi001.stdout:6/16: link d0/f2 d0/f5 0 2024-09-15T22:26:36.247 INFO:tasks.workunit.client.0.smithi001.stdout:6/17: readlink - no filename 2024-09-15T22:26:36.248 INFO:tasks.workunit.client.0.smithi001.stdout:8/9: symlink l3 0 2024-09-15T22:26:36.250 INFO:tasks.workunit.client.0.smithi001.stdout:7/15: unlink d0/f2 0 2024-09-15T22:26:36.252 INFO:tasks.workunit.client.0.smithi001.stdout:4/23: rename d0/f5 to d0/f8 0 2024-09-15T22:26:36.252 INFO:tasks.workunit.client.0.smithi001.stdout:4/24: chown d0 256044 1 2024-09-15T22:26:36.252 INFO:tasks.workunit.client.0.smithi001.stdout:4/25: truncate d0/f8 939776 0 2024-09-15T22:26:36.252 INFO:tasks.workunit.client.0.smithi001.stdout:4/26: chown d0/f7 63 1 2024-09-15T22:26:36.252 INFO:tasks.workunit.client.0.smithi001.stdout:4/27: truncate d0/f7 53860 0 2024-09-15T22:26:36.252 INFO:tasks.workunit.client.0.smithi001.stdout:4/28: write d0/f8 [1529615,82893] 0 2024-09-15T22:26:36.252 INFO:tasks.workunit.client.0.smithi001.stdout:4/29: stat d0 0 2024-09-15T22:26:36.253 INFO:tasks.workunit.client.0.smithi001.stdout:1/31: creat d3/f9 x:0 0 0 2024-09-15T22:26:36.266 INFO:tasks.workunit.client.0.smithi001.stdout:0/25: mkdir d0/d6 0 2024-09-15T22:26:36.266 INFO:tasks.workunit.client.0.smithi001.stdout:8/10: stat l2 0 2024-09-15T22:26:36.266 INFO:tasks.workunit.client.0.smithi001.stdout:8/11: dwrite - no filename 2024-09-15T22:26:36.266 INFO:tasks.workunit.client.0.smithi001.stdout:8/12: write - no filename 2024-09-15T22:26:36.266 INFO:tasks.workunit.client.0.smithi001.stdout:8/13: truncate - no filename 2024-09-15T22:26:36.266 INFO:tasks.workunit.client.0.smithi001.stdout:8/14: chown l2 478768 1 2024-09-15T22:26:36.266 INFO:tasks.workunit.client.0.smithi001.stdout:8/15: dwrite - no filename 2024-09-15T22:26:36.266 INFO:tasks.workunit.client.0.smithi001.stdout:8/16: readlink l2 0 2024-09-15T22:26:36.266 INFO:tasks.workunit.client.0.smithi001.stdout:8/17: fsync - no filename 2024-09-15T22:26:36.267 INFO:tasks.workunit.client.0.smithi001.stdout:8/18: dread - no filename 2024-09-15T22:26:36.267 INFO:tasks.workunit.client.0.smithi001.stdout:8/19: rmdir - no directory 2024-09-15T22:26:36.267 INFO:tasks.workunit.client.0.smithi001.stdout:7/16: creat d0/f4 x:0 0 0 2024-09-15T22:26:36.267 INFO:tasks.workunit.client.0.smithi001.stdout:4/30: link d0/f7 d0/f9 0 2024-09-15T22:26:36.267 INFO:tasks.workunit.client.0.smithi001.stdout:1/32: mknod d3/ca 0 2024-09-15T22:26:36.267 INFO:tasks.workunit.client.0.smithi001.stdout:8/20: stat l2 0 2024-09-15T22:26:36.267 INFO:tasks.workunit.client.0.smithi001.stdout:8/21: write - no filename 2024-09-15T22:26:36.267 INFO:tasks.workunit.client.0.smithi001.stdout:8/22: chown l2 124 1 2024-09-15T22:26:36.268 INFO:tasks.workunit.client.0.smithi001.stdout:8/23: dread - no filename 2024-09-15T22:26:36.268 INFO:tasks.workunit.client.0.smithi001.stdout:7/17: symlink d0/l5 0 2024-09-15T22:26:36.268 INFO:tasks.workunit.client.0.smithi001.stdout:4/31: mknod d0/ca 0 2024-09-15T22:26:36.270 INFO:tasks.workunit.client.0.smithi001.stdout:8/24: creat f4 x:0 0 0 2024-09-15T22:26:36.270 INFO:tasks.workunit.client.0.smithi001.stdout:8/25: dread - f4 zero size 2024-09-15T22:26:36.272 INFO:tasks.workunit.client.0.smithi001.stdout:7/18: creat d0/f6 x:0 0 0 2024-09-15T22:26:36.275 INFO:tasks.workunit.client.0.smithi001.stdout:0/26: dread d0/f4 [0,4194304] 0 2024-09-15T22:26:36.280 INFO:tasks.workunit.client.0.smithi001.stdout:0/27: creat d0/f7 x:0 0 0 2024-09-15T22:26:36.282 INFO:tasks.workunit.client.0.smithi001.stdout:0/28: creat d0/f8 x:0 0 0 2024-09-15T22:26:36.297 INFO:tasks.workunit.client.0.smithi001.stdout:6/18: dwrite d0/f5 [0,4194304] 0 2024-09-15T22:26:36.297 INFO:tasks.workunit.client.0.smithi001.stdout:3/22: truncate f2 490707 0 2024-09-15T22:26:36.300 INFO:tasks.workunit.client.0.smithi001.stdout:3/23: creat f5 x:0 0 0 2024-09-15T22:26:36.300 INFO:tasks.workunit.client.0.smithi001.stdout:3/24: chown f5 10 1 2024-09-15T22:26:36.300 INFO:tasks.workunit.client.0.smithi001.stdout:3/25: chown c4 126420 1 2024-09-15T22:26:36.300 INFO:tasks.workunit.client.0.smithi001.stdout:3/26: dread - f5 zero size 2024-09-15T22:26:36.301 INFO:tasks.workunit.client.0.smithi001.stdout:3/27: creat f6 x:0 0 0 2024-09-15T22:26:36.310 INFO:tasks.workunit.client.0.smithi001.stdout:7/19: dwrite d0/f6 [0,4194304] 0 2024-09-15T22:26:36.316 INFO:tasks.workunit.client.0.smithi001.stdout:7/20: rename d0/d3 to d0/d7 0 2024-09-15T22:26:36.316 INFO:tasks.workunit.client.0.smithi001.stdout:7/21: truncate d0/f4 468907 0 2024-09-15T22:26:36.319 INFO:tasks.workunit.client.0.smithi001.stdout:6/19: dread d0/f5 [0,4194304] 0 2024-09-15T22:26:36.319 INFO:tasks.workunit.client.0.smithi001.stdout:6/20: chown d0/c1 896 1 2024-09-15T22:26:36.319 INFO:tasks.workunit.client.0.smithi001.stdout:7/22: mknod d0/c8 0 2024-09-15T22:26:36.333 INFO:tasks.workunit.client.0.smithi001.stdout:0/29: dwrite d0/f8 [0,4194304] 0 2024-09-15T22:26:36.334 INFO:tasks.workunit.client.0.smithi001.stdout:8/26: dwrite f4 [0,4194304] 0 2024-09-15T22:26:36.335 INFO:tasks.workunit.client.0.smithi001.stdout:0/30: mkdir d0/d9 0 2024-09-15T22:26:36.337 INFO:tasks.workunit.client.0.smithi001.stdout:0/31: mkdir d0/da 0 2024-09-15T22:26:36.337 INFO:tasks.workunit.client.0.smithi001.stdout:0/32: fsync d0/f3 0 2024-09-15T22:26:36.366 INFO:tasks.workunit.client.0.smithi001.stdout:0/33: dwrite d0/f4 [0,4194304] 0 2024-09-15T22:26:36.472 INFO:tasks.workunit.client.0.smithi001.stdout:1/33: getdents d3 0 2024-09-15T22:26:36.472 INFO:tasks.workunit.client.0.smithi001.stdout:1/34: truncate d3/f9 823138 0 2024-09-15T22:26:36.472 INFO:tasks.workunit.client.0.smithi001.stdout:1/35: chown d3/f4 1842930320 1 2024-09-15T22:26:36.472 INFO:tasks.workunit.client.0.smithi001.stdout:1/36: chown d3/f5 571 1 2024-09-15T22:26:36.473 INFO:tasks.workunit.client.0.smithi001.stdout:1/37: mknod d3/cb 0 2024-09-15T22:26:36.475 INFO:tasks.workunit.client.0.smithi001.stdout:1/38: symlink d3/lc 0 2024-09-15T22:26:36.475 INFO:tasks.workunit.client.0.smithi001.stdout:1/39: fsync d3/f9 0 2024-09-15T22:26:36.479 INFO:tasks.workunit.client.0.smithi001.stdout:3/28: truncate f2 1060629 0 2024-09-15T22:26:36.479 INFO:tasks.workunit.client.0.smithi001.stdout:6/21: truncate d0/f2 672318 0 2024-09-15T22:26:36.480 INFO:tasks.workunit.client.0.smithi001.stdout:3/29: fsync f6 0 2024-09-15T22:26:36.483 INFO:tasks.workunit.client.0.smithi001.stdout:0/34: truncate d0/f8 1481281 0 2024-09-15T22:26:36.484 INFO:tasks.workunit.client.0.smithi001.stdout:6/22: mkdir d0/d6 0 2024-09-15T22:26:36.485 INFO:tasks.workunit.client.0.smithi001.stdout:8/27: truncate f4 3904517 0 2024-09-15T22:26:36.487 INFO:tasks.workunit.client.0.smithi001.stdout:6/23: mkdir d0/d7 0 2024-09-15T22:26:36.488 INFO:tasks.workunit.client.0.smithi001.stdout:8/28: creat f5 x:0 0 0 2024-09-15T22:26:36.488 INFO:tasks.workunit.client.0.smithi001.stdout:8/29: write f5 [537728,9920] 0 2024-09-15T22:26:36.490 INFO:tasks.workunit.client.0.smithi001.stdout:8/30: link l2 l6 0 2024-09-15T22:26:36.498 INFO:tasks.workunit.client.0.smithi001.stdout:0/35: dread d0/f2 [0,4194304] 0 2024-09-15T22:26:36.527 INFO:tasks.workunit.client.0.smithi001.stdout:1/40: dwrite d3/f5 [0,4194304] 0 2024-09-15T22:26:36.533 INFO:tasks.workunit.client.0.smithi001.stdout:1/41: dread d3/f7 [0,4194304] 0 2024-09-15T22:26:36.533 INFO:tasks.workunit.client.0.smithi001.stdout:1/42: write d3/f8 [1323497,50163] 0 2024-09-15T22:26:36.537 INFO:tasks.workunit.client.0.smithi001.stdout:1/43: dread d3/f4 [0,4194304] 0 2024-09-15T22:26:36.537 INFO:tasks.workunit.client.0.smithi001.stdout:1/44: chown d3/f9 3783 1 2024-09-15T22:26:36.761 INFO:tasks.workunit.client.0.smithi001.stdout:1/45: mkdir d3/dd 0 2024-09-15T22:26:36.765 INFO:tasks.workunit.client.0.smithi001.stdout:3/30: dread f2 [0,4194304] 0 2024-09-15T22:26:36.765 INFO:tasks.workunit.client.0.smithi001.stdout:3/31: readlink - no filename 2024-09-15T22:26:36.765 INFO:tasks.workunit.client.0.smithi001.stdout:3/32: write f6 [677336,101452] 0 2024-09-15T22:26:36.765 INFO:tasks.workunit.client.0.smithi001.stdout:3/33: chown f5 53096 1 2024-09-15T22:26:36.768 INFO:tasks.workunit.client.0.smithi001.stdout:3/34: creat f7 x:0 0 0 2024-09-15T22:26:36.798 INFO:tasks.workunit.client.0.smithi001.stdout:3/35: creat f8 x:0 0 0 2024-09-15T22:26:36.798 INFO:tasks.workunit.client.0.smithi001.stdout:0/36: rmdir d0 39 2024-09-15T22:26:36.802 INFO:tasks.workunit.client.0.smithi001.stdout:3/36: rename c0 to c9 0 2024-09-15T22:26:36.807 INFO:tasks.workunit.client.0.smithi001.stdout:0/37: rename d0/da to d0/d9/db 0 2024-09-15T22:26:36.809 INFO:tasks.workunit.client.0.smithi001.stdout:3/37: mkdir da 0 2024-09-15T22:26:36.809 INFO:tasks.workunit.client.0.smithi001.stdout:3/38: write f5 [1030853,29891] 0 2024-09-15T22:26:36.809 INFO:tasks.workunit.client.0.smithi001.stdout:3/39: truncate f7 89558 0 2024-09-15T22:26:36.810 INFO:tasks.workunit.client.0.smithi001.stdout:0/38: link d0/c5 d0/cc 0 2024-09-15T22:26:36.810 INFO:tasks.workunit.client.0.smithi001.stdout:0/39: fdatasync d0/f4 0 2024-09-15T22:26:36.817 INFO:tasks.workunit.client.0.smithi001.stdout:0/40: mkdir d0/dd 0 2024-09-15T22:26:36.820 INFO:tasks.workunit.client.0.smithi001.stdout:3/40: write f2 [671778,14311] 0 2024-09-15T22:26:36.821 INFO:tasks.workunit.client.0.smithi001.stdout:3/41: getdents da 0 2024-09-15T22:26:36.822 INFO:tasks.workunit.client.0.smithi001.stdout:0/41: creat d0/fe x:0 0 0 2024-09-15T22:26:36.822 INFO:tasks.workunit.client.0.smithi001.stdout:0/42: chown d0/f3 16855893 1 2024-09-15T22:26:36.962 INFO:tasks.workunit.client.0.smithi001.stdout:8/31: fsync f4 0 2024-09-15T22:26:36.963 INFO:tasks.workunit.client.0.smithi001.stdout:8/32: chown f4 5761 1 2024-09-15T22:26:37.057 INFO:tasks.workunit.client.0.smithi001.stdout:1/46: getdents d3 0 2024-09-15T22:26:37.057 INFO:tasks.workunit.client.0.smithi001.stdout:1/47: truncate d3/f7 1039514 0 2024-09-15T22:26:37.104 INFO:tasks.workunit.client.0.smithi001.stdout:1/48: read d3/f9 [469742,129802] 0 2024-09-15T22:26:37.104 INFO:tasks.workunit.client.0.smithi001.stdout:1/49: getdents d3/dd 0 2024-09-15T22:26:37.104 INFO:tasks.workunit.client.0.smithi001.stdout:1/50: write d3/f9 [1339230,19066] 0 2024-09-15T22:26:37.104 INFO:tasks.workunit.client.0.smithi001.stdout:1/51: truncate d3/f4 1734308 0 2024-09-15T22:26:37.116 INFO:tasks.workunit.client.0.smithi001.stdout:1/52: symlink d3/le 0 2024-09-15T22:26:37.116 INFO:tasks.workunit.client.0.smithi001.stdout:1/53: truncate d3/f8 1589773 0 2024-09-15T22:26:37.122 INFO:tasks.workunit.client.0.smithi001.stdout:8/33: write f4 [2502788,73330] 0 2024-09-15T22:26:37.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:36 smithi001 ceph-mon[30843]: pgmap v408: 97 pgs: 97 active+clean; 115 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 9.1 MiB/s wr, 1.82k op/s 2024-09-15T22:26:37.127 INFO:tasks.workunit.client.0.smithi001.stdout:1/54: creat d3/dd/ff x:0 0 0 2024-09-15T22:26:37.127 INFO:tasks.workunit.client.0.smithi001.stdout:1/55: rename d3 to d3/dd/d10 22 2024-09-15T22:26:37.129 INFO:tasks.workunit.client.0.smithi001.stdout:4/32: sync 2024-09-15T22:26:37.129 INFO:tasks.workunit.client.0.smithi001.stdout:7/23: sync 2024-09-15T22:26:37.129 INFO:tasks.workunit.client.0.smithi001.stdout:5/9: sync 2024-09-15T22:26:37.129 INFO:tasks.workunit.client.0.smithi001.stdout:5/10: dwrite - no filename 2024-09-15T22:26:37.129 INFO:tasks.workunit.client.0.smithi001.stdout:5/11: dwrite - no filename 2024-09-15T22:26:37.129 INFO:tasks.workunit.client.0.smithi001.stdout:5/12: read - no filename 2024-09-15T22:26:37.133 INFO:tasks.workunit.client.0.smithi001.stdout:9/11: sync 2024-09-15T22:26:37.134 INFO:tasks.workunit.client.0.smithi001.stdout:9/12: chown . 32189 1 2024-09-15T22:26:37.134 INFO:tasks.workunit.client.0.smithi001.stdout:9/13: dread - no filename 2024-09-15T22:26:37.134 INFO:tasks.workunit.client.0.smithi001.stdout:9/14: dread - no filename 2024-09-15T22:26:37.134 INFO:tasks.workunit.client.0.smithi001.stdout:9/15: dread - no filename 2024-09-15T22:26:37.134 INFO:tasks.workunit.client.0.smithi001.stdout:9/16: fdatasync - no filename 2024-09-15T22:26:37.134 INFO:tasks.workunit.client.0.smithi001.stdout:9/17: chown . 19 1 2024-09-15T22:26:37.134 INFO:tasks.workunit.client.0.smithi001.stdout:2/13: sync 2024-09-15T22:26:37.137 INFO:tasks.workunit.client.0.smithi001.stdout:6/24: sync 2024-09-15T22:26:37.137 INFO:tasks.workunit.client.0.smithi001.stdout:3/42: fsync f8 0 2024-09-15T22:26:37.152 INFO:tasks.workunit.client.0.smithi001.stdout:4/33: creat d0/fb x:0 0 0 2024-09-15T22:26:37.152 INFO:tasks.workunit.client.0.smithi001.stdout:4/34: rename d0 to d0/dc 22 2024-09-15T22:26:37.152 INFO:tasks.workunit.client.0.smithi001.stdout:3/43: mkdir da/db 0 2024-09-15T22:26:37.152 INFO:tasks.workunit.client.0.smithi001.stdout:3/44: dread - f8 zero size 2024-09-15T22:26:37.153 INFO:tasks.workunit.client.0.smithi001.stdout:3/45: write f8 [48475,100739] 0 2024-09-15T22:26:37.153 INFO:tasks.workunit.client.0.smithi001.stdout:5/13: mknod c0 0 2024-09-15T22:26:37.153 INFO:tasks.workunit.client.0.smithi001.stdout:9/18: creat f0 x:0 0 0 2024-09-15T22:26:37.163 INFO:tasks.workunit.client.0.smithi001.stdout:3/46: dread f6 [0,4194304] 0 2024-09-15T22:26:37.168 INFO:tasks.workunit.client.0.smithi001.stdout:9/19: link f0 f1 0 2024-09-15T22:26:37.168 INFO:tasks.workunit.client.0.smithi001.stdout:9/20: write f0 [744624,122816] 0 2024-09-15T22:26:37.168 INFO:tasks.workunit.client.0.smithi001.stdout:9/21: chown f1 197 1 2024-09-15T22:26:37.168 INFO:tasks.workunit.client.0.smithi001.stdout:5/14: rename c0 to c1 0 2024-09-15T22:26:37.168 INFO:tasks.workunit.client.0.smithi001.stdout:5/15: rmdir - no directory 2024-09-15T22:26:37.168 INFO:tasks.workunit.client.0.smithi001.stdout:5/16: dread - no filename 2024-09-15T22:26:37.168 INFO:tasks.workunit.client.0.smithi001.stdout:5/17: truncate - no filename 2024-09-15T22:26:37.168 INFO:tasks.workunit.client.0.smithi001.stdout:5/18: truncate - no filename 2024-09-15T22:26:37.171 INFO:tasks.workunit.client.0.smithi001.stdout:9/22: unlink f1 0 2024-09-15T22:26:37.172 INFO:tasks.workunit.client.0.smithi001.stdout:5/19: mknod c2 0 2024-09-15T22:26:37.172 INFO:tasks.workunit.client.0.smithi001.stdout:5/20: dread - no filename 2024-09-15T22:26:37.177 INFO:tasks.workunit.client.0.smithi001.stdout:5/21: stat c1 0 2024-09-15T22:26:37.177 INFO:tasks.workunit.client.0.smithi001.stdout:5/22: write - no filename 2024-09-15T22:26:37.183 INFO:tasks.workunit.client.0.smithi001.stdout:5/23: mkdir d3 0 2024-09-15T22:26:37.187 INFO:tasks.workunit.client.0.smithi001.stdout:5/24: symlink d3/l4 0 2024-09-15T22:26:37.187 INFO:tasks.workunit.client.0.smithi001.stdout:5/25: dwrite - no filename 2024-09-15T22:26:37.187 INFO:tasks.workunit.client.0.smithi001.stdout:5/26: read - no filename 2024-09-15T22:26:37.188 INFO:tasks.workunit.client.0.smithi001.stdout:2/14: write f1 [3789119,127097] 0 2024-09-15T22:26:37.191 INFO:tasks.workunit.client.0.smithi001.stdout:5/27: link c2 d3/c5 0 2024-09-15T22:26:37.191 INFO:tasks.workunit.client.0.smithi001.stdout:5/28: truncate - no filename 2024-09-15T22:26:37.191 INFO:tasks.workunit.client.0.smithi001.stdout:5/29: read - no filename 2024-09-15T22:26:37.191 INFO:tasks.workunit.client.0.smithi001.stdout:5/30: write - no filename 2024-09-15T22:26:37.194 INFO:tasks.workunit.client.0.smithi001.stdout:2/15: mkdir d2/d5 0 2024-09-15T22:26:37.195 INFO:tasks.workunit.client.0.smithi001.stdout:5/31: mkdir d3/d6 0 2024-09-15T22:26:37.195 INFO:tasks.workunit.client.0.smithi001.stdout:2/16: write f1 [1042136,55547] 0 2024-09-15T22:26:37.196 INFO:tasks.workunit.client.0.smithi001.stdout:5/32: creat d3/d6/f7 x:0 0 0 2024-09-15T22:26:37.198 INFO:tasks.workunit.client.0.smithi001.stdout:5/33: creat d3/d6/f8 x:0 0 0 2024-09-15T22:26:37.198 INFO:tasks.workunit.client.0.smithi001.stdout:5/34: fdatasync d3/d6/f8 0 2024-09-15T22:26:37.206 INFO:tasks.workunit.client.0.smithi001.stdout:5/35: creat d3/d6/f9 x:0 0 0 2024-09-15T22:26:37.206 INFO:tasks.workunit.client.0.smithi001.stdout:5/36: chown c2 992108147 1 2024-09-15T22:26:37.211 INFO:tasks.workunit.client.0.smithi001.stdout:5/37: symlink d3/d6/la 0 2024-09-15T22:26:37.216 INFO:tasks.workunit.client.0.smithi001.stdout:5/38: symlink d3/d6/lb 0 2024-09-15T22:26:37.217 INFO:tasks.workunit.client.0.smithi001.stdout:5/39: fdatasync d3/d6/f7 0 2024-09-15T22:26:37.217 INFO:tasks.workunit.client.0.smithi001.stdout:5/40: dread - d3/d6/f9 zero size 2024-09-15T22:26:37.217 INFO:tasks.workunit.client.0.smithi001.stdout:5/41: write d3/d6/f7 [378265,10115] 0 2024-09-15T22:26:37.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:36 smithi012 ceph-mon[34883]: pgmap v408: 97 pgs: 97 active+clean; 115 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 9.1 MiB/s wr, 1.82k op/s 2024-09-15T22:26:37.283 INFO:tasks.workunit.client.0.smithi001.stdout:4/35: dread d0/f7 [0,4194304] 0 2024-09-15T22:26:37.283 INFO:tasks.workunit.client.0.smithi001.stdout:4/36: chown d0/fb 10 1 2024-09-15T22:26:37.290 INFO:tasks.workunit.client.0.smithi001.stdout:4/37: read d0/f8 [62500,58575] 0 2024-09-15T22:26:37.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:36 smithi098 ceph-mon[35514]: pgmap v408: 97 pgs: 97 active+clean; 115 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 9.1 MiB/s wr, 1.82k op/s 2024-09-15T22:26:37.330 INFO:tasks.workunit.client.0.smithi001.stdout:1/56: dread d3/f8 [0,4194304] 0 2024-09-15T22:26:37.331 INFO:tasks.workunit.client.0.smithi001.stdout:1/57: write d3/f8 [2588177,123107] 0 2024-09-15T22:26:37.331 INFO:tasks.workunit.client.0.smithi001.stdout:1/58: fsync d3/f5 0 2024-09-15T22:26:37.343 INFO:tasks.workunit.client.0.smithi001.stdout:3/47: dwrite f2 [0,4194304] 0 2024-09-15T22:26:37.351 INFO:tasks.workunit.client.0.smithi001.stdout:3/48: mknod da/db/cc 0 2024-09-15T22:26:37.353 INFO:tasks.workunit.client.0.smithi001.stdout:3/49: mknod da/db/cd 0 2024-09-15T22:26:37.353 INFO:tasks.workunit.client.0.smithi001.stdout:3/50: write f7 [945679,111697] 0 2024-09-15T22:26:37.354 INFO:tasks.workunit.client.0.smithi001.stdout:3/51: creat da/fe x:0 0 0 2024-09-15T22:26:37.359 INFO:tasks.workunit.client.0.smithi001.stdout:3/52: creat da/db/ff x:0 0 0 2024-09-15T22:26:37.360 INFO:tasks.workunit.client.0.smithi001.stdout:4/38: dwrite d0/fb [0,4194304] 0 2024-09-15T22:26:37.362 INFO:tasks.workunit.client.0.smithi001.stdout:7/24: dwrite d0/f4 [0,4194304] 0 2024-09-15T22:26:37.365 INFO:tasks.workunit.client.0.smithi001.stdout:4/39: creat d0/fd x:0 0 0 2024-09-15T22:26:37.377 INFO:tasks.workunit.client.0.smithi001.stdout:5/42: fdatasync d3/d6/f7 0 2024-09-15T22:26:37.377 INFO:tasks.workunit.client.0.smithi001.stdout:5/43: truncate d3/d6/f7 942593 0 2024-09-15T22:26:37.377 INFO:tasks.workunit.client.0.smithi001.stdout:2/17: dwrite d2/f4 [0,4194304] 0 2024-09-15T22:26:37.377 INFO:tasks.workunit.client.0.smithi001.stdout:2/18: readlink - no filename 2024-09-15T22:26:37.377 INFO:tasks.workunit.client.0.smithi001.stdout:2/19: fdatasync d2/f4 0 2024-09-15T22:26:37.377 INFO:tasks.workunit.client.0.smithi001.stdout:2/20: chown d2/d5 3303 1 2024-09-15T22:26:37.377 INFO:tasks.workunit.client.0.smithi001.stdout:7/25: symlink d0/d7/l9 0 2024-09-15T22:26:37.377 INFO:tasks.workunit.client.0.smithi001.stdout:4/40: creat d0/fe x:0 0 0 2024-09-15T22:26:37.377 INFO:tasks.workunit.client.0.smithi001.stdout:4/41: rename d0 to d0/df 22 2024-09-15T22:26:37.377 INFO:tasks.workunit.client.0.smithi001.stdout:4/42: symlink d0/l10 0 2024-09-15T22:26:37.377 INFO:tasks.workunit.client.0.smithi001.stdout:4/43: truncate d0/f8 2053403 0 2024-09-15T22:26:37.377 INFO:tasks.workunit.client.0.smithi001.stdout:4/44: write d0/f9 [342492,75100] 0 2024-09-15T22:26:37.378 INFO:tasks.workunit.client.0.smithi001.stdout:4/45: creat d0/f11 x:0 0 0 2024-09-15T22:26:37.381 INFO:tasks.workunit.client.0.smithi001.stdout:4/46: mknod d0/c12 0 2024-09-15T22:26:37.381 INFO:tasks.workunit.client.0.smithi001.stdout:4/47: write d0/f9 [629319,34033] 0 2024-09-15T22:26:37.387 INFO:tasks.workunit.client.0.smithi001.stdout:4/48: rmdir d0 39 2024-09-15T22:26:37.398 INFO:tasks.workunit.client.0.smithi001.stdout:8/34: dwrite f5 [0,4194304] 0 2024-09-15T22:26:37.399 INFO:tasks.workunit.client.0.smithi001.stdout:8/35: truncate f5 4947830 0 2024-09-15T22:26:37.399 INFO:tasks.workunit.client.0.smithi001.stdout:8/36: rmdir - no directory 2024-09-15T22:26:37.400 INFO:tasks.workunit.client.0.smithi001.stdout:8/37: fdatasync f5 0 2024-09-15T22:26:37.412 INFO:tasks.workunit.client.0.smithi001.stdout:5/44: write d3/d6/f7 [807423,41348] 0 2024-09-15T22:26:37.418 INFO:tasks.workunit.client.0.smithi001.stdout:9/23: getdents . 0 2024-09-15T22:26:37.419 INFO:tasks.workunit.client.0.smithi001.stdout:5/45: creat d3/fc x:0 0 0 2024-09-15T22:26:37.419 INFO:tasks.workunit.client.0.smithi001.stdout:9/24: write f0 [1606323,127600] 0 2024-09-15T22:26:37.419 INFO:tasks.workunit.client.0.smithi001.stdout:9/25: chown f0 6654295 1 2024-09-15T22:26:37.424 INFO:tasks.workunit.client.0.smithi001.stdout:7/26: write d0/f6 [310552,68132] 0 2024-09-15T22:26:37.424 INFO:tasks.workunit.client.0.smithi001.stdout:7/27: stat d0/l5 0 2024-09-15T22:26:37.434 INFO:tasks.workunit.client.0.smithi001.stdout:7/28: rename d0/d7/l9 to d0/d7/la 0 2024-09-15T22:26:37.436 INFO:tasks.workunit.client.0.smithi001.stdout:7/29: symlink d0/d7/lb 0 2024-09-15T22:26:37.467 INFO:tasks.workunit.client.0.smithi001.stdout:3/53: dwrite f2 [0,4194304] 0 2024-09-15T22:26:37.468 INFO:tasks.workunit.client.0.smithi001.stdout:3/54: chown f6 297065522 1 2024-09-15T22:26:37.468 INFO:tasks.workunit.client.0.smithi001.stdout:1/59: dread d3/f7 [0,4194304] 0 2024-09-15T22:26:37.476 INFO:tasks.workunit.client.0.smithi001.stdout:5/46: dread d3/d6/f7 [0,4194304] 0 2024-09-15T22:26:37.483 INFO:tasks.workunit.client.0.smithi001.stdout:1/60: truncate d3/f8 1830487 0 2024-09-15T22:26:37.498 INFO:tasks.workunit.client.0.smithi001.stdout:1/61: creat d3/f11 x:0 0 0 2024-09-15T22:26:37.518 INFO:tasks.workunit.client.0.smithi001.stdout:8/38: dwrite f5 [0,4194304] 0 2024-09-15T22:26:37.518 INFO:tasks.workunit.client.0.smithi001.stdout:8/39: readlink l1 0 2024-09-15T22:26:37.524 INFO:tasks.workunit.client.0.smithi001.stdout:2/21: dwrite d2/f4 [0,4194304] 0 2024-09-15T22:26:37.524 INFO:tasks.workunit.client.0.smithi001.stdout:5/47: dwrite d3/d6/f7 [0,4194304] 0 2024-09-15T22:26:37.526 INFO:tasks.workunit.client.0.smithi001.stdout:9/26: dread f0 [0,4194304] 0 2024-09-15T22:26:37.532 INFO:tasks.workunit.client.0.smithi001.stdout:1/62: dread d3/f8 [0,4194304] 0 2024-09-15T22:26:37.533 INFO:tasks.workunit.client.0.smithi001.stdout:1/63: write d3/f11 [879441,89484] 0 2024-09-15T22:26:37.538 INFO:tasks.workunit.client.0.smithi001.stdout:9/27: dread f0 [0,4194304] 0 2024-09-15T22:26:37.538 INFO:tasks.workunit.client.0.smithi001.stdout:9/28: getdents . 0 2024-09-15T22:26:37.538 INFO:tasks.workunit.client.0.smithi001.stdout:9/29: fsync f0 0 2024-09-15T22:26:37.546 INFO:tasks.workunit.client.0.smithi001.stdout:2/22: dread d2/f4 [0,4194304] 0 2024-09-15T22:26:37.548 INFO:tasks.workunit.client.0.smithi001.stdout:3/55: dwrite da/db/ff [0,4194304] 0 2024-09-15T22:26:37.549 INFO:tasks.workunit.client.0.smithi001.stdout:7/30: dwrite d0/f6 [0,4194304] 0 2024-09-15T22:26:37.558 INFO:tasks.workunit.client.0.smithi001.stdout:4/49: dwrite d0/fd [0,4194304] 0 2024-09-15T22:26:37.579 INFO:tasks.workunit.client.0.smithi001.stdout:8/40: creat f7 x:0 0 0 2024-09-15T22:26:37.579 INFO:tasks.workunit.client.0.smithi001.stdout:8/41: stat l1 0 2024-09-15T22:26:37.597 INFO:tasks.workunit.client.0.smithi001.stdout:9/30: dwrite f0 [0,4194304] 0 2024-09-15T22:26:37.638 INFO:tasks.workunit.client.0.smithi001.stdout:5/48: symlink d3/ld 0 2024-09-15T22:26:37.645 INFO:tasks.workunit.client.0.smithi001.stdout:1/64: unlink d3/le 0 2024-09-15T22:26:37.661 INFO:tasks.workunit.client.0.smithi001.stdout:2/23: symlink d2/l6 0 2024-09-15T22:26:37.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:37.664+0000 7f3059600640 1 -- 172.21.15.1:0/2397797838 <== mds.0 v2:172.21.15.98:6838/2831161859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c5975f0b80 con 0x55c59770d820 2024-09-15T22:26:37.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:37.664+0000 7f3059600640 10 client.25198 handle_command_reply: tid=0 2024-09-15T22:26:37.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:37.664+0000 7f3079a6a740 1 client.25198 shutdown 2024-09-15T22:26:37.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:37.664+0000 7f3079a6a740 1 -- 172.21.15.1:0/2397797838 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c597684090 msgr2=0x55c59769b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:37.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:37.664+0000 7f3079a6a740 1 --2- 172.21.15.1:0/2397797838 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c597684090 0x55c59769b390 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3060000f80 tx=0x7f306001c040 comp rx=0 tx=0).stop 2024-09-15T22:26:37.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:37.664+0000 7f3079a6a740 1 -- 172.21.15.1:0/2397797838 shutdown_connections 2024-09-15T22:26:37.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:37.664+0000 7f3079a6a740 1 --2- 172.21.15.1:0/2397797838 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55c59770d820 0x55c59770fc40 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:37.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:37.664+0000 7f3079a6a740 1 --2- 172.21.15.1:0/2397797838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c597689a60 0x55c59769c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:37.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:37.664+0000 7f3079a6a740 1 --2- 172.21.15.1:0/2397797838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5976849d0 0x55c59769b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:37.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:37.664+0000 7f3059600640 0 client.25198 ms_handle_reset on v2:172.21.15.98:6838/2831161859 2024-09-15T22:26:37.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:37.664+0000 7f3079a6a740 1 --2- 172.21.15.1:0/2397797838 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c597684090 0x55c59769b390 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:37.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:37.664+0000 7f3079a6a740 1 -- 172.21.15.1:0/2397797838 >> 172.21.15.1:0/2397797838 conn(0x55c59767f700 msgr2=0x55c59767e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:37.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:37.665+0000 7f3079a6a740 1 -- 172.21.15.1:0/2397797838 shutdown_connections 2024-09-15T22:26:37.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:37.665+0000 7f3079a6a740 1 -- 172.21.15.1:0/2397797838 wait complete. 2024-09-15T22:26:37.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:37.665+0000 7f3079a6a740 20 client.25198 trim_cache size 0 max 16384 2024-09-15T22:26:37.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-15T22:26:37.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-15T22:26:37.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-15T22:26:37.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-15T22:26:37.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:37.666+0000 7f3076c00640 1 -- 172.21.15.1:0/2741331314 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f30540a3240 msgr2=0x7f30540a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:37.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:37.666+0000 7f3076c00640 1 --2- 172.21.15.1:0/2741331314 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f30540a3240 0x7f30540a5700 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f30680b88d0 tx=0x7f30680b8040 comp rx=0 tx=0).stop 2024-09-15T22:26:37.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:37.666+0000 7f3076c00640 1 -- 172.21.15.1:0/2741331314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3070103d60 msgr2=0x7f307019a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:37.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:37.666+0000 7f3076c00640 1 --2- 172.21.15.1:0/2741331314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3070103d60 0x7f307019a080 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3068031440 tx=0x7f3068032ce0 comp rx=0 tx=0).stop 2024-09-15T22:26:37.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:37.666+0000 7f3076c00640 1 -- 172.21.15.1:0/2741331314 shutdown_connections 2024-09-15T22:26:37.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:37.666+0000 7f3076c00640 1 --2- 172.21.15.1:0/2741331314 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f30540a3240 0x7f30540a5700 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:37.666+0000 7f3076c00640 1 --2- 172.21.15.1:0/2741331314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3070105910 0x7f30701a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:37.666+0000 7f3076c00640 1 --2- 172.21.15.1:0/2741331314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3070104f50 0x7f307019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:37.666+0000 7f3076c00640 1 --2- 172.21.15.1:0/2741331314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3070103d60 0x7f307019a080 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:37.666+0000 7f3076c00640 1 -- 172.21.15.1:0/2741331314 >> 172.21.15.1:0/2741331314 conn(0x7f30700ff4e0 msgr2=0x7f3070108370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:37.666+0000 7f3076c00640 1 -- 172.21.15.1:0/2741331314 shutdown_connections 2024-09-15T22:26:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:37.666+0000 7f3076c00640 1 -- 172.21.15.1:0/2741331314 wait complete. 2024-09-15T22:26:37.676 INFO:tasks.workunit.client.0.smithi001.stdout:3/56: rmdir da/db 39 2024-09-15T22:26:37.678 INFO:tasks.workunit.client.0.smithi001.stdout:7/31: link d0/c8 d0/d7/cc 0 2024-09-15T22:26:37.692 INFO:tasks.workunit.client.0.smithi001.stdout:7/32: write d0/f4 [403618,92673] 0 2024-09-15T22:26:37.717 INFO:tasks.workunit.client.0.smithi001.stdout:4/50: creat d0/f13 x:0 0 0 2024-09-15T22:26:37.717 INFO:tasks.workunit.client.0.smithi001.stdout:0/43: sync 2024-09-15T22:26:37.717 INFO:tasks.workunit.client.0.smithi001.stdout:6/25: sync 2024-09-15T22:26:37.720 INFO:tasks.workunit.client.0.smithi001.stdout:9/31: mknod c2 0 2024-09-15T22:26:37.722 INFO:tasks.workunit.client.0.smithi001.stdout:5/49: link d3/fc d3/d6/fe 0 2024-09-15T22:26:37.724 INFO:tasks.workunit.client.0.smithi001.stdout:1/65: unlink l2 0 2024-09-15T22:26:37.724 INFO:tasks.workunit.client.0.smithi001.stdout:1/66: chown d3/lc 130245 1 2024-09-15T22:26:37.729 INFO:tasks.workunit.client.0.smithi001.stdout:2/24: symlink d2/l7 0 2024-09-15T22:26:37.729 INFO:tasks.workunit.client.0.smithi001.stdout:3/57: symlink da/db/l10 0 2024-09-15T22:26:37.730 INFO:tasks.workunit.client.0.smithi001.stdout:3/58: write f6 [1603939,127270] 0 2024-09-15T22:26:37.731 INFO:tasks.workunit.client.0.smithi001.stdout:4/51: mkdir d0/d14 0 2024-09-15T22:26:37.732 INFO:tasks.workunit.client.0.smithi001.stdout:0/44: creat d0/dd/ff x:0 0 0 2024-09-15T22:26:37.732 INFO:tasks.workunit.client.0.smithi001.stdout:0/45: truncate d0/f3 709429 0 2024-09-15T22:26:37.736 INFO:tasks.workunit.client.0.smithi001.stdout:8/42: truncate f5 3594516 0 2024-09-15T22:26:37.739 INFO:tasks.workunit.client.0.smithi001.stdout:5/50: symlink d3/lf 0 2024-09-15T22:26:37.739 INFO:tasks.workunit.client.0.smithi001.stdout:1/67: mkdir d3/d12 0 2024-09-15T22:26:37.740 INFO:tasks.workunit.client.0.smithi001.stdout:6/26: dread d0/f5 [0,4194304] 0 2024-09-15T22:26:37.740 INFO:tasks.workunit.client.0.smithi001.stdout:6/27: truncate d0/f5 692225 0 2024-09-15T22:26:37.742 INFO:tasks.workunit.client.0.smithi001.stdout:3/59: creat da/f11 x:0 0 0 2024-09-15T22:26:37.743 INFO:tasks.workunit.client.0.smithi001.stdout:0/46: rmdir d0/dd 39 2024-09-15T22:26:37.743 INFO:tasks.workunit.client.0.smithi001.stdout:0/47: chown d0/f7 6215 1 2024-09-15T22:26:37.744 INFO:tasks.workunit.client.0.smithi001.stdout:5/51: mknod d3/d6/c10 0 2024-09-15T22:26:37.744 INFO:tasks.workunit.client.0.smithi001.stdout:2/25: truncate f1 1396157 0 2024-09-15T22:26:37.745 INFO:tasks.workunit.client.0.smithi001.stdout:1/68: creat d3/dd/f13 x:0 0 0 2024-09-15T22:26:37.747 INFO:tasks.workunit.client.0.smithi001.stdout:6/28: symlink d0/d7/l8 0 2024-09-15T22:26:37.751 INFO:tasks.workunit.client.0.smithi001.stdout:2/26: creat d2/d5/f8 x:0 0 0 2024-09-15T22:26:37.751 INFO:tasks.workunit.client.0.smithi001.stdout:2/27: fdatasync d2/d5/f8 0 2024-09-15T22:26:37.752 INFO:tasks.workunit.client.0.smithi001.stdout:2/28: chown d2/d5/f8 19853993 1 2024-09-15T22:26:37.752 INFO:tasks.workunit.client.0.smithi001.stdout:1/69: read d3/f4 [214653,125990] 0 2024-09-15T22:26:37.752 INFO:tasks.workunit.client.0.smithi001.stdout:8/43: dread f4 [0,4194304] 0 2024-09-15T22:26:37.753 INFO:tasks.workunit.client.0.smithi001.stdout:3/60: unlink da/db/l10 0 2024-09-15T22:26:37.754 INFO:tasks.workunit.client.0.smithi001.stdout:2/29: creat d2/f9 x:0 0 0 2024-09-15T22:26:37.754 INFO:tasks.workunit.client.0.smithi001.stdout:2/30: fsync d2/f4 0 2024-09-15T22:26:37.754 INFO:tasks.workunit.client.0.smithi001.stdout:2/31: write d2/d5/f8 [381875,73423] 0 2024-09-15T22:26:37.757 INFO:tasks.workunit.client.0.smithi001.stdout:1/70: mkdir d3/dd/d14 0 2024-09-15T22:26:37.758 INFO:tasks.workunit.client.0.smithi001.stdout:3/61: creat da/f12 x:0 0 0 2024-09-15T22:26:37.759 INFO:tasks.workunit.client.0.smithi001.stdout:8/44: creat f8 x:0 0 0 2024-09-15T22:26:37.759 INFO:tasks.workunit.client.0.smithi001.stdout:8/45: stat f8 0 2024-09-15T22:26:37.760 INFO:tasks.workunit.client.0.smithi001.stdout:2/32: unlink d2/l6 0 2024-09-15T22:26:37.761 INFO:tasks.workunit.client.0.smithi001.stdout:3/62: unlink da/f11 0 2024-09-15T22:26:37.764 INFO:tasks.workunit.client.0.smithi001.stdout:0/48: dread d0/f2 [0,4194304] 0 2024-09-15T22:26:37.765 INFO:tasks.workunit.client.0.smithi001.stdout:2/33: creat d2/d5/fa x:0 0 0 2024-09-15T22:26:37.765 INFO:tasks.workunit.client.0.smithi001.stdout:2/34: chown d2/f4 24974 1 2024-09-15T22:26:37.765 INFO:tasks.workunit.client.0.smithi001.stdout:9/32: dread f0 [0,4194304] 0 2024-09-15T22:26:37.765 INFO:tasks.workunit.client.0.smithi001.stdout:2/35: fdatasync d2/f3 0 2024-09-15T22:26:37.768 INFO:tasks.workunit.client.0.smithi001.stdout:0/49: rename d0/fe to d0/d9/db/f10 0 2024-09-15T22:26:37.769 INFO:tasks.workunit.client.0.smithi001.stdout:0/50: chown d0 18970 1 2024-09-15T22:26:37.769 INFO:tasks.workunit.client.0.smithi001.stdout:0/51: chown d0/f2 107291 1 2024-09-15T22:26:37.769 INFO:tasks.workunit.client.0.smithi001.stdout:0/52: fdatasync d0/d9/db/f10 0 2024-09-15T22:26:37.770 INFO:tasks.workunit.client.0.smithi001.stdout:0/53: truncate d0/f8 1634147 0 2024-09-15T22:26:37.770 INFO:tasks.workunit.client.0.smithi001.stdout:0/54: chown d0/f7 5 1 2024-09-15T22:26:37.781 INFO:tasks.workunit.client.0.smithi001.stdout:1/71: dread d3/f7 [0,4194304] 0 2024-09-15T22:26:37.782 INFO:tasks.workunit.client.0.smithi001.stdout:1/72: rename d3 to d3/d15 22 2024-09-15T22:26:37.782 INFO:tasks.workunit.client.0.smithi001.stdout:1/73: dread - d3/dd/f13 zero size 2024-09-15T22:26:37.782 INFO:tasks.workunit.client.0.smithi001.stdout:1/74: truncate d3/f11 1092834 0 2024-09-15T22:26:37.790 INFO:tasks.workunit.client.0.smithi001.stdout:1/75: truncate d3/f9 1170769 0 2024-09-15T22:26:37.790 INFO:tasks.workunit.client.0.smithi001.stdout:1/76: chown d3/f7 1708508313 1 2024-09-15T22:26:37.790 INFO:tasks.workunit.client.0.smithi001.stdout:1/77: chown d3/dd/f13 881828943 1 2024-09-15T22:26:37.794 INFO:tasks.workunit.client.0.smithi001.stdout:5/52: dwrite d3/fc [0,4194304] 0 2024-09-15T22:26:37.794 INFO:tasks.workunit.client.0.smithi001.stdout:5/53: read - d3/d6/f8 zero size 2024-09-15T22:26:37.794 INFO:tasks.workunit.client.0.smithi001.stdout:4/52: dwrite d0/f13 [0,4194304] 0 2024-09-15T22:26:37.800 INFO:tasks.workunit.client.0.smithi001.stdout:5/54: symlink d3/l11 0 2024-09-15T22:26:37.800 INFO:tasks.workunit.client.0.smithi001.stdout:5/55: rename d3 to d3/d6/d12 22 2024-09-15T22:26:37.800 INFO:tasks.workunit.client.0.smithi001.stdout:4/53: rmdir d0/d14 0 2024-09-15T22:26:37.800 INFO:tasks.workunit.client.0.smithi001.stdout:4/54: readlink d0/l3 0 2024-09-15T22:26:37.800 INFO:tasks.workunit.client.0.smithi001.stdout:4/55: readlink d0/l3 0 2024-09-15T22:26:37.801 INFO:tasks.workunit.client.0.smithi001.stdout:4/56: rename d0/ca to d0/c15 0 2024-09-15T22:26:37.832 INFO:tasks.workunit.client.0.smithi001.stdout:7/33: dwrite d0/f6 [4194304,4194304] 0 2024-09-15T22:26:37.833 INFO:tasks.workunit.client.0.smithi001.stdout:1/78: write d3/f5 [1446659,58187] 0 2024-09-15T22:26:37.833 INFO:tasks.workunit.client.0.smithi001.stdout:1/79: dread - d3/dd/ff zero size 2024-09-15T22:26:37.833 INFO:tasks.workunit.client.0.smithi001.stdout:1/80: truncate d3/f9 2212627 0 2024-09-15T22:26:37.855 INFO:tasks.workunit.client.0.smithi001.stdout:3/63: dwrite f7 [0,4194304] 0 2024-09-15T22:26:37.855 INFO:tasks.workunit.client.0.smithi001.stdout:0/55: dwrite d0/f3 [0,4194304] 0 2024-09-15T22:26:37.856 INFO:tasks.workunit.client.0.smithi001.stdout:5/56: dwrite d3/d6/fe [0,4194304] 0 2024-09-15T22:26:37.859 INFO:tasks.workunit.client.0.smithi001.stdout:9/33: dwrite f0 [0,4194304] 0 2024-09-15T22:26:37.866 INFO:tasks.workunit.client.0.smithi001.stdout:2/36: dwrite f1 [0,4194304] 0 2024-09-15T22:26:37.867 INFO:tasks.workunit.client.0.smithi001.stdout:2/37: read - d2/f9 zero size 2024-09-15T22:26:37.867 INFO:tasks.workunit.client.0.smithi001.stdout:2/38: readlink d2/l7 0 2024-09-15T22:26:37.867 INFO:tasks.workunit.client.0.smithi001.stdout:2/39: fdatasync d2/d5/fa 0 2024-09-15T22:26:37.892 INFO:tasks.workunit.client.0.smithi001.stdout:4/57: dwrite d0/fd [0,4194304] 0 2024-09-15T22:26:37.892 INFO:tasks.workunit.client.0.smithi001.stdout:4/58: dread - d0/f11 zero size 2024-09-15T22:26:37.893 INFO:tasks.workunit.client.0.smithi001.stdout:1/81: dwrite d3/f9 [0,4194304] 0 2024-09-15T22:26:37.893 INFO:tasks.workunit.client.0.smithi001.stdout:3/64: dwrite f5 [0,4194304] 0 2024-09-15T22:26:37.906 INFO:tasks.workunit.client.0.smithi001.stdout:4/59: write d0/fb [1165192,30711] 0 2024-09-15T22:26:37.913 INFO:tasks.workunit.client.0.smithi001.stdout:7/34: rmdir d0/d7 39 2024-09-15T22:26:38.009 INFO:tasks.workunit.client.0.smithi001.stdout:0/56: mknod d0/d6/c11 0 2024-09-15T22:26:38.021 INFO:tasks.workunit.client.0.smithi001.stdout:5/57: mknod d3/d6/c13 0 2024-09-15T22:26:38.021 INFO:tasks.workunit.client.0.smithi001.stdout:9/34: mknod c3 0 2024-09-15T22:26:38.024 INFO:tasks.workunit.client.0.smithi001.stdout:2/40: unlink d2/f4 0 2024-09-15T22:26:38.024 INFO:tasks.workunit.client.0.smithi001.stdout:2/41: write d2/f3 [92704,105604] 0 2024-09-15T22:26:38.046 INFO:tasks.workunit.client.0.smithi001.stdout:1/82: link l1 d3/d12/l16 0 2024-09-15T22:26:38.046 INFO:tasks.workunit.client.0.smithi001.stdout:1/83: chown d3 1008724630 1 2024-09-15T22:26:38.047 INFO:tasks.workunit.client.0.smithi001.stdout:4/60: mkdir d0/d16 0 2024-09-15T22:26:38.048 INFO:tasks.workunit.client.0.smithi001.stdout:4/61: fdatasync d0/f13 0 2024-09-15T22:26:38.049 INFO:tasks.workunit.client.0.smithi001.stdout:7/35: unlink d0/c8 0 2024-09-15T22:26:38.049 INFO:tasks.workunit.client.0.smithi001.stdout:7/36: readlink d0/d7/lb 0 2024-09-15T22:26:38.050 INFO:tasks.workunit.client.0.smithi001.stdout:5/58: dwrite d3/d6/fe [0,4194304] 0 2024-09-15T22:26:38.050 INFO:tasks.workunit.client.0.smithi001.stdout:5/59: fdatasync d3/d6/fe 0 2024-09-15T22:26:38.054 INFO:tasks.workunit.client.0.smithi001.stdout:9/35: creat f4 x:0 0 0 2024-09-15T22:26:38.054 INFO:tasks.workunit.client.0.smithi001.stdout:9/36: write f4 [55661,57343] 0 2024-09-15T22:26:38.054 INFO:tasks.workunit.client.0.smithi001.stdout:9/37: fdatasync f0 0 2024-09-15T22:26:38.054 INFO:tasks.workunit.client.0.smithi001.stdout:9/38: rmdir - no directory 2024-09-15T22:26:38.055 INFO:tasks.workunit.client.0.smithi001.stdout:2/42: symlink d2/d5/lb 0 2024-09-15T22:26:38.055 INFO:tasks.workunit.client.0.smithi001.stdout:3/65: truncate f5 2427383 0 2024-09-15T22:26:38.056 INFO:tasks.workunit.client.0.smithi001.stdout:3/66: fdatasync da/db/ff 0 2024-09-15T22:26:38.062 INFO:tasks.workunit.client.0.smithi001.stdout:5/60: link d3/d6/lb d3/d6/l14 0 2024-09-15T22:26:38.062 INFO:tasks.workunit.client.0.smithi001.stdout:5/61: read - d3/d6/f9 zero size 2024-09-15T22:26:38.063 INFO:tasks.workunit.client.0.smithi001.stdout:2/43: rename d2/d5/lb to d2/lc 0 2024-09-15T22:26:38.063 INFO:tasks.workunit.client.0.smithi001.stdout:7/37: creat d0/d7/fd x:0 0 0 2024-09-15T22:26:38.063 INFO:tasks.workunit.client.0.smithi001.stdout:4/62: dread d0/f13 [0,4194304] 0 2024-09-15T22:26:38.063 INFO:tasks.workunit.client.0.smithi001.stdout:4/63: chown d0/fe 175 1 2024-09-15T22:26:38.063 INFO:tasks.workunit.client.0.smithi001.stdout:4/64: write d0/f7 [1314861,96043] 0 2024-09-15T22:26:38.063 INFO:tasks.workunit.client.0.smithi001.stdout:4/65: chown d0/fb 3460758 1 2024-09-15T22:26:38.066 INFO:tasks.workunit.client.0.smithi001.stdout:3/67: getdents da/db 0 2024-09-15T22:26:38.071 INFO:tasks.workunit.client.0.smithi001.stdout:2/44: creat d2/d5/fd x:0 0 0 2024-09-15T22:26:38.071 INFO:tasks.workunit.client.0.smithi001.stdout:2/45: chown d2 3 1 2024-09-15T22:26:38.072 INFO:tasks.workunit.client.0.smithi001.stdout:4/66: symlink d0/l17 0 2024-09-15T22:26:38.074 INFO:tasks.workunit.client.0.smithi001.stdout:3/68: creat da/f13 x:0 0 0 2024-09-15T22:26:38.075 INFO:tasks.workunit.client.0.smithi001.stdout:2/46: rename d2/d5/f8 to d2/d5/fe 0 2024-09-15T22:26:38.076 INFO:tasks.workunit.client.0.smithi001.stdout:2/47: read d2/f3 [41145,35957] 0 2024-09-15T22:26:38.077 INFO:tasks.workunit.client.0.smithi001.stdout:4/67: rename d0/l10 to d0/l18 0 2024-09-15T22:26:38.077 INFO:tasks.workunit.client.0.smithi001.stdout:4/68: chown d0/f9 54950 1 2024-09-15T22:26:38.077 INFO:tasks.workunit.client.0.smithi001.stdout:4/69: write d0/f7 [2427586,59697] 0 2024-09-15T22:26:38.080 INFO:tasks.workunit.client.0.smithi001.stdout:7/38: dread d0/f4 [0,4194304] 0 2024-09-15T22:26:38.082 INFO:tasks.workunit.client.0.smithi001.stdout:3/69: mkdir da/d14 0 2024-09-15T22:26:38.082 INFO:tasks.workunit.client.0.smithi001.stdout:2/48: mkdir d2/df 0 2024-09-15T22:26:38.082 INFO:tasks.workunit.client.0.smithi001.stdout:3/70: stat f2 0 2024-09-15T22:26:38.082 INFO:tasks.workunit.client.0.smithi001.stdout:2/49: stat d2/f3 0 2024-09-15T22:26:38.082 INFO:tasks.workunit.client.0.smithi001.stdout:2/50: truncate d2/d5/fe 817624 0 2024-09-15T22:26:38.082 INFO:tasks.workunit.client.0.smithi001.stdout:2/51: write d2/d5/fe [1593786,97490] 0 2024-09-15T22:26:38.084 INFO:tasks.workunit.client.0.smithi001.stdout:0/57: dwrite d0/f4 [0,4194304] 0 2024-09-15T22:26:38.085 INFO:tasks.workunit.client.0.smithi001.stdout:4/70: creat d0/d16/f19 x:0 0 0 2024-09-15T22:26:38.086 INFO:tasks.workunit.client.0.smithi001.stdout:7/39: symlink d0/le 0 2024-09-15T22:26:38.089 INFO:tasks.workunit.client.0.smithi001.stdout:3/71: link c9 da/d14/c15 0 2024-09-15T22:26:38.090 INFO:tasks.workunit.client.0.smithi001.stdout:5/62: write d3/fc [4024114,78889] 0 2024-09-15T22:26:38.090 INFO:tasks.workunit.client.0.smithi001.stdout:5/63: write d3/d6/f8 [230537,118994] 0 2024-09-15T22:26:38.092 INFO:tasks.workunit.client.0.smithi001.stdout:2/52: link d2/f3 d2/f10 0 2024-09-15T22:26:38.093 INFO:tasks.workunit.client.0.smithi001.stdout:4/71: creat d0/f1a x:0 0 0 2024-09-15T22:26:38.093 INFO:tasks.workunit.client.0.smithi001.stdout:1/84: dwrite d3/f4 [0,4194304] 0 2024-09-15T22:26:38.094 INFO:tasks.workunit.client.0.smithi001.stdout:5/64: symlink d3/l15 0 2024-09-15T22:26:38.094 INFO:tasks.workunit.client.0.smithi001.stdout:5/65: fdatasync d3/d6/f7 0 2024-09-15T22:26:38.095 INFO:tasks.workunit.client.0.smithi001.stdout:2/53: getdents d2/d5 0 2024-09-15T22:26:38.099 INFO:tasks.workunit.client.0.smithi001.stdout:4/72: rmdir d0 39 2024-09-15T22:26:38.101 INFO:tasks.workunit.client.0.smithi001.stdout:1/85: creat d3/d12/f17 x:0 0 0 2024-09-15T22:26:38.102 INFO:tasks.workunit.client.0.smithi001.stdout:7/40: mkdir d0/d7/df 0 2024-09-15T22:26:38.102 INFO:tasks.workunit.client.0.smithi001.stdout:8/46: sync 2024-09-15T22:26:38.103 INFO:tasks.workunit.client.0.smithi001.stdout:6/29: sync 2024-09-15T22:26:38.103 INFO:tasks.workunit.client.0.smithi001.stdout:2/54: creat d2/f11 x:0 0 0 2024-09-15T22:26:38.103 INFO:tasks.workunit.client.0.smithi001.stdout:4/73: mkdir d0/d1b 0 2024-09-15T22:26:38.104 INFO:tasks.workunit.client.0.smithi001.stdout:1/86: rename d3/f8 to d3/dd/d14/f18 0 2024-09-15T22:26:38.105 INFO:tasks.workunit.client.0.smithi001.stdout:3/72: read f2 [526221,83998] 0 2024-09-15T22:26:38.106 INFO:tasks.workunit.client.0.smithi001.stdout:8/47: mkdir d9 0 2024-09-15T22:26:38.106 INFO:tasks.workunit.client.0.smithi001.stdout:8/48: chown f5 11 1 2024-09-15T22:26:38.106 INFO:tasks.workunit.client.0.smithi001.stdout:6/30: creat d0/f9 x:0 0 0 2024-09-15T22:26:38.108 INFO:tasks.workunit.client.0.smithi001.stdout:4/74: rmdir d0/d1b 0 2024-09-15T22:26:38.111 INFO:tasks.workunit.client.0.smithi001.stdout:8/49: creat d9/fa x:0 0 0 2024-09-15T22:26:38.111 INFO:tasks.workunit.client.0.smithi001.stdout:8/50: read - f7 zero size 2024-09-15T22:26:38.112 INFO:tasks.workunit.client.0.smithi001.stdout:8/51: fsync f7 0 2024-09-15T22:26:38.112 INFO:tasks.workunit.client.0.smithi001.stdout:8/52: read f4 [356084,71710] 0 2024-09-15T22:26:38.123 INFO:tasks.workunit.client.0.smithi001.stdout:6/31: mknod d0/d7/ca 0 2024-09-15T22:26:38.123 INFO:tasks.workunit.client.0.smithi001.stdout:1/87: rename d3/dd/d14/f18 to d3/dd/f19 0 2024-09-15T22:26:38.123 INFO:tasks.workunit.client.0.smithi001.stdout:1/88: write d3/dd/ff [788946,14643] 0 2024-09-15T22:26:38.123 INFO:tasks.workunit.client.0.smithi001.stdout:7/41: write d0/d7/fd [983201,120354] 0 2024-09-15T22:26:38.124 INFO:tasks.workunit.client.0.smithi001.stdout:4/75: read d0/f13 [342187,102100] 0 2024-09-15T22:26:38.124 INFO:tasks.workunit.client.0.smithi001.stdout:4/76: write d0/f1a [657107,60655] 0 2024-09-15T22:26:38.125 INFO:tasks.workunit.client.0.smithi001.stdout:8/53: creat d9/fb x:0 0 0 2024-09-15T22:26:38.126 INFO:tasks.workunit.client.0.smithi001.stdout:8/54: symlink d9/lc 0 2024-09-15T22:26:38.127 INFO:tasks.workunit.client.0.smithi001.stdout:6/32: write d0/f5 [173585,38283] 0 2024-09-15T22:26:38.131 INFO:tasks.workunit.client.0.smithi001.stdout:6/33: creat d0/fb x:0 0 0 2024-09-15T22:26:38.132 INFO:tasks.workunit.client.0.smithi001.stdout:0/58: dwrite d0/dd/ff [0,4194304] 0 2024-09-15T22:26:38.132 INFO:tasks.workunit.client.0.smithi001.stdout:0/59: chown d0/d9/db/f10 18589 1 2024-09-15T22:26:38.135 INFO:tasks.workunit.client.0.smithi001.stdout:6/34: mknod d0/d6/cc 0 2024-09-15T22:26:38.138 INFO:tasks.workunit.client.0.smithi001.stdout:0/60: mknod d0/c12 0 2024-09-15T22:26:38.140 INFO:tasks.workunit.client.0.smithi001.stdout:0/61: link d0/cc d0/d9/db/c13 0 2024-09-15T22:26:38.141 INFO:tasks.workunit.client.0.smithi001.stdout:0/62: mknod d0/d9/db/c14 0 2024-09-15T22:26:38.146 INFO:tasks.workunit.client.0.smithi001.stdout:7/42: dread d0/f6 [0,4194304] 0 2024-09-15T22:26:38.146 INFO:tasks.workunit.client.0.smithi001.stdout:1/89: write d3/f9 [1510493,88536] 0 2024-09-15T22:26:38.152 INFO:tasks.workunit.client.0.smithi001.stdout:0/63: link d0/d9/db/f10 d0/d6/f15 0 2024-09-15T22:26:38.155 INFO:tasks.workunit.client.0.smithi001.stdout:1/90: creat d3/d12/f1a x:0 0 0 2024-09-15T22:26:38.155 INFO:tasks.workunit.client.0.smithi001.stdout:0/64: link d0/d6/f15 d0/f16 0 2024-09-15T22:26:38.159 INFO:tasks.workunit.client.0.smithi001.stdout:1/91: mkdir d3/dd/d14/d1b 0 2024-09-15T22:26:38.160 INFO:tasks.workunit.client.0.smithi001.stdout:0/65: fsync d0/d9/db/f10 0 2024-09-15T22:26:38.165 INFO:tasks.workunit.client.0.smithi001.stdout:1/92: creat d3/dd/d14/f1c x:0 0 0 2024-09-15T22:26:38.165 INFO:tasks.workunit.client.0.smithi001.stdout:1/93: chown d3/f5 126 1 2024-09-15T22:26:38.174 INFO:tasks.workunit.client.0.smithi001.stdout:9/39: dwrite f4 [0,4194304] 0 2024-09-15T22:26:38.179 INFO:tasks.workunit.client.0.smithi001.stdout:9/40: mkdir d5 0 2024-09-15T22:26:38.179 INFO:tasks.workunit.client.0.smithi001.stdout:1/94: fdatasync d3/f9 0 2024-09-15T22:26:38.179 INFO:tasks.workunit.client.0.smithi001.stdout:1/95: truncate d3/dd/f13 47366 0 2024-09-15T22:26:38.179 INFO:tasks.workunit.client.0.smithi001.stdout:1/96: write d3/f5 [3083117,85589] 0 2024-09-15T22:26:38.183 INFO:tasks.workunit.client.0.smithi001.stdout:8/55: dwrite d9/fa [0,4194304] 0 2024-09-15T22:26:38.185 INFO:tasks.workunit.client.0.smithi001.stdout:5/66: dwrite d3/fc [0,4194304] 0 2024-09-15T22:26:38.190 INFO:tasks.workunit.client.0.smithi001.stdout:1/97: dread d3/f9 [0,4194304] 0 2024-09-15T22:26:38.192 INFO:tasks.workunit.client.0.smithi001.stdout:1/98: link d3/f11 d3/d12/f1d 0 2024-09-15T22:26:38.199 INFO:tasks.workunit.client.0.smithi001.stdout:7/43: dwrite d0/f4 [0,4194304] 0 2024-09-15T22:26:38.199 INFO:tasks.workunit.client.0.smithi001.stdout:4/77: dwrite d0/f8 [0,4194304] 0 2024-09-15T22:26:38.200 INFO:tasks.workunit.client.0.smithi001.stdout:9/41: read f4 [1161034,96979] 0 2024-09-15T22:26:38.201 INFO:tasks.workunit.client.0.smithi001.stdout:2/55: dwrite d2/d5/fa [0,4194304] 0 2024-09-15T22:26:38.201 INFO:tasks.workunit.client.0.smithi001.stdout:2/56: readlink d2/lc 0 2024-09-15T22:26:38.201 INFO:tasks.workunit.client.0.smithi001.stdout:2/57: truncate d2/f3 856555 0 2024-09-15T22:26:38.204 INFO:tasks.workunit.client.0.smithi001.stdout:7/44: mknod d0/d7/df/c10 0 2024-09-15T22:26:38.205 INFO:tasks.workunit.client.0.smithi001.stdout:4/78: rename d0/f9 to d0/f1c 0 2024-09-15T22:26:38.206 INFO:tasks.workunit.client.0.smithi001.stdout:4/79: readlink d0/l3 0 2024-09-15T22:26:38.206 INFO:tasks.workunit.client.0.smithi001.stdout:4/80: mknod d0/d16/c1d 0 2024-09-15T22:26:38.207 INFO:tasks.workunit.client.0.smithi001.stdout:8/56: write f5 [2934554,76795] 0 2024-09-15T22:26:38.207 INFO:tasks.workunit.client.0.smithi001.stdout:8/57: chown f4 160944 1 2024-09-15T22:26:38.208 INFO:tasks.workunit.client.0.smithi001.stdout:4/81: symlink d0/d16/l1e 0 2024-09-15T22:26:38.208 INFO:tasks.workunit.client.0.smithi001.stdout:8/58: creat d9/fd x:0 0 0 2024-09-15T22:26:38.209 INFO:tasks.workunit.client.0.smithi001.stdout:4/82: link d0/fb d0/f1f 0 2024-09-15T22:26:38.210 INFO:tasks.workunit.client.0.smithi001.stdout:8/59: creat d9/fe x:0 0 0 2024-09-15T22:26:38.210 INFO:tasks.workunit.client.0.smithi001.stdout:8/60: chown l1 2 1 2024-09-15T22:26:38.211 INFO:tasks.workunit.client.0.smithi001.stdout:4/83: mkdir d0/d16/d20 0 2024-09-15T22:26:38.212 INFO:tasks.workunit.client.0.smithi001.stdout:4/84: creat d0/d16/f21 x:0 0 0 2024-09-15T22:26:38.213 INFO:tasks.workunit.client.0.smithi001.stdout:6/35: dwrite d0/fb [0,4194304] 0 2024-09-15T22:26:38.213 INFO:tasks.workunit.client.0.smithi001.stdout:6/36: write d0/f3 [39662,47827] 0 2024-09-15T22:26:38.214 INFO:tasks.workunit.client.0.smithi001.stdout:4/85: rename d0/fb to d0/d16/f22 0 2024-09-15T22:26:38.217 INFO:tasks.workunit.client.0.smithi001.stdout:6/37: creat d0/d6/fd x:0 0 0 2024-09-15T22:26:38.217 INFO:tasks.workunit.client.0.smithi001.stdout:6/38: stat d0/d6/fd 0 2024-09-15T22:26:38.231 INFO:tasks.workunit.client.0.smithi001.stdout:1/99: dwrite d3/f4 [0,4194304] 0 2024-09-15T22:26:38.231 INFO:tasks.workunit.client.0.smithi001.stdout:1/100: readlink d3/d12/l16 0 2024-09-15T22:26:38.235 INFO:tasks.workunit.client.0.smithi001.stdout:9/42: dread f0 [0,4194304] 0 2024-09-15T22:26:38.235 INFO:tasks.workunit.client.0.smithi001.stdout:9/43: fsync f0 0 2024-09-15T22:26:38.237 INFO:tasks.workunit.client.0.smithi001.stdout:4/86: getdents d0 0 2024-09-15T22:26:38.246 INFO:tasks.workunit.client.0.smithi001.stdout:1/101: rename d3/d12/f1a to d3/d12/f1e 0 2024-09-15T22:26:38.246 INFO:tasks.workunit.client.0.smithi001.stdout:9/44: mknod d5/c6 0 2024-09-15T22:26:38.247 INFO:tasks.workunit.client.0.smithi001.stdout:4/87: creat d0/d16/f23 x:0 0 0 2024-09-15T22:26:38.248 INFO:tasks.workunit.client.0.smithi001.stdout:1/102: mknod d3/dd/d14/c1f 0 2024-09-15T22:26:38.249 INFO:tasks.workunit.client.0.smithi001.stdout:4/88: link d0/d16/f19 d0/f24 0 2024-09-15T22:26:38.249 INFO:tasks.workunit.client.0.smithi001.stdout:4/89: stat d0/c15 0 2024-09-15T22:26:38.249 INFO:tasks.workunit.client.0.smithi001.stdout:4/90: fsync d0/f1f 0 2024-09-15T22:26:38.250 INFO:tasks.workunit.client.0.smithi001.stdout:1/103: rename d3/lc to d3/d12/l20 0 2024-09-15T22:26:38.251 INFO:tasks.workunit.client.0.smithi001.stdout:1/104: unlink d3/dd/ff 0 2024-09-15T22:26:38.251 INFO:tasks.workunit.client.0.smithi001.stdout:4/91: rmdir d0 39 2024-09-15T22:26:38.253 INFO:tasks.workunit.client.0.smithi001.stdout:4/92: rename d0/f8 to d0/d16/d20/f25 0 2024-09-15T22:26:38.253 INFO:tasks.workunit.client.0.smithi001.stdout:4/93: write d0/d16/f22 [1203210,74124] 0 2024-09-15T22:26:38.254 INFO:tasks.workunit.client.0.smithi001.stdout:4/94: creat d0/d16/d20/f26 x:0 0 0 2024-09-15T22:26:38.254 INFO:tasks.workunit.client.0.smithi001.stdout:4/95: chown d0/d16/d20/f26 10 1 2024-09-15T22:26:38.254 INFO:tasks.workunit.client.0.smithi001.stdout:4/96: dread - d0/d16/f23 zero size 2024-09-15T22:26:38.255 INFO:tasks.workunit.client.0.smithi001.stdout:4/97: truncate d0/f7 3396235 0 2024-09-15T22:26:38.257 INFO:tasks.workunit.client.0.smithi001.stdout:4/98: mkdir d0/d27 0 2024-09-15T22:26:38.283 INFO:tasks.workunit.client.0.smithi001.stdout:2/58: dwrite d2/f11 [0,4194304] 0 2024-09-15T22:26:38.285 INFO:tasks.workunit.client.0.smithi001.stdout:8/61: dwrite f7 [0,4194304] 0 2024-09-15T22:26:38.285 INFO:tasks.workunit.client.0.smithi001.stdout:2/59: mkdir d2/d12 0 2024-09-15T22:26:38.289 INFO:tasks.workunit.client.0.smithi001.stdout:8/62: creat d9/ff x:0 0 0 2024-09-15T22:26:38.291 INFO:tasks.workunit.client.0.smithi001.stdout:2/60: rename f1 to d2/df/f13 0 2024-09-15T22:26:38.294 INFO:tasks.workunit.client.0.smithi001.stdout:8/63: symlink d9/l10 0 2024-09-15T22:26:38.294 INFO:tasks.workunit.client.0.smithi001.stdout:8/64: fdatasync f4 0 2024-09-15T22:26:38.295 INFO:tasks.workunit.client.0.smithi001.stdout:9/45: write f0 [1482376,97822] 0 2024-09-15T22:26:38.296 INFO:tasks.workunit.client.0.smithi001.stdout:9/46: rmdir d5 39 2024-09-15T22:26:38.296 INFO:tasks.workunit.client.0.smithi001.stdout:2/61: write d2/f10 [498884,73128] 0 2024-09-15T22:26:38.297 INFO:tasks.workunit.client.0.smithi001.stdout:9/47: truncate f4 1872785 0 2024-09-15T22:26:38.298 INFO:tasks.workunit.client.0.smithi001.stdout:2/62: mkdir d2/d14 0 2024-09-15T22:26:38.299 INFO:tasks.workunit.client.0.smithi001.stdout:2/63: read d2/f10 [289922,67729] 0 2024-09-15T22:26:38.299 INFO:tasks.workunit.client.0.smithi001.stdout:2/64: chown d2/d5 1569 1 2024-09-15T22:26:38.302 INFO:tasks.workunit.client.0.smithi001.stdout:2/65: rename d2/d5/fd to d2/d14/f15 0 2024-09-15T22:26:38.303 INFO:tasks.workunit.client.0.smithi001.stdout:2/66: mknod d2/c16 0 2024-09-15T22:26:38.303 INFO:tasks.workunit.client.0.smithi001.stdout:2/67: mkdir d2/d14/d17 0 2024-09-15T22:26:38.304 INFO:tasks.workunit.client.0.smithi001.stdout:2/68: symlink d2/d14/d17/l18 0 2024-09-15T22:26:38.308 INFO:tasks.workunit.client.0.smithi001.stdout:4/99: write d0/fd [1158652,64461] 0 2024-09-15T22:26:38.308 INFO:tasks.workunit.client.0.smithi001.stdout:4/100: chown d0/c15 465 1 2024-09-15T22:26:38.308 INFO:tasks.workunit.client.0.smithi001.stdout:4/101: write d0/f1f [328915,44584] 0 2024-09-15T22:26:38.309 INFO:tasks.workunit.client.0.smithi001.stdout:4/102: rename d0/f24 to d0/d16/d20/f28 0 2024-09-15T22:26:38.311 INFO:tasks.workunit.client.0.smithi001.stdout:6/39: dwrite d0/f4 [0,4194304] 0 2024-09-15T22:26:38.311 INFO:tasks.workunit.client.0.smithi001.stdout:6/40: write d0/f9 [105091,91630] 0 2024-09-15T22:26:38.311 INFO:tasks.workunit.client.0.smithi001.stdout:6/41: write d0/f2 [4618668,107141] 0 2024-09-15T22:26:38.312 INFO:tasks.workunit.client.0.smithi001.stdout:1/105: dwrite d3/f9 [4194304,4194304] 0 2024-09-15T22:26:38.314 INFO:tasks.workunit.client.0.smithi001.stdout:4/103: mkdir d0/d16/d20/d29 0 2024-09-15T22:26:38.315 INFO:tasks.workunit.client.0.smithi001.stdout:3/73: sync 2024-09-15T22:26:38.320 INFO:tasks.workunit.client.0.smithi001.stdout:2/69: write d2/f11 [3991477,17615] 0 2024-09-15T22:26:38.320 INFO:tasks.workunit.client.0.smithi001.stdout:2/70: chown d2/df/f13 1 1 2024-09-15T22:26:38.324 INFO:tasks.workunit.client.0.smithi001.stdout:1/106: truncate d3/f4 2099277 0 2024-09-15T22:26:38.326 INFO:tasks.workunit.client.0.smithi001.stdout:4/104: mknod d0/d27/c2a 0 2024-09-15T22:26:38.327 INFO:tasks.workunit.client.0.smithi001.stdout:2/71: link d2/f9 d2/df/f19 0 2024-09-15T22:26:38.327 INFO:tasks.workunit.client.0.smithi001.stdout:2/72: chown d2/d12 5 1 2024-09-15T22:26:38.328 INFO:tasks.workunit.client.0.smithi001.stdout:1/107: mkdir d3/d12/d21 0 2024-09-15T22:26:38.329 INFO:tasks.workunit.client.0.smithi001.stdout:4/105: symlink d0/d27/l2b 0 2024-09-15T22:26:38.329 INFO:tasks.workunit.client.0.smithi001.stdout:5/67: sync 2024-09-15T22:26:38.329 INFO:tasks.workunit.client.0.smithi001.stdout:0/66: sync 2024-09-15T22:26:38.329 INFO:tasks.workunit.client.0.smithi001.stdout:0/67: read - d0/f7 zero size 2024-09-15T22:26:38.329 INFO:tasks.workunit.client.0.smithi001.stdout:2/73: truncate d2/d5/fe 157487 0 2024-09-15T22:26:38.331 INFO:tasks.workunit.client.0.smithi001.stdout:1/108: unlink d3/ca 0 2024-09-15T22:26:38.331 INFO:tasks.workunit.client.0.smithi001.stdout:7/45: sync 2024-09-15T22:26:38.332 INFO:tasks.workunit.client.0.smithi001.stdout:4/106: write d0/f1a [354049,29002] 0 2024-09-15T22:26:38.332 INFO:tasks.workunit.client.0.smithi001.stdout:4/107: write d0/d16/d20/f28 [720671,20639] 0 2024-09-15T22:26:38.332 INFO:tasks.workunit.client.0.smithi001.stdout:4/108: write d0/d16/d20/f26 [309095,68798] 0 2024-09-15T22:26:38.332 INFO:tasks.workunit.client.0.smithi001.stdout:5/68: creat d3/f16 x:0 0 0 2024-09-15T22:26:38.333 INFO:tasks.workunit.client.0.smithi001.stdout:0/68: mknod d0/c17 0 2024-09-15T22:26:38.336 INFO:tasks.workunit.client.0.smithi001.stdout:2/74: mkdir d2/d14/d1a 0 2024-09-15T22:26:38.336 INFO:tasks.workunit.client.0.smithi001.stdout:1/109: creat d3/d12/d21/f22 x:0 0 0 2024-09-15T22:26:38.336 INFO:tasks.workunit.client.0.smithi001.stdout:7/46: getdents d0/d7/df 0 2024-09-15T22:26:38.337 INFO:tasks.workunit.client.0.smithi001.stdout:8/65: dwrite d9/fb [0,4194304] 0 2024-09-15T22:26:38.337 INFO:tasks.workunit.client.0.smithi001.stdout:8/66: chown d9 21124 1 2024-09-15T22:26:38.337 INFO:tasks.workunit.client.0.smithi001.stdout:4/109: creat d0/d27/f2c x:0 0 0 2024-09-15T22:26:38.340 INFO:tasks.workunit.client.0.smithi001.stdout:5/69: unlink d3/c5 0 2024-09-15T22:26:38.340 INFO:tasks.workunit.client.0.smithi001.stdout:5/70: write d3/d6/f7 [5099840,14980] 0 2024-09-15T22:26:38.341 INFO:tasks.workunit.client.0.smithi001.stdout:0/69: creat d0/d6/f18 x:0 0 0 2024-09-15T22:26:38.343 INFO:tasks.workunit.client.0.smithi001.stdout:7/47: creat d0/d7/df/f11 x:0 0 0 2024-09-15T22:26:38.346 INFO:tasks.workunit.client.0.smithi001.stdout:8/67: rmdir d9 39 2024-09-15T22:26:38.346 INFO:tasks.workunit.client.0.smithi001.stdout:8/68: write d9/fd [913359,76956] 0 2024-09-15T22:26:38.348 INFO:tasks.workunit.client.0.smithi001.stdout:4/110: truncate d0/f13 3225577 0 2024-09-15T22:26:38.350 INFO:tasks.workunit.client.0.smithi001.stdout:0/70: creat d0/d9/db/f19 x:0 0 0 2024-09-15T22:26:38.350 INFO:tasks.workunit.client.0.smithi001.stdout:8/69: creat d9/f11 x:0 0 0 2024-09-15T22:26:38.350 INFO:tasks.workunit.client.0.smithi001.stdout:8/70: dread - f8 zero size 2024-09-15T22:26:38.350 INFO:tasks.workunit.client.0.smithi001.stdout:8/71: rename d9 to d9/d12 22 2024-09-15T22:26:38.350 INFO:tasks.workunit.client.0.smithi001.stdout:8/72: chown l2 100 1 2024-09-15T22:26:38.353 INFO:tasks.workunit.client.0.smithi001.stdout:5/71: read d3/d6/f8 [214640,101198] 0 2024-09-15T22:26:38.358 INFO:tasks.workunit.client.0.smithi001.stdout:4/111: creat d0/d16/f2d x:0 0 0 2024-09-15T22:26:38.358 INFO:tasks.workunit.client.0.smithi001.stdout:8/73: symlink d9/l13 0 2024-09-15T22:26:38.358 INFO:tasks.workunit.client.0.smithi001.stdout:0/71: mkdir d0/d9/d1a 0 2024-09-15T22:26:38.358 INFO:tasks.workunit.client.0.smithi001.stdout:5/72: truncate d3/fc 1034691 0 2024-09-15T22:26:38.358 INFO:tasks.workunit.client.0.smithi001.stdout:7/48: write d0/f6 [1891744,12837] 0 2024-09-15T22:26:38.360 INFO:tasks.workunit.client.0.smithi001.stdout:4/112: creat d0/f2e x:0 0 0 2024-09-15T22:26:38.360 INFO:tasks.workunit.client.0.smithi001.stdout:8/74: mknod d9/c14 0 2024-09-15T22:26:38.362 INFO:tasks.workunit.client.0.smithi001.stdout:5/73: mknod d3/c17 0 2024-09-15T22:26:38.365 INFO:tasks.workunit.client.0.smithi001.stdout:4/113: creat d0/d16/f2f x:0 0 0 2024-09-15T22:26:38.366 INFO:tasks.workunit.client.0.smithi001.stdout:8/75: mknod d9/c15 0 2024-09-15T22:26:38.369 INFO:tasks.workunit.client.0.smithi001.stdout:7/49: rename d0/d7/cc to d0/c12 0 2024-09-15T22:26:38.370 INFO:tasks.workunit.client.0.smithi001.stdout:4/114: mkdir d0/d27/d30 0 2024-09-15T22:26:38.370 INFO:tasks.workunit.client.0.smithi001.stdout:4/115: stat d0/l18 0 2024-09-15T22:26:38.370 INFO:tasks.workunit.client.0.smithi001.stdout:8/76: rename d9/fe to d9/f16 0 2024-09-15T22:26:38.372 INFO:tasks.workunit.client.0.smithi001.stdout:4/116: link d0/l17 d0/d27/l31 0 2024-09-15T22:26:38.373 INFO:tasks.workunit.client.0.smithi001.stdout:4/117: rename d0/c15 to d0/d27/c32 0 2024-09-15T22:26:38.374 INFO:tasks.workunit.client.0.smithi001.stdout:4/118: write d0/f2e [918603,72405] 0 2024-09-15T22:26:38.374 INFO:tasks.workunit.client.0.smithi001.stdout:4/119: truncate d0/f11 341087 0 2024-09-15T22:26:38.376 INFO:tasks.workunit.client.0.smithi001.stdout:4/120: rmdir d0/d16/d20 39 2024-09-15T22:26:38.376 INFO:tasks.workunit.client.0.smithi001.stdout:4/121: dread - d0/d27/f2c zero size 2024-09-15T22:26:38.376 INFO:tasks.workunit.client.0.smithi001.stdout:4/122: write d0/d16/f2f [375586,130471] 0 2024-09-15T22:26:38.376 INFO:tasks.workunit.client.0.smithi001.stdout:1/110: dwrite d3/d12/f1d [0,4194304] 0 2024-09-15T22:26:38.381 INFO:tasks.workunit.client.0.smithi001.stdout:5/74: dread d3/fc [0,4194304] 0 2024-09-15T22:26:38.381 INFO:tasks.workunit.client.0.smithi001.stdout:3/74: dwrite f2 [0,4194304] 0 2024-09-15T22:26:38.381 INFO:tasks.workunit.client.0.smithi001.stdout:3/75: chown da/db/ff 3478726 1 2024-09-15T22:26:38.384 INFO:tasks.workunit.client.0.smithi001.stdout:4/123: unlink d0/f13 0 2024-09-15T22:26:38.385 INFO:tasks.workunit.client.0.smithi001.stdout:5/75: truncate d3/fc 703117 0 2024-09-15T22:26:38.386 INFO:tasks.workunit.client.0.smithi001.stdout:4/124: symlink d0/d16/l33 0 2024-09-15T22:26:38.387 INFO:tasks.workunit.client.0.smithi001.stdout:5/76: getdents d3 0 2024-09-15T22:26:38.388 INFO:tasks.workunit.client.0.smithi001.stdout:5/77: read d3/d6/f8 [316190,28976] 0 2024-09-15T22:26:38.391 INFO:tasks.workunit.client.0.smithi001.stdout:4/125: mkdir d0/d16/d20/d29/d34 0 2024-09-15T22:26:38.391 INFO:tasks.workunit.client.0.smithi001.stdout:4/126: stat d0/f1f 0 2024-09-15T22:26:38.392 INFO:tasks.workunit.client.0.smithi001.stdout:5/78: symlink d3/d6/l18 0 2024-09-15T22:26:38.394 INFO:tasks.workunit.client.0.smithi001.stdout:4/127: mkdir d0/d27/d35 0 2024-09-15T22:26:38.395 INFO:tasks.workunit.client.0.smithi001.stdout:6/42: dwrite d0/f4 [0,4194304] 0 2024-09-15T22:26:38.395 INFO:tasks.workunit.client.0.smithi001.stdout:5/79: rename d3/d6/la to d3/d6/l19 0 2024-09-15T22:26:38.398 INFO:tasks.workunit.client.0.smithi001.stdout:6/43: creat d0/d7/fe x:0 0 0 2024-09-15T22:26:38.398 INFO:tasks.workunit.client.0.smithi001.stdout:6/44: write d0/f9 [211123,92936] 0 2024-09-15T22:26:38.399 INFO:tasks.workunit.client.0.smithi001.stdout:5/80: mknod d3/c1a 0 2024-09-15T22:26:38.402 INFO:tasks.workunit.client.0.smithi001.stdout:6/45: mkdir d0/df 0 2024-09-15T22:26:38.403 INFO:tasks.workunit.client.0.smithi001.stdout:5/81: mknod d3/c1b 0 2024-09-15T22:26:38.403 INFO:tasks.workunit.client.0.smithi001.stdout:5/82: fdatasync d3/f16 0 2024-09-15T22:26:38.404 INFO:tasks.workunit.client.0.smithi001.stdout:6/46: symlink d0/l10 0 2024-09-15T22:26:38.404 INFO:tasks.workunit.client.0.smithi001.stdout:6/47: fdatasync d0/f4 0 2024-09-15T22:26:38.406 INFO:tasks.workunit.client.0.smithi001.stdout:6/48: creat d0/f11 x:0 0 0 2024-09-15T22:26:38.406 INFO:tasks.workunit.client.0.smithi001.stdout:3/76: rename da/db to da/d16 0 2024-09-15T22:26:38.406 INFO:tasks.workunit.client.0.smithi001.stdout:3/77: truncate f2 4973988 0 2024-09-15T22:26:38.407 INFO:tasks.workunit.client.0.smithi001.stdout:6/49: creat d0/f12 x:0 0 0 2024-09-15T22:26:38.408 INFO:tasks.workunit.client.0.smithi001.stdout:3/78: unlink da/d16/cd 0 2024-09-15T22:26:38.409 INFO:tasks.workunit.client.0.smithi001.stdout:6/50: creat d0/d6/f13 x:0 0 0 2024-09-15T22:26:38.410 INFO:tasks.workunit.client.0.smithi001.stdout:3/79: mkdir da/d17 0 2024-09-15T22:26:38.410 INFO:tasks.workunit.client.0.smithi001.stdout:3/80: rename da to da/d18 22 2024-09-15T22:26:38.410 INFO:tasks.workunit.client.0.smithi001.stdout:3/81: dread - da/f12 zero size 2024-09-15T22:26:38.414 INFO:tasks.workunit.client.0.smithi001.stdout:5/83: dread d3/d6/f8 [0,4194304] 0 2024-09-15T22:26:38.414 INFO:tasks.workunit.client.0.smithi001.stdout:6/51: creat d0/d6/f14 x:0 0 0 2024-09-15T22:26:38.414 INFO:tasks.workunit.client.0.smithi001.stdout:3/82: mknod da/c19 0 2024-09-15T22:26:38.415 INFO:tasks.workunit.client.0.smithi001.stdout:5/84: mknod d3/d6/c1c 0 2024-09-15T22:26:38.416 INFO:tasks.workunit.client.0.smithi001.stdout:6/52: symlink d0/d6/l15 0 2024-09-15T22:26:38.417 INFO:tasks.workunit.client.0.smithi001.stdout:3/83: symlink da/d14/l1a 0 2024-09-15T22:26:38.417 INFO:tasks.workunit.client.0.smithi001.stdout:5/85: mkdir d3/d1d 0 2024-09-15T22:26:38.417 INFO:tasks.workunit.client.0.smithi001.stdout:5/86: readlink d3/d6/l19 0 2024-09-15T22:26:38.418 INFO:tasks.workunit.client.0.smithi001.stdout:6/53: creat d0/d7/f16 x:0 0 0 2024-09-15T22:26:38.418 INFO:tasks.workunit.client.0.smithi001.stdout:6/54: stat d0/d7 0 2024-09-15T22:26:38.420 INFO:tasks.workunit.client.0.smithi001.stdout:2/75: dwrite d2/df/f13 [0,4194304] 0 2024-09-15T22:26:38.420 INFO:tasks.workunit.client.0.smithi001.stdout:6/55: rename d0/d7/f16 to d0/d6/f17 0 2024-09-15T22:26:38.421 INFO:tasks.workunit.client.0.smithi001.stdout:5/87: unlink d3/lf 0 2024-09-15T22:26:38.423 INFO:tasks.workunit.client.0.smithi001.stdout:2/76: mkdir d2/d14/d1a/d1b 0 2024-09-15T22:26:38.424 INFO:tasks.workunit.client.0.smithi001.stdout:6/56: creat d0/df/f18 x:0 0 0 2024-09-15T22:26:38.425 INFO:tasks.workunit.client.0.smithi001.stdout:5/88: mknod d3/d6/c1e 0 2024-09-15T22:26:38.426 INFO:tasks.workunit.client.0.smithi001.stdout:6/57: creat d0/f19 x:0 0 0 2024-09-15T22:26:38.427 INFO:tasks.workunit.client.0.smithi001.stdout:6/58: chown d0/f12 159 1 2024-09-15T22:26:38.432 INFO:tasks.workunit.client.0.smithi001.stdout:5/89: rename d3/l4 to d3/d1d/l1f 0 2024-09-15T22:26:38.432 INFO:tasks.workunit.client.0.smithi001.stdout:5/90: creat d3/d6/f20 x:0 0 0 2024-09-15T22:26:38.432 INFO:tasks.workunit.client.0.smithi001.stdout:5/91: readlink d3/l15 0 2024-09-15T22:26:38.440 INFO:tasks.workunit.client.0.smithi001.stdout:3/84: dread f6 [0,4194304] 0 2024-09-15T22:26:38.441 INFO:tasks.workunit.client.0.smithi001.stdout:8/77: dwrite d9/fd [0,4194304] 0 2024-09-15T22:26:38.442 INFO:tasks.workunit.client.0.smithi001.stdout:3/85: mkdir da/d17/d1b 0 2024-09-15T22:26:38.443 INFO:tasks.workunit.client.0.smithi001.stdout:2/77: dread d2/d5/fa [0,4194304] 0 2024-09-15T22:26:38.443 INFO:tasks.workunit.client.0.smithi001.stdout:8/78: mknod d9/c17 0 2024-09-15T22:26:38.443 INFO:tasks.workunit.client.0.smithi001.stdout:8/79: write f5 [1934851,35223] 0 2024-09-15T22:26:38.444 INFO:tasks.workunit.client.0.smithi001.stdout:3/86: creat da/f1c x:0 0 0 2024-09-15T22:26:38.444 INFO:tasks.workunit.client.0.smithi001.stdout:3/87: dread - da/fe zero size 2024-09-15T22:26:38.445 INFO:tasks.workunit.client.0.smithi001.stdout:2/78: creat d2/d12/f1c x:0 0 0 2024-09-15T22:26:38.445 INFO:tasks.workunit.client.0.smithi001.stdout:2/79: write d2/d12/f1c [252206,10263] 0 2024-09-15T22:26:38.446 INFO:tasks.workunit.client.0.smithi001.stdout:8/80: unlink d9/f16 0 2024-09-15T22:26:38.447 INFO:tasks.workunit.client.0.smithi001.stdout:7/50: dwrite d0/d7/df/f11 [0,4194304] 0 2024-09-15T22:26:38.449 INFO:tasks.workunit.client.0.smithi001.stdout:3/88: unlink c9 0 2024-09-15T22:26:38.449 INFO:tasks.workunit.client.0.smithi001.stdout:6/59: write d0/f4 [1132965,68102] 0 2024-09-15T22:26:38.449 INFO:tasks.workunit.client.0.smithi001.stdout:2/80: symlink d2/d14/d17/l1d 0 2024-09-15T22:26:38.450 INFO:tasks.workunit.client.0.smithi001.stdout:2/81: write d2/f9 [194148,16123] 0 2024-09-15T22:26:38.460 INFO:tasks.workunit.client.0.smithi001.stdout:1/111: dwrite d3/f9 [4194304,4194304] 0 2024-09-15T22:26:38.461 INFO:tasks.workunit.client.0.smithi001.stdout:3/89: read f5 [1771135,105161] 0 2024-09-15T22:26:38.469 INFO:tasks.workunit.client.0.smithi001.stdout:7/51: rename d0/c12 to d0/d7/c13 0 2024-09-15T22:26:38.472 INFO:tasks.workunit.client.0.smithi001.stdout:1/112: mkdir d3/dd/d14/d23 0 2024-09-15T22:26:38.472 INFO:tasks.workunit.client.0.smithi001.stdout:1/113: read d3/dd/f13 [2358,44503] 0 2024-09-15T22:26:38.472 INFO:tasks.workunit.client.0.smithi001.stdout:1/114: dread - d3/d12/f17 zero size 2024-09-15T22:26:38.474 INFO:tasks.workunit.client.0.smithi001.stdout:6/60: rename d0/f12 to d0/df/f1a 0 2024-09-15T22:26:38.475 INFO:tasks.workunit.client.0.smithi001.stdout:7/52: unlink d0/d7/df/c10 0 2024-09-15T22:26:38.476 INFO:tasks.workunit.client.0.smithi001.stdout:1/115: stat d3/d12/l16 0 2024-09-15T22:26:38.476 INFO:tasks.workunit.client.0.smithi001.stdout:1/116: chown c0 172641 1 2024-09-15T22:26:38.477 INFO:tasks.workunit.client.0.smithi001.stdout:6/61: mknod d0/df/c1b 0 2024-09-15T22:26:38.480 INFO:tasks.workunit.client.0.smithi001.stdout:1/117: creat d3/d12/f24 x:0 0 0 2024-09-15T22:26:38.488 INFO:tasks.workunit.client.0.smithi001.stdout:7/53: symlink d0/d7/l14 0 2024-09-15T22:26:38.490 INFO:tasks.workunit.client.0.smithi001.stdout:7/54: link d0/le d0/d7/df/l15 0 2024-09-15T22:26:38.491 INFO:tasks.workunit.client.0.smithi001.stdout:7/55: symlink d0/l16 0 2024-09-15T22:26:38.493 INFO:tasks.workunit.client.0.smithi001.stdout:6/62: dread d0/f2 [0,4194304] 0 2024-09-15T22:26:38.493 INFO:tasks.workunit.client.0.smithi001.stdout:6/63: write d0/f19 [215739,41135] 0 2024-09-15T22:26:38.493 INFO:tasks.workunit.client.0.smithi001.stdout:3/90: dread da/d16/ff [0,4194304] 0 2024-09-15T22:26:38.493 INFO:tasks.workunit.client.0.smithi001.stdout:5/92: dwrite d3/d6/f8 [0,4194304] 0 2024-09-15T22:26:38.493 INFO:tasks.workunit.client.0.smithi001.stdout:5/93: write d3/d6/fe [928449,111630] 0 2024-09-15T22:26:38.495 INFO:tasks.workunit.client.0.smithi001.stdout:6/64: rmdir d0/d7 39 2024-09-15T22:26:38.495 INFO:tasks.workunit.client.0.smithi001.stdout:6/65: write d0/f5 [1353468,12649] 0 2024-09-15T22:26:38.495 INFO:tasks.workunit.client.0.smithi001.stdout:6/66: chown d0/f19 7 1 2024-09-15T22:26:38.496 INFO:tasks.workunit.client.0.smithi001.stdout:3/91: mknod da/d17/d1b/c1d 0 2024-09-15T22:26:38.498 INFO:tasks.workunit.client.0.smithi001.stdout:5/94: unlink d3/d6/f9 0 2024-09-15T22:26:38.500 INFO:tasks.workunit.client.0.smithi001.stdout:6/67: rmdir d0/d7 39 2024-09-15T22:26:38.500 INFO:tasks.workunit.client.0.smithi001.stdout:6/68: write d0/d6/fd [48565,64941] 0 2024-09-15T22:26:38.501 INFO:tasks.workunit.client.0.smithi001.stdout:3/92: getdents da/d17 0 2024-09-15T22:26:38.502 INFO:tasks.workunit.client.0.smithi001.stdout:9/48: sync 2024-09-15T22:26:38.504 INFO:tasks.workunit.client.0.smithi001.stdout:5/95: truncate d3/d6/f7 1229797 0 2024-09-15T22:26:38.504 INFO:tasks.workunit.client.0.smithi001.stdout:6/69: mkdir d0/d7/d1c 0 2024-09-15T22:26:38.505 INFO:tasks.workunit.client.0.smithi001.stdout:3/93: creat da/d16/f1e x:0 0 0 2024-09-15T22:26:38.507 INFO:tasks.workunit.client.0.smithi001.stdout:9/49: mkdir d5/d7 0 2024-09-15T22:26:38.507 INFO:tasks.workunit.client.0.smithi001.stdout:9/50: fdatasync f4 0 2024-09-15T22:26:38.508 INFO:tasks.workunit.client.0.smithi001.stdout:7/56: write d0/f4 [1661312,31796] 0 2024-09-15T22:26:38.509 INFO:tasks.workunit.client.0.smithi001.stdout:2/82: dwrite d2/f9 [0,4194304] 0 2024-09-15T22:26:38.510 INFO:tasks.workunit.client.0.smithi001.stdout:6/70: creat d0/d7/d1c/f1d x:0 0 0 2024-09-15T22:26:38.510 INFO:tasks.workunit.client.0.smithi001.stdout:6/71: chown d0/c1 1809 1 2024-09-15T22:26:38.510 INFO:tasks.workunit.client.0.smithi001.stdout:5/96: fsync d3/d6/f7 0 2024-09-15T22:26:38.514 INFO:tasks.workunit.client.0.smithi001.stdout:3/94: truncate f7 4070987 0 2024-09-15T22:26:38.514 INFO:tasks.workunit.client.0.smithi001.stdout:7/57: creat d0/d7/f17 x:0 0 0 2024-09-15T22:26:38.514 INFO:tasks.workunit.client.0.smithi001.stdout:7/58: readlink d0/le 0 2024-09-15T22:26:38.521 INFO:tasks.workunit.client.0.smithi001.stdout:5/97: unlink d3/d6/c1c 0 2024-09-15T22:26:38.523 INFO:tasks.workunit.client.0.smithi001.stdout:3/95: mkdir da/d1f 0 2024-09-15T22:26:38.525 INFO:tasks.workunit.client.0.smithi001.stdout:7/59: rmdir d0/d7 39 2024-09-15T22:26:38.525 INFO:tasks.workunit.client.0.smithi001.stdout:7/60: write d0/d7/fd [1522024,8101] 0 2024-09-15T22:26:38.525 INFO:tasks.workunit.client.0.smithi001.stdout:7/61: dread - d0/d7/f17 zero size 2024-09-15T22:26:38.526 INFO:tasks.workunit.client.0.smithi001.stdout:7/62: write d0/f6 [254253,6848] 0 2024-09-15T22:26:38.526 INFO:tasks.workunit.client.0.smithi001.stdout:0/72: sync 2024-09-15T22:26:38.526 INFO:tasks.workunit.client.0.smithi001.stdout:0/73: truncate d0/f7 412747 0 2024-09-15T22:26:38.527 INFO:tasks.workunit.client.0.smithi001.stdout:0/74: readlink - no filename 2024-09-15T22:26:38.527 INFO:tasks.workunit.client.0.smithi001.stdout:0/75: getdents d0/d9/d1a 0 2024-09-15T22:26:38.527 INFO:tasks.workunit.client.0.smithi001.stdout:0/76: mkdir d0/dd/d1b 0 2024-09-15T22:26:38.527 INFO:tasks.workunit.client.0.smithi001.stdout:1/118: dwrite d3/dd/f19 [0,4194304] 0 2024-09-15T22:26:38.528 INFO:tasks.workunit.client.0.smithi001.stdout:7/63: rename d0/f4 to d0/d7/f18 0 2024-09-15T22:26:38.528 INFO:tasks.workunit.client.0.smithi001.stdout:7/64: read - d0/d7/f17 zero size 2024-09-15T22:26:38.529 INFO:tasks.workunit.client.0.smithi001.stdout:0/77: rmdir d0/d9 39 2024-09-15T22:26:38.530 INFO:tasks.workunit.client.0.smithi001.stdout:7/65: unlink d0/l16 0 2024-09-15T22:26:38.530 INFO:tasks.workunit.client.0.smithi001.stdout:7/66: write d0/d7/f18 [1204345,97924] 0 2024-09-15T22:26:38.531 INFO:tasks.workunit.client.0.smithi001.stdout:0/78: creat d0/d9/f1c x:0 0 0 2024-09-15T22:26:38.531 INFO:tasks.workunit.client.0.smithi001.stdout:0/79: write d0/d9/db/f19 [257625,98975] 0 2024-09-15T22:26:38.532 INFO:tasks.workunit.client.0.smithi001.stdout:7/67: creat d0/d7/f19 x:0 0 0 2024-09-15T22:26:38.532 INFO:tasks.workunit.client.0.smithi001.stdout:1/119: dread d3/dd/f13 [0,4194304] 0 2024-09-15T22:26:38.533 INFO:tasks.workunit.client.0.smithi001.stdout:1/120: fdatasync d3/d12/f17 0 2024-09-15T22:26:38.534 INFO:tasks.workunit.client.0.smithi001.stdout:0/80: rename d0/d9/db/c13 to d0/dd/d1b/c1d 0 2024-09-15T22:26:38.534 INFO:tasks.workunit.client.0.smithi001.stdout:0/81: chown d0 3 1 2024-09-15T22:26:38.534 INFO:tasks.workunit.client.0.smithi001.stdout:7/68: readlink d0/d7/la 0 2024-09-15T22:26:38.535 INFO:tasks.workunit.client.0.smithi001.stdout:5/98: dread d3/d6/fe [0,4194304] 0 2024-09-15T22:26:38.536 INFO:tasks.workunit.client.0.smithi001.stdout:5/99: readlink d3/d6/lb 0 2024-09-15T22:26:38.536 INFO:tasks.workunit.client.0.smithi001.stdout:5/100: fsync d3/f16 0 2024-09-15T22:26:38.536 INFO:tasks.workunit.client.0.smithi001.stdout:5/101: readlink d3/l15 0 2024-09-15T22:26:38.536 INFO:tasks.workunit.client.0.smithi001.stdout:0/82: creat d0/d9/db/f1e x:0 0 0 2024-09-15T22:26:38.536 INFO:tasks.workunit.client.0.smithi001.stdout:0/83: chown d0/d9/db/f10 1369597 1 2024-09-15T22:26:38.536 INFO:tasks.workunit.client.0.smithi001.stdout:0/84: chown d0/d6/f18 242575681 1 2024-09-15T22:26:38.539 INFO:tasks.workunit.client.0.smithi001.stdout:7/69: fdatasync d0/f6 0 2024-09-15T22:26:38.540 INFO:tasks.workunit.client.0.smithi001.stdout:7/70: symlink d0/d7/df/l1a 0 2024-09-15T22:26:38.570 INFO:tasks.workunit.client.0.smithi001.stdout:5/102: dread d3/d6/f8 [0,4194304] 0 2024-09-15T22:26:38.570 INFO:tasks.workunit.client.0.smithi001.stdout:5/103: readlink d3/l11 0 2024-09-15T22:26:38.570 INFO:tasks.workunit.client.0.smithi001.stdout:5/104: chown d3/c1b 112650 1 2024-09-15T22:26:38.570 INFO:tasks.workunit.client.0.smithi001.stdout:5/105: fsync d3/d6/fe 0 2024-09-15T22:26:38.570 INFO:tasks.workunit.client.0.smithi001.stdout:5/106: read - d3/d6/f20 zero size 2024-09-15T22:26:38.570 INFO:tasks.workunit.client.0.smithi001.stdout:5/107: dread - d3/f16 zero size 2024-09-15T22:26:38.570 INFO:tasks.workunit.client.0.smithi001.stdout:5/108: dread - d3/f16 zero size 2024-09-15T22:26:38.576 INFO:tasks.workunit.client.0.smithi001.stdout:5/109: write d3/d6/f7 [85113,73165] 0 2024-09-15T22:26:38.578 INFO:tasks.workunit.client.0.smithi001.stdout:4/128: sync 2024-09-15T22:26:38.578 INFO:tasks.workunit.client.0.smithi001.stdout:8/81: sync 2024-09-15T22:26:38.579 INFO:tasks.workunit.client.0.smithi001.stdout:5/110: symlink d3/l21 0 2024-09-15T22:26:38.580 INFO:tasks.workunit.client.0.smithi001.stdout:4/129: creat d0/d27/f36 x:0 0 0 2024-09-15T22:26:38.582 INFO:tasks.workunit.client.0.smithi001.stdout:8/82: creat d9/f18 x:0 0 0 2024-09-15T22:26:38.585 INFO:tasks.workunit.client.0.smithi001.stdout:8/83: mkdir d9/d19 0 2024-09-15T22:26:38.589 INFO:tasks.workunit.client.0.smithi001.stdout:6/72: dwrite d0/fb [0,4194304] 0 2024-09-15T22:26:38.589 INFO:tasks.workunit.client.0.smithi001.stdout:6/73: fsync d0/f9 0 2024-09-15T22:26:38.593 INFO:tasks.workunit.client.0.smithi001.stdout:5/111: write d3/fc [74652,73809] 0 2024-09-15T22:26:38.595 INFO:tasks.workunit.client.0.smithi001.stdout:5/112: mkdir d3/d22 0 2024-09-15T22:26:38.596 INFO:tasks.workunit.client.0.smithi001.stdout:1/121: dwrite d3/f7 [0,4194304] 0 2024-09-15T22:26:38.603 INFO:tasks.workunit.client.0.smithi001.stdout:4/130: dread d0/d16/f22 [0,4194304] 0 2024-09-15T22:26:38.603 INFO:tasks.workunit.client.0.smithi001.stdout:4/131: truncate d0/d27/f36 808398 0 2024-09-15T22:26:38.603 INFO:tasks.workunit.client.0.smithi001.stdout:3/96: dwrite da/d16/ff [0,4194304] 0 2024-09-15T22:26:38.607 INFO:tasks.workunit.client.0.smithi001.stdout:5/113: truncate d3/d6/f7 700974 0 2024-09-15T22:26:38.621 INFO:tasks.workunit.client.0.smithi001.stdout:9/51: dwrite f4 [0,4194304] 0 2024-09-15T22:26:38.624 INFO:tasks.workunit.client.0.smithi001.stdout:4/132: dread d0/d16/d20/f25 [0,4194304] 0 2024-09-15T22:26:38.630 INFO:tasks.workunit.client.0.smithi001.stdout:9/52: mknod d5/d7/c8 0 2024-09-15T22:26:38.630 INFO:tasks.workunit.client.0.smithi001.stdout:4/133: symlink d0/d27/l37 0 2024-09-15T22:26:38.630 INFO:tasks.workunit.client.0.smithi001.stdout:9/53: fsync f4 0 2024-09-15T22:26:38.631 INFO:tasks.workunit.client.0.smithi001.stdout:4/134: creat d0/d16/d20/f38 x:0 0 0 2024-09-15T22:26:38.638 INFO:tasks.workunit.client.0.smithi001.stdout:9/54: mknod d5/d7/c9 0 2024-09-15T22:26:38.638 INFO:tasks.workunit.client.0.smithi001.stdout:9/55: stat c2 0 2024-09-15T22:26:38.638 INFO:tasks.workunit.client.0.smithi001.stdout:9/56: chown d5/c6 43908 1 2024-09-15T22:26:38.639 INFO:tasks.workunit.client.0.smithi001.stdout:9/57: truncate f4 1300701 0 2024-09-15T22:26:38.639 INFO:tasks.workunit.client.0.smithi001.stdout:9/58: stat c2 0 2024-09-15T22:26:38.640 INFO:tasks.workunit.client.0.smithi001.stdout:9/59: rename f0 to d5/fa 0 2024-09-15T22:26:38.641 INFO:tasks.workunit.client.0.smithi001.stdout:7/71: dwrite d0/d7/df/f11 [0,4194304] 0 2024-09-15T22:26:38.642 INFO:tasks.workunit.client.0.smithi001.stdout:9/60: mknod d5/d7/cb 0 2024-09-15T22:26:38.644 INFO:tasks.workunit.client.0.smithi001.stdout:7/72: symlink d0/d7/df/l1b 0 2024-09-15T22:26:38.645 INFO:tasks.workunit.client.0.smithi001.stdout:9/61: rename d5/fa to d5/fc 0 2024-09-15T22:26:38.647 INFO:tasks.workunit.client.0.smithi001.stdout:9/62: rename c2 to d5/d7/cd 0 2024-09-15T22:26:38.648 INFO:tasks.workunit.client.0.smithi001.stdout:9/63: fdatasync d5/fc 0 2024-09-15T22:26:38.649 INFO:tasks.workunit.client.0.smithi001.stdout:9/64: mkdir d5/de 0 2024-09-15T22:26:38.651 INFO:tasks.workunit.client.0.smithi001.stdout:9/65: mknod d5/d7/cf 0 2024-09-15T22:26:38.653 INFO:tasks.workunit.client.0.smithi001.stdout:5/114: fsync d3/fc 0 2024-09-15T22:26:38.662 INFO:tasks.workunit.client.0.smithi001.stdout:1/122: dwrite d3/d12/d21/f22 [0,4194304] 0 2024-09-15T22:26:38.662 INFO:tasks.workunit.client.0.smithi001.stdout:6/74: dwrite d0/f11 [0,4194304] 0 2024-09-15T22:26:38.662 INFO:tasks.workunit.client.0.smithi001.stdout:6/75: readlink d0/d7/l8 0 2024-09-15T22:26:38.664 INFO:tasks.workunit.client.0.smithi001.stdout:5/115: rename d3/d6/c10 to d3/d6/c23 0 2024-09-15T22:26:38.668 INFO:tasks.workunit.client.0.smithi001.stdout:8/84: dwrite f5 [0,4194304] 0 2024-09-15T22:26:38.668 INFO:tasks.workunit.client.0.smithi001.stdout:1/123: rename d3/d12/f1d to d3/dd/d14/f25 0 2024-09-15T22:26:38.669 INFO:tasks.workunit.client.0.smithi001.stdout:6/76: symlink d0/d6/l1e 0 2024-09-15T22:26:38.669 INFO:tasks.workunit.client.0.smithi001.stdout:6/77: readlink d0/l10 0 2024-09-15T22:26:38.670 INFO:tasks.workunit.client.0.smithi001.stdout:5/116: creat d3/f24 x:0 0 0 2024-09-15T22:26:38.672 INFO:tasks.workunit.client.0.smithi001.stdout:8/85: mknod d9/c1a 0 2024-09-15T22:26:38.675 INFO:tasks.workunit.client.0.smithi001.stdout:1/124: rmdir d3/dd/d14 39 2024-09-15T22:26:38.676 INFO:tasks.workunit.client.0.smithi001.stdout:1/125: dread - d3/d12/f1e zero size 2024-09-15T22:26:38.676 INFO:tasks.workunit.client.0.smithi001.stdout:2/83: dwrite d2/df/f13 [0,4194304] 0 2024-09-15T22:26:38.677 INFO:tasks.workunit.client.0.smithi001.stdout:2/84: rmdir d2/d14 39 2024-09-15T22:26:38.677 INFO:tasks.workunit.client.0.smithi001.stdout:2/85: symlink d2/d14/l1e 0 2024-09-15T22:26:38.678 INFO:tasks.workunit.client.0.smithi001.stdout:2/86: chown d2/d12 1012965 1 2024-09-15T22:26:38.679 INFO:tasks.workunit.client.0.smithi001.stdout:2/87: mkdir d2/d14/d17/d1f 0 2024-09-15T22:26:38.691 INFO:tasks.workunit.client.0.smithi001.stdout:2/88: unlink d2/d14/d17/l18 0 2024-09-15T22:26:38.691 INFO:tasks.workunit.client.0.smithi001.stdout:2/89: read d2/f11 [2263804,87995] 0 2024-09-15T22:26:38.698 INFO:tasks.workunit.client.0.smithi001.stdout:3/97: dwrite da/d16/ff [4194304,4194304] 0 2024-09-15T22:26:38.712 INFO:tasks.workunit.client.0.smithi001.stdout:4/135: dwrite d0/d16/d20/f28 [0,4194304] 0 2024-09-15T22:26:38.714 INFO:tasks.workunit.client.0.smithi001.stdout:5/117: dread d3/d6/fe [0,4194304] 0 2024-09-15T22:26:38.715 INFO:tasks.workunit.client.0.smithi001.stdout:2/90: write d2/df/f13 [2342692,121718] 0 2024-09-15T22:26:38.717 INFO:tasks.workunit.client.0.smithi001.stdout:1/126: dread d3/dd/f13 [0,4194304] 0 2024-09-15T22:26:38.721 INFO:tasks.workunit.client.0.smithi001.stdout:4/136: creat d0/d16/d20/d29/d34/f39 x:0 0 0 2024-09-15T22:26:38.723 INFO:tasks.workunit.client.0.smithi001.stdout:2/91: rename d2/df to d2/d14/d1a/d20 0 2024-09-15T22:26:38.723 INFO:tasks.workunit.client.0.smithi001.stdout:2/92: stat d2/l7 0 2024-09-15T22:26:38.724 INFO:tasks.workunit.client.0.smithi001.stdout:9/66: dwrite d5/fc [4194304,4194304] 0 2024-09-15T22:26:38.724 INFO:tasks.workunit.client.0.smithi001.stdout:1/127: creat d3/dd/d14/d1b/f26 x:0 0 0 2024-09-15T22:26:38.725 INFO:tasks.workunit.client.0.smithi001.stdout:4/137: mkdir d0/d16/d20/d29/d34/d3a 0 2024-09-15T22:26:38.730 INFO:tasks.workunit.client.0.smithi001.stdout:9/67: link d5/c6 d5/c10 0 2024-09-15T22:26:38.731 INFO:tasks.workunit.client.0.smithi001.stdout:9/68: chown c3 59 1 2024-09-15T22:26:38.731 INFO:tasks.workunit.client.0.smithi001.stdout:1/128: truncate d3/f4 2357514 0 2024-09-15T22:26:38.732 INFO:tasks.workunit.client.0.smithi001.stdout:1/129: write d3/d12/d21/f22 [4748355,73540] 0 2024-09-15T22:26:38.732 INFO:tasks.workunit.client.0.smithi001.stdout:1/130: fdatasync d3/dd/d14/d1b/f26 0 2024-09-15T22:26:38.733 INFO:tasks.workunit.client.0.smithi001.stdout:4/138: symlink d0/d16/d20/d29/d34/l3b 0 2024-09-15T22:26:38.733 INFO:tasks.workunit.client.0.smithi001.stdout:4/139: write d0/f11 [678461,2661] 0 2024-09-15T22:26:38.735 INFO:tasks.workunit.client.0.smithi001.stdout:4/140: unlink d0/f2e 0 2024-09-15T22:26:38.737 INFO:tasks.workunit.client.0.smithi001.stdout:6/78: dwrite d0/f3 [0,4194304] 0 2024-09-15T22:26:38.737 INFO:tasks.workunit.client.0.smithi001.stdout:6/79: chown d0/df/c1b 12522251 1 2024-09-15T22:26:38.737 INFO:tasks.workunit.client.0.smithi001.stdout:6/80: write d0/df/f18 [2184,101443] 0 2024-09-15T22:26:38.737 INFO:tasks.workunit.client.0.smithi001.stdout:1/131: dread d3/dd/f13 [0,4194304] 0 2024-09-15T22:26:38.737 INFO:tasks.workunit.client.0.smithi001.stdout:1/132: fsync d3/dd/f13 0 2024-09-15T22:26:38.738 INFO:tasks.workunit.client.0.smithi001.stdout:4/141: creat d0/d16/f3c x:0 0 0 2024-09-15T22:26:38.739 INFO:tasks.workunit.client.0.smithi001.stdout:6/81: getdents d0/d7/d1c 0 2024-09-15T22:26:38.740 INFO:tasks.workunit.client.0.smithi001.stdout:2/93: rename d2/d5 to d2/d14/d17/d1f/d21 0 2024-09-15T22:26:38.742 INFO:tasks.workunit.client.0.smithi001.stdout:1/133: creat d3/f27 x:0 0 0 2024-09-15T22:26:38.742 INFO:tasks.workunit.client.0.smithi001.stdout:8/86: dwrite d9/fb [0,4194304] 0 2024-09-15T22:26:38.744 INFO:tasks.workunit.client.0.smithi001.stdout:4/142: creat d0/d27/f3d x:0 0 0 2024-09-15T22:26:38.745 INFO:tasks.workunit.client.0.smithi001.stdout:4/143: chown d0/d16/l33 1 1 2024-09-15T22:26:38.745 INFO:tasks.workunit.client.0.smithi001.stdout:4/144: write d0/d27/f36 [1635308,81262] 0 2024-09-15T22:26:38.747 INFO:tasks.workunit.client.0.smithi001.stdout:2/94: creat d2/d14/d1a/d1b/f22 x:0 0 0 2024-09-15T22:26:38.748 INFO:tasks.workunit.client.0.smithi001.stdout:1/134: truncate d3/f5 853367 0 2024-09-15T22:26:38.748 INFO:tasks.workunit.client.0.smithi001.stdout:8/87: symlink d9/d19/l1b 0 2024-09-15T22:26:38.748 INFO:tasks.workunit.client.0.smithi001.stdout:8/88: truncate d9/f11 69990 0 2024-09-15T22:26:38.749 INFO:tasks.workunit.client.0.smithi001.stdout:9/69: read d5/fc [7784192,119448] 0 2024-09-15T22:26:38.751 INFO:tasks.workunit.client.0.smithi001.stdout:1/135: unlink d3/f27 0 2024-09-15T22:26:38.751 INFO:tasks.workunit.client.0.smithi001.stdout:4/145: creat d0/d27/d35/f3e x:0 0 0 2024-09-15T22:26:38.753 INFO:tasks.workunit.client.0.smithi001.stdout:7/73: dwrite d0/d7/f17 [0,4194304] 0 2024-09-15T22:26:38.753 INFO:tasks.workunit.client.0.smithi001.stdout:1/136: mknod d3/dd/d14/d23/c28 0 2024-09-15T22:26:38.754 INFO:tasks.workunit.client.0.smithi001.stdout:3/98: dwrite da/fe [0,4194304] 0 2024-09-15T22:26:38.764 INFO:tasks.workunit.client.0.smithi001.stdout:1/137: dread d3/d12/d21/f22 [4194304,4194304] 0 2024-09-15T22:26:38.764 INFO:tasks.workunit.client.0.smithi001.stdout:1/138: fsync d3/f9 0 2024-09-15T22:26:38.775 INFO:tasks.workunit.client.0.smithi001.stdout:4/146: dread d0/d16/f19 [0,4194304] 0 2024-09-15T22:26:38.775 INFO:tasks.workunit.client.0.smithi001.stdout:4/147: chown d0/d16/l33 15780591 1 2024-09-15T22:26:38.775 INFO:tasks.workunit.client.0.smithi001.stdout:8/89: write f5 [2010494,62649] 0 2024-09-15T22:26:38.776 INFO:tasks.workunit.client.0.smithi001.stdout:8/90: write f8 [692488,48066] 0 2024-09-15T22:26:38.794 INFO:tasks.workunit.client.0.smithi001.stdout:3/99: dread f5 [0,4194304] 0 2024-09-15T22:26:38.795 INFO:tasks.workunit.client.0.smithi001.stdout:3/100: write da/f13 [706225,69912] 0 2024-09-15T22:26:38.820 INFO:tasks.workunit.client.0.smithi001.stdout:7/74: unlink d0/d7/df/l1b 0 2024-09-15T22:26:38.822 INFO:tasks.workunit.client.0.smithi001.stdout:6/82: dwrite d0/d7/fe [0,4194304] 0 2024-09-15T22:26:38.822 INFO:tasks.workunit.client.0.smithi001.stdout:6/83: truncate d0/d7/d1c/f1d 1031443 0 2024-09-15T22:26:38.822 INFO:tasks.workunit.client.0.smithi001.stdout:0/85: sync 2024-09-15T22:26:38.825 INFO:tasks.workunit.client.0.smithi001.stdout:4/148: mknod d0/d16/d20/d29/d34/c3f 0 2024-09-15T22:26:38.825 INFO:tasks.workunit.client.0.smithi001.stdout:8/91: getdents d9 0 2024-09-15T22:26:38.825 INFO:tasks.workunit.client.0.smithi001.stdout:7/75: creat d0/d7/df/f1c x:0 0 0 2024-09-15T22:26:38.826 INFO:tasks.workunit.client.0.smithi001.stdout:0/86: unlink d0/dd/d1b/c1d 0 2024-09-15T22:26:38.826 INFO:tasks.workunit.client.0.smithi001.stdout:0/87: fsync d0/d6/f18 0 2024-09-15T22:26:38.827 INFO:tasks.workunit.client.0.smithi001.stdout:4/149: mkdir d0/d16/d20/d29/d40 0 2024-09-15T22:26:38.828 INFO:tasks.workunit.client.0.smithi001.stdout:0/88: symlink d0/l1f 0 2024-09-15T22:26:38.828 INFO:tasks.workunit.client.0.smithi001.stdout:0/89: stat d0/f8 0 2024-09-15T22:26:38.829 INFO:tasks.workunit.client.0.smithi001.stdout:4/150: read d0/f1c [967651,85510] 0 2024-09-15T22:26:38.829 INFO:tasks.workunit.client.0.smithi001.stdout:1/139: dwrite d3/dd/f13 [0,4194304] 0 2024-09-15T22:26:38.830 INFO:tasks.workunit.client.0.smithi001.stdout:4/151: truncate d0/fd 2013586 0 2024-09-15T22:26:38.830 INFO:tasks.workunit.client.0.smithi001.stdout:4/152: chown d0/fe 162 1 2024-09-15T22:26:38.831 INFO:tasks.workunit.client.0.smithi001.stdout:1/140: mknod d3/dd/c29 0 2024-09-15T22:26:38.831 INFO:tasks.workunit.client.0.smithi001.stdout:4/153: unlink d0/f1c 0 2024-09-15T22:26:38.833 INFO:tasks.workunit.client.0.smithi001.stdout:4/154: creat d0/d16/d20/d29/d34/f41 x:0 0 0 2024-09-15T22:26:38.833 INFO:tasks.workunit.client.0.smithi001.stdout:4/155: rename d0/d16/d20 to d0/d16/d20/d29/d40/d42 22 2024-09-15T22:26:38.833 INFO:tasks.workunit.client.0.smithi001.stdout:4/156: chown d0/l3 315 1 2024-09-15T22:26:38.835 INFO:tasks.workunit.client.0.smithi001.stdout:0/90: link d0/c12 d0/dd/c20 0 2024-09-15T22:26:38.836 INFO:tasks.workunit.client.0.smithi001.stdout:0/91: creat d0/dd/d1b/f21 x:0 0 0 2024-09-15T22:26:38.838 INFO:tasks.workunit.client.0.smithi001.stdout:0/92: mknod d0/d6/c22 0 2024-09-15T22:26:38.849 INFO:tasks.workunit.client.0.smithi001.stdout:8/92: dread d9/fd [0,4194304] 0 2024-09-15T22:26:38.852 INFO:tasks.workunit.client.0.smithi001.stdout:0/93: creat d0/f23 x:0 0 0 2024-09-15T22:26:38.855 INFO:tasks.workunit.client.0.smithi001.stdout:0/94: rmdir d0/d9 39 2024-09-15T22:26:38.855 INFO:tasks.workunit.client.0.smithi001.stdout:0/95: fdatasync d0/d9/db/f10 0 2024-09-15T22:26:38.863 INFO:tasks.workunit.client.0.smithi001.stdout:0/96: mknod d0/c24 0 2024-09-15T22:26:38.871 INFO:tasks.workunit.client.0.smithi001.stdout:9/70: dwrite d5/fc [8388608,4194304] 0 2024-09-15T22:26:38.871 INFO:tasks.workunit.client.0.smithi001.stdout:9/71: readlink - no filename 2024-09-15T22:26:38.875 INFO:tasks.workunit.client.0.smithi001.stdout:0/97: dread d0/f7 [0,4194304] 0 2024-09-15T22:26:38.885 INFO:tasks.workunit.client.0.smithi001.stdout:9/72: dread f4 [0,4194304] 0 2024-09-15T22:26:38.887 INFO:tasks.workunit.client.0.smithi001.stdout:9/73: rename d5/fc to d5/f11 0 2024-09-15T22:26:38.900 INFO:tasks.workunit.client.0.smithi001.stdout:2/95: dwrite d2/f11 [0,4194304] 0 2024-09-15T22:26:38.901 INFO:tasks.workunit.client.0.smithi001.stdout:2/96: creat d2/d14/d17/d1f/d21/f23 x:0 0 0 2024-09-15T22:26:38.901 INFO:tasks.workunit.client.0.smithi001.stdout:2/97: write d2/d14/d17/d1f/d21/fe [901822,32672] 0 2024-09-15T22:26:38.901 INFO:tasks.workunit.client.0.smithi001.stdout:2/98: read - d2/d14/d1a/d1b/f22 zero size 2024-09-15T22:26:38.903 INFO:tasks.workunit.client.0.smithi001.stdout:2/99: symlink d2/d14/d17/d1f/d21/l24 0 2024-09-15T22:26:38.903 INFO:tasks.workunit.client.0.smithi001.stdout:2/100: stat d2/c16 0 2024-09-15T22:26:38.905 INFO:tasks.workunit.client.0.smithi001.stdout:2/101: link d2/f10 d2/d14/d17/d1f/f25 0 2024-09-15T22:26:38.905 INFO:tasks.workunit.client.0.smithi001.stdout:0/98: dread d0/f2 [0,4194304] 0 2024-09-15T22:26:38.909 INFO:tasks.workunit.client.0.smithi001.stdout:2/102: getdents d2/d14/d1a/d20 0 2024-09-15T22:26:38.910 INFO:tasks.workunit.client.0.smithi001.stdout:0/99: creat d0/d9/db/f25 x:0 0 0 2024-09-15T22:26:38.910 INFO:tasks.workunit.client.0.smithi001.stdout:7/76: dwrite d0/f6 [4194304,4194304] 0 2024-09-15T22:26:38.911 INFO:tasks.workunit.client.0.smithi001.stdout:2/103: creat d2/d14/d1a/d1b/f26 x:0 0 0 2024-09-15T22:26:38.911 INFO:tasks.workunit.client.0.smithi001.stdout:0/100: read d0/d9/db/f19 [238611,56205] 0 2024-09-15T22:26:38.912 INFO:tasks.workunit.client.0.smithi001.stdout:0/101: write d0/d9/f1c [696811,75060] 0 2024-09-15T22:26:38.914 INFO:tasks.workunit.client.0.smithi001.stdout:2/104: truncate d2/d12/f1c 168795 0 2024-09-15T22:26:38.916 INFO:tasks.workunit.client.0.smithi001.stdout:0/102: getdents d0/d6 0 2024-09-15T22:26:38.919 INFO:tasks.workunit.client.0.smithi001.stdout:1/141: dwrite d3/d12/d21/f22 [0,4194304] 0 2024-09-15T22:26:38.919 INFO:tasks.workunit.client.0.smithi001.stdout:3/101: dwrite f7 [0,4194304] 0 2024-09-15T22:26:38.919 INFO:tasks.workunit.client.0.smithi001.stdout:3/102: chown da/f1c 267545899 1 2024-09-15T22:26:38.919 INFO:tasks.workunit.client.0.smithi001.stdout:6/84: dwrite d0/d7/fe [0,4194304] 0 2024-09-15T22:26:38.919 INFO:tasks.workunit.client.0.smithi001.stdout:3/103: read f2 [4241729,102771] 0 2024-09-15T22:26:38.923 INFO:tasks.workunit.client.0.smithi001.stdout:2/105: dread d2/f10 [0,4194304] 0 2024-09-15T22:26:38.927 INFO:tasks.workunit.client.0.smithi001.stdout:0/103: creat d0/d9/f26 x:0 0 0 2024-09-15T22:26:38.927 INFO:tasks.workunit.client.0.smithi001.stdout:0/104: readlink d0/l1f 0 2024-09-15T22:26:38.928 INFO:tasks.workunit.client.0.smithi001.stdout:0/105: dread - d0/d6/f15 zero size 2024-09-15T22:26:38.928 INFO:tasks.workunit.client.0.smithi001.stdout:7/77: dread d0/d7/f18 [0,4194304] 0 2024-09-15T22:26:38.928 INFO:tasks.workunit.client.0.smithi001.stdout:6/85: symlink d0/df/l1f 0 2024-09-15T22:26:38.928 INFO:tasks.workunit.client.0.smithi001.stdout:6/86: write d0/d6/f17 [136663,75974] 0 2024-09-15T22:26:38.928 INFO:tasks.workunit.client.0.smithi001.stdout:3/104: chown da/d14/c15 227335427 1 2024-09-15T22:26:38.929 INFO:tasks.workunit.client.0.smithi001.stdout:8/93: dwrite f7 [0,4194304] 0 2024-09-15T22:26:38.929 INFO:tasks.workunit.client.0.smithi001.stdout:8/94: chown d9/c1a 11 1 2024-09-15T22:26:38.930 INFO:tasks.workunit.client.0.smithi001.stdout:1/142: dread d3/f7 [0,4194304] 0 2024-09-15T22:26:38.930 INFO:tasks.workunit.client.0.smithi001.stdout:1/143: dread - d3/dd/d14/d1b/f26 zero size 2024-09-15T22:26:38.932 INFO:tasks.workunit.client.0.smithi001.stdout:6/87: rename d0/df/c1b to d0/df/c20 0 2024-09-15T22:26:38.934 INFO:tasks.workunit.client.0.smithi001.stdout:3/105: truncate f7 3574702 0 2024-09-15T22:26:38.936 INFO:tasks.workunit.client.0.smithi001.stdout:5/118: sync 2024-09-15T22:26:38.938 INFO:tasks.workunit.client.0.smithi001.stdout:5/119: rmdir d3/d22 0 2024-09-15T22:26:38.940 INFO:tasks.workunit.client.0.smithi001.stdout:5/120: mkdir d3/d6/d25 0 2024-09-15T22:26:38.948 INFO:tasks.workunit.client.0.smithi001.stdout:5/121: link d3/ld d3/l26 0 2024-09-15T22:26:38.948 INFO:tasks.workunit.client.0.smithi001.stdout:3/106: dread f6 [0,4194304] 0 2024-09-15T22:26:38.948 INFO:tasks.workunit.client.0.smithi001.stdout:8/95: dread f5 [0,4194304] 0 2024-09-15T22:26:38.948 INFO:tasks.workunit.client.0.smithi001.stdout:2/106: dread d2/d14/d1a/d20/f19 [0,4194304] 0 2024-09-15T22:26:38.948 INFO:tasks.workunit.client.0.smithi001.stdout:3/107: creat da/d14/f20 x:0 0 0 2024-09-15T22:26:38.949 INFO:tasks.workunit.client.0.smithi001.stdout:3/108: read - da/d16/f1e zero size 2024-09-15T22:26:38.950 INFO:tasks.workunit.client.0.smithi001.stdout:2/107: rename d2/f11 to d2/d14/f27 0 2024-09-15T22:26:38.950 INFO:tasks.workunit.client.0.smithi001.stdout:2/108: write d2/d14/d17/d1f/f25 [551417,79266] 0 2024-09-15T22:26:38.951 INFO:tasks.workunit.client.0.smithi001.stdout:3/109: rename da/d16/cc to da/d1f/c21 0 2024-09-15T22:26:38.952 INFO:tasks.workunit.client.0.smithi001.stdout:3/110: creat da/d1f/f22 x:0 0 0 2024-09-15T22:26:38.952 INFO:tasks.workunit.client.0.smithi001.stdout:6/88: dread d0/f9 [0,4194304] 0 2024-09-15T22:26:38.954 INFO:tasks.workunit.client.0.smithi001.stdout:3/111: mknod da/d17/c23 0 2024-09-15T22:26:38.954 INFO:tasks.workunit.client.0.smithi001.stdout:6/89: mkdir d0/d6/d21 0 2024-09-15T22:26:38.954 INFO:tasks.workunit.client.0.smithi001.stdout:6/90: readlink d0/d6/l15 0 2024-09-15T22:26:38.964 INFO:tasks.workunit.client.0.smithi001.stdout:2/109: getdents d2/d14 0 2024-09-15T22:26:38.964 INFO:tasks.workunit.client.0.smithi001.stdout:2/110: chown d2/d14/d17/l1d 17 1 2024-09-15T22:26:38.964 INFO:tasks.workunit.client.0.smithi001.stdout:2/111: dread - d2/d14/f15 zero size 2024-09-15T22:26:38.964 INFO:tasks.workunit.client.0.smithi001.stdout:7/78: dread d0/d7/f17 [0,4194304] 0 2024-09-15T22:26:38.965 INFO:tasks.workunit.client.0.smithi001.stdout:6/91: creat d0/f22 x:0 0 0 2024-09-15T22:26:38.965 INFO:tasks.workunit.client.0.smithi001.stdout:7/79: read d0/d7/f18 [1015587,16960] 0 2024-09-15T22:26:38.965 INFO:tasks.workunit.client.0.smithi001.stdout:7/80: chown d0/d7/fd 779 1 2024-09-15T22:26:38.965 INFO:tasks.workunit.client.0.smithi001.stdout:6/92: fdatasync d0/f3 0 2024-09-15T22:26:38.965 INFO:tasks.workunit.client.0.smithi001.stdout:6/93: write d0/df/f18 [808603,39066] 0 2024-09-15T22:26:38.965 INFO:tasks.workunit.client.0.smithi001.stdout:7/81: symlink d0/l1d 0 2024-09-15T22:26:38.965 INFO:tasks.workunit.client.0.smithi001.stdout:6/94: creat d0/d6/f23 x:0 0 0 2024-09-15T22:26:38.965 INFO:tasks.workunit.client.0.smithi001.stdout:6/95: fsync d0/d6/fd 0 2024-09-15T22:26:38.965 INFO:tasks.workunit.client.0.smithi001.stdout:6/96: mkdir d0/df/d24 0 2024-09-15T22:26:38.966 INFO:tasks.workunit.client.0.smithi001.stdout:6/97: symlink d0/df/l25 0 2024-09-15T22:26:38.966 INFO:tasks.workunit.client.0.smithi001.stdout:6/98: stat d0/d7/ca 0 2024-09-15T22:26:38.966 INFO:tasks.workunit.client.0.smithi001.stdout:6/99: fsync d0/d7/fe 0 2024-09-15T22:26:38.966 INFO:tasks.workunit.client.0.smithi001.stdout:1/144: dread d3/f5 [0,4194304] 0 2024-09-15T22:26:38.966 INFO:tasks.workunit.client.0.smithi001.stdout:1/145: fdatasync d3/d12/d21/f22 0 2024-09-15T22:26:38.966 INFO:tasks.workunit.client.0.smithi001.stdout:1/146: write d3/f9 [2414327,100007] 0 2024-09-15T22:26:38.968 INFO:tasks.workunit.client.0.smithi001.stdout:5/122: dread d3/d6/f8 [0,4194304] 0 2024-09-15T22:26:38.968 INFO:tasks.workunit.client.0.smithi001.stdout:5/123: chown d3/l11 504460 1 2024-09-15T22:26:38.972 INFO:tasks.workunit.client.0.smithi001.stdout:6/100: creat d0/d7/f26 x:0 0 0 2024-09-15T22:26:38.982 INFO:tasks.workunit.client.0.smithi001.stdout:1/147: rmdir d3/dd/d14/d23 39 2024-09-15T22:26:38.982 INFO:tasks.workunit.client.0.smithi001.stdout:6/101: link d0/d6/cc d0/d7/c27 0 2024-09-15T22:26:38.983 INFO:tasks.workunit.client.0.smithi001.stdout:5/124: mkdir d3/d27 0 2024-09-15T22:26:38.983 INFO:tasks.workunit.client.0.smithi001.stdout:1/148: symlink d3/dd/d14/d1b/l2a 0 2024-09-15T22:26:38.983 INFO:tasks.workunit.client.0.smithi001.stdout:1/149: chown d3/dd/f13 15 1 2024-09-15T22:26:38.984 INFO:tasks.workunit.client.0.smithi001.stdout:5/125: truncate d3/fc 121389 0 2024-09-15T22:26:38.986 INFO:tasks.workunit.client.0.smithi001.stdout:6/102: rmdir d0 39 2024-09-15T22:26:38.991 INFO:tasks.workunit.client.0.smithi001.stdout:5/126: write d3/fc [619245,50185] 0 2024-09-15T22:26:38.991 INFO:tasks.workunit.client.0.smithi001.stdout:5/127: write d3/d6/f8 [5071871,7554] 0 2024-09-15T22:26:38.991 INFO:tasks.workunit.client.0.smithi001.stdout:5/128: stat d3/d6/d25 0 2024-09-15T22:26:38.992 INFO:tasks.workunit.client.0.smithi001.stdout:6/103: write d0/f22 [740759,124021] 0 2024-09-15T22:26:39.007 INFO:tasks.workunit.client.0.smithi001.stdout:2/112: dwrite d2/d14/d1a/d20/f19 [0,4194304] 0 2024-09-15T22:26:39.010 INFO:tasks.workunit.client.0.smithi001.stdout:5/129: mknod d3/d27/c28 0 2024-09-15T22:26:39.010 INFO:tasks.workunit.client.0.smithi001.stdout:5/130: read - d3/d6/f20 zero size 2024-09-15T22:26:39.015 INFO:tasks.workunit.client.0.smithi001.stdout:8/96: dwrite d9/f18 [0,4194304] 0 2024-09-15T22:26:39.015 INFO:tasks.workunit.client.0.smithi001.stdout:8/97: chown d9/c1a 61 1 2024-09-15T22:26:39.015 INFO:tasks.workunit.client.0.smithi001.stdout:8/98: truncate d9/ff 143329 0 2024-09-15T22:26:39.016 INFO:tasks.workunit.client.0.smithi001.stdout:6/104: rename d0/d7/l8 to d0/df/l28 0 2024-09-15T22:26:39.016 INFO:tasks.workunit.client.0.smithi001.stdout:2/113: mknod d2/d14/d1a/d1b/c28 0 2024-09-15T22:26:39.017 INFO:tasks.workunit.client.0.smithi001.stdout:5/131: creat d3/d1d/f29 x:0 0 0 2024-09-15T22:26:39.019 INFO:tasks.workunit.client.0.smithi001.stdout:8/99: mknod d9/c1c 0 2024-09-15T22:26:39.019 INFO:tasks.workunit.client.0.smithi001.stdout:8/100: write f7 [4875448,90181] 0 2024-09-15T22:26:39.019 INFO:tasks.workunit.client.0.smithi001.stdout:8/101: fsync d9/f11 0 2024-09-15T22:26:39.019 INFO:tasks.workunit.client.0.smithi001.stdout:6/105: truncate d0/f4 3270811 0 2024-09-15T22:26:39.019 INFO:tasks.workunit.client.0.smithi001.stdout:8/102: write d9/ff [66245,15104] 0 2024-09-15T22:26:39.019 INFO:tasks.workunit.client.0.smithi001.stdout:2/114: mknod d2/d14/d17/d1f/c29 0 2024-09-15T22:26:39.021 INFO:tasks.workunit.client.0.smithi001.stdout:5/132: creat d3/f2a x:0 0 0 2024-09-15T22:26:39.021 INFO:tasks.workunit.client.0.smithi001.stdout:8/103: creat d9/f1d x:0 0 0 2024-09-15T22:26:39.022 INFO:tasks.workunit.client.0.smithi001.stdout:3/112: dwrite da/d14/f20 [0,4194304] 0 2024-09-15T22:26:39.022 INFO:tasks.workunit.client.0.smithi001.stdout:2/115: creat d2/d14/d1a/d20/f2a x:0 0 0 2024-09-15T22:26:39.022 INFO:tasks.workunit.client.0.smithi001.stdout:2/116: stat d2/d14/d1a/d1b/f26 0 2024-09-15T22:26:39.023 INFO:tasks.workunit.client.0.smithi001.stdout:5/133: mknod d3/c2b 0 2024-09-15T22:26:39.023 INFO:tasks.workunit.client.0.smithi001.stdout:5/134: chown d3 754611 1 2024-09-15T22:26:39.023 INFO:tasks.workunit.client.0.smithi001.stdout:5/135: truncate d3/f24 832385 0 2024-09-15T22:26:39.023 INFO:tasks.workunit.client.0.smithi001.stdout:5/136: write d3/d6/f8 [5176462,9502] 0 2024-09-15T22:26:39.024 INFO:tasks.workunit.client.0.smithi001.stdout:5/137: fsync d3/f24 0 2024-09-15T22:26:39.026 INFO:tasks.workunit.client.0.smithi001.stdout:3/113: creat da/d1f/f24 x:0 0 0 2024-09-15T22:26:39.030 INFO:tasks.workunit.client.0.smithi001.stdout:5/138: creat d3/d6/d25/f2c x:0 0 0 2024-09-15T22:26:39.030 INFO:tasks.workunit.client.0.smithi001.stdout:5/139: dread - d3/d1d/f29 zero size 2024-09-15T22:26:39.031 INFO:tasks.workunit.client.0.smithi001.stdout:2/117: rmdir d2 39 2024-09-15T22:26:39.032 INFO:tasks.workunit.client.0.smithi001.stdout:5/140: fsync d3/fc 0 2024-09-15T22:26:39.032 INFO:tasks.workunit.client.0.smithi001.stdout:3/114: creat da/d17/f25 x:0 0 0 2024-09-15T22:26:39.034 INFO:tasks.workunit.client.0.smithi001.stdout:5/141: creat d3/d27/f2d x:0 0 0 2024-09-15T22:26:39.075 INFO:tasks.workunit.client.0.smithi001.stdout:7/82: dwrite d0/d7/fd [0,4194304] 0 2024-09-15T22:26:39.126 INFO:tasks.workunit.client.0.smithi001.stdout:1/150: dwrite d3/d12/f24 [0,4194304] 0 2024-09-15T22:26:39.130 INFO:tasks.workunit.client.0.smithi001.stdout:1/151: mkdir d3/dd/d14/d1b/d2b 0 2024-09-15T22:26:39.130 INFO:tasks.workunit.client.0.smithi001.stdout:1/152: chown d3/dd/d14/d1b/l2a 95212131 1 2024-09-15T22:26:39.132 INFO:tasks.workunit.client.0.smithi001.stdout:9/74: sync 2024-09-15T22:26:39.132 INFO:tasks.workunit.client.0.smithi001.stdout:0/106: sync 2024-09-15T22:26:39.132 INFO:tasks.workunit.client.0.smithi001.stdout:4/157: sync 2024-09-15T22:26:39.132 INFO:tasks.workunit.client.0.smithi001.stdout:0/107: dread - d0/d6/f15 zero size 2024-09-15T22:26:39.133 INFO:tasks.workunit.client.0.smithi001.stdout:9/75: mknod d5/d7/c12 0 2024-09-15T22:26:39.135 INFO:tasks.workunit.client.0.smithi001.stdout:9/76: symlink d5/d7/l13 0 2024-09-15T22:26:39.137 INFO:tasks.workunit.client.0.smithi001.stdout:9/77: symlink d5/de/l14 0 2024-09-15T22:26:39.139 INFO:tasks.workunit.client.0.smithi001.stdout:1/153: dread d3/f5 [0,4194304] 0 2024-09-15T22:26:39.140 INFO:tasks.workunit.client.0.smithi001.stdout:1/154: readlink d3/d12/l16 0 2024-09-15T22:26:39.141 INFO:tasks.workunit.client.0.smithi001.stdout:1/155: symlink d3/dd/d14/d23/l2c 0 2024-09-15T22:26:39.141 INFO:tasks.workunit.client.0.smithi001.stdout:1/156: chown d3/dd/d14/d23/l2c 11690972 1 2024-09-15T22:26:39.141 INFO:tasks.workunit.client.0.smithi001.stdout:1/157: rename d3 to d3/dd/d14/d1b/d2d 22 2024-09-15T22:26:39.142 INFO:tasks.workunit.client.0.smithi001.stdout:9/78: truncate d5/f11 2491441 0 2024-09-15T22:26:39.143 INFO:tasks.workunit.client.0.smithi001.stdout:1/158: unlink d3/d12/l16 0 2024-09-15T22:26:39.143 INFO:tasks.workunit.client.0.smithi001.stdout:4/158: dread d0/d16/f2f [0,4194304] 0 2024-09-15T22:26:39.143 INFO:tasks.workunit.client.0.smithi001.stdout:4/159: fdatasync d0/d27/f3d 0 2024-09-15T22:26:39.146 INFO:tasks.workunit.client.0.smithi001.stdout:9/79: mkdir d5/de/d15 0 2024-09-15T22:26:39.147 INFO:tasks.workunit.client.0.smithi001.stdout:4/160: creat d0/d16/f43 x:0 0 0 2024-09-15T22:26:39.147 INFO:tasks.workunit.client.0.smithi001.stdout:4/161: chown d0/d16/d20/d29/d34/f41 10148160 1 2024-09-15T22:26:39.147 INFO:tasks.workunit.client.0.smithi001.stdout:4/162: truncate d0/d16/f2f 785228 0 2024-09-15T22:26:39.148 INFO:tasks.workunit.client.0.smithi001.stdout:4/163: mkdir d0/d27/d30/d44 0 2024-09-15T22:26:39.148 INFO:tasks.workunit.client.0.smithi001.stdout:4/164: chown d0/l3 441 1 2024-09-15T22:26:39.148 INFO:tasks.workunit.client.0.smithi001.stdout:8/104: dwrite f4 [4194304,4194304] 0 2024-09-15T22:26:39.151 INFO:tasks.workunit.client.0.smithi001.stdout:6/106: dwrite d0/f4 [0,4194304] 0 2024-09-15T22:26:39.153 INFO:tasks.workunit.client.0.smithi001.stdout:4/165: rename d0/d27/d35/f3e to d0/d27/d30/f45 0 2024-09-15T22:26:39.153 INFO:tasks.workunit.client.0.smithi001.stdout:9/80: write f4 [460757,126729] 0 2024-09-15T22:26:39.153 INFO:tasks.workunit.client.0.smithi001.stdout:9/81: readlink d5/de/l14 0 2024-09-15T22:26:39.155 INFO:tasks.workunit.client.0.smithi001.stdout:4/166: unlink d0/fe 0 2024-09-15T22:26:39.155 INFO:tasks.workunit.client.0.smithi001.stdout:4/167: chown d0/l18 185 1 2024-09-15T22:26:39.157 INFO:tasks.workunit.client.0.smithi001.stdout:1/159: dread d3/f4 [0,4194304] 0 2024-09-15T22:26:39.162 INFO:tasks.workunit.client.0.smithi001.stdout:5/142: dwrite d3/f2a [0,4194304] 0 2024-09-15T22:26:39.162 INFO:tasks.workunit.client.0.smithi001.stdout:4/168: link d0/d27/l2b d0/l46 0 2024-09-15T22:26:39.162 INFO:tasks.workunit.client.0.smithi001.stdout:4/169: read - d0/d16/f3c zero size 2024-09-15T22:26:39.162 INFO:tasks.workunit.client.0.smithi001.stdout:1/160: creat d3/dd/d14/f2e x:0 0 0 2024-09-15T22:26:39.162 INFO:tasks.workunit.client.0.smithi001.stdout:1/161: fdatasync d3/f9 0 2024-09-15T22:26:39.162 INFO:tasks.workunit.client.0.smithi001.stdout:1/162: truncate d3/f11 4708727 0 2024-09-15T22:26:39.164 INFO:tasks.workunit.client.0.smithi001.stdout:4/170: mknod d0/d16/d20/d29/d40/c47 0 2024-09-15T22:26:39.166 INFO:tasks.workunit.client.0.smithi001.stdout:4/171: rename d0/d16/f2f to d0/f48 0 2024-09-15T22:26:39.166 INFO:tasks.workunit.client.0.smithi001.stdout:4/172: dread - d0/d27/d30/f45 zero size 2024-09-15T22:26:39.168 INFO:tasks.workunit.client.0.smithi001.stdout:4/173: rmdir d0/d27 39 2024-09-15T22:26:39.168 INFO:tasks.workunit.client.0.smithi001.stdout:4/174: write d0/f1a [635064,94841] 0 2024-09-15T22:26:39.173 INFO:tasks.workunit.client.0.smithi001.stdout:5/143: dread d3/d6/f7 [0,4194304] 0 2024-09-15T22:26:39.173 INFO:tasks.workunit.client.0.smithi001.stdout:5/144: fsync d3/f24 0 2024-09-15T22:26:39.176 INFO:tasks.workunit.client.0.smithi001.stdout:5/145: mknod d3/d6/c2e 0 2024-09-15T22:26:39.177 INFO:tasks.workunit.client.0.smithi001.stdout:5/146: mknod d3/c2f 0 2024-09-15T22:26:39.177 INFO:tasks.workunit.client.0.smithi001.stdout:5/147: fsync d3/f16 0 2024-09-15T22:26:39.177 INFO:tasks.workunit.client.0.smithi001.stdout:5/148: mknod d3/c30 0 2024-09-15T22:26:39.178 INFO:tasks.workunit.client.0.smithi001.stdout:5/149: mknod d3/d1d/c31 0 2024-09-15T22:26:39.180 INFO:tasks.workunit.client.0.smithi001.stdout:5/150: link d3/d6/c13 d3/d1d/c32 0 2024-09-15T22:26:39.182 INFO:tasks.workunit.client.0.smithi001.stdout:5/151: rename d3/d6/fe to d3/f33 0 2024-09-15T22:26:39.195 INFO:tasks.workunit.client.0.smithi001.stdout:7/83: dwrite d0/d7/f17 [0,4194304] 0 2024-09-15T22:26:39.197 INFO:tasks.workunit.client.0.smithi001.stdout:7/84: unlink d0/d7/c13 0 2024-09-15T22:26:39.200 INFO:tasks.workunit.client.0.smithi001.stdout:7/85: mknod d0/d7/c1e 0 2024-09-15T22:26:39.203 INFO:tasks.workunit.client.0.smithi001.stdout:0/108: dwrite d0/d9/f26 [0,4194304] 0 2024-09-15T22:26:39.206 INFO:tasks.workunit.client.0.smithi001.stdout:8/105: dwrite d9/ff [0,4194304] 0 2024-09-15T22:26:39.209 INFO:tasks.workunit.client.0.smithi001.stdout:8/106: truncate d9/fd 236395 0 2024-09-15T22:26:39.209 INFO:tasks.workunit.client.0.smithi001.stdout:8/107: dread - d9/f1d zero size 2024-09-15T22:26:39.210 INFO:tasks.workunit.client.0.smithi001.stdout:7/86: symlink d0/d7/l1f 0 2024-09-15T22:26:39.212 INFO:tasks.workunit.client.0.smithi001.stdout:8/108: creat d9/d19/f1e x:0 0 0 2024-09-15T22:26:39.214 INFO:tasks.workunit.client.0.smithi001.stdout:8/109: creat d9/d19/f1f x:0 0 0 2024-09-15T22:26:39.214 INFO:tasks.workunit.client.0.smithi001.stdout:8/110: write d9/fa [5159732,106111] 0 2024-09-15T22:26:39.214 INFO:tasks.workunit.client.0.smithi001.stdout:8/111: chown d9/f11 90702 1 2024-09-15T22:26:39.214 INFO:tasks.workunit.client.0.smithi001.stdout:8/112: fdatasync f7 0 2024-09-15T22:26:39.215 INFO:tasks.workunit.client.0.smithi001.stdout:8/113: write d9/f1d [33150,76404] 0 2024-09-15T22:26:39.215 INFO:tasks.workunit.client.0.smithi001.stdout:8/114: readlink l6 0 2024-09-15T22:26:39.215 INFO:tasks.workunit.client.0.smithi001.stdout:8/115: write d9/d19/f1f [944742,43789] 0 2024-09-15T22:26:39.215 INFO:tasks.workunit.client.0.smithi001.stdout:8/116: chown d9/d19/f1e 85050 1 2024-09-15T22:26:39.215 INFO:tasks.workunit.client.0.smithi001.stdout:4/175: dwrite d0/d16/f43 [0,4194304] 0 2024-09-15T22:26:39.216 INFO:tasks.workunit.client.0.smithi001.stdout:8/117: mknod d9/c20 0 2024-09-15T22:26:39.216 INFO:tasks.workunit.client.0.smithi001.stdout:9/82: dread d5/f11 [0,4194304] 0 2024-09-15T22:26:39.218 INFO:tasks.workunit.client.0.smithi001.stdout:0/109: read d0/dd/ff [638513,115574] 0 2024-09-15T22:26:39.218 INFO:tasks.workunit.client.0.smithi001.stdout:0/110: write d0/d6/f18 [149206,33417] 0 2024-09-15T22:26:39.220 INFO:tasks.workunit.client.0.smithi001.stdout:4/176: mknod d0/d27/d30/c49 0 2024-09-15T22:26:39.222 INFO:tasks.workunit.client.0.smithi001.stdout:9/83: getdents d5/de 0 2024-09-15T22:26:39.222 INFO:tasks.workunit.client.0.smithi001.stdout:9/84: write d5/f11 [2446459,97375] 0 2024-09-15T22:26:39.222 INFO:tasks.workunit.client.0.smithi001.stdout:2/118: dwrite d2/f3 [0,4194304] 0 2024-09-15T22:26:39.223 INFO:tasks.workunit.client.0.smithi001.stdout:4/177: creat d0/d27/d35/f4a x:0 0 0 2024-09-15T22:26:39.223 INFO:tasks.workunit.client.0.smithi001.stdout:4/178: write d0/d16/d20/d29/d34/f41 [423871,88015] 0 2024-09-15T22:26:39.225 INFO:tasks.workunit.client.0.smithi001.stdout:8/118: truncate d9/fd 665770 0 2024-09-15T22:26:39.227 INFO:tasks.workunit.client.0.smithi001.stdout:9/85: getdents d5 0 2024-09-15T22:26:39.227 INFO:tasks.workunit.client.0.smithi001.stdout:9/86: rename d5/de to d5/de/d16 22 2024-09-15T22:26:39.227 INFO:tasks.workunit.client.0.smithi001.stdout:9/87: write d5/f11 [2395291,26196] 0 2024-09-15T22:26:39.236 INFO:tasks.workunit.client.0.smithi001.stdout:2/119: creat d2/f2b x:0 0 0 2024-09-15T22:26:39.237 INFO:tasks.workunit.client.0.smithi001.stdout:4/179: dread d0/d16/f22 [0,4194304] 0 2024-09-15T22:26:39.237 INFO:tasks.workunit.client.0.smithi001.stdout:4/180: write d0/d16/d20/f38 [865837,59776] 0 2024-09-15T22:26:39.237 INFO:tasks.workunit.client.0.smithi001.stdout:2/120: creat d2/d14/d17/f2c x:0 0 0 2024-09-15T22:26:39.238 INFO:tasks.workunit.client.0.smithi001.stdout:2/121: fsync d2/d14/d1a/d20/f13 0 2024-09-15T22:26:39.238 INFO:tasks.workunit.client.0.smithi001.stdout:2/122: chown d2/f2b 244164579 1 2024-09-15T22:26:39.238 INFO:tasks.workunit.client.0.smithi001.stdout:5/152: dwrite d3/f24 [0,4194304] 0 2024-09-15T22:26:39.238 INFO:tasks.workunit.client.0.smithi001.stdout:5/153: chown d3/d1d/f29 2681 1 2024-09-15T22:26:39.238 INFO:tasks.workunit.client.0.smithi001.stdout:5/154: truncate d3/fc 1564082 0 2024-09-15T22:26:39.239 INFO:tasks.workunit.client.0.smithi001.stdout:4/181: getdents d0 0 2024-09-15T22:26:39.242 INFO:tasks.workunit.client.0.smithi001.stdout:9/88: truncate d5/f11 2422783 0 2024-09-15T22:26:39.242 INFO:tasks.workunit.client.0.smithi001.stdout:8/119: dread d9/fd [0,4194304] 0 2024-09-15T22:26:39.242 INFO:tasks.workunit.client.0.smithi001.stdout:9/89: readlink d5/de/l14 0 2024-09-15T22:26:39.242 INFO:tasks.workunit.client.0.smithi001.stdout:9/90: chown d5/d7 20777794 1 2024-09-15T22:26:39.243 INFO:tasks.workunit.client.0.smithi001.stdout:4/182: mknod d0/d16/d20/c4b 0 2024-09-15T22:26:39.244 INFO:tasks.workunit.client.0.smithi001.stdout:2/123: getdents d2/d14/d17 0 2024-09-15T22:26:39.244 INFO:tasks.workunit.client.0.smithi001.stdout:2/124: stat d2/l7 0 2024-09-15T22:26:39.244 INFO:tasks.workunit.client.0.smithi001.stdout:2/125: dread - d2/d14/d1a/d20/f2a zero size 2024-09-15T22:26:39.245 INFO:tasks.workunit.client.0.smithi001.stdout:3/115: sync 2024-09-15T22:26:39.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:38 smithi012 ceph-mon[34883]: pgmap v409: 97 pgs: 97 active+clean; 121 MiB data, 825 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.7 MiB/s wr, 827 op/s 2024-09-15T22:26:39.257 INFO:tasks.workunit.client.0.smithi001.stdout:8/120: write d9/ff [2242194,126514] 0 2024-09-15T22:26:39.259 INFO:tasks.workunit.client.0.smithi001.stdout:5/155: write d3/f24 [2792116,116814] 0 2024-09-15T22:26:39.264 INFO:tasks.workunit.client.0.smithi001.stdout:8/121: creat d9/f21 x:0 0 0 2024-09-15T22:26:39.265 INFO:tasks.workunit.client.0.smithi001.stdout:5/156: rmdir d3/d6/d25 39 2024-09-15T22:26:39.265 INFO:tasks.workunit.client.0.smithi001.stdout:8/122: mknod d9/d19/c22 0 2024-09-15T22:26:39.266 INFO:tasks.workunit.client.0.smithi001.stdout:8/123: chown d9/fa 1662 1 2024-09-15T22:26:39.266 INFO:tasks.workunit.client.0.smithi001.stdout:4/183: dread d0/d16/f43 [0,4194304] 0 2024-09-15T22:26:39.267 INFO:tasks.workunit.client.0.smithi001.stdout:5/157: rename d3/d6/c1e to d3/c34 0 2024-09-15T22:26:39.268 INFO:tasks.workunit.client.0.smithi001.stdout:4/184: mknod d0/d16/d20/d29/d34/c4c 0 2024-09-15T22:26:39.268 INFO:tasks.workunit.client.0.smithi001.stdout:4/185: fsync d0/d16/d20/f25 0 2024-09-15T22:26:39.269 INFO:tasks.workunit.client.0.smithi001.stdout:4/186: creat d0/d16/d20/d29/d40/f4d x:0 0 0 2024-09-15T22:26:39.288 INFO:tasks.workunit.client.0.smithi001.stdout:5/158: dread d3/f24 [0,4194304] 0 2024-09-15T22:26:39.295 INFO:tasks.workunit.client.0.smithi001.stdout:9/91: dwrite d5/f11 [0,4194304] 0 2024-09-15T22:26:39.295 INFO:tasks.workunit.client.0.smithi001.stdout:9/92: stat d5/d7/cf 0 2024-09-15T22:26:39.297 INFO:tasks.workunit.client.0.smithi001.stdout:2/126: dread d2/f9 [0,4194304] 0 2024-09-15T22:26:39.298 INFO:tasks.workunit.client.0.smithi001.stdout:3/116: dwrite f8 [0,4194304] 0 2024-09-15T22:26:39.300 INFO:tasks.workunit.client.0.smithi001.stdout:3/117: rmdir da/d1f 39 2024-09-15T22:26:39.301 INFO:tasks.workunit.client.0.smithi001.stdout:3/118: creat da/d16/f26 x:0 0 0 2024-09-15T22:26:39.303 INFO:tasks.workunit.client.0.smithi001.stdout:3/119: creat da/d1f/f27 x:0 0 0 2024-09-15T22:26:39.304 INFO:tasks.workunit.client.0.smithi001.stdout:3/120: creat da/d1f/f28 x:0 0 0 2024-09-15T22:26:39.306 INFO:tasks.workunit.client.0.smithi001.stdout:3/121: creat da/d17/f29 x:0 0 0 2024-09-15T22:26:39.309 INFO:tasks.workunit.client.0.smithi001.stdout:2/127: dread d2/d14/d1a/d20/f13 [0,4194304] 0 2024-09-15T22:26:39.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:38 smithi098 ceph-mon[35514]: pgmap v409: 97 pgs: 97 active+clean; 121 MiB data, 825 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.7 MiB/s wr, 827 op/s 2024-09-15T22:26:39.318 INFO:tasks.workunit.client.0.smithi001.stdout:9/93: dread d5/f11 [0,4194304] 0 2024-09-15T22:26:39.319 INFO:tasks.workunit.client.0.smithi001.stdout:9/94: creat d5/d7/f17 x:0 0 0 2024-09-15T22:26:39.319 INFO:tasks.workunit.client.0.smithi001.stdout:9/95: dread - d5/d7/f17 zero size 2024-09-15T22:26:39.320 INFO:tasks.workunit.client.0.smithi001.stdout:9/96: rmdir d5/d7 39 2024-09-15T22:26:39.321 INFO:tasks.workunit.client.0.smithi001.stdout:9/97: truncate f4 622013 0 2024-09-15T22:26:39.321 INFO:tasks.workunit.client.0.smithi001.stdout:4/187: dwrite d0/d16/d20/d29/d34/f41 [0,4194304] 0 2024-09-15T22:26:39.324 INFO:tasks.workunit.client.0.smithi001.stdout:9/98: creat d5/de/f18 x:0 0 0 2024-09-15T22:26:39.324 INFO:tasks.workunit.client.0.smithi001.stdout:9/99: dread - d5/de/f18 zero size 2024-09-15T22:26:39.325 INFO:tasks.workunit.client.0.smithi001.stdout:4/188: mknod d0/d27/c4e 0 2024-09-15T22:26:39.326 INFO:tasks.workunit.client.0.smithi001.stdout:9/100: symlink d5/d7/l19 0 2024-09-15T22:26:39.327 INFO:tasks.workunit.client.0.smithi001.stdout:4/189: rmdir d0/d27/d35 39 2024-09-15T22:26:39.328 INFO:tasks.workunit.client.0.smithi001.stdout:9/101: mkdir d5/de/d1a 0 2024-09-15T22:26:39.328 INFO:tasks.workunit.client.0.smithi001.stdout:9/102: chown d5/d7/c12 6 1 2024-09-15T22:26:39.328 INFO:tasks.workunit.client.0.smithi001.stdout:9/103: chown d5/d7/c9 23430428 1 2024-09-15T22:26:39.333 INFO:tasks.workunit.client.0.smithi001.stdout:9/104: getdents d5/d7 0 2024-09-15T22:26:39.336 INFO:tasks.workunit.client.0.smithi001.stdout:5/159: dwrite d3/d6/d25/f2c [0,4194304] 0 2024-09-15T22:26:39.345 INFO:tasks.workunit.client.0.smithi001.stdout:3/122: dwrite da/f12 [0,4194304] 0 2024-09-15T22:26:39.345 INFO:tasks.workunit.client.0.smithi001.stdout:3/123: chown da/d1f/f22 93 1 2024-09-15T22:26:39.345 INFO:tasks.workunit.client.0.smithi001.stdout:3/124: dread - da/d17/f25 zero size 2024-09-15T22:26:39.351 INFO:tasks.workunit.client.0.smithi001.stdout:3/125: creat da/d14/f2a x:0 0 0 2024-09-15T22:26:39.366 INFO:tasks.workunit.client.0.smithi001.stdout:6/107: sync 2024-09-15T22:26:39.366 INFO:tasks.workunit.client.0.smithi001.stdout:6/108: write d0/f2 [4435721,8235] 0 2024-09-15T22:26:39.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:38 smithi001 ceph-mon[30843]: pgmap v409: 97 pgs: 97 active+clean; 121 MiB data, 825 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.7 MiB/s wr, 827 op/s 2024-09-15T22:26:39.377 INFO:tasks.workunit.client.0.smithi001.stdout:6/109: dread d0/df/f18 [0,4194304] 0 2024-09-15T22:26:39.391 INFO:tasks.workunit.client.0.smithi001.stdout:4/190: dwrite d0/f1a [0,4194304] 0 2024-09-15T22:26:39.391 INFO:tasks.workunit.client.0.smithi001.stdout:4/191: readlink d0/d27/l31 0 2024-09-15T22:26:39.391 INFO:tasks.workunit.client.0.smithi001.stdout:4/192: dread - d0/d27/f3d zero size 2024-09-15T22:26:39.392 INFO:tasks.workunit.client.0.smithi001.stdout:5/160: dwrite d3/d27/f2d [0,4194304] 0 2024-09-15T22:26:39.396 INFO:tasks.workunit.client.0.smithi001.stdout:4/193: creat d0/d16/d20/f4f x:0 0 0 2024-09-15T22:26:39.396 INFO:tasks.workunit.client.0.smithi001.stdout:4/194: truncate d0/d16/f21 1040713 0 2024-09-15T22:26:39.398 INFO:tasks.workunit.client.0.smithi001.stdout:4/195: creat d0/d16/d20/d29/d34/f50 x:0 0 0 2024-09-15T22:26:39.398 INFO:tasks.workunit.client.0.smithi001.stdout:4/196: readlink d0/l46 0 2024-09-15T22:26:39.404 INFO:tasks.workunit.client.0.smithi001.stdout:9/105: dwrite d5/de/f18 [0,4194304] 0 2024-09-15T22:26:39.405 INFO:tasks.workunit.client.0.smithi001.stdout:9/106: mkdir d5/de/d1a/d1b 0 2024-09-15T22:26:39.407 INFO:tasks.workunit.client.0.smithi001.stdout:9/107: symlink d5/d7/l1c 0 2024-09-15T22:26:39.419 INFO:tasks.workunit.client.0.smithi001.stdout:9/108: read d5/de/f18 [4132342,72886] 0 2024-09-15T22:26:39.420 INFO:tasks.workunit.client.0.smithi001.stdout:6/110: dwrite d0/d6/f13 [0,4194304] 0 2024-09-15T22:26:39.421 INFO:tasks.workunit.client.0.smithi001.stdout:9/109: symlink d5/l1d 0 2024-09-15T22:26:39.422 INFO:tasks.workunit.client.0.smithi001.stdout:6/111: creat d0/d6/f29 x:0 0 0 2024-09-15T22:26:39.423 INFO:tasks.workunit.client.0.smithi001.stdout:6/112: mknod d0/d7/d1c/c2a 0 2024-09-15T22:26:39.424 INFO:tasks.workunit.client.0.smithi001.stdout:6/113: creat d0/d7/f2b x:0 0 0 2024-09-15T22:26:39.438 INFO:tasks.workunit.client.0.smithi001.stdout:4/197: dwrite d0/d16/d20/f28 [0,4194304] 0 2024-09-15T22:26:39.438 INFO:tasks.workunit.client.0.smithi001.stdout:4/198: readlink d0/d16/l1e 0 2024-09-15T22:26:39.441 INFO:tasks.workunit.client.0.smithi001.stdout:4/199: creat d0/f51 x:0 0 0 2024-09-15T22:26:39.442 INFO:tasks.workunit.client.0.smithi001.stdout:4/200: creat d0/d16/d20/d29/d34/f52 x:0 0 0 2024-09-15T22:26:39.443 INFO:tasks.workunit.client.0.smithi001.stdout:4/201: mkdir d0/d27/d35/d53 0 2024-09-15T22:26:39.443 INFO:tasks.workunit.client.0.smithi001.stdout:4/202: write d0/f11 [1382567,56719] 0 2024-09-15T22:26:39.444 INFO:tasks.workunit.client.0.smithi001.stdout:4/203: mkdir d0/d27/d35/d53/d54 0 2024-09-15T22:26:39.445 INFO:tasks.workunit.client.0.smithi001.stdout:4/204: mknod d0/d16/d20/c55 0 2024-09-15T22:26:39.445 INFO:tasks.workunit.client.0.smithi001.stdout:4/205: write d0/d27/d35/f4a [616165,86361] 0 2024-09-15T22:26:39.448 INFO:tasks.workunit.client.0.smithi001.stdout:4/206: write d0/f11 [1920259,35296] 0 2024-09-15T22:26:39.448 INFO:tasks.workunit.client.0.smithi001.stdout:5/161: dwrite d3/d6/d25/f2c [4194304,4194304] 0 2024-09-15T22:26:39.452 INFO:tasks.workunit.client.0.smithi001.stdout:7/87: sync 2024-09-15T22:26:39.452 INFO:tasks.workunit.client.0.smithi001.stdout:1/163: sync 2024-09-15T22:26:39.454 INFO:tasks.workunit.client.0.smithi001.stdout:7/88: rename d0/f6 to d0/d7/df/f20 0 2024-09-15T22:26:39.456 INFO:tasks.workunit.client.0.smithi001.stdout:1/164: creat d3/dd/d14/d1b/f2f x:0 0 0 2024-09-15T22:26:39.456 INFO:tasks.workunit.client.0.smithi001.stdout:1/165: write d3/d12/f17 [1038820,3028] 0 2024-09-15T22:26:39.456 INFO:tasks.workunit.client.0.smithi001.stdout:1/166: fdatasync d3/dd/d14/f2e 0 2024-09-15T22:26:39.456 INFO:tasks.workunit.client.0.smithi001.stdout:1/167: fsync d3/dd/f13 0 2024-09-15T22:26:39.456 INFO:tasks.workunit.client.0.smithi001.stdout:1/168: read - d3/dd/d14/d1b/f2f zero size 2024-09-15T22:26:39.465 INFO:tasks.workunit.client.0.smithi001.stdout:6/114: dwrite d0/d7/f26 [0,4194304] 0 2024-09-15T22:26:39.466 INFO:tasks.workunit.client.0.smithi001.stdout:7/89: mkdir d0/d7/d21 0 2024-09-15T22:26:39.466 INFO:tasks.workunit.client.0.smithi001.stdout:1/169: creat d3/dd/d14/d1b/f30 x:0 0 0 2024-09-15T22:26:39.466 INFO:tasks.workunit.client.0.smithi001.stdout:7/90: fsync d0/d7/df/f1c 0 2024-09-15T22:26:39.469 INFO:tasks.workunit.client.0.smithi001.stdout:1/170: truncate d3/f5 151041 0 2024-09-15T22:26:39.471 INFO:tasks.workunit.client.0.smithi001.stdout:7/91: rename d0/d7/df/l15 to d0/d7/d21/l22 0 2024-09-15T22:26:39.472 INFO:tasks.workunit.client.0.smithi001.stdout:7/92: truncate d0/d7/f19 402385 0 2024-09-15T22:26:39.472 INFO:tasks.workunit.client.0.smithi001.stdout:7/93: chown d0/d7/f18 539 1 2024-09-15T22:26:39.476 INFO:tasks.workunit.client.0.smithi001.stdout:7/94: mkdir d0/d7/d23 0 2024-09-15T22:26:39.476 INFO:tasks.workunit.client.0.smithi001.stdout:1/171: read d3/f7 [1018529,63743] 0 2024-09-15T22:26:39.476 INFO:tasks.workunit.client.0.smithi001.stdout:1/172: truncate d3/d12/f24 4240263 0 2024-09-15T22:26:39.476 INFO:tasks.workunit.client.0.smithi001.stdout:7/95: fsync d0/d7/df/f20 0 2024-09-15T22:26:39.478 INFO:tasks.workunit.client.0.smithi001.stdout:1/173: rename d3/dd/d14/d1b/f26 to d3/dd/d14/f31 0 2024-09-15T22:26:39.479 INFO:tasks.workunit.client.0.smithi001.stdout:7/96: creat d0/d7/f24 x:0 0 0 2024-09-15T22:26:39.481 INFO:tasks.workunit.client.0.smithi001.stdout:1/174: link d3/d12/f1e d3/f32 0 2024-09-15T22:26:39.481 INFO:tasks.workunit.client.0.smithi001.stdout:1/175: dread - d3/dd/d14/d1b/f2f zero size 2024-09-15T22:26:39.482 INFO:tasks.workunit.client.0.smithi001.stdout:7/97: unlink d0/d7/df/l1a 0 2024-09-15T22:26:39.482 INFO:tasks.workunit.client.0.smithi001.stdout:7/98: fsync d0/d7/df/f11 0 2024-09-15T22:26:39.482 INFO:tasks.workunit.client.0.smithi001.stdout:7/99: truncate d0/d7/fd 4255732 0 2024-09-15T22:26:39.483 INFO:tasks.workunit.client.0.smithi001.stdout:1/176: creat d3/dd/f33 x:0 0 0 2024-09-15T22:26:39.484 INFO:tasks.workunit.client.0.smithi001.stdout:7/100: mknod d0/d7/d23/c25 0 2024-09-15T22:26:39.486 INFO:tasks.workunit.client.0.smithi001.stdout:1/177: link d3/d12/f17 d3/dd/f34 0 2024-09-15T22:26:39.487 INFO:tasks.workunit.client.0.smithi001.stdout:4/207: dwrite d0/d16/d20/d29/d34/f41 [0,4194304] 0 2024-09-15T22:26:39.490 INFO:tasks.workunit.client.0.smithi001.stdout:7/101: rmdir d0 39 2024-09-15T22:26:39.490 INFO:tasks.workunit.client.0.smithi001.stdout:1/178: creat d3/d12/f35 x:0 0 0 2024-09-15T22:26:39.492 INFO:tasks.workunit.client.0.smithi001.stdout:1/179: mknod d3/d12/d21/c36 0 2024-09-15T22:26:39.492 INFO:tasks.workunit.client.0.smithi001.stdout:1/180: dread - d3/dd/d14/f1c zero size 2024-09-15T22:26:39.500 INFO:tasks.workunit.client.0.smithi001.stdout:4/208: read d0/d16/d20/d29/d34/f41 [3068650,32317] 0 2024-09-15T22:26:39.510 INFO:tasks.workunit.client.0.smithi001.stdout:6/115: dwrite d0/f5 [0,4194304] 0 2024-09-15T22:26:39.510 INFO:tasks.workunit.client.0.smithi001.stdout:6/116: truncate d0/d6/f14 710821 0 2024-09-15T22:26:39.510 INFO:tasks.workunit.client.0.smithi001.stdout:5/162: dwrite d3/d6/f8 [0,4194304] 0 2024-09-15T22:26:39.510 INFO:tasks.workunit.client.0.smithi001.stdout:6/117: write d0/d7/f2b [1045337,88657] 0 2024-09-15T22:26:39.510 INFO:tasks.workunit.client.0.smithi001.stdout:6/118: write d0/df/f1a [693868,32396] 0 2024-09-15T22:26:39.510 INFO:tasks.workunit.client.0.smithi001.stdout:6/119: getdents d0/df/d24 0 2024-09-15T22:26:39.513 INFO:tasks.workunit.client.0.smithi001.stdout:5/163: rename c2 to d3/d6/d25/c35 0 2024-09-15T22:26:39.515 INFO:tasks.workunit.client.0.smithi001.stdout:4/209: dread d0/f1f [0,4194304] 0 2024-09-15T22:26:39.515 INFO:tasks.workunit.client.0.smithi001.stdout:4/210: write d0/d27/f3d [127931,2062] 0 2024-09-15T22:26:39.516 INFO:tasks.workunit.client.0.smithi001.stdout:6/120: dread d0/d7/d1c/f1d [0,4194304] 0 2024-09-15T22:26:39.516 INFO:tasks.workunit.client.0.smithi001.stdout:6/121: readlink d0/df/l25 0 2024-09-15T22:26:39.524 INFO:tasks.workunit.client.0.smithi001.stdout:0/111: sync 2024-09-15T22:26:39.539 INFO:tasks.workunit.client.0.smithi001.stdout:4/211: write d0/d16/d20/f25 [1877770,41593] 0 2024-09-15T22:26:39.539 INFO:tasks.workunit.client.0.smithi001.stdout:4/212: write d0/d16/f23 [56654,8241] 0 2024-09-15T22:26:39.541 INFO:tasks.workunit.client.0.smithi001.stdout:4/213: unlink d0/d27/c4e 0 2024-09-15T22:26:39.541 INFO:tasks.workunit.client.0.smithi001.stdout:4/214: stat d0/d27/l31 0 2024-09-15T22:26:39.541 INFO:tasks.workunit.client.0.smithi001.stdout:4/215: chown d0/d16/d20 179 1 2024-09-15T22:26:39.542 INFO:tasks.workunit.client.0.smithi001.stdout:7/102: dwrite d0/d7/f18 [0,4194304] 0 2024-09-15T22:26:39.549 INFO:tasks.workunit.client.0.smithi001.stdout:4/216: dread d0/d16/d20/f26 [0,4194304] 0 2024-09-15T22:26:39.550 INFO:tasks.workunit.client.0.smithi001.stdout:4/217: creat d0/d27/d30/d44/f56 x:0 0 0 2024-09-15T22:26:39.551 INFO:tasks.workunit.client.0.smithi001.stdout:4/218: dread - d0/d27/d30/d44/f56 zero size 2024-09-15T22:26:39.551 INFO:tasks.workunit.client.0.smithi001.stdout:4/219: getdents d0/d16/d20/d29 0 2024-09-15T22:26:39.551 INFO:tasks.workunit.client.0.smithi001.stdout:4/220: chown d0/d16/d20/d29/d40 21846024 1 2024-09-15T22:26:39.552 INFO:tasks.workunit.client.0.smithi001.stdout:4/221: chown d0/l46 5666869 1 2024-09-15T22:26:39.553 INFO:tasks.workunit.client.0.smithi001.stdout:4/222: fdatasync d0/d16/d20/f25 0 2024-09-15T22:26:39.554 INFO:tasks.workunit.client.0.smithi001.stdout:4/223: mkdir d0/d27/d57 0 2024-09-15T22:26:39.556 INFO:tasks.workunit.client.0.smithi001.stdout:4/224: rename d0/d27/f3d to d0/d27/d35/f58 0 2024-09-15T22:26:39.557 INFO:tasks.workunit.client.0.smithi001.stdout:4/225: mkdir d0/d27/d35/d59 0 2024-09-15T22:26:39.558 INFO:tasks.workunit.client.0.smithi001.stdout:7/103: read d0/d7/df/f11 [3336401,107480] 0 2024-09-15T22:26:39.558 INFO:tasks.workunit.client.0.smithi001.stdout:1/181: dwrite d3/f7 [0,4194304] 0 2024-09-15T22:26:39.559 INFO:tasks.workunit.client.0.smithi001.stdout:1/182: dread - d3/dd/f33 zero size 2024-09-15T22:26:39.559 INFO:tasks.workunit.client.0.smithi001.stdout:7/104: creat d0/f26 x:0 0 0 2024-09-15T22:26:39.560 INFO:tasks.workunit.client.0.smithi001.stdout:1/183: link l1 d3/dd/d14/d23/l37 0 2024-09-15T22:26:39.561 INFO:tasks.workunit.client.0.smithi001.stdout:7/105: creat d0/d7/df/f27 x:0 0 0 2024-09-15T22:26:39.561 INFO:tasks.workunit.client.0.smithi001.stdout:7/106: chown d0/d7/d23/c25 3946 1 2024-09-15T22:26:39.561 INFO:tasks.workunit.client.0.smithi001.stdout:7/107: write d0/f26 [169275,105478] 0 2024-09-15T22:26:39.563 INFO:tasks.workunit.client.0.smithi001.stdout:6/122: dwrite d0/d7/fe [0,4194304] 0 2024-09-15T22:26:39.563 INFO:tasks.workunit.client.0.smithi001.stdout:6/123: fdatasync d0/d7/f26 0 2024-09-15T22:26:39.563 INFO:tasks.workunit.client.0.smithi001.stdout:7/108: creat d0/d7/df/f28 x:0 0 0 2024-09-15T22:26:39.565 INFO:tasks.workunit.client.0.smithi001.stdout:6/124: creat d0/df/d24/f2c x:0 0 0 2024-09-15T22:26:39.566 INFO:tasks.workunit.client.0.smithi001.stdout:7/109: link d0/d7/df/f1c d0/d7/d23/f29 0 2024-09-15T22:26:39.585 INFO:tasks.workunit.client.0.smithi001.stdout:6/125: write d0/fb [2468589,106726] 0 2024-09-15T22:26:39.587 INFO:tasks.workunit.client.0.smithi001.stdout:6/126: mknod d0/df/c2d 0 2024-09-15T22:26:39.587 INFO:tasks.workunit.client.0.smithi001.stdout:6/127: dread - d0/d6/f29 zero size 2024-09-15T22:26:39.587 INFO:tasks.workunit.client.0.smithi001.stdout:6/128: stat d0/f3 0 2024-09-15T22:26:39.589 INFO:tasks.workunit.client.0.smithi001.stdout:5/164: dwrite d3/d6/f8 [4194304,4194304] 0 2024-09-15T22:26:39.591 INFO:tasks.workunit.client.0.smithi001.stdout:5/165: symlink d3/d6/l36 0 2024-09-15T22:26:39.592 INFO:tasks.workunit.client.0.smithi001.stdout:5/166: symlink d3/d6/d25/l37 0 2024-09-15T22:26:39.592 INFO:tasks.workunit.client.0.smithi001.stdout:5/167: fsync d3/f16 0 2024-09-15T22:26:39.592 INFO:tasks.workunit.client.0.smithi001.stdout:6/129: rename d0/d7/d1c to d0/df/d24/d2e 0 2024-09-15T22:26:39.593 INFO:tasks.workunit.client.0.smithi001.stdout:5/168: creat d3/d6/d25/f38 x:0 0 0 2024-09-15T22:26:39.595 INFO:tasks.workunit.client.0.smithi001.stdout:5/169: link d3/d1d/f29 d3/d27/f39 0 2024-09-15T22:26:39.596 INFO:tasks.workunit.client.0.smithi001.stdout:5/170: truncate d3/d6/d25/f2c 2566330 0 2024-09-15T22:26:39.600 INFO:tasks.workunit.client.0.smithi001.stdout:0/112: dwrite d0/f16 [0,4194304] 0 2024-09-15T22:26:39.600 INFO:tasks.workunit.client.0.smithi001.stdout:0/113: write d0/d9/db/f19 [169346,78058] 0 2024-09-15T22:26:39.610 INFO:tasks.workunit.client.0.smithi001.stdout:0/114: dread d0/dd/ff [0,4194304] 0 2024-09-15T22:26:39.613 INFO:tasks.workunit.client.0.smithi001.stdout:5/171: dread d3/d27/f2d [0,4194304] 0 2024-09-15T22:26:39.620 INFO:tasks.workunit.client.0.smithi001.stdout:0/115: rename d0/d6/c11 to d0/c27 0 2024-09-15T22:26:39.620 INFO:tasks.workunit.client.0.smithi001.stdout:5/172: dread d3/d6/f7 [0,4194304] 0 2024-09-15T22:26:39.621 INFO:tasks.workunit.client.0.smithi001.stdout:6/130: rename d0/d7 to d0/d2f 0 2024-09-15T22:26:39.621 INFO:tasks.workunit.client.0.smithi001.stdout:6/131: write d0/fb [4421606,28736] 0 2024-09-15T22:26:39.623 INFO:tasks.workunit.client.0.smithi001.stdout:0/116: creat d0/d9/d1a/f28 x:0 0 0 2024-09-15T22:26:39.623 INFO:tasks.workunit.client.0.smithi001.stdout:5/173: creat d3/d27/f3a x:0 0 0 2024-09-15T22:26:39.624 INFO:tasks.workunit.client.0.smithi001.stdout:6/132: mkdir d0/d6/d21/d30 0 2024-09-15T22:26:39.625 INFO:tasks.workunit.client.0.smithi001.stdout:5/174: rename d3/d6/l14 to d3/l3b 0 2024-09-15T22:26:39.626 INFO:tasks.workunit.client.0.smithi001.stdout:5/175: read - d3/f16 zero size 2024-09-15T22:26:39.627 INFO:tasks.workunit.client.0.smithi001.stdout:5/176: mkdir d3/d27/d3c 0 2024-09-15T22:26:39.635 INFO:tasks.workunit.client.0.smithi001.stdout:4/226: dwrite d0/d16/d20/f26 [0,4194304] 0 2024-09-15T22:26:39.637 INFO:tasks.workunit.client.0.smithi001.stdout:0/117: dread d0/f2 [0,4194304] 0 2024-09-15T22:26:39.637 INFO:tasks.workunit.client.0.smithi001.stdout:0/118: stat d0/d9/db/f1e 0 2024-09-15T22:26:39.637 INFO:tasks.workunit.client.0.smithi001.stdout:0/119: chown d0/d9/d1a/f28 192019 1 2024-09-15T22:26:39.638 INFO:tasks.workunit.client.0.smithi001.stdout:0/120: readlink d0/l1f 0 2024-09-15T22:26:39.638 INFO:tasks.workunit.client.0.smithi001.stdout:1/184: dwrite d3/f7 [0,4194304] 0 2024-09-15T22:26:39.639 INFO:tasks.workunit.client.0.smithi001.stdout:4/227: creat d0/d16/d20/d29/d40/f5a x:0 0 0 2024-09-15T22:26:39.639 INFO:tasks.workunit.client.0.smithi001.stdout:4/228: write d0/d27/f36 [2685405,115083] 0 2024-09-15T22:26:39.639 INFO:tasks.workunit.client.0.smithi001.stdout:9/110: sync 2024-09-15T22:26:39.639 INFO:tasks.workunit.client.0.smithi001.stdout:2/128: sync 2024-09-15T22:26:39.639 INFO:tasks.workunit.client.0.smithi001.stdout:3/126: sync 2024-09-15T22:26:39.640 INFO:tasks.workunit.client.0.smithi001.stdout:3/127: truncate da/d17/f29 583889 0 2024-09-15T22:26:39.643 INFO:tasks.workunit.client.0.smithi001.stdout:1/185: creat d3/dd/f38 x:0 0 0 2024-09-15T22:26:39.643 INFO:tasks.workunit.client.0.smithi001.stdout:1/186: write d3/dd/d14/f31 [829565,20569] 0 2024-09-15T22:26:39.643 INFO:tasks.workunit.client.0.smithi001.stdout:1/187: fsync d3/dd/d14/f25 0 2024-09-15T22:26:39.644 INFO:tasks.workunit.client.0.smithi001.stdout:1/188: write d3/f32 [164073,70983] 0 2024-09-15T22:26:39.644 INFO:tasks.workunit.client.0.smithi001.stdout:4/229: creat d0/d16/f5b x:0 0 0 2024-09-15T22:26:39.644 INFO:tasks.workunit.client.0.smithi001.stdout:4/230: truncate d0/f51 405874 0 2024-09-15T22:26:39.644 INFO:tasks.workunit.client.0.smithi001.stdout:9/111: symlink d5/de/d1a/l1e 0 2024-09-15T22:26:39.644 INFO:tasks.workunit.client.0.smithi001.stdout:9/112: chown d5/de/d15 47 1 2024-09-15T22:26:39.644 INFO:tasks.workunit.client.0.smithi001.stdout:4/231: rmdir d0/d16/d20/d29 39 2024-09-15T22:26:39.644 INFO:tasks.workunit.client.0.smithi001.stdout:8/124: sync 2024-09-15T22:26:39.644 INFO:tasks.workunit.client.0.smithi001.stdout:4/232: truncate d0/f51 970489 0 2024-09-15T22:26:39.644 INFO:tasks.workunit.client.0.smithi001.stdout:4/233: write d0/d27/d30/d44/f56 [596966,97569] 0 2024-09-15T22:26:39.644 INFO:tasks.workunit.client.0.smithi001.stdout:9/113: symlink d5/d7/l1f 0 2024-09-15T22:26:39.645 INFO:tasks.workunit.client.0.smithi001.stdout:9/114: chown d5/l1d 45075 1 2024-09-15T22:26:39.646 INFO:tasks.workunit.client.0.smithi001.stdout:8/125: truncate d9/fb 1226482 0 2024-09-15T22:26:39.646 INFO:tasks.workunit.client.0.smithi001.stdout:4/234: link d0/c12 d0/d27/d35/c5c 0 2024-09-15T22:26:39.646 INFO:tasks.workunit.client.0.smithi001.stdout:4/235: write d0/d27/d30/d44/f56 [1458221,123894] 0 2024-09-15T22:26:39.647 INFO:tasks.workunit.client.0.smithi001.stdout:9/115: unlink d5/c10 0 2024-09-15T22:26:39.649 INFO:tasks.workunit.client.0.smithi001.stdout:6/133: write d0/f5 [1773872,22238] 0 2024-09-15T22:26:39.657 INFO:tasks.workunit.client.0.smithi001.stdout:7/110: dwrite d0/d7/f19 [0,4194304] 0 2024-09-15T22:26:39.661 INFO:tasks.workunit.client.0.smithi001.stdout:9/116: dread d5/de/f18 [0,4194304] 0 2024-09-15T22:26:39.661 INFO:tasks.workunit.client.0.smithi001.stdout:9/117: chown d5/de/l14 350698395 1 2024-09-15T22:26:39.661 INFO:tasks.workunit.client.0.smithi001.stdout:6/134: truncate d0/f3 623898 0 2024-09-15T22:26:39.662 INFO:tasks.workunit.client.0.smithi001.stdout:1/189: write d3/f11 [50189,71777] 0 2024-09-15T22:26:39.664 INFO:tasks.workunit.client.0.smithi001.stdout:9/118: mkdir d5/d20 0 2024-09-15T22:26:39.664 INFO:tasks.workunit.client.0.smithi001.stdout:9/119: write f4 [473202,32037] 0 2024-09-15T22:26:39.664 INFO:tasks.workunit.client.0.smithi001.stdout:9/120: chown d5/d7/l1f 2178930 1 2024-09-15T22:26:39.664 INFO:tasks.workunit.client.0.smithi001.stdout:8/126: dread f8 [0,4194304] 0 2024-09-15T22:26:39.667 INFO:tasks.workunit.client.0.smithi001.stdout:6/135: symlink d0/df/l31 0 2024-09-15T22:26:39.667 INFO:tasks.workunit.client.0.smithi001.stdout:6/136: chown d0/d6 2905 1 2024-09-15T22:26:39.667 INFO:tasks.workunit.client.0.smithi001.stdout:6/137: dread - d0/d6/f23 zero size 2024-09-15T22:26:39.667 INFO:tasks.workunit.client.0.smithi001.stdout:2/129: write d2/f10 [2756774,48690] 0 2024-09-15T22:26:39.667 INFO:tasks.workunit.client.0.smithi001.stdout:9/121: mkdir d5/d7/d21 0 2024-09-15T22:26:39.667 INFO:tasks.workunit.client.0.smithi001.stdout:9/122: stat d5/d7/l13 0 2024-09-15T22:26:39.674 INFO:tasks.workunit.client.0.smithi001.stdout:6/138: rename d0/l10 to d0/df/d24/l32 0 2024-09-15T22:26:39.674 INFO:tasks.workunit.client.0.smithi001.stdout:2/130: creat d2/d14/f2d x:0 0 0 2024-09-15T22:26:39.674 INFO:tasks.workunit.client.0.smithi001.stdout:9/123: mkdir d5/de/d1a/d1b/d22 0 2024-09-15T22:26:39.674 INFO:tasks.workunit.client.0.smithi001.stdout:2/131: write d2/d14/d1a/d1b/f26 [850639,130960] 0 2024-09-15T22:26:39.674 INFO:tasks.workunit.client.0.smithi001.stdout:2/132: link d2/d14/d17/l1d d2/d14/d17/d1f/d21/l2e 0 2024-09-15T22:26:39.674 INFO:tasks.workunit.client.0.smithi001.stdout:2/133: dread - d2/d14/f2d zero size 2024-09-15T22:26:39.674 INFO:tasks.workunit.client.0.smithi001.stdout:2/134: mkdir d2/d14/d2f 0 2024-09-15T22:26:39.674 INFO:tasks.workunit.client.0.smithi001.stdout:2/135: read d2/d14/d1a/d20/f13 [3405058,8647] 0 2024-09-15T22:26:39.674 INFO:tasks.workunit.client.0.smithi001.stdout:2/136: chown d2/d14/d17/f2c 512496605 1 2024-09-15T22:26:39.674 INFO:tasks.workunit.client.0.smithi001.stdout:2/137: write d2/d14/d1a/d1b/f26 [939967,98918] 0 2024-09-15T22:26:39.674 INFO:tasks.workunit.client.0.smithi001.stdout:2/138: dread - d2/d14/f2d zero size 2024-09-15T22:26:39.675 INFO:tasks.workunit.client.0.smithi001.stdout:8/127: unlink d9/ff 0 2024-09-15T22:26:39.675 INFO:tasks.workunit.client.0.smithi001.stdout:8/128: chown f7 1299 1 2024-09-15T22:26:39.676 INFO:tasks.workunit.client.0.smithi001.stdout:8/129: link f8 d9/d19/f23 0 2024-09-15T22:26:39.689 INFO:tasks.workunit.client.0.smithi001.stdout:4/236: dread d0/d27/f36 [0,4194304] 0 2024-09-15T22:26:39.689 INFO:tasks.workunit.client.0.smithi001.stdout:3/128: write f6 [976677,129687] 0 2024-09-15T22:26:39.690 INFO:tasks.workunit.client.0.smithi001.stdout:3/129: chown da/d14/f20 683274756 1 2024-09-15T22:26:39.694 INFO:tasks.workunit.client.0.smithi001.stdout:9/124: dread d5/f11 [0,4194304] 0 2024-09-15T22:26:39.697 INFO:tasks.workunit.client.0.smithi001.stdout:1/190: dread d3/f7 [0,4194304] 0 2024-09-15T22:26:39.697 INFO:tasks.workunit.client.0.smithi001.stdout:1/191: write d3/dd/d14/f1c [232726,12551] 0 2024-09-15T22:26:39.700 INFO:tasks.workunit.client.0.smithi001.stdout:9/125: mkdir d5/d7/d21/d23 0 2024-09-15T22:26:39.700 INFO:tasks.workunit.client.0.smithi001.stdout:0/121: dwrite d0/f2 [0,4194304] 0 2024-09-15T22:26:39.700 INFO:tasks.workunit.client.0.smithi001.stdout:9/126: write f4 [1284273,94526] 0 2024-09-15T22:26:39.700 INFO:tasks.workunit.client.0.smithi001.stdout:9/127: chown d5/d7/l1f 2423 1 2024-09-15T22:26:39.702 INFO:tasks.workunit.client.0.smithi001.stdout:0/122: creat d0/dd/f29 x:0 0 0 2024-09-15T22:26:39.704 INFO:tasks.workunit.client.0.smithi001.stdout:5/177: dwrite d3/d27/f39 [0,4194304] 0 2024-09-15T22:26:39.718 INFO:tasks.workunit.client.0.smithi001.stdout:9/128: rename d5/d20 to d5/d7/d21/d24 0 2024-09-15T22:26:39.718 INFO:tasks.workunit.client.0.smithi001.stdout:7/111: dwrite d0/d7/f18 [0,4194304] 0 2024-09-15T22:26:39.720 INFO:tasks.workunit.client.0.smithi001.stdout:0/123: getdents d0 0 2024-09-15T22:26:39.722 INFO:tasks.workunit.client.0.smithi001.stdout:9/129: link d5/f11 d5/d7/d21/f25 0 2024-09-15T22:26:39.722 INFO:tasks.workunit.client.0.smithi001.stdout:9/130: dread - d5/d7/f17 zero size 2024-09-15T22:26:39.722 INFO:tasks.workunit.client.0.smithi001.stdout:9/131: truncate d5/d7/f17 386474 0 2024-09-15T22:26:39.724 INFO:tasks.workunit.client.0.smithi001.stdout:0/124: creat d0/d6/f2a x:0 0 0 2024-09-15T22:26:39.724 INFO:tasks.workunit.client.0.smithi001.stdout:0/125: dread - d0/dd/f29 zero size 2024-09-15T22:26:39.725 INFO:tasks.workunit.client.0.smithi001.stdout:9/132: unlink d5/c6 0 2024-09-15T22:26:39.725 INFO:tasks.workunit.client.0.smithi001.stdout:9/133: getdents d5/de/d1a/d1b/d22 0 2024-09-15T22:26:39.726 INFO:tasks.workunit.client.0.smithi001.stdout:9/134: write d5/d7/f17 [983031,43546] 0 2024-09-15T22:26:39.736 INFO:tasks.workunit.client.0.smithi001.stdout:8/130: dwrite d9/fb [0,4194304] 0 2024-09-15T22:26:39.737 INFO:tasks.workunit.client.0.smithi001.stdout:8/131: chown d9/d19 13083276 1 2024-09-15T22:26:39.737 INFO:tasks.workunit.client.0.smithi001.stdout:6/139: dwrite d0/d6/f29 [0,4194304] 0 2024-09-15T22:26:39.737 INFO:tasks.workunit.client.0.smithi001.stdout:9/135: mknod d5/de/d1a/d1b/d22/c26 0 2024-09-15T22:26:39.737 INFO:tasks.workunit.client.0.smithi001.stdout:9/136: chown c3 31295 1 2024-09-15T22:26:39.738 INFO:tasks.workunit.client.0.smithi001.stdout:8/132: mknod d9/c24 0 2024-09-15T22:26:39.744 INFO:tasks.workunit.client.0.smithi001.stdout:8/133: write d9/f1d [19355,51192] 0 2024-09-15T22:26:39.744 INFO:tasks.workunit.client.0.smithi001.stdout:2/139: dwrite d2/d14/d1a/d1b/f22 [0,4194304] 0 2024-09-15T22:26:39.744 INFO:tasks.workunit.client.0.smithi001.stdout:2/140: stat d2/d14/d1a/d20 0 2024-09-15T22:26:39.744 INFO:tasks.workunit.client.0.smithi001.stdout:2/141: readlink d2/lc 0 2024-09-15T22:26:39.744 INFO:tasks.workunit.client.0.smithi001.stdout:0/126: dread d0/f8 [0,4194304] 0 2024-09-15T22:26:39.745 INFO:tasks.workunit.client.0.smithi001.stdout:4/237: dread d0/d27/d35/f4a [0,4194304] 0 2024-09-15T22:26:39.746 INFO:tasks.workunit.client.0.smithi001.stdout:6/140: link d0/d6/fd d0/f33 0 2024-09-15T22:26:39.746 INFO:tasks.workunit.client.0.smithi001.stdout:6/141: write d0/d6/fd [1031852,95590] 0 2024-09-15T22:26:39.750 INFO:tasks.workunit.client.0.smithi001.stdout:4/238: rename d0/d27/d30 to d0/d5d 0 2024-09-15T22:26:39.750 INFO:tasks.workunit.client.0.smithi001.stdout:8/134: dread d9/fd [0,4194304] 0 2024-09-15T22:26:39.750 INFO:tasks.workunit.client.0.smithi001.stdout:0/127: link d0/c12 d0/dd/d1b/c2b 0 2024-09-15T22:26:39.751 INFO:tasks.workunit.client.0.smithi001.stdout:6/142: link d0/d6/f13 d0/df/d24/f34 0 2024-09-15T22:26:39.753 INFO:tasks.workunit.client.0.smithi001.stdout:4/239: symlink d0/d27/l5e 0 2024-09-15T22:26:39.754 INFO:tasks.workunit.client.0.smithi001.stdout:0/128: rename d0/d6/f18 to d0/d9/f2c 0 2024-09-15T22:26:39.755 INFO:tasks.workunit.client.0.smithi001.stdout:8/135: mknod d9/d19/c25 0 2024-09-15T22:26:39.755 INFO:tasks.workunit.client.0.smithi001.stdout:4/240: write d0/d27/f36 [2197067,56810] 0 2024-09-15T22:26:39.756 INFO:tasks.workunit.client.0.smithi001.stdout:4/241: write d0/d16/f22 [1691090,85363] 0 2024-09-15T22:26:39.756 INFO:tasks.workunit.client.0.smithi001.stdout:4/242: chown d0/d27/l31 111108 1 2024-09-15T22:26:39.757 INFO:tasks.workunit.client.0.smithi001.stdout:6/143: symlink d0/d6/d21/l35 0 2024-09-15T22:26:39.758 INFO:tasks.workunit.client.0.smithi001.stdout:5/178: dwrite d3/fc [0,4194304] 0 2024-09-15T22:26:39.759 INFO:tasks.workunit.client.0.smithi001.stdout:8/136: symlink d9/d19/l26 0 2024-09-15T22:26:39.759 INFO:tasks.workunit.client.0.smithi001.stdout:8/137: write d9/fd [1201520,81169] 0 2024-09-15T22:26:39.759 INFO:tasks.workunit.client.0.smithi001.stdout:8/138: fdatasync d9/d19/f1e 0 2024-09-15T22:26:39.760 INFO:tasks.workunit.client.0.smithi001.stdout:4/243: link d0/d16/f19 d0/d27/d35/d53/d54/f5f 0 2024-09-15T22:26:39.761 INFO:tasks.workunit.client.0.smithi001.stdout:1/192: dread d3/dd/d14/f31 [0,4194304] 0 2024-09-15T22:26:39.762 INFO:tasks.workunit.client.0.smithi001.stdout:9/137: dread d5/f11 [0,4194304] 0 2024-09-15T22:26:39.763 INFO:tasks.workunit.client.0.smithi001.stdout:6/144: mknod d0/c36 0 2024-09-15T22:26:39.764 INFO:tasks.workunit.client.0.smithi001.stdout:8/139: getdents d9 0 2024-09-15T22:26:39.764 INFO:tasks.workunit.client.0.smithi001.stdout:5/179: rename d3/d6/d25/l37 to d3/l3d 0 2024-09-15T22:26:39.764 INFO:tasks.workunit.client.0.smithi001.stdout:4/244: mknod d0/d27/d35/c60 0 2024-09-15T22:26:39.765 INFO:tasks.workunit.client.0.smithi001.stdout:8/140: creat d9/f27 x:0 0 0 2024-09-15T22:26:39.766 INFO:tasks.workunit.client.0.smithi001.stdout:5/180: creat d3/f3e x:0 0 0 2024-09-15T22:26:39.766 INFO:tasks.workunit.client.0.smithi001.stdout:5/181: mknod d3/c3f 0 2024-09-15T22:26:39.774 INFO:tasks.workunit.client.0.smithi001.stdout:3/130: dwrite f5 [0,4194304] 0 2024-09-15T22:26:39.774 INFO:tasks.workunit.client.0.smithi001.stdout:3/131: dread - da/d14/f2a zero size 2024-09-15T22:26:39.774 INFO:tasks.workunit.client.0.smithi001.stdout:3/132: write da/d1f/f28 [70616,29625] 0 2024-09-15T22:26:39.780 INFO:tasks.workunit.client.0.smithi001.stdout:4/245: rename d0/d16 to d0/d27/d35/d61 0 2024-09-15T22:26:39.780 INFO:tasks.workunit.client.0.smithi001.stdout:6/145: dread d0/d2f/f2b [0,4194304] 0 2024-09-15T22:26:39.780 INFO:tasks.workunit.client.0.smithi001.stdout:6/146: truncate d0/d2f/f2b 1748260 0 2024-09-15T22:26:39.798 INFO:tasks.workunit.client.0.smithi001.stdout:7/112: dwrite d0/d7/df/f28 [0,4194304] 0 2024-09-15T22:26:39.800 INFO:tasks.workunit.client.0.smithi001.stdout:5/182: write d3/f2a [510458,9627] 0 2024-09-15T22:26:39.800 INFO:tasks.workunit.client.0.smithi001.stdout:5/183: dread - d3/f16 zero size 2024-09-15T22:26:39.800 INFO:tasks.workunit.client.0.smithi001.stdout:5/184: chown d3/l15 11 1 2024-09-15T22:26:39.800 INFO:tasks.workunit.client.0.smithi001.stdout:5/185: readlink d3/l3b 0 2024-09-15T22:26:39.810 INFO:tasks.workunit.client.0.smithi001.stdout:0/129: dwrite d0/dd/ff [0,4194304] 0 2024-09-15T22:26:39.817 INFO:tasks.workunit.client.0.smithi001.stdout:3/133: mknod da/d16/c2b 0 2024-09-15T22:26:39.818 INFO:tasks.workunit.client.0.smithi001.stdout:4/246: creat d0/d27/d35/d61/d20/d29/d34/f62 x:0 0 0 2024-09-15T22:26:39.835 INFO:tasks.workunit.client.0.smithi001.stdout:3/134: write f8 [2308627,122270] 0 2024-09-15T22:26:39.835 INFO:tasks.workunit.client.0.smithi001.stdout:3/135: write da/f12 [4516988,82550] 0 2024-09-15T22:26:39.835 INFO:tasks.workunit.client.0.smithi001.stdout:3/136: chown da/d17/d1b/c1d 7436 1 2024-09-15T22:26:39.840 INFO:tasks.workunit.client.0.smithi001.stdout:5/186: symlink d3/d1d/l40 0 2024-09-15T22:26:39.840 INFO:tasks.workunit.client.0.smithi001.stdout:5/187: readlink d3/l3b 0 2024-09-15T22:26:39.841 INFO:tasks.workunit.client.0.smithi001.stdout:5/188: readlink d3/l15 0 2024-09-15T22:26:39.842 INFO:tasks.workunit.client.0.smithi001.stdout:4/247: creat d0/d27/d35/d61/d20/f63 x:0 0 0 2024-09-15T22:26:39.842 INFO:tasks.workunit.client.0.smithi001.stdout:4/248: rename d0/d27/d35/d61/d20 to d0/d27/d35/d61/d20/d64 22 2024-09-15T22:26:39.863 INFO:tasks.workunit.client.0.smithi001.stdout:5/189: dread d3/f33 [0,4194304] 0 2024-09-15T22:26:39.864 INFO:tasks.workunit.client.0.smithi001.stdout:5/190: mkdir d3/d6/d41 0 2024-09-15T22:26:39.864 INFO:tasks.workunit.client.0.smithi001.stdout:5/191: readlink d3/l3d 0 2024-09-15T22:26:39.873 INFO:tasks.workunit.client.0.smithi001.stdout:9/138: dread d5/de/f18 [0,4194304] 0 2024-09-15T22:26:39.873 INFO:tasks.workunit.client.0.smithi001.stdout:1/193: dwrite d3/d12/f35 [0,4194304] 0 2024-09-15T22:26:39.873 INFO:tasks.workunit.client.0.smithi001.stdout:9/139: stat d5/de/d1a/d1b 0 2024-09-15T22:26:39.873 INFO:tasks.workunit.client.0.smithi001.stdout:9/140: chown d5/d7/d21/f25 63 1 2024-09-15T22:26:39.874 INFO:tasks.workunit.client.0.smithi001.stdout:9/141: chown d5/de/d1a/d1b/d22/c26 49606 1 2024-09-15T22:26:39.874 INFO:tasks.workunit.client.0.smithi001.stdout:1/194: write d3/dd/d14/f1c [481934,36849] 0 2024-09-15T22:26:39.876 INFO:tasks.workunit.client.0.smithi001.stdout:9/142: rmdir d5/de/d1a 39 2024-09-15T22:26:39.878 INFO:tasks.workunit.client.0.smithi001.stdout:1/195: creat d3/f39 x:0 0 0 2024-09-15T22:26:39.879 INFO:tasks.workunit.client.0.smithi001.stdout:1/196: symlink d3/l3a 0 2024-09-15T22:26:39.880 INFO:tasks.workunit.client.0.smithi001.stdout:1/197: rmdir d3/dd/d14/d23 39 2024-09-15T22:26:39.886 INFO:tasks.workunit.client.0.smithi001.stdout:2/142: dwrite d2/d12/f1c [0,4194304] 0 2024-09-15T22:26:39.886 INFO:tasks.workunit.client.0.smithi001.stdout:6/147: dwrite d0/d6/f23 [0,4194304] 0 2024-09-15T22:26:39.886 INFO:tasks.workunit.client.0.smithi001.stdout:6/148: chown d0/df/l28 15697334 1 2024-09-15T22:26:39.886 INFO:tasks.workunit.client.0.smithi001.stdout:6/149: truncate d0/f5 1153932 0 2024-09-15T22:26:39.895 INFO:tasks.workunit.client.0.smithi001.stdout:2/143: getdents d2/d14/d1a/d20 0 2024-09-15T22:26:39.895 INFO:tasks.workunit.client.0.smithi001.stdout:8/141: dwrite f7 [4194304,4194304] 0 2024-09-15T22:26:39.896 INFO:tasks.workunit.client.0.smithi001.stdout:6/150: dread d0/d6/f14 [0,4194304] 0 2024-09-15T22:26:39.898 INFO:tasks.workunit.client.0.smithi001.stdout:6/151: creat d0/d2f/f37 x:0 0 0 2024-09-15T22:26:39.907 INFO:tasks.workunit.client.0.smithi001.stdout:1/198: dread d3/d12/f1e [0,4194304] 0 2024-09-15T22:26:39.908 INFO:tasks.workunit.client.0.smithi001.stdout:1/199: creat d3/dd/d14/d1b/f3b x:0 0 0 2024-09-15T22:26:39.910 INFO:tasks.workunit.client.0.smithi001.stdout:7/113: dwrite d0/d7/f18 [0,4194304] 0 2024-09-15T22:26:39.912 INFO:tasks.workunit.client.0.smithi001.stdout:7/114: creat d0/f2a x:0 0 0 2024-09-15T22:26:39.914 INFO:tasks.workunit.client.0.smithi001.stdout:9/143: dread d5/f11 [0,4194304] 0 2024-09-15T22:26:39.914 INFO:tasks.workunit.client.0.smithi001.stdout:9/144: chown d5/l1d 25 1 2024-09-15T22:26:39.915 INFO:tasks.workunit.client.0.smithi001.stdout:9/145: unlink d5/de/l14 0 2024-09-15T22:26:39.916 INFO:tasks.workunit.client.0.smithi001.stdout:9/146: mkdir d5/de/d15/d27 0 2024-09-15T22:26:39.916 INFO:tasks.workunit.client.0.smithi001.stdout:9/147: write d5/de/f18 [1683141,34232] 0 2024-09-15T22:26:39.917 INFO:tasks.workunit.client.0.smithi001.stdout:9/148: mknod d5/d7/d21/d24/c28 0 2024-09-15T22:26:39.917 INFO:tasks.workunit.client.0.smithi001.stdout:9/149: readlink d5/d7/l1f 0 2024-09-15T22:26:39.920 INFO:tasks.workunit.client.0.smithi001.stdout:1/200: dread d3/dd/f13 [0,4194304] 0 2024-09-15T22:26:39.941 INFO:tasks.workunit.client.0.smithi001.stdout:6/152: dread d0/f33 [0,4194304] 0 2024-09-15T22:26:39.944 INFO:tasks.workunit.client.0.smithi001.stdout:6/153: rename d0/df/f18 to d0/d2f/f38 0 2024-09-15T22:26:39.944 INFO:tasks.workunit.client.0.smithi001.stdout:6/154: read - d0/d2f/f37 zero size 2024-09-15T22:26:39.960 INFO:tasks.workunit.client.0.smithi001.stdout:6/155: read d0/d6/f13 [643873,76141] 0 2024-09-15T22:26:39.978 INFO:tasks.workunit.client.0.smithi001.stdout:1/201: dwrite d3/dd/f33 [0,4194304] 0 2024-09-15T22:26:39.978 INFO:tasks.workunit.client.0.smithi001.stdout:9/150: dwrite d5/d7/f17 [0,4194304] 0 2024-09-15T22:26:39.993 INFO:tasks.workunit.client.0.smithi001.stdout:4/249: dwrite d0/fd [0,4194304] 0 2024-09-15T22:26:39.993 INFO:tasks.workunit.client.0.smithi001.stdout:6/156: dread d0/fb [0,4194304] 0 2024-09-15T22:26:39.993 INFO:tasks.workunit.client.0.smithi001.stdout:6/157: stat d0/d2f/f37 0 2024-09-15T22:26:39.993 INFO:tasks.workunit.client.0.smithi001.stdout:6/158: read d0/f19 [183428,14964] 0 2024-09-15T22:26:39.995 INFO:tasks.workunit.client.0.smithi001.stdout:1/202: mkdir d3/dd/d3c 0 2024-09-15T22:26:39.995 INFO:tasks.workunit.client.0.smithi001.stdout:9/151: rename d5/d7/c12 to d5/d7/c29 0 2024-09-15T22:26:40.003 INFO:tasks.workunit.client.0.smithi001.stdout:1/203: dread d3/f4 [0,4194304] 0 2024-09-15T22:26:40.004 INFO:tasks.workunit.client.0.smithi001.stdout:1/204: write d3/dd/f19 [4688676,83442] 0 2024-09-15T22:26:40.004 INFO:tasks.workunit.client.0.smithi001.stdout:1/205: write d3/dd/d14/f1c [645200,69324] 0 2024-09-15T22:26:40.007 INFO:tasks.workunit.client.0.smithi001.stdout:9/152: mkdir d5/de/d1a/d1b/d2a 0 2024-09-15T22:26:40.007 INFO:tasks.workunit.client.0.smithi001.stdout:9/153: rename d5/de/d1a/d1b/d22 to d5/de/d1a/d1b/d22/d2b 22 2024-09-15T22:26:40.009 INFO:tasks.workunit.client.0.smithi001.stdout:7/115: dread d0/f26 [0,4194304] 0 2024-09-15T22:26:40.012 INFO:tasks.workunit.client.0.smithi001.stdout:7/116: mkdir d0/d7/d21/d2b 0 2024-09-15T22:26:40.013 INFO:tasks.workunit.client.0.smithi001.stdout:7/117: rmdir d0/d7/d23 39 2024-09-15T22:26:40.015 INFO:tasks.workunit.client.0.smithi001.stdout:7/118: symlink d0/d7/d21/d2b/l2c 0 2024-09-15T22:26:40.015 INFO:tasks.workunit.client.0.smithi001.stdout:7/119: fsync d0/f26 0 2024-09-15T22:26:40.017 INFO:tasks.workunit.client.0.smithi001.stdout:7/120: creat d0/d7/d23/f2d x:0 0 0 2024-09-15T22:26:40.018 INFO:tasks.workunit.client.0.smithi001.stdout:7/121: mkdir d0/d7/d2e 0 2024-09-15T22:26:40.019 INFO:tasks.workunit.client.0.smithi001.stdout:1/206: getdents d3/dd 0 2024-09-15T22:26:40.021 INFO:tasks.workunit.client.0.smithi001.stdout:1/207: creat d3/d12/f3d x:0 0 0 2024-09-15T22:26:40.022 INFO:tasks.workunit.client.0.smithi001.stdout:9/154: truncate d5/d7/f17 695973 0 2024-09-15T22:26:40.022 INFO:tasks.workunit.client.0.smithi001.stdout:4/250: read d0/d27/d35/d61/d20/f26 [62543,76989] 0 2024-09-15T22:26:40.025 INFO:tasks.workunit.client.0.smithi001.stdout:4/251: mkdir d0/d5d/d44/d65 0 2024-09-15T22:26:40.027 INFO:tasks.workunit.client.0.smithi001.stdout:4/252: creat d0/d27/d35/d61/f66 x:0 0 0 2024-09-15T22:26:40.030 INFO:tasks.workunit.client.0.smithi001.stdout:2/144: dwrite d2/d14/d17/d1f/d21/f23 [0,4194304] 0 2024-09-15T22:26:40.034 INFO:tasks.workunit.client.0.smithi001.stdout:9/155: rename d5/d7 to d5/de/d1a/d1b/d22/d2c 0 2024-09-15T22:26:40.035 INFO:tasks.workunit.client.0.smithi001.stdout:7/122: read d0/d7/df/f28 [1695034,57768] 0 2024-09-15T22:26:40.036 INFO:tasks.workunit.client.0.smithi001.stdout:8/142: dwrite d9/f21 [0,4194304] 0 2024-09-15T22:26:40.036 INFO:tasks.workunit.client.0.smithi001.stdout:8/143: fdatasync d9/d19/f1e 0 2024-09-15T22:26:40.038 INFO:tasks.workunit.client.0.smithi001.stdout:9/156: unlink d5/de/d1a/d1b/d22/d2c/l1c 0 2024-09-15T22:26:40.042 INFO:tasks.workunit.client.0.smithi001.stdout:6/159: dwrite d0/f2 [0,4194304] 0 2024-09-15T22:26:40.042 INFO:tasks.workunit.client.0.smithi001.stdout:6/160: fsync d0/d2f/f37 0 2024-09-15T22:26:40.042 INFO:tasks.workunit.client.0.smithi001.stdout:6/161: chown d0/df/d24/d2e 432596 1 2024-09-15T22:26:40.043 INFO:tasks.workunit.client.0.smithi001.stdout:2/145: read d2/d14/d17/d1f/d21/fa [1206074,6459] 0 2024-09-15T22:26:40.043 INFO:tasks.workunit.client.0.smithi001.stdout:2/146: dread - d2/d14/f15 zero size 2024-09-15T22:26:40.045 INFO:tasks.workunit.client.0.smithi001.stdout:6/162: rename d0/d2f/c27 to d0/d2f/c39 0 2024-09-15T22:26:40.045 INFO:tasks.workunit.client.0.smithi001.stdout:6/163: write d0/f19 [1227530,24223] 0 2024-09-15T22:26:40.045 INFO:tasks.workunit.client.0.smithi001.stdout:6/164: chown d0/f22 1347309904 1 2024-09-15T22:26:40.045 INFO:tasks.workunit.client.0.smithi001.stdout:2/147: creat d2/f30 x:0 0 0 2024-09-15T22:26:40.045 INFO:tasks.workunit.client.0.smithi001.stdout:2/148: dread - d2/f2b zero size 2024-09-15T22:26:40.046 INFO:tasks.workunit.client.0.smithi001.stdout:6/165: creat d0/df/d24/f3a x:0 0 0 2024-09-15T22:26:40.065 INFO:tasks.workunit.client.0.smithi001.stdout:5/192: sync 2024-09-15T22:26:40.065 INFO:tasks.workunit.client.0.smithi001.stdout:0/130: sync 2024-09-15T22:26:40.065 INFO:tasks.workunit.client.0.smithi001.stdout:0/131: read - d0/dd/d1b/f21 zero size 2024-09-15T22:26:40.065 INFO:tasks.workunit.client.0.smithi001.stdout:5/193: write d3/f33 [5040837,68046] 0 2024-09-15T22:26:40.065 INFO:tasks.workunit.client.0.smithi001.stdout:3/137: sync 2024-09-15T22:26:40.067 INFO:tasks.workunit.client.0.smithi001.stdout:9/157: dread d5/de/d1a/d1b/d22/d2c/f17 [0,4194304] 0 2024-09-15T22:26:40.079 INFO:tasks.workunit.client.0.smithi001.stdout:1/208: dwrite d3/dd/d14/d1b/f30 [0,4194304] 0 2024-09-15T22:26:40.096 INFO:tasks.workunit.client.0.smithi001.stdout:1/209: unlink d3/d12/d21/c36 0 2024-09-15T22:26:40.109 INFO:tasks.workunit.client.0.smithi001.stdout:1/210: write d3/dd/d14/d1b/f30 [4120863,46191] 0 2024-09-15T22:26:40.110 INFO:tasks.workunit.client.0.smithi001.stdout:8/144: dwrite f7 [4194304,4194304] 0 2024-09-15T22:26:40.110 INFO:tasks.workunit.client.0.smithi001.stdout:7/123: dwrite d0/d7/df/f28 [0,4194304] 0 2024-09-15T22:26:40.112 INFO:tasks.workunit.client.0.smithi001.stdout:1/211: unlink d3/d12/f17 0 2024-09-15T22:26:40.112 INFO:tasks.workunit.client.0.smithi001.stdout:1/212: read - d3/dd/d14/f2e zero size 2024-09-15T22:26:40.112 INFO:tasks.workunit.client.0.smithi001.stdout:1/213: dread - d3/f39 zero size 2024-09-15T22:26:40.116 INFO:tasks.workunit.client.0.smithi001.stdout:7/124: rmdir d0/d7/df 39 2024-09-15T22:26:40.117 INFO:tasks.workunit.client.0.smithi001.stdout:7/125: truncate d0/d7/f19 4137330 0 2024-09-15T22:26:40.121 INFO:tasks.workunit.client.0.smithi001.stdout:9/158: dread d5/de/d1a/d1b/d22/d2c/d21/f25 [0,4194304] 0 2024-09-15T22:26:40.122 INFO:tasks.workunit.client.0.smithi001.stdout:9/159: creat d5/de/d1a/d1b/d2a/f2d x:0 0 0 2024-09-15T22:26:40.124 INFO:tasks.workunit.client.0.smithi001.stdout:9/160: link d5/de/d1a/d1b/d22/d2c/c29 d5/de/d1a/c2e 0 2024-09-15T22:26:40.127 INFO:tasks.workunit.client.0.smithi001.stdout:9/161: creat d5/de/d1a/d1b/d22/f2f x:0 0 0 2024-09-15T22:26:40.128 INFO:tasks.workunit.client.0.smithi001.stdout:8/145: dread f7 [0,4194304] 0 2024-09-15T22:26:40.130 INFO:tasks.workunit.client.0.smithi001.stdout:1/214: dread d3/dd/d14/f31 [0,4194304] 0 2024-09-15T22:26:40.131 INFO:tasks.workunit.client.0.smithi001.stdout:1/215: truncate d3/dd/d14/f25 2022189 0 2024-09-15T22:26:40.133 INFO:tasks.workunit.client.0.smithi001.stdout:1/216: symlink d3/dd/d14/d1b/d2b/l3e 0 2024-09-15T22:26:40.136 INFO:tasks.workunit.client.0.smithi001.stdout:8/146: dread d9/fd [0,4194304] 0 2024-09-15T22:26:40.141 INFO:tasks.workunit.client.0.smithi001.stdout:7/126: read d0/d7/df/f28 [519763,129817] 0 2024-09-15T22:26:40.141 INFO:tasks.workunit.client.0.smithi001.stdout:7/127: write d0/f2a [343115,100308] 0 2024-09-15T22:26:40.141 INFO:tasks.workunit.client.0.smithi001.stdout:7/128: dread - d0/d7/f24 zero size 2024-09-15T22:26:40.141 INFO:tasks.workunit.client.0.smithi001.stdout:7/129: write d0/d7/df/f27 [809039,7548] 0 2024-09-15T22:26:40.142 INFO:tasks.workunit.client.0.smithi001.stdout:7/130: link d0/d7/fd d0/f2f 0 2024-09-15T22:26:40.146 INFO:tasks.workunit.client.0.smithi001.stdout:7/131: link d0/d7/c1e d0/d7/c30 0 2024-09-15T22:26:40.147 INFO:tasks.workunit.client.0.smithi001.stdout:7/132: symlink d0/d7/df/l31 0 2024-09-15T22:26:40.147 INFO:tasks.workunit.client.0.smithi001.stdout:7/133: write d0/d7/d23/f29 [901242,22208] 0 2024-09-15T22:26:40.163 INFO:tasks.workunit.client.0.smithi001.stdout:3/138: dwrite f5 [0,4194304] 0 2024-09-15T22:26:40.164 INFO:tasks.workunit.client.0.smithi001.stdout:3/139: chown da/d16/c2b 16983487 1 2024-09-15T22:26:40.164 INFO:tasks.workunit.client.0.smithi001.stdout:3/140: chown da/d1f 171315 1 2024-09-15T22:26:40.169 INFO:tasks.workunit.client.0.smithi001.stdout:6/166: dwrite d0/f4 [4194304,4194304] 0 2024-09-15T22:26:40.169 INFO:tasks.workunit.client.0.smithi001.stdout:0/132: dwrite d0/f7 [0,4194304] 0 2024-09-15T22:26:40.172 INFO:tasks.workunit.client.0.smithi001.stdout:2/149: dwrite d2/d14/d17/d1f/d21/f23 [0,4194304] 0 2024-09-15T22:26:40.172 INFO:tasks.workunit.client.0.smithi001.stdout:7/134: dread d0/d7/fd [0,4194304] 0 2024-09-15T22:26:40.173 INFO:tasks.workunit.client.0.smithi001.stdout:5/194: dwrite d3/f2a [0,4194304] 0 2024-09-15T22:26:40.174 INFO:tasks.workunit.client.0.smithi001.stdout:9/162: dwrite f4 [0,4194304] 0 2024-09-15T22:26:40.174 INFO:tasks.workunit.client.0.smithi001.stdout:6/167: mknod d0/df/d24/c3b 0 2024-09-15T22:26:40.174 INFO:tasks.workunit.client.0.smithi001.stdout:7/135: fdatasync d0/d7/df/f1c 0 2024-09-15T22:26:40.174 INFO:tasks.workunit.client.0.smithi001.stdout:7/136: chown d0/d7/l1f 45815588 1 2024-09-15T22:26:40.176 INFO:tasks.workunit.client.0.smithi001.stdout:2/150: creat d2/d12/f31 x:0 0 0 2024-09-15T22:26:40.176 INFO:tasks.workunit.client.0.smithi001.stdout:2/151: write d2/d14/d1a/d20/f13 [3180557,130454] 0 2024-09-15T22:26:40.177 INFO:tasks.workunit.client.0.smithi001.stdout:1/217: dwrite d3/d12/f35 [0,4194304] 0 2024-09-15T22:26:40.182 INFO:tasks.workunit.client.0.smithi001.stdout:5/195: rename d3/f2a to d3/d27/f42 0 2024-09-15T22:26:40.183 INFO:tasks.workunit.client.0.smithi001.stdout:9/163: creat d5/de/d15/f30 x:0 0 0 2024-09-15T22:26:40.183 INFO:tasks.workunit.client.0.smithi001.stdout:3/141: dread f7 [0,4194304] 0 2024-09-15T22:26:40.183 INFO:tasks.workunit.client.0.smithi001.stdout:3/142: write da/d16/f26 [221199,50910] 0 2024-09-15T22:26:40.184 INFO:tasks.workunit.client.0.smithi001.stdout:7/137: creat d0/d7/d21/d2b/f32 x:0 0 0 2024-09-15T22:26:40.184 INFO:tasks.workunit.client.0.smithi001.stdout:7/138: stat d0/d7/f17 0 2024-09-15T22:26:40.184 INFO:tasks.workunit.client.0.smithi001.stdout:7/139: write d0/d7/df/f27 [1598529,36957] 0 2024-09-15T22:26:40.187 INFO:tasks.workunit.client.0.smithi001.stdout:2/152: creat d2/d14/d1a/d20/f32 x:0 0 0 2024-09-15T22:26:40.187 INFO:tasks.workunit.client.0.smithi001.stdout:5/196: creat d3/d27/d3c/f43 x:0 0 0 2024-09-15T22:26:40.187 INFO:tasks.workunit.client.0.smithi001.stdout:0/133: dread d0/dd/ff [0,4194304] 0 2024-09-15T22:26:40.188 INFO:tasks.workunit.client.0.smithi001.stdout:1/218: write d3/dd/d14/f1c [265335,38992] 0 2024-09-15T22:26:40.190 INFO:tasks.workunit.client.0.smithi001.stdout:9/164: creat d5/de/d1a/d1b/d22/d2c/f31 x:0 0 0 2024-09-15T22:26:40.191 INFO:tasks.workunit.client.0.smithi001.stdout:3/143: rename f2 to da/d17/d1b/f2c 0 2024-09-15T22:26:40.191 INFO:tasks.workunit.client.0.smithi001.stdout:3/144: write da/d1f/f22 [791629,69281] 0 2024-09-15T22:26:40.191 INFO:tasks.workunit.client.0.smithi001.stdout:9/165: write d5/de/d15/f30 [578736,130003] 0 2024-09-15T22:26:40.192 INFO:tasks.workunit.client.0.smithi001.stdout:2/153: symlink d2/d14/l33 0 2024-09-15T22:26:40.192 INFO:tasks.workunit.client.0.smithi001.stdout:4/253: sync 2024-09-15T22:26:40.192 INFO:tasks.workunit.client.0.smithi001.stdout:4/254: chown d0/d5d/c49 6012322 1 2024-09-15T22:26:40.192 INFO:tasks.workunit.client.0.smithi001.stdout:1/219: creat d3/f3f x:0 0 0 2024-09-15T22:26:40.192 INFO:tasks.workunit.client.0.smithi001.stdout:6/168: unlink d0/f3 0 2024-09-15T22:26:40.193 INFO:tasks.workunit.client.0.smithi001.stdout:4/255: write d0/d27/d35/d61/d20/f38 [510553,119145] 0 2024-09-15T22:26:40.193 INFO:tasks.workunit.client.0.smithi001.stdout:7/140: symlink d0/d7/l33 0 2024-09-15T22:26:40.193 INFO:tasks.workunit.client.0.smithi001.stdout:3/145: stat da/d14/l1a 0 2024-09-15T22:26:40.194 INFO:tasks.workunit.client.0.smithi001.stdout:9/166: symlink d5/de/d1a/d1b/d22/d2c/d21/l32 0 2024-09-15T22:26:40.195 INFO:tasks.workunit.client.0.smithi001.stdout:1/220: creat d3/d12/f40 x:0 0 0 2024-09-15T22:26:40.196 INFO:tasks.workunit.client.0.smithi001.stdout:6/169: link d0/d2f/f37 d0/d6/d21/f3c 0 2024-09-15T22:26:40.196 INFO:tasks.workunit.client.0.smithi001.stdout:4/256: mkdir d0/d27/d35/d59/d67 0 2024-09-15T22:26:40.196 INFO:tasks.workunit.client.0.smithi001.stdout:4/257: write d0/d27/d35/d61/f21 [1648624,91815] 0 2024-09-15T22:26:40.197 INFO:tasks.workunit.client.0.smithi001.stdout:4/258: chown d0/d27/d35/d61/f66 204599 1 2024-09-15T22:26:40.197 INFO:tasks.workunit.client.0.smithi001.stdout:4/259: truncate d0/d27/d35/d61/d20/d29/d34/f39 1042696 0 2024-09-15T22:26:40.197 INFO:tasks.workunit.client.0.smithi001.stdout:4/260: chown d0/d27/d35/d61/f23 4860618 1 2024-09-15T22:26:40.202 INFO:tasks.workunit.client.0.smithi001.stdout:0/134: dread d0/f16 [0,4194304] 0 2024-09-15T22:26:40.206 INFO:tasks.workunit.client.0.smithi001.stdout:3/146: mknod da/d16/c2d 0 2024-09-15T22:26:40.206 INFO:tasks.workunit.client.0.smithi001.stdout:1/221: mkdir d3/dd/d14/d1b/d41 0 2024-09-15T22:26:40.206 INFO:tasks.workunit.client.0.smithi001.stdout:9/167: creat d5/de/d1a/d1b/f33 x:0 0 0 2024-09-15T22:26:40.206 INFO:tasks.workunit.client.0.smithi001.stdout:6/170: symlink d0/d6/d21/l3d 0 2024-09-15T22:26:40.206 INFO:tasks.workunit.client.0.smithi001.stdout:6/171: chown d0/df/d24/c3b 397020 1 2024-09-15T22:26:40.206 INFO:tasks.workunit.client.0.smithi001.stdout:4/261: mknod d0/d5d/d44/c68 0 2024-09-15T22:26:40.206 INFO:tasks.workunit.client.0.smithi001.stdout:4/262: stat d0/l17 0 2024-09-15T22:26:40.206 INFO:tasks.workunit.client.0.smithi001.stdout:2/154: dread d2/d14/d1a/d20/f19 [0,4194304] 0 2024-09-15T22:26:40.215 INFO:tasks.workunit.client.0.smithi001.stdout:6/172: creat d0/d6/f3e x:0 0 0 2024-09-15T22:26:40.215 INFO:tasks.workunit.client.0.smithi001.stdout:4/263: creat d0/d27/d35/f69 x:0 0 0 2024-09-15T22:26:40.215 INFO:tasks.workunit.client.0.smithi001.stdout:9/168: rmdir d5/de/d1a/d1b/d22 39 2024-09-15T22:26:40.215 INFO:tasks.workunit.client.0.smithi001.stdout:9/169: readlink d5/de/d1a/l1e 0 2024-09-15T22:26:40.215 INFO:tasks.workunit.client.0.smithi001.stdout:6/173: write d0/f19 [1565574,93728] 0 2024-09-15T22:26:40.215 INFO:tasks.workunit.client.0.smithi001.stdout:7/141: dread d0/d7/df/f28 [0,4194304] 0 2024-09-15T22:26:40.218 INFO:tasks.workunit.client.0.smithi001.stdout:4/264: mkdir d0/d5d/d44/d65/d6a 0 2024-09-15T22:26:40.218 INFO:tasks.workunit.client.0.smithi001.stdout:4/265: readlink d0/l3 0 2024-09-15T22:26:40.219 INFO:tasks.workunit.client.0.smithi001.stdout:1/222: dread d3/dd/d14/f31 [0,4194304] 0 2024-09-15T22:26:40.220 INFO:tasks.workunit.client.0.smithi001.stdout:2/155: getdents d2/d12 0 2024-09-15T22:26:40.220 INFO:tasks.workunit.client.0.smithi001.stdout:2/156: chown d2/d14/d1a/d20/f13 87 1 2024-09-15T22:26:40.223 INFO:tasks.workunit.client.0.smithi001.stdout:3/147: read f5 [2270890,96072] 0 2024-09-15T22:26:40.225 INFO:tasks.workunit.client.0.smithi001.stdout:2/157: read d2/d14/d17/d1f/d21/fe [374435,45715] 0 2024-09-15T22:26:40.225 INFO:tasks.workunit.client.0.smithi001.stdout:4/266: creat d0/f6b x:0 0 0 2024-09-15T22:26:40.227 INFO:tasks.workunit.client.0.smithi001.stdout:1/223: unlink d3/dd/d14/d23/l37 0 2024-09-15T22:26:40.230 INFO:tasks.workunit.client.0.smithi001.stdout:4/267: symlink d0/d27/d35/d61/d20/d29/d40/l6c 0 2024-09-15T22:26:40.230 INFO:tasks.workunit.client.0.smithi001.stdout:1/224: chown d3/dd/f33 1106687 1 2024-09-15T22:26:40.230 INFO:tasks.workunit.client.0.smithi001.stdout:1/225: read d3/dd/d14/f25 [1686086,85872] 0 2024-09-15T22:26:40.230 INFO:tasks.workunit.client.0.smithi001.stdout:1/226: chown d3/dd/d14/f25 931254 1 2024-09-15T22:26:40.230 INFO:tasks.workunit.client.0.smithi001.stdout:2/158: rmdir d2/d14/d17/d1f/d21 39 2024-09-15T22:26:40.230 INFO:tasks.workunit.client.0.smithi001.stdout:7/142: dread d0/d7/df/f27 [0,4194304] 0 2024-09-15T22:26:40.236 INFO:tasks.workunit.client.0.smithi001.stdout:4/268: rename d0/d27/d35/d61/f3c to d0/d5d/d44/d65/d6a/f6d 0 2024-09-15T22:26:40.236 INFO:tasks.workunit.client.0.smithi001.stdout:4/269: read d0/d27/d35/d61/d20/f38 [569861,49797] 0 2024-09-15T22:26:40.236 INFO:tasks.workunit.client.0.smithi001.stdout:7/143: creat d0/d7/d2e/f34 x:0 0 0 2024-09-15T22:26:40.236 INFO:tasks.workunit.client.0.smithi001.stdout:1/227: creat d3/f42 x:0 0 0 2024-09-15T22:26:40.237 INFO:tasks.workunit.client.0.smithi001.stdout:7/144: mknod d0/d7/d21/d2b/c35 0 2024-09-15T22:26:40.239 INFO:tasks.workunit.client.0.smithi001.stdout:1/228: rename d3/f4 to d3/dd/d3c/f43 0 2024-09-15T22:26:40.245 INFO:tasks.workunit.client.0.smithi001.stdout:7/145: dread d0/d7/df/f27 [0,4194304] 0 2024-09-15T22:26:40.249 INFO:tasks.workunit.client.0.smithi001.stdout:0/135: dwrite d0/d9/db/f19 [0,4194304] 0 2024-09-15T22:26:40.253 INFO:tasks.workunit.client.0.smithi001.stdout:0/136: mknod d0/c2d 0 2024-09-15T22:26:40.256 INFO:tasks.workunit.client.0.smithi001.stdout:5/197: dwrite d3/d6/d25/f38 [0,4194304] 0 2024-09-15T22:26:40.256 INFO:tasks.workunit.client.0.smithi001.stdout:5/198: dread - d3/f3e zero size 2024-09-15T22:26:40.259 INFO:tasks.workunit.client.0.smithi001.stdout:7/146: dread d0/d7/f19 [0,4194304] 0 2024-09-15T22:26:40.268 INFO:tasks.workunit.client.0.smithi001.stdout:5/199: write d3/fc [2546532,40816] 0 2024-09-15T22:26:40.275 INFO:tasks.workunit.client.0.smithi001.stdout:0/137: read d0/d9/db/f10 [2082348,129084] 0 2024-09-15T22:26:40.275 INFO:tasks.workunit.client.0.smithi001.stdout:0/138: mknod d0/dd/d1b/c2e 0 2024-09-15T22:26:40.276 INFO:tasks.workunit.client.0.smithi001.stdout:0/139: write d0/d9/f2c [95957,16259] 0 2024-09-15T22:26:40.277 INFO:tasks.workunit.client.0.smithi001.stdout:0/140: mknod d0/d9/db/c2f 0 2024-09-15T22:26:40.283 INFO:tasks.workunit.client.0.smithi001.stdout:0/141: fdatasync d0/d9/f2c 0 2024-09-15T22:26:40.283 INFO:tasks.workunit.client.0.smithi001.stdout:0/142: truncate d0/d6/f2a 818661 0 2024-09-15T22:26:40.290 INFO:tasks.workunit.client.0.smithi001.stdout:0/143: write d0/d9/f1c [262383,86996] 0 2024-09-15T22:26:40.290 INFO:tasks.workunit.client.0.smithi001.stdout:0/144: truncate d0/d9/db/f1e 250133 0 2024-09-15T22:26:40.290 INFO:tasks.workunit.client.0.smithi001.stdout:0/145: readlink d0/l1f 0 2024-09-15T22:26:40.291 INFO:tasks.workunit.client.0.smithi001.stdout:8/147: sync 2024-09-15T22:26:40.293 INFO:tasks.workunit.client.0.smithi001.stdout:7/147: dread d0/d7/df/f28 [0,4194304] 0 2024-09-15T22:26:40.294 INFO:tasks.workunit.client.0.smithi001.stdout:0/146: getdents d0/dd 0 2024-09-15T22:26:40.298 INFO:tasks.workunit.client.0.smithi001.stdout:5/200: dread d3/d27/f42 [0,4194304] 0 2024-09-15T22:26:40.302 INFO:tasks.workunit.client.0.smithi001.stdout:6/174: dwrite d0/d2f/f2b [0,4194304] 0 2024-09-15T22:26:40.312 INFO:tasks.workunit.client.0.smithi001.stdout:0/147: dread d0/d6/f15 [0,4194304] 0 2024-09-15T22:26:40.313 INFO:tasks.workunit.client.0.smithi001.stdout:0/148: creat d0/d6/f30 x:0 0 0 2024-09-15T22:26:40.313 INFO:tasks.workunit.client.0.smithi001.stdout:0/149: write d0/d9/db/f1e [1014201,107738] 0 2024-09-15T22:26:40.313 INFO:tasks.workunit.client.0.smithi001.stdout:0/150: fsync d0/f16 0 2024-09-15T22:26:40.314 INFO:tasks.workunit.client.0.smithi001.stdout:3/148: dwrite f7 [0,4194304] 0 2024-09-15T22:26:40.315 INFO:tasks.workunit.client.0.smithi001.stdout:0/151: rename d0/c2d to d0/d6/c31 0 2024-09-15T22:26:40.315 INFO:tasks.workunit.client.0.smithi001.stdout:0/152: fsync d0/f8 0 2024-09-15T22:26:40.315 INFO:tasks.workunit.client.0.smithi001.stdout:7/148: write d0/d7/df/f20 [6988806,62814] 0 2024-09-15T22:26:40.317 INFO:tasks.workunit.client.0.smithi001.stdout:8/148: dread d9/f21 [0,4194304] 0 2024-09-15T22:26:40.317 INFO:tasks.workunit.client.0.smithi001.stdout:8/149: fsync d9/d19/f1e 0 2024-09-15T22:26:40.319 INFO:tasks.workunit.client.0.smithi001.stdout:3/149: mkdir da/d1f/d2e 0 2024-09-15T22:26:40.319 INFO:tasks.workunit.client.0.smithi001.stdout:0/153: creat d0/d9/f32 x:0 0 0 2024-09-15T22:26:40.319 INFO:tasks.workunit.client.0.smithi001.stdout:0/154: chown d0/d9/d1a/f28 376 1 2024-09-15T22:26:40.322 INFO:tasks.workunit.client.0.smithi001.stdout:0/155: write d0/f8 [31430,60658] 0 2024-09-15T22:26:40.329 INFO:tasks.workunit.client.0.smithi001.stdout:3/150: mknod da/d1f/c2f 0 2024-09-15T22:26:40.330 INFO:tasks.workunit.client.0.smithi001.stdout:6/175: dread d0/d2f/f2b [0,4194304] 0 2024-09-15T22:26:40.331 INFO:tasks.workunit.client.0.smithi001.stdout:4/270: dwrite d0/d27/d35/d61/d20/f63 [0,4194304] 0 2024-09-15T22:26:40.331 INFO:tasks.workunit.client.0.smithi001.stdout:6/176: write d0/df/d24/d2e/f1d [1128578,114355] 0 2024-09-15T22:26:40.331 INFO:tasks.workunit.client.0.smithi001.stdout:4/271: write d0/d27/d35/d61/f2d [227667,87443] 0 2024-09-15T22:26:40.331 INFO:tasks.workunit.client.0.smithi001.stdout:4/272: write d0/d27/d35/d61/d20/f25 [3038427,94232] 0 2024-09-15T22:26:40.331 INFO:tasks.workunit.client.0.smithi001.stdout:0/156: mkdir d0/dd/d33 0 2024-09-15T22:26:40.331 INFO:tasks.workunit.client.0.smithi001.stdout:5/201: dwrite d3/d6/f7 [0,4194304] 0 2024-09-15T22:26:40.332 INFO:tasks.workunit.client.0.smithi001.stdout:3/151: creat da/d16/f30 x:0 0 0 2024-09-15T22:26:40.332 INFO:tasks.workunit.client.0.smithi001.stdout:0/157: mknod d0/dd/d1b/c34 0 2024-09-15T22:26:40.333 INFO:tasks.workunit.client.0.smithi001.stdout:4/273: creat d0/d5d/d44/d65/d6a/f6e x:0 0 0 2024-09-15T22:26:40.334 INFO:tasks.workunit.client.0.smithi001.stdout:5/202: symlink d3/d1d/l44 0 2024-09-15T22:26:40.334 INFO:tasks.workunit.client.0.smithi001.stdout:5/203: chown d3/c2f 4444 1 2024-09-15T22:26:40.335 INFO:tasks.workunit.client.0.smithi001.stdout:3/152: creat da/f31 x:0 0 0 2024-09-15T22:26:40.336 INFO:tasks.workunit.client.0.smithi001.stdout:0/158: mknod d0/dd/d1b/c35 0 2024-09-15T22:26:40.337 INFO:tasks.workunit.client.0.smithi001.stdout:3/153: link da/d1f/f24 da/d17/f32 0 2024-09-15T22:26:40.338 INFO:tasks.workunit.client.0.smithi001.stdout:0/159: mkdir d0/d9/d1a/d36 0 2024-09-15T22:26:40.344 INFO:tasks.workunit.client.0.smithi001.stdout:0/160: symlink d0/d9/db/l37 0 2024-09-15T22:26:40.344 INFO:tasks.workunit.client.0.smithi001.stdout:3/154: creat da/d17/f33 x:0 0 0 2024-09-15T22:26:40.345 INFO:tasks.workunit.client.0.smithi001.stdout:3/155: link da/d1f/c2f da/d17/d1b/c34 0 2024-09-15T22:26:40.348 INFO:tasks.workunit.client.0.smithi001.stdout:5/204: read d3/d6/f7 [1234076,126196] 0 2024-09-15T22:26:40.360 INFO:tasks.workunit.client.0.smithi001.stdout:4/274: dread d0/f1f [0,4194304] 0 2024-09-15T22:26:40.366 INFO:tasks.workunit.client.0.smithi001.stdout:7/149: write d0/d7/f19 [2318517,129109] 0 2024-09-15T22:26:40.369 INFO:tasks.workunit.client.0.smithi001.stdout:0/161: write d0/dd/ff [3679847,9685] 0 2024-09-15T22:26:40.371 INFO:tasks.workunit.client.0.smithi001.stdout:4/275: mknod d0/d27/d35/d61/d20/d29/d40/c6f 0 2024-09-15T22:26:40.375 INFO:tasks.workunit.client.0.smithi001.stdout:4/276: creat d0/d27/d35/d61/d20/d29/d34/f70 x:0 0 0 2024-09-15T22:26:40.375 INFO:tasks.workunit.client.0.smithi001.stdout:4/277: chown d0/d27/l31 443964667 1 2024-09-15T22:26:40.376 INFO:tasks.workunit.client.0.smithi001.stdout:4/278: creat d0/d27/d35/d61/d20/d29/d40/f71 x:0 0 0 2024-09-15T22:26:40.376 INFO:tasks.workunit.client.0.smithi001.stdout:4/279: dread - d0/d27/d35/d61/d20/d29/d34/f70 zero size 2024-09-15T22:26:40.377 INFO:tasks.workunit.client.0.smithi001.stdout:4/280: chown d0/f7 19 1 2024-09-15T22:26:40.381 INFO:tasks.workunit.client.0.smithi001.stdout:6/177: dwrite d0/df/d24/d2e/f1d [0,4194304] 0 2024-09-15T22:26:40.387 INFO:tasks.workunit.client.0.smithi001.stdout:4/281: getdents d0/d27/d35/d61/d20/d29/d40 0 2024-09-15T22:26:40.387 INFO:tasks.workunit.client.0.smithi001.stdout:4/282: chown d0/f6b 1523296 1 2024-09-15T22:26:40.388 INFO:tasks.workunit.client.0.smithi001.stdout:4/283: creat d0/d27/d35/f72 x:0 0 0 2024-09-15T22:26:40.390 INFO:tasks.workunit.client.0.smithi001.stdout:4/284: mkdir d0/d27/d35/d53/d54/d73 0 2024-09-15T22:26:40.390 INFO:tasks.workunit.client.0.smithi001.stdout:4/285: fdatasync d0/d27/d35/d61/f22 0 2024-09-15T22:26:40.391 INFO:tasks.workunit.client.0.smithi001.stdout:4/286: mkdir d0/d27/d35/d74 0 2024-09-15T22:26:40.392 INFO:tasks.workunit.client.0.smithi001.stdout:4/287: mkdir d0/d27/d35/d61/d20/d29/d34/d3a/d75 0 2024-09-15T22:26:40.393 INFO:tasks.workunit.client.0.smithi001.stdout:4/288: mknod d0/d27/d35/d53/c76 0 2024-09-15T22:26:40.394 INFO:tasks.workunit.client.0.smithi001.stdout:4/289: symlink d0/d27/d57/l77 0 2024-09-15T22:26:40.394 INFO:tasks.workunit.client.0.smithi001.stdout:4/290: write d0/d27/d35/d61/f21 [2293981,52044] 0 2024-09-15T22:26:40.395 INFO:tasks.workunit.client.0.smithi001.stdout:8/150: dwrite d9/fa [0,4194304] 0 2024-09-15T22:26:40.398 INFO:tasks.workunit.client.0.smithi001.stdout:4/291: rename d0/l18 to d0/l78 0 2024-09-15T22:26:40.399 INFO:tasks.workunit.client.0.smithi001.stdout:8/151: mknod d9/c28 0 2024-09-15T22:26:40.400 INFO:tasks.workunit.client.0.smithi001.stdout:4/292: rename d0/d27/d35/d61/d20/f28 to d0/d27/f79 0 2024-09-15T22:26:40.400 INFO:tasks.workunit.client.0.smithi001.stdout:4/293: readlink d0/l3 0 2024-09-15T22:26:40.400 INFO:tasks.workunit.client.0.smithi001.stdout:4/294: dread - d0/d27/d35/d61/d20/f4f zero size 2024-09-15T22:26:40.400 INFO:tasks.workunit.client.0.smithi001.stdout:4/295: stat d0/d27/l2b 0 2024-09-15T22:26:40.401 INFO:tasks.workunit.client.0.smithi001.stdout:3/156: dwrite da/d1f/f24 [0,4194304] 0 2024-09-15T22:26:40.401 INFO:tasks.workunit.client.0.smithi001.stdout:3/157: read - da/d16/f1e zero size 2024-09-15T22:26:40.402 INFO:tasks.workunit.client.0.smithi001.stdout:4/296: link d0/d27/c32 d0/d27/d35/d61/d20/c7a 0 2024-09-15T22:26:40.402 INFO:tasks.workunit.client.0.smithi001.stdout:4/297: read - d0/d27/d35/d61/d20/f4f zero size 2024-09-15T22:26:40.403 INFO:tasks.workunit.client.0.smithi001.stdout:8/152: rmdir d9 39 2024-09-15T22:26:40.403 INFO:tasks.workunit.client.0.smithi001.stdout:7/150: dread d0/d7/f19 [0,4194304] 0 2024-09-15T22:26:40.405 INFO:tasks.workunit.client.0.smithi001.stdout:3/158: symlink da/l35 0 2024-09-15T22:26:40.407 INFO:tasks.workunit.client.0.smithi001.stdout:4/298: rename d0/d27/d35/d61/d20/d29/d34/d3a/d75 to d0/d27/d35/d59/d67/d7b 0 2024-09-15T22:26:40.407 INFO:tasks.workunit.client.0.smithi001.stdout:4/299: fsync d0/f6b 0 2024-09-15T22:26:40.408 INFO:tasks.workunit.client.0.smithi001.stdout:8/153: mkdir d9/d19/d29 0 2024-09-15T22:26:40.408 INFO:tasks.workunit.client.0.smithi001.stdout:1/229: sync 2024-09-15T22:26:40.408 INFO:tasks.workunit.client.0.smithi001.stdout:9/170: sync 2024-09-15T22:26:40.408 INFO:tasks.workunit.client.0.smithi001.stdout:2/159: sync 2024-09-15T22:26:40.408 INFO:tasks.workunit.client.0.smithi001.stdout:7/151: mkdir d0/d7/df/d36 0 2024-09-15T22:26:40.410 INFO:tasks.workunit.client.0.smithi001.stdout:3/159: symlink da/d1f/l36 0 2024-09-15T22:26:40.410 INFO:tasks.workunit.client.0.smithi001.stdout:3/160: readlink da/d14/l1a 0 2024-09-15T22:26:40.411 INFO:tasks.workunit.client.0.smithi001.stdout:0/162: dwrite d0/dd/f29 [0,4194304] 0 2024-09-15T22:26:40.411 INFO:tasks.workunit.client.0.smithi001.stdout:0/163: write d0/d9/db/f1e [1318301,84476] 0 2024-09-15T22:26:40.411 INFO:tasks.workunit.client.0.smithi001.stdout:0/164: dread - d0/d9/f32 zero size 2024-09-15T22:26:40.411 INFO:tasks.workunit.client.0.smithi001.stdout:0/165: dread - d0/f23 zero size 2024-09-15T22:26:40.412 INFO:tasks.workunit.client.0.smithi001.stdout:8/154: unlink d9/d19/f23 0 2024-09-15T22:26:40.412 INFO:tasks.workunit.client.0.smithi001.stdout:8/155: chown d9/d19/d29 1302025334 1 2024-09-15T22:26:40.413 INFO:tasks.workunit.client.0.smithi001.stdout:2/160: unlink d2/d14/d1a/d20/f32 0 2024-09-15T22:26:40.414 INFO:tasks.workunit.client.0.smithi001.stdout:2/161: write d2/d14/f15 [947585,121256] 0 2024-09-15T22:26:40.414 INFO:tasks.workunit.client.0.smithi001.stdout:1/230: creat d3/dd/d14/f44 x:0 0 0 2024-09-15T22:26:40.415 INFO:tasks.workunit.client.0.smithi001.stdout:7/152: creat d0/d7/d21/d2b/f37 x:0 0 0 2024-09-15T22:26:40.416 INFO:tasks.workunit.client.0.smithi001.stdout:8/156: write d9/fa [4757409,111426] 0 2024-09-15T22:26:40.416 INFO:tasks.workunit.client.0.smithi001.stdout:0/166: creat d0/d9/f38 x:0 0 0 2024-09-15T22:26:40.417 INFO:tasks.workunit.client.0.smithi001.stdout:9/171: dread d5/de/f18 [0,4194304] 0 2024-09-15T22:26:40.417 INFO:tasks.workunit.client.0.smithi001.stdout:2/162: truncate d2/f9 1345014 0 2024-09-15T22:26:40.418 INFO:tasks.workunit.client.0.smithi001.stdout:1/231: mknod d3/dd/d14/d23/c45 0 2024-09-15T22:26:40.419 INFO:tasks.workunit.client.0.smithi001.stdout:7/153: creat d0/d7/d23/f38 x:0 0 0 2024-09-15T22:26:40.419 INFO:tasks.workunit.client.0.smithi001.stdout:3/161: mkdir da/d14/d37 0 2024-09-15T22:26:40.421 INFO:tasks.workunit.client.0.smithi001.stdout:0/167: link d0/d9/f26 d0/d9/f39 0 2024-09-15T22:26:40.421 INFO:tasks.workunit.client.0.smithi001.stdout:0/168: chown d0/d9/db/f19 32678262 1 2024-09-15T22:26:40.421 INFO:tasks.workunit.client.0.smithi001.stdout:0/169: write d0/f23 [207970,83536] 0 2024-09-15T22:26:40.422 INFO:tasks.workunit.client.0.smithi001.stdout:9/172: unlink d5/de/d1a/d1b/d2a/f2d 0 2024-09-15T22:26:40.423 INFO:tasks.workunit.client.0.smithi001.stdout:2/163: mknod d2/d14/d17/d1f/d21/c34 0 2024-09-15T22:26:40.425 INFO:tasks.workunit.client.0.smithi001.stdout:1/232: symlink d3/dd/d14/l46 0 2024-09-15T22:26:40.425 INFO:tasks.workunit.client.0.smithi001.stdout:1/233: write d3/d12/f3d [541850,13020] 0 2024-09-15T22:26:40.427 INFO:tasks.workunit.client.0.smithi001.stdout:7/154: rename d0/d7/f18 to d0/d7/d21/f39 0 2024-09-15T22:26:40.428 INFO:tasks.workunit.client.0.smithi001.stdout:3/162: unlink da/d1f/c2f 0 2024-09-15T22:26:40.428 INFO:tasks.workunit.client.0.smithi001.stdout:3/163: readlink da/l35 0 2024-09-15T22:26:40.429 INFO:tasks.workunit.client.0.smithi001.stdout:3/164: chown da/d17/d1b/c34 2018 1 2024-09-15T22:26:40.429 INFO:tasks.workunit.client.0.smithi001.stdout:8/157: dread d9/f1d [0,4194304] 0 2024-09-15T22:26:40.429 INFO:tasks.workunit.client.0.smithi001.stdout:8/158: chown d9/d19 37830 1 2024-09-15T22:26:40.430 INFO:tasks.workunit.client.0.smithi001.stdout:2/164: getdents d2/d14/d17/d1f 0 2024-09-15T22:26:40.430 INFO:tasks.workunit.client.0.smithi001.stdout:9/173: dread d5/de/d1a/d1b/d22/d2c/f17 [0,4194304] 0 2024-09-15T22:26:40.430 INFO:tasks.workunit.client.0.smithi001.stdout:9/174: read d5/de/f18 [3491801,62316] 0 2024-09-15T22:26:40.431 INFO:tasks.workunit.client.0.smithi001.stdout:1/234: mknod d3/dd/d14/d1b/d2b/c47 0 2024-09-15T22:26:40.431 INFO:tasks.workunit.client.0.smithi001.stdout:1/235: stat d3/dd/d14/d1b/d2b 0 2024-09-15T22:26:40.431 INFO:tasks.workunit.client.0.smithi001.stdout:1/236: chown d3/dd/d3c 359153041 1 2024-09-15T22:26:40.435 INFO:tasks.workunit.client.0.smithi001.stdout:7/155: rename d0/f26 to d0/d7/d21/f3a 0 2024-09-15T22:26:40.436 INFO:tasks.workunit.client.0.smithi001.stdout:3/165: creat da/d16/f38 x:0 0 0 2024-09-15T22:26:40.437 INFO:tasks.workunit.client.0.smithi001.stdout:3/166: readlink da/d1f/l36 0 2024-09-15T22:26:40.438 INFO:tasks.workunit.client.0.smithi001.stdout:2/165: mknod d2/c35 0 2024-09-15T22:26:40.440 INFO:tasks.workunit.client.0.smithi001.stdout:9/175: mknod d5/de/d1a/d1b/d22/d2c/d21/d24/c34 0 2024-09-15T22:26:40.440 INFO:tasks.workunit.client.0.smithi001.stdout:7/156: rmdir d0 39 2024-09-15T22:26:40.441 INFO:tasks.workunit.client.0.smithi001.stdout:9/176: link d5/de/d1a/d1b/d22/d2c/d21/d24/c34 d5/de/d1a/d1b/d22/c35 0 2024-09-15T22:26:40.441 INFO:tasks.workunit.client.0.smithi001.stdout:9/177: write d5/de/f18 [4274553,61235] 0 2024-09-15T22:26:40.442 INFO:tasks.workunit.client.0.smithi001.stdout:8/159: dread d9/d19/f1f [0,4194304] 0 2024-09-15T22:26:40.442 INFO:tasks.workunit.client.0.smithi001.stdout:0/170: dread d0/f3 [0,4194304] 0 2024-09-15T22:26:40.442 INFO:tasks.workunit.client.0.smithi001.stdout:0/171: readlink d0/l1f 0 2024-09-15T22:26:40.442 INFO:tasks.workunit.client.0.smithi001.stdout:9/178: getdents d5 0 2024-09-15T22:26:40.443 INFO:tasks.workunit.client.0.smithi001.stdout:2/166: read d2/d14/d1a/d20/f19 [605284,50995] 0 2024-09-15T22:26:40.444 INFO:tasks.workunit.client.0.smithi001.stdout:4/300: dwrite d0/d27/d35/d61/d20/f38 [0,4194304] 0 2024-09-15T22:26:40.447 INFO:tasks.workunit.client.0.smithi001.stdout:0/172: rename d0/d9/db/f1e to d0/d9/d1a/d36/f3a 0 2024-09-15T22:26:40.448 INFO:tasks.workunit.client.0.smithi001.stdout:9/179: getdents d5/de/d1a/d1b 0 2024-09-15T22:26:40.450 INFO:tasks.workunit.client.0.smithi001.stdout:8/160: rmdir d9 39 2024-09-15T22:26:40.450 INFO:tasks.workunit.client.0.smithi001.stdout:8/161: read - d9/d19/f1e zero size 2024-09-15T22:26:40.455 INFO:tasks.workunit.client.0.smithi001.stdout:4/301: truncate d0/d27/d35/d61/d20/d29/d34/f41 902403 0 2024-09-15T22:26:40.455 INFO:tasks.workunit.client.0.smithi001.stdout:9/180: dread d5/de/d15/f30 [0,4194304] 0 2024-09-15T22:26:40.456 INFO:tasks.workunit.client.0.smithi001.stdout:8/162: truncate d9/fb 1412966 0 2024-09-15T22:26:40.456 INFO:tasks.workunit.client.0.smithi001.stdout:0/173: rmdir d0/d9/db 39 2024-09-15T22:26:40.456 INFO:tasks.workunit.client.0.smithi001.stdout:8/163: write d9/fd [1535081,24716] 0 2024-09-15T22:26:40.459 INFO:tasks.workunit.client.0.smithi001.stdout:4/302: truncate d0/d27/f36 1822500 0 2024-09-15T22:26:40.459 INFO:tasks.workunit.client.0.smithi001.stdout:4/303: stat d0/l46 0 2024-09-15T22:26:40.460 INFO:tasks.workunit.client.0.smithi001.stdout:9/181: symlink d5/de/d15/l36 0 2024-09-15T22:26:40.460 INFO:tasks.workunit.client.0.smithi001.stdout:9/182: fdatasync d5/de/d1a/d1b/d22/d2c/d21/f25 0 2024-09-15T22:26:40.460 INFO:tasks.workunit.client.0.smithi001.stdout:0/174: rmdir d0/dd/d1b 39 2024-09-15T22:26:40.461 INFO:tasks.workunit.client.0.smithi001.stdout:8/164: creat d9/d19/d29/f2a x:0 0 0 2024-09-15T22:26:40.462 INFO:tasks.workunit.client.0.smithi001.stdout:4/304: unlink d0/d27/l2b 0 2024-09-15T22:26:40.463 INFO:tasks.workunit.client.0.smithi001.stdout:4/305: getdents d0/d27/d35/d53/d54/d73 0 2024-09-15T22:26:40.465 INFO:tasks.workunit.client.0.smithi001.stdout:9/183: creat d5/f37 x:0 0 0 2024-09-15T22:26:40.467 INFO:tasks.workunit.client.0.smithi001.stdout:4/306: mkdir d0/d5d/d7c 0 2024-09-15T22:26:40.467 INFO:tasks.workunit.client.0.smithi001.stdout:4/307: fdatasync d0/d5d/d44/d65/d6a/f6d 0 2024-09-15T22:26:40.467 INFO:tasks.workunit.client.0.smithi001.stdout:0/175: creat d0/f3b x:0 0 0 2024-09-15T22:26:40.468 INFO:tasks.workunit.client.0.smithi001.stdout:9/184: mkdir d5/de/d1a/d38 0 2024-09-15T22:26:40.471 INFO:tasks.workunit.client.0.smithi001.stdout:4/308: write d0/f11 [1179836,25378] 0 2024-09-15T22:26:40.477 INFO:tasks.workunit.client.0.smithi001.stdout:9/185: dread d5/de/d1a/d1b/d22/d2c/f17 [0,4194304] 0 2024-09-15T22:26:40.480 INFO:tasks.workunit.client.0.smithi001.stdout:9/186: symlink d5/de/l39 0 2024-09-15T22:26:40.480 INFO:tasks.workunit.client.0.smithi001.stdout:8/165: dread f5 [0,4194304] 0 2024-09-15T22:26:40.481 INFO:tasks.workunit.client.0.smithi001.stdout:9/187: getdents d5/de/d1a/d1b/d22/d2c/d21/d24 0 2024-09-15T22:26:40.481 INFO:tasks.workunit.client.0.smithi001.stdout:2/167: dwrite d2/d14/d1a/d20/f19 [0,4194304] 0 2024-09-15T22:26:40.482 INFO:tasks.workunit.client.0.smithi001.stdout:2/168: rename d2/d14 to d2/d14/d17/d1f/d21/d36 22 2024-09-15T22:26:40.482 INFO:tasks.workunit.client.0.smithi001.stdout:8/166: creat d9/d19/f2b x:0 0 0 2024-09-15T22:26:40.482 INFO:tasks.workunit.client.0.smithi001.stdout:8/167: fdatasync d9/d19/f1e 0 2024-09-15T22:26:40.482 INFO:tasks.workunit.client.0.smithi001.stdout:8/168: chown d9/lc 27303742 1 2024-09-15T22:26:40.484 INFO:tasks.workunit.client.0.smithi001.stdout:2/169: link d2/d14/d17/d1f/d21/l2e d2/l37 0 2024-09-15T22:26:40.485 INFO:tasks.workunit.client.0.smithi001.stdout:8/169: mknod d9/d19/d29/c2c 0 2024-09-15T22:26:40.487 INFO:tasks.workunit.client.0.smithi001.stdout:8/170: mkdir d9/d2d 0 2024-09-15T22:26:40.487 INFO:tasks.workunit.client.0.smithi001.stdout:8/171: readlink l6 0 2024-09-15T22:26:40.488 INFO:tasks.workunit.client.0.smithi001.stdout:8/172: symlink d9/d19/l2e 0 2024-09-15T22:26:40.488 INFO:tasks.workunit.client.0.smithi001.stdout:8/173: getdents d9/d2d 0 2024-09-15T22:26:40.490 INFO:tasks.workunit.client.0.smithi001.stdout:8/174: rmdir d9 39 2024-09-15T22:26:40.491 INFO:tasks.workunit.client.0.smithi001.stdout:8/175: mkdir d9/d2f 0 2024-09-15T22:26:40.492 INFO:tasks.workunit.client.0.smithi001.stdout:8/176: truncate f4 4586663 0 2024-09-15T22:26:40.492 INFO:tasks.workunit.client.0.smithi001.stdout:8/177: chown d9/c17 925 1 2024-09-15T22:26:40.492 INFO:tasks.workunit.client.0.smithi001.stdout:8/178: readlink l2 0 2024-09-15T22:26:40.493 INFO:tasks.workunit.client.0.smithi001.stdout:8/179: creat d9/d2f/f30 x:0 0 0 2024-09-15T22:26:40.499 INFO:tasks.workunit.client.0.smithi001.stdout:2/170: dread d2/d14/d1a/d20/f19 [0,4194304] 0 2024-09-15T22:26:40.503 INFO:tasks.workunit.client.0.smithi001.stdout:2/171: mknod d2/d14/d2f/c38 0 2024-09-15T22:26:40.511 INFO:tasks.workunit.client.0.smithi001.stdout:3/167: write da/fe [167856,125843] 0 2024-09-15T22:26:40.512 INFO:tasks.workunit.client.0.smithi001.stdout:3/168: rmdir da/d14/d37 0 2024-09-15T22:26:40.513 INFO:tasks.workunit.client.0.smithi001.stdout:3/169: stat da/d16/c2d 0 2024-09-15T22:26:40.513 INFO:tasks.workunit.client.0.smithi001.stdout:3/170: read da/d1f/f28 [37668,42035] 0 2024-09-15T22:26:40.513 INFO:tasks.workunit.client.0.smithi001.stdout:3/171: write da/f12 [5361082,30937] 0 2024-09-15T22:26:40.515 INFO:tasks.workunit.client.0.smithi001.stdout:3/172: symlink da/d14/l39 0 2024-09-15T22:26:40.517 INFO:tasks.workunit.client.0.smithi001.stdout:3/173: unlink da/d1f/c21 0 2024-09-15T22:26:40.518 INFO:tasks.workunit.client.0.smithi001.stdout:3/174: mknod da/d14/c3a 0 2024-09-15T22:26:40.521 INFO:tasks.workunit.client.0.smithi001.stdout:3/175: rename da/d17 to da/d3b 0 2024-09-15T22:26:40.522 INFO:tasks.workunit.client.0.smithi001.stdout:8/180: write f7 [2102438,52244] 0 2024-09-15T22:26:40.523 INFO:tasks.workunit.client.0.smithi001.stdout:8/181: fdatasync d9/fa 0 2024-09-15T22:26:40.523 INFO:tasks.workunit.client.0.smithi001.stdout:8/182: chown d9/c28 13866503 1 2024-09-15T22:26:40.523 INFO:tasks.workunit.client.0.smithi001.stdout:8/183: readlink l2 0 2024-09-15T22:26:40.523 INFO:tasks.workunit.client.0.smithi001.stdout:8/184: write d9/fd [1988996,121546] 0 2024-09-15T22:26:40.523 INFO:tasks.workunit.client.0.smithi001.stdout:1/237: dwrite d3/dd/f33 [0,4194304] 0 2024-09-15T22:26:40.526 INFO:tasks.workunit.client.0.smithi001.stdout:1/238: unlink d3/dd/d14/d23/c45 0 2024-09-15T22:26:40.547 INFO:tasks.workunit.client.0.smithi001.stdout:5/205: sync 2024-09-15T22:26:40.547 INFO:tasks.workunit.client.0.smithi001.stdout:5/206: readlink d3/d6/l36 0 2024-09-15T22:26:40.548 INFO:tasks.workunit.client.0.smithi001.stdout:7/157: dwrite d0/f2a [0,4194304] 0 2024-09-15T22:26:40.548 INFO:tasks.workunit.client.0.smithi001.stdout:5/207: unlink d3/d6/c23 0 2024-09-15T22:26:40.551 INFO:tasks.workunit.client.0.smithi001.stdout:7/158: creat d0/d7/d23/f3b x:0 0 0 2024-09-15T22:26:40.551 INFO:tasks.workunit.client.0.smithi001.stdout:7/159: read - d0/d7/d21/d2b/f37 zero size 2024-09-15T22:26:40.551 INFO:tasks.workunit.client.0.smithi001.stdout:5/208: truncate d3/d1d/f29 3895449 0 2024-09-15T22:26:40.551 INFO:tasks.workunit.client.0.smithi001.stdout:5/209: chown d3/d6/d25/f2c 4996 1 2024-09-15T22:26:40.551 INFO:tasks.workunit.client.0.smithi001.stdout:5/210: stat d3/d27/f3a 0 2024-09-15T22:26:40.552 INFO:tasks.workunit.client.0.smithi001.stdout:7/160: link d0/le d0/d7/d21/d2b/l3c 0 2024-09-15T22:26:40.552 INFO:tasks.workunit.client.0.smithi001.stdout:1/239: write d3/dd/d14/f31 [385639,106187] 0 2024-09-15T22:26:40.553 INFO:tasks.workunit.client.0.smithi001.stdout:5/211: symlink d3/d27/l45 0 2024-09-15T22:26:40.553 INFO:tasks.workunit.client.0.smithi001.stdout:5/212: dread - d3/f3e zero size 2024-09-15T22:26:40.556 INFO:tasks.workunit.client.0.smithi001.stdout:1/240: mkdir d3/d12/d21/d48 0 2024-09-15T22:26:40.557 INFO:tasks.workunit.client.0.smithi001.stdout:1/241: mknod d3/dd/d3c/c49 0 2024-09-15T22:26:40.557 INFO:tasks.workunit.client.0.smithi001.stdout:1/242: chown c0 14191782 1 2024-09-15T22:26:40.557 INFO:tasks.workunit.client.0.smithi001.stdout:1/243: readlink d3/dd/d14/d1b/d2b/l3e 0 2024-09-15T22:26:40.558 INFO:tasks.workunit.client.0.smithi001.stdout:1/244: chown d3 26 1 2024-09-15T22:26:40.559 INFO:tasks.workunit.client.0.smithi001.stdout:9/188: dwrite d5/f37 [0,4194304] 0 2024-09-15T22:26:40.562 INFO:tasks.workunit.client.0.smithi001.stdout:1/245: symlink d3/dd/d14/d23/l4a 0 2024-09-15T22:26:40.562 INFO:tasks.workunit.client.0.smithi001.stdout:7/161: getdents d0/d7/d23 0 2024-09-15T22:26:40.568 INFO:tasks.workunit.client.0.smithi001.stdout:5/213: dread d3/f24 [0,4194304] 0 2024-09-15T22:26:40.575 INFO:tasks.workunit.client.0.smithi001.stdout:3/176: dwrite da/d16/f26 [0,4194304] 0 2024-09-15T22:26:40.577 INFO:tasks.workunit.client.0.smithi001.stdout:5/214: creat d3/d27/f46 x:0 0 0 2024-09-15T22:26:40.577 INFO:tasks.workunit.client.0.smithi001.stdout:5/215: chown d3/l15 2520054 1 2024-09-15T22:26:40.578 INFO:tasks.workunit.client.0.smithi001.stdout:5/216: chown d3/d27/l45 4507342 1 2024-09-15T22:26:40.579 INFO:tasks.workunit.client.0.smithi001.stdout:6/178: sync 2024-09-15T22:26:40.580 INFO:tasks.workunit.client.0.smithi001.stdout:3/177: rename da/f12 to da/d3b/f3c 0 2024-09-15T22:26:40.580 INFO:tasks.workunit.client.0.smithi001.stdout:5/217: mknod d3/d6/d25/c47 0 2024-09-15T22:26:40.581 INFO:tasks.workunit.client.0.smithi001.stdout:3/178: mkdir da/d3d 0 2024-09-15T22:26:40.582 INFO:tasks.workunit.client.0.smithi001.stdout:5/218: stat d3/d6/d25/c35 0 2024-09-15T22:26:40.583 INFO:tasks.workunit.client.0.smithi001.stdout:5/219: symlink d3/d27/l48 0 2024-09-15T22:26:40.584 INFO:tasks.workunit.client.0.smithi001.stdout:5/220: mkdir d3/d49 0 2024-09-15T22:26:40.585 INFO:tasks.workunit.client.0.smithi001.stdout:5/221: rename d3/f24 to d3/d27/d3c/f4a 0 2024-09-15T22:26:40.602 INFO:tasks.workunit.client.0.smithi001.stdout:3/179: dread f5 [0,4194304] 0 2024-09-15T22:26:40.606 INFO:tasks.workunit.client.0.smithi001.stdout:5/222: write d3/d1d/f29 [2645178,12593] 0 2024-09-15T22:26:40.606 INFO:tasks.workunit.client.0.smithi001.stdout:5/223: chown d3/l26 11395 1 2024-09-15T22:26:40.610 INFO:tasks.workunit.client.0.smithi001.stdout:1/246: dread d3/dd/d14/f1c [0,4194304] 0 2024-09-15T22:26:40.618 INFO:tasks.workunit.client.0.smithi001.stdout:6/179: dwrite d0/f11 [0,4194304] 0 2024-09-15T22:26:40.618 INFO:tasks.workunit.client.0.smithi001.stdout:3/180: write da/d16/ff [7123981,44272] 0 2024-09-15T22:26:40.618 INFO:tasks.workunit.client.0.smithi001.stdout:3/181: read f5 [1954463,38778] 0 2024-09-15T22:26:40.619 INFO:tasks.workunit.client.0.smithi001.stdout:0/176: sync 2024-09-15T22:26:40.619 INFO:tasks.workunit.client.0.smithi001.stdout:2/172: sync 2024-09-15T22:26:40.619 INFO:tasks.workunit.client.0.smithi001.stdout:4/309: sync 2024-09-15T22:26:40.619 INFO:tasks.workunit.client.0.smithi001.stdout:8/185: sync 2024-09-15T22:26:40.629 INFO:tasks.workunit.client.0.smithi001.stdout:1/247: mkdir d3/dd/d14/d23/d4b 0 2024-09-15T22:26:40.629 INFO:tasks.workunit.client.0.smithi001.stdout:2/173: mknod d2/c39 0 2024-09-15T22:26:40.629 INFO:tasks.workunit.client.0.smithi001.stdout:6/180: truncate d0/f33 1096032 0 2024-09-15T22:26:40.629 INFO:tasks.workunit.client.0.smithi001.stdout:2/174: chown d2/d12 2009233 1 2024-09-15T22:26:40.629 INFO:tasks.workunit.client.0.smithi001.stdout:3/182: unlink da/d1f/f27 0 2024-09-15T22:26:40.629 INFO:tasks.workunit.client.0.smithi001.stdout:3/183: fdatasync da/d16/f26 0 2024-09-15T22:26:40.631 INFO:tasks.workunit.client.0.smithi001.stdout:0/177: dread d0/d9/db/f10 [0,4194304] 0 2024-09-15T22:26:40.632 INFO:tasks.workunit.client.0.smithi001.stdout:1/248: rename d3/dd/d14/d1b/d41 to d3/dd/d3c/d4c 0 2024-09-15T22:26:40.632 INFO:tasks.workunit.client.0.smithi001.stdout:6/181: mknod d0/c3f 0 2024-09-15T22:26:40.633 INFO:tasks.workunit.client.0.smithi001.stdout:4/310: creat d0/d5d/d44/d65/f7d x:0 0 0 2024-09-15T22:26:40.634 INFO:tasks.workunit.client.0.smithi001.stdout:3/184: rename da/d16/f1e to da/d1f/f3e 0 2024-09-15T22:26:40.634 INFO:tasks.workunit.client.0.smithi001.stdout:3/185: chown da/fe 1711867 1 2024-09-15T22:26:40.634 INFO:tasks.workunit.client.0.smithi001.stdout:6/182: mkdir d0/df/d24/d40 0 2024-09-15T22:26:40.639 INFO:tasks.workunit.client.0.smithi001.stdout:3/186: mkdir da/d1f/d2e/d3f 0 2024-09-15T22:26:40.639 INFO:tasks.workunit.client.0.smithi001.stdout:6/183: rename d0/d6/f23 to d0/df/d24/d2e/f41 0 2024-09-15T22:26:40.640 INFO:tasks.workunit.client.0.smithi001.stdout:1/249: mknod d3/dd/c4d 0 2024-09-15T22:26:40.642 INFO:tasks.workunit.client.0.smithi001.stdout:1/250: creat d3/dd/d3c/d4c/f4e x:0 0 0 2024-09-15T22:26:40.644 INFO:tasks.workunit.client.0.smithi001.stdout:7/162: dwrite d0/d7/df/f1c [0,4194304] 0 2024-09-15T22:26:40.644 INFO:tasks.workunit.client.0.smithi001.stdout:3/187: rename da/d14/f20 to da/d3b/f40 0 2024-09-15T22:26:40.645 INFO:tasks.workunit.client.0.smithi001.stdout:3/188: readlink da/d1f/l36 0 2024-09-15T22:26:40.650 INFO:tasks.workunit.client.0.smithi001.stdout:1/251: creat d3/dd/d14/d23/f4f x:0 0 0 2024-09-15T22:26:40.650 INFO:tasks.workunit.client.0.smithi001.stdout:2/175: write d2/d12/f1c [2296408,79436] 0 2024-09-15T22:26:40.652 INFO:tasks.workunit.client.0.smithi001.stdout:7/163: creat d0/d7/d21/f3d x:0 0 0 2024-09-15T22:26:40.657 INFO:tasks.workunit.client.0.smithi001.stdout:2/176: rename d2/lc to d2/d14/d17/d1f/l3a 0 2024-09-15T22:26:40.657 INFO:tasks.workunit.client.0.smithi001.stdout:1/252: unlink d3/dd/d14/f25 0 2024-09-15T22:26:40.658 INFO:tasks.workunit.client.0.smithi001.stdout:3/189: mkdir da/d14/d41 0 2024-09-15T22:26:40.659 INFO:tasks.workunit.client.0.smithi001.stdout:3/190: chown da/d16 61943 1 2024-09-15T22:26:40.659 INFO:tasks.workunit.client.0.smithi001.stdout:1/253: truncate d3/dd/f38 397619 0 2024-09-15T22:26:40.659 INFO:tasks.workunit.client.0.smithi001.stdout:1/254: chown d3/dd/c29 170822 1 2024-09-15T22:26:40.668 INFO:tasks.workunit.client.0.smithi001.stdout:8/186: dwrite d9/fb [0,4194304] 0 2024-09-15T22:26:40.679 INFO:tasks.workunit.client.0.smithi001.stdout:1/255: dread d3/f9 [0,4194304] 0 2024-09-15T22:26:40.689 INFO:tasks.workunit.client.0.smithi001.stdout:9/189: dwrite d5/de/d1a/d1b/d22/d2c/d21/f25 [0,4194304] 0 2024-09-15T22:26:40.689 INFO:tasks.workunit.client.0.smithi001.stdout:9/190: chown d5/de/l39 68 1 2024-09-15T22:26:40.690 INFO:tasks.workunit.client.0.smithi001.stdout:9/191: getdents d5/de/d1a/d1b/d22/d2c/d21/d23 0 2024-09-15T22:26:40.690 INFO:tasks.workunit.client.0.smithi001.stdout:9/192: fdatasync d5/de/d1a/d1b/d22/d2c/f17 0 2024-09-15T22:26:40.717 INFO:tasks.workunit.client.0.smithi001.stdout:4/311: dwrite d0/f48 [0,4194304] 0 2024-09-15T22:26:40.731 INFO:tasks.workunit.client.0.smithi001.stdout:2/177: dwrite d2/d14/d17/d1f/d21/f23 [0,4194304] 0 2024-09-15T22:26:40.732 INFO:tasks.workunit.client.0.smithi001.stdout:2/178: mknod d2/d14/d17/d1f/c3b 0 2024-09-15T22:26:40.733 INFO:tasks.workunit.client.0.smithi001.stdout:2/179: creat d2/d14/d17/d1f/f3c x:0 0 0 2024-09-15T22:26:40.734 INFO:tasks.workunit.client.0.smithi001.stdout:2/180: rename d2/d12/f31 to d2/f3d 0 2024-09-15T22:26:40.740 INFO:tasks.workunit.client.0.smithi001.stdout:5/224: dwrite d3/d1d/f29 [0,4194304] 0 2024-09-15T22:26:40.741 INFO:tasks.workunit.client.0.smithi001.stdout:0/178: dwrite d0/f7 [0,4194304] 0 2024-09-15T22:26:40.741 INFO:tasks.workunit.client.0.smithi001.stdout:1/256: dwrite d3/d12/d21/f22 [4194304,4194304] 0 2024-09-15T22:26:40.745 INFO:tasks.workunit.client.0.smithi001.stdout:5/225: unlink d3/c1b 0 2024-09-15T22:26:40.746 INFO:tasks.workunit.client.0.smithi001.stdout:5/226: read d3/fc [2326786,80193] 0 2024-09-15T22:26:40.746 INFO:tasks.workunit.client.0.smithi001.stdout:5/227: fdatasync d3/d1d/f29 0 2024-09-15T22:26:40.751 INFO:tasks.workunit.client.0.smithi001.stdout:5/228: creat d3/d27/d3c/f4b x:0 0 0 2024-09-15T22:26:40.756 INFO:tasks.workunit.client.0.smithi001.stdout:7/164: dwrite d0/d7/f24 [0,4194304] 0 2024-09-15T22:26:40.756 INFO:tasks.workunit.client.0.smithi001.stdout:7/165: dread - d0/d7/d2e/f34 zero size 2024-09-15T22:26:40.756 INFO:tasks.workunit.client.0.smithi001.stdout:7/166: truncate d0/d7/d21/f39 4897817 0 2024-09-15T22:26:40.758 INFO:tasks.workunit.client.0.smithi001.stdout:1/257: dread d3/dd/f34 [0,4194304] 0 2024-09-15T22:26:40.759 INFO:tasks.workunit.client.0.smithi001.stdout:7/167: truncate d0/f2f 1244199 0 2024-09-15T22:26:40.759 INFO:tasks.workunit.client.0.smithi001.stdout:7/168: chown d0/le 14 1 2024-09-15T22:26:40.760 INFO:tasks.workunit.client.0.smithi001.stdout:3/191: dwrite da/d3b/f40 [4194304,4194304] 0 2024-09-15T22:26:40.762 INFO:tasks.workunit.client.0.smithi001.stdout:1/258: mkdir d3/dd/d14/d23/d4b/d50 0 2024-09-15T22:26:40.772 INFO:tasks.workunit.client.0.smithi001.stdout:4/312: dwrite d0/d5d/d44/f56 [0,4194304] 0 2024-09-15T22:26:40.782 INFO:tasks.workunit.client.0.smithi001.stdout:9/193: dwrite d5/de/d1a/d1b/f33 [0,4194304] 0 2024-09-15T22:26:40.782 INFO:tasks.workunit.client.0.smithi001.stdout:9/194: write d5/de/f18 [991485,46001] 0 2024-09-15T22:26:40.783 INFO:tasks.workunit.client.0.smithi001.stdout:1/259: dread d3/dd/f19 [0,4194304] 0 2024-09-15T22:26:40.785 INFO:tasks.workunit.client.0.smithi001.stdout:3/192: write da/d3b/d1b/f2c [1126530,2857] 0 2024-09-15T22:26:40.785 INFO:tasks.workunit.client.0.smithi001.stdout:9/195: creat d5/de/d1a/d1b/f3a x:0 0 0 2024-09-15T22:26:40.785 INFO:tasks.workunit.client.0.smithi001.stdout:9/196: dread - d5/de/d1a/d1b/d22/f2f zero size 2024-09-15T22:26:40.785 INFO:tasks.workunit.client.0.smithi001.stdout:1/260: mknod d3/dd/d14/d1b/d2b/c51 0 2024-09-15T22:26:40.785 INFO:tasks.workunit.client.0.smithi001.stdout:5/229: dwrite d3/d27/f2d [0,4194304] 0 2024-09-15T22:26:40.786 INFO:tasks.workunit.client.0.smithi001.stdout:5/230: write d3/d6/d25/f38 [4659038,94487] 0 2024-09-15T22:26:40.786 INFO:tasks.workunit.client.0.smithi001.stdout:9/197: rename d5/de/d1a/d1b/d22/d2c/l13 to d5/de/d1a/l3b 0 2024-09-15T22:26:40.798 INFO:tasks.workunit.client.0.smithi001.stdout:1/261: creat d3/dd/d14/d23/d4b/f52 x:0 0 0 2024-09-15T22:26:40.798 INFO:tasks.workunit.client.0.smithi001.stdout:5/231: stat d3/l3b 0 2024-09-15T22:26:40.798 INFO:tasks.workunit.client.0.smithi001.stdout:3/193: mknod da/d14/c42 0 2024-09-15T22:26:40.798 INFO:tasks.workunit.client.0.smithi001.stdout:9/198: getdents d5/de/d1a/d1b 0 2024-09-15T22:26:40.798 INFO:tasks.workunit.client.0.smithi001.stdout:9/199: dread - d5/de/d1a/d1b/d22/f2f zero size 2024-09-15T22:26:40.798 INFO:tasks.workunit.client.0.smithi001.stdout:4/313: dread d0/d27/d35/d61/d20/f26 [0,4194304] 0 2024-09-15T22:26:40.798 INFO:tasks.workunit.client.0.smithi001.stdout:4/314: read - d0/d5d/f45 zero size 2024-09-15T22:26:40.798 INFO:tasks.workunit.client.0.smithi001.stdout:4/315: readlink d0/d27/d35/d61/l33 0 2024-09-15T22:26:40.799 INFO:tasks.workunit.client.0.smithi001.stdout:4/316: chown d0/d27/c32 7 1 2024-09-15T22:26:40.799 INFO:tasks.workunit.client.0.smithi001.stdout:9/200: truncate f4 1913528 0 2024-09-15T22:26:40.800 INFO:tasks.workunit.client.0.smithi001.stdout:4/317: getdents d0/d27/d35/d61 0 2024-09-15T22:26:40.800 INFO:tasks.workunit.client.0.smithi001.stdout:4/318: chown d0/d27/d35/d61/d20/d29/d34/d3a 1009315120 1 2024-09-15T22:26:40.801 INFO:tasks.workunit.client.0.smithi001.stdout:4/319: symlink d0/d5d/d44/d65/l7e 0 2024-09-15T22:26:40.804 INFO:tasks.workunit.client.0.smithi001.stdout:4/320: mknod d0/d27/d35/d59/d67/d7b/c7f 0 2024-09-15T22:26:40.805 INFO:tasks.workunit.client.0.smithi001.stdout:3/194: rename da/d14 to da/d3d/d43 0 2024-09-15T22:26:40.808 INFO:tasks.workunit.client.0.smithi001.stdout:3/195: mknod da/c44 0 2024-09-15T22:26:40.809 INFO:tasks.workunit.client.0.smithi001.stdout:9/201: dread d5/de/d1a/d1b/d22/d2c/f17 [0,4194304] 0 2024-09-15T22:26:40.812 INFO:tasks.workunit.client.0.smithi001.stdout:1/262: rename d3/dd/d14/d23/d4b/d50 to d3/dd/d53 0 2024-09-15T22:26:40.813 INFO:tasks.workunit.client.0.smithi001.stdout:9/202: rename d5/de/d1a/d1b/d22/d2c to d5/de/d1a/d1b/d22/d2c/d21/d23/d3c 22 2024-09-15T22:26:40.813 INFO:tasks.workunit.client.0.smithi001.stdout:1/263: dread - d3/f42 zero size 2024-09-15T22:26:40.813 INFO:tasks.workunit.client.0.smithi001.stdout:9/203: chown d5/de/d1a/d1b/d22/d2c/c29 512741 1 2024-09-15T22:26:40.813 INFO:tasks.workunit.client.0.smithi001.stdout:1/264: chown d3/dd/f33 31 1 2024-09-15T22:26:40.814 INFO:tasks.workunit.client.0.smithi001.stdout:9/204: mkdir d5/de/d1a/d1b/d22/d2c/d21/d23/d3d 0 2024-09-15T22:26:40.814 INFO:tasks.workunit.client.0.smithi001.stdout:9/205: fsync d5/de/d1a/d1b/f3a 0 2024-09-15T22:26:40.814 INFO:tasks.workunit.client.0.smithi001.stdout:9/206: stat d5/de/d1a/d1b/d22/d2c/d21/d23 0 2024-09-15T22:26:40.815 INFO:tasks.workunit.client.0.smithi001.stdout:1/265: creat d3/d12/d21/d48/f54 x:0 0 0 2024-09-15T22:26:40.815 INFO:tasks.workunit.client.0.smithi001.stdout:9/207: mkdir d5/d3e 0 2024-09-15T22:26:40.816 INFO:tasks.workunit.client.0.smithi001.stdout:9/208: write d5/de/d1a/d1b/f3a [621491,108962] 0 2024-09-15T22:26:40.818 INFO:tasks.workunit.client.0.smithi001.stdout:5/232: dread d3/d27/f2d [0,4194304] 0 2024-09-15T22:26:40.818 INFO:tasks.workunit.client.0.smithi001.stdout:1/266: rename d3/d12/d21/d48/f54 to d3/dd/f55 0 2024-09-15T22:26:40.818 INFO:tasks.workunit.client.0.smithi001.stdout:3/196: dread da/d3b/d1b/f2c [4194304,4194304] 0 2024-09-15T22:26:40.821 INFO:tasks.workunit.client.0.smithi001.stdout:3/197: write f8 [416725,48631] 0 2024-09-15T22:26:40.822 INFO:tasks.workunit.client.0.smithi001.stdout:7/169: dwrite d0/d7/d21/d2b/f32 [0,4194304] 0 2024-09-15T22:26:40.824 INFO:tasks.workunit.client.0.smithi001.stdout:7/170: truncate d0/d7/df/f27 1618373 0 2024-09-15T22:26:40.824 INFO:tasks.workunit.client.0.smithi001.stdout:7/171: chown d0/d7/d23/f29 485838 1 2024-09-15T22:26:40.827 INFO:tasks.workunit.client.0.smithi001.stdout:3/198: dread da/d1f/f28 [0,4194304] 0 2024-09-15T22:26:40.831 INFO:tasks.workunit.client.0.smithi001.stdout:7/172: mkdir d0/d7/d21/d2b/d3e 0 2024-09-15T22:26:40.831 INFO:tasks.workunit.client.0.smithi001.stdout:7/173: chown d0/d7/la 644035037 1 2024-09-15T22:26:40.831 INFO:tasks.workunit.client.0.smithi001.stdout:1/267: write d3/dd/f19 [1953911,14848] 0 2024-09-15T22:26:40.833 INFO:tasks.workunit.client.0.smithi001.stdout:7/174: mkdir d0/d7/df/d3f 0 2024-09-15T22:26:40.833 INFO:tasks.workunit.client.0.smithi001.stdout:7/175: fdatasync d0/f2a 0 2024-09-15T22:26:40.858 INFO:tasks.workunit.client.0.smithi001.stdout:4/321: dwrite d0/d27/d35/f58 [0,4194304] 0 2024-09-15T22:26:40.858 INFO:tasks.workunit.client.0.smithi001.stdout:4/322: chown d0/d27/d35/d59/d67/d7b 811941 1 2024-09-15T22:26:40.860 INFO:tasks.workunit.client.0.smithi001.stdout:4/323: mknod d0/d27/d35/c80 0 2024-09-15T22:26:40.860 INFO:tasks.workunit.client.0.smithi001.stdout:4/324: truncate d0/d5d/f45 469264 0 2024-09-15T22:26:40.860 INFO:tasks.workunit.client.0.smithi001.stdout:4/325: write d0/d27/d35/f72 [317902,129517] 0 2024-09-15T22:26:40.860 INFO:tasks.workunit.client.0.smithi001.stdout:4/326: fdatasync d0/d27/d35/d61/d20/d29/d40/f71 0 2024-09-15T22:26:40.861 INFO:tasks.workunit.client.0.smithi001.stdout:4/327: write d0/d27/d35/d61/f21 [3067164,23102] 0 2024-09-15T22:26:40.871 INFO:tasks.workunit.client.0.smithi001.stdout:9/209: dwrite d5/de/d1a/d1b/d22/d2c/d21/f25 [0,4194304] 0 2024-09-15T22:26:40.891 INFO:tasks.workunit.client.0.smithi001.stdout:9/210: dread d5/f11 [0,4194304] 0 2024-09-15T22:26:40.892 INFO:tasks.workunit.client.0.smithi001.stdout:9/211: truncate d5/de/d1a/d1b/d22/d2c/f17 619428 0 2024-09-15T22:26:40.894 INFO:tasks.workunit.client.0.smithi001.stdout:9/212: symlink d5/de/d1a/d1b/d22/d2c/d21/d24/l3f 0 2024-09-15T22:26:40.895 INFO:tasks.workunit.client.0.smithi001.stdout:9/213: link d5/de/d1a/d1b/d22/d2c/d21/d24/c28 d5/de/d1a/d1b/d22/c40 0 2024-09-15T22:26:40.899 INFO:tasks.workunit.client.0.smithi001.stdout:0/179: sync 2024-09-15T22:26:40.900 INFO:tasks.workunit.client.0.smithi001.stdout:8/187: sync 2024-09-15T22:26:40.900 INFO:tasks.workunit.client.0.smithi001.stdout:2/181: sync 2024-09-15T22:26:40.900 INFO:tasks.workunit.client.0.smithi001.stdout:0/180: fdatasync d0/d9/f2c 0 2024-09-15T22:26:40.900 INFO:tasks.workunit.client.0.smithi001.stdout:6/184: sync 2024-09-15T22:26:40.900 INFO:tasks.workunit.client.0.smithi001.stdout:4/328: dwrite d0/d27/d35/d61/d20/f38 [0,4194304] 0 2024-09-15T22:26:40.904 INFO:tasks.workunit.client.0.smithi001.stdout:2/182: getdents d2/d14/d1a 0 2024-09-15T22:26:40.904 INFO:tasks.workunit.client.0.smithi001.stdout:8/188: creat d9/f31 x:0 0 0 2024-09-15T22:26:40.904 INFO:tasks.workunit.client.0.smithi001.stdout:0/181: unlink d0/f3b 0 2024-09-15T22:26:40.904 INFO:tasks.workunit.client.0.smithi001.stdout:0/182: chown d0/d9/db/c14 55 1 2024-09-15T22:26:40.904 INFO:tasks.workunit.client.0.smithi001.stdout:6/185: unlink d0/df/f1a 0 2024-09-15T22:26:40.904 INFO:tasks.workunit.client.0.smithi001.stdout:0/183: readlink d0/l1f 0 2024-09-15T22:26:40.904 INFO:tasks.workunit.client.0.smithi001.stdout:8/189: write d9/f27 [707453,65187] 0 2024-09-15T22:26:40.904 INFO:tasks.workunit.client.0.smithi001.stdout:8/190: chown d9 11 1 2024-09-15T22:26:40.905 INFO:tasks.workunit.client.0.smithi001.stdout:2/183: symlink d2/d14/d17/l3e 0 2024-09-15T22:26:40.906 INFO:tasks.workunit.client.0.smithi001.stdout:2/184: mknod d2/d12/c3f 0 2024-09-15T22:26:40.906 INFO:tasks.workunit.client.0.smithi001.stdout:2/185: chown d2/d14/d1a/d20/f13 1761 1 2024-09-15T22:26:40.911 INFO:tasks.workunit.client.0.smithi001.stdout:5/233: dwrite d3/f16 [0,4194304] 0 2024-09-15T22:26:40.911 INFO:tasks.workunit.client.0.smithi001.stdout:1/268: dwrite d3/f39 [0,4194304] 0 2024-09-15T22:26:40.913 INFO:tasks.workunit.client.0.smithi001.stdout:9/214: write d5/de/d1a/d1b/f33 [368746,79565] 0 2024-09-15T22:26:40.913 INFO:tasks.workunit.client.0.smithi001.stdout:9/215: truncate d5/de/d1a/d1b/d22/d2c/f31 865725 0 2024-09-15T22:26:40.916 INFO:tasks.workunit.client.0.smithi001.stdout:5/234: rename d3/f3e to d3/d6/d41/f4c 0 2024-09-15T22:26:40.919 INFO:tasks.workunit.client.0.smithi001.stdout:4/329: dread d0/d27/d35/d61/f22 [0,4194304] 0 2024-09-15T22:26:40.923 INFO:tasks.workunit.client.0.smithi001.stdout:2/186: dread d2/f3 [0,4194304] 0 2024-09-15T22:26:40.923 INFO:tasks.workunit.client.0.smithi001.stdout:2/187: chown d2/d14/f15 316628 1 2024-09-15T22:26:40.923 INFO:tasks.workunit.client.0.smithi001.stdout:2/188: read d2/f3 [238882,51100] 0 2024-09-15T22:26:40.923 INFO:tasks.workunit.client.0.smithi001.stdout:2/189: fsync d2/f2b 0 2024-09-15T22:26:40.923 INFO:tasks.workunit.client.0.smithi001.stdout:2/190: write d2/d14/d1a/d1b/f26 [995804,128498] 0 2024-09-15T22:26:40.929 INFO:tasks.workunit.client.0.smithi001.stdout:1/269: truncate d3/d12/f35 1040342 0 2024-09-15T22:26:40.929 INFO:tasks.workunit.client.0.smithi001.stdout:9/216: mkdir d5/de/d1a/d41 0 2024-09-15T22:26:40.929 INFO:tasks.workunit.client.0.smithi001.stdout:6/186: dread d0/d2f/f26 [0,4194304] 0 2024-09-15T22:26:40.929 INFO:tasks.workunit.client.0.smithi001.stdout:6/187: chown d0/df/d24/c3b 640 1 2024-09-15T22:26:40.929 INFO:tasks.workunit.client.0.smithi001.stdout:8/191: dread d9/f21 [0,4194304] 0 2024-09-15T22:26:40.932 INFO:tasks.workunit.client.0.smithi001.stdout:1/270: creat d3/dd/d14/d1b/d2b/f56 x:0 0 0 2024-09-15T22:26:40.932 INFO:tasks.workunit.client.0.smithi001.stdout:1/271: chown d3/dd/d14/f31 2 1 2024-09-15T22:26:40.933 INFO:tasks.workunit.client.0.smithi001.stdout:8/192: truncate f4 3953338 0 2024-09-15T22:26:40.933 INFO:tasks.workunit.client.0.smithi001.stdout:8/193: truncate d9/f31 1009463 0 2024-09-15T22:26:40.933 INFO:tasks.workunit.client.0.smithi001.stdout:8/194: read d9/f1d [70319,58384] 0 2024-09-15T22:26:40.935 INFO:tasks.workunit.client.0.smithi001.stdout:4/330: rename d0/f1a to d0/d27/d35/d53/d54/d73/f81 0 2024-09-15T22:26:40.935 INFO:tasks.workunit.client.0.smithi001.stdout:4/331: dread - d0/d27/d35/d61/d20/d29/d34/f62 zero size 2024-09-15T22:26:40.936 INFO:tasks.workunit.client.0.smithi001.stdout:1/272: link d3/d12/f35 d3/d12/d21/f57 0 2024-09-15T22:26:40.938 INFO:tasks.workunit.client.0.smithi001.stdout:4/332: mknod d0/d27/d35/d61/d20/c82 0 2024-09-15T22:26:40.942 INFO:tasks.workunit.client.0.smithi001.stdout:4/333: symlink d0/d27/d35/l83 0 2024-09-15T22:26:40.942 INFO:tasks.workunit.client.0.smithi001.stdout:5/235: dread d3/d6/d25/f38 [0,4194304] 0 2024-09-15T22:26:40.942 INFO:tasks.workunit.client.0.smithi001.stdout:1/273: rename d3/d12/f24 to d3/dd/f58 0 2024-09-15T22:26:40.976 INFO:tasks.workunit.client.0.smithi001.stdout:2/191: dwrite d2/d14/d1a/d20/f2a [0,4194304] 0 2024-09-15T22:26:40.978 INFO:tasks.workunit.client.0.smithi001.stdout:9/217: dwrite d5/de/d1a/d1b/d22/d2c/f31 [0,4194304] 0 2024-09-15T22:26:40.981 INFO:tasks.workunit.client.0.smithi001.stdout:2/192: creat d2/d14/d17/f40 x:0 0 0 2024-09-15T22:26:40.999 INFO:tasks.workunit.client.0.smithi001.stdout:9/218: write d5/f37 [1749836,88267] 0 2024-09-15T22:26:41.007 INFO:tasks.workunit.client.0.smithi001.stdout:9/219: dread d5/de/d15/f30 [0,4194304] 0 2024-09-15T22:26:41.009 INFO:tasks.workunit.client.0.smithi001.stdout:9/220: creat d5/de/d1a/f42 x:0 0 0 2024-09-15T22:26:41.010 INFO:tasks.workunit.client.0.smithi001.stdout:9/221: mknod d5/de/d1a/d1b/d22/d2c/d21/d23/c43 0 2024-09-15T22:26:41.012 INFO:tasks.workunit.client.0.smithi001.stdout:9/222: creat d5/f44 x:0 0 0 2024-09-15T22:26:41.014 INFO:tasks.workunit.client.0.smithi001.stdout:9/223: rename d5/de/d1a/d1b/d22/c40 to d5/de/d1a/d1b/d22/d2c/c45 0 2024-09-15T22:26:41.015 INFO:tasks.workunit.client.0.smithi001.stdout:6/188: dwrite d0/df/d24/f3a [0,4194304] 0 2024-09-15T22:26:41.016 INFO:tasks.workunit.client.0.smithi001.stdout:9/224: mknod d5/de/d1a/d1b/d22/d2c/d21/d23/c46 0 2024-09-15T22:26:41.017 INFO:tasks.workunit.client.0.smithi001.stdout:6/189: mknod d0/d6/d21/c42 0 2024-09-15T22:26:41.018 INFO:tasks.workunit.client.0.smithi001.stdout:9/225: symlink d5/de/d1a/d38/l47 0 2024-09-15T22:26:41.019 INFO:tasks.workunit.client.0.smithi001.stdout:8/195: dwrite d9/fb [0,4194304] 0 2024-09-15T22:26:41.019 INFO:tasks.workunit.client.0.smithi001.stdout:4/334: dwrite d0/d27/d35/d53/d54/d73/f81 [0,4194304] 0 2024-09-15T22:26:41.020 INFO:tasks.workunit.client.0.smithi001.stdout:9/226: write d5/de/d1a/d1b/d22/d2c/f17 [67906,18135] 0 2024-09-15T22:26:41.021 INFO:tasks.workunit.client.0.smithi001.stdout:9/227: mkdir d5/de/d1a/d1b/d22/d2c/d21/d48 0 2024-09-15T22:26:41.022 INFO:tasks.workunit.client.0.smithi001.stdout:5/236: dwrite d3/d6/f8 [0,4194304] 0 2024-09-15T22:26:41.024 INFO:tasks.workunit.client.0.smithi001.stdout:9/228: creat d5/de/d1a/d38/f49 x:0 0 0 2024-09-15T22:26:41.026 INFO:tasks.workunit.client.0.smithi001.stdout:9/229: link d5/de/f18 d5/de/d1a/d1b/d22/f4a 0 2024-09-15T22:26:41.026 INFO:tasks.workunit.client.0.smithi001.stdout:9/230: fdatasync d5/de/d1a/d38/f49 0 2024-09-15T22:26:41.027 INFO:tasks.workunit.client.0.smithi001.stdout:9/231: getdents d5/de/d1a/d1b/d2a 0 2024-09-15T22:26:41.029 INFO:tasks.workunit.client.0.smithi001.stdout:9/232: mknod d5/de/d1a/d1b/d2a/c4b 0 2024-09-15T22:26:41.034 INFO:tasks.workunit.client.0.smithi001.stdout:3/199: sync 2024-09-15T22:26:41.034 INFO:tasks.workunit.client.0.smithi001.stdout:7/176: sync 2024-09-15T22:26:41.035 INFO:tasks.workunit.client.0.smithi001.stdout:0/184: sync 2024-09-15T22:26:41.035 INFO:tasks.workunit.client.0.smithi001.stdout:0/185: stat d0/dd/d33 0 2024-09-15T22:26:41.035 INFO:tasks.workunit.client.0.smithi001.stdout:0/186: stat d0/d9/db/c14 0 2024-09-15T22:26:41.036 INFO:tasks.workunit.client.0.smithi001.stdout:7/177: mknod d0/d7/d23/c40 0 2024-09-15T22:26:41.036 INFO:tasks.workunit.client.0.smithi001.stdout:7/178: fdatasync d0/d7/df/f20 0 2024-09-15T22:26:41.036 INFO:tasks.workunit.client.0.smithi001.stdout:7/179: write d0/d7/d21/f3d [748233,2885] 0 2024-09-15T22:26:41.036 INFO:tasks.workunit.client.0.smithi001.stdout:7/180: read d0/d7/d21/f3a [237179,102987] 0 2024-09-15T22:26:41.037 INFO:tasks.workunit.client.0.smithi001.stdout:3/200: creat da/d3d/f45 x:0 0 0 2024-09-15T22:26:41.037 INFO:tasks.workunit.client.0.smithi001.stdout:3/201: write da/d3b/d1b/f2c [1658050,47441] 0 2024-09-15T22:26:41.038 INFO:tasks.workunit.client.0.smithi001.stdout:7/181: creat d0/d7/d21/d2b/d3e/f41 x:0 0 0 2024-09-15T22:26:41.039 INFO:tasks.workunit.client.0.smithi001.stdout:3/202: mkdir da/d1f/d46 0 2024-09-15T22:26:41.040 INFO:tasks.workunit.client.0.smithi001.stdout:3/203: fsync da/d3b/f3c 0 2024-09-15T22:26:41.042 INFO:tasks.workunit.client.0.smithi001.stdout:5/237: dread d3/d27/f42 [0,4194304] 0 2024-09-15T22:26:41.044 INFO:tasks.workunit.client.0.smithi001.stdout:7/182: symlink d0/d7/d21/d2b/d3e/l42 0 2024-09-15T22:26:41.044 INFO:tasks.workunit.client.0.smithi001.stdout:7/183: chown d0/d7/d23/f29 1502 1 2024-09-15T22:26:41.045 INFO:tasks.workunit.client.0.smithi001.stdout:7/184: symlink d0/d7/d21/d2b/d3e/l43 0 2024-09-15T22:26:41.053 INFO:tasks.workunit.client.0.smithi001.stdout:7/185: rename d0/d7/df to d0/d7/d44 0 2024-09-15T22:26:41.057 INFO:tasks.workunit.client.0.smithi001.stdout:0/187: write d0/f2 [4043137,64436] 0 2024-09-15T22:26:41.057 INFO:tasks.workunit.client.0.smithi001.stdout:4/335: write d0/d27/d35/d53/d54/f5f [3675293,110469] 0 2024-09-15T22:26:41.057 INFO:tasks.workunit.client.0.smithi001.stdout:4/336: chown d0/d27/d35/d53 51 1 2024-09-15T22:26:41.057 INFO:tasks.workunit.client.0.smithi001.stdout:4/337: truncate d0/d5d/d44/d65/f7d 932724 0 2024-09-15T22:26:41.057 INFO:tasks.workunit.client.0.smithi001.stdout:4/338: readlink d0/d27/d35/d61/d20/d29/d40/l6c 0 2024-09-15T22:26:41.057 INFO:tasks.workunit.client.0.smithi001.stdout:7/186: link d0/d7/d23/f29 d0/d7/d21/f45 0 2024-09-15T22:26:41.057 INFO:tasks.workunit.client.0.smithi001.stdout:2/193: dwrite d2/f3 [4194304,4194304] 0 2024-09-15T22:26:41.058 INFO:tasks.workunit.client.0.smithi001.stdout:2/194: chown d2/f10 181778 1 2024-09-15T22:26:41.058 INFO:tasks.workunit.client.0.smithi001.stdout:2/195: chown d2/d14/d17/d1f/f25 22661 1 2024-09-15T22:26:41.058 INFO:tasks.workunit.client.0.smithi001.stdout:2/196: chown d2/c16 94789046 1 2024-09-15T22:26:41.058 INFO:tasks.workunit.client.0.smithi001.stdout:4/339: mkdir d0/d27/d35/d61/d20/d29/d34/d84 0 2024-09-15T22:26:41.058 INFO:tasks.workunit.client.0.smithi001.stdout:4/340: dread - d0/d27/d35/d61/f66 zero size 2024-09-15T22:26:41.059 INFO:tasks.workunit.client.0.smithi001.stdout:7/187: symlink d0/l46 0 2024-09-15T22:26:41.059 INFO:tasks.workunit.client.0.smithi001.stdout:7/188: stat d0/d7/d44/l31 0 2024-09-15T22:26:41.061 INFO:tasks.workunit.client.0.smithi001.stdout:4/341: creat d0/d27/d35/d61/d20/d29/d40/f85 x:0 0 0 2024-09-15T22:26:41.063 INFO:tasks.workunit.client.0.smithi001.stdout:7/189: creat d0/d7/d44/f47 x:0 0 0 2024-09-15T22:26:41.064 INFO:tasks.workunit.client.0.smithi001.stdout:4/342: symlink d0/d27/d35/d59/d67/d7b/l86 0 2024-09-15T22:26:41.069 INFO:tasks.workunit.client.0.smithi001.stdout:7/190: unlink d0/d7/d21/d2b/l2c 0 2024-09-15T22:26:41.069 INFO:tasks.workunit.client.0.smithi001.stdout:8/196: dwrite d9/d19/f1e [0,4194304] 0 2024-09-15T22:26:41.069 INFO:tasks.workunit.client.0.smithi001.stdout:8/197: write d9/fd [2636967,97665] 0 2024-09-15T22:26:41.073 INFO:tasks.workunit.client.0.smithi001.stdout:7/191: creat d0/d7/d44/d36/f48 x:0 0 0 2024-09-15T22:26:41.075 INFO:tasks.workunit.client.0.smithi001.stdout:8/198: rename d9/f1d to d9/d19/f32 0 2024-09-15T22:26:41.075 INFO:tasks.workunit.client.0.smithi001.stdout:1/274: sync 2024-09-15T22:26:41.075 INFO:tasks.workunit.client.0.smithi001.stdout:1/275: chown d3/dd/f38 29 1 2024-09-15T22:26:41.075 INFO:tasks.workunit.client.0.smithi001.stdout:7/192: mkdir d0/d7/d44/d3f/d49 0 2024-09-15T22:26:41.075 INFO:tasks.workunit.client.0.smithi001.stdout:7/193: chown d0/d7/d23/f38 5682 1 2024-09-15T22:26:41.092 INFO:tasks.workunit.client.0.smithi001.stdout:9/233: dwrite d5/de/d1a/d1b/d22/d2c/f31 [0,4194304] 0 2024-09-15T22:26:41.093 INFO:tasks.workunit.client.0.smithi001.stdout:9/234: write d5/de/d1a/d1b/d22/f2f [19685,86614] 0 2024-09-15T22:26:41.093 INFO:tasks.workunit.client.0.smithi001.stdout:7/194: dread d0/d7/d44/f20 [0,4194304] 0 2024-09-15T22:26:41.094 INFO:tasks.workunit.client.0.smithi001.stdout:9/235: creat d5/de/d1a/d1b/d22/d2c/d21/d24/f4c x:0 0 0 2024-09-15T22:26:41.096 INFO:tasks.workunit.client.0.smithi001.stdout:9/236: mkdir d5/de/d1a/d1b/d22/d2c/d21/d4d 0 2024-09-15T22:26:41.097 INFO:tasks.workunit.client.0.smithi001.stdout:9/237: getdents d5/de/d1a 0 2024-09-15T22:26:41.101 INFO:tasks.workunit.client.0.smithi001.stdout:6/190: dwrite d0/d6/f3e [0,4194304] 0 2024-09-15T22:26:41.101 INFO:tasks.workunit.client.0.smithi001.stdout:3/204: dread da/d1f/f22 [0,4194304] 0 2024-09-15T22:26:41.102 INFO:tasks.workunit.client.0.smithi001.stdout:3/205: write da/d3b/d1b/f2c [5176605,9484] 0 2024-09-15T22:26:41.102 INFO:tasks.workunit.client.0.smithi001.stdout:8/199: dread f4 [0,4194304] 0 2024-09-15T22:26:41.104 INFO:tasks.workunit.client.0.smithi001.stdout:6/191: rename d0/d6/d21 to d0/df/d24/d2e/d43 0 2024-09-15T22:26:41.105 INFO:tasks.workunit.client.0.smithi001.stdout:3/206: link da/c19 da/d1f/c47 0 2024-09-15T22:26:41.106 INFO:tasks.workunit.client.0.smithi001.stdout:6/192: creat d0/d2f/f44 x:0 0 0 2024-09-15T22:26:41.109 INFO:tasks.workunit.client.0.smithi001.stdout:7/195: read d0/d7/d21/f39 [497550,117083] 0 2024-09-15T22:26:41.111 INFO:tasks.workunit.client.0.smithi001.stdout:1/276: dwrite d3/dd/d3c/f43 [0,4194304] 0 2024-09-15T22:26:41.113 INFO:tasks.workunit.client.0.smithi001.stdout:1/277: rename d3/dd/d14/d1b/d2b/l3e to d3/l59 0 2024-09-15T22:26:41.122 INFO:tasks.workunit.client.0.smithi001.stdout:9/238: dread f4 [0,4194304] 0 2024-09-15T22:26:41.122 INFO:tasks.workunit.client.0.smithi001.stdout:9/239: truncate d5/de/d1a/d1b/d22/f2f 816392 0 2024-09-15T22:26:41.122 INFO:tasks.workunit.client.0.smithi001.stdout:9/240: write d5/f44 [956087,76031] 0 2024-09-15T22:26:41.126 INFO:tasks.workunit.client.0.smithi001.stdout:6/193: write d0/d2f/fe [1509247,125546] 0 2024-09-15T22:26:41.128 INFO:tasks.workunit.client.0.smithi001.stdout:6/194: creat d0/df/d24/d2e/f45 x:0 0 0 2024-09-15T22:26:41.128 INFO:tasks.workunit.client.0.smithi001.stdout:6/195: stat d0/d2f/f2b 0 2024-09-15T22:26:41.128 INFO:tasks.workunit.client.0.smithi001.stdout:6/196: rename d0 to d0/df/d24/d2e/d43/d46 22 2024-09-15T22:26:41.128 INFO:tasks.workunit.client.0.smithi001.stdout:6/197: fdatasync d0/d2f/f38 0 2024-09-15T22:26:41.128 INFO:tasks.workunit.client.0.smithi001.stdout:6/198: chown d0/df/d24/d2e/d43/f3c 1321272255 1 2024-09-15T22:26:41.129 INFO:tasks.workunit.client.0.smithi001.stdout:6/199: readlink d0/df/l28 0 2024-09-15T22:26:41.133 INFO:tasks.workunit.client.0.smithi001.stdout:6/200: mknod d0/c47 0 2024-09-15T22:26:41.137 INFO:tasks.workunit.client.0.smithi001.stdout:6/201: truncate d0/df/d24/f34 1545799 0 2024-09-15T22:26:41.137 INFO:tasks.workunit.client.0.smithi001.stdout:0/188: dwrite d0/dd/f29 [0,4194304] 0 2024-09-15T22:26:41.138 INFO:tasks.workunit.client.0.smithi001.stdout:0/189: chown d0/d9/f38 3088806 1 2024-09-15T22:26:41.138 INFO:tasks.workunit.client.0.smithi001.stdout:0/190: chown d0/d9/d1a 148 1 2024-09-15T22:26:41.138 INFO:tasks.workunit.client.0.smithi001.stdout:0/191: getdents d0/d9/d1a 0 2024-09-15T22:26:41.142 INFO:tasks.workunit.client.0.smithi001.stdout:5/238: dwrite d3/d27/d3c/f4a [0,4194304] 0 2024-09-15T22:26:41.154 INFO:tasks.workunit.client.0.smithi001.stdout:2/197: dwrite d2/d14/d17/f40 [0,4194304] 0 2024-09-15T22:26:41.155 INFO:tasks.workunit.client.0.smithi001.stdout:0/192: read d0/dd/f29 [1258219,98849] 0 2024-09-15T22:26:41.160 INFO:tasks.workunit.client.0.smithi001.stdout:7/196: write d0/d7/d44/f27 [22884,107722] 0 2024-09-15T22:26:41.161 INFO:tasks.workunit.client.0.smithi001.stdout:8/200: dwrite d9/d19/f1e [0,4194304] 0 2024-09-15T22:26:41.163 INFO:tasks.workunit.client.0.smithi001.stdout:0/193: getdents d0/dd 0 2024-09-15T22:26:41.164 INFO:tasks.workunit.client.0.smithi001.stdout:7/197: creat d0/d7/d21/d2b/f4a x:0 0 0 2024-09-15T22:26:41.166 INFO:tasks.workunit.client.0.smithi001.stdout:0/194: read d0/f23 [151216,129483] 0 2024-09-15T22:26:41.166 INFO:tasks.workunit.client.0.smithi001.stdout:8/201: write d9/f11 [50590,50095] 0 2024-09-15T22:26:41.166 INFO:tasks.workunit.client.0.smithi001.stdout:7/198: rename d0/d7/d21/f45 to d0/d7/d21/d2b/d3e/f4b 0 2024-09-15T22:26:41.166 INFO:tasks.workunit.client.0.smithi001.stdout:7/199: stat d0/d7/d21/f3d 0 2024-09-15T22:26:41.167 INFO:tasks.workunit.client.0.smithi001.stdout:8/202: mkdir d9/d19/d29/d33 0 2024-09-15T22:26:41.170 INFO:tasks.workunit.client.0.smithi001.stdout:7/200: unlink d0/d7/d44/d36/f48 0 2024-09-15T22:26:41.170 INFO:tasks.workunit.client.0.smithi001.stdout:7/201: chown d0/l5 1 1 2024-09-15T22:26:41.178 INFO:tasks.workunit.client.0.smithi001.stdout:2/198: dread d2/d14/d1a/d20/f2a [0,4194304] 0 2024-09-15T22:26:41.183 INFO:tasks.workunit.client.0.smithi001.stdout:0/195: dread d0/f8 [0,4194304] 0 2024-09-15T22:26:41.184 INFO:tasks.workunit.client.0.smithi001.stdout:3/207: dwrite da/d1f/f24 [4194304,4194304] 0 2024-09-15T22:26:41.186 INFO:tasks.workunit.client.0.smithi001.stdout:1/278: dwrite d3/dd/d14/d23/d4b/f52 [0,4194304] 0 2024-09-15T22:26:41.186 INFO:tasks.workunit.client.0.smithi001.stdout:1/279: dread - d3/dd/d14/d1b/d2b/f56 zero size 2024-09-15T22:26:41.186 INFO:tasks.workunit.client.0.smithi001.stdout:1/280: read - d3/d12/f40 zero size 2024-09-15T22:26:41.186 INFO:tasks.workunit.client.0.smithi001.stdout:0/196: symlink d0/dd/l3c 0 2024-09-15T22:26:41.190 INFO:tasks.workunit.client.0.smithi001.stdout:3/208: rename da/d3d/f45 to da/d16/f48 0 2024-09-15T22:26:41.190 INFO:tasks.workunit.client.0.smithi001.stdout:4/343: dwrite d0/d27/d35/d61/f19 [4194304,4194304] 0 2024-09-15T22:26:41.198 INFO:tasks.workunit.client.0.smithi001.stdout:1/281: creat d3/dd/d14/f5a x:0 0 0 2024-09-15T22:26:41.198 INFO:tasks.workunit.client.0.smithi001.stdout:0/197: rename d0/d9/db/l37 to d0/dd/d1b/l3d 0 2024-09-15T22:26:41.201 INFO:tasks.workunit.client.0.smithi001.stdout:2/199: read d2/f9 [1779059,19821] 0 2024-09-15T22:26:41.201 INFO:tasks.workunit.client.0.smithi001.stdout:2/200: stat d2/f10 0 2024-09-15T22:26:41.206 INFO:tasks.workunit.client.0.smithi001.stdout:4/344: write d0/d27/d35/f58 [1754178,47092] 0 2024-09-15T22:26:41.208 INFO:tasks.workunit.client.0.smithi001.stdout:6/202: dwrite d0/df/d24/d2e/f41 [4194304,4194304] 0 2024-09-15T22:26:41.208 INFO:tasks.workunit.client.0.smithi001.stdout:6/203: chown d0/d6 255029 1 2024-09-15T22:26:41.208 INFO:tasks.workunit.client.0.smithi001.stdout:6/204: read - d0/df/d24/f2c zero size 2024-09-15T22:26:41.210 INFO:tasks.workunit.client.0.smithi001.stdout:4/345: creat d0/d27/d35/d59/d67/d7b/f87 x:0 0 0 2024-09-15T22:26:41.210 INFO:tasks.workunit.client.0.smithi001.stdout:4/346: read d0/d27/d35/d61/d20/f26 [1867432,76292] 0 2024-09-15T22:26:41.213 INFO:tasks.workunit.client.0.smithi001.stdout:4/347: rmdir d0/d5d/d44/d65 39 2024-09-15T22:26:41.213 INFO:tasks.workunit.client.0.smithi001.stdout:4/348: write d0/d5d/d44/d65/d6a/f6d [1009746,111704] 0 2024-09-15T22:26:41.213 INFO:tasks.workunit.client.0.smithi001.stdout:6/205: creat d0/f48 x:0 0 0 2024-09-15T22:26:41.215 INFO:tasks.workunit.client.0.smithi001.stdout:4/349: unlink d0/d27/d35/c60 0 2024-09-15T22:26:41.217 INFO:tasks.workunit.client.0.smithi001.stdout:4/350: creat d0/d5d/d44/f88 x:0 0 0 2024-09-15T22:26:41.218 INFO:tasks.workunit.client.0.smithi001.stdout:4/351: creat d0/d27/d35/d61/d20/d29/d34/f89 x:0 0 0 2024-09-15T22:26:41.218 INFO:tasks.workunit.client.0.smithi001.stdout:4/352: write d0/d5d/d44/f88 [386338,78087] 0 2024-09-15T22:26:41.223 INFO:tasks.workunit.client.0.smithi001.stdout:4/353: write d0/f6b [814710,120935] 0 2024-09-15T22:26:41.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:40 smithi012 ceph-mon[34883]: pgmap v410: 97 pgs: 97 active+clean; 198 MiB data, 1007 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 23 MiB/s wr, 1.07k op/s 2024-09-15T22:26:41.249 INFO:tasks.workunit.client.0.smithi001.stdout:7/202: dwrite d0/d7/f19 [0,4194304] 0 2024-09-15T22:26:41.249 INFO:tasks.workunit.client.0.smithi001.stdout:7/203: write d0/d7/d2e/f34 [390119,103641] 0 2024-09-15T22:26:41.251 INFO:tasks.workunit.client.0.smithi001.stdout:7/204: symlink d0/l4c 0 2024-09-15T22:26:41.280 INFO:tasks.workunit.client.0.smithi001.stdout:8/203: dwrite f7 [0,4194304] 0 2024-09-15T22:26:41.280 INFO:tasks.workunit.client.0.smithi001.stdout:6/206: dread d0/f2 [0,4194304] 0 2024-09-15T22:26:41.280 INFO:tasks.workunit.client.0.smithi001.stdout:6/207: write d0/d6/f17 [602144,69334] 0 2024-09-15T22:26:41.299 INFO:tasks.workunit.client.0.smithi001.stdout:1/282: dwrite d3/f39 [0,4194304] 0 2024-09-15T22:26:41.299 INFO:tasks.workunit.client.0.smithi001.stdout:1/283: chown d3/dd/d14/f31 1994 1 2024-09-15T22:26:41.300 INFO:tasks.workunit.client.0.smithi001.stdout:2/201: dwrite d2/d14/d17/f2c [0,4194304] 0 2024-09-15T22:26:41.302 INFO:tasks.workunit.client.0.smithi001.stdout:6/208: write d0/df/d24/f3a [1870465,23011] 0 2024-09-15T22:26:41.303 INFO:tasks.workunit.client.0.smithi001.stdout:4/354: dwrite d0/d27/d35/d61/d20/d29/d34/f89 [0,4194304] 0 2024-09-15T22:26:41.305 INFO:tasks.workunit.client.0.smithi001.stdout:6/209: mkdir d0/df/d24/d49 0 2024-09-15T22:26:41.305 INFO:tasks.workunit.client.0.smithi001.stdout:6/210: chown d0/f4 6 1 2024-09-15T22:26:41.306 INFO:tasks.workunit.client.0.smithi001.stdout:6/211: truncate d0/f22 373993 0 2024-09-15T22:26:41.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:40 smithi098 ceph-mon[35514]: pgmap v410: 97 pgs: 97 active+clean; 198 MiB data, 1007 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 23 MiB/s wr, 1.07k op/s 2024-09-15T22:26:41.311 INFO:tasks.workunit.client.0.smithi001.stdout:6/212: write d0/d6/f17 [356314,90419] 0 2024-09-15T22:26:41.311 INFO:tasks.workunit.client.0.smithi001.stdout:3/209: dwrite f5 [4194304,4194304] 0 2024-09-15T22:26:41.311 INFO:tasks.workunit.client.0.smithi001.stdout:3/210: chown da/d16/ff 504 1 2024-09-15T22:26:41.311 INFO:tasks.workunit.client.0.smithi001.stdout:6/213: stat d0 0 2024-09-15T22:26:41.311 INFO:tasks.workunit.client.0.smithi001.stdout:6/214: chown d0/c47 13647 1 2024-09-15T22:26:41.312 INFO:tasks.workunit.client.0.smithi001.stdout:3/211: symlink da/l49 0 2024-09-15T22:26:41.312 INFO:tasks.workunit.client.0.smithi001.stdout:3/212: creat da/d1f/d46/f4a x:0 0 0 2024-09-15T22:26:41.320 INFO:tasks.workunit.client.0.smithi001.stdout:3/213: unlink da/d3d/d43/l39 0 2024-09-15T22:26:41.320 INFO:tasks.workunit.client.0.smithi001.stdout:3/214: dread - da/d3b/f33 zero size 2024-09-15T22:26:41.320 INFO:tasks.workunit.client.0.smithi001.stdout:3/215: fdatasync da/d16/f30 0 2024-09-15T22:26:41.321 INFO:tasks.workunit.client.0.smithi001.stdout:3/216: creat da/d16/f4b x:0 0 0 2024-09-15T22:26:41.322 INFO:tasks.workunit.client.0.smithi001.stdout:2/202: dread d2/d14/d17/f40 [0,4194304] 0 2024-09-15T22:26:41.323 INFO:tasks.workunit.client.0.smithi001.stdout:4/355: dread d0/d27/d35/d61/d20/f63 [0,4194304] 0 2024-09-15T22:26:41.326 INFO:tasks.workunit.client.0.smithi001.stdout:3/217: mknod da/d3b/c4c 0 2024-09-15T22:26:41.328 INFO:tasks.workunit.client.0.smithi001.stdout:4/356: rename d0/d27/d35/d61/d20/d29/d34/f50 to d0/d27/d35/d61/d20/d29/d34/d3a/f8a 0 2024-09-15T22:26:41.330 INFO:tasks.workunit.client.0.smithi001.stdout:3/218: getdents da/d1f 0 2024-09-15T22:26:41.330 INFO:tasks.workunit.client.0.smithi001.stdout:3/219: fdatasync da/f1c 0 2024-09-15T22:26:41.335 INFO:tasks.workunit.client.0.smithi001.stdout:8/204: dwrite f8 [0,4194304] 0 2024-09-15T22:26:41.338 INFO:tasks.workunit.client.0.smithi001.stdout:6/215: dread d0/d6/f3e [0,4194304] 0 2024-09-15T22:26:41.338 INFO:tasks.workunit.client.0.smithi001.stdout:6/216: write d0/df/d24/f3a [2905029,76507] 0 2024-09-15T22:26:41.339 INFO:tasks.workunit.client.0.smithi001.stdout:4/357: symlink d0/d5d/d44/d65/d6a/l8b 0 2024-09-15T22:26:41.340 INFO:tasks.workunit.client.0.smithi001.stdout:3/220: symlink da/l4d 0 2024-09-15T22:26:41.343 INFO:tasks.workunit.client.0.smithi001.stdout:8/205: mkdir d9/d19/d34 0 2024-09-15T22:26:41.344 INFO:tasks.workunit.client.0.smithi001.stdout:6/217: rmdir d0/df/d24/d40 0 2024-09-15T22:26:41.345 INFO:tasks.workunit.client.0.smithi001.stdout:4/358: creat d0/d27/d35/d61/d20/f8c x:0 0 0 2024-09-15T22:26:41.346 INFO:tasks.workunit.client.0.smithi001.stdout:3/221: symlink da/d1f/l4e 0 2024-09-15T22:26:41.347 INFO:tasks.workunit.client.0.smithi001.stdout:3/222: write da/d1f/f3e [515947,108783] 0 2024-09-15T22:26:41.347 INFO:tasks.workunit.client.0.smithi001.stdout:3/223: truncate da/d16/f30 827925 0 2024-09-15T22:26:41.347 INFO:tasks.workunit.client.0.smithi001.stdout:8/206: mkdir d9/d19/d29/d35 0 2024-09-15T22:26:41.348 INFO:tasks.workunit.client.0.smithi001.stdout:0/198: dwrite d0/f2 [0,4194304] 0 2024-09-15T22:26:41.348 INFO:tasks.workunit.client.0.smithi001.stdout:0/199: dread - d0/d6/f30 zero size 2024-09-15T22:26:41.352 INFO:tasks.workunit.client.0.smithi001.stdout:7/205: dwrite d0/d7/d44/f11 [4194304,4194304] 0 2024-09-15T22:26:41.352 INFO:tasks.workunit.client.0.smithi001.stdout:7/206: readlink d0/l1d 0 2024-09-15T22:26:41.352 INFO:tasks.workunit.client.0.smithi001.stdout:0/200: unlink d0/dd/d1b/f21 0 2024-09-15T22:26:41.352 INFO:tasks.workunit.client.0.smithi001.stdout:0/201: fdatasync d0/d9/db/f19 0 2024-09-15T22:26:41.352 INFO:tasks.workunit.client.0.smithi001.stdout:4/359: creat d0/d27/d35/d53/f8d x:0 0 0 2024-09-15T22:26:41.353 INFO:tasks.workunit.client.0.smithi001.stdout:4/360: readlink d0/d27/d35/l83 0 2024-09-15T22:26:41.353 INFO:tasks.workunit.client.0.smithi001.stdout:4/361: chown d0/d27/l5e 0 1 2024-09-15T22:26:41.354 INFO:tasks.workunit.client.0.smithi001.stdout:0/202: symlink d0/d9/d1a/l3e 0 2024-09-15T22:26:41.355 INFO:tasks.workunit.client.0.smithi001.stdout:0/203: chown d0/d9/db/f19 54262 1 2024-09-15T22:26:41.355 INFO:tasks.workunit.client.0.smithi001.stdout:0/204: symlink d0/d9/l3f 0 2024-09-15T22:26:41.355 INFO:tasks.workunit.client.0.smithi001.stdout:0/205: mknod d0/d9/d1a/c40 0 2024-09-15T22:26:41.357 INFO:tasks.workunit.client.0.smithi001.stdout:0/206: creat d0/d9/d1a/d36/f41 x:0 0 0 2024-09-15T22:26:41.357 INFO:tasks.workunit.client.0.smithi001.stdout:0/207: chown d0/d6/f15 1 1 2024-09-15T22:26:41.358 INFO:tasks.workunit.client.0.smithi001.stdout:0/208: creat d0/d6/f42 x:0 0 0 2024-09-15T22:26:41.358 INFO:tasks.workunit.client.0.smithi001.stdout:0/209: fsync d0/d6/f30 0 2024-09-15T22:26:41.358 INFO:tasks.workunit.client.0.smithi001.stdout:0/210: truncate d0/f16 4381005 0 2024-09-15T22:26:41.358 INFO:tasks.workunit.client.0.smithi001.stdout:0/211: chown d0/d6/f15 4 1 2024-09-15T22:26:41.359 INFO:tasks.workunit.client.0.smithi001.stdout:9/241: sync 2024-09-15T22:26:41.359 INFO:tasks.workunit.client.0.smithi001.stdout:5/239: sync 2024-09-15T22:26:41.359 INFO:tasks.workunit.client.0.smithi001.stdout:0/212: symlink d0/dd/d33/l43 0 2024-09-15T22:26:41.361 INFO:tasks.workunit.client.0.smithi001.stdout:0/213: symlink d0/d9/d1a/l44 0 2024-09-15T22:26:41.361 INFO:tasks.workunit.client.0.smithi001.stdout:5/240: rmdir d3 39 2024-09-15T22:26:41.361 INFO:tasks.workunit.client.0.smithi001.stdout:2/203: dwrite d2/d14/d1a/d20/f19 [0,4194304] 0 2024-09-15T22:26:41.362 INFO:tasks.workunit.client.0.smithi001.stdout:5/241: mkdir d3/d6/d41/d4d 0 2024-09-15T22:26:41.363 INFO:tasks.workunit.client.0.smithi001.stdout:5/242: fdatasync d3/fc 0 2024-09-15T22:26:41.364 INFO:tasks.workunit.client.0.smithi001.stdout:8/207: write f7 [4595213,7828] 0 2024-09-15T22:26:41.365 INFO:tasks.workunit.client.0.smithi001.stdout:5/243: getdents d3/d6 0 2024-09-15T22:26:41.365 INFO:tasks.workunit.client.0.smithi001.stdout:5/244: fsync d3/d6/f8 0 2024-09-15T22:26:41.367 INFO:tasks.workunit.client.0.smithi001.stdout:5/245: write d3/d6/f7 [4945858,115179] 0 2024-09-15T22:26:41.368 INFO:tasks.workunit.client.0.smithi001.stdout:5/246: rmdir d3/d27/d3c 39 2024-09-15T22:26:41.370 INFO:tasks.workunit.client.0.smithi001.stdout:5/247: mkdir d3/d27/d4e 0 2024-09-15T22:26:41.375 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:40 smithi001 ceph-mon[30843]: pgmap v410: 97 pgs: 97 active+clean; 198 MiB data, 1007 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 23 MiB/s wr, 1.07k op/s 2024-09-15T22:26:41.380 INFO:tasks.workunit.client.0.smithi001.stdout:5/248: rename d3/d6/f20 to d3/f4f 0 2024-09-15T22:26:41.381 INFO:tasks.workunit.client.0.smithi001.stdout:0/214: truncate d0/d6/f15 4020786 0 2024-09-15T22:26:41.381 INFO:tasks.workunit.client.0.smithi001.stdout:0/215: fdatasync d0/f4 0 2024-09-15T22:26:41.381 INFO:tasks.workunit.client.0.smithi001.stdout:0/216: fsync d0/f23 0 2024-09-15T22:26:41.382 INFO:tasks.workunit.client.0.smithi001.stdout:5/249: mknod d3/d6/d41/d4d/c50 0 2024-09-15T22:26:41.383 INFO:tasks.workunit.client.0.smithi001.stdout:0/217: creat d0/d9/d1a/d36/f45 x:0 0 0 2024-09-15T22:26:41.385 INFO:tasks.workunit.client.0.smithi001.stdout:0/218: creat d0/f46 x:0 0 0 2024-09-15T22:26:41.406 INFO:tasks.workunit.client.0.smithi001.stdout:4/362: dwrite d0/d27/d35/f69 [0,4194304] 0 2024-09-15T22:26:41.429 INFO:tasks.workunit.client.0.smithi001.stdout:5/250: dwrite d3/d27/d3c/f4a [4194304,4194304] 0 2024-09-15T22:26:41.445 INFO:tasks.workunit.client.0.smithi001.stdout:2/204: dwrite d2/d14/d17/d1f/d21/f23 [0,4194304] 0 2024-09-15T22:26:41.445 INFO:tasks.workunit.client.0.smithi001.stdout:7/207: dwrite d0/d7/f17 [0,4194304] 0 2024-09-15T22:26:41.449 INFO:tasks.workunit.client.0.smithi001.stdout:7/208: rmdir d0 39 2024-09-15T22:26:41.451 INFO:tasks.workunit.client.0.smithi001.stdout:6/218: dwrite d0/d2f/f2b [4194304,4194304] 0 2024-09-15T22:26:41.454 INFO:tasks.workunit.client.0.smithi001.stdout:6/219: creat d0/df/d24/d2e/d43/f4a x:0 0 0 2024-09-15T22:26:41.458 INFO:tasks.workunit.client.0.smithi001.stdout:6/220: creat d0/d6/f4b x:0 0 0 2024-09-15T22:26:41.458 INFO:tasks.workunit.client.0.smithi001.stdout:6/221: write d0/df/d24/d2e/f45 [295176,12885] 0 2024-09-15T22:26:41.459 INFO:tasks.workunit.client.0.smithi001.stdout:6/222: write d0/df/d24/d2e/d43/f4a [1014295,49084] 0 2024-09-15T22:26:41.459 INFO:tasks.workunit.client.0.smithi001.stdout:6/223: fdatasync d0/f22 0 2024-09-15T22:26:41.460 INFO:tasks.workunit.client.0.smithi001.stdout:6/224: symlink d0/l4c 0 2024-09-15T22:26:41.461 INFO:tasks.workunit.client.0.smithi001.stdout:6/225: rename d0/f11 to d0/df/f4d 0 2024-09-15T22:26:41.461 INFO:tasks.workunit.client.0.smithi001.stdout:6/226: chown d0/d6/f4b 2 1 2024-09-15T22:26:41.464 INFO:tasks.workunit.client.0.smithi001.stdout:7/209: dread d0/d7/f17 [0,4194304] 0 2024-09-15T22:26:41.464 INFO:tasks.workunit.client.0.smithi001.stdout:7/210: write d0/d7/fd [1334320,93806] 0 2024-09-15T22:26:41.465 INFO:tasks.workunit.client.0.smithi001.stdout:7/211: symlink d0/d7/d44/d36/l4d 0 2024-09-15T22:26:41.466 INFO:tasks.workunit.client.0.smithi001.stdout:7/212: unlink d0/l4c 0 2024-09-15T22:26:41.468 INFO:tasks.workunit.client.0.smithi001.stdout:7/213: unlink d0/d7/d44/d36/l4d 0 2024-09-15T22:26:41.468 INFO:tasks.workunit.client.0.smithi001.stdout:7/214: readlink d0/l46 0 2024-09-15T22:26:41.468 INFO:tasks.workunit.client.0.smithi001.stdout:7/215: stat d0/d7/d21/f3a 0 2024-09-15T22:26:41.478 INFO:tasks.workunit.client.0.smithi001.stdout:7/216: write d0/d7/f17 [3132964,58466] 0 2024-09-15T22:26:41.478 INFO:tasks.workunit.client.0.smithi001.stdout:7/217: fsync d0/d7/d21/f39 0 2024-09-15T22:26:41.478 INFO:tasks.workunit.client.0.smithi001.stdout:7/218: fsync d0/d7/d21/d2b/d3e/f4b 0 2024-09-15T22:26:41.500 INFO:tasks.workunit.client.0.smithi001.stdout:5/251: dwrite d3/d27/f39 [0,4194304] 0 2024-09-15T22:26:41.504 INFO:tasks.workunit.client.0.smithi001.stdout:5/252: mknod d3/c51 0 2024-09-15T22:26:41.504 INFO:tasks.workunit.client.0.smithi001.stdout:9/242: dwrite f4 [0,4194304] 0 2024-09-15T22:26:41.504 INFO:tasks.workunit.client.0.smithi001.stdout:9/243: write d5/de/d1a/d38/f49 [626340,33612] 0 2024-09-15T22:26:41.504 INFO:tasks.workunit.client.0.smithi001.stdout:0/219: dread d0/f7 [0,4194304] 0 2024-09-15T22:26:41.505 INFO:tasks.workunit.client.0.smithi001.stdout:0/220: chown d0/dd/c20 6074 1 2024-09-15T22:26:41.506 INFO:tasks.workunit.client.0.smithi001.stdout:5/253: unlink d3/d6/l36 0 2024-09-15T22:26:41.508 INFO:tasks.workunit.client.0.smithi001.stdout:9/244: getdents d5 0 2024-09-15T22:26:41.509 INFO:tasks.workunit.client.0.smithi001.stdout:9/245: write d5/de/d1a/d1b/d22/d2c/d21/f25 [4914937,35461] 0 2024-09-15T22:26:41.511 INFO:tasks.workunit.client.0.smithi001.stdout:4/363: dwrite d0/d27/d35/d61/f43 [4194304,4194304] 0 2024-09-15T22:26:41.513 INFO:tasks.workunit.client.0.smithi001.stdout:5/254: mkdir d3/d27/d3c/d52 0 2024-09-15T22:26:41.513 INFO:tasks.workunit.client.0.smithi001.stdout:2/205: dwrite d2/d14/d1a/d20/f2a [0,4194304] 0 2024-09-15T22:26:41.514 INFO:tasks.workunit.client.0.smithi001.stdout:2/206: truncate d2/d14/d1a/d20/f19 4885781 0 2024-09-15T22:26:41.514 INFO:tasks.workunit.client.0.smithi001.stdout:2/207: truncate d2/d14/d17/d1f/f25 9321135 0 2024-09-15T22:26:41.516 INFO:tasks.workunit.client.0.smithi001.stdout:4/364: truncate d0/d27/d35/d61/f21 2369417 0 2024-09-15T22:26:41.518 INFO:tasks.workunit.client.0.smithi001.stdout:9/246: dread d5/de/d1a/d1b/f3a [0,4194304] 0 2024-09-15T22:26:41.519 INFO:tasks.workunit.client.0.smithi001.stdout:5/255: creat d3/d6/d41/f53 x:0 0 0 2024-09-15T22:26:41.520 INFO:tasks.workunit.client.0.smithi001.stdout:2/208: mknod d2/d14/d2f/c41 0 2024-09-15T22:26:41.521 INFO:tasks.workunit.client.0.smithi001.stdout:4/365: fdatasync d0/f11 0 2024-09-15T22:26:41.523 INFO:tasks.workunit.client.0.smithi001.stdout:0/221: dread d0/f2 [0,4194304] 0 2024-09-15T22:26:41.523 INFO:tasks.workunit.client.0.smithi001.stdout:0/222: write d0/d9/d1a/d36/f41 [647684,126557] 0 2024-09-15T22:26:41.523 INFO:tasks.workunit.client.0.smithi001.stdout:5/256: write d3/fc [4963501,1705] 0 2024-09-15T22:26:41.523 INFO:tasks.workunit.client.0.smithi001.stdout:9/247: link d5/de/d1a/d1b/d22/d2c/f31 d5/de/d1a/d1b/d22/d2c/d21/d4d/f4e 0 2024-09-15T22:26:41.524 INFO:tasks.workunit.client.0.smithi001.stdout:1/284: sync 2024-09-15T22:26:41.525 INFO:tasks.workunit.client.0.smithi001.stdout:2/209: rename d2/d14/d2f/c41 to d2/d14/d1a/d1b/c42 0 2024-09-15T22:26:41.525 INFO:tasks.workunit.client.0.smithi001.stdout:2/210: write d2/f3d [234625,80791] 0 2024-09-15T22:26:41.526 INFO:tasks.workunit.client.0.smithi001.stdout:4/366: creat d0/f8e x:0 0 0 2024-09-15T22:26:41.527 INFO:tasks.workunit.client.0.smithi001.stdout:7/219: dwrite d0/d7/d21/d2b/f4a [0,4194304] 0 2024-09-15T22:26:41.528 INFO:tasks.workunit.client.0.smithi001.stdout:7/220: stat d0/d7/d2e/f34 0 2024-09-15T22:26:41.528 INFO:tasks.workunit.client.0.smithi001.stdout:7/221: chown d0/d7/d21/d2b/f4a 482312695 1 2024-09-15T22:26:41.528 INFO:tasks.workunit.client.0.smithi001.stdout:0/223: creat d0/dd/f47 x:0 0 0 2024-09-15T22:26:41.528 INFO:tasks.workunit.client.0.smithi001.stdout:0/224: chown d0/dd 3 1 2024-09-15T22:26:41.529 INFO:tasks.workunit.client.0.smithi001.stdout:5/257: mkdir d3/d1d/d54 0 2024-09-15T22:26:41.530 INFO:tasks.workunit.client.0.smithi001.stdout:9/248: getdents d5/de 0 2024-09-15T22:26:41.530 INFO:tasks.workunit.client.0.smithi001.stdout:9/249: read d5/de/d1a/d1b/f33 [3529179,35218] 0 2024-09-15T22:26:41.531 INFO:tasks.workunit.client.0.smithi001.stdout:1/285: creat d3/dd/d3c/f5b x:0 0 0 2024-09-15T22:26:41.531 INFO:tasks.workunit.client.0.smithi001.stdout:8/208: sync 2024-09-15T22:26:41.531 INFO:tasks.workunit.client.0.smithi001.stdout:3/224: sync 2024-09-15T22:26:41.531 INFO:tasks.workunit.client.0.smithi001.stdout:6/227: dwrite d0/d6/f29 [0,4194304] 0 2024-09-15T22:26:41.532 INFO:tasks.workunit.client.0.smithi001.stdout:2/211: creat d2/f43 x:0 0 0 2024-09-15T22:26:41.532 INFO:tasks.workunit.client.0.smithi001.stdout:2/212: chown d2/f10 3 1 2024-09-15T22:26:41.533 INFO:tasks.workunit.client.0.smithi001.stdout:4/367: getdents d0/d27/d35/d53/d54/d73 0 2024-09-15T22:26:41.536 INFO:tasks.workunit.client.0.smithi001.stdout:7/222: mknod d0/d7/d21/c4e 0 2024-09-15T22:26:41.539 INFO:tasks.workunit.client.0.smithi001.stdout:0/225: link d0/cc d0/dd/d1b/c48 0 2024-09-15T22:26:41.541 INFO:tasks.workunit.client.0.smithi001.stdout:9/250: rename d5/de/d1a/d1b/d22/d2c/d21/d48 to d5/de/d1a/d41/d4f 0 2024-09-15T22:26:41.542 INFO:tasks.workunit.client.0.smithi001.stdout:1/286: creat d3/dd/d3c/d4c/f5c x:0 0 0 2024-09-15T22:26:41.542 INFO:tasks.workunit.client.0.smithi001.stdout:1/287: truncate d3/f42 1025954 0 2024-09-15T22:26:41.542 INFO:tasks.workunit.client.0.smithi001.stdout:1/288: dread - d3/dd/d14/f5a zero size 2024-09-15T22:26:41.543 INFO:tasks.workunit.client.0.smithi001.stdout:8/209: truncate d9/f18 2172119 0 2024-09-15T22:26:41.544 INFO:tasks.workunit.client.0.smithi001.stdout:3/225: mknod da/d1f/d2e/d3f/c4f 0 2024-09-15T22:26:41.544 INFO:tasks.workunit.client.0.smithi001.stdout:3/226: fdatasync f5 0 2024-09-15T22:26:41.545 INFO:tasks.workunit.client.0.smithi001.stdout:6/228: creat d0/d2f/f4e x:0 0 0 2024-09-15T22:26:41.546 INFO:tasks.workunit.client.0.smithi001.stdout:2/213: unlink d2/l7 0 2024-09-15T22:26:41.547 INFO:tasks.workunit.client.0.smithi001.stdout:2/214: stat d2/d14/d17/d1f/d21 0 2024-09-15T22:26:41.547 INFO:tasks.workunit.client.0.smithi001.stdout:7/223: mkdir d0/d7/d44/d3f/d49/d4f 0 2024-09-15T22:26:41.551 INFO:tasks.workunit.client.0.smithi001.stdout:9/251: creat d5/de/d15/d27/f50 x:0 0 0 2024-09-15T22:26:41.551 INFO:tasks.workunit.client.0.smithi001.stdout:1/289: unlink d3/dd/d3c/c49 0 2024-09-15T22:26:41.551 INFO:tasks.workunit.client.0.smithi001.stdout:1/290: chown d3/dd/d14/d1b 977634 1 2024-09-15T22:26:41.557 INFO:tasks.workunit.client.0.smithi001.stdout:0/226: read d0/f7 [143409,62346] 0 2024-09-15T22:26:41.558 INFO:tasks.workunit.client.0.smithi001.stdout:7/224: dread d0/f2f [0,4194304] 0 2024-09-15T22:26:41.558 INFO:tasks.workunit.client.0.smithi001.stdout:2/215: rename d2/d14/d2f/c38 to d2/d14/d1a/c44 0 2024-09-15T22:26:41.558 INFO:tasks.workunit.client.0.smithi001.stdout:1/291: symlink d3/dd/d14/l5d 0 2024-09-15T22:26:41.559 INFO:tasks.workunit.client.0.smithi001.stdout:3/227: rmdir da/d3b/d1b 39 2024-09-15T22:26:41.559 INFO:tasks.workunit.client.0.smithi001.stdout:1/292: truncate d3/dd/f34 1528282 0 2024-09-15T22:26:41.560 INFO:tasks.workunit.client.0.smithi001.stdout:7/225: symlink d0/d7/d44/d3f/l50 0 2024-09-15T22:26:41.561 INFO:tasks.workunit.client.0.smithi001.stdout:9/252: rename d5/de/d1a/d41 to d5/de/d51 0 2024-09-15T22:26:41.563 INFO:tasks.workunit.client.0.smithi001.stdout:0/227: rmdir d0/d6 39 2024-09-15T22:26:41.563 INFO:tasks.workunit.client.0.smithi001.stdout:3/228: chown da/d3b/d1b/c1d 7 1 2024-09-15T22:26:41.565 INFO:tasks.workunit.client.0.smithi001.stdout:7/226: creat d0/d7/d21/d2b/d3e/f51 x:0 0 0 2024-09-15T22:26:41.565 INFO:tasks.workunit.client.0.smithi001.stdout:7/227: chown d0/d7/d23 857 1 2024-09-15T22:26:41.566 INFO:tasks.workunit.client.0.smithi001.stdout:0/228: mknod d0/dd/d33/c49 0 2024-09-15T22:26:41.569 INFO:tasks.workunit.client.0.smithi001.stdout:7/228: getdents d0/d7/d44 0 2024-09-15T22:26:41.569 INFO:tasks.workunit.client.0.smithi001.stdout:3/229: rmdir da/d3d/d43 39 2024-09-15T22:26:41.570 INFO:tasks.workunit.client.0.smithi001.stdout:7/229: unlink d0/d7/d21/f39 0 2024-09-15T22:26:41.589 INFO:tasks.workunit.client.0.smithi001.stdout:2/216: dread d2/f9 [0,4194304] 0 2024-09-15T22:26:41.589 INFO:tasks.workunit.client.0.smithi001.stdout:2/217: fsync d2/d14/d1a/d1b/f26 0 2024-09-15T22:26:41.591 INFO:tasks.workunit.client.0.smithi001.stdout:3/230: read da/d1f/f24 [6184123,118178] 0 2024-09-15T22:26:41.591 INFO:tasks.workunit.client.0.smithi001.stdout:3/231: write da/d3b/f32 [4601637,44882] 0 2024-09-15T22:26:41.608 INFO:tasks.workunit.client.0.smithi001.stdout:1/293: dwrite d3/d12/f3d [0,4194304] 0 2024-09-15T22:26:41.628 INFO:tasks.workunit.client.0.smithi001.stdout:5/258: dwrite d3/d27/f46 [0,4194304] 0 2024-09-15T22:26:41.629 INFO:tasks.workunit.client.0.smithi001.stdout:5/259: chown d3/fc 511283604 1 2024-09-15T22:26:41.635 INFO:tasks.workunit.client.0.smithi001.stdout:8/210: dwrite d9/d19/f32 [0,4194304] 0 2024-09-15T22:26:41.636 INFO:tasks.workunit.client.0.smithi001.stdout:8/211: readlink d9/d19/l26 0 2024-09-15T22:26:41.639 INFO:tasks.workunit.client.0.smithi001.stdout:8/212: unlink f5 0 2024-09-15T22:26:41.640 INFO:tasks.workunit.client.0.smithi001.stdout:1/294: read d3/f9 [7466967,45490] 0 2024-09-15T22:26:41.655 INFO:tasks.workunit.client.0.smithi001.stdout:2/218: dwrite d2/d14/d17/d1f/d21/f23 [0,4194304] 0 2024-09-15T22:26:41.656 INFO:tasks.workunit.client.0.smithi001.stdout:2/219: truncate d2/d14/d17/d1f/f3c 543621 0 2024-09-15T22:26:41.663 INFO:tasks.workunit.client.0.smithi001.stdout:2/220: rmdir d2/d14/d2f 0 2024-09-15T22:26:41.665 INFO:tasks.workunit.client.0.smithi001.stdout:0/229: dwrite d0/d9/f1c [0,4194304] 0 2024-09-15T22:26:41.665 INFO:tasks.workunit.client.0.smithi001.stdout:0/230: truncate d0/d6/f2a 917478 0 2024-09-15T22:26:41.666 INFO:tasks.workunit.client.0.smithi001.stdout:3/232: dwrite da/d1f/f3e [0,4194304] 0 2024-09-15T22:26:41.667 INFO:tasks.workunit.client.0.smithi001.stdout:7/230: dwrite d0/d7/d44/f47 [0,4194304] 0 2024-09-15T22:26:41.669 INFO:tasks.workunit.client.0.smithi001.stdout:0/231: unlink d0/f23 0 2024-09-15T22:26:41.675 INFO:tasks.workunit.client.0.smithi001.stdout:7/231: link d0/d7/d23/f29 d0/d7/d21/f52 0 2024-09-15T22:26:41.675 INFO:tasks.workunit.client.0.smithi001.stdout:7/232: readlink d0/d7/l14 0 2024-09-15T22:26:41.676 INFO:tasks.workunit.client.0.smithi001.stdout:0/232: rename d0/dd/l3c to d0/d9/db/l4a 0 2024-09-15T22:26:41.676 INFO:tasks.workunit.client.0.smithi001.stdout:0/233: chown d0/d6/f30 1006038108 1 2024-09-15T22:26:41.682 INFO:tasks.workunit.client.0.smithi001.stdout:7/233: rmdir d0/d7/d2e 39 2024-09-15T22:26:41.683 INFO:tasks.workunit.client.0.smithi001.stdout:6/229: dwrite d0/f19 [0,4194304] 0 2024-09-15T22:26:41.684 INFO:tasks.workunit.client.0.smithi001.stdout:5/260: dwrite d3/d27/f39 [4194304,4194304] 0 2024-09-15T22:26:41.684 INFO:tasks.workunit.client.0.smithi001.stdout:5/261: stat d3/d1d/l40 0 2024-09-15T22:26:41.684 INFO:tasks.workunit.client.0.smithi001.stdout:2/221: write d2/d14/d17/f2c [3495535,67275] 0 2024-09-15T22:26:41.685 INFO:tasks.workunit.client.0.smithi001.stdout:3/233: dread da/d16/f26 [0,4194304] 0 2024-09-15T22:26:41.686 INFO:tasks.workunit.client.0.smithi001.stdout:6/230: rename d0/d6/f17 to d0/df/d24/d2e/d43/d30/f4f 0 2024-09-15T22:26:41.686 INFO:tasks.workunit.client.0.smithi001.stdout:6/231: rename d0/df/d24 to d0/df/d24/d49/d50 22 2024-09-15T22:26:41.686 INFO:tasks.workunit.client.0.smithi001.stdout:6/232: dread - d0/f48 zero size 2024-09-15T22:26:41.687 INFO:tasks.workunit.client.0.smithi001.stdout:5/262: creat d3/d27/d3c/f55 x:0 0 0 2024-09-15T22:26:41.688 INFO:tasks.workunit.client.0.smithi001.stdout:2/222: rmdir d2/d14/d1a 39 2024-09-15T22:26:41.692 INFO:tasks.workunit.client.0.smithi001.stdout:3/234: symlink da/d3b/d1b/l50 0 2024-09-15T22:26:41.692 INFO:tasks.workunit.client.0.smithi001.stdout:3/235: dread - da/d16/f4b zero size 2024-09-15T22:26:41.692 INFO:tasks.workunit.client.0.smithi001.stdout:2/223: mknod d2/d14/d17/c45 0 2024-09-15T22:26:41.697 INFO:tasks.workunit.client.0.smithi001.stdout:1/295: dwrite d3/dd/f34 [0,4194304] 0 2024-09-15T22:26:41.699 INFO:tasks.workunit.client.0.smithi001.stdout:1/296: unlink d3/dd/c29 0 2024-09-15T22:26:41.699 INFO:tasks.workunit.client.0.smithi001.stdout:1/297: chown d3/dd/d14/d23/d4b/f52 87698 1 2024-09-15T22:26:41.700 INFO:tasks.workunit.client.0.smithi001.stdout:1/298: write d3/dd/d14/d1b/f30 [2845641,75180] 0 2024-09-15T22:26:41.700 INFO:tasks.workunit.client.0.smithi001.stdout:1/299: chown d3/dd/d14/c1f 11562582 1 2024-09-15T22:26:41.700 INFO:tasks.workunit.client.0.smithi001.stdout:1/300: rename d3/dd/d14/f2e to d3/f5e 0 2024-09-15T22:26:41.702 INFO:tasks.workunit.client.0.smithi001.stdout:2/224: dread d2/f3d [0,4194304] 0 2024-09-15T22:26:41.702 INFO:tasks.workunit.client.0.smithi001.stdout:2/225: read - d2/f43 zero size 2024-09-15T22:26:41.702 INFO:tasks.workunit.client.0.smithi001.stdout:2/226: write d2/d14/f15 [1742382,92638] 0 2024-09-15T22:26:41.702 INFO:tasks.workunit.client.0.smithi001.stdout:2/227: readlink d2/d14/l33 0 2024-09-15T22:26:41.702 INFO:tasks.workunit.client.0.smithi001.stdout:2/228: chown d2/c35 66175673 1 2024-09-15T22:26:41.702 INFO:tasks.workunit.client.0.smithi001.stdout:1/301: truncate d3/d12/f35 274114 0 2024-09-15T22:26:41.702 INFO:tasks.workunit.client.0.smithi001.stdout:1/302: readlink d3/dd/d14/d1b/l2a 0 2024-09-15T22:26:41.703 INFO:tasks.workunit.client.0.smithi001.stdout:2/229: mknod d2/d14/d1a/d1b/c46 0 2024-09-15T22:26:41.704 INFO:tasks.workunit.client.0.smithi001.stdout:1/303: mknod d3/dd/d3c/c5f 0 2024-09-15T22:26:41.705 INFO:tasks.workunit.client.0.smithi001.stdout:2/230: creat d2/d14/d1a/d20/f47 x:0 0 0 2024-09-15T22:26:41.707 INFO:tasks.workunit.client.0.smithi001.stdout:2/231: unlink d2/d14/d17/d1f/d21/fe 0 2024-09-15T22:26:41.711 INFO:tasks.workunit.client.0.smithi001.stdout:6/233: write d0/df/d24/d2e/f41 [3189026,47870] 0 2024-09-15T22:26:41.711 INFO:tasks.workunit.client.0.smithi001.stdout:6/234: truncate d0/d6/f4b 727793 0 2024-09-15T22:26:41.731 INFO:tasks.workunit.client.0.smithi001.stdout:8/213: dwrite f7 [0,4194304] 0 2024-09-15T22:26:41.733 INFO:tasks.workunit.client.0.smithi001.stdout:8/214: link d9/c28 d9/d2f/c36 0 2024-09-15T22:26:41.746 INFO:tasks.workunit.client.0.smithi001.stdout:1/304: read d3/f39 [44934,15157] 0 2024-09-15T22:26:41.746 INFO:tasks.workunit.client.0.smithi001.stdout:1/305: truncate d3/d12/f35 1085761 0 2024-09-15T22:26:41.746 INFO:tasks.workunit.client.0.smithi001.stdout:1/306: chown d3/dd/f33 35059 1 2024-09-15T22:26:41.748 INFO:tasks.workunit.client.0.smithi001.stdout:5/263: dwrite d3/d27/f46 [0,4194304] 0 2024-09-15T22:26:41.748 INFO:tasks.workunit.client.0.smithi001.stdout:8/215: dread d9/f11 [0,4194304] 0 2024-09-15T22:26:41.753 INFO:tasks.workunit.client.0.smithi001.stdout:6/235: write d0/d2f/f2b [1332284,13258] 0 2024-09-15T22:26:41.754 INFO:tasks.workunit.client.0.smithi001.stdout:1/307: creat d3/dd/d14/d23/d4b/f60 x:0 0 0 2024-09-15T22:26:41.756 INFO:tasks.workunit.client.0.smithi001.stdout:5/264: rename d3/d27/d3c to d3/d1d/d54/d56 0 2024-09-15T22:26:41.757 INFO:tasks.workunit.client.0.smithi001.stdout:6/236: symlink d0/df/d24/l51 0 2024-09-15T22:26:41.758 INFO:tasks.workunit.client.0.smithi001.stdout:1/308: creat d3/dd/d14/d1b/d2b/f61 x:0 0 0 2024-09-15T22:26:41.760 INFO:tasks.workunit.client.0.smithi001.stdout:5/265: mkdir d3/d6/d57 0 2024-09-15T22:26:41.760 INFO:tasks.workunit.client.0.smithi001.stdout:5/266: write d3/fc [5346409,35666] 0 2024-09-15T22:26:41.760 INFO:tasks.workunit.client.0.smithi001.stdout:5/267: chown d3/l11 104944364 1 2024-09-15T22:26:41.760 INFO:tasks.workunit.client.0.smithi001.stdout:5/268: stat d3/d6/c13 0 2024-09-15T22:26:41.760 INFO:tasks.workunit.client.0.smithi001.stdout:5/269: write d3/fc [3332152,49171] 0 2024-09-15T22:26:41.761 INFO:tasks.workunit.client.0.smithi001.stdout:6/237: link d0/df/l31 d0/df/d24/l52 0 2024-09-15T22:26:41.762 INFO:tasks.workunit.client.0.smithi001.stdout:1/309: symlink d3/dd/d14/d23/l62 0 2024-09-15T22:26:41.762 INFO:tasks.workunit.client.0.smithi001.stdout:1/310: fsync d3/dd/d14/d23/d4b/f52 0 2024-09-15T22:26:41.763 INFO:tasks.workunit.client.0.smithi001.stdout:6/238: unlink d0/df/d24/c3b 0 2024-09-15T22:26:41.763 INFO:tasks.workunit.client.0.smithi001.stdout:6/239: write d0/d6/f14 [1548076,48563] 0 2024-09-15T22:26:41.765 INFO:tasks.workunit.client.0.smithi001.stdout:7/234: dwrite d0/d7/d23/f29 [0,4194304] 0 2024-09-15T22:26:41.770 INFO:tasks.workunit.client.0.smithi001.stdout:1/311: unlink d3/d12/f1e 0 2024-09-15T22:26:41.770 INFO:tasks.workunit.client.0.smithi001.stdout:1/312: truncate d3/dd/d3c/d4c/f5c 243360 0 2024-09-15T22:26:41.778 INFO:tasks.workunit.client.0.smithi001.stdout:4/368: sync 2024-09-15T22:26:41.778 INFO:tasks.workunit.client.0.smithi001.stdout:9/253: sync 2024-09-15T22:26:41.779 INFO:tasks.workunit.client.0.smithi001.stdout:4/369: dread - d0/d27/d35/d61/d20/f8c zero size 2024-09-15T22:26:41.782 INFO:tasks.workunit.client.0.smithi001.stdout:9/254: creat d5/d3e/f52 x:0 0 0 2024-09-15T22:26:41.790 INFO:tasks.workunit.client.0.smithi001.stdout:0/234: dwrite d0/f7 [0,4194304] 0 2024-09-15T22:26:41.790 INFO:tasks.workunit.client.0.smithi001.stdout:0/235: readlink d0/d9/d1a/l3e 0 2024-09-15T22:26:41.794 INFO:tasks.workunit.client.0.smithi001.stdout:0/236: mknod d0/dd/d1b/c4b 0 2024-09-15T22:26:41.794 INFO:tasks.workunit.client.0.smithi001.stdout:0/237: dread - d0/d6/f30 zero size 2024-09-15T22:26:41.796 INFO:tasks.workunit.client.0.smithi001.stdout:0/238: rename d0/dd/d1b/l3d to d0/d9/d1a/d36/l4c 0 2024-09-15T22:26:41.801 INFO:tasks.workunit.client.0.smithi001.stdout:0/239: symlink d0/dd/d33/l4d 0 2024-09-15T22:26:41.806 INFO:tasks.workunit.client.0.smithi001.stdout:4/370: dread d0/d5d/d44/f88 [0,4194304] 0 2024-09-15T22:26:41.806 INFO:tasks.workunit.client.0.smithi001.stdout:4/371: read - d0/d27/d35/d61/d20/d29/d40/f85 zero size 2024-09-15T22:26:41.806 INFO:tasks.workunit.client.0.smithi001.stdout:1/313: dread d3/dd/f58 [0,4194304] 0 2024-09-15T22:26:41.806 INFO:tasks.workunit.client.0.smithi001.stdout:4/372: mknod d0/d27/d35/d59/c8f 0 2024-09-15T22:26:41.807 INFO:tasks.workunit.client.0.smithi001.stdout:1/314: getdents d3/d12 0 2024-09-15T22:26:41.809 INFO:tasks.workunit.client.0.smithi001.stdout:9/255: write d5/f11 [4098821,69472] 0 2024-09-15T22:26:41.810 INFO:tasks.workunit.client.0.smithi001.stdout:1/315: rename d3/dd/d14/f31 to d3/dd/d14/d1b/d2b/f63 0 2024-09-15T22:26:41.810 INFO:tasks.workunit.client.0.smithi001.stdout:1/316: fsync d3/d12/d21/f57 0 2024-09-15T22:26:41.814 INFO:tasks.workunit.client.0.smithi001.stdout:9/256: rename d5/de/d51/d4f to d5/de/d51/d53 0 2024-09-15T22:26:41.814 INFO:tasks.workunit.client.0.smithi001.stdout:9/257: write d5/de/d1a/d1b/d22/d2c/f17 [1653522,13263] 0 2024-09-15T22:26:41.814 INFO:tasks.workunit.client.0.smithi001.stdout:0/240: dread d0/d9/d1a/d36/f3a [0,4194304] 0 2024-09-15T22:26:41.814 INFO:tasks.workunit.client.0.smithi001.stdout:0/241: fdatasync d0/d6/f15 0 2024-09-15T22:26:41.815 INFO:tasks.workunit.client.0.smithi001.stdout:0/242: unlink d0/d6/f42 0 2024-09-15T22:26:41.816 INFO:tasks.workunit.client.0.smithi001.stdout:3/236: dwrite da/d3b/f32 [0,4194304] 0 2024-09-15T22:26:41.823 INFO:tasks.workunit.client.0.smithi001.stdout:8/216: dwrite f4 [0,4194304] 0 2024-09-15T22:26:41.824 INFO:tasks.workunit.client.0.smithi001.stdout:8/217: fdatasync d9/f21 0 2024-09-15T22:26:41.824 INFO:tasks.workunit.client.0.smithi001.stdout:8/218: fsync d9/d19/f1f 0 2024-09-15T22:26:41.824 INFO:tasks.workunit.client.0.smithi001.stdout:8/219: fdatasync d9/f18 0 2024-09-15T22:26:41.824 INFO:tasks.workunit.client.0.smithi001.stdout:8/220: write d9/f11 [725235,54203] 0 2024-09-15T22:26:41.824 INFO:tasks.workunit.client.0.smithi001.stdout:7/235: dwrite d0/d7/d21/f3d [0,4194304] 0 2024-09-15T22:26:41.824 INFO:tasks.workunit.client.0.smithi001.stdout:7/236: readlink d0/l1d 0 2024-09-15T22:26:41.824 INFO:tasks.workunit.client.0.smithi001.stdout:7/237: chown d0/d7/f19 24 1 2024-09-15T22:26:41.825 INFO:tasks.workunit.client.0.smithi001.stdout:7/238: creat d0/d7/f53 x:0 0 0 2024-09-15T22:26:41.827 INFO:tasks.workunit.client.0.smithi001.stdout:6/240: dwrite d0/f22 [0,4194304] 0 2024-09-15T22:26:41.829 INFO:tasks.workunit.client.0.smithi001.stdout:7/239: symlink d0/d7/d21/l54 0 2024-09-15T22:26:41.835 INFO:tasks.workunit.client.0.smithi001.stdout:4/373: dread d0/d27/d35/d61/d20/f63 [0,4194304] 0 2024-09-15T22:26:41.841 INFO:tasks.workunit.client.0.smithi001.stdout:0/243: write d0/d9/db/f19 [881072,119433] 0 2024-09-15T22:26:41.841 INFO:tasks.workunit.client.0.smithi001.stdout:0/244: truncate d0/f46 573655 0 2024-09-15T22:26:41.843 INFO:tasks.workunit.client.0.smithi001.stdout:3/237: dread da/d1f/f22 [0,4194304] 0 2024-09-15T22:26:41.843 INFO:tasks.workunit.client.0.smithi001.stdout:0/245: rename d0/f3 to d0/d9/db/f4e 0 2024-09-15T22:26:41.845 INFO:tasks.workunit.client.0.smithi001.stdout:1/317: dread d3/dd/d3c/f43 [0,4194304] 0 2024-09-15T22:26:41.845 INFO:tasks.workunit.client.0.smithi001.stdout:1/318: truncate d3/dd/d14/d1b/f2f 370656 0 2024-09-15T22:26:41.846 INFO:tasks.workunit.client.0.smithi001.stdout:1/319: mkdir d3/dd/d3c/d64 0 2024-09-15T22:26:41.848 INFO:tasks.workunit.client.0.smithi001.stdout:1/320: symlink d3/dd/d14/l65 0 2024-09-15T22:26:41.848 INFO:tasks.workunit.client.0.smithi001.stdout:1/321: stat d3/dd 0 2024-09-15T22:26:41.849 INFO:tasks.workunit.client.0.smithi001.stdout:1/322: symlink d3/dd/d14/d1b/l66 0 2024-09-15T22:26:41.850 INFO:tasks.workunit.client.0.smithi001.stdout:1/323: write d3/f11 [925894,18157] 0 2024-09-15T22:26:41.851 INFO:tasks.workunit.client.0.smithi001.stdout:1/324: truncate d3/dd/d3c/f43 2526887 0 2024-09-15T22:26:41.851 INFO:tasks.workunit.client.0.smithi001.stdout:1/325: chown d3/d12/d21/d48 0 1 2024-09-15T22:26:41.851 INFO:tasks.workunit.client.0.smithi001.stdout:1/326: dread - d3/dd/d14/d23/d4b/f60 zero size 2024-09-15T22:26:41.851 INFO:tasks.workunit.client.0.smithi001.stdout:1/327: truncate d3/dd/d14/d1b/d2b/f56 798623 0 2024-09-15T22:26:41.852 INFO:tasks.workunit.client.0.smithi001.stdout:1/328: symlink d3/dd/d14/d1b/l67 0 2024-09-15T22:26:41.854 INFO:tasks.workunit.client.0.smithi001.stdout:1/329: rename d3/d12/d21/d48 to d3/dd/d14/d1b/d2b/d68 0 2024-09-15T22:26:41.854 INFO:tasks.workunit.client.0.smithi001.stdout:7/240: dread d0/f2a [0,4194304] 0 2024-09-15T22:26:41.854 INFO:tasks.workunit.client.0.smithi001.stdout:7/241: readlink d0/d7/d44/d3f/l50 0 2024-09-15T22:26:41.854 INFO:tasks.workunit.client.0.smithi001.stdout:7/242: write d0/d7/f53 [244924,105276] 0 2024-09-15T22:26:41.855 INFO:tasks.workunit.client.0.smithi001.stdout:7/243: truncate d0/d7/f24 4136202 0 2024-09-15T22:26:41.856 INFO:tasks.workunit.client.0.smithi001.stdout:7/244: readlink d0/le 0 2024-09-15T22:26:41.857 INFO:tasks.workunit.client.0.smithi001.stdout:5/270: dwrite d3/f16 [0,4194304] 0 2024-09-15T22:26:41.857 INFO:tasks.workunit.client.0.smithi001.stdout:1/330: mkdir d3/dd/d69 0 2024-09-15T22:26:41.857 INFO:tasks.workunit.client.0.smithi001.stdout:5/271: write d3/f33 [798943,52601] 0 2024-09-15T22:26:41.858 INFO:tasks.workunit.client.0.smithi001.stdout:1/331: read - d3/dd/d3c/d4c/f4e zero size 2024-09-15T22:26:41.858 INFO:tasks.workunit.client.0.smithi001.stdout:5/272: truncate d3/d1d/d54/d56/f55 1045554 0 2024-09-15T22:26:41.858 INFO:tasks.workunit.client.0.smithi001.stdout:1/332: write d3/dd/d14/d23/d4b/f60 [715275,58421] 0 2024-09-15T22:26:41.858 INFO:tasks.workunit.client.0.smithi001.stdout:5/273: fsync d3/d6/d41/f4c 0 2024-09-15T22:26:41.858 INFO:tasks.workunit.client.0.smithi001.stdout:5/274: chown c1 3 1 2024-09-15T22:26:41.858 INFO:tasks.workunit.client.0.smithi001.stdout:7/245: creat d0/d7/d21/f55 x:0 0 0 2024-09-15T22:26:41.861 INFO:tasks.workunit.client.0.smithi001.stdout:1/333: chown d3/f39 309758 1 2024-09-15T22:26:41.862 INFO:tasks.workunit.client.0.smithi001.stdout:1/334: fsync d3/dd/f38 0 2024-09-15T22:26:41.863 INFO:tasks.workunit.client.0.smithi001.stdout:5/275: rename d3/d6/d41/f53 to d3/d27/d4e/f58 0 2024-09-15T22:26:41.863 INFO:tasks.workunit.client.0.smithi001.stdout:5/276: fdatasync d3/d6/f7 0 2024-09-15T22:26:41.863 INFO:tasks.workunit.client.0.smithi001.stdout:0/246: write d0/f46 [442526,9287] 0 2024-09-15T22:26:41.863 INFO:tasks.workunit.client.0.smithi001.stdout:5/277: dread - d3/d1d/d54/d56/f4b zero size 2024-09-15T22:26:41.863 INFO:tasks.workunit.client.0.smithi001.stdout:5/278: write d3/f33 [4332681,32477] 0 2024-09-15T22:26:41.864 INFO:tasks.workunit.client.0.smithi001.stdout:4/374: dread d0/d27/d35/d61/f22 [0,4194304] 0 2024-09-15T22:26:41.874 INFO:tasks.workunit.client.0.smithi001.stdout:1/335: rename d3/dd/d14/d23/d4b/f60 to d3/dd/d3c/d64/f6a 0 2024-09-15T22:26:41.874 INFO:tasks.workunit.client.0.smithi001.stdout:1/336: chown d3/dd/d14/d1b/d2b/c51 19 1 2024-09-15T22:26:41.875 INFO:tasks.workunit.client.0.smithi001.stdout:0/247: mknod d0/dd/c4f 0 2024-09-15T22:26:41.875 INFO:tasks.workunit.client.0.smithi001.stdout:4/375: creat d0/d27/d35/d61/d20/d29/d40/f90 x:0 0 0 2024-09-15T22:26:41.877 INFO:tasks.workunit.client.0.smithi001.stdout:1/337: rmdir d3/dd/d14/d1b/d2b 39 2024-09-15T22:26:41.879 INFO:tasks.workunit.client.0.smithi001.stdout:0/248: creat d0/f50 x:0 0 0 2024-09-15T22:26:41.880 INFO:tasks.workunit.client.0.smithi001.stdout:4/376: unlink d0/d27/d35/d61/d20/d29/d40/c6f 0 2024-09-15T22:26:41.880 INFO:tasks.workunit.client.0.smithi001.stdout:4/377: chown d0/d27/d35/d61/d20/d29/d34/f41 3626 1 2024-09-15T22:26:41.881 INFO:tasks.workunit.client.0.smithi001.stdout:1/338: getdents d3/dd/d14/d23 0 2024-09-15T22:26:41.881 INFO:tasks.workunit.client.0.smithi001.stdout:9/258: dwrite d5/de/d1a/d1b/d22/f4a [0,4194304] 0 2024-09-15T22:26:41.883 INFO:tasks.workunit.client.0.smithi001.stdout:3/238: dread da/d3b/f40 [0,4194304] 0 2024-09-15T22:26:41.883 INFO:tasks.workunit.client.0.smithi001.stdout:0/249: rmdir d0/dd/d1b 39 2024-09-15T22:26:41.884 INFO:tasks.workunit.client.0.smithi001.stdout:3/239: rename da/d3b/d1b/c1d to da/d1f/d2e/c51 0 2024-09-15T22:26:41.886 INFO:tasks.workunit.client.0.smithi001.stdout:1/339: write d3/dd/d3c/d4c/f5c [78361,35664] 0 2024-09-15T22:26:41.887 INFO:tasks.workunit.client.0.smithi001.stdout:5/279: dread d3/f16 [0,4194304] 0 2024-09-15T22:26:41.887 INFO:tasks.workunit.client.0.smithi001.stdout:5/280: chown d3/l21 3 1 2024-09-15T22:26:41.887 INFO:tasks.workunit.client.0.smithi001.stdout:0/250: unlink d0/c5 0 2024-09-15T22:26:41.887 INFO:tasks.workunit.client.0.smithi001.stdout:0/251: stat d0/f16 0 2024-09-15T22:26:41.887 INFO:tasks.workunit.client.0.smithi001.stdout:2/232: sync 2024-09-15T22:26:41.889 INFO:tasks.workunit.client.0.smithi001.stdout:2/233: link d2/d14/l33 d2/d14/d1a/d20/l48 0 2024-09-15T22:26:41.894 INFO:tasks.workunit.client.0.smithi001.stdout:2/234: symlink d2/d14/l49 0 2024-09-15T22:26:41.894 INFO:tasks.workunit.client.0.smithi001.stdout:2/235: fsync d2/d14/d1a/d20/f2a 0 2024-09-15T22:26:41.897 INFO:tasks.workunit.client.0.smithi001.stdout:4/378: dread d0/d27/d35/d61/f19 [0,4194304] 0 2024-09-15T22:26:41.897 INFO:tasks.workunit.client.0.smithi001.stdout:4/379: fdatasync d0/d27/d35/d61/d20/f38 0 2024-09-15T22:26:41.897 INFO:tasks.workunit.client.0.smithi001.stdout:4/380: fsync d0/d27/d35/d61/d20/d29/d40/f5a 0 2024-09-15T22:26:41.908 INFO:tasks.workunit.client.0.smithi001.stdout:3/240: dread da/f13 [0,4194304] 0 2024-09-15T22:26:41.917 INFO:tasks.workunit.client.0.smithi001.stdout:5/281: dread d3/d27/f46 [0,4194304] 0 2024-09-15T22:26:41.917 INFO:tasks.workunit.client.0.smithi001.stdout:9/259: write d5/de/d1a/d1b/d22/d2c/f31 [1813342,109021] 0 2024-09-15T22:26:41.917 INFO:tasks.workunit.client.0.smithi001.stdout:5/282: read - d3/d1d/d54/d56/f4b zero size 2024-09-15T22:26:41.922 INFO:tasks.workunit.client.0.smithi001.stdout:5/283: rmdir d3/d6/d25 39 2024-09-15T22:26:41.930 INFO:tasks.workunit.client.0.smithi001.stdout:5/284: rmdir d3/d1d 39 2024-09-15T22:26:41.930 INFO:tasks.workunit.client.0.smithi001.stdout:5/285: write d3/d27/d4e/f58 [859409,29008] 0 2024-09-15T22:26:41.930 INFO:tasks.workunit.client.0.smithi001.stdout:3/241: dread da/d1f/f3e [0,4194304] 0 2024-09-15T22:26:41.931 INFO:tasks.workunit.client.0.smithi001.stdout:3/242: link da/d3b/f3c da/d16/f52 0 2024-09-15T22:26:41.932 INFO:tasks.workunit.client.0.smithi001.stdout:3/243: mkdir da/d1f/d2e/d53 0 2024-09-15T22:26:41.955 INFO:tasks.workunit.client.0.smithi001.stdout:5/286: dread d3/d27/f2d [0,4194304] 0 2024-09-15T22:26:41.955 INFO:tasks.workunit.client.0.smithi001.stdout:5/287: write d3/d1d/d54/d56/f43 [667222,110739] 0 2024-09-15T22:26:41.955 INFO:tasks.workunit.client.0.smithi001.stdout:5/288: chown d3/d1d/l44 236777 1 2024-09-15T22:26:41.955 INFO:tasks.workunit.client.0.smithi001.stdout:0/252: dwrite d0/f7 [0,4194304] 0 2024-09-15T22:26:41.961 INFO:tasks.workunit.client.0.smithi001.stdout:1/340: dwrite d3/d12/d21/f57 [0,4194304] 0 2024-09-15T22:26:41.961 INFO:tasks.workunit.client.0.smithi001.stdout:4/381: dwrite d0/d27/d35/d61/f5b [0,4194304] 0 2024-09-15T22:26:41.961 INFO:tasks.workunit.client.0.smithi001.stdout:1/341: chown d3/dd/d14/f44 100328 1 2024-09-15T22:26:41.967 INFO:tasks.workunit.client.0.smithi001.stdout:7/246: dwrite d0/d7/d44/f20 [4194304,4194304] 0 2024-09-15T22:26:41.973 INFO:tasks.workunit.client.0.smithi001.stdout:4/382: getdents d0/d27/d35/d53 0 2024-09-15T22:26:41.974 INFO:tasks.workunit.client.0.smithi001.stdout:4/383: chown d0/f11 3 1 2024-09-15T22:26:41.976 INFO:tasks.workunit.client.0.smithi001.stdout:7/247: unlink d0/d7/d23/f38 0 2024-09-15T22:26:41.976 INFO:tasks.workunit.client.0.smithi001.stdout:7/248: write d0/d7/d21/d2b/d3e/f51 [614861,53984] 0 2024-09-15T22:26:41.976 INFO:tasks.workunit.client.0.smithi001.stdout:7/249: chown d0/d7/fd 2848902 1 2024-09-15T22:26:41.978 INFO:tasks.workunit.client.0.smithi001.stdout:4/384: unlink d0/d27/d35/d61/d20/f38 0 2024-09-15T22:26:41.978 INFO:tasks.workunit.client.0.smithi001.stdout:4/385: write d0/d27/d35/d61/f22 [3192403,28885] 0 2024-09-15T22:26:41.979 INFO:tasks.workunit.client.0.smithi001.stdout:7/250: symlink d0/l56 0 2024-09-15T22:26:41.979 INFO:tasks.workunit.client.0.smithi001.stdout:0/253: write d0/f7 [608508,27214] 0 2024-09-15T22:26:41.979 INFO:tasks.workunit.client.0.smithi001.stdout:0/254: write d0/d6/f30 [809849,73818] 0 2024-09-15T22:26:41.980 INFO:tasks.workunit.client.0.smithi001.stdout:7/251: truncate d0/d7/d21/d2b/f4a 2095348 0 2024-09-15T22:26:41.982 INFO:tasks.workunit.client.0.smithi001.stdout:0/255: mkdir d0/d51 0 2024-09-15T22:26:41.984 INFO:tasks.workunit.client.0.smithi001.stdout:7/252: symlink d0/d7/d44/d36/l57 0 2024-09-15T22:26:41.984 INFO:tasks.workunit.client.0.smithi001.stdout:7/253: stat d0/d7/d23/f2d 0 2024-09-15T22:26:41.986 INFO:tasks.workunit.client.0.smithi001.stdout:0/256: symlink d0/l52 0 2024-09-15T22:26:41.987 INFO:tasks.workunit.client.0.smithi001.stdout:0/257: symlink d0/dd/d33/l53 0 2024-09-15T22:26:41.988 INFO:tasks.workunit.client.0.smithi001.stdout:0/258: read d0/f8 [986164,20199] 0 2024-09-15T22:26:41.988 INFO:tasks.workunit.client.0.smithi001.stdout:0/259: chown d0/dd/f47 34 1 2024-09-15T22:26:41.989 INFO:tasks.workunit.client.0.smithi001.stdout:0/260: unlink d0/f8 0 2024-09-15T22:26:41.991 INFO:tasks.workunit.client.0.smithi001.stdout:7/254: mknod d0/d7/c58 0 2024-09-15T22:26:41.991 INFO:tasks.workunit.client.0.smithi001.stdout:7/255: stat d0/d7/l14 0 2024-09-15T22:26:41.992 INFO:tasks.workunit.client.0.smithi001.stdout:0/261: rename d0/d9/db/c14 to d0/d9/d1a/d36/c54 0 2024-09-15T22:26:41.995 INFO:tasks.workunit.client.0.smithi001.stdout:0/262: link d0/d9/d1a/d36/f41 d0/d9/d1a/d36/f55 0 2024-09-15T22:26:41.996 INFO:tasks.workunit.client.0.smithi001.stdout:0/263: creat d0/d9/f56 x:0 0 0 2024-09-15T22:26:42.019 INFO:tasks.workunit.client.0.smithi001.stdout:0/264: write d0/f2 [3326004,57429] 0 2024-09-15T22:26:42.020 INFO:tasks.workunit.client.0.smithi001.stdout:2/236: dwrite d2/d14/f2d [0,4194304] 0 2024-09-15T22:26:42.023 INFO:tasks.workunit.client.0.smithi001.stdout:1/342: dwrite d3/dd/d14/d23/d4b/f52 [4194304,4194304] 0 2024-09-15T22:26:42.023 INFO:tasks.workunit.client.0.smithi001.stdout:2/237: creat d2/d14/d1a/d20/f4a x:0 0 0 2024-09-15T22:26:42.025 INFO:tasks.workunit.client.0.smithi001.stdout:2/238: creat d2/d14/d17/d1f/f4b x:0 0 0 2024-09-15T22:26:42.025 INFO:tasks.workunit.client.0.smithi001.stdout:2/239: fsync d2/d14/f27 0 2024-09-15T22:26:42.028 INFO:tasks.workunit.client.0.smithi001.stdout:5/289: dwrite d3/d6/f8 [0,4194304] 0 2024-09-15T22:26:42.031 INFO:tasks.workunit.client.0.smithi001.stdout:5/290: creat d3/d6/f59 x:0 0 0 2024-09-15T22:26:42.032 INFO:tasks.workunit.client.0.smithi001.stdout:9/260: dwrite d5/de/d15/f30 [0,4194304] 0 2024-09-15T22:26:42.036 INFO:tasks.workunit.client.0.smithi001.stdout:5/291: mkdir d3/d6/d41/d4d/d5a 0 2024-09-15T22:26:42.048 INFO:tasks.workunit.client.0.smithi001.stdout:4/386: dwrite d0/d27/d35/d53/f8d [0,4194304] 0 2024-09-15T22:26:42.048 INFO:tasks.workunit.client.0.smithi001.stdout:2/240: dread d2/d14/d1a/d20/f13 [0,4194304] 0 2024-09-15T22:26:42.049 INFO:tasks.workunit.client.0.smithi001.stdout:6/241: sync 2024-09-15T22:26:42.049 INFO:tasks.workunit.client.0.smithi001.stdout:8/221: sync 2024-09-15T22:26:42.050 INFO:tasks.workunit.client.0.smithi001.stdout:5/292: getdents d3/d6 0 2024-09-15T22:26:42.053 INFO:tasks.workunit.client.0.smithi001.stdout:1/343: dread d3/f9 [4194304,4194304] 0 2024-09-15T22:26:42.056 INFO:tasks.workunit.client.0.smithi001.stdout:2/241: mkdir d2/d14/d17/d4c 0 2024-09-15T22:26:42.056 INFO:tasks.workunit.client.0.smithi001.stdout:2/242: chown d2/d14/f2d 5302321 1 2024-09-15T22:26:42.056 INFO:tasks.workunit.client.0.smithi001.stdout:6/242: mkdir d0/d2f/d53 0 2024-09-15T22:26:42.057 INFO:tasks.workunit.client.0.smithi001.stdout:1/344: link d3/dd/f55 d3/dd/d3c/d4c/f6b 0 2024-09-15T22:26:42.058 INFO:tasks.workunit.client.0.smithi001.stdout:6/243: creat d0/d2f/f54 x:0 0 0 2024-09-15T22:26:42.059 INFO:tasks.workunit.client.0.smithi001.stdout:1/345: creat d3/dd/d14/d1b/f6c x:0 0 0 2024-09-15T22:26:42.059 INFO:tasks.workunit.client.0.smithi001.stdout:1/346: dread - d3/dd/d14/d23/f4f zero size 2024-09-15T22:26:42.061 INFO:tasks.workunit.client.0.smithi001.stdout:1/347: truncate d3/dd/f58 788689 0 2024-09-15T22:26:42.061 INFO:tasks.workunit.client.0.smithi001.stdout:1/348: write d3/dd/f19 [1080301,129069] 0 2024-09-15T22:26:42.061 INFO:tasks.workunit.client.0.smithi001.stdout:1/349: chown d3/dd/d14/d1b/f30 15143246 1 2024-09-15T22:26:42.065 INFO:tasks.workunit.client.0.smithi001.stdout:8/222: dread d9/f27 [0,4194304] 0 2024-09-15T22:26:42.069 INFO:tasks.workunit.client.0.smithi001.stdout:8/223: write d9/f11 [375932,116864] 0 2024-09-15T22:26:42.073 INFO:tasks.workunit.client.0.smithi001.stdout:3/244: dwrite da/d3b/f32 [4194304,4194304] 0 2024-09-15T22:26:42.074 INFO:tasks.workunit.client.0.smithi001.stdout:6/244: write d0/f2 [4235431,107482] 0 2024-09-15T22:26:42.075 INFO:tasks.workunit.client.0.smithi001.stdout:8/224: link d9/c14 d9/d19/c37 0 2024-09-15T22:26:42.075 INFO:tasks.workunit.client.0.smithi001.stdout:3/245: creat da/d3d/d43/d41/f54 x:0 0 0 2024-09-15T22:26:42.076 INFO:tasks.workunit.client.0.smithi001.stdout:6/245: creat d0/df/f55 x:0 0 0 2024-09-15T22:26:42.076 INFO:tasks.workunit.client.0.smithi001.stdout:6/246: fsync d0/f33 0 2024-09-15T22:26:42.080 INFO:tasks.workunit.client.0.smithi001.stdout:8/225: truncate d9/d19/f2b 110106 0 2024-09-15T22:26:42.080 INFO:tasks.workunit.client.0.smithi001.stdout:8/226: write d9/f18 [2226819,117226] 0 2024-09-15T22:26:42.080 INFO:tasks.workunit.client.0.smithi001.stdout:3/246: creat da/d1f/d2e/f55 x:0 0 0 2024-09-15T22:26:42.080 INFO:tasks.workunit.client.0.smithi001.stdout:3/247: write da/d16/f30 [1497799,38031] 0 2024-09-15T22:26:42.080 INFO:tasks.workunit.client.0.smithi001.stdout:6/247: creat d0/df/d24/d49/f56 x:0 0 0 2024-09-15T22:26:42.080 INFO:tasks.workunit.client.0.smithi001.stdout:6/248: write d0/df/d24/f34 [1454942,6305] 0 2024-09-15T22:26:42.082 INFO:tasks.workunit.client.0.smithi001.stdout:3/248: truncate da/d3b/d1b/f2c 2734519 0 2024-09-15T22:26:42.083 INFO:tasks.workunit.client.0.smithi001.stdout:6/249: symlink d0/df/d24/l57 0 2024-09-15T22:26:42.083 INFO:tasks.workunit.client.0.smithi001.stdout:8/227: truncate f7 258463 0 2024-09-15T22:26:42.086 INFO:tasks.workunit.client.0.smithi001.stdout:3/249: rename da/c44 to da/d1f/d2e/d53/c56 0 2024-09-15T22:26:42.087 INFO:tasks.workunit.client.0.smithi001.stdout:8/228: truncate d9/f21 1452513 0 2024-09-15T22:26:42.091 INFO:tasks.workunit.client.0.smithi001.stdout:6/250: rmdir d0/df/d24 39 2024-09-15T22:26:42.093 INFO:tasks.workunit.client.0.smithi001.stdout:3/250: mknod da/d16/c57 0 2024-09-15T22:26:42.094 INFO:tasks.workunit.client.0.smithi001.stdout:8/229: mknod d9/d19/d29/d33/c38 0 2024-09-15T22:26:42.097 INFO:tasks.workunit.client.0.smithi001.stdout:6/251: rename d0/d2f/f37 to d0/df/d24/f58 0 2024-09-15T22:26:42.100 INFO:tasks.workunit.client.0.smithi001.stdout:3/251: getdents da/d3d/d43/d41 0 2024-09-15T22:26:42.100 INFO:tasks.workunit.client.0.smithi001.stdout:8/230: read d9/d19/f1f [459386,127095] 0 2024-09-15T22:26:42.100 INFO:tasks.workunit.client.0.smithi001.stdout:8/231: chown d9/fa 7 1 2024-09-15T22:26:42.104 INFO:tasks.workunit.client.0.smithi001.stdout:8/232: creat d9/d19/d29/d35/f39 x:0 0 0 2024-09-15T22:26:42.104 INFO:tasks.workunit.client.0.smithi001.stdout:3/252: mkdir da/d3b/d58 0 2024-09-15T22:26:42.105 INFO:tasks.workunit.client.0.smithi001.stdout:9/261: dwrite d5/f11 [0,4194304] 0 2024-09-15T22:26:42.105 INFO:tasks.workunit.client.0.smithi001.stdout:0/265: dwrite d0/d9/d1a/f28 [0,4194304] 0 2024-09-15T22:26:42.106 INFO:tasks.workunit.client.0.smithi001.stdout:8/233: getdents d9/d19/d29 0 2024-09-15T22:26:42.106 INFO:tasks.workunit.client.0.smithi001.stdout:3/253: mknod da/d1f/d2e/d3f/c59 0 2024-09-15T22:26:42.108 INFO:tasks.workunit.client.0.smithi001.stdout:9/262: mknod d5/c54 0 2024-09-15T22:26:42.108 INFO:tasks.workunit.client.0.smithi001.stdout:9/263: write d5/d3e/f52 [780378,125998] 0 2024-09-15T22:26:42.108 INFO:tasks.workunit.client.0.smithi001.stdout:9/264: chown d5/de/d1a/c2e 237806091 1 2024-09-15T22:26:42.108 INFO:tasks.workunit.client.0.smithi001.stdout:0/266: symlink d0/d9/d1a/d36/l57 0 2024-09-15T22:26:42.110 INFO:tasks.workunit.client.0.smithi001.stdout:8/234: unlink d9/c15 0 2024-09-15T22:26:42.111 INFO:tasks.workunit.client.0.smithi001.stdout:3/254: getdents da/d3d/d43 0 2024-09-15T22:26:42.112 INFO:tasks.workunit.client.0.smithi001.stdout:9/265: symlink d5/de/d1a/d1b/d22/d2c/d21/d23/l55 0 2024-09-15T22:26:42.113 INFO:tasks.workunit.client.0.smithi001.stdout:8/235: link d9/f11 d9/f3a 0 2024-09-15T22:26:42.113 INFO:tasks.workunit.client.0.smithi001.stdout:8/236: write d9/d19/d29/f2a [756318,76340] 0 2024-09-15T22:26:42.116 INFO:tasks.workunit.client.0.smithi001.stdout:3/255: creat da/d3d/d43/f5a x:0 0 0 2024-09-15T22:26:42.122 INFO:tasks.workunit.client.0.smithi001.stdout:6/252: write d0/df/f4d [1090316,74677] 0 2024-09-15T22:26:42.122 INFO:tasks.workunit.client.0.smithi001.stdout:6/253: write d0/f33 [1700433,72535] 0 2024-09-15T22:26:42.122 INFO:tasks.workunit.client.0.smithi001.stdout:5/293: read d3/f16 [1147530,66704] 0 2024-09-15T22:26:42.122 INFO:tasks.workunit.client.0.smithi001.stdout:5/294: write d3/f33 [6413682,28352] 0 2024-09-15T22:26:42.122 INFO:tasks.workunit.client.0.smithi001.stdout:5/295: stat d3/l11 0 2024-09-15T22:26:42.128 INFO:tasks.workunit.client.0.smithi001.stdout:9/266: rename d5/de/d1a/d38/f49 to d5/de/d1a/f56 0 2024-09-15T22:26:42.128 INFO:tasks.workunit.client.0.smithi001.stdout:8/237: rmdir d9/d19/d29/d33 39 2024-09-15T22:26:42.129 INFO:tasks.workunit.client.0.smithi001.stdout:3/256: symlink da/d16/l5b 0 2024-09-15T22:26:42.129 INFO:tasks.workunit.client.0.smithi001.stdout:3/257: readlink da/d16/l5b 0 2024-09-15T22:26:42.131 INFO:tasks.workunit.client.0.smithi001.stdout:2/243: dwrite d2/f3d [0,4194304] 0 2024-09-15T22:26:42.131 INFO:tasks.workunit.client.0.smithi001.stdout:2/244: fsync d2/d14/d1a/d1b/f22 0 2024-09-15T22:26:42.131 INFO:tasks.workunit.client.0.smithi001.stdout:4/387: dwrite d0/d27/d35/d61/d20/f63 [4194304,4194304] 0 2024-09-15T22:26:42.133 INFO:tasks.workunit.client.0.smithi001.stdout:2/245: rename d2/f3d to d2/d14/d1a/d1b/f4d 0 2024-09-15T22:26:42.134 INFO:tasks.workunit.client.0.smithi001.stdout:4/388: chown d0/l17 2331 1 2024-09-15T22:26:42.136 INFO:tasks.workunit.client.0.smithi001.stdout:3/258: fsync da/d3d/d43/f5a 0 2024-09-15T22:26:42.136 INFO:tasks.workunit.client.0.smithi001.stdout:3/259: fdatasync da/d1f/f28 0 2024-09-15T22:26:42.136 INFO:tasks.workunit.client.0.smithi001.stdout:3/260: chown da/d3b/f33 34110 1 2024-09-15T22:26:42.139 INFO:tasks.workunit.client.0.smithi001.stdout:5/296: dread d3/d1d/d54/d56/f4a [0,4194304] 0 2024-09-15T22:26:42.142 INFO:tasks.workunit.client.0.smithi001.stdout:1/350: dwrite d3/f42 [0,4194304] 0 2024-09-15T22:26:42.142 INFO:tasks.workunit.client.0.smithi001.stdout:1/351: dread - d3/dd/d14/d1b/f6c zero size 2024-09-15T22:26:42.146 INFO:tasks.workunit.client.0.smithi001.stdout:6/254: write d0/d6/f14 [318335,7472] 0 2024-09-15T22:26:42.146 INFO:tasks.workunit.client.0.smithi001.stdout:6/255: write d0/df/d24/d2e/d43/f4a [1801826,120601] 0 2024-09-15T22:26:42.146 INFO:tasks.workunit.client.0.smithi001.stdout:6/256: dread - d0/d2f/f54 zero size 2024-09-15T22:26:42.146 INFO:tasks.workunit.client.0.smithi001.stdout:6/257: chown d0/df/f55 40031124 1 2024-09-15T22:26:42.149 INFO:tasks.workunit.client.0.smithi001.stdout:3/261: rename da/d1f/d46/f4a to da/d1f/f5c 0 2024-09-15T22:26:42.151 INFO:tasks.workunit.client.0.smithi001.stdout:4/389: dread d0/d27/d35/d61/d20/f25 [0,4194304] 0 2024-09-15T22:26:42.154 INFO:tasks.workunit.client.0.smithi001.stdout:9/267: write d5/de/f18 [2637930,121522] 0 2024-09-15T22:26:42.158 INFO:tasks.workunit.client.0.smithi001.stdout:0/267: dwrite d0/d9/f39 [0,4194304] 0 2024-09-15T22:26:42.159 INFO:tasks.workunit.client.0.smithi001.stdout:5/297: unlink d3/d6/c13 0 2024-09-15T22:26:42.159 INFO:tasks.workunit.client.0.smithi001.stdout:2/246: write d2/d14/d1a/d1b/f4d [358823,56426] 0 2024-09-15T22:26:42.159 INFO:tasks.workunit.client.0.smithi001.stdout:2/247: chown d2/d14/d1a/d20/f19 237 1 2024-09-15T22:26:42.159 INFO:tasks.workunit.client.0.smithi001.stdout:1/352: creat d3/dd/d14/d1b/f6d x:0 0 0 2024-09-15T22:26:42.160 INFO:tasks.workunit.client.0.smithi001.stdout:1/353: write d3/dd/d14/d1b/f6d [923554,88630] 0 2024-09-15T22:26:42.160 INFO:tasks.workunit.client.0.smithi001.stdout:6/258: rename d0/df/d24/d2e/d43/d30/f4f to d0/df/d24/d2e/d43/f59 0 2024-09-15T22:26:42.162 INFO:tasks.workunit.client.0.smithi001.stdout:4/390: getdents d0/d27/d35/d61/d20/d29/d34/d3a 0 2024-09-15T22:26:42.162 INFO:tasks.workunit.client.0.smithi001.stdout:4/391: stat d0/d27/d35/d61/d20/d29/d34/d84 0 2024-09-15T22:26:42.162 INFO:tasks.workunit.client.0.smithi001.stdout:9/268: mknod d5/de/d1a/c57 0 2024-09-15T22:26:42.164 INFO:tasks.workunit.client.0.smithi001.stdout:0/268: creat d0/d9/d1a/f58 x:0 0 0 2024-09-15T22:26:42.167 INFO:tasks.workunit.client.0.smithi001.stdout:5/298: link d3/d6/l18 d3/d6/d41/d4d/d5a/l5b 0 2024-09-15T22:26:42.168 INFO:tasks.workunit.client.0.smithi001.stdout:2/248: creat d2/d14/d17/f4e x:0 0 0 2024-09-15T22:26:42.172 INFO:tasks.workunit.client.0.smithi001.stdout:7/256: sync 2024-09-15T22:26:42.173 INFO:tasks.workunit.client.0.smithi001.stdout:4/392: mknod d0/d27/d35/d61/d20/d29/d34/d3a/c91 0 2024-09-15T22:26:42.173 INFO:tasks.workunit.client.0.smithi001.stdout:6/259: dread d0/df/d24/f34 [0,4194304] 0 2024-09-15T22:26:42.173 INFO:tasks.workunit.client.0.smithi001.stdout:6/260: readlink d0/d6/l1e 0 2024-09-15T22:26:42.173 INFO:tasks.workunit.client.0.smithi001.stdout:6/261: chown d0/df/d24/d2e/f41 27383593 1 2024-09-15T22:26:42.173 INFO:tasks.workunit.client.0.smithi001.stdout:9/269: symlink d5/de/d1a/d1b/d22/d2c/d21/d4d/l58 0 2024-09-15T22:26:42.173 INFO:tasks.workunit.client.0.smithi001.stdout:9/270: chown d5/de/d1a/d1b/d22/d2c/d21/d23/d3d 3567469 1 2024-09-15T22:26:42.173 INFO:tasks.workunit.client.0.smithi001.stdout:0/269: mknod d0/d6/c59 0 2024-09-15T22:26:42.174 INFO:tasks.workunit.client.0.smithi001.stdout:5/299: mkdir d3/d27/d5c 0 2024-09-15T22:26:42.175 INFO:tasks.workunit.client.0.smithi001.stdout:1/354: link d3/dd/d14/d23/l4a d3/l6e 0 2024-09-15T22:26:42.176 INFO:tasks.workunit.client.0.smithi001.stdout:4/393: creat d0/d27/d35/d61/d20/d29/f92 x:0 0 0 2024-09-15T22:26:42.180 INFO:tasks.workunit.client.0.smithi001.stdout:9/271: getdents d5/de/d1a/d1b/d22/d2c/d21 0 2024-09-15T22:26:42.182 INFO:tasks.workunit.client.0.smithi001.stdout:6/262: mknod d0/df/d24/d2e/c5a 0 2024-09-15T22:26:42.182 INFO:tasks.workunit.client.0.smithi001.stdout:1/355: mkdir d3/dd/d14/d23/d4b/d6f 0 2024-09-15T22:26:42.187 INFO:tasks.workunit.client.0.smithi001.stdout:6/263: rename d0/df/l31 to d0/df/d24/l5b 0 2024-09-15T22:26:42.188 INFO:tasks.workunit.client.0.smithi001.stdout:1/356: creat d3/dd/d14/d23/d4b/f70 x:0 0 0 2024-09-15T22:26:42.189 INFO:tasks.workunit.client.0.smithi001.stdout:6/264: symlink d0/df/l5c 0 2024-09-15T22:26:42.190 INFO:tasks.workunit.client.0.smithi001.stdout:6/265: mkdir d0/d6/d5d 0 2024-09-15T22:26:42.192 INFO:tasks.workunit.client.0.smithi001.stdout:8/238: dwrite d9/d2f/f30 [0,4194304] 0 2024-09-15T22:26:42.193 INFO:tasks.workunit.client.0.smithi001.stdout:7/257: read d0/f2a [3970622,119903] 0 2024-09-15T22:26:42.193 INFO:tasks.workunit.client.0.smithi001.stdout:7/258: chown d0/d7/d21 43 1 2024-09-15T22:26:42.193 INFO:tasks.workunit.client.0.smithi001.stdout:7/259: getdents d0/d7/d44 0 2024-09-15T22:26:42.195 INFO:tasks.workunit.client.0.smithi001.stdout:3/262: dwrite f8 [0,4194304] 0 2024-09-15T22:26:42.199 INFO:tasks.workunit.client.0.smithi001.stdout:6/266: rename d0/d2f/fe to d0/df/d24/d49/f5e 0 2024-09-15T22:26:42.203 INFO:tasks.workunit.client.0.smithi001.stdout:5/300: dread d3/d6/d25/f2c [0,4194304] 0 2024-09-15T22:26:42.215 INFO:tasks.workunit.client.0.smithi001.stdout:8/239: mknod d9/c3b 0 2024-09-15T22:26:42.215 INFO:tasks.workunit.client.0.smithi001.stdout:7/260: rename d0/d7/fd to d0/d7/d44/d3f/d49/f59 0 2024-09-15T22:26:42.215 INFO:tasks.workunit.client.0.smithi001.stdout:8/240: write d9/d19/f2b [285549,74282] 0 2024-09-15T22:26:42.215 INFO:tasks.workunit.client.0.smithi001.stdout:6/267: getdents d0/df 0 2024-09-15T22:26:42.215 INFO:tasks.workunit.client.0.smithi001.stdout:6/268: truncate d0/f4 8941642 0 2024-09-15T22:26:42.218 INFO:tasks.workunit.client.0.smithi001.stdout:7/261: rename d0/d7/f17 to d0/d7/d44/d36/f5a 0 2024-09-15T22:26:42.218 INFO:tasks.workunit.client.0.smithi001.stdout:7/262: read d0/d7/d44/f20 [1758449,128794] 0 2024-09-15T22:26:42.219 INFO:tasks.workunit.client.0.smithi001.stdout:7/263: link d0/d7/d21/f3a d0/d7/d44/f5b 0 2024-09-15T22:26:42.219 INFO:tasks.workunit.client.0.smithi001.stdout:7/264: chown d0/d7/d44/l31 647672 1 2024-09-15T22:26:42.220 INFO:tasks.workunit.client.0.smithi001.stdout:7/265: fdatasync d0/d7/d44/d36/f5a 0 2024-09-15T22:26:42.238 INFO:tasks.workunit.client.0.smithi001.stdout:5/301: dread d3/d27/f46 [0,4194304] 0 2024-09-15T22:26:42.239 INFO:tasks.workunit.client.0.smithi001.stdout:7/266: write d0/d7/d44/f20 [4698919,31625] 0 2024-09-15T22:26:42.241 INFO:tasks.workunit.client.0.smithi001.stdout:7/267: rename d0/d7/d44/f20 to d0/f5c 0 2024-09-15T22:26:42.245 INFO:tasks.workunit.client.0.smithi001.stdout:4/394: dwrite d0/d27/d35/d61/d20/d29/d34/d3a/f8a [0,4194304] 0 2024-09-15T22:26:42.248 INFO:tasks.workunit.client.0.smithi001.stdout:4/395: rename d0/d27/d35/d61/d20/d29/d34/d3a/c91 to d0/d5d/c93 0 2024-09-15T22:26:42.251 INFO:tasks.workunit.client.0.smithi001.stdout:4/396: mkdir d0/d27/d94 0 2024-09-15T22:26:42.259 INFO:tasks.workunit.client.0.smithi001.stdout:5/302: write d3/d6/d25/f38 [1826969,79843] 0 2024-09-15T22:26:42.261 INFO:tasks.workunit.client.0.smithi001.stdout:5/303: truncate d3/d6/d25/f2c 1327686 0 2024-09-15T22:26:42.261 INFO:tasks.workunit.client.0.smithi001.stdout:4/397: dread d0/d27/d35/d61/f23 [0,4194304] 0 2024-09-15T22:26:42.265 INFO:tasks.workunit.client.0.smithi001.stdout:3/263: dread da/d3b/f40 [4194304,4194304] 0 2024-09-15T22:26:42.266 INFO:tasks.workunit.client.0.smithi001.stdout:4/398: rename d0/d27/d35/d53/d54 to d0/d27/d35/d61/d20/d29/d34/d84/d95 0 2024-09-15T22:26:42.268 INFO:tasks.workunit.client.0.smithi001.stdout:4/399: unlink d0/d5d/d44/f88 0 2024-09-15T22:26:42.272 INFO:tasks.workunit.client.0.smithi001.stdout:4/400: getdents d0/d5d 0 2024-09-15T22:26:42.272 INFO:tasks.workunit.client.0.smithi001.stdout:4/401: write d0/d27/d35/d61/d20/d29/d34/f52 [391298,83908] 0 2024-09-15T22:26:42.274 INFO:tasks.workunit.client.0.smithi001.stdout:4/402: mknod d0/d5d/c96 0 2024-09-15T22:26:42.275 INFO:tasks.workunit.client.0.smithi001.stdout:4/403: symlink d0/d5d/d44/d65/d6a/l97 0 2024-09-15T22:26:42.275 INFO:tasks.workunit.client.0.smithi001.stdout:4/404: dread - d0/d5d/d44/d65/d6a/f6e zero size 2024-09-15T22:26:42.276 INFO:tasks.workunit.client.0.smithi001.stdout:4/405: write d0/d27/d35/d61/d20/d29/d34/f62 [714819,125987] 0 2024-09-15T22:26:42.277 INFO:tasks.workunit.client.0.smithi001.stdout:1/357: dwrite d3/f9 [4194304,4194304] 0 2024-09-15T22:26:42.286 INFO:tasks.workunit.client.0.smithi001.stdout:8/241: dwrite f4 [0,4194304] 0 2024-09-15T22:26:42.289 INFO:tasks.workunit.client.0.smithi001.stdout:5/304: write d3/d6/f8 [260754,65844] 0 2024-09-15T22:26:42.289 INFO:tasks.workunit.client.0.smithi001.stdout:5/305: stat d3 0 2024-09-15T22:26:42.289 INFO:tasks.workunit.client.0.smithi001.stdout:6/269: dread d0/df/d24/d2e/f41 [0,4194304] 0 2024-09-15T22:26:42.289 INFO:tasks.workunit.client.0.smithi001.stdout:6/270: readlink d0/d6/l15 0 2024-09-15T22:26:42.289 INFO:tasks.workunit.client.0.smithi001.stdout:9/272: dwrite d5/de/d1a/d1b/d22/d2c/d21/d24/f4c [0,4194304] 0 2024-09-15T22:26:42.293 INFO:tasks.workunit.client.0.smithi001.stdout:6/271: mknod d0/c5f 0 2024-09-15T22:26:42.294 INFO:tasks.workunit.client.0.smithi001.stdout:6/272: rmdir d0/df/d24/d2e/d43 39 2024-09-15T22:26:42.294 INFO:tasks.workunit.client.0.smithi001.stdout:6/273: chown d0/df/l28 47580023 1 2024-09-15T22:26:42.297 INFO:tasks.workunit.client.0.smithi001.stdout:7/268: dwrite d0/d7/d44/f5b [0,4194304] 0 2024-09-15T22:26:42.300 INFO:tasks.workunit.client.0.smithi001.stdout:0/270: sync 2024-09-15T22:26:42.300 INFO:tasks.workunit.client.0.smithi001.stdout:0/271: chown d0/d6/f15 7619 1 2024-09-15T22:26:42.300 INFO:tasks.workunit.client.0.smithi001.stdout:2/249: sync 2024-09-15T22:26:42.300 INFO:tasks.workunit.client.0.smithi001.stdout:0/272: fdatasync d0/d9/f39 0 2024-09-15T22:26:42.300 INFO:tasks.workunit.client.0.smithi001.stdout:0/273: dread - d0/d9/f38 zero size 2024-09-15T22:26:42.301 INFO:tasks.workunit.client.0.smithi001.stdout:0/274: dread - d0/d9/f38 zero size 2024-09-15T22:26:42.301 INFO:tasks.workunit.client.0.smithi001.stdout:2/250: fsync d2/d14/d1a/d20/f2a 0 2024-09-15T22:26:42.301 INFO:tasks.workunit.client.0.smithi001.stdout:2/251: dread - d2/d14/d17/f4e zero size 2024-09-15T22:26:42.301 INFO:tasks.workunit.client.0.smithi001.stdout:0/275: mknod d0/d9/db/c5a 0 2024-09-15T22:26:42.302 INFO:tasks.workunit.client.0.smithi001.stdout:2/252: symlink d2/d14/d1a/d1b/l4f 0 2024-09-15T22:26:42.304 INFO:tasks.workunit.client.0.smithi001.stdout:0/276: unlink d0/l1f 0 2024-09-15T22:26:42.310 INFO:tasks.workunit.client.0.smithi001.stdout:0/277: getdents d0/d9/db 0 2024-09-15T22:26:42.314 INFO:tasks.workunit.client.0.smithi001.stdout:7/269: dread d0/d7/f19 [0,4194304] 0 2024-09-15T22:26:42.315 INFO:tasks.workunit.client.0.smithi001.stdout:7/270: creat d0/d7/f5d x:0 0 0 2024-09-15T22:26:42.316 INFO:tasks.workunit.client.0.smithi001.stdout:7/271: symlink d0/d7/d44/d3f/d49/d4f/l5e 0 2024-09-15T22:26:42.317 INFO:tasks.workunit.client.0.smithi001.stdout:0/278: dread d0/f46 [0,4194304] 0 2024-09-15T22:26:42.317 INFO:tasks.workunit.client.0.smithi001.stdout:0/279: fsync d0/f16 0 2024-09-15T22:26:42.317 INFO:tasks.workunit.client.0.smithi001.stdout:0/280: write d0/dd/ff [1724910,66758] 0 2024-09-15T22:26:42.320 INFO:tasks.workunit.client.0.smithi001.stdout:7/272: mknod d0/d7/d21/d2b/d3e/c5f 0 2024-09-15T22:26:42.325 INFO:tasks.workunit.client.0.smithi001.stdout:7/273: mkdir d0/d7/d2e/d60 0 2024-09-15T22:26:42.325 INFO:tasks.workunit.client.0.smithi001.stdout:5/306: write d3/d27/f2d [861651,89768] 0 2024-09-15T22:26:42.325 INFO:tasks.workunit.client.0.smithi001.stdout:6/274: dread d0/df/d24/d2e/d43/f4a [0,4194304] 0 2024-09-15T22:26:42.325 INFO:tasks.workunit.client.0.smithi001.stdout:5/307: chown d3/d1d/d54/d56/f43 191267286 1 2024-09-15T22:26:42.326 INFO:tasks.workunit.client.0.smithi001.stdout:5/308: read d3/d6/f7 [3583921,26263] 0 2024-09-15T22:26:42.327 INFO:tasks.workunit.client.0.smithi001.stdout:5/309: rename d3/l11 to d3/d1d/d54/l5d 0 2024-09-15T22:26:42.341 INFO:tasks.workunit.client.0.smithi001.stdout:7/274: dread d0/d7/d44/f28 [0,4194304] 0 2024-09-15T22:26:42.343 INFO:tasks.workunit.client.0.smithi001.stdout:4/406: dwrite d0/d27/d35/d61/d20/f4f [0,4194304] 0 2024-09-15T22:26:42.347 INFO:tasks.workunit.client.0.smithi001.stdout:7/275: truncate d0/d7/d44/f11 6846372 0 2024-09-15T22:26:42.347 INFO:tasks.workunit.client.0.smithi001.stdout:7/276: stat d0/d7/d21/d2b/d3e/l43 0 2024-09-15T22:26:42.357 INFO:tasks.workunit.client.0.smithi001.stdout:0/281: dwrite d0/d9/f56 [0,4194304] 0 2024-09-15T22:26:42.377 INFO:tasks.workunit.client.0.smithi001.stdout:0/282: write d0/d9/f1c [3565660,104945] 0 2024-09-15T22:26:42.377 INFO:tasks.workunit.client.0.smithi001.stdout:0/283: readlink d0/l52 0 2024-09-15T22:26:42.377 INFO:tasks.workunit.client.0.smithi001.stdout:9/273: dwrite d5/f44 [0,4194304] 0 2024-09-15T22:26:42.377 INFO:tasks.workunit.client.0.smithi001.stdout:9/274: write d5/de/d1a/d1b/d22/f4a [2289300,120683] 0 2024-09-15T22:26:42.379 INFO:tasks.workunit.client.0.smithi001.stdout:5/310: read d3/d27/f42 [4177757,113977] 0 2024-09-15T22:26:42.381 INFO:tasks.workunit.client.0.smithi001.stdout:7/277: write d0/f2f [245045,103943] 0 2024-09-15T22:26:42.382 INFO:tasks.workunit.client.0.smithi001.stdout:0/284: creat d0/dd/d33/f5b x:0 0 0 2024-09-15T22:26:42.383 INFO:tasks.workunit.client.0.smithi001.stdout:5/311: truncate d3/d6/d25/f38 3094286 0 2024-09-15T22:26:42.384 INFO:tasks.workunit.client.0.smithi001.stdout:5/312: creat d3/d6/d41/f5e x:0 0 0 2024-09-15T22:26:42.386 INFO:tasks.workunit.client.0.smithi001.stdout:5/313: rename d3/l3b to d3/d27/d5c/l5f 0 2024-09-15T22:26:42.392 INFO:tasks.workunit.client.0.smithi001.stdout:2/253: dwrite d2/d14/d1a/d1b/f4d [0,4194304] 0 2024-09-15T22:26:42.392 INFO:tasks.workunit.client.0.smithi001.stdout:0/285: dread d0/dd/f29 [0,4194304] 0 2024-09-15T22:26:42.397 INFO:tasks.workunit.client.0.smithi001.stdout:0/286: rename d0/dd/d1b/c35 to d0/dd/c5c 0 2024-09-15T22:26:42.399 INFO:tasks.workunit.client.0.smithi001.stdout:9/275: write d5/de/d1a/d1b/d22/d2c/d21/f25 [2746926,24910] 0 2024-09-15T22:26:42.399 INFO:tasks.workunit.client.0.smithi001.stdout:9/276: chown d5/de/d1a/d1b/d22/d2c/cf 207 1 2024-09-15T22:26:42.399 INFO:tasks.workunit.client.0.smithi001.stdout:9/277: chown d5/c54 5 1 2024-09-15T22:26:42.399 INFO:tasks.workunit.client.0.smithi001.stdout:6/275: dwrite d0/f5 [0,4194304] 0 2024-09-15T22:26:42.400 INFO:tasks.workunit.client.0.smithi001.stdout:6/276: write d0/d6/f4b [1240145,75672] 0 2024-09-15T22:26:42.401 INFO:tasks.workunit.client.0.smithi001.stdout:6/277: rename d0/f48 to d0/d2f/f60 0 2024-09-15T22:26:42.403 INFO:tasks.workunit.client.0.smithi001.stdout:6/278: unlink d0/d6/f14 0 2024-09-15T22:26:42.403 INFO:tasks.workunit.client.0.smithi001.stdout:6/279: write d0/f33 [2177665,97348] 0 2024-09-15T22:26:42.419 INFO:tasks.workunit.client.0.smithi001.stdout:0/287: dread d0/dd/f29 [0,4194304] 0 2024-09-15T22:26:42.419 INFO:tasks.workunit.client.0.smithi001.stdout:0/288: chown d0/d9/d1a/l44 15557877 1 2024-09-15T22:26:42.419 INFO:tasks.workunit.client.0.smithi001.stdout:0/289: write d0/dd/f29 [2059620,32532] 0 2024-09-15T22:26:42.419 INFO:tasks.workunit.client.0.smithi001.stdout:0/290: dread - d0/dd/f47 zero size 2024-09-15T22:26:42.419 INFO:tasks.workunit.client.0.smithi001.stdout:0/291: readlink d0/l52 0 2024-09-15T22:26:42.425 INFO:tasks.workunit.client.0.smithi001.stdout:3/264: sync 2024-09-15T22:26:42.427 INFO:tasks.workunit.client.0.smithi001.stdout:3/265: rename da/d16/f48 to da/d3b/d58/f5d 0 2024-09-15T22:26:42.429 INFO:tasks.workunit.client.0.smithi001.stdout:3/266: creat da/d3d/d43/d41/f5e x:0 0 0 2024-09-15T22:26:42.429 INFO:tasks.workunit.client.0.smithi001.stdout:3/267: read - da/d3d/d43/f5a zero size 2024-09-15T22:26:42.429 INFO:tasks.workunit.client.0.smithi001.stdout:3/268: creat da/d1f/d2e/f5f x:0 0 0 2024-09-15T22:26:42.432 INFO:tasks.workunit.client.0.smithi001.stdout:3/269: link da/d16/f4b da/d3b/d1b/f60 0 2024-09-15T22:26:42.433 INFO:tasks.workunit.client.0.smithi001.stdout:3/270: link da/fe da/f61 0 2024-09-15T22:26:42.433 INFO:tasks.workunit.client.0.smithi001.stdout:3/271: chown da/d1f/d2e 21783 1 2024-09-15T22:26:42.441 INFO:tasks.workunit.client.0.smithi001.stdout:3/272: read da/d1f/f3e [1058952,90172] 0 2024-09-15T22:26:42.446 INFO:tasks.workunit.client.0.smithi001.stdout:0/292: write d0/d9/f26 [1802727,38712] 0 2024-09-15T22:26:42.446 INFO:tasks.workunit.client.0.smithi001.stdout:0/293: dread - d0/d9/db/f25 zero size 2024-09-15T22:26:42.452 INFO:tasks.workunit.client.0.smithi001.stdout:2/254: dwrite d2/d14/f15 [0,4194304] 0 2024-09-15T22:26:42.457 INFO:tasks.workunit.client.0.smithi001.stdout:2/255: rename d2/d14/d17/d1f/c29 to d2/d14/d1a/d20/c50 0 2024-09-15T22:26:42.458 INFO:tasks.workunit.client.0.smithi001.stdout:2/256: readlink d2/d14/d17/l3e 0 2024-09-15T22:26:42.458 INFO:tasks.workunit.client.0.smithi001.stdout:2/257: write d2/d14/d17/d1f/f25 [758189,124021] 0 2024-09-15T22:26:42.458 INFO:tasks.workunit.client.0.smithi001.stdout:2/258: stat d2/d14/d1a/c44 0 2024-09-15T22:26:42.464 INFO:tasks.workunit.client.0.smithi001.stdout:0/294: dread d0/d9/f26 [0,4194304] 0 2024-09-15T22:26:42.475 INFO:tasks.workunit.client.0.smithi001.stdout:9/278: write d5/f44 [3412114,22285] 0 2024-09-15T22:26:42.481 INFO:tasks.workunit.client.0.smithi001.stdout:6/280: dwrite d0/df/d24/d2e/f41 [4194304,4194304] 0 2024-09-15T22:26:42.481 INFO:tasks.workunit.client.0.smithi001.stdout:6/281: dread - d0/df/d24/f2c zero size 2024-09-15T22:26:42.481 INFO:tasks.workunit.client.0.smithi001.stdout:6/282: readlink d0/df/d24/d2e/d43/l35 0 2024-09-15T22:26:42.488 INFO:tasks.workunit.client.0.smithi001.stdout:5/314: dwrite d3/d1d/d54/d56/f4b [0,4194304] 0 2024-09-15T22:26:42.490 INFO:tasks.workunit.client.0.smithi001.stdout:3/273: dwrite da/f31 [0,4194304] 0 2024-09-15T22:26:42.490 INFO:tasks.workunit.client.0.smithi001.stdout:5/315: symlink d3/d49/l60 0 2024-09-15T22:26:42.493 INFO:tasks.workunit.client.0.smithi001.stdout:3/274: getdents da 0 2024-09-15T22:26:42.493 INFO:tasks.workunit.client.0.smithi001.stdout:3/275: chown da/d3d/d43/f5a 33 1 2024-09-15T22:26:42.493 INFO:tasks.workunit.client.0.smithi001.stdout:3/276: truncate da/d3b/d58/f5d 17514 0 2024-09-15T22:26:42.494 INFO:tasks.workunit.client.0.smithi001.stdout:3/277: fsync da/d3d/d43/f2a 0 2024-09-15T22:26:42.496 INFO:tasks.workunit.client.0.smithi001.stdout:3/278: write da/d3b/f3c [4884008,111625] 0 2024-09-15T22:26:42.497 INFO:tasks.workunit.client.0.smithi001.stdout:3/279: chown da/d3b/d1b/l50 2335 1 2024-09-15T22:26:42.497 INFO:tasks.workunit.client.0.smithi001.stdout:3/280: fdatasync da/d1f/f5c 0 2024-09-15T22:26:42.521 INFO:tasks.workunit.client.0.smithi001.stdout:2/259: dwrite d2/d14/d17/f2c [4194304,4194304] 0 2024-09-15T22:26:42.540 INFO:tasks.workunit.client.0.smithi001.stdout:0/295: dwrite d0/f46 [0,4194304] 0 2024-09-15T22:26:42.540 INFO:tasks.workunit.client.0.smithi001.stdout:5/316: dwrite d3/d6/d41/f5e [0,4194304] 0 2024-09-15T22:26:42.541 INFO:tasks.workunit.client.0.smithi001.stdout:5/317: truncate d3/d6/f59 285257 0 2024-09-15T22:26:42.543 INFO:tasks.workunit.client.0.smithi001.stdout:1/358: sync 2024-09-15T22:26:42.543 INFO:tasks.workunit.client.0.smithi001.stdout:1/359: write d3/dd/d14/d23/f4f [96202,36457] 0 2024-09-15T22:26:42.543 INFO:tasks.workunit.client.0.smithi001.stdout:8/242: sync 2024-09-15T22:26:42.547 INFO:tasks.workunit.client.0.smithi001.stdout:0/296: mkdir d0/d9/db/d5d 0 2024-09-15T22:26:42.547 INFO:tasks.workunit.client.0.smithi001.stdout:0/297: write d0/d9/db/f10 [4528569,23789] 0 2024-09-15T22:26:42.547 INFO:tasks.workunit.client.0.smithi001.stdout:0/298: write d0/dd/d33/f5b [896789,86245] 0 2024-09-15T22:26:42.547 INFO:tasks.workunit.client.0.smithi001.stdout:1/360: symlink d3/dd/d14/d1b/d2b/d68/l71 0 2024-09-15T22:26:42.547 INFO:tasks.workunit.client.0.smithi001.stdout:1/361: symlink d3/d12/d21/l72 0 2024-09-15T22:26:42.547 INFO:tasks.workunit.client.0.smithi001.stdout:1/362: mknod d3/dd/d14/d23/d4b/c73 0 2024-09-15T22:26:42.547 INFO:tasks.workunit.client.0.smithi001.stdout:1/363: write d3/dd/d3c/f5b [288560,79636] 0 2024-09-15T22:26:42.547 INFO:tasks.workunit.client.0.smithi001.stdout:1/364: readlink d3/dd/d14/l5d 0 2024-09-15T22:26:42.548 INFO:tasks.workunit.client.0.smithi001.stdout:1/365: mknod d3/dd/d14/d23/c74 0 2024-09-15T22:26:42.549 INFO:tasks.workunit.client.0.smithi001.stdout:1/366: rename d3/d12/d21/l72 to d3/dd/d14/d23/l75 0 2024-09-15T22:26:42.550 INFO:tasks.workunit.client.0.smithi001.stdout:1/367: fsync d3/dd/d3c/d4c/f4e 0 2024-09-15T22:26:42.555 INFO:tasks.workunit.client.0.smithi001.stdout:1/368: write d3/dd/f19 [4670460,94855] 0 2024-09-15T22:26:42.555 INFO:tasks.workunit.client.0.smithi001.stdout:1/369: stat d3/dd/f55 0 2024-09-15T22:26:42.556 INFO:tasks.workunit.client.0.smithi001.stdout:1/370: mknod d3/dd/d3c/d64/c76 0 2024-09-15T22:26:42.563 INFO:tasks.workunit.client.0.smithi001.stdout:5/318: dread d3/f33 [0,4194304] 0 2024-09-15T22:26:42.564 INFO:tasks.workunit.client.0.smithi001.stdout:5/319: mkdir d3/d1d/d54/d56/d52/d61 0 2024-09-15T22:26:42.567 INFO:tasks.workunit.client.0.smithi001.stdout:5/320: rename d3/l26 to d3/d1d/l62 0 2024-09-15T22:26:42.567 INFO:tasks.workunit.client.0.smithi001.stdout:6/283: dwrite d0/df/d24/d2e/f1d [0,4194304] 0 2024-09-15T22:26:42.571 INFO:tasks.workunit.client.0.smithi001.stdout:1/371: write d3/d12/f35 [849997,127556] 0 2024-09-15T22:26:42.573 INFO:tasks.workunit.client.0.smithi001.stdout:2/260: dwrite d2/d12/f1c [4194304,4194304] 0 2024-09-15T22:26:42.573 INFO:tasks.workunit.client.0.smithi001.stdout:2/261: write d2/d14/d17/f4e [741413,59288] 0 2024-09-15T22:26:42.575 INFO:tasks.workunit.client.0.smithi001.stdout:2/262: truncate d2/d14/d17/d1f/d21/fa 3827424 0 2024-09-15T22:26:42.582 INFO:tasks.workunit.client.0.smithi001.stdout:1/372: dread d3/f7 [0,4194304] 0 2024-09-15T22:26:42.582 INFO:tasks.workunit.client.0.smithi001.stdout:1/373: stat d3/dd/d14/d23/l2c 0 2024-09-15T22:26:42.582 INFO:tasks.workunit.client.0.smithi001.stdout:2/263: link d2/d14/d17/d1f/d21/fa d2/d14/d17/d1f/d21/f51 0 2024-09-15T22:26:42.583 INFO:tasks.workunit.client.0.smithi001.stdout:2/264: creat d2/d12/f52 x:0 0 0 2024-09-15T22:26:42.584 INFO:tasks.workunit.client.0.smithi001.stdout:2/265: symlink d2/d14/d1a/l53 0 2024-09-15T22:26:42.584 INFO:tasks.workunit.client.0.smithi001.stdout:2/266: mknod d2/d14/d1a/c54 0 2024-09-15T22:26:42.593 INFO:tasks.workunit.client.0.smithi001.stdout:1/374: write d3/f42 [1409628,63926] 0 2024-09-15T22:26:42.594 INFO:tasks.workunit.client.0.smithi001.stdout:1/375: stat d3/f42 0 2024-09-15T22:26:42.594 INFO:tasks.workunit.client.0.smithi001.stdout:5/321: dread d3/d1d/f29 [0,4194304] 0 2024-09-15T22:26:42.594 INFO:tasks.workunit.client.0.smithi001.stdout:1/376: symlink d3/dd/d14/d23/l77 0 2024-09-15T22:26:42.595 INFO:tasks.workunit.client.0.smithi001.stdout:5/322: symlink d3/d6/d41/l63 0 2024-09-15T22:26:42.595 INFO:tasks.workunit.client.0.smithi001.stdout:5/323: fsync d3/d6/d25/f2c 0 2024-09-15T22:26:42.596 INFO:tasks.workunit.client.0.smithi001.stdout:5/324: write d3/f33 [3513299,12766] 0 2024-09-15T22:26:42.599 INFO:tasks.workunit.client.0.smithi001.stdout:2/267: write d2/d14/d17/f2c [7402762,28373] 0 2024-09-15T22:26:42.599 INFO:tasks.workunit.client.0.smithi001.stdout:1/377: symlink d3/dd/d14/d23/l78 0 2024-09-15T22:26:42.599 INFO:tasks.workunit.client.0.smithi001.stdout:1/378: write d3/dd/d14/d1b/d2b/f56 [1312823,46334] 0 2024-09-15T22:26:42.601 INFO:tasks.workunit.client.0.smithi001.stdout:8/243: dwrite f7 [0,4194304] 0 2024-09-15T22:26:42.601 INFO:tasks.workunit.client.0.smithi001.stdout:3/281: dwrite da/d3b/f25 [0,4194304] 0 2024-09-15T22:26:42.601 INFO:tasks.workunit.client.0.smithi001.stdout:9/279: dwrite d5/de/d1a/d1b/f3a [0,4194304] 0 2024-09-15T22:26:42.603 INFO:tasks.workunit.client.0.smithi001.stdout:2/268: fdatasync d2/f3 0 2024-09-15T22:26:42.603 INFO:tasks.workunit.client.0.smithi001.stdout:2/269: fdatasync d2/f2b 0 2024-09-15T22:26:42.603 INFO:tasks.workunit.client.0.smithi001.stdout:6/284: write d0/d6/fd [132637,16279] 0 2024-09-15T22:26:42.609 INFO:tasks.workunit.client.0.smithi001.stdout:1/379: dread d3/dd/d14/f1c [0,4194304] 0 2024-09-15T22:26:42.609 INFO:tasks.workunit.client.0.smithi001.stdout:1/380: readlink d3/dd/d14/l46 0 2024-09-15T22:26:42.609 INFO:tasks.workunit.client.0.smithi001.stdout:1/381: read d3/f39 [514828,31315] 0 2024-09-15T22:26:42.612 INFO:tasks.workunit.client.0.smithi001.stdout:5/325: dread d3/d27/f42 [0,4194304] 0 2024-09-15T22:26:42.612 INFO:tasks.workunit.client.0.smithi001.stdout:5/326: dread - d3/d27/f3a zero size 2024-09-15T22:26:42.612 INFO:tasks.workunit.client.0.smithi001.stdout:5/327: read d3/d6/f7 [1602062,40597] 0 2024-09-15T22:26:42.613 INFO:tasks.workunit.client.0.smithi001.stdout:1/382: read d3/dd/d3c/d64/f6a [66669,102524] 0 2024-09-15T22:26:42.613 INFO:tasks.workunit.client.0.smithi001.stdout:6/285: dread d0/d6/f4b [0,4194304] 0 2024-09-15T22:26:42.613 INFO:tasks.workunit.client.0.smithi001.stdout:3/282: mknod da/c62 0 2024-09-15T22:26:42.615 INFO:tasks.workunit.client.0.smithi001.stdout:9/280: creat d5/f59 x:0 0 0 2024-09-15T22:26:42.615 INFO:tasks.workunit.client.0.smithi001.stdout:9/281: stat d5/de/d1a/d1b/d22/d2c/d21/f25 0 2024-09-15T22:26:42.615 INFO:tasks.workunit.client.0.smithi001.stdout:5/328: symlink d3/d6/d41/d4d/l64 0 2024-09-15T22:26:42.616 INFO:tasks.workunit.client.0.smithi001.stdout:5/329: chown c1 31410 1 2024-09-15T22:26:42.617 INFO:tasks.workunit.client.0.smithi001.stdout:1/383: unlink d3/dd/d14/c1f 0 2024-09-15T22:26:42.617 INFO:tasks.workunit.client.0.smithi001.stdout:1/384: fdatasync d3/dd/d14/d1b/d2b/f61 0 2024-09-15T22:26:42.618 INFO:tasks.workunit.client.0.smithi001.stdout:6/286: creat d0/df/d24/f61 x:0 0 0 2024-09-15T22:26:42.618 INFO:tasks.workunit.client.0.smithi001.stdout:3/283: truncate da/d16/f26 1439944 0 2024-09-15T22:26:42.620 INFO:tasks.workunit.client.0.smithi001.stdout:1/385: mkdir d3/d12/d79 0 2024-09-15T22:26:42.621 INFO:tasks.workunit.client.0.smithi001.stdout:6/287: symlink d0/df/l62 0 2024-09-15T22:26:42.621 INFO:tasks.workunit.client.0.smithi001.stdout:6/288: write d0/df/f4d [3607536,106335] 0 2024-09-15T22:26:42.621 INFO:tasks.workunit.client.0.smithi001.stdout:6/289: fdatasync d0/f5 0 2024-09-15T22:26:42.623 INFO:tasks.workunit.client.0.smithi001.stdout:1/386: creat d3/dd/d14/d1b/d2b/d68/f7a x:0 0 0 2024-09-15T22:26:42.624 INFO:tasks.workunit.client.0.smithi001.stdout:0/299: dwrite d0/d9/d1a/d36/f41 [0,4194304] 0 2024-09-15T22:26:42.625 INFO:tasks.workunit.client.0.smithi001.stdout:3/284: unlink da/d3d/d43/c3a 0 2024-09-15T22:26:42.629 INFO:tasks.workunit.client.0.smithi001.stdout:6/290: fsync d0/d6/fd 0 2024-09-15T22:26:42.629 INFO:tasks.workunit.client.0.smithi001.stdout:1/387: chown d3/f5 307 1 2024-09-15T22:26:42.632 INFO:tasks.workunit.client.0.smithi001.stdout:1/388: dread - d3/dd/d14/d23/d4b/f70 zero size 2024-09-15T22:26:42.632 INFO:tasks.workunit.client.0.smithi001.stdout:0/300: getdents d0/dd/d33 0 2024-09-15T22:26:42.633 INFO:tasks.workunit.client.0.smithi001.stdout:8/244: dread f4 [0,4194304] 0 2024-09-15T22:26:42.637 INFO:tasks.workunit.client.0.smithi001.stdout:1/389: creat d3/d12/d21/f7b x:0 0 0 2024-09-15T22:26:42.637 INFO:tasks.workunit.client.0.smithi001.stdout:4/407: sync 2024-09-15T22:26:42.637 INFO:tasks.workunit.client.0.smithi001.stdout:7/278: sync 2024-09-15T22:26:42.637 INFO:tasks.workunit.client.0.smithi001.stdout:6/291: truncate d0/df/d24/d2e/f41 856626 0 2024-09-15T22:26:42.637 INFO:tasks.workunit.client.0.smithi001.stdout:4/408: symlink d0/d27/d35/d61/d20/d29/d40/l98 0 2024-09-15T22:26:42.637 INFO:tasks.workunit.client.0.smithi001.stdout:4/409: readlink d0/d27/d35/d61/d20/d29/d40/l6c 0 2024-09-15T22:26:42.638 INFO:tasks.workunit.client.0.smithi001.stdout:0/301: rename d0/d9/db/f4e to d0/dd/d1b/f5e 0 2024-09-15T22:26:42.638 INFO:tasks.workunit.client.0.smithi001.stdout:3/285: dread da/d3b/f29 [0,4194304] 0 2024-09-15T22:26:42.639 INFO:tasks.workunit.client.0.smithi001.stdout:6/292: link d0/f19 d0/d6/d5d/f63 0 2024-09-15T22:26:42.639 INFO:tasks.workunit.client.0.smithi001.stdout:6/293: fdatasync d0/f4 0 2024-09-15T22:26:42.641 INFO:tasks.workunit.client.0.smithi001.stdout:3/286: write f6 [1312644,67428] 0 2024-09-15T22:26:42.642 INFO:tasks.workunit.client.0.smithi001.stdout:6/294: write d0/d6/fd [1628003,58425] 0 2024-09-15T22:26:42.642 INFO:tasks.workunit.client.0.smithi001.stdout:6/295: chown d0/df/l1f 25063205 1 2024-09-15T22:26:42.643 INFO:tasks.workunit.client.0.smithi001.stdout:4/410: rename d0/d27/f79 to d0/d27/d35/d74/f99 0 2024-09-15T22:26:42.644 INFO:tasks.workunit.client.0.smithi001.stdout:7/279: dread d0/d7/d2e/f34 [0,4194304] 0 2024-09-15T22:26:42.645 INFO:tasks.workunit.client.0.smithi001.stdout:1/390: dread d3/dd/d14/f1c [0,4194304] 0 2024-09-15T22:26:42.650 INFO:tasks.workunit.client.0.smithi001.stdout:6/296: write d0/f9 [77258,104046] 0 2024-09-15T22:26:42.650 INFO:tasks.workunit.client.0.smithi001.stdout:6/297: chown d0/df/d24/d2e/c5a 288531037 1 2024-09-15T22:26:42.650 INFO:tasks.workunit.client.0.smithi001.stdout:7/280: rmdir d0/d7 39 2024-09-15T22:26:42.652 INFO:tasks.workunit.client.0.smithi001.stdout:2/270: dwrite d2/f43 [0,4194304] 0 2024-09-15T22:26:42.652 INFO:tasks.workunit.client.0.smithi001.stdout:2/271: write d2/d14/d1a/d20/f13 [4736226,59736] 0 2024-09-15T22:26:42.653 INFO:tasks.workunit.client.0.smithi001.stdout:7/281: rename d0/d7/d44/d3f/l50 to d0/d7/d44/d3f/d49/d4f/l61 0 2024-09-15T22:26:42.653 INFO:tasks.workunit.client.0.smithi001.stdout:8/245: dread d9/f18 [0,4194304] 0 2024-09-15T22:26:42.654 INFO:tasks.workunit.client.0.smithi001.stdout:7/282: unlink d0/d7/f19 0 2024-09-15T22:26:42.654 INFO:tasks.workunit.client.0.smithi001.stdout:8/246: creat d9/d19/f3c x:0 0 0 2024-09-15T22:26:42.655 INFO:tasks.workunit.client.0.smithi001.stdout:7/283: creat d0/d7/d44/d36/f62 x:0 0 0 2024-09-15T22:26:42.655 INFO:tasks.workunit.client.0.smithi001.stdout:7/284: readlink d0/d7/l33 0 2024-09-15T22:26:42.655 INFO:tasks.workunit.client.0.smithi001.stdout:7/285: chown d0/d7/d21/d2b/d3e/f41 1660253 1 2024-09-15T22:26:42.671 INFO:tasks.workunit.client.0.smithi001.stdout:3/287: write f8 [2608139,10852] 0 2024-09-15T22:26:42.672 INFO:tasks.workunit.client.0.smithi001.stdout:3/288: creat da/d1f/d2e/d3f/f63 x:0 0 0 2024-09-15T22:26:42.684 INFO:tasks.workunit.client.0.smithi001.stdout:1/391: write d3/dd/f33 [2874250,50229] 0 2024-09-15T22:26:42.690 INFO:tasks.workunit.client.0.smithi001.stdout:1/392: truncate d3/f9 7300147 0 2024-09-15T22:26:42.701 INFO:tasks.workunit.client.0.smithi001.stdout:0/302: dwrite d0/d9/f26 [0,4194304] 0 2024-09-15T22:26:42.701 INFO:tasks.workunit.client.0.smithi001.stdout:1/393: dread d3/f42 [0,4194304] 0 2024-09-15T22:26:42.702 INFO:tasks.workunit.client.0.smithi001.stdout:1/394: creat d3/dd/d3c/d64/f7c x:0 0 0 2024-09-15T22:26:42.703 INFO:tasks.workunit.client.0.smithi001.stdout:1/395: unlink d3/d12/f35 0 2024-09-15T22:26:42.704 INFO:tasks.workunit.client.0.smithi001.stdout:1/396: rmdir d3/dd/d14/d1b/d2b 39 2024-09-15T22:26:42.705 INFO:tasks.workunit.client.0.smithi001.stdout:1/397: mkdir d3/dd/d3c/d7d 0 2024-09-15T22:26:42.705 INFO:tasks.workunit.client.0.smithi001.stdout:1/398: write d3/dd/f19 [2839728,18002] 0 2024-09-15T22:26:42.705 INFO:tasks.workunit.client.0.smithi001.stdout:1/399: readlink d3/dd/d14/l46 0 2024-09-15T22:26:42.707 INFO:tasks.workunit.client.0.smithi001.stdout:1/400: rename d3/dd/d3c/d64/f7c to d3/dd/d3c/d64/f7e 0 2024-09-15T22:26:42.707 INFO:tasks.workunit.client.0.smithi001.stdout:1/401: chown d3/dd/d3c/d4c 36132 1 2024-09-15T22:26:42.707 INFO:tasks.workunit.client.0.smithi001.stdout:1/402: fdatasync d3/dd/d3c/d4c/f6b 0 2024-09-15T22:26:42.707 INFO:tasks.workunit.client.0.smithi001.stdout:1/403: write d3/dd/d14/f44 [914033,57099] 0 2024-09-15T22:26:42.708 INFO:tasks.workunit.client.0.smithi001.stdout:5/330: dwrite d3/f33 [0,4194304] 0 2024-09-15T22:26:42.709 INFO:tasks.workunit.client.0.smithi001.stdout:5/331: stat d3/d1d/l44 0 2024-09-15T22:26:42.719 INFO:tasks.workunit.client.0.smithi001.stdout:4/411: dread d0/d27/d35/d61/f43 [4194304,4194304] 0 2024-09-15T22:26:42.719 INFO:tasks.workunit.client.0.smithi001.stdout:4/412: stat d0/d5d/d44/c68 0 2024-09-15T22:26:42.723 INFO:tasks.workunit.client.0.smithi001.stdout:5/332: unlink d3/d1d/l44 0 2024-09-15T22:26:42.724 INFO:tasks.workunit.client.0.smithi001.stdout:8/247: dwrite d9/fb [0,4194304] 0 2024-09-15T22:26:42.725 INFO:tasks.workunit.client.0.smithi001.stdout:1/404: write d3/dd/d14/d23/d4b/f52 [2980048,117555] 0 2024-09-15T22:26:42.726 INFO:tasks.workunit.client.0.smithi001.stdout:1/405: truncate d3/dd/f58 1164922 0 2024-09-15T22:26:42.726 INFO:tasks.workunit.client.0.smithi001.stdout:1/406: truncate d3/d12/d21/f7b 689854 0 2024-09-15T22:26:42.726 INFO:tasks.workunit.client.0.smithi001.stdout:1/407: fdatasync d3/dd/f38 0 2024-09-15T22:26:42.727 INFO:tasks.workunit.client.0.smithi001.stdout:5/333: mkdir d3/d6/d41/d65 0 2024-09-15T22:26:42.728 INFO:tasks.workunit.client.0.smithi001.stdout:2/272: dread d2/d14/d17/d1f/d21/f51 [0,4194304] 0 2024-09-15T22:26:42.728 INFO:tasks.workunit.client.0.smithi001.stdout:2/273: truncate d2/d14/d1a/d20/f47 115658 0 2024-09-15T22:26:42.728 INFO:tasks.workunit.client.0.smithi001.stdout:9/282: dwrite f4 [0,4194304] 0 2024-09-15T22:26:42.729 INFO:tasks.workunit.client.0.smithi001.stdout:9/283: rename d5/de to d5/de/d5a 22 2024-09-15T22:26:42.729 INFO:tasks.workunit.client.0.smithi001.stdout:1/408: creat d3/dd/d14/d1b/f7f x:0 0 0 2024-09-15T22:26:42.730 INFO:tasks.workunit.client.0.smithi001.stdout:5/334: mknod d3/d1d/d54/d56/c66 0 2024-09-15T22:26:42.730 INFO:tasks.workunit.client.0.smithi001.stdout:5/335: read d3/fc [4493488,117140] 0 2024-09-15T22:26:42.730 INFO:tasks.workunit.client.0.smithi001.stdout:5/336: write d3/f16 [4075752,77325] 0 2024-09-15T22:26:42.732 INFO:tasks.workunit.client.0.smithi001.stdout:8/248: rmdir d9/d2d 0 2024-09-15T22:26:42.732 INFO:tasks.workunit.client.0.smithi001.stdout:8/249: chown d9/f11 64 1 2024-09-15T22:26:42.734 INFO:tasks.workunit.client.0.smithi001.stdout:8/250: creat d9/d19/f3d x:0 0 0 2024-09-15T22:26:42.752 INFO:tasks.workunit.client.0.smithi001.stdout:5/337: dread d3/fc [4194304,4194304] 0 2024-09-15T22:26:42.755 INFO:tasks.workunit.client.0.smithi001.stdout:3/289: dwrite da/d16/f52 [0,4194304] 0 2024-09-15T22:26:42.758 INFO:tasks.workunit.client.0.smithi001.stdout:7/286: dwrite d0/d7/d44/f47 [0,4194304] 0 2024-09-15T22:26:42.761 INFO:tasks.workunit.client.0.smithi001.stdout:5/338: rename d3/c1a to d3/d6/c67 0 2024-09-15T22:26:42.761 INFO:tasks.workunit.client.0.smithi001.stdout:3/290: getdents da/d3b 0 2024-09-15T22:26:42.765 INFO:tasks.workunit.client.0.smithi001.stdout:7/287: rmdir d0/d7/d21/d2b 39 2024-09-15T22:26:42.769 INFO:tasks.workunit.client.0.smithi001.stdout:8/251: dwrite d9/d19/d29/d35/f39 [0,4194304] 0 2024-09-15T22:26:42.771 INFO:tasks.workunit.client.0.smithi001.stdout:8/252: rmdir d9 39 2024-09-15T22:26:42.771 INFO:tasks.workunit.client.0.smithi001.stdout:8/253: getdents d9/d19/d29 0 2024-09-15T22:26:42.772 INFO:tasks.workunit.client.0.smithi001.stdout:0/303: dwrite d0/f4 [0,4194304] 0 2024-09-15T22:26:42.773 INFO:tasks.workunit.client.0.smithi001.stdout:8/254: creat d9/d19/d29/f3e x:0 0 0 2024-09-15T22:26:42.773 INFO:tasks.workunit.client.0.smithi001.stdout:0/304: symlink d0/l5f 0 2024-09-15T22:26:42.778 INFO:tasks.workunit.client.0.smithi001.stdout:8/255: creat d9/d19/f3f x:0 0 0 2024-09-15T22:26:42.782 INFO:tasks.workunit.client.0.smithi001.stdout:8/256: mkdir d9/d19/d40 0 2024-09-15T22:26:42.783 INFO:tasks.workunit.client.0.smithi001.stdout:8/257: mkdir d9/d19/d34/d41 0 2024-09-15T22:26:42.787 INFO:tasks.workunit.client.0.smithi001.stdout:7/288: dread d0/d7/d44/f11 [0,4194304] 0 2024-09-15T22:26:42.788 INFO:tasks.workunit.client.0.smithi001.stdout:8/258: rmdir d9/d19 39 2024-09-15T22:26:42.788 INFO:tasks.workunit.client.0.smithi001.stdout:5/339: rename d3/d6/c67 to d3/c68 0 2024-09-15T22:26:42.789 INFO:tasks.workunit.client.0.smithi001.stdout:5/340: truncate d3/d6/d25/f38 3733850 0 2024-09-15T22:26:42.790 INFO:tasks.workunit.client.0.smithi001.stdout:8/259: link d9/lc d9/d19/l42 0 2024-09-15T22:26:42.790 INFO:tasks.workunit.client.0.smithi001.stdout:8/260: write d9/d19/f1f [1934987,13887] 0 2024-09-15T22:26:42.791 INFO:tasks.workunit.client.0.smithi001.stdout:7/289: read d0/d7/d44/f27 [1107643,34304] 0 2024-09-15T22:26:42.791 INFO:tasks.workunit.client.0.smithi001.stdout:7/290: dread - d0/d7/d23/f3b zero size 2024-09-15T22:26:42.792 INFO:tasks.workunit.client.0.smithi001.stdout:0/305: dread d0/d9/d1a/d36/f55 [0,4194304] 0 2024-09-15T22:26:42.792 INFO:tasks.workunit.client.0.smithi001.stdout:8/261: write d9/f3a [647298,11193] 0 2024-09-15T22:26:42.793 INFO:tasks.workunit.client.0.smithi001.stdout:7/291: creat d0/d7/d2e/f63 x:0 0 0 2024-09-15T22:26:42.794 INFO:tasks.workunit.client.0.smithi001.stdout:0/306: rename d0/d9/d1a/l3e to d0/dd/d33/l60 0 2024-09-15T22:26:42.795 INFO:tasks.workunit.client.0.smithi001.stdout:8/262: creat d9/d19/d34/f43 x:0 0 0 2024-09-15T22:26:42.797 INFO:tasks.workunit.client.0.smithi001.stdout:0/307: rename d0/d9/db/c2f to d0/d51/c61 0 2024-09-15T22:26:42.797 INFO:tasks.workunit.client.0.smithi001.stdout:0/308: write d0/d6/f2a [1688026,291] 0 2024-09-15T22:26:42.797 INFO:tasks.workunit.client.0.smithi001.stdout:0/309: write d0/f7 [3756059,13873] 0 2024-09-15T22:26:42.798 INFO:tasks.workunit.client.0.smithi001.stdout:0/310: unlink d0/d9/d1a/d36/f55 0 2024-09-15T22:26:42.802 INFO:tasks.workunit.client.0.smithi001.stdout:1/409: dwrite d3/f5 [0,4194304] 0 2024-09-15T22:26:42.802 INFO:tasks.workunit.client.0.smithi001.stdout:1/410: write d3/dd/d14/d23/f4f [1001822,7527] 0 2024-09-15T22:26:42.804 INFO:tasks.workunit.client.0.smithi001.stdout:1/411: write d3/f5e [825448,56555] 0 2024-09-15T22:26:42.806 INFO:tasks.workunit.client.0.smithi001.stdout:1/412: rename d3/d12/d21/f7b to d3/d12/d79/f80 0 2024-09-15T22:26:42.806 INFO:tasks.workunit.client.0.smithi001.stdout:1/413: write d3/dd/d3c/d64/f6a [644071,26496] 0 2024-09-15T22:26:42.808 INFO:tasks.workunit.client.0.smithi001.stdout:1/414: rmdir d3/dd/d14/d23/d4b/d6f 0 2024-09-15T22:26:42.808 INFO:tasks.workunit.client.0.smithi001.stdout:1/415: write d3/dd/d3c/f5b [387713,72804] 0 2024-09-15T22:26:42.810 INFO:tasks.workunit.client.0.smithi001.stdout:1/416: rename d3/f32 to d3/d12/d79/f81 0 2024-09-15T22:26:42.811 INFO:tasks.workunit.client.0.smithi001.stdout:4/413: dwrite d0/d5d/d44/d65/f7d [0,4194304] 0 2024-09-15T22:26:42.811 INFO:tasks.workunit.client.0.smithi001.stdout:4/414: chown d0/d27/d35/d61/d20/f4f 7091860 1 2024-09-15T22:26:42.813 INFO:tasks.workunit.client.0.smithi001.stdout:4/415: rename d0/d5d/d44/f56 to d0/d5d/d44/d65/f9a 0 2024-09-15T22:26:42.816 INFO:tasks.workunit.client.0.smithi001.stdout:7/292: dread d0/d7/f53 [0,4194304] 0 2024-09-15T22:26:42.817 INFO:tasks.workunit.client.0.smithi001.stdout:7/293: creat d0/d7/d44/d36/f64 x:0 0 0 2024-09-15T22:26:42.817 INFO:tasks.workunit.client.0.smithi001.stdout:7/294: fsync d0/d7/d21/d2b/f4a 0 2024-09-15T22:26:42.829 INFO:tasks.workunit.client.0.smithi001.stdout:3/291: dwrite da/d1f/d2e/d3f/f63 [0,4194304] 0 2024-09-15T22:26:42.829 INFO:tasks.workunit.client.0.smithi001.stdout:5/341: dwrite d3/d27/f46 [0,4194304] 0 2024-09-15T22:26:42.831 INFO:tasks.workunit.client.0.smithi001.stdout:3/292: creat da/d3b/f64 x:0 0 0 2024-09-15T22:26:42.831 INFO:tasks.workunit.client.0.smithi001.stdout:5/342: creat d3/d1d/d54/d56/d52/f69 x:0 0 0 2024-09-15T22:26:42.832 INFO:tasks.workunit.client.0.smithi001.stdout:3/293: symlink da/l65 0 2024-09-15T22:26:42.833 INFO:tasks.workunit.client.0.smithi001.stdout:5/343: creat d3/d6/d25/f6a x:0 0 0 2024-09-15T22:26:42.835 INFO:tasks.workunit.client.0.smithi001.stdout:5/344: creat d3/d1d/d54/d56/f6b x:0 0 0 2024-09-15T22:26:42.835 INFO:tasks.workunit.client.0.smithi001.stdout:5/345: getdents d3/d6/d57 0 2024-09-15T22:26:42.853 INFO:tasks.workunit.client.0.smithi001.stdout:1/417: dwrite d3/dd/d3c/f43 [0,4194304] 0 2024-09-15T22:26:42.858 INFO:tasks.workunit.client.0.smithi001.stdout:1/418: write d3/dd/d14/d1b/f6d [392649,78659] 0 2024-09-15T22:26:42.862 INFO:tasks.workunit.client.0.smithi001.stdout:1/419: mkdir d3/d12/d21/d82 0 2024-09-15T22:26:42.862 INFO:tasks.workunit.client.0.smithi001.stdout:1/420: readlink d3/dd/d14/d1b/l2a 0 2024-09-15T22:26:42.871 INFO:tasks.workunit.client.0.smithi001.stdout:4/416: dwrite d0/d27/d35/d61/f5b [0,4194304] 0 2024-09-15T22:26:42.871 INFO:tasks.workunit.client.0.smithi001.stdout:4/417: readlink d0/d5d/d44/d65/d6a/l8b 0 2024-09-15T22:26:42.871 INFO:tasks.workunit.client.0.smithi001.stdout:4/418: fdatasync d0/d27/d35/f72 0 2024-09-15T22:26:42.871 INFO:tasks.workunit.client.0.smithi001.stdout:4/419: getdents d0/d5d/d44/d65 0 2024-09-15T22:26:42.884 INFO:tasks.workunit.client.0.smithi001.stdout:7/295: dwrite d0/d7/d44/d3f/d49/f59 [0,4194304] 0 2024-09-15T22:26:42.885 INFO:tasks.workunit.client.0.smithi001.stdout:7/296: truncate d0/d7/d21/f3d 1608125 0 2024-09-15T22:26:42.885 INFO:tasks.workunit.client.0.smithi001.stdout:4/420: write d0/d27/d35/d74/f99 [5300314,95303] 0 2024-09-15T22:26:42.890 INFO:tasks.workunit.client.0.smithi001.stdout:7/297: mknod d0/d7/d23/c65 0 2024-09-15T22:26:42.890 INFO:tasks.workunit.client.0.smithi001.stdout:7/298: write d0/d7/f53 [689228,83765] 0 2024-09-15T22:26:42.890 INFO:tasks.workunit.client.0.smithi001.stdout:4/421: creat d0/d5d/f9b x:0 0 0 2024-09-15T22:26:42.891 INFO:tasks.workunit.client.0.smithi001.stdout:4/422: getdents d0/d5d/d7c 0 2024-09-15T22:26:42.892 INFO:tasks.workunit.client.0.smithi001.stdout:4/423: truncate d0/f48 2162398 0 2024-09-15T22:26:42.892 INFO:tasks.workunit.client.0.smithi001.stdout:4/424: mkdir d0/d27/d35/d61/d20/d29/d34/d9c 0 2024-09-15T22:26:42.896 INFO:tasks.workunit.client.0.smithi001.stdout:3/294: dwrite da/d3d/d43/d41/f54 [0,4194304] 0 2024-09-15T22:26:42.896 INFO:tasks.workunit.client.0.smithi001.stdout:5/346: dwrite d3/d6/d25/f38 [0,4194304] 0 2024-09-15T22:26:42.900 INFO:tasks.workunit.client.0.smithi001.stdout:3/295: rmdir da/d3b/d1b 39 2024-09-15T22:26:42.941 INFO:tasks.workunit.client.0.smithi001.stdout:1/421: dwrite d3/f5e [0,4194304] 0 2024-09-15T22:26:42.943 INFO:tasks.workunit.client.0.smithi001.stdout:6/298: sync 2024-09-15T22:26:42.943 INFO:tasks.workunit.client.0.smithi001.stdout:6/299: readlink d0/d6/l1e 0 2024-09-15T22:26:42.943 INFO:tasks.workunit.client.0.smithi001.stdout:6/300: chown d0/df/c20 25947333 1 2024-09-15T22:26:42.947 INFO:tasks.workunit.client.0.smithi001.stdout:1/422: mknod d3/dd/d3c/d64/c83 0 2024-09-15T22:26:42.947 INFO:tasks.workunit.client.0.smithi001.stdout:1/423: dread - d3/dd/d3c/d64/f7e zero size 2024-09-15T22:26:42.949 INFO:tasks.workunit.client.0.smithi001.stdout:1/424: mkdir d3/dd/d53/d84 0 2024-09-15T22:26:42.965 INFO:tasks.workunit.client.0.smithi001.stdout:7/299: dwrite d0/d7/d44/f5b [0,4194304] 0 2024-09-15T22:26:42.970 INFO:tasks.workunit.client.0.smithi001.stdout:4/425: dwrite d0/d5d/d44/d65/f7d [0,4194304] 0 2024-09-15T22:26:42.970 INFO:tasks.workunit.client.0.smithi001.stdout:5/347: dwrite d3/d6/d25/f2c [0,4194304] 0 2024-09-15T22:26:42.970 INFO:tasks.workunit.client.0.smithi001.stdout:3/296: dwrite da/d1f/d2e/d3f/f63 [0,4194304] 0 2024-09-15T22:26:42.970 INFO:tasks.workunit.client.0.smithi001.stdout:4/426: chown d0/f48 29382 1 2024-09-15T22:26:42.970 INFO:tasks.workunit.client.0.smithi001.stdout:4/427: fsync d0/d27/d35/d61/d20/d29/d40/f5a 0 2024-09-15T22:26:42.974 INFO:tasks.workunit.client.0.smithi001.stdout:5/348: getdents d3 0 2024-09-15T22:26:42.974 INFO:tasks.workunit.client.0.smithi001.stdout:5/349: chown d3/d1d/f29 6 1 2024-09-15T22:26:42.984 INFO:tasks.workunit.client.0.smithi001.stdout:8/263: sync 2024-09-15T22:26:42.984 INFO:tasks.workunit.client.0.smithi001.stdout:9/284: sync 2024-09-15T22:26:42.984 INFO:tasks.workunit.client.0.smithi001.stdout:0/311: sync 2024-09-15T22:26:42.984 INFO:tasks.workunit.client.0.smithi001.stdout:0/312: write d0/d6/f30 [1267807,117407] 0 2024-09-15T22:26:42.984 INFO:tasks.workunit.client.0.smithi001.stdout:0/313: truncate d0/d6/f2a 2166969 0 2024-09-15T22:26:42.984 INFO:tasks.workunit.client.0.smithi001.stdout:2/274: sync 2024-09-15T22:26:42.985 INFO:tasks.workunit.client.0.smithi001.stdout:7/300: write d0/d7/f24 [1063736,84462] 0 2024-09-15T22:26:42.987 INFO:tasks.workunit.client.0.smithi001.stdout:7/301: link d0/d7/d44/f27 d0/d7/d44/d3f/d49/f66 0 2024-09-15T22:26:42.987 INFO:tasks.workunit.client.0.smithi001.stdout:7/302: read - d0/d7/d21/d2b/d3e/f41 zero size 2024-09-15T22:26:42.994 INFO:tasks.workunit.client.0.smithi001.stdout:6/301: dwrite d0/df/d24/f34 [0,4194304] 0 2024-09-15T22:26:42.997 INFO:tasks.workunit.client.0.smithi001.stdout:6/302: rename d0/df/d24/d2e/f41 to d0/df/d24/d2e/d43/d30/f64 0 2024-09-15T22:26:42.997 INFO:tasks.workunit.client.0.smithi001.stdout:6/303: readlink d0/df/l25 0 2024-09-15T22:26:42.997 INFO:tasks.workunit.client.0.smithi001.stdout:6/304: write d0/df/d24/f61 [92098,5056] 0 2024-09-15T22:26:42.997 INFO:tasks.workunit.client.0.smithi001.stdout:5/350: dread d3/d1d/d54/d56/f55 [0,4194304] 0 2024-09-15T22:26:42.999 INFO:tasks.workunit.client.0.smithi001.stdout:9/285: dread d5/de/d1a/d1b/d22/d2c/f31 [0,4194304] 0 2024-09-15T22:26:43.001 INFO:tasks.workunit.client.0.smithi001.stdout:5/351: unlink d3/d1d/d54/d56/f6b 0 2024-09-15T22:26:43.001 INFO:tasks.workunit.client.0.smithi001.stdout:5/352: readlink d3/d6/d41/d4d/d5a/l5b 0 2024-09-15T22:26:43.001 INFO:tasks.workunit.client.0.smithi001.stdout:5/353: dread - d3/f4f zero size 2024-09-15T22:26:43.002 INFO:tasks.workunit.client.0.smithi001.stdout:9/286: rename c3 to d5/de/d1a/d1b/d22/c5b 0 2024-09-15T22:26:43.002 INFO:tasks.workunit.client.0.smithi001.stdout:9/287: write d5/de/f18 [83086,59387] 0 2024-09-15T22:26:43.002 INFO:tasks.workunit.client.0.smithi001.stdout:9/288: readlink d5/de/l39 0 2024-09-15T22:26:43.003 INFO:tasks.workunit.client.0.smithi001.stdout:9/289: mknod d5/de/d51/c5c 0 2024-09-15T22:26:43.006 INFO:tasks.workunit.client.0.smithi001.stdout:2/275: dread d2/f3 [4194304,4194304] 0 2024-09-15T22:26:43.009 INFO:tasks.workunit.client.0.smithi001.stdout:3/297: dwrite da/d3b/d1b/f60 [0,4194304] 0 2024-09-15T22:26:43.009 INFO:tasks.workunit.client.0.smithi001.stdout:3/298: readlink da/l49 0 2024-09-15T22:26:43.018 INFO:tasks.workunit.client.0.smithi001.stdout:5/354: rename d3/d1d/c32 to d3/d1d/d54/d56/d52/c6c 0 2024-09-15T22:26:43.018 INFO:tasks.workunit.client.0.smithi001.stdout:5/355: dread - d3/f4f zero size 2024-09-15T22:26:43.018 INFO:tasks.workunit.client.0.smithi001.stdout:5/356: chown d3/d6/d25/c35 1308 1 2024-09-15T22:26:43.018 INFO:tasks.workunit.client.0.smithi001.stdout:5/357: stat d3/d6/d41/l63 0 2024-09-15T22:26:43.018 INFO:tasks.workunit.client.0.smithi001.stdout:9/290: getdents d5/de/d1a/d1b/d22 0 2024-09-15T22:26:43.019 INFO:tasks.workunit.client.0.smithi001.stdout:2/276: mknod d2/d14/d17/c55 0 2024-09-15T22:26:43.022 INFO:tasks.workunit.client.0.smithi001.stdout:3/299: creat da/d3b/f66 x:0 0 0 2024-09-15T22:26:43.023 INFO:tasks.workunit.client.0.smithi001.stdout:9/291: creat d5/de/d1a/d1b/d22/d2c/d21/d4d/f5d x:0 0 0 2024-09-15T22:26:43.023 INFO:tasks.workunit.client.0.smithi001.stdout:3/300: getdents da/d1f/d2e 0 2024-09-15T22:26:43.025 INFO:tasks.workunit.client.0.smithi001.stdout:3/301: getdents da/d1f/d2e/d3f 0 2024-09-15T22:26:43.025 INFO:tasks.workunit.client.0.smithi001.stdout:3/302: fsync da/d3b/d1b/f2c 0 2024-09-15T22:26:43.026 INFO:tasks.workunit.client.0.smithi001.stdout:3/303: rmdir da/d3d 39 2024-09-15T22:26:43.027 INFO:tasks.workunit.client.0.smithi001.stdout:7/303: write d0/d7/d23/f29 [2676840,82634] 0 2024-09-15T22:26:43.027 INFO:tasks.workunit.client.0.smithi001.stdout:7/304: fsync d0/d7/d44/f11 0 2024-09-15T22:26:43.041 INFO:tasks.workunit.client.0.smithi001.stdout:9/292: rename d5/de/d1a/d1b/d22/d2c/d21/d24/c28 to d5/de/d1a/d1b/d22/d2c/d21/c5e 0 2024-09-15T22:26:43.041 INFO:tasks.workunit.client.0.smithi001.stdout:7/305: rename d0/d7/f5d to d0/d7/d21/d2b/d3e/f67 0 2024-09-15T22:26:43.041 INFO:tasks.workunit.client.0.smithi001.stdout:7/306: symlink d0/d7/d44/d3f/l68 0 2024-09-15T22:26:43.042 INFO:tasks.workunit.client.0.smithi001.stdout:7/307: link d0/d7/c58 d0/d7/d21/d2b/d3e/c69 0 2024-09-15T22:26:43.042 INFO:tasks.workunit.client.0.smithi001.stdout:4/428: dwrite d0/d27/d35/d61/f23 [0,4194304] 0 2024-09-15T22:26:43.042 INFO:tasks.workunit.client.0.smithi001.stdout:4/429: dread - d0/d27/d35/d61/d20/d29/d34/f70 zero size 2024-09-15T22:26:43.042 INFO:tasks.workunit.client.0.smithi001.stdout:7/308: truncate d0/f5c 1563101 0 2024-09-15T22:26:43.042 INFO:tasks.workunit.client.0.smithi001.stdout:7/309: mkdir d0/d6a 0 2024-09-15T22:26:43.044 INFO:tasks.workunit.client.0.smithi001.stdout:7/310: unlink d0/d7/d44/d36/f5a 0 2024-09-15T22:26:43.044 INFO:tasks.workunit.client.0.smithi001.stdout:7/311: chown d0/d7/c58 42974302 1 2024-09-15T22:26:43.045 INFO:tasks.workunit.client.0.smithi001.stdout:7/312: write d0/d7/d21/f55 [892877,9707] 0 2024-09-15T22:26:43.050 INFO:tasks.workunit.client.0.smithi001.stdout:7/313: rename d0/d7/d23 to d0/d7/d21/d6b 0 2024-09-15T22:26:43.052 INFO:tasks.workunit.client.0.smithi001.stdout:7/314: symlink d0/d7/d44/l6c 0 2024-09-15T22:26:43.052 INFO:tasks.workunit.client.0.smithi001.stdout:7/315: write d0/d7/d21/d2b/d3e/f4b [4029662,57058] 0 2024-09-15T22:26:43.054 INFO:tasks.workunit.client.0.smithi001.stdout:7/316: symlink d0/l6d 0 2024-09-15T22:26:43.054 INFO:tasks.workunit.client.0.smithi001.stdout:2/277: dread d2/d14/d17/f2c [4194304,4194304] 0 2024-09-15T22:26:43.058 INFO:tasks.workunit.client.0.smithi001.stdout:2/278: rename d2/d14/d17/d1f/d21 to d2/d12/d56 0 2024-09-15T22:26:43.060 INFO:tasks.workunit.client.0.smithi001.stdout:4/430: read d0/d27/d35/f69 [518730,53806] 0 2024-09-15T22:26:43.061 INFO:tasks.workunit.client.0.smithi001.stdout:2/279: mknod d2/d14/d1a/d20/c57 0 2024-09-15T22:26:43.064 INFO:tasks.workunit.client.0.smithi001.stdout:4/431: creat d0/d27/d35/f9d x:0 0 0 2024-09-15T22:26:43.069 INFO:tasks.workunit.client.0.smithi001.stdout:2/280: dread d2/d14/d17/f4e [0,4194304] 0 2024-09-15T22:26:43.078 INFO:tasks.workunit.client.0.smithi001.stdout:5/358: dwrite d3/d27/d4e/f58 [0,4194304] 0 2024-09-15T22:26:43.078 INFO:tasks.workunit.client.0.smithi001.stdout:6/305: dwrite d0/df/d24/f3a [0,4194304] 0 2024-09-15T22:26:43.078 INFO:tasks.workunit.client.0.smithi001.stdout:2/281: creat d2/d14/d1a/d1b/f58 x:0 0 0 2024-09-15T22:26:43.078 INFO:tasks.workunit.client.0.smithi001.stdout:4/432: fsync d0/d27/d35/f9d 0 2024-09-15T22:26:43.081 INFO:tasks.workunit.client.0.smithi001.stdout:5/359: symlink d3/d6/d41/d65/l6d 0 2024-09-15T22:26:43.081 INFO:tasks.workunit.client.0.smithi001.stdout:5/360: dread - d3/d1d/d54/d56/d52/f69 zero size 2024-09-15T22:26:43.084 INFO:tasks.workunit.client.0.smithi001.stdout:6/306: creat d0/d2f/d53/f65 x:0 0 0 2024-09-15T22:26:43.084 INFO:tasks.workunit.client.0.smithi001.stdout:6/307: write d0/df/f55 [331241,30746] 0 2024-09-15T22:26:43.085 INFO:tasks.workunit.client.0.smithi001.stdout:6/308: write d0/df/d24/d2e/d43/d30/f64 [101243,70913] 0 2024-09-15T22:26:43.085 INFO:tasks.workunit.client.0.smithi001.stdout:5/361: mknod d3/d1d/d54/d56/d52/d61/c6e 0 2024-09-15T22:26:43.085 INFO:tasks.workunit.client.0.smithi001.stdout:4/433: dread d0/d27/d35/d61/f2d [0,4194304] 0 2024-09-15T22:26:43.086 INFO:tasks.workunit.client.0.smithi001.stdout:4/434: creat d0/d27/d35/d59/d67/f9e x:0 0 0 2024-09-15T22:26:43.092 INFO:tasks.workunit.client.0.smithi001.stdout:3/304: dwrite da/d16/f30 [0,4194304] 0 2024-09-15T22:26:43.093 INFO:tasks.workunit.client.0.smithi001.stdout:4/435: creat d0/d27/d35/d61/d20/f9f x:0 0 0 2024-09-15T22:26:43.099 INFO:tasks.workunit.client.0.smithi001.stdout:9/293: dread d5/de/f18 [0,4194304] 0 2024-09-15T22:26:43.099 INFO:tasks.workunit.client.0.smithi001.stdout:9/294: readlink d5/de/d1a/d1b/d22/d2c/d21/d24/l3f 0 2024-09-15T22:26:43.099 INFO:tasks.workunit.client.0.smithi001.stdout:9/295: getdents d5/de/d51/d53 0 2024-09-15T22:26:43.099 INFO:tasks.workunit.client.0.smithi001.stdout:9/296: chown d5/de/d1a/d1b/d22/d2c/c29 240 1 2024-09-15T22:26:43.099 INFO:tasks.workunit.client.0.smithi001.stdout:2/282: dread d2/f3 [4194304,4194304] 0 2024-09-15T22:26:43.100 INFO:tasks.workunit.client.0.smithi001.stdout:6/309: dread d0/d6/fd [0,4194304] 0 2024-09-15T22:26:43.101 INFO:tasks.workunit.client.0.smithi001.stdout:4/436: rmdir d0/d27 39 2024-09-15T22:26:43.101 INFO:tasks.workunit.client.0.smithi001.stdout:4/437: write d0/d27/d35/d74/f99 [5296021,60857] 0 2024-09-15T22:26:43.103 INFO:tasks.workunit.client.0.smithi001.stdout:6/310: symlink d0/df/d24/d2e/l66 0 2024-09-15T22:26:43.103 INFO:tasks.workunit.client.0.smithi001.stdout:6/311: readlink d0/df/d24/l5b 0 2024-09-15T22:26:43.105 INFO:tasks.workunit.client.0.smithi001.stdout:4/438: truncate d0/d27/d35/d61/d20/f4f 376453 0 2024-09-15T22:26:43.106 INFO:tasks.workunit.client.0.smithi001.stdout:4/439: mkdir d0/d27/d35/d61/d20/d29/d34/da0 0 2024-09-15T22:26:43.107 INFO:tasks.workunit.client.0.smithi001.stdout:1/425: sync 2024-09-15T22:26:43.110 INFO:tasks.workunit.client.0.smithi001.stdout:1/426: mkdir d3/d12/d79/d85 0 2024-09-15T22:26:43.111 INFO:tasks.workunit.client.0.smithi001.stdout:1/427: readlink d3/dd/d14/d1b/d2b/d68/l71 0 2024-09-15T22:26:43.111 INFO:tasks.workunit.client.0.smithi001.stdout:4/440: rmdir d0/d27 39 2024-09-15T22:26:43.113 INFO:tasks.workunit.client.0.smithi001.stdout:1/428: mkdir d3/dd/d86 0 2024-09-15T22:26:43.114 INFO:tasks.workunit.client.0.smithi001.stdout:3/305: read da/d16/f52 [1618873,44054] 0 2024-09-15T22:26:43.119 INFO:tasks.workunit.client.0.smithi001.stdout:2/283: dread d2/d14/d1a/d20/f2a [0,4194304] 0 2024-09-15T22:26:43.119 INFO:tasks.workunit.client.0.smithi001.stdout:7/317: dwrite d0/d7/d44/d36/f62 [0,4194304] 0 2024-09-15T22:26:43.122 INFO:tasks.workunit.client.0.smithi001.stdout:7/318: symlink d0/d6a/l6e 0 2024-09-15T22:26:43.122 INFO:tasks.workunit.client.0.smithi001.stdout:6/312: write d0/d6/d5d/f63 [942204,72203] 0 2024-09-15T22:26:43.127 INFO:tasks.workunit.client.0.smithi001.stdout:7/319: mkdir d0/d7/d44/d6f 0 2024-09-15T22:26:43.128 INFO:tasks.workunit.client.0.smithi001.stdout:4/441: dread d0/d27/d35/d61/f23 [0,4194304] 0 2024-09-15T22:26:43.129 INFO:tasks.workunit.client.0.smithi001.stdout:7/320: mknod d0/d7/d21/c70 0 2024-09-15T22:26:43.129 INFO:tasks.workunit.client.0.smithi001.stdout:7/321: fdatasync d0/d7/d2e/f63 0 2024-09-15T22:26:43.130 INFO:tasks.workunit.client.0.smithi001.stdout:3/306: dread da/d16/f52 [0,4194304] 0 2024-09-15T22:26:43.130 INFO:tasks.workunit.client.0.smithi001.stdout:4/442: creat d0/d27/fa1 x:0 0 0 2024-09-15T22:26:43.133 INFO:tasks.workunit.client.0.smithi001.stdout:3/307: mknod da/d1f/d46/c67 0 2024-09-15T22:26:43.135 INFO:tasks.workunit.client.0.smithi001.stdout:7/322: symlink d0/d7/l71 0 2024-09-15T22:26:43.135 INFO:tasks.workunit.client.0.smithi001.stdout:7/323: fdatasync d0/d7/d21/f3d 0 2024-09-15T22:26:43.139 INFO:tasks.workunit.client.0.smithi001.stdout:6/313: rename d0/d2f to d0/d6/d5d/d67 0 2024-09-15T22:26:43.140 INFO:tasks.workunit.client.0.smithi001.stdout:3/308: rename da/d1f/l36 to da/d1f/d46/l68 0 2024-09-15T22:26:43.141 INFO:tasks.workunit.client.0.smithi001.stdout:7/324: read d0/d7/d21/f3d [477125,76005] 0 2024-09-15T22:26:43.141 INFO:tasks.workunit.client.0.smithi001.stdout:6/314: creat d0/d6/d5d/d67/f68 x:0 0 0 2024-09-15T22:26:43.141 INFO:tasks.workunit.client.0.smithi001.stdout:2/284: dread d2/d14/d17/d1f/f25 [0,4194304] 0 2024-09-15T22:26:43.141 INFO:tasks.workunit.client.0.smithi001.stdout:2/285: write d2/d12/d56/f51 [506488,98146] 0 2024-09-15T22:26:43.142 INFO:tasks.workunit.client.0.smithi001.stdout:3/309: mknod da/d3b/d58/c69 0 2024-09-15T22:26:43.142 INFO:tasks.workunit.client.0.smithi001.stdout:3/310: fsync da/d1f/d2e/f5f 0 2024-09-15T22:26:43.144 INFO:tasks.workunit.client.0.smithi001.stdout:7/325: rename d0/d7/d21/f3a to d0/d7/d44/d36/f72 0 2024-09-15T22:26:43.145 INFO:tasks.workunit.client.0.smithi001.stdout:6/315: creat d0/df/d24/f69 x:0 0 0 2024-09-15T22:26:43.145 INFO:tasks.workunit.client.0.smithi001.stdout:7/326: symlink d0/d7/d21/l73 0 2024-09-15T22:26:43.148 INFO:tasks.workunit.client.0.smithi001.stdout:6/316: creat d0/df/d24/d49/f6a x:0 0 0 2024-09-15T22:26:43.149 INFO:tasks.workunit.client.0.smithi001.stdout:7/327: creat d0/d7/d44/f74 x:0 0 0 2024-09-15T22:26:43.149 INFO:tasks.workunit.client.0.smithi001.stdout:7/328: chown d0/d7/d44/f74 101 1 2024-09-15T22:26:43.171 INFO:tasks.workunit.client.0.smithi001.stdout:5/362: dwrite d3/f4f [0,4194304] 0 2024-09-15T22:26:43.171 INFO:tasks.workunit.client.0.smithi001.stdout:5/363: write d3/f33 [7041838,3309] 0 2024-09-15T22:26:43.174 INFO:tasks.workunit.client.0.smithi001.stdout:5/364: rename d3/d6/f8 to d3/d27/d5c/f6f 0 2024-09-15T22:26:43.175 INFO:tasks.workunit.client.0.smithi001.stdout:1/429: dwrite d3/dd/d14/d1b/d2b/f56 [0,4194304] 0 2024-09-15T22:26:43.176 INFO:tasks.workunit.client.0.smithi001.stdout:5/365: rename d3/d6/l19 to d3/d1d/d54/d56/d52/d61/l70 0 2024-09-15T22:26:43.179 INFO:tasks.workunit.client.0.smithi001.stdout:1/430: creat d3/dd/d86/f87 x:0 0 0 2024-09-15T22:26:43.185 INFO:tasks.workunit.client.0.smithi001.stdout:1/431: getdents d3/dd/d86 0 2024-09-15T22:26:43.197 INFO:tasks.workunit.client.0.smithi001.stdout:5/366: dread d3/fc [0,4194304] 0 2024-09-15T22:26:43.197 INFO:tasks.workunit.client.0.smithi001.stdout:5/367: chown d3/l15 408951257 1 2024-09-15T22:26:43.203 INFO:tasks.workunit.client.0.smithi001.stdout:5/368: rename d3/d1d/d54/d56/f43 to d3/d1d/d54/d56/d52/d61/f71 0 2024-09-15T22:26:43.203 INFO:tasks.workunit.client.0.smithi001.stdout:5/369: truncate d3/d6/d41/f5e 4847633 0 2024-09-15T22:26:43.210 INFO:tasks.workunit.client.0.smithi001.stdout:4/443: dwrite d0/d27/d35/d61/d20/d29/d40/f5a [0,4194304] 0 2024-09-15T22:26:43.212 INFO:tasks.workunit.client.0.smithi001.stdout:4/444: getdents d0/d27/d35/d61/d20/d29/d34/d84/d95 0 2024-09-15T22:26:43.213 INFO:tasks.workunit.client.0.smithi001.stdout:4/445: creat d0/d27/d35/d61/d20/d29/d34/d9c/fa2 x:0 0 0 2024-09-15T22:26:43.215 INFO:tasks.workunit.client.0.smithi001.stdout:4/446: rename d0/d27/d35/d61/d20/d29/d34/c3f to d0/d27/d35/d59/d67/d7b/ca3 0 2024-09-15T22:26:43.215 INFO:tasks.workunit.client.0.smithi001.stdout:4/447: fsync d0/f48 0 2024-09-15T22:26:43.216 INFO:tasks.workunit.client.0.smithi001.stdout:4/448: mkdir d0/d27/d35/da4 0 2024-09-15T22:26:43.218 INFO:tasks.workunit.client.0.smithi001.stdout:4/449: rename d0/d27/f2c to d0/d27/d35/d61/d20/d29/d40/fa5 0 2024-09-15T22:26:43.218 INFO:tasks.workunit.client.0.smithi001.stdout:8/264: sync 2024-09-15T22:26:43.218 INFO:tasks.workunit.client.0.smithi001.stdout:0/314: sync 2024-09-15T22:26:43.219 INFO:tasks.workunit.client.0.smithi001.stdout:8/265: mknod d9/d19/d29/d33/c44 0 2024-09-15T22:26:43.223 INFO:tasks.workunit.client.0.smithi001.stdout:5/370: dread d3/d27/d5c/f6f [4194304,4194304] 0 2024-09-15T22:26:43.223 INFO:tasks.workunit.client.0.smithi001.stdout:5/371: fdatasync d3/d6/d25/f38 0 2024-09-15T22:26:43.227 INFO:tasks.workunit.client.0.smithi001.stdout:6/317: write d0/d6/f3e [3361084,68104] 0 2024-09-15T22:26:43.227 INFO:tasks.workunit.client.0.smithi001.stdout:7/329: dwrite d0/d7/d44/f47 [0,4194304] 0 2024-09-15T22:26:43.228 INFO:tasks.workunit.client.0.smithi001.stdout:6/318: creat d0/df/d24/f6b x:0 0 0 2024-09-15T22:26:43.229 INFO:tasks.workunit.client.0.smithi001.stdout:7/330: creat d0/d7/d44/d3f/f75 x:0 0 0 2024-09-15T22:26:43.230 INFO:tasks.workunit.client.0.smithi001.stdout:6/319: link d0/d6/d5d/d67/f26 d0/d6/d5d/d67/d53/f6c 0 2024-09-15T22:26:43.230 INFO:tasks.workunit.client.0.smithi001.stdout:6/320: write d0/d6/d5d/d67/f44 [657030,33378] 0 2024-09-15T22:26:43.231 INFO:tasks.workunit.client.0.smithi001.stdout:7/331: rmdir d0/d7 39 2024-09-15T22:26:43.233 INFO:tasks.workunit.client.0.smithi001.stdout:0/315: dread d0/d6/f30 [0,4194304] 0 2024-09-15T22:26:43.233 INFO:tasks.workunit.client.0.smithi001.stdout:0/316: write d0/f2 [3458118,51068] 0 2024-09-15T22:26:43.241 INFO:tasks.workunit.client.0.smithi001.stdout:5/372: dread d3/d1d/d54/d56/d52/d61/f71 [0,4194304] 0 2024-09-15T22:26:43.242 INFO:tasks.workunit.client.0.smithi001.stdout:5/373: creat d3/d49/f72 x:0 0 0 2024-09-15T22:26:43.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:42 smithi012 ceph-mon[34883]: pgmap v411: 97 pgs: 97 active+clean; 387 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 MiB/s rd, 52 MiB/s wr, 1.64k op/s 2024-09-15T22:26:43.252 INFO:tasks.workunit.client.0.smithi001.stdout:6/321: dread d0/f22 [0,4194304] 0 2024-09-15T22:26:43.257 INFO:tasks.workunit.client.0.smithi001.stdout:0/317: dread d0/d6/f15 [0,4194304] 0 2024-09-15T22:26:43.258 INFO:tasks.workunit.client.0.smithi001.stdout:0/318: mknod d0/d9/db/c62 0 2024-09-15T22:26:43.258 INFO:tasks.workunit.client.0.smithi001.stdout:0/319: read d0/f16 [3706889,82700] 0 2024-09-15T22:26:43.262 INFO:tasks.workunit.client.0.smithi001.stdout:8/266: dwrite d9/d19/f3c [0,4194304] 0 2024-09-15T22:26:43.262 INFO:tasks.workunit.client.0.smithi001.stdout:8/267: stat d9/d19/d29/d33/c38 0 2024-09-15T22:26:43.264 INFO:tasks.workunit.client.0.smithi001.stdout:8/268: creat d9/d19/d29/f45 x:0 0 0 2024-09-15T22:26:43.270 INFO:tasks.workunit.client.0.smithi001.stdout:8/269: creat d9/d2f/f46 x:0 0 0 2024-09-15T22:26:43.270 INFO:tasks.workunit.client.0.smithi001.stdout:8/270: write d9/d19/d29/f2a [1197975,115684] 0 2024-09-15T22:26:43.270 INFO:tasks.workunit.client.0.smithi001.stdout:1/432: dwrite d3/dd/f33 [0,4194304] 0 2024-09-15T22:26:43.276 INFO:tasks.workunit.client.0.smithi001.stdout:1/433: rename d3/dd/d14/d1b/d2b/f63 to d3/dd/d3c/d7d/f88 0 2024-09-15T22:26:43.276 INFO:tasks.workunit.client.0.smithi001.stdout:1/434: write d3/dd/d14/d23/d4b/f70 [62748,74959] 0 2024-09-15T22:26:43.276 INFO:tasks.workunit.client.0.smithi001.stdout:1/435: dread - d3/dd/d86/f87 zero size 2024-09-15T22:26:43.276 INFO:tasks.workunit.client.0.smithi001.stdout:1/436: write d3/dd/f38 [1178184,94050] 0 2024-09-15T22:26:43.277 INFO:tasks.workunit.client.0.smithi001.stdout:1/437: mkdir d3/d12/d79/d89 0 2024-09-15T22:26:43.278 INFO:tasks.workunit.client.0.smithi001.stdout:1/438: mkdir d3/dd/d14/d1b/d2b/d68/d8a 0 2024-09-15T22:26:43.284 INFO:tasks.workunit.client.0.smithi001.stdout:9/297: sync 2024-09-15T22:26:43.284 INFO:tasks.workunit.client.0.smithi001.stdout:1/439: creat d3/dd/d14/d1b/d2b/d68/f8b x:0 0 0 2024-09-15T22:26:43.296 INFO:tasks.workunit.client.0.smithi001.stdout:1/440: write d3/d12/f3d [3400093,126225] 0 2024-09-15T22:26:43.300 INFO:tasks.workunit.client.0.smithi001.stdout:8/271: write d9/d2f/f30 [1900502,38565] 0 2024-09-15T22:26:43.302 INFO:tasks.workunit.client.0.smithi001.stdout:7/332: dwrite d0/d7/d21/d2b/f32 [4194304,4194304] 0 2024-09-15T22:26:43.304 INFO:tasks.workunit.client.0.smithi001.stdout:8/272: truncate d9/f21 9069 0 2024-09-15T22:26:43.306 INFO:tasks.workunit.client.0.smithi001.stdout:1/441: write d3/dd/f13 [1131737,30345] 0 2024-09-15T22:26:43.310 INFO:tasks.workunit.client.0.smithi001.stdout:8/273: rename d9/d2f/f46 to d9/d19/d34/f47 0 2024-09-15T22:26:43.310 INFO:tasks.workunit.client.0.smithi001.stdout:8/274: truncate d9/f18 2683784 0 2024-09-15T22:26:43.310 INFO:tasks.workunit.client.0.smithi001.stdout:1/442: truncate d3/f7 3861961 0 2024-09-15T22:26:43.310 INFO:tasks.workunit.client.0.smithi001.stdout:1/443: write d3/dd/f19 [2661128,55055] 0 2024-09-15T22:26:43.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:42 smithi098 ceph-mon[35514]: pgmap v411: 97 pgs: 97 active+clean; 387 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 MiB/s rd, 52 MiB/s wr, 1.64k op/s 2024-09-15T22:26:43.312 INFO:tasks.workunit.client.0.smithi001.stdout:6/322: dwrite d0/df/d24/f3a [0,4194304] 0 2024-09-15T22:26:43.316 INFO:tasks.workunit.client.0.smithi001.stdout:6/323: link d0/c1 d0/c6d 0 2024-09-15T22:26:43.319 INFO:tasks.workunit.client.0.smithi001.stdout:6/324: creat d0/df/f6e x:0 0 0 2024-09-15T22:26:43.319 INFO:tasks.workunit.client.0.smithi001.stdout:6/325: stat d0/d6/d5d/d67/f60 0 2024-09-15T22:26:43.319 INFO:tasks.workunit.client.0.smithi001.stdout:6/326: write d0/df/d24/f3a [4544138,123039] 0 2024-09-15T22:26:43.319 INFO:tasks.workunit.client.0.smithi001.stdout:6/327: fdatasync d0/df/d24/d49/f6a 0 2024-09-15T22:26:43.321 INFO:tasks.workunit.client.0.smithi001.stdout:6/328: rename d0/df/d24/d49/f5e to d0/df/d24/d2e/f6f 0 2024-09-15T22:26:43.323 INFO:tasks.workunit.client.0.smithi001.stdout:6/329: rename d0/df/d24/l32 to d0/df/d24/d2e/d43/l70 0 2024-09-15T22:26:43.324 INFO:tasks.workunit.client.0.smithi001.stdout:6/330: creat d0/d6/f71 x:0 0 0 2024-09-15T22:26:43.326 INFO:tasks.workunit.client.0.smithi001.stdout:6/331: link d0/df/d24/d2e/f45 d0/d6/d5d/d67/d53/f72 0 2024-09-15T22:26:43.327 INFO:tasks.workunit.client.0.smithi001.stdout:6/332: creat d0/df/d24/d2e/d43/f73 x:0 0 0 2024-09-15T22:26:43.328 INFO:tasks.workunit.client.0.smithi001.stdout:6/333: mknod d0/d6/c74 0 2024-09-15T22:26:43.337 INFO:tasks.workunit.client.0.smithi001.stdout:8/275: dread d9/f21 [0,4194304] 0 2024-09-15T22:26:43.337 INFO:tasks.workunit.client.0.smithi001.stdout:8/276: dread - d9/d19/f3d zero size 2024-09-15T22:26:43.339 INFO:tasks.workunit.client.0.smithi001.stdout:8/277: symlink d9/d19/d40/l48 0 2024-09-15T22:26:43.340 INFO:tasks.workunit.client.0.smithi001.stdout:8/278: getdents d9 0 2024-09-15T22:26:43.342 INFO:tasks.workunit.client.0.smithi001.stdout:8/279: link d9/d19/d29/f3e d9/d2f/f49 0 2024-09-15T22:26:43.343 INFO:tasks.workunit.client.0.smithi001.stdout:6/334: read d0/df/d24/f34 [2541381,44472] 0 2024-09-15T22:26:43.343 INFO:tasks.workunit.client.0.smithi001.stdout:8/280: creat d9/d19/d34/f4a x:0 0 0 2024-09-15T22:26:43.345 INFO:tasks.workunit.client.0.smithi001.stdout:6/335: creat d0/d6/d5d/f75 x:0 0 0 2024-09-15T22:26:43.345 INFO:tasks.workunit.client.0.smithi001.stdout:0/320: dwrite d0/d9/d1a/f58 [0,4194304] 0 2024-09-15T22:26:43.345 INFO:tasks.workunit.client.0.smithi001.stdout:7/333: write d0/d7/d44/d36/f72 [1087669,8883] 0 2024-09-15T22:26:43.348 INFO:tasks.workunit.client.0.smithi001.stdout:8/281: rmdir d9 39 2024-09-15T22:26:43.348 INFO:tasks.workunit.client.0.smithi001.stdout:6/336: creat d0/d6/f76 x:0 0 0 2024-09-15T22:26:43.353 INFO:tasks.workunit.client.0.smithi001.stdout:6/337: truncate d0/f2 3413068 0 2024-09-15T22:26:43.353 INFO:tasks.workunit.client.0.smithi001.stdout:6/338: fsync d0/df/d24/d49/f56 0 2024-09-15T22:26:43.353 INFO:tasks.workunit.client.0.smithi001.stdout:6/339: rename d0 to d0/d6/d5d/d67/d77 22 2024-09-15T22:26:43.353 INFO:tasks.workunit.client.0.smithi001.stdout:6/340: chown d0/d6/d5d/d67/d53 3141128 1 2024-09-15T22:26:43.353 INFO:tasks.workunit.client.0.smithi001.stdout:9/298: dwrite d5/de/d1a/d1b/d22/f2f [0,4194304] 0 2024-09-15T22:26:43.353 INFO:tasks.workunit.client.0.smithi001.stdout:1/444: dwrite d3/d12/f3d [0,4194304] 0 2024-09-15T22:26:43.354 INFO:tasks.workunit.client.0.smithi001.stdout:9/299: truncate d5/de/d1a/d1b/f3a 2526317 0 2024-09-15T22:26:43.356 INFO:tasks.workunit.client.0.smithi001.stdout:1/445: symlink d3/dd/d3c/l8c 0 2024-09-15T22:26:43.356 INFO:tasks.workunit.client.0.smithi001.stdout:1/446: dread - d3/dd/d3c/d64/f7e zero size 2024-09-15T22:26:43.358 INFO:tasks.workunit.client.0.smithi001.stdout:1/447: mkdir d3/d8d 0 2024-09-15T22:26:43.364 INFO:tasks.workunit.client.0.smithi001.stdout:1/448: creat d3/dd/d14/d1b/d2b/d68/f8e x:0 0 0 2024-09-15T22:26:43.367 INFO:tasks.workunit.client.0.smithi001.stdout:9/300: dread d5/de/d1a/d1b/d22/d2c/d21/d4d/f4e [0,4194304] 0 2024-09-15T22:26:43.369 INFO:tasks.workunit.client.0.smithi001.stdout:8/282: dread d9/d19/d29/f2a [0,4194304] 0 2024-09-15T22:26:43.372 INFO:tasks.workunit.client.0.smithi001.stdout:8/283: creat d9/d19/d34/d41/f4b x:0 0 0 2024-09-15T22:26:43.373 INFO:tasks.workunit.client.0.smithi001.stdout:8/284: truncate d9/f31 100774 0 2024-09-15T22:26:43.379 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:42 smithi001 ceph-mon[30843]: pgmap v411: 97 pgs: 97 active+clean; 387 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 MiB/s rd, 52 MiB/s wr, 1.64k op/s 2024-09-15T22:26:43.379 INFO:tasks.workunit.client.0.smithi001.stdout:8/285: mknod d9/d2f/c4c 0 2024-09-15T22:26:43.379 INFO:tasks.workunit.client.0.smithi001.stdout:5/374: dwrite d3/d6/d25/f38 [0,4194304] 0 2024-09-15T22:26:43.388 INFO:tasks.workunit.client.0.smithi001.stdout:3/311: sync 2024-09-15T22:26:43.389 INFO:tasks.workunit.client.0.smithi001.stdout:4/450: sync 2024-09-15T22:26:43.389 INFO:tasks.workunit.client.0.smithi001.stdout:3/312: truncate f6 751257 0 2024-09-15T22:26:43.389 INFO:tasks.workunit.client.0.smithi001.stdout:3/313: fdatasync da/d3b/f33 0 2024-09-15T22:26:43.390 INFO:tasks.workunit.client.0.smithi001.stdout:4/451: creat d0/d27/d35/d74/fa6 x:0 0 0 2024-09-15T22:26:43.390 INFO:tasks.workunit.client.0.smithi001.stdout:3/314: stat da/d3d/d43/c15 0 2024-09-15T22:26:43.392 INFO:tasks.workunit.client.0.smithi001.stdout:4/452: creat d0/d27/d35/d61/d20/d29/fa7 x:0 0 0 2024-09-15T22:26:43.395 INFO:tasks.workunit.client.0.smithi001.stdout:3/315: mkdir da/d3b/d1b/d6a 0 2024-09-15T22:26:43.396 INFO:tasks.workunit.client.0.smithi001.stdout:8/286: dread d9/d2f/f30 [0,4194304] 0 2024-09-15T22:26:43.399 INFO:tasks.workunit.client.0.smithi001.stdout:4/453: rename d0/f7 to d0/d27/d35/d61/d20/d29/d34/d84/d95/d73/fa8 0 2024-09-15T22:26:43.399 INFO:tasks.workunit.client.0.smithi001.stdout:8/287: creat d9/d2f/f4d x:0 0 0 2024-09-15T22:26:43.401 INFO:tasks.workunit.client.0.smithi001.stdout:4/454: creat d0/d27/d57/fa9 x:0 0 0 2024-09-15T22:26:43.402 INFO:tasks.workunit.client.0.smithi001.stdout:4/455: rmdir d0/d27/d35/d61/d20/d29/d34/d84 39 2024-09-15T22:26:43.406 INFO:tasks.workunit.client.0.smithi001.stdout:4/456: creat d0/d27/d35/da4/faa x:0 0 0 2024-09-15T22:26:43.406 INFO:tasks.workunit.client.0.smithi001.stdout:4/457: stat d0/d27/d35 0 2024-09-15T22:26:43.409 INFO:tasks.workunit.client.0.smithi001.stdout:7/334: dwrite d0/d7/d2e/f63 [0,4194304] 0 2024-09-15T22:26:43.422 INFO:tasks.workunit.client.0.smithi001.stdout:5/375: write d3/d1d/d54/d56/f4b [1495479,100016] 0 2024-09-15T22:26:43.422 INFO:tasks.workunit.client.0.smithi001.stdout:5/376: write d3/d6/d25/f6a [392398,65912] 0 2024-09-15T22:26:43.425 INFO:tasks.workunit.client.0.smithi001.stdout:5/377: link d3/d6/d41/f5e d3/d6/d41/d4d/f73 0 2024-09-15T22:26:43.427 INFO:tasks.workunit.client.0.smithi001.stdout:2/286: sync 2024-09-15T22:26:43.427 INFO:tasks.workunit.client.0.smithi001.stdout:4/458: dread d0/d27/d35/d53/f8d [0,4194304] 0 2024-09-15T22:26:43.427 INFO:tasks.workunit.client.0.smithi001.stdout:1/449: dwrite d3/dd/d14/d1b/d2b/f56 [4194304,4194304] 0 2024-09-15T22:26:43.427 INFO:tasks.workunit.client.0.smithi001.stdout:6/341: dwrite d0/d6/d5d/d67/f60 [0,4194304] 0 2024-09-15T22:26:43.427 INFO:tasks.workunit.client.0.smithi001.stdout:5/378: mknod d3/d1d/d54/d56/d52/c74 0 2024-09-15T22:26:43.427 INFO:tasks.workunit.client.0.smithi001.stdout:5/379: chown d3 99780 1 2024-09-15T22:26:43.429 INFO:tasks.workunit.client.0.smithi001.stdout:2/287: getdents d2 0 2024-09-15T22:26:43.432 INFO:tasks.workunit.client.0.smithi001.stdout:1/450: mkdir d3/d12/d21/d8f 0 2024-09-15T22:26:43.434 INFO:tasks.workunit.client.0.smithi001.stdout:5/380: dread d3/d6/f59 [0,4194304] 0 2024-09-15T22:26:43.435 INFO:tasks.workunit.client.0.smithi001.stdout:6/342: write d0/d6/fd [46755,131058] 0 2024-09-15T22:26:43.435 INFO:tasks.workunit.client.0.smithi001.stdout:6/343: truncate d0/d6/d5d/f75 480725 0 2024-09-15T22:26:43.435 INFO:tasks.workunit.client.0.smithi001.stdout:7/335: dread d0/d7/f24 [0,4194304] 0 2024-09-15T22:26:43.436 INFO:tasks.workunit.client.0.smithi001.stdout:6/344: creat d0/df/d24/d2e/d43/f78 x:0 0 0 2024-09-15T22:26:43.436 INFO:tasks.workunit.client.0.smithi001.stdout:6/345: write d0/df/d24/d2e/d43/f78 [717687,80746] 0 2024-09-15T22:26:43.438 INFO:tasks.workunit.client.0.smithi001.stdout:4/459: rename d0/d27/d35/d53 to d0/d27/d35/d59/d67/dab 0 2024-09-15T22:26:43.440 INFO:tasks.workunit.client.0.smithi001.stdout:2/288: rename d2/f30 to d2/d12/f59 0 2024-09-15T22:26:43.441 INFO:tasks.workunit.client.0.smithi001.stdout:3/316: write da/d3b/d1b/f60 [1874630,89807] 0 2024-09-15T22:26:43.445 INFO:tasks.workunit.client.0.smithi001.stdout:6/346: rename d0/c1 to d0/df/c79 0 2024-09-15T22:26:43.445 INFO:tasks.workunit.client.0.smithi001.stdout:6/347: chown d0/df/d24/f58 2 1 2024-09-15T22:26:43.445 INFO:tasks.workunit.client.0.smithi001.stdout:3/317: creat da/d3b/d1b/d6a/f6b x:0 0 0 2024-09-15T22:26:43.445 INFO:tasks.workunit.client.0.smithi001.stdout:3/318: rename da/d1f/d2e/d3f/c4f to da/d1f/d2e/d3f/c6c 0 2024-09-15T22:26:43.445 INFO:tasks.workunit.client.0.smithi001.stdout:9/301: dwrite d5/de/d1a/d1b/d22/f4a [0,4194304] 0 2024-09-15T22:26:43.446 INFO:tasks.workunit.client.0.smithi001.stdout:9/302: symlink d5/de/d1a/l5f 0 2024-09-15T22:26:43.446 INFO:tasks.workunit.client.0.smithi001.stdout:9/303: chown d5/de/d1a/c57 0 1 2024-09-15T22:26:43.446 INFO:tasks.workunit.client.0.smithi001.stdout:4/460: mkdir d0/d5d/d44/dac 0 2024-09-15T22:26:43.446 INFO:tasks.workunit.client.0.smithi001.stdout:4/461: stat d0/d27/d35/d61/d20/d29/d40/f5a 0 2024-09-15T22:26:43.447 INFO:tasks.workunit.client.0.smithi001.stdout:9/304: link d5/de/d1a/d1b/d22/f2f d5/de/d51/d53/f60 0 2024-09-15T22:26:43.447 INFO:tasks.workunit.client.0.smithi001.stdout:3/319: write da/d1f/f22 [638425,122113] 0 2024-09-15T22:26:43.447 INFO:tasks.workunit.client.0.smithi001.stdout:4/462: getdents d0/d27/d35/d61/d20/d29/d34/d3a 0 2024-09-15T22:26:43.449 INFO:tasks.workunit.client.0.smithi001.stdout:3/320: symlink da/d16/l6d 0 2024-09-15T22:26:43.451 INFO:tasks.workunit.client.0.smithi001.stdout:3/321: getdents da/d3b/d1b 0 2024-09-15T22:26:43.451 INFO:tasks.workunit.client.0.smithi001.stdout:3/322: dread - da/d3d/d43/f2a zero size 2024-09-15T22:26:43.453 INFO:tasks.workunit.client.0.smithi001.stdout:4/463: rmdir d0/d27/d35/d59/d67 39 2024-09-15T22:26:43.455 INFO:tasks.workunit.client.0.smithi001.stdout:3/323: mknod da/c6e 0 2024-09-15T22:26:43.455 INFO:tasks.workunit.client.0.smithi001.stdout:3/324: chown da/d1f/d2e/f55 66128 1 2024-09-15T22:26:43.455 INFO:tasks.workunit.client.0.smithi001.stdout:3/325: chown da/d3b/f66 0 1 2024-09-15T22:26:43.455 INFO:tasks.workunit.client.0.smithi001.stdout:4/464: getdents d0/d27/d35/d74 0 2024-09-15T22:26:43.456 INFO:tasks.workunit.client.0.smithi001.stdout:9/305: dread d5/de/d1a/d1b/d22/f4a [4194304,4194304] 0 2024-09-15T22:26:43.457 INFO:tasks.workunit.client.0.smithi001.stdout:3/326: mkdir da/d3b/d1b/d6a/d6f 0 2024-09-15T22:26:43.459 INFO:tasks.workunit.client.0.smithi001.stdout:9/306: rmdir d5/de/d1a 39 2024-09-15T22:26:43.459 INFO:tasks.workunit.client.0.smithi001.stdout:9/307: write d5/d3e/f52 [1610171,43139] 0 2024-09-15T22:26:43.460 INFO:tasks.workunit.client.0.smithi001.stdout:9/308: rmdir d5/de/d1a/d38 39 2024-09-15T22:26:43.465 INFO:tasks.workunit.client.0.smithi001.stdout:9/309: link d5/f44 d5/de/d1a/d1b/d22/d2c/f61 0 2024-09-15T22:26:43.465 INFO:tasks.workunit.client.0.smithi001.stdout:6/348: dread d0/d6/d5d/d67/f60 [0,4194304] 0 2024-09-15T22:26:43.466 INFO:tasks.workunit.client.0.smithi001.stdout:6/349: creat d0/df/d24/f7a x:0 0 0 2024-09-15T22:26:43.467 INFO:tasks.workunit.client.0.smithi001.stdout:6/350: mkdir d0/df/d24/d7b 0 2024-09-15T22:26:43.470 INFO:tasks.workunit.client.0.smithi001.stdout:8/288: dwrite d9/d19/f3f [0,4194304] 0 2024-09-15T22:26:43.476 INFO:tasks.workunit.client.0.smithi001.stdout:6/351: symlink d0/df/d24/d7b/l7c 0 2024-09-15T22:26:43.477 INFO:tasks.workunit.client.0.smithi001.stdout:6/352: write d0/df/d24/d2e/d43/d30/f64 [1356749,113979] 0 2024-09-15T22:26:43.480 INFO:tasks.workunit.client.0.smithi001.stdout:8/289: unlink d9/d19/c25 0 2024-09-15T22:26:43.488 INFO:tasks.workunit.client.0.smithi001.stdout:4/465: dread d0/fd [0,4194304] 0 2024-09-15T22:26:43.488 INFO:tasks.workunit.client.0.smithi001.stdout:4/466: fdatasync d0/d27/d35/d61/d20/d29/d34/f70 0 2024-09-15T22:26:43.488 INFO:tasks.workunit.client.0.smithi001.stdout:4/467: dread - d0/d27/d35/f9d zero size 2024-09-15T22:26:43.492 INFO:tasks.workunit.client.0.smithi001.stdout:4/468: creat d0/d27/d35/d61/d20/d29/d34/da0/fad x:0 0 0 2024-09-15T22:26:43.502 INFO:tasks.workunit.client.0.smithi001.stdout:9/310: dwrite d5/f59 [0,4194304] 0 2024-09-15T22:26:43.503 INFO:tasks.workunit.client.0.smithi001.stdout:9/311: creat d5/de/d15/f62 x:0 0 0 2024-09-15T22:26:43.508 INFO:tasks.workunit.client.0.smithi001.stdout:9/312: mkdir d5/de/d15/d27/d63 0 2024-09-15T22:26:43.508 INFO:tasks.workunit.client.0.smithi001.stdout:0/321: sync 2024-09-15T22:26:43.508 INFO:tasks.workunit.client.0.smithi001.stdout:0/322: chown d0/d6/c22 397124 1 2024-09-15T22:26:43.508 INFO:tasks.workunit.client.0.smithi001.stdout:5/381: dwrite d3/d27/f46 [0,4194304] 0 2024-09-15T22:26:43.509 INFO:tasks.workunit.client.0.smithi001.stdout:0/323: mkdir d0/dd/d63 0 2024-09-15T22:26:43.512 INFO:tasks.workunit.client.0.smithi001.stdout:1/451: dwrite d3/dd/d3c/d64/f6a [0,4194304] 0 2024-09-15T22:26:43.513 INFO:tasks.workunit.client.0.smithi001.stdout:0/324: creat d0/d9/d1a/f64 x:0 0 0 2024-09-15T22:26:43.513 INFO:tasks.workunit.client.0.smithi001.stdout:0/325: chown d0/f16 1993219 1 2024-09-15T22:26:43.515 INFO:tasks.workunit.client.0.smithi001.stdout:0/326: symlink d0/dd/d33/l65 0 2024-09-15T22:26:43.515 INFO:tasks.workunit.client.0.smithi001.stdout:0/327: readlink d0/d9/db/l4a 0 2024-09-15T22:26:43.515 INFO:tasks.workunit.client.0.smithi001.stdout:0/328: fdatasync d0/d9/f39 0 2024-09-15T22:26:43.515 INFO:tasks.workunit.client.0.smithi001.stdout:0/329: read d0/dd/ff [927632,9471] 0 2024-09-15T22:26:43.516 INFO:tasks.workunit.client.0.smithi001.stdout:4/469: write d0/d5d/d44/d65/f7d [2531680,22937] 0 2024-09-15T22:26:43.517 INFO:tasks.workunit.client.0.smithi001.stdout:5/382: write d3/f33 [4175126,74467] 0 2024-09-15T22:26:43.523 INFO:tasks.workunit.client.0.smithi001.stdout:0/330: creat d0/d9/db/f66 x:0 0 0 2024-09-15T22:26:43.523 INFO:tasks.workunit.client.0.smithi001.stdout:4/470: creat d0/d5d/d44/d65/fae x:0 0 0 2024-09-15T22:26:43.523 INFO:tasks.workunit.client.0.smithi001.stdout:5/383: getdents d3/d6/d41/d65 0 2024-09-15T22:26:43.523 INFO:tasks.workunit.client.0.smithi001.stdout:5/384: write d3/d6/d41/f4c [10051,129716] 0 2024-09-15T22:26:43.524 INFO:tasks.workunit.client.0.smithi001.stdout:4/471: rmdir d0/d27/d35/d59/d67 39 2024-09-15T22:26:43.524 INFO:tasks.workunit.client.0.smithi001.stdout:4/472: rmdir d0/d27/d35/d61/d20/d29 39 2024-09-15T22:26:43.524 INFO:tasks.workunit.client.0.smithi001.stdout:4/473: dread - d0/d27/d35/d61/d20/d29/f92 zero size 2024-09-15T22:26:43.525 INFO:tasks.workunit.client.0.smithi001.stdout:1/452: dread d3/dd/d3c/d7d/f88 [0,4194304] 0 2024-09-15T22:26:43.525 INFO:tasks.workunit.client.0.smithi001.stdout:1/453: write d3/d12/f40 [13486,43410] 0 2024-09-15T22:26:43.527 INFO:tasks.workunit.client.0.smithi001.stdout:7/336: dwrite d0/d7/d21/d2b/f37 [0,4194304] 0 2024-09-15T22:26:43.530 INFO:tasks.workunit.client.0.smithi001.stdout:1/454: rmdir d3/dd/d53/d84 0 2024-09-15T22:26:43.534 INFO:tasks.workunit.client.0.smithi001.stdout:1/455: mkdir d3/d12/d90 0 2024-09-15T22:26:43.539 INFO:tasks.workunit.client.0.smithi001.stdout:9/313: write d5/de/d51/d53/f60 [2149897,35959] 0 2024-09-15T22:26:43.539 INFO:tasks.workunit.client.0.smithi001.stdout:0/331: dread d0/dd/ff [0,4194304] 0 2024-09-15T22:26:43.541 INFO:tasks.workunit.client.0.smithi001.stdout:0/332: link d0/d9/db/c62 d0/d9/db/d5d/c67 0 2024-09-15T22:26:43.541 INFO:tasks.workunit.client.0.smithi001.stdout:5/385: dread d3/d1d/d54/d56/f4b [0,4194304] 0 2024-09-15T22:26:43.542 INFO:tasks.workunit.client.0.smithi001.stdout:5/386: truncate d3/d1d/d54/d56/f4a 8075607 0 2024-09-15T22:26:43.543 INFO:tasks.workunit.client.0.smithi001.stdout:8/290: dwrite d9/d19/f3d [0,4194304] 0 2024-09-15T22:26:43.559 INFO:tasks.workunit.client.0.smithi001.stdout:3/327: dwrite da/d3b/f25 [0,4194304] 0 2024-09-15T22:26:43.559 INFO:tasks.workunit.client.0.smithi001.stdout:3/328: chown da/d16/c2b 0 1 2024-09-15T22:26:43.565 INFO:tasks.workunit.client.0.smithi001.stdout:3/329: mkdir da/d3d/d43/d41/d70 0 2024-09-15T22:26:43.567 INFO:tasks.workunit.client.0.smithi001.stdout:3/330: rename da/d3b/f29 to da/d3b/d1b/d6a/d6f/f71 0 2024-09-15T22:26:43.570 INFO:tasks.workunit.client.0.smithi001.stdout:5/387: write d3/d27/f46 [1020652,42254] 0 2024-09-15T22:26:43.571 INFO:tasks.workunit.client.0.smithi001.stdout:5/388: creat d3/d1d/d54/d56/d52/f75 x:0 0 0 2024-09-15T22:26:43.573 INFO:tasks.workunit.client.0.smithi001.stdout:5/389: creat d3/d1d/d54/d56/f76 x:0 0 0 2024-09-15T22:26:43.573 INFO:tasks.workunit.client.0.smithi001.stdout:6/353: dwrite d0/f33 [0,4194304] 0 2024-09-15T22:26:43.574 INFO:tasks.workunit.client.0.smithi001.stdout:5/390: symlink d3/d6/d41/l77 0 2024-09-15T22:26:43.576 INFO:tasks.workunit.client.0.smithi001.stdout:5/391: symlink d3/d6/d41/l78 0 2024-09-15T22:26:43.576 INFO:tasks.workunit.client.0.smithi001.stdout:5/392: write d3/f16 [534096,111658] 0 2024-09-15T22:26:43.576 INFO:tasks.workunit.client.0.smithi001.stdout:5/393: truncate d3/d49/f72 158862 0 2024-09-15T22:26:43.576 INFO:tasks.workunit.client.0.smithi001.stdout:5/394: chown d3/d6/d41/f5e 31073 1 2024-09-15T22:26:43.590 INFO:tasks.workunit.client.0.smithi001.stdout:6/354: dread d0/d6/d5d/d67/d53/f72 [0,4194304] 0 2024-09-15T22:26:43.598 INFO:tasks.workunit.client.0.smithi001.stdout:5/395: write d3/f4f [1632185,116310] 0 2024-09-15T22:26:43.599 INFO:tasks.workunit.client.0.smithi001.stdout:5/396: creat d3/d6/d25/f79 x:0 0 0 2024-09-15T22:26:43.617 INFO:tasks.workunit.client.0.smithi001.stdout:8/291: dwrite d9/d19/d34/f47 [0,4194304] 0 2024-09-15T22:26:43.618 INFO:tasks.workunit.client.0.smithi001.stdout:7/337: dwrite d0/d7/d44/f1c [4194304,4194304] 0 2024-09-15T22:26:43.618 INFO:tasks.workunit.client.0.smithi001.stdout:7/338: write d0/d7/d21/d6b/f29 [3941151,35774] 0 2024-09-15T22:26:43.619 INFO:tasks.workunit.client.0.smithi001.stdout:1/456: dwrite d3/d12/d79/f81 [0,4194304] 0 2024-09-15T22:26:43.621 INFO:tasks.workunit.client.0.smithi001.stdout:3/331: dwrite f8 [4194304,4194304] 0 2024-09-15T22:26:43.621 INFO:tasks.workunit.client.0.smithi001.stdout:3/332: fsync da/d3b/d1b/f2c 0 2024-09-15T22:26:43.621 INFO:tasks.workunit.client.0.smithi001.stdout:3/333: truncate da/d3d/d43/d41/f5e 967775 0 2024-09-15T22:26:43.626 INFO:tasks.workunit.client.0.smithi001.stdout:7/339: unlink d0/d7/d21/l73 0 2024-09-15T22:26:43.626 INFO:tasks.workunit.client.0.smithi001.stdout:7/340: write d0/d7/f24 [2462951,106245] 0 2024-09-15T22:26:43.626 INFO:tasks.workunit.client.0.smithi001.stdout:7/341: chown d0/d7/d21/d2b/d3e/f4b 0 1 2024-09-15T22:26:43.628 INFO:tasks.workunit.client.0.smithi001.stdout:1/457: unlink d3/f9 0 2024-09-15T22:26:43.633 INFO:tasks.workunit.client.0.smithi001.stdout:6/355: dwrite d0/d6/d5d/d67/f26 [4194304,4194304] 0 2024-09-15T22:26:43.633 INFO:tasks.workunit.client.0.smithi001.stdout:6/356: readlink d0/df/d24/l57 0 2024-09-15T22:26:43.637 INFO:tasks.workunit.client.0.smithi001.stdout:3/334: mkdir da/d1f/d2e/d53/d72 0 2024-09-15T22:26:43.637 INFO:tasks.workunit.client.0.smithi001.stdout:7/342: getdents d0/d7/d44/d3f/d49 0 2024-09-15T22:26:43.637 INFO:tasks.workunit.client.0.smithi001.stdout:1/458: mkdir d3/d8d/d91 0 2024-09-15T22:26:43.637 INFO:tasks.workunit.client.0.smithi001.stdout:8/292: truncate d9/d19/d34/f47 1271177 0 2024-09-15T22:26:43.639 INFO:tasks.workunit.client.0.smithi001.stdout:7/343: rename d0/d7/d44/d36/f62 to d0/f76 0 2024-09-15T22:26:43.639 INFO:tasks.workunit.client.0.smithi001.stdout:7/344: write d0/d7/d44/d36/f72 [947830,85137] 0 2024-09-15T22:26:43.640 INFO:tasks.workunit.client.0.smithi001.stdout:1/459: creat d3/dd/d69/f92 x:0 0 0 2024-09-15T22:26:43.654 INFO:tasks.workunit.client.0.smithi001.stdout:6/357: write d0/df/d24/f3a [2005597,115586] 0 2024-09-15T22:26:43.654 INFO:tasks.workunit.client.0.smithi001.stdout:2/289: sync 2024-09-15T22:26:43.665 INFO:tasks.workunit.client.0.smithi001.stdout:9/314: dwrite d5/de/d51/d53/f60 [0,4194304] 0 2024-09-15T22:26:43.666 INFO:tasks.workunit.client.0.smithi001.stdout:6/358: mkdir d0/df/d24/d7d 0 2024-09-15T22:26:43.668 INFO:tasks.workunit.client.0.smithi001.stdout:6/359: unlink d0/df/c79 0 2024-09-15T22:26:43.671 INFO:tasks.workunit.client.0.smithi001.stdout:6/360: unlink d0/df/d24/l57 0 2024-09-15T22:26:43.671 INFO:tasks.workunit.client.0.smithi001.stdout:6/361: stat d0/d6/c74 0 2024-09-15T22:26:43.671 INFO:tasks.workunit.client.0.smithi001.stdout:6/362: chown d0/d6/d5d/d67/f38 13284440 1 2024-09-15T22:26:43.683 INFO:tasks.workunit.client.0.smithi001.stdout:9/315: write d5/de/d15/f30 [4070494,120318] 0 2024-09-15T22:26:43.687 INFO:tasks.workunit.client.0.smithi001.stdout:8/293: dwrite d9/d19/d34/d41/f4b [0,4194304] 0 2024-09-15T22:26:43.689 INFO:tasks.workunit.client.0.smithi001.stdout:8/294: creat d9/d2f/f4e x:0 0 0 2024-09-15T22:26:43.691 INFO:tasks.workunit.client.0.smithi001.stdout:8/295: rmdir d9/d19/d34/d41 39 2024-09-15T22:26:43.691 INFO:tasks.workunit.client.0.smithi001.stdout:8/296: truncate d9/fa 5742989 0 2024-09-15T22:26:43.692 INFO:tasks.workunit.client.0.smithi001.stdout:8/297: creat d9/d19/d40/f4f x:0 0 0 2024-09-15T22:26:43.693 INFO:tasks.workunit.client.0.smithi001.stdout:8/298: readlink d9/d19/l2e 0 2024-09-15T22:26:43.694 INFO:tasks.workunit.client.0.smithi001.stdout:8/299: mkdir d9/d19/d29/d50 0 2024-09-15T22:26:43.696 INFO:tasks.workunit.client.0.smithi001.stdout:8/300: symlink d9/d19/l51 0 2024-09-15T22:26:43.697 INFO:tasks.workunit.client.0.smithi001.stdout:8/301: creat d9/d19/d29/d50/f52 x:0 0 0 2024-09-15T22:26:43.698 INFO:tasks.workunit.client.0.smithi001.stdout:9/316: dread d5/f11 [0,4194304] 0 2024-09-15T22:26:43.700 INFO:tasks.workunit.client.0.smithi001.stdout:7/345: write d0/d7/d44/f47 [2031775,109896] 0 2024-09-15T22:26:43.700 INFO:tasks.workunit.client.0.smithi001.stdout:7/346: write d0/d7/d21/d2b/d3e/f67 [321278,103541] 0 2024-09-15T22:26:43.701 INFO:tasks.workunit.client.0.smithi001.stdout:2/290: dread d2/d14/d17/d1f/f3c [0,4194304] 0 2024-09-15T22:26:43.701 INFO:tasks.workunit.client.0.smithi001.stdout:8/302: rmdir d9/d19/d29 39 2024-09-15T22:26:43.702 INFO:tasks.workunit.client.0.smithi001.stdout:7/347: mknod d0/d7/d21/d2b/d3e/c77 0 2024-09-15T22:26:43.704 INFO:tasks.workunit.client.0.smithi001.stdout:2/291: creat d2/f5a x:0 0 0 2024-09-15T22:26:43.704 INFO:tasks.workunit.client.0.smithi001.stdout:2/292: dread - d2/d14/d1a/d20/f4a zero size 2024-09-15T22:26:43.704 INFO:tasks.workunit.client.0.smithi001.stdout:2/293: stat d2 0 2024-09-15T22:26:43.704 INFO:tasks.workunit.client.0.smithi001.stdout:2/294: write d2/d14/d1a/d1b/f58 [161722,9347] 0 2024-09-15T22:26:43.704 INFO:tasks.workunit.client.0.smithi001.stdout:9/317: rmdir d5/de/d1a/d1b/d22/d2c/d21/d24 39 2024-09-15T22:26:43.704 INFO:tasks.workunit.client.0.smithi001.stdout:9/318: write d5/de/d1a/d1b/d22/d2c/f31 [4560853,33426] 0 2024-09-15T22:26:43.704 INFO:tasks.workunit.client.0.smithi001.stdout:9/319: fsync d5/de/d1a/d1b/d22/d2c/f61 0 2024-09-15T22:26:43.705 INFO:tasks.workunit.client.0.smithi001.stdout:2/295: rmdir d2/d12 39 2024-09-15T22:26:43.705 INFO:tasks.workunit.client.0.smithi001.stdout:2/296: mknod d2/c5b 0 2024-09-15T22:26:43.706 INFO:tasks.workunit.client.0.smithi001.stdout:2/297: link d2/d14/d1a/d20/c57 d2/c5c 0 2024-09-15T22:26:43.708 INFO:tasks.workunit.client.0.smithi001.stdout:7/348: read d0/d7/f53 [555916,119289] 0 2024-09-15T22:26:43.708 INFO:tasks.workunit.client.0.smithi001.stdout:3/335: dwrite da/d16/ff [0,4194304] 0 2024-09-15T22:26:43.708 INFO:tasks.workunit.client.0.smithi001.stdout:3/336: read da/d1f/f28 [87972,61461] 0 2024-09-15T22:26:43.720 INFO:tasks.workunit.client.0.smithi001.stdout:7/349: creat d0/d7/d44/f78 x:0 0 0 2024-09-15T22:26:43.724 INFO:tasks.workunit.client.0.smithi001.stdout:3/337: mkdir da/d1f/d2e/d53/d73 0 2024-09-15T22:26:43.726 INFO:tasks.workunit.client.0.smithi001.stdout:9/320: write d5/de/d1a/d1b/d22/f2f [4153419,34348] 0 2024-09-15T22:26:43.726 INFO:tasks.workunit.client.0.smithi001.stdout:9/321: chown d5 2886026 1 2024-09-15T22:26:43.729 INFO:tasks.workunit.client.0.smithi001.stdout:3/338: mknod da/d3b/d1b/c74 0 2024-09-15T22:26:43.730 INFO:tasks.workunit.client.0.smithi001.stdout:3/339: chown da/l65 3926090 1 2024-09-15T22:26:43.730 INFO:tasks.workunit.client.0.smithi001.stdout:3/340: write da/d3b/d1b/f2c [485193,74997] 0 2024-09-15T22:26:43.731 INFO:tasks.workunit.client.0.smithi001.stdout:1/460: dwrite d3/dd/f19 [4194304,4194304] 0 2024-09-15T22:26:43.734 INFO:tasks.workunit.client.0.smithi001.stdout:3/341: mknod da/d3d/d43/d41/c75 0 2024-09-15T22:26:43.736 INFO:tasks.workunit.client.0.smithi001.stdout:8/303: dwrite f4 [0,4194304] 0 2024-09-15T22:26:43.748 INFO:tasks.workunit.client.0.smithi001.stdout:1/461: dread d3/dd/f33 [0,4194304] 0 2024-09-15T22:26:43.748 INFO:tasks.workunit.client.0.smithi001.stdout:1/462: chown d3/dd/d14/d1b/f6c 41202446 1 2024-09-15T22:26:43.748 INFO:tasks.workunit.client.0.smithi001.stdout:1/463: read d3/dd/d14/d1b/f6d [754802,123541] 0 2024-09-15T22:26:43.748 INFO:tasks.workunit.client.0.smithi001.stdout:3/342: unlink f7 0 2024-09-15T22:26:43.748 INFO:tasks.workunit.client.0.smithi001.stdout:3/343: truncate da/f1c 1043975 0 2024-09-15T22:26:43.760 INFO:tasks.workunit.client.0.smithi001.stdout:7/350: rename d0/d7/d21/f52 to d0/d7/f79 0 2024-09-15T22:26:43.762 INFO:tasks.workunit.client.0.smithi001.stdout:2/298: unlink d2/d14/l1e 0 2024-09-15T22:26:43.765 INFO:tasks.workunit.client.0.smithi001.stdout:3/344: write da/d3d/d43/d41/f54 [527002,59828] 0 2024-09-15T22:26:43.770 INFO:tasks.workunit.client.0.smithi001.stdout:7/351: creat d0/f7a x:0 0 0 2024-09-15T22:26:43.774 INFO:tasks.workunit.client.0.smithi001.stdout:2/299: symlink d2/d14/d1a/d1b/l5d 0 2024-09-15T22:26:43.774 INFO:tasks.workunit.client.0.smithi001.stdout:9/322: rename d5/f37 to d5/de/d1a/f64 0 2024-09-15T22:26:43.774 INFO:tasks.workunit.client.0.smithi001.stdout:9/323: read - d5/de/d15/f62 zero size 2024-09-15T22:26:43.774 INFO:tasks.workunit.client.0.smithi001.stdout:8/304: rmdir d9/d19 39 2024-09-15T22:26:43.774 INFO:tasks.workunit.client.0.smithi001.stdout:8/305: chown f8 1911859929 1 2024-09-15T22:26:43.774 INFO:tasks.workunit.client.0.smithi001.stdout:8/306: getdents d9 0 2024-09-15T22:26:43.775 INFO:tasks.workunit.client.0.smithi001.stdout:8/307: chown d9/f31 2881698 1 2024-09-15T22:26:43.776 INFO:tasks.workunit.client.0.smithi001.stdout:8/308: symlink d9/d19/d29/d50/l53 0 2024-09-15T22:26:43.776 INFO:tasks.workunit.client.0.smithi001.stdout:8/309: fdatasync d9/d19/f2b 0 2024-09-15T22:26:43.777 INFO:tasks.workunit.client.0.smithi001.stdout:8/310: fsync d9/d19/f1e 0 2024-09-15T22:26:43.786 INFO:tasks.workunit.client.0.smithi001.stdout:7/352: dread d0/f2a [0,4194304] 0 2024-09-15T22:26:43.786 INFO:tasks.workunit.client.0.smithi001.stdout:7/353: dread - d0/d7/d21/d2b/d3e/f41 zero size 2024-09-15T22:26:43.787 INFO:tasks.workunit.client.0.smithi001.stdout:8/311: dread d9/d19/f2b [0,4194304] 0 2024-09-15T22:26:43.789 INFO:tasks.workunit.client.0.smithi001.stdout:8/312: creat d9/d2f/f54 x:0 0 0 2024-09-15T22:26:43.789 INFO:tasks.workunit.client.0.smithi001.stdout:7/354: truncate d0/d7/f24 1380423 0 2024-09-15T22:26:43.790 INFO:tasks.workunit.client.0.smithi001.stdout:8/313: rename d9/d19/c37 to d9/d19/d34/c55 0 2024-09-15T22:26:43.791 INFO:tasks.workunit.client.0.smithi001.stdout:8/314: readlink d9/d19/l26 0 2024-09-15T22:26:43.791 INFO:tasks.workunit.client.0.smithi001.stdout:7/355: mknod d0/d7/d44/d3f/d49/c7b 0 2024-09-15T22:26:43.793 INFO:tasks.workunit.client.0.smithi001.stdout:8/315: rename d9/c20 to d9/d19/d34/d41/c56 0 2024-09-15T22:26:43.794 INFO:tasks.workunit.client.0.smithi001.stdout:7/356: getdents d0/d7/d21/d2b/d3e 0 2024-09-15T22:26:43.796 INFO:tasks.workunit.client.0.smithi001.stdout:7/357: truncate d0/d7/d21/d6b/f29 8352961 0 2024-09-15T22:26:43.796 INFO:tasks.workunit.client.0.smithi001.stdout:7/358: fsync d0/d7/f24 0 2024-09-15T22:26:43.796 INFO:tasks.workunit.client.0.smithi001.stdout:7/359: chown d0/d7/l14 59043498 1 2024-09-15T22:26:43.796 INFO:tasks.workunit.client.0.smithi001.stdout:7/360: chown d0/d7/d44/d3f/d49/d4f/l61 286 1 2024-09-15T22:26:43.796 INFO:tasks.workunit.client.0.smithi001.stdout:7/361: fdatasync d0/d7/d44/d3f/d49/f59 0 2024-09-15T22:26:43.801 INFO:tasks.workunit.client.0.smithi001.stdout:7/362: rename d0/d7/d44/d6f to d0/d7/d7c 0 2024-09-15T22:26:43.810 INFO:tasks.workunit.client.0.smithi001.stdout:9/324: dread d5/d3e/f52 [0,4194304] 0 2024-09-15T22:26:43.810 INFO:tasks.workunit.client.0.smithi001.stdout:7/363: dread d0/d7/d21/d2b/d3e/f67 [0,4194304] 0 2024-09-15T22:26:43.813 INFO:tasks.workunit.client.0.smithi001.stdout:3/345: dwrite da/d3b/d1b/f2c [0,4194304] 0 2024-09-15T22:26:43.813 INFO:tasks.workunit.client.0.smithi001.stdout:3/346: stat da/d3b/f3c 0 2024-09-15T22:26:43.823 INFO:tasks.workunit.client.0.smithi001.stdout:9/325: rmdir d5/d3e 39 2024-09-15T22:26:43.834 INFO:tasks.workunit.client.0.smithi001.stdout:3/347: write da/d3b/d1b/f2c [179361,102192] 0 2024-09-15T22:26:43.834 INFO:tasks.workunit.client.0.smithi001.stdout:9/326: creat d5/de/d1a/d1b/d22/f65 x:0 0 0 2024-09-15T22:26:43.837 INFO:tasks.workunit.client.0.smithi001.stdout:3/348: creat da/d3b/d1b/f76 x:0 0 0 2024-09-15T22:26:43.847 INFO:tasks.workunit.client.0.smithi001.stdout:9/327: dread d5/de/d15/f30 [0,4194304] 0 2024-09-15T22:26:43.847 INFO:tasks.workunit.client.0.smithi001.stdout:9/328: write d5/de/d1a/d1b/d22/f65 [640611,49973] 0 2024-09-15T22:26:43.847 INFO:tasks.workunit.client.0.smithi001.stdout:9/329: readlink d5/de/d15/l36 0 2024-09-15T22:26:43.847 INFO:tasks.workunit.client.0.smithi001.stdout:8/316: dwrite d9/f31 [0,4194304] 0 2024-09-15T22:26:43.848 INFO:tasks.workunit.client.0.smithi001.stdout:9/330: symlink d5/de/d1a/d1b/d22/d2c/d21/l66 0 2024-09-15T22:26:43.849 INFO:tasks.workunit.client.0.smithi001.stdout:8/317: creat d9/d19/d40/f57 x:0 0 0 2024-09-15T22:26:43.849 INFO:tasks.workunit.client.0.smithi001.stdout:8/318: write d9/f27 [773651,1861] 0 2024-09-15T22:26:43.849 INFO:tasks.workunit.client.0.smithi001.stdout:8/319: readlink d9/l10 0 2024-09-15T22:26:43.850 INFO:tasks.workunit.client.0.smithi001.stdout:9/331: unlink d5/de/d15/f30 0 2024-09-15T22:26:43.851 INFO:tasks.workunit.client.0.smithi001.stdout:9/332: write d5/f44 [4024805,37454] 0 2024-09-15T22:26:43.852 INFO:tasks.workunit.client.0.smithi001.stdout:8/320: getdents d9/d2f 0 2024-09-15T22:26:43.852 INFO:tasks.workunit.client.0.smithi001.stdout:8/321: truncate d9/f3a 1020971 0 2024-09-15T22:26:43.853 INFO:tasks.workunit.client.0.smithi001.stdout:9/333: mknod d5/de/d1a/d38/c67 0 2024-09-15T22:26:43.853 INFO:tasks.workunit.client.0.smithi001.stdout:9/334: stat d5/de/d15/d27/f50 0 2024-09-15T22:26:43.855 INFO:tasks.workunit.client.0.smithi001.stdout:8/322: rename d9/d2f to d9/d19/d58 0 2024-09-15T22:26:43.867 INFO:tasks.workunit.client.0.smithi001.stdout:0/333: sync 2024-09-15T22:26:43.867 INFO:tasks.workunit.client.0.smithi001.stdout:4/474: sync 2024-09-15T22:26:43.875 INFO:tasks.workunit.client.0.smithi001.stdout:0/334: truncate d0/d9/d1a/f58 567405 0 2024-09-15T22:26:43.879 INFO:tasks.workunit.client.0.smithi001.stdout:4/475: getdents d0/d27/d35/d59/d67/dab 0 2024-09-15T22:26:43.882 INFO:tasks.workunit.client.0.smithi001.stdout:9/335: dread d5/de/d1a/d1b/d22/d2c/d21/d24/f4c [0,4194304] 0 2024-09-15T22:26:43.883 INFO:tasks.workunit.client.0.smithi001.stdout:3/349: dwrite da/f13 [0,4194304] 0 2024-09-15T22:26:43.887 INFO:tasks.workunit.client.0.smithi001.stdout:4/476: mknod d0/d5d/d44/caf 0 2024-09-15T22:26:43.887 INFO:tasks.workunit.client.0.smithi001.stdout:9/336: rmdir d5/de/d1a/d1b/d22/d2c/d21/d24 39 2024-09-15T22:26:43.892 INFO:tasks.workunit.client.0.smithi001.stdout:4/477: creat d0/d27/d35/d59/fb0 x:0 0 0 2024-09-15T22:26:43.893 INFO:tasks.workunit.client.0.smithi001.stdout:4/478: dread - d0/d27/d35/d61/d20/d29/d40/f71 zero size 2024-09-15T22:26:43.893 INFO:tasks.workunit.client.0.smithi001.stdout:4/479: dread - d0/d27/d35/d61/d20/d29/fa7 zero size 2024-09-15T22:26:43.900 INFO:tasks.workunit.client.0.smithi001.stdout:4/480: creat d0/d27/d35/d61/d20/d29/fb1 x:0 0 0 2024-09-15T22:26:43.901 INFO:tasks.workunit.client.0.smithi001.stdout:4/481: readlink d0/l78 0 2024-09-15T22:26:43.904 INFO:tasks.workunit.client.0.smithi001.stdout:4/482: rename d0/d27/d57 to d0/d27/d35/d61/d20/d29/d34/db2 0 2024-09-15T22:26:43.907 INFO:tasks.workunit.client.0.smithi001.stdout:4/483: mknod d0/d5d/d44/d65/cb3 0 2024-09-15T22:26:43.907 INFO:tasks.workunit.client.0.smithi001.stdout:4/484: chown d0/d27/d35/d61/d20/d29/d40/f4d 49038 1 2024-09-15T22:26:43.907 INFO:tasks.workunit.client.0.smithi001.stdout:4/485: write d0/d5d/f9b [638904,3271] 0 2024-09-15T22:26:43.907 INFO:tasks.workunit.client.0.smithi001.stdout:4/486: chown d0/d27/d35/d61/d20/d29/d40/f5a 504107 1 2024-09-15T22:26:43.908 INFO:tasks.workunit.client.0.smithi001.stdout:4/487: rename d0/d27/d35/d61/f23 to d0/d5d/fb4 0 2024-09-15T22:26:43.911 INFO:tasks.workunit.client.0.smithi001.stdout:4/488: symlink d0/d27/d35/d61/d20/d29/d34/d84/lb5 0 2024-09-15T22:26:43.920 INFO:tasks.workunit.client.0.smithi001.stdout:8/323: dwrite d9/d19/d58/f30 [0,4194304] 0 2024-09-15T22:26:43.922 INFO:tasks.workunit.client.0.smithi001.stdout:4/489: dread d0/f51 [0,4194304] 0 2024-09-15T22:26:43.922 INFO:tasks.workunit.client.0.smithi001.stdout:4/490: chown d0/d5d/fb4 24914 1 2024-09-15T22:26:43.922 INFO:tasks.workunit.client.0.smithi001.stdout:4/491: chown d0/d27/d35/d61/d20/d29/d34/f62 2264906 1 2024-09-15T22:26:43.923 INFO:tasks.workunit.client.0.smithi001.stdout:8/324: creat d9/f59 x:0 0 0 2024-09-15T22:26:43.925 INFO:tasks.workunit.client.0.smithi001.stdout:4/492: link d0/d27/d35/d61/d20/d29/d34/d84/d95/d73/fa8 d0/d27/d35/d61/d20/d29/d34/da0/fb6 0 2024-09-15T22:26:43.926 INFO:tasks.workunit.client.0.smithi001.stdout:4/493: getdents d0/d27/d35/d61/d20/d29/d34/db2 0 2024-09-15T22:26:43.927 INFO:tasks.workunit.client.0.smithi001.stdout:0/335: dwrite d0/d9/f2c [0,4194304] 0 2024-09-15T22:26:43.929 INFO:tasks.workunit.client.0.smithi001.stdout:0/336: truncate d0/f46 3709389 0 2024-09-15T22:26:43.930 INFO:tasks.workunit.client.0.smithi001.stdout:4/494: unlink d0/d27/d35/d74/fa6 0 2024-09-15T22:26:43.930 INFO:tasks.workunit.client.0.smithi001.stdout:4/495: truncate d0/d27/d35/d61/d20/d29/d34/da0/fad 909821 0 2024-09-15T22:26:43.932 INFO:tasks.workunit.client.0.smithi001.stdout:0/337: truncate d0/d9/f2c 2385098 0 2024-09-15T22:26:43.936 INFO:tasks.workunit.client.0.smithi001.stdout:4/496: creat d0/d27/d35/d61/d20/d29/d34/fb7 x:0 0 0 2024-09-15T22:26:43.937 INFO:tasks.workunit.client.0.smithi001.stdout:3/350: dwrite da/f1c [0,4194304] 0 2024-09-15T22:26:43.941 INFO:tasks.workunit.client.0.smithi001.stdout:4/497: link d0/d27/d35/d61/l1e d0/d5d/lb8 0 2024-09-15T22:26:43.943 INFO:tasks.workunit.client.0.smithi001.stdout:4/498: read d0/d27/d35/f4a [508718,98231] 0 2024-09-15T22:26:43.945 INFO:tasks.workunit.client.0.smithi001.stdout:3/351: symlink da/d3b/d58/l77 0 2024-09-15T22:26:43.946 INFO:tasks.workunit.client.0.smithi001.stdout:3/352: mknod da/d1f/d2e/c78 0 2024-09-15T22:26:43.946 INFO:tasks.workunit.client.0.smithi001.stdout:3/353: read - da/d1f/d2e/f5f zero size 2024-09-15T22:26:43.947 INFO:tasks.workunit.client.0.smithi001.stdout:3/354: truncate da/d16/f30 2027839 0 2024-09-15T22:26:43.947 INFO:tasks.workunit.client.0.smithi001.stdout:3/355: write da/d3b/d58/f5d [382006,57889] 0 2024-09-15T22:26:43.949 INFO:tasks.workunit.client.0.smithi001.stdout:3/356: symlink da/d3d/d43/l79 0 2024-09-15T22:26:43.950 INFO:tasks.workunit.client.0.smithi001.stdout:3/357: mknod da/d3b/d58/c7a 0 2024-09-15T22:26:43.955 INFO:tasks.workunit.client.0.smithi001.stdout:6/363: sync 2024-09-15T22:26:43.955 INFO:tasks.workunit.client.0.smithi001.stdout:5/397: sync 2024-09-15T22:26:43.955 INFO:tasks.workunit.client.0.smithi001.stdout:6/364: stat d0/df/l25 0 2024-09-15T22:26:43.956 INFO:tasks.workunit.client.0.smithi001.stdout:5/398: mkdir d3/d27/d7a 0 2024-09-15T22:26:43.958 INFO:tasks.workunit.client.0.smithi001.stdout:5/399: creat d3/d1d/d54/f7b x:0 0 0 2024-09-15T22:26:43.961 INFO:tasks.workunit.client.0.smithi001.stdout:6/365: rename d0/df/d24/d7d to d0/d7e 0 2024-09-15T22:26:43.963 INFO:tasks.workunit.client.0.smithi001.stdout:5/400: rename d3/d1d/d54/d56/d52/f69 to d3/d6/d57/f7c 0 2024-09-15T22:26:43.964 INFO:tasks.workunit.client.0.smithi001.stdout:5/401: mknod d3/d27/c7d 0 2024-09-15T22:26:43.966 INFO:tasks.workunit.client.0.smithi001.stdout:6/366: rename d0/df/f55 to d0/df/d24/f7f 0 2024-09-15T22:26:43.966 INFO:tasks.workunit.client.0.smithi001.stdout:5/402: creat d3/d49/f7e x:0 0 0 2024-09-15T22:26:43.969 INFO:tasks.workunit.client.0.smithi001.stdout:6/367: symlink d0/df/d24/d7b/l80 0 2024-09-15T22:26:43.971 INFO:tasks.workunit.client.0.smithi001.stdout:6/368: chown d0/d6/l1e 53 1 2024-09-15T22:26:43.972 INFO:tasks.workunit.client.0.smithi001.stdout:5/403: creat d3/d6/d25/f7f x:0 0 0 2024-09-15T22:26:43.972 INFO:tasks.workunit.client.0.smithi001.stdout:6/369: creat d0/df/d24/d49/f81 x:0 0 0 2024-09-15T22:26:43.972 INFO:tasks.workunit.client.0.smithi001.stdout:6/370: readlink d0/df/l5c 0 2024-09-15T22:26:43.973 INFO:tasks.workunit.client.0.smithi001.stdout:6/371: stat d0/df/l5c 0 2024-09-15T22:26:43.982 INFO:tasks.workunit.client.0.smithi001.stdout:0/338: dwrite d0/dd/f29 [0,4194304] 0 2024-09-15T22:26:43.984 INFO:tasks.workunit.client.0.smithi001.stdout:0/339: symlink d0/d9/d1a/l68 0 2024-09-15T22:26:43.984 INFO:tasks.workunit.client.0.smithi001.stdout:0/340: dread - d0/d9/db/f66 zero size 2024-09-15T22:26:43.984 INFO:tasks.workunit.client.0.smithi001.stdout:5/404: dread d3/d1d/d54/d56/f4a [4194304,4194304] 0 2024-09-15T22:26:43.984 INFO:tasks.workunit.client.0.smithi001.stdout:5/405: fsync d3/f4f 0 2024-09-15T22:26:43.985 INFO:tasks.workunit.client.0.smithi001.stdout:5/406: mkdir d3/d27/d7a/d80 0 2024-09-15T22:26:43.985 INFO:tasks.workunit.client.0.smithi001.stdout:0/341: mknod d0/d9/db/c69 0 2024-09-15T22:26:43.986 INFO:tasks.workunit.client.0.smithi001.stdout:5/407: mknod d3/d27/d7a/c81 0 2024-09-15T22:26:43.987 INFO:tasks.workunit.client.0.smithi001.stdout:0/342: mkdir d0/d6/d6a 0 2024-09-15T22:26:43.987 INFO:tasks.workunit.client.0.smithi001.stdout:0/343: fsync d0/d9/f56 0 2024-09-15T22:26:43.987 INFO:tasks.workunit.client.0.smithi001.stdout:0/344: write d0/d9/f2c [2969857,42804] 0 2024-09-15T22:26:43.989 INFO:tasks.workunit.client.0.smithi001.stdout:6/372: write d0/f2 [2186547,8725] 0 2024-09-15T22:26:43.992 INFO:tasks.workunit.client.0.smithi001.stdout:6/373: mknod d0/df/d24/c82 0 2024-09-15T22:26:43.994 INFO:tasks.workunit.client.0.smithi001.stdout:6/374: rmdir d0/df 39 2024-09-15T22:26:43.998 INFO:tasks.workunit.client.0.smithi001.stdout:6/375: mknod d0/df/c83 0 2024-09-15T22:26:43.998 INFO:tasks.workunit.client.0.smithi001.stdout:6/376: fdatasync d0/df/d24/d49/f6a 0 2024-09-15T22:26:44.001 INFO:tasks.workunit.client.0.smithi001.stdout:6/377: creat d0/df/d24/f84 x:0 0 0 2024-09-15T22:26:44.001 INFO:tasks.workunit.client.0.smithi001.stdout:8/325: dwrite d9/d19/f3c [0,4194304] 0 2024-09-15T22:26:44.001 INFO:tasks.workunit.client.0.smithi001.stdout:5/408: dread d3/d27/d5c/f6f [0,4194304] 0 2024-09-15T22:26:44.001 INFO:tasks.workunit.client.0.smithi001.stdout:5/409: truncate d3/d1d/d54/d56/f76 1015816 0 2024-09-15T22:26:44.001 INFO:tasks.workunit.client.0.smithi001.stdout:6/378: mknod d0/df/c85 0 2024-09-15T22:26:44.008 INFO:tasks.workunit.client.0.smithi001.stdout:6/379: dread d0/d6/d5d/d67/f44 [0,4194304] 0 2024-09-15T22:26:44.009 INFO:tasks.workunit.client.0.smithi001.stdout:0/345: dread d0/f7 [0,4194304] 0 2024-09-15T22:26:44.010 INFO:tasks.workunit.client.0.smithi001.stdout:3/358: dwrite da/d1f/d2e/f55 [0,4194304] 0 2024-09-15T22:26:44.010 INFO:tasks.workunit.client.0.smithi001.stdout:3/359: truncate da/d3b/d1b/f76 104220 0 2024-09-15T22:26:44.010 INFO:tasks.workunit.client.0.smithi001.stdout:3/360: truncate da/d16/f38 231486 0 2024-09-15T22:26:44.010 INFO:tasks.workunit.client.0.smithi001.stdout:5/410: fsync d3/d1d/d54/f7b 0 2024-09-15T22:26:44.010 INFO:tasks.workunit.client.0.smithi001.stdout:6/380: write d0/f19 [3758093,25973] 0 2024-09-15T22:26:44.012 INFO:tasks.workunit.client.0.smithi001.stdout:3/361: getdents da/d3d/d43/d41 0 2024-09-15T22:26:44.012 INFO:tasks.workunit.client.0.smithi001.stdout:3/362: write da/d3b/f33 [989859,115668] 0 2024-09-15T22:26:44.012 INFO:tasks.workunit.client.0.smithi001.stdout:3/363: fsync da/d16/ff 0 2024-09-15T22:26:44.013 INFO:tasks.workunit.client.0.smithi001.stdout:6/381: creat d0/df/d24/d2e/f86 x:0 0 0 2024-09-15T22:26:44.015 INFO:tasks.workunit.client.0.smithi001.stdout:6/382: unlink d0/d6/d5d/d67/d53/f6c 0 2024-09-15T22:26:44.018 INFO:tasks.workunit.client.0.smithi001.stdout:6/383: rmdir d0/df/d24/d2e 39 2024-09-15T22:26:44.021 INFO:tasks.workunit.client.0.smithi001.stdout:6/384: symlink d0/df/d24/d49/l87 0 2024-09-15T22:26:44.021 INFO:tasks.workunit.client.0.smithi001.stdout:6/385: chown d0/df/d24/d49/l87 90674402 1 2024-09-15T22:26:44.022 INFO:tasks.workunit.client.0.smithi001.stdout:5/411: creat d3/d6/d41/f82 x:0 0 0 2024-09-15T22:26:44.024 INFO:tasks.workunit.client.0.smithi001.stdout:5/412: rename d3/d6/l18 to d3/d6/d41/l83 0 2024-09-15T22:26:44.024 INFO:tasks.workunit.client.0.smithi001.stdout:6/386: truncate d0/f9 600985 0 2024-09-15T22:26:44.027 INFO:tasks.workunit.client.0.smithi001.stdout:0/346: dread d0/d9/f2c [0,4194304] 0 2024-09-15T22:26:44.030 INFO:tasks.workunit.client.0.smithi001.stdout:6/387: dread d0/d6/d5d/d67/f44 [0,4194304] 0 2024-09-15T22:26:44.031 INFO:tasks.workunit.client.0.smithi001.stdout:6/388: creat d0/f88 x:0 0 0 2024-09-15T22:26:44.032 INFO:tasks.workunit.client.0.smithi001.stdout:6/389: chown d0/df/d24/f69 88357205 1 2024-09-15T22:26:44.045 INFO:tasks.workunit.client.0.smithi001.stdout:4/499: dwrite d0/d27/d35/f69 [0,4194304] 0 2024-09-15T22:26:44.051 INFO:tasks.workunit.client.0.smithi001.stdout:4/500: symlink d0/d27/d35/d61/d20/d29/d34/d84/d95/lb9 0 2024-09-15T22:26:44.062 INFO:tasks.workunit.client.0.smithi001.stdout:8/326: dwrite d9/f21 [0,4194304] 0 2024-09-15T22:26:44.063 INFO:tasks.workunit.client.0.smithi001.stdout:8/327: chown d9/l13 130 1 2024-09-15T22:26:44.063 INFO:tasks.workunit.client.0.smithi001.stdout:8/328: chown d9/f27 1023 1 2024-09-15T22:26:44.064 INFO:tasks.workunit.client.0.smithi001.stdout:8/329: getdents d9/d19/d34 0 2024-09-15T22:26:44.066 INFO:tasks.workunit.client.0.smithi001.stdout:8/330: symlink d9/d19/d29/l5a 0 2024-09-15T22:26:44.066 INFO:tasks.workunit.client.0.smithi001.stdout:2/300: sync 2024-09-15T22:26:44.066 INFO:tasks.workunit.client.0.smithi001.stdout:1/464: sync 2024-09-15T22:26:44.066 INFO:tasks.workunit.client.0.smithi001.stdout:7/364: sync 2024-09-15T22:26:44.066 INFO:tasks.workunit.client.0.smithi001.stdout:9/337: sync 2024-09-15T22:26:44.068 INFO:tasks.workunit.client.0.smithi001.stdout:9/338: mkdir d5/de/d1a/d1b/d22/d2c/d21/d68 0 2024-09-15T22:26:44.068 INFO:tasks.workunit.client.0.smithi001.stdout:9/339: chown d5/de/d1a/d1b/d22/d2c/d21/f25 39472 1 2024-09-15T22:26:44.068 INFO:tasks.workunit.client.0.smithi001.stdout:1/465: getdents d3/dd/d14/d1b/d2b/d68 0 2024-09-15T22:26:44.069 INFO:tasks.workunit.client.0.smithi001.stdout:4/501: rename d0/d27/d35/d61 to d0/d5d/d7c/dba 0 2024-09-15T22:26:44.069 INFO:tasks.workunit.client.0.smithi001.stdout:1/466: stat d3/d12/d21/f22 0 2024-09-15T22:26:44.070 INFO:tasks.workunit.client.0.smithi001.stdout:1/467: mknod d3/dd/d14/d1b/c93 0 2024-09-15T22:26:44.084 INFO:tasks.workunit.client.0.smithi001.stdout:2/301: dread d2/d14/d1a/d20/f47 [0,4194304] 0 2024-09-15T22:26:44.089 INFO:tasks.workunit.client.0.smithi001.stdout:2/302: rename d2/d14/f15 to d2/f5e 0 2024-09-15T22:26:44.091 INFO:tasks.workunit.client.0.smithi001.stdout:2/303: truncate d2/d14/d17/d1f/f3c 425592 0 2024-09-15T22:26:44.092 INFO:tasks.workunit.client.0.smithi001.stdout:2/304: unlink d2/d14/f27 0 2024-09-15T22:26:44.099 INFO:tasks.workunit.client.0.smithi001.stdout:8/331: dread d9/d19/f3c [0,4194304] 0 2024-09-15T22:26:44.100 INFO:tasks.workunit.client.0.smithi001.stdout:8/332: mknod d9/d19/d34/d41/c5b 0 2024-09-15T22:26:44.102 INFO:tasks.workunit.client.0.smithi001.stdout:8/333: mknod d9/d19/d29/c5c 0 2024-09-15T22:26:44.102 INFO:tasks.workunit.client.0.smithi001.stdout:6/390: dwrite d0/d6/f13 [0,4194304] 0 2024-09-15T22:26:44.103 INFO:tasks.workunit.client.0.smithi001.stdout:9/340: dread d5/de/d1a/d1b/d22/f4a [0,4194304] 0 2024-09-15T22:26:44.103 INFO:tasks.workunit.client.0.smithi001.stdout:9/341: stat d5/de/d1a/d1b/d22/d2c/f31 0 2024-09-15T22:26:44.104 INFO:tasks.workunit.client.0.smithi001.stdout:9/342: creat d5/de/d1a/d1b/d22/d2c/d21/d24/f69 x:0 0 0 2024-09-15T22:26:44.105 INFO:tasks.workunit.client.0.smithi001.stdout:9/343: chown d5/de/d1a/d1b/d22/d2c/cf 371 1 2024-09-15T22:26:44.107 INFO:tasks.workunit.client.0.smithi001.stdout:9/344: link d5/de/d1a/d1b/d22/d2c/d21/d24/f4c d5/de/d1a/d1b/d22/d2c/f6a 0 2024-09-15T22:26:44.107 INFO:tasks.workunit.client.0.smithi001.stdout:9/345: fsync d5/f44 0 2024-09-15T22:26:44.111 INFO:tasks.workunit.client.0.smithi001.stdout:9/346: symlink d5/de/d51/d53/l6b 0 2024-09-15T22:26:44.113 INFO:tasks.workunit.client.0.smithi001.stdout:9/347: link d5/de/d1a/d1b/d22/d2c/cf d5/de/d1a/d38/c6c 0 2024-09-15T22:26:44.114 INFO:tasks.workunit.client.0.smithi001.stdout:4/502: dread d0/d5d/d7c/dba/d20/f63 [4194304,4194304] 0 2024-09-15T22:26:44.115 INFO:tasks.workunit.client.0.smithi001.stdout:4/503: chown d0/d27/d35/d59/d67/d7b 0 1 2024-09-15T22:26:44.115 INFO:tasks.workunit.client.0.smithi001.stdout:0/347: dwrite d0/d9/d1a/d36/f41 [0,4194304] 0 2024-09-15T22:26:44.115 INFO:tasks.workunit.client.0.smithi001.stdout:9/348: link d5/de/d1a/d1b/d22/d2c/f31 d5/de/d51/d53/f6d 0 2024-09-15T22:26:44.115 INFO:tasks.workunit.client.0.smithi001.stdout:4/504: mknod d0/d5d/d7c/dba/d20/d29/d34/d9c/cbb 0 2024-09-15T22:26:44.116 INFO:tasks.workunit.client.0.smithi001.stdout:4/505: mkdir d0/d5d/d7c/dba/d20/d29/d34/dbc 0 2024-09-15T22:26:44.117 INFO:tasks.workunit.client.0.smithi001.stdout:9/349: link d5/de/d15/d27/f50 d5/de/d1a/d1b/d22/d2c/d21/d24/f6e 0 2024-09-15T22:26:44.118 INFO:tasks.workunit.client.0.smithi001.stdout:0/348: unlink d0/dd/d1b/c4b 0 2024-09-15T22:26:44.120 INFO:tasks.workunit.client.0.smithi001.stdout:9/350: mknod d5/de/d1a/d1b/d22/d2c/d21/d23/d3d/c6f 0 2024-09-15T22:26:44.120 INFO:tasks.workunit.client.0.smithi001.stdout:4/506: link d0/fd d0/d27/d35/fbd 0 2024-09-15T22:26:44.120 INFO:tasks.workunit.client.0.smithi001.stdout:4/507: fsync d0/d5d/d44/d65/f9a 0 2024-09-15T22:26:44.123 INFO:tasks.workunit.client.0.smithi001.stdout:0/349: link d0/d6/f15 d0/d9/db/f6b 0 2024-09-15T22:26:44.123 INFO:tasks.workunit.client.0.smithi001.stdout:0/350: stat d0/d6/c22 0 2024-09-15T22:26:44.124 INFO:tasks.workunit.client.0.smithi001.stdout:0/351: readlink d0/l52 0 2024-09-15T22:26:44.127 INFO:tasks.workunit.client.0.smithi001.stdout:7/365: dwrite d0/d7/d21/d6b/f2d [0,4194304] 0 2024-09-15T22:26:44.129 INFO:tasks.workunit.client.0.smithi001.stdout:8/334: read f4 [2890572,39100] 0 2024-09-15T22:26:44.129 INFO:tasks.workunit.client.0.smithi001.stdout:8/335: fsync d9/fb 0 2024-09-15T22:26:44.132 INFO:tasks.workunit.client.0.smithi001.stdout:7/366: rename d0/d7/d21/d2b/d3e/c5f to d0/d7/d44/c7d 0 2024-09-15T22:26:44.133 INFO:tasks.workunit.client.0.smithi001.stdout:0/352: link d0/d9/d1a/c40 d0/dd/d1b/c6c 0 2024-09-15T22:26:44.135 INFO:tasks.workunit.client.0.smithi001.stdout:0/353: mkdir d0/d9/db/d5d/d6d 0 2024-09-15T22:26:44.140 INFO:tasks.workunit.client.0.smithi001.stdout:0/354: rename d0/l5f to d0/dd/d1b/l6e 0 2024-09-15T22:26:44.143 INFO:tasks.workunit.client.0.smithi001.stdout:0/355: symlink d0/d9/db/l6f 0 2024-09-15T22:26:44.146 INFO:tasks.workunit.client.0.smithi001.stdout:0/356: mkdir d0/d9/d1a/d70 0 2024-09-15T22:26:44.146 INFO:tasks.workunit.client.0.smithi001.stdout:0/357: chown d0/dd/d33/l53 0 1 2024-09-15T22:26:44.146 INFO:tasks.workunit.client.0.smithi001.stdout:0/358: stat d0/d9/f1c 0 2024-09-15T22:26:44.150 INFO:tasks.workunit.client.0.smithi001.stdout:0/359: symlink d0/d9/d1a/d36/l71 0 2024-09-15T22:26:44.163 INFO:tasks.workunit.client.0.smithi001.stdout:7/367: read d0/d7/d21/d2b/d3e/f4b [6504845,30626] 0 2024-09-15T22:26:44.163 INFO:tasks.workunit.client.0.smithi001.stdout:7/368: stat d0/d7/d21/d6b 0 2024-09-15T22:26:44.167 INFO:tasks.workunit.client.0.smithi001.stdout:2/305: dwrite d2/d12/d56/f23 [0,4194304] 0 2024-09-15T22:26:44.168 INFO:tasks.workunit.client.0.smithi001.stdout:6/391: dwrite d0/df/d24/f69 [0,4194304] 0 2024-09-15T22:26:44.168 INFO:tasks.workunit.client.0.smithi001.stdout:6/392: chown d0/df/d24/d49/f56 263655523 1 2024-09-15T22:26:44.168 INFO:tasks.workunit.client.0.smithi001.stdout:4/508: dwrite d0/d5d/d7c/dba/d20/d29/d34/da0/fad [0,4194304] 0 2024-09-15T22:26:44.169 INFO:tasks.workunit.client.0.smithi001.stdout:7/369: mknod d0/d7/d44/c7e 0 2024-09-15T22:26:44.172 INFO:tasks.workunit.client.0.smithi001.stdout:6/393: creat d0/df/f89 x:0 0 0 2024-09-15T22:26:44.174 INFO:tasks.workunit.client.0.smithi001.stdout:6/394: creat d0/d6/d5d/d67/d53/f8a x:0 0 0 2024-09-15T22:26:44.174 INFO:tasks.workunit.client.0.smithi001.stdout:8/336: dwrite d9/d19/d58/f49 [0,4194304] 0 2024-09-15T22:26:44.184 INFO:tasks.workunit.client.0.smithi001.stdout:6/395: rmdir d0/df/d24/d7b 39 2024-09-15T22:26:44.185 INFO:tasks.workunit.client.0.smithi001.stdout:8/337: symlink d9/l5d 0 2024-09-15T22:26:44.185 INFO:tasks.workunit.client.0.smithi001.stdout:2/306: mknod d2/d12/c5f 0 2024-09-15T22:26:44.188 INFO:tasks.workunit.client.0.smithi001.stdout:2/307: creat d2/d14/d1a/d20/f60 x:0 0 0 2024-09-15T22:26:44.188 INFO:tasks.workunit.client.0.smithi001.stdout:2/308: fsync d2/d12/f59 0 2024-09-15T22:26:44.190 INFO:tasks.workunit.client.0.smithi001.stdout:2/309: creat d2/d12/f61 x:0 0 0 2024-09-15T22:26:44.190 INFO:tasks.workunit.client.0.smithi001.stdout:2/310: write d2/d14/d1a/d20/f47 [805466,88640] 0 2024-09-15T22:26:44.192 INFO:tasks.workunit.client.0.smithi001.stdout:8/338: dread d9/d19/d29/f2a [0,4194304] 0 2024-09-15T22:26:44.192 INFO:tasks.workunit.client.0.smithi001.stdout:8/339: chown d9/d19/f32 5955888 1 2024-09-15T22:26:44.194 INFO:tasks.workunit.client.0.smithi001.stdout:8/340: creat d9/d19/d34/f5e x:0 0 0 2024-09-15T22:26:44.194 INFO:tasks.workunit.client.0.smithi001.stdout:8/341: readlink d9/d19/d29/d50/l53 0 2024-09-15T22:26:44.194 INFO:tasks.workunit.client.0.smithi001.stdout:8/342: write d9/d19/d34/f43 [920937,41398] 0 2024-09-15T22:26:44.194 INFO:tasks.workunit.client.0.smithi001.stdout:2/311: rename d2/d14/d17 to d2/d12/d62 0 2024-09-15T22:26:44.195 INFO:tasks.workunit.client.0.smithi001.stdout:8/343: mkdir d9/d19/d40/d5f 0 2024-09-15T22:26:44.197 INFO:tasks.workunit.client.0.smithi001.stdout:8/344: mknod d9/d19/d29/d33/c60 0 2024-09-15T22:26:44.197 INFO:tasks.workunit.client.0.smithi001.stdout:8/345: mkdir d9/d19/d40/d5f/d61 0 2024-09-15T22:26:44.200 INFO:tasks.workunit.client.0.smithi001.stdout:2/312: dread d2/d14/d1a/d1b/f26 [0,4194304] 0 2024-09-15T22:26:44.201 INFO:tasks.workunit.client.0.smithi001.stdout:2/313: symlink d2/d12/l63 0 2024-09-15T22:26:44.205 INFO:tasks.workunit.client.0.smithi001.stdout:7/370: dwrite d0/d7/d44/d3f/d49/f59 [0,4194304] 0 2024-09-15T22:26:44.243 INFO:tasks.workunit.client.0.smithi001.stdout:3/364: sync 2024-09-15T22:26:44.243 INFO:tasks.workunit.client.0.smithi001.stdout:5/413: sync 2024-09-15T22:26:44.243 INFO:tasks.workunit.client.0.smithi001.stdout:5/414: write d3/d1d/d54/d56/d52/f75 [367722,101802] 0 2024-09-15T22:26:44.243 INFO:tasks.workunit.client.0.smithi001.stdout:3/365: symlink da/l7b 0 2024-09-15T22:26:44.244 INFO:tasks.workunit.client.0.smithi001.stdout:5/415: mkdir d3/d6/d41/d4d/d5a/d84 0 2024-09-15T22:26:44.244 INFO:tasks.workunit.client.0.smithi001.stdout:5/416: dread - d3/d6/d25/f7f zero size 2024-09-15T22:26:44.246 INFO:tasks.workunit.client.0.smithi001.stdout:5/417: symlink d3/d27/l85 0 2024-09-15T22:26:44.246 INFO:tasks.workunit.client.0.smithi001.stdout:5/418: symlink d3/d6/d41/d4d/l86 0 2024-09-15T22:26:44.248 INFO:tasks.workunit.client.0.smithi001.stdout:5/419: mkdir d3/d6/d57/d87 0 2024-09-15T22:26:44.250 INFO:tasks.workunit.client.0.smithi001.stdout:0/360: dwrite d0/d9/db/f6b [0,4194304] 0 2024-09-15T22:26:44.250 INFO:tasks.workunit.client.0.smithi001.stdout:0/361: write d0/f7 [4290153,88261] 0 2024-09-15T22:26:44.250 INFO:tasks.workunit.client.0.smithi001.stdout:7/371: dwrite d0/d7/d44/f28 [0,4194304] 0 2024-09-15T22:26:44.251 INFO:tasks.workunit.client.0.smithi001.stdout:7/372: chown d0/d7/d21/d6b/f29 26963487 1 2024-09-15T22:26:44.251 INFO:tasks.workunit.client.0.smithi001.stdout:7/373: write d0/d7/d44/d36/f72 [1800090,6942] 0 2024-09-15T22:26:44.251 INFO:tasks.workunit.client.0.smithi001.stdout:8/346: dwrite d9/d19/d29/d50/f52 [0,4194304] 0 2024-09-15T22:26:44.254 INFO:tasks.workunit.client.0.smithi001.stdout:0/362: creat d0/dd/d1b/f72 x:0 0 0 2024-09-15T22:26:44.254 INFO:tasks.workunit.client.0.smithi001.stdout:0/363: write d0/d9/d1a/f64 [86423,121203] 0 2024-09-15T22:26:44.255 INFO:tasks.workunit.client.0.smithi001.stdout:5/420: dread d3/d6/d25/f6a [0,4194304] 0 2024-09-15T22:26:44.255 INFO:tasks.workunit.client.0.smithi001.stdout:7/374: creat d0/d7/d21/d2b/f7f x:0 0 0 2024-09-15T22:26:44.255 INFO:tasks.workunit.client.0.smithi001.stdout:7/375: chown d0/d7/d44/d3f/d49/d4f 2757 1 2024-09-15T22:26:44.259 INFO:tasks.workunit.client.0.smithi001.stdout:0/364: creat d0/dd/d33/f73 x:0 0 0 2024-09-15T22:26:44.261 INFO:tasks.workunit.client.0.smithi001.stdout:7/376: link d0/d7/d44/d3f/f75 d0/d7/d44/f80 0 2024-09-15T22:26:44.262 INFO:tasks.workunit.client.0.smithi001.stdout:0/365: symlink d0/d9/d1a/d70/l74 0 2024-09-15T22:26:44.264 INFO:tasks.workunit.client.0.smithi001.stdout:7/377: unlink d0/d7/l71 0 2024-09-15T22:26:44.265 INFO:tasks.workunit.client.0.smithi001.stdout:0/366: symlink d0/d6/l75 0 2024-09-15T22:26:44.265 INFO:tasks.workunit.client.0.smithi001.stdout:0/367: fsync d0/f4 0 2024-09-15T22:26:44.265 INFO:tasks.workunit.client.0.smithi001.stdout:5/421: dread d3/d27/f42 [0,4194304] 0 2024-09-15T22:26:44.266 INFO:tasks.workunit.client.0.smithi001.stdout:0/368: unlink d0/d9/db/f66 0 2024-09-15T22:26:44.268 INFO:tasks.workunit.client.0.smithi001.stdout:0/369: creat d0/d9/db/d5d/f76 x:0 0 0 2024-09-15T22:26:44.269 INFO:tasks.workunit.client.0.smithi001.stdout:0/370: mkdir d0/d6/d77 0 2024-09-15T22:26:44.269 INFO:tasks.workunit.client.0.smithi001.stdout:2/314: rename d2/d14/d1a/d20 to d2/d12/d62/d64 0 2024-09-15T22:26:44.270 INFO:tasks.workunit.client.0.smithi001.stdout:0/371: mkdir d0/d6/d77/d78 0 2024-09-15T22:26:44.273 INFO:tasks.workunit.client.0.smithi001.stdout:2/315: link d2/d12/d62/d64/f60 d2/d12/f65 0 2024-09-15T22:26:44.274 INFO:tasks.workunit.client.0.smithi001.stdout:2/316: creat d2/d14/f66 x:0 0 0 2024-09-15T22:26:44.275 INFO:tasks.workunit.client.0.smithi001.stdout:2/317: truncate d2/d12/d56/f23 2413387 0 2024-09-15T22:26:44.276 INFO:tasks.workunit.client.0.smithi001.stdout:3/366: rename da/d1f/d2e to da/d3d/d43/d7c 0 2024-09-15T22:26:44.279 INFO:tasks.workunit.client.0.smithi001.stdout:0/372: getdents d0/d6/d77 0 2024-09-15T22:26:44.280 INFO:tasks.workunit.client.0.smithi001.stdout:0/373: mkdir d0/d9/db/d5d/d79 0 2024-09-15T22:26:44.280 INFO:tasks.workunit.client.0.smithi001.stdout:0/374: chown d0/d9/db/l4a 217008 1 2024-09-15T22:26:44.282 INFO:tasks.workunit.client.0.smithi001.stdout:1/468: sync 2024-09-15T22:26:44.284 INFO:tasks.workunit.client.0.smithi001.stdout:2/318: rename d2/d12/c5f to d2/d12/d56/c67 0 2024-09-15T22:26:44.284 INFO:tasks.workunit.client.0.smithi001.stdout:2/319: readlink d2/d14/d1a/d1b/l5d 0 2024-09-15T22:26:44.286 INFO:tasks.workunit.client.0.smithi001.stdout:2/320: creat d2/d12/d62/f68 x:0 0 0 2024-09-15T22:26:44.286 INFO:tasks.workunit.client.0.smithi001.stdout:2/321: chown d2/d14/d1a/d1b/f58 1066694 1 2024-09-15T22:26:44.287 INFO:tasks.workunit.client.0.smithi001.stdout:2/322: getdents d2 0 2024-09-15T22:26:44.287 INFO:tasks.workunit.client.0.smithi001.stdout:2/323: write d2/d12/d62/f40 [5098000,56387] 0 2024-09-15T22:26:44.299 INFO:tasks.workunit.client.0.smithi001.stdout:1/469: write d3/d12/f3d [1347178,94376] 0 2024-09-15T22:26:44.300 INFO:tasks.workunit.client.0.smithi001.stdout:1/470: symlink d3/l94 0 2024-09-15T22:26:44.300 INFO:tasks.workunit.client.0.smithi001.stdout:1/471: fdatasync d3/dd/f19 0 2024-09-15T22:26:44.301 INFO:tasks.workunit.client.0.smithi001.stdout:1/472: chown d3/cb 1631609076 1 2024-09-15T22:26:44.302 INFO:tasks.workunit.client.0.smithi001.stdout:5/422: dwrite d3/d6/d41/f4c [0,4194304] 0 2024-09-15T22:26:44.305 INFO:tasks.workunit.client.0.smithi001.stdout:5/423: write d3/d6/d25/f6a [220715,22868] 0 2024-09-15T22:26:44.306 INFO:tasks.workunit.client.0.smithi001.stdout:5/424: mkdir d3/d6/d41/d88 0 2024-09-15T22:26:44.307 INFO:tasks.workunit.client.0.smithi001.stdout:5/425: mkdir d3/d27/d4e/d89 0 2024-09-15T22:26:44.308 INFO:tasks.workunit.client.0.smithi001.stdout:5/426: mkdir d3/d1d/d54/d56/d8a 0 2024-09-15T22:26:44.308 INFO:tasks.workunit.client.0.smithi001.stdout:5/427: stat d3/d49 0 2024-09-15T22:26:44.308 INFO:tasks.workunit.client.0.smithi001.stdout:5/428: getdents d3 0 2024-09-15T22:26:44.309 INFO:tasks.workunit.client.0.smithi001.stdout:5/429: truncate d3/d1d/d54/d56/f4a 2588689 0 2024-09-15T22:26:44.310 INFO:tasks.workunit.client.0.smithi001.stdout:5/430: unlink d3/d49/f72 0 2024-09-15T22:26:44.311 INFO:tasks.workunit.client.0.smithi001.stdout:0/375: dread d0/f16 [0,4194304] 0 2024-09-15T22:26:44.312 INFO:tasks.workunit.client.0.smithi001.stdout:2/324: creat d2/d14/d1a/f69 x:0 0 0 2024-09-15T22:26:44.312 INFO:tasks.workunit.client.0.smithi001.stdout:2/325: stat d2/d12/d56/c34 0 2024-09-15T22:26:44.312 INFO:tasks.workunit.client.0.smithi001.stdout:2/326: mknod d2/d12/d56/c6a 0 2024-09-15T22:26:44.313 INFO:tasks.workunit.client.0.smithi001.stdout:2/327: fdatasync d2/d14/d1a/f69 0 2024-09-15T22:26:44.316 INFO:tasks.workunit.client.0.smithi001.stdout:2/328: link d2/d12/d62/f4e d2/d12/d62/d1f/f6b 0 2024-09-15T22:26:44.317 INFO:tasks.workunit.client.0.smithi001.stdout:2/329: symlink d2/d12/d62/d1f/l6c 0 2024-09-15T22:26:44.318 INFO:tasks.workunit.client.0.smithi001.stdout:2/330: unlink d2/d12/d62/c45 0 2024-09-15T22:26:44.321 INFO:tasks.workunit.client.0.smithi001.stdout:2/331: mknod d2/d12/c6d 0 2024-09-15T22:26:44.323 INFO:tasks.workunit.client.0.smithi001.stdout:2/332: creat d2/d14/f6e x:0 0 0 2024-09-15T22:26:44.323 INFO:tasks.workunit.client.0.smithi001.stdout:2/333: mkdir d2/d12/d62/d1f/d6f 0 2024-09-15T22:26:44.323 INFO:tasks.workunit.client.0.smithi001.stdout:2/334: readlink d2/d12/d62/d1f/l3a 0 2024-09-15T22:26:44.324 INFO:tasks.workunit.client.0.smithi001.stdout:2/335: mkdir d2/d12/d62/d1f/d6f/d70 0 2024-09-15T22:26:44.325 INFO:tasks.workunit.client.0.smithi001.stdout:2/336: mkdir d2/d12/d62/d4c/d71 0 2024-09-15T22:26:44.325 INFO:tasks.workunit.client.0.smithi001.stdout:2/337: fdatasync d2/d14/d1a/d1b/f4d 0 2024-09-15T22:26:44.326 INFO:tasks.workunit.client.0.smithi001.stdout:2/338: rmdir d2/d12/d56 39 2024-09-15T22:26:44.326 INFO:tasks.workunit.client.0.smithi001.stdout:2/339: chown d2/d12/d62/f40 2 1 2024-09-15T22:26:44.327 INFO:tasks.workunit.client.0.smithi001.stdout:2/340: mknod d2/d12/d56/c72 0 2024-09-15T22:26:44.341 INFO:tasks.workunit.client.0.smithi001.stdout:7/378: dwrite d0/d7/d21/f55 [0,4194304] 0 2024-09-15T22:26:44.341 INFO:tasks.workunit.client.0.smithi001.stdout:7/379: write d0/d7/d44/f1c [7185988,16389] 0 2024-09-15T22:26:44.375 INFO:tasks.workunit.client.0.smithi001.stdout:7/380: dwrite d0/d7/d21/d2b/d3e/f51 [0,4194304] 0 2024-09-15T22:26:44.375 INFO:tasks.workunit.client.0.smithi001.stdout:7/381: write d0/d7/d21/d2b/d3e/f41 [388677,40352] 0 2024-09-15T22:26:44.376 INFO:tasks.workunit.client.0.smithi001.stdout:7/382: mknod d0/d7/d44/c81 0 2024-09-15T22:26:44.377 INFO:tasks.workunit.client.0.smithi001.stdout:7/383: symlink d0/d6a/l82 0 2024-09-15T22:26:44.377 INFO:tasks.workunit.client.0.smithi001.stdout:7/384: fsync d0/d7/d44/f27 0 2024-09-15T22:26:44.377 INFO:tasks.workunit.client.0.smithi001.stdout:3/367: dwrite da/d16/ff [4194304,4194304] 0 2024-09-15T22:26:44.379 INFO:tasks.workunit.client.0.smithi001.stdout:7/385: creat d0/d7/d44/d36/f83 x:0 0 0 2024-09-15T22:26:44.381 INFO:tasks.workunit.client.0.smithi001.stdout:3/368: rename da/d1f/c47 to da/d3d/c7d 0 2024-09-15T22:26:44.381 INFO:tasks.workunit.client.0.smithi001.stdout:3/369: chown da/d16/f26 4775 1 2024-09-15T22:26:44.381 INFO:tasks.workunit.client.0.smithi001.stdout:7/386: creat d0/d7/d44/d36/f84 x:0 0 0 2024-09-15T22:26:44.382 INFO:tasks.workunit.client.0.smithi001.stdout:3/370: mkdir da/d1f/d7e 0 2024-09-15T22:26:44.382 INFO:tasks.workunit.client.0.smithi001.stdout:3/371: fdatasync da/d3b/d1b/d6a/d6f/f71 0 2024-09-15T22:26:44.383 INFO:tasks.workunit.client.0.smithi001.stdout:7/387: creat d0/d7/d2e/f85 x:0 0 0 2024-09-15T22:26:44.384 INFO:tasks.workunit.client.0.smithi001.stdout:3/372: mkdir da/d3d/d43/d41/d70/d7f 0 2024-09-15T22:26:44.388 INFO:tasks.workunit.client.0.smithi001.stdout:0/376: dwrite d0/f4 [0,4194304] 0 2024-09-15T22:26:44.389 INFO:tasks.workunit.client.0.smithi001.stdout:0/377: creat d0/d6/d77/d78/f7a x:0 0 0 2024-09-15T22:26:44.389 INFO:tasks.workunit.client.0.smithi001.stdout:0/378: dread - d0/d9/db/f25 zero size 2024-09-15T22:26:44.390 INFO:tasks.workunit.client.0.smithi001.stdout:2/341: dwrite d2/d12/f59 [0,4194304] 0 2024-09-15T22:26:44.390 INFO:tasks.workunit.client.0.smithi001.stdout:2/342: read d2/d12/d56/f51 [566896,36330] 0 2024-09-15T22:26:44.392 INFO:tasks.workunit.client.0.smithi001.stdout:2/343: mknod d2/d14/c73 0 2024-09-15T22:26:44.393 INFO:tasks.workunit.client.0.smithi001.stdout:2/344: mkdir d2/d12/d56/d74 0 2024-09-15T22:26:44.395 INFO:tasks.workunit.client.0.smithi001.stdout:2/345: truncate d2/d14/d1a/d1b/f4d 2702277 0 2024-09-15T22:26:44.399 INFO:tasks.workunit.client.0.smithi001.stdout:3/373: dread da/d3d/d43/d41/f54 [0,4194304] 0 2024-09-15T22:26:44.399 INFO:tasks.workunit.client.0.smithi001.stdout:3/374: dread - da/d3b/f66 zero size 2024-09-15T22:26:44.403 INFO:tasks.workunit.client.0.smithi001.stdout:2/346: dread d2/f3 [8388608,4194304] 0 2024-09-15T22:26:44.403 INFO:tasks.workunit.client.0.smithi001.stdout:2/347: chown d2/d14/l49 119049189 1 2024-09-15T22:26:44.404 INFO:tasks.workunit.client.0.smithi001.stdout:2/348: creat d2/d12/d62/d1f/f75 x:0 0 0 2024-09-15T22:26:44.405 INFO:tasks.workunit.client.0.smithi001.stdout:2/349: mkdir d2/d12/d62/d64/d76 0 2024-09-15T22:26:44.405 INFO:tasks.workunit.client.0.smithi001.stdout:2/350: write d2/d12/d56/fa [3439559,88170] 0 2024-09-15T22:26:44.406 INFO:tasks.workunit.client.0.smithi001.stdout:2/351: chown d2/d12/d56/f51 8934674 1 2024-09-15T22:26:44.406 INFO:tasks.workunit.client.0.smithi001.stdout:2/352: link d2/d12/d62/d64/f4a d2/d12/d62/d1f/f77 0 2024-09-15T22:26:44.417 INFO:tasks.workunit.client.0.smithi001.stdout:9/351: sync 2024-09-15T22:26:44.417 INFO:tasks.workunit.client.0.smithi001.stdout:4/509: sync 2024-09-15T22:26:44.417 INFO:tasks.workunit.client.0.smithi001.stdout:4/510: readlink d0/d5d/lb8 0 2024-09-15T22:26:44.418 INFO:tasks.workunit.client.0.smithi001.stdout:6/396: sync 2024-09-15T22:26:44.419 INFO:tasks.workunit.client.0.smithi001.stdout:9/352: rmdir d5/de/d1a/d1b/d2a 39 2024-09-15T22:26:44.419 INFO:tasks.workunit.client.0.smithi001.stdout:4/511: mknod d0/d5d/d7c/dba/d20/d29/d34/dbc/cbe 0 2024-09-15T22:26:44.421 INFO:tasks.workunit.client.0.smithi001.stdout:4/512: mkdir d0/d5d/d7c/dba/d20/d29/d34/dbc/dbf 0 2024-09-15T22:26:44.421 INFO:tasks.workunit.client.0.smithi001.stdout:4/513: write d0/d5d/d7c/dba/d20/d29/d40/f71 [1001465,631] 0 2024-09-15T22:26:44.425 INFO:tasks.workunit.client.0.smithi001.stdout:9/353: truncate d5/f11 3691214 0 2024-09-15T22:26:44.427 INFO:tasks.workunit.client.0.smithi001.stdout:6/397: rename d0/df/d24/d2e/d43/l3d to d0/df/d24/d2e/l8b 0 2024-09-15T22:26:44.427 INFO:tasks.workunit.client.0.smithi001.stdout:2/353: write d2/d12/d62/d64/f2a [4074534,27563] 0 2024-09-15T22:26:44.429 INFO:tasks.workunit.client.0.smithi001.stdout:6/398: mkdir d0/d6/d5d/d8c 0 2024-09-15T22:26:44.429 INFO:tasks.workunit.client.0.smithi001.stdout:2/354: creat d2/d14/d1a/d1b/f78 x:0 0 0 2024-09-15T22:26:44.430 INFO:tasks.workunit.client.0.smithi001.stdout:2/355: creat d2/f79 x:0 0 0 2024-09-15T22:26:44.430 INFO:tasks.workunit.client.0.smithi001.stdout:6/399: creat d0/d6/d5d/d8c/f8d x:0 0 0 2024-09-15T22:26:44.431 INFO:tasks.workunit.client.0.smithi001.stdout:6/400: truncate d0/df/d24/d2e/f45 303940 0 2024-09-15T22:26:44.437 INFO:tasks.workunit.client.0.smithi001.stdout:3/375: dwrite da/d3b/f64 [0,4194304] 0 2024-09-15T22:26:44.437 INFO:tasks.workunit.client.0.smithi001.stdout:3/376: fdatasync da/d1f/f22 0 2024-09-15T22:26:44.437 INFO:tasks.workunit.client.0.smithi001.stdout:3/377: read da/d3b/d1b/f2c [2945558,32778] 0 2024-09-15T22:26:44.439 INFO:tasks.workunit.client.0.smithi001.stdout:0/379: dwrite d0/d9/d1a/f64 [0,4194304] 0 2024-09-15T22:26:44.446 INFO:tasks.workunit.client.0.smithi001.stdout:6/401: rename d0/df/d24/d2e/f45 to d0/d6/d5d/d8c/f8e 0 2024-09-15T22:26:44.452 INFO:tasks.workunit.client.0.smithi001.stdout:9/354: dread d5/de/d1a/d1b/d22/d2c/d21/d24/f4c [0,4194304] 0 2024-09-15T22:26:44.459 INFO:tasks.workunit.client.0.smithi001.stdout:6/402: symlink d0/d6/d5d/d8c/l8f 0 2024-09-15T22:26:44.463 INFO:tasks.workunit.client.0.smithi001.stdout:7/388: dwrite d0/f2a [0,4194304] 0 2024-09-15T22:26:44.464 INFO:tasks.workunit.client.0.smithi001.stdout:6/403: unlink d0/d6/c74 0 2024-09-15T22:26:44.476 INFO:tasks.workunit.client.0.smithi001.stdout:9/355: read d5/de/d1a/d1b/f3a [2368438,41180] 0 2024-09-15T22:26:44.477 INFO:tasks.workunit.client.0.smithi001.stdout:9/356: fsync d5/de/d1a/d1b/d22/d2c/f61 0 2024-09-15T22:26:44.477 INFO:tasks.workunit.client.0.smithi001.stdout:2/356: dwrite d2/f2b [0,4194304] 0 2024-09-15T22:26:44.484 INFO:tasks.workunit.client.0.smithi001.stdout:4/514: dwrite d0/d5d/d7c/dba/d20/f4f [0,4194304] 0 2024-09-15T22:26:44.489 INFO:tasks.workunit.client.0.smithi001.stdout:4/515: unlink d0/d5d/d7c/dba/d20/d29/d34/f89 0 2024-09-15T22:26:44.494 INFO:tasks.workunit.client.0.smithi001.stdout:3/378: dwrite da/d3b/d1b/f2c [0,4194304] 0 2024-09-15T22:26:44.497 INFO:tasks.workunit.client.0.smithi001.stdout:3/379: truncate da/f61 112040 0 2024-09-15T22:26:44.499 INFO:tasks.workunit.client.0.smithi001.stdout:0/380: dwrite d0/f2 [0,4194304] 0 2024-09-15T22:26:44.499 INFO:tasks.workunit.client.0.smithi001.stdout:3/380: rename da/d1f/f24 to da/d3d/d43/d41/f80 0 2024-09-15T22:26:44.500 INFO:tasks.workunit.client.0.smithi001.stdout:0/381: mknod d0/d6/c7b 0 2024-09-15T22:26:44.500 INFO:tasks.workunit.client.0.smithi001.stdout:2/357: dread d2/d12/d62/d64/f2a [0,4194304] 0 2024-09-15T22:26:44.500 INFO:tasks.workunit.client.0.smithi001.stdout:2/358: chown d2/d12/c3f 22191 1 2024-09-15T22:26:44.501 INFO:tasks.workunit.client.0.smithi001.stdout:3/381: unlink da/d3b/d1b/d6a/f6b 0 2024-09-15T22:26:44.501 INFO:tasks.workunit.client.0.smithi001.stdout:2/359: creat d2/d14/d1a/f7a x:0 0 0 2024-09-15T22:26:44.501 INFO:tasks.workunit.client.0.smithi001.stdout:2/360: write d2/d12/d62/f68 [253998,74735] 0 2024-09-15T22:26:44.503 INFO:tasks.workunit.client.0.smithi001.stdout:2/361: truncate d2/d12/d62/d1f/f25 338526 0 2024-09-15T22:26:44.503 INFO:tasks.workunit.client.0.smithi001.stdout:6/404: dwrite d0/df/d24/f69 [4194304,4194304] 0 2024-09-15T22:26:44.503 INFO:tasks.workunit.client.0.smithi001.stdout:2/362: write d2/d12/f61 [193595,52188] 0 2024-09-15T22:26:44.503 INFO:tasks.workunit.client.0.smithi001.stdout:6/405: chown d0/d6/d5d/d67/d53/f8a 1408 1 2024-09-15T22:26:44.503 INFO:tasks.workunit.client.0.smithi001.stdout:0/382: link d0/c24 d0/d9/db/d5d/d6d/c7c 0 2024-09-15T22:26:44.503 INFO:tasks.workunit.client.0.smithi001.stdout:0/383: dread - d0/dd/f47 zero size 2024-09-15T22:26:44.504 INFO:tasks.workunit.client.0.smithi001.stdout:2/363: symlink d2/d12/d62/d64/d76/l7b 0 2024-09-15T22:26:44.504 INFO:tasks.workunit.client.0.smithi001.stdout:2/364: chown d2/d14/c73 22267 1 2024-09-15T22:26:44.504 INFO:tasks.workunit.client.0.smithi001.stdout:2/365: truncate d2/f79 953951 0 2024-09-15T22:26:44.505 INFO:tasks.workunit.client.0.smithi001.stdout:2/366: truncate d2/d14/f6e 260547 0 2024-09-15T22:26:44.505 INFO:tasks.workunit.client.0.smithi001.stdout:2/367: write d2/d12/f65 [618674,27349] 0 2024-09-15T22:26:44.505 INFO:tasks.workunit.client.0.smithi001.stdout:2/368: truncate d2/d12/d62/d64/f4a 569380 0 2024-09-15T22:26:44.506 INFO:tasks.workunit.client.0.smithi001.stdout:6/406: symlink d0/df/d24/l90 0 2024-09-15T22:26:44.507 INFO:tasks.workunit.client.0.smithi001.stdout:2/369: unlink d2/d12/d56/fa 0 2024-09-15T22:26:44.507 INFO:tasks.workunit.client.0.smithi001.stdout:0/384: truncate d0/d9/f1c 2884307 0 2024-09-15T22:26:44.507 INFO:tasks.workunit.client.0.smithi001.stdout:0/385: chown d0/dd/d33/l43 3253 1 2024-09-15T22:26:44.508 INFO:tasks.workunit.client.0.smithi001.stdout:2/370: mknod d2/d12/d62/d4c/d71/c7c 0 2024-09-15T22:26:44.508 INFO:tasks.workunit.client.0.smithi001.stdout:3/382: dread da/d3b/d1b/d6a/d6f/f71 [0,4194304] 0 2024-09-15T22:26:44.509 INFO:tasks.workunit.client.0.smithi001.stdout:2/371: mknod d2/d12/d62/d1f/d6f/c7d 0 2024-09-15T22:26:44.511 INFO:tasks.workunit.client.0.smithi001.stdout:6/407: creat d0/d6/d5d/f91 x:0 0 0 2024-09-15T22:26:44.512 INFO:tasks.workunit.client.0.smithi001.stdout:0/386: creat d0/d51/f7d x:0 0 0 2024-09-15T22:26:44.512 INFO:tasks.workunit.client.0.smithi001.stdout:6/408: mknod d0/df/d24/d7b/c92 0 2024-09-15T22:26:44.515 INFO:tasks.workunit.client.0.smithi001.stdout:2/372: rename d2/d14/d1a/d1b/f58 to d2/d12/d62/d1f/f7e 0 2024-09-15T22:26:44.559 INFO:tasks.workunit.client.0.smithi001.stdout:7/389: dwrite d0/d7/d21/d2b/f37 [0,4194304] 0 2024-09-15T22:26:44.559 INFO:tasks.workunit.client.0.smithi001.stdout:7/390: write d0/d7/d44/f80 [159923,7943] 0 2024-09-15T22:26:44.560 INFO:tasks.workunit.client.0.smithi001.stdout:7/391: link d0/d7/d21/d6b/f29 d0/d7/d44/d3f/d49/f86 0 2024-09-15T22:26:44.560 INFO:tasks.workunit.client.0.smithi001.stdout:7/392: chown d0/l1d 23777 1 2024-09-15T22:26:44.561 INFO:tasks.workunit.client.0.smithi001.stdout:7/393: truncate d0/d7/d21/d2b/f32 6699382 0 2024-09-15T22:26:44.567 INFO:tasks.workunit.client.0.smithi001.stdout:3/383: dwrite da/d3d/d43/d7c/d3f/f63 [4194304,4194304] 0 2024-09-15T22:26:44.567 INFO:tasks.workunit.client.0.smithi001.stdout:8/347: sync 2024-09-15T22:26:44.567 INFO:tasks.workunit.client.0.smithi001.stdout:8/348: readlink d9/l13 0 2024-09-15T22:26:44.568 INFO:tasks.workunit.client.0.smithi001.stdout:3/384: symlink da/d3d/d43/d41/d70/l81 0 2024-09-15T22:26:44.593 INFO:tasks.workunit.client.0.smithi001.stdout:2/373: dwrite d2/d12/d62/d64/f4a [0,4194304] 0 2024-09-15T22:26:44.606 INFO:tasks.workunit.client.0.smithi001.stdout:0/387: dwrite d0/dd/d33/f5b [0,4194304] 0 2024-09-15T22:26:44.609 INFO:tasks.workunit.client.0.smithi001.stdout:0/388: creat d0/d6/d77/d78/f7e x:0 0 0 2024-09-15T22:26:44.611 INFO:tasks.workunit.client.0.smithi001.stdout:2/374: read d2/d12/d62/d1f/f77 [3525145,3275] 0 2024-09-15T22:26:44.611 INFO:tasks.workunit.client.0.smithi001.stdout:2/375: write d2/d14/d1a/d1b/f26 [1451995,49262] 0 2024-09-15T22:26:44.612 INFO:tasks.workunit.client.0.smithi001.stdout:2/376: getdents d2/d14/d1a/d1b 0 2024-09-15T22:26:44.614 INFO:tasks.workunit.client.0.smithi001.stdout:2/377: write d2/d12/d62/d1f/f6b [333650,124734] 0 2024-09-15T22:26:44.616 INFO:tasks.workunit.client.0.smithi001.stdout:2/378: truncate d2/d12/d62/f2c 6961818 0 2024-09-15T22:26:44.616 INFO:tasks.workunit.client.0.smithi001.stdout:2/379: write d2/d12/d62/d64/f60 [1086332,72344] 0 2024-09-15T22:26:44.618 INFO:tasks.workunit.client.0.smithi001.stdout:2/380: mkdir d2/d12/d62/d64/d76/d7f 0 2024-09-15T22:26:44.618 INFO:tasks.workunit.client.0.smithi001.stdout:2/381: chown d2/d12 1897 1 2024-09-15T22:26:44.625 INFO:tasks.workunit.client.0.smithi001.stdout:7/394: dwrite d0/d7/d44/f80 [0,4194304] 0 2024-09-15T22:26:44.625 INFO:tasks.workunit.client.0.smithi001.stdout:7/395: write d0/d7/d44/d36/f72 [16316,40952] 0 2024-09-15T22:26:44.625 INFO:tasks.workunit.client.0.smithi001.stdout:7/396: chown d0 22315817 1 2024-09-15T22:26:44.626 INFO:tasks.workunit.client.0.smithi001.stdout:3/385: dwrite da/d3b/f40 [8388608,4194304] 0 2024-09-15T22:26:44.631 INFO:tasks.workunit.client.0.smithi001.stdout:3/386: symlink da/d3b/d1b/d6a/d6f/l82 0 2024-09-15T22:26:44.632 INFO:tasks.workunit.client.0.smithi001.stdout:3/387: creat da/d1f/d46/f83 x:0 0 0 2024-09-15T22:26:44.633 INFO:tasks.workunit.client.0.smithi001.stdout:1/473: sync 2024-09-15T22:26:44.633 INFO:tasks.workunit.client.0.smithi001.stdout:5/431: sync 2024-09-15T22:26:44.634 INFO:tasks.workunit.client.0.smithi001.stdout:2/382: dread d2/d12/d56/f51 [0,4194304] 0 2024-09-15T22:26:44.637 INFO:tasks.workunit.client.0.smithi001.stdout:7/397: dread d0/d7/d21/d6b/f29 [0,4194304] 0 2024-09-15T22:26:44.638 INFO:tasks.workunit.client.0.smithi001.stdout:7/398: creat d0/d7/d44/f87 x:0 0 0 2024-09-15T22:26:44.639 INFO:tasks.workunit.client.0.smithi001.stdout:5/432: symlink d3/d1d/l8b 0 2024-09-15T22:26:44.639 INFO:tasks.workunit.client.0.smithi001.stdout:7/399: rename d0/l56 to d0/l88 0 2024-09-15T22:26:44.639 INFO:tasks.workunit.client.0.smithi001.stdout:7/400: write d0/d7/d44/d3f/d49/f66 [2366433,71031] 0 2024-09-15T22:26:44.640 INFO:tasks.workunit.client.0.smithi001.stdout:5/433: truncate d3/d27/f39 3495541 0 2024-09-15T22:26:44.641 INFO:tasks.workunit.client.0.smithi001.stdout:7/401: creat d0/d7/d44/d3f/d49/f89 x:0 0 0 2024-09-15T22:26:44.641 INFO:tasks.workunit.client.0.smithi001.stdout:5/434: mkdir d3/d6/d57/d87/d8c 0 2024-09-15T22:26:44.642 INFO:tasks.workunit.client.0.smithi001.stdout:7/402: unlink d0/d7/d21/c70 0 2024-09-15T22:26:44.643 INFO:tasks.workunit.client.0.smithi001.stdout:5/435: symlink d3/d1d/d54/d56/d52/d61/l8d 0 2024-09-15T22:26:44.643 INFO:tasks.workunit.client.0.smithi001.stdout:3/388: dread da/d3b/f33 [0,4194304] 0 2024-09-15T22:26:44.643 INFO:tasks.workunit.client.0.smithi001.stdout:3/389: fdatasync da/d3b/d1b/f2c 0 2024-09-15T22:26:44.645 INFO:tasks.workunit.client.0.smithi001.stdout:5/436: unlink d3/d6/d25/f6a 0 2024-09-15T22:26:44.648 INFO:tasks.workunit.client.0.smithi001.stdout:1/474: dread d3/f42 [0,4194304] 0 2024-09-15T22:26:44.648 INFO:tasks.workunit.client.0.smithi001.stdout:7/403: symlink d0/d7/d2e/l8a 0 2024-09-15T22:26:44.648 INFO:tasks.workunit.client.0.smithi001.stdout:7/404: rename d0/d7 to d0/d7/d21/d6b/d8b 22 2024-09-15T22:26:44.649 INFO:tasks.workunit.client.0.smithi001.stdout:3/390: getdents da/d3b/d1b 0 2024-09-15T22:26:44.649 INFO:tasks.workunit.client.0.smithi001.stdout:2/383: dread d2/d12/d56/f23 [0,4194304] 0 2024-09-15T22:26:44.649 INFO:tasks.workunit.client.0.smithi001.stdout:3/391: fsync da/d3b/f3c 0 2024-09-15T22:26:44.649 INFO:tasks.workunit.client.0.smithi001.stdout:3/392: stat da/d3b/d1b/d6a/d6f/f71 0 2024-09-15T22:26:44.649 INFO:tasks.workunit.client.0.smithi001.stdout:3/393: getdents da/d3d/d43/d41/d70/d7f 0 2024-09-15T22:26:44.650 INFO:tasks.workunit.client.0.smithi001.stdout:7/405: mknod d0/d7/d2e/d60/c8c 0 2024-09-15T22:26:44.650 INFO:tasks.workunit.client.0.smithi001.stdout:1/475: mknod d3/dd/d53/c95 0 2024-09-15T22:26:44.650 INFO:tasks.workunit.client.0.smithi001.stdout:1/476: readlink d3/dd/d14/l65 0 2024-09-15T22:26:44.650 INFO:tasks.workunit.client.0.smithi001.stdout:1/477: fdatasync d3/f3f 0 2024-09-15T22:26:44.653 INFO:tasks.workunit.client.0.smithi001.stdout:3/394: creat da/d3d/d43/d41/d70/f84 x:0 0 0 2024-09-15T22:26:44.654 INFO:tasks.workunit.client.0.smithi001.stdout:3/395: chown da/l4d 16182 1 2024-09-15T22:26:44.654 INFO:tasks.workunit.client.0.smithi001.stdout:3/396: write da/d16/f30 [2921605,120731] 0 2024-09-15T22:26:44.657 INFO:tasks.workunit.client.0.smithi001.stdout:3/397: unlink da/l49 0 2024-09-15T22:26:44.671 INFO:tasks.workunit.client.0.smithi001.stdout:3/398: write da/d3b/f32 [3281595,102887] 0 2024-09-15T22:26:44.671 INFO:tasks.workunit.client.0.smithi001.stdout:3/399: chown da/d3b/f33 8 1 2024-09-15T22:26:44.675 INFO:tasks.workunit.client.0.smithi001.stdout:9/357: sync 2024-09-15T22:26:44.685 INFO:tasks.workunit.client.0.smithi001.stdout:1/478: dread d3/dd/d14/d1b/d2b/f56 [4194304,4194304] 0 2024-09-15T22:26:44.696 INFO:tasks.workunit.client.0.smithi001.stdout:3/400: dread da/d3d/d43/d7c/f55 [0,4194304] 0 2024-09-15T22:26:44.696 INFO:tasks.workunit.client.0.smithi001.stdout:3/401: dread - da/d1f/d46/f83 zero size 2024-09-15T22:26:44.696 INFO:tasks.workunit.client.0.smithi001.stdout:3/402: chown da/d1f/f5c 3227 1 2024-09-15T22:26:44.700 INFO:tasks.workunit.client.0.smithi001.stdout:3/403: symlink da/d3d/d43/l85 0 2024-09-15T22:26:44.701 INFO:tasks.workunit.client.0.smithi001.stdout:3/404: truncate da/d16/f30 2965615 0 2024-09-15T22:26:44.701 INFO:tasks.workunit.client.0.smithi001.stdout:3/405: write da/d1f/f28 [1126217,16651] 0 2024-09-15T22:26:44.702 INFO:tasks.workunit.client.0.smithi001.stdout:3/406: mknod da/d3d/d43/d7c/d53/d73/c86 0 2024-09-15T22:26:44.703 INFO:tasks.workunit.client.0.smithi001.stdout:5/437: dwrite d3/f4f [4194304,4194304] 0 2024-09-15T22:26:44.704 INFO:tasks.workunit.client.0.smithi001.stdout:1/479: dread d3/dd/d3c/d4c/f5c [0,4194304] 0 2024-09-15T22:26:44.704 INFO:tasks.workunit.client.0.smithi001.stdout:1/480: fsync d3/dd/d14/d1b/d2b/d68/f7a 0 2024-09-15T22:26:44.705 INFO:tasks.workunit.client.0.smithi001.stdout:3/407: creat da/d3d/d43/d7c/d3f/f87 x:0 0 0 2024-09-15T22:26:44.705 INFO:tasks.workunit.client.0.smithi001.stdout:5/438: link d3/d49/l60 d3/d6/d41/l8e 0 2024-09-15T22:26:44.705 INFO:tasks.workunit.client.0.smithi001.stdout:5/439: fsync d3/d1d/d54/d56/f4b 0 2024-09-15T22:26:44.705 INFO:tasks.workunit.client.0.smithi001.stdout:5/440: readlink d3/d6/d41/l78 0 2024-09-15T22:26:44.706 INFO:tasks.workunit.client.0.smithi001.stdout:5/441: creat d3/d6/d57/f8f x:0 0 0 2024-09-15T22:26:44.707 INFO:tasks.workunit.client.0.smithi001.stdout:3/408: mknod da/d3b/c88 0 2024-09-15T22:26:44.725 INFO:tasks.workunit.client.0.smithi001.stdout:7/406: dwrite d0/f5c [0,4194304] 0 2024-09-15T22:26:44.725 INFO:tasks.workunit.client.0.smithi001.stdout:2/384: dwrite d2/f10 [0,4194304] 0 2024-09-15T22:26:44.725 INFO:tasks.workunit.client.0.smithi001.stdout:2/385: write d2/d12/d62/f4e [673822,34016] 0 2024-09-15T22:26:44.725 INFO:tasks.workunit.client.0.smithi001.stdout:2/386: read d2/d12/d62/f2c [1571732,203] 0 2024-09-15T22:26:44.725 INFO:tasks.workunit.client.0.smithi001.stdout:2/387: chown d2/f10 7323 1 2024-09-15T22:26:44.727 INFO:tasks.workunit.client.0.smithi001.stdout:2/388: mkdir d2/d14/d1a/d80 0 2024-09-15T22:26:44.728 INFO:tasks.workunit.client.0.smithi001.stdout:2/389: rename d2/d12/d62/d1f/l3a to d2/d12/d62/d64/d76/l81 0 2024-09-15T22:26:44.729 INFO:tasks.workunit.client.0.smithi001.stdout:2/390: mkdir d2/d14/d1a/d1b/d82 0 2024-09-15T22:26:44.729 INFO:tasks.workunit.client.0.smithi001.stdout:8/349: sync 2024-09-15T22:26:44.729 INFO:tasks.workunit.client.0.smithi001.stdout:4/516: sync 2024-09-15T22:26:44.729 INFO:tasks.workunit.client.0.smithi001.stdout:2/391: read d2/d12/d62/f4e [323638,101691] 0 2024-09-15T22:26:44.730 INFO:tasks.workunit.client.0.smithi001.stdout:0/389: sync 2024-09-15T22:26:44.730 INFO:tasks.workunit.client.0.smithi001.stdout:2/392: write d2/d12/d62/d64/f2a [355739,81007] 0 2024-09-15T22:26:44.730 INFO:tasks.workunit.client.0.smithi001.stdout:0/390: truncate d0/dd/f47 57004 0 2024-09-15T22:26:44.730 INFO:tasks.workunit.client.0.smithi001.stdout:0/391: chown d0/d9/db/d5d/d6d 22813 1 2024-09-15T22:26:44.733 INFO:tasks.workunit.client.0.smithi001.stdout:6/409: sync 2024-09-15T22:26:44.734 INFO:tasks.workunit.client.0.smithi001.stdout:2/393: write d2/d12/d62/d64/f60 [857526,15552] 0 2024-09-15T22:26:44.734 INFO:tasks.workunit.client.0.smithi001.stdout:2/394: write d2/f3 [4925411,48673] 0 2024-09-15T22:26:44.734 INFO:tasks.workunit.client.0.smithi001.stdout:4/517: mkdir d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d73/dc0 0 2024-09-15T22:26:44.736 INFO:tasks.workunit.client.0.smithi001.stdout:6/410: creat d0/df/d24/d2e/d43/f93 x:0 0 0 2024-09-15T22:26:44.738 INFO:tasks.workunit.client.0.smithi001.stdout:6/411: mknod d0/d6/c94 0 2024-09-15T22:26:44.751 INFO:tasks.workunit.client.0.smithi001.stdout:0/392: dread d0/f7 [0,4194304] 0 2024-09-15T22:26:44.756 INFO:tasks.workunit.client.0.smithi001.stdout:7/407: write d0/d7/d2e/f34 [198937,108949] 0 2024-09-15T22:26:44.757 INFO:tasks.workunit.client.0.smithi001.stdout:2/395: dread d2/d12/f1c [0,4194304] 0 2024-09-15T22:26:44.757 INFO:tasks.workunit.client.0.smithi001.stdout:2/396: truncate d2/d14/d1a/d1b/f26 2211034 0 2024-09-15T22:26:44.759 INFO:tasks.workunit.client.0.smithi001.stdout:2/397: mkdir d2/d14/d1a/d1b/d82/d83 0 2024-09-15T22:26:44.760 INFO:tasks.workunit.client.0.smithi001.stdout:2/398: symlink d2/d12/d62/d64/d76/l84 0 2024-09-15T22:26:44.765 INFO:tasks.workunit.client.0.smithi001.stdout:8/350: dread d9/d19/d29/f3e [0,4194304] 0 2024-09-15T22:26:44.765 INFO:tasks.workunit.client.0.smithi001.stdout:8/351: read - d9/d19/d34/f5e zero size 2024-09-15T22:26:44.770 INFO:tasks.workunit.client.0.smithi001.stdout:0/393: dread d0/d9/d1a/f64 [0,4194304] 0 2024-09-15T22:26:44.770 INFO:tasks.workunit.client.0.smithi001.stdout:1/481: dwrite d3/d12/d21/f22 [4194304,4194304] 0 2024-09-15T22:26:44.770 INFO:tasks.workunit.client.0.smithi001.stdout:0/394: readlink d0/d9/db/l6f 0 2024-09-15T22:26:44.774 INFO:tasks.workunit.client.0.smithi001.stdout:4/518: dread d0/d5d/d7c/dba/d20/f26 [0,4194304] 0 2024-09-15T22:26:44.775 INFO:tasks.workunit.client.0.smithi001.stdout:8/352: creat d9/d19/d40/f62 x:0 0 0 2024-09-15T22:26:44.775 INFO:tasks.workunit.client.0.smithi001.stdout:7/408: rmdir d0/d7/d21/d2b/d3e 39 2024-09-15T22:26:44.775 INFO:tasks.workunit.client.0.smithi001.stdout:8/353: fsync f7 0 2024-09-15T22:26:44.776 INFO:tasks.workunit.client.0.smithi001.stdout:8/354: mkdir d9/d19/d29/d33/d63 0 2024-09-15T22:26:44.776 INFO:tasks.workunit.client.0.smithi001.stdout:8/355: dread - d9/d19/d34/f5e zero size 2024-09-15T22:26:44.777 INFO:tasks.workunit.client.0.smithi001.stdout:8/356: dread - d9/d19/d34/f5e zero size 2024-09-15T22:26:44.777 INFO:tasks.workunit.client.0.smithi001.stdout:8/357: readlink d9/d19/l2e 0 2024-09-15T22:26:44.777 INFO:tasks.workunit.client.0.smithi001.stdout:8/358: fsync d9/d19/d29/d35/f39 0 2024-09-15T22:26:44.786 INFO:tasks.workunit.client.0.smithi001.stdout:7/409: read d0/f76 [1798088,109938] 0 2024-09-15T22:26:44.787 INFO:tasks.workunit.client.0.smithi001.stdout:8/359: rename d9/d19/d40/f62 to d9/d19/d29/d33/d63/f64 0 2024-09-15T22:26:44.789 INFO:tasks.workunit.client.0.smithi001.stdout:7/410: rmdir d0/d7/d44/d3f 39 2024-09-15T22:26:44.789 INFO:tasks.workunit.client.0.smithi001.stdout:7/411: read - d0/d7/d44/f74 zero size 2024-09-15T22:26:44.790 INFO:tasks.workunit.client.0.smithi001.stdout:7/412: creat d0/d7/d44/f8d x:0 0 0 2024-09-15T22:26:44.794 INFO:tasks.workunit.client.0.smithi001.stdout:0/395: write d0/d9/d1a/d36/f41 [1900611,69980] 0 2024-09-15T22:26:44.800 INFO:tasks.workunit.client.0.smithi001.stdout:0/396: symlink d0/d9/d1a/l7f 0 2024-09-15T22:26:44.805 INFO:tasks.workunit.client.0.smithi001.stdout:3/409: dwrite da/d3d/d43/f5a [0,4194304] 0 2024-09-15T22:26:44.822 INFO:tasks.workunit.client.0.smithi001.stdout:2/399: fdatasync d2/f10 0 2024-09-15T22:26:44.823 INFO:tasks.workunit.client.0.smithi001.stdout:4/519: dread d0/d5d/d7c/dba/f19 [0,4194304] 0 2024-09-15T22:26:44.830 INFO:tasks.workunit.client.0.smithi001.stdout:6/412: dwrite d0/df/d24/d2e/d43/f78 [0,4194304] 0 2024-09-15T22:26:44.830 INFO:tasks.workunit.client.0.smithi001.stdout:7/413: dwrite d0/d7/d21/d2b/f32 [0,4194304] 0 2024-09-15T22:26:44.831 INFO:tasks.workunit.client.0.smithi001.stdout:4/520: unlink d0/d5d/d7c/dba/d20/d29/d40/l6c 0 2024-09-15T22:26:44.832 INFO:tasks.workunit.client.0.smithi001.stdout:0/397: dread d0/f46 [0,4194304] 0 2024-09-15T22:26:44.832 INFO:tasks.workunit.client.0.smithi001.stdout:0/398: truncate d0/d9/d1a/f58 797465 0 2024-09-15T22:26:44.833 INFO:tasks.workunit.client.0.smithi001.stdout:4/521: unlink d0/d5d/d44/d65/l7e 0 2024-09-15T22:26:44.835 INFO:tasks.workunit.client.0.smithi001.stdout:8/360: dwrite d9/d19/f3c [0,4194304] 0 2024-09-15T22:26:44.836 INFO:tasks.workunit.client.0.smithi001.stdout:8/361: fsync d9/d19/f2b 0 2024-09-15T22:26:44.836 INFO:tasks.workunit.client.0.smithi001.stdout:8/362: fdatasync d9/d19/d58/f30 0 2024-09-15T22:26:44.836 INFO:tasks.workunit.client.0.smithi001.stdout:6/413: rmdir d0/df 39 2024-09-15T22:26:44.838 INFO:tasks.workunit.client.0.smithi001.stdout:2/400: write d2/d12/d62/d64/f19 [3495371,62419] 0 2024-09-15T22:26:44.838 INFO:tasks.workunit.client.0.smithi001.stdout:4/522: creat d0/d5d/d7c/dba/d20/d29/d34/d84/fc1 x:0 0 0 2024-09-15T22:26:44.839 INFO:tasks.workunit.client.0.smithi001.stdout:2/401: mknod d2/d12/d56/d74/c85 0 2024-09-15T22:26:44.839 INFO:tasks.workunit.client.0.smithi001.stdout:2/402: write d2/f9 [3480002,27291] 0 2024-09-15T22:26:44.840 INFO:tasks.workunit.client.0.smithi001.stdout:7/414: rename d0/d7/d21/d2b to d0/d8e 0 2024-09-15T22:26:44.840 INFO:tasks.workunit.client.0.smithi001.stdout:7/415: write d0/d7/d44/f80 [5159782,48239] 0 2024-09-15T22:26:44.840 INFO:tasks.workunit.client.0.smithi001.stdout:4/523: symlink d0/d5d/d7c/dba/d20/d29/d34/d84/lc2 0 2024-09-15T22:26:44.841 INFO:tasks.workunit.client.0.smithi001.stdout:2/403: creat d2/d12/d62/f86 x:0 0 0 2024-09-15T22:26:44.841 INFO:tasks.workunit.client.0.smithi001.stdout:2/404: read - d2/d14/d1a/f7a zero size 2024-09-15T22:26:44.841 INFO:tasks.workunit.client.0.smithi001.stdout:4/524: rmdir d0/d5d/d44/d65/d6a 39 2024-09-15T22:26:44.841 INFO:tasks.workunit.client.0.smithi001.stdout:7/416: mknod d0/d7/d44/d3f/c8f 0 2024-09-15T22:26:44.842 INFO:tasks.workunit.client.0.smithi001.stdout:2/405: symlink d2/d14/d1a/l87 0 2024-09-15T22:26:44.843 INFO:tasks.workunit.client.0.smithi001.stdout:4/525: creat d0/d5d/d7c/dba/d20/fc3 x:0 0 0 2024-09-15T22:26:44.843 INFO:tasks.workunit.client.0.smithi001.stdout:7/417: symlink d0/d7/d2e/l90 0 2024-09-15T22:26:44.843 INFO:tasks.workunit.client.0.smithi001.stdout:4/526: dread - d0/f8e zero size 2024-09-15T22:26:44.844 INFO:tasks.workunit.client.0.smithi001.stdout:4/527: write d0/d27/d35/d59/fb0 [871048,101112] 0 2024-09-15T22:26:44.844 INFO:tasks.workunit.client.0.smithi001.stdout:7/418: creat d0/d8e/f91 x:0 0 0 2024-09-15T22:26:44.852 INFO:tasks.workunit.client.0.smithi001.stdout:2/406: mknod d2/d12/c88 0 2024-09-15T22:26:44.855 INFO:tasks.workunit.client.0.smithi001.stdout:2/407: read d2/d12/d62/d64/f19 [4496744,9007] 0 2024-09-15T22:26:44.855 INFO:tasks.workunit.client.0.smithi001.stdout:2/408: fdatasync d2/d12/f65 0 2024-09-15T22:26:44.855 INFO:tasks.workunit.client.0.smithi001.stdout:2/409: dread - d2/f5a zero size 2024-09-15T22:26:44.855 INFO:tasks.workunit.client.0.smithi001.stdout:2/410: readlink d2/d12/d62/d64/d76/l84 0 2024-09-15T22:26:44.858 INFO:tasks.workunit.client.0.smithi001.stdout:2/411: creat d2/d14/d1a/d1b/d82/d83/f89 x:0 0 0 2024-09-15T22:26:44.858 INFO:tasks.workunit.client.0.smithi001.stdout:7/419: dread d0/d8e/f4a [0,4194304] 0 2024-09-15T22:26:44.858 INFO:tasks.workunit.client.0.smithi001.stdout:2/412: write d2/d12/f59 [4533499,80807] 0 2024-09-15T22:26:44.858 INFO:tasks.workunit.client.0.smithi001.stdout:2/413: fsync d2/d12/d62/d64/f4a 0 2024-09-15T22:26:44.859 INFO:tasks.workunit.client.0.smithi001.stdout:2/414: mkdir d2/d14/d1a/d8a 0 2024-09-15T22:26:44.860 INFO:tasks.workunit.client.0.smithi001.stdout:2/415: read d2/f9 [722682,32212] 0 2024-09-15T22:26:44.860 INFO:tasks.workunit.client.0.smithi001.stdout:7/420: unlink d0/d8e/d3e/c77 0 2024-09-15T22:26:44.860 INFO:tasks.workunit.client.0.smithi001.stdout:2/416: truncate d2/d14/d1a/d1b/d82/d83/f89 949488 0 2024-09-15T22:26:44.860 INFO:tasks.workunit.client.0.smithi001.stdout:7/421: mknod d0/d7/d44/c92 0 2024-09-15T22:26:44.862 INFO:tasks.workunit.client.0.smithi001.stdout:9/358: sync 2024-09-15T22:26:44.862 INFO:tasks.workunit.client.0.smithi001.stdout:9/359: fsync d5/f44 0 2024-09-15T22:26:44.862 INFO:tasks.workunit.client.0.smithi001.stdout:2/417: link d2/d14/l49 d2/d14/d1a/d1b/d82/l8b 0 2024-09-15T22:26:44.862 INFO:tasks.workunit.client.0.smithi001.stdout:9/360: getdents d5/de/d15/d27 0 2024-09-15T22:26:44.867 INFO:tasks.workunit.client.0.smithi001.stdout:9/361: creat d5/de/d1a/d1b/f70 x:0 0 0 2024-09-15T22:26:44.867 INFO:tasks.workunit.client.0.smithi001.stdout:3/410: dwrite da/d3b/f3c [0,4194304] 0 2024-09-15T22:26:44.869 INFO:tasks.workunit.client.0.smithi001.stdout:4/528: dread d0/f51 [0,4194304] 0 2024-09-15T22:26:44.869 INFO:tasks.workunit.client.0.smithi001.stdout:9/362: mknod d5/c71 0 2024-09-15T22:26:44.871 INFO:tasks.workunit.client.0.smithi001.stdout:9/363: truncate d5/f59 3641600 0 2024-09-15T22:26:44.873 INFO:tasks.workunit.client.0.smithi001.stdout:9/364: creat d5/de/d1a/d38/f72 x:0 0 0 2024-09-15T22:26:44.873 INFO:tasks.workunit.client.0.smithi001.stdout:9/365: chown d5/de/d1a/d1b/d22/f2f 516687 1 2024-09-15T22:26:44.873 INFO:tasks.workunit.client.0.smithi001.stdout:9/366: read d5/f44 [2621311,20034] 0 2024-09-15T22:26:44.875 INFO:tasks.workunit.client.0.smithi001.stdout:9/367: creat d5/de/d15/d27/d63/f73 x:0 0 0 2024-09-15T22:26:44.883 INFO:tasks.workunit.client.0.smithi001.stdout:6/414: dwrite d0/d6/d5d/d67/d53/f8a [0,4194304] 0 2024-09-15T22:26:44.883 INFO:tasks.workunit.client.0.smithi001.stdout:6/415: truncate d0/df/d24/d2e/d43/d30/f64 1716286 0 2024-09-15T22:26:44.883 INFO:tasks.workunit.client.0.smithi001.stdout:6/416: getdents d0/d7e 0 2024-09-15T22:26:44.887 INFO:tasks.workunit.client.0.smithi001.stdout:6/417: symlink d0/df/d24/l95 0 2024-09-15T22:26:44.890 INFO:tasks.workunit.client.0.smithi001.stdout:0/399: dwrite d0/dd/f29 [0,4194304] 0 2024-09-15T22:26:44.891 INFO:tasks.workunit.client.0.smithi001.stdout:4/529: write d0/d5d/d44/d65/f9a [1394005,40493] 0 2024-09-15T22:26:44.891 INFO:tasks.workunit.client.0.smithi001.stdout:0/400: creat d0/d9/db/f80 x:0 0 0 2024-09-15T22:26:44.892 INFO:tasks.workunit.client.0.smithi001.stdout:0/401: symlink d0/d9/db/d5d/d79/l81 0 2024-09-15T22:26:44.896 INFO:tasks.workunit.client.0.smithi001.stdout:4/530: link d0/d5d/d7c/dba/l1e d0/d27/d35/d59/d67/lc4 0 2024-09-15T22:26:44.896 INFO:tasks.workunit.client.0.smithi001.stdout:4/531: chown d0/d5d/d7c/dba/d20/d29/d34/f39 841876 1 2024-09-15T22:26:44.897 INFO:tasks.workunit.client.0.smithi001.stdout:0/402: symlink d0/d9/d1a/d36/l82 0 2024-09-15T22:26:44.897 INFO:tasks.workunit.client.0.smithi001.stdout:3/411: dread da/d3d/d43/d41/f80 [0,4194304] 0 2024-09-15T22:26:44.897 INFO:tasks.workunit.client.0.smithi001.stdout:0/403: unlink d0/d9/d1a/d36/l4c 0 2024-09-15T22:26:44.897 INFO:tasks.workunit.client.0.smithi001.stdout:3/412: getdents da/d3b 0 2024-09-15T22:26:44.904 INFO:tasks.workunit.client.0.smithi001.stdout:0/404: creat d0/d9/db/f83 x:0 0 0 2024-09-15T22:26:44.904 INFO:tasks.workunit.client.0.smithi001.stdout:3/413: link da/d3b/d58/l77 da/d3d/d43/l89 0 2024-09-15T22:26:44.904 INFO:tasks.workunit.client.0.smithi001.stdout:3/414: fsync da/d16/f30 0 2024-09-15T22:26:44.909 INFO:tasks.workunit.client.0.smithi001.stdout:7/422: dwrite d0/d8e/d3e/f41 [0,4194304] 0 2024-09-15T22:26:44.911 INFO:tasks.workunit.client.0.smithi001.stdout:7/423: mkdir d0/d7/d21/d6b/d93 0 2024-09-15T22:26:44.913 INFO:tasks.workunit.client.0.smithi001.stdout:7/424: mkdir d0/d7/d44/d94 0 2024-09-15T22:26:44.913 INFO:tasks.workunit.client.0.smithi001.stdout:7/425: getdents d0/d7/d44/d94 0 2024-09-15T22:26:44.913 INFO:tasks.workunit.client.0.smithi001.stdout:7/426: getdents d0/d7/d44/d94 0 2024-09-15T22:26:44.913 INFO:tasks.workunit.client.0.smithi001.stdout:7/427: read - d0/d7/d44/d36/f64 zero size 2024-09-15T22:26:44.916 INFO:tasks.workunit.client.0.smithi001.stdout:6/418: write d0/d6/f13 [4062556,55206] 0 2024-09-15T22:26:44.916 INFO:tasks.workunit.client.0.smithi001.stdout:6/419: chown d0/d6/l15 0 1 2024-09-15T22:26:44.916 INFO:tasks.workunit.client.0.smithi001.stdout:9/368: dwrite d5/de/d1a/d1b/d22/f4a [0,4194304] 0 2024-09-15T22:26:44.930 INFO:tasks.workunit.client.0.smithi001.stdout:9/369: rmdir d5/de/d1a/d1b/d2a 39 2024-09-15T22:26:44.932 INFO:tasks.workunit.client.0.smithi001.stdout:6/420: truncate d0/df/d24/d2e/f6f 3373307 0 2024-09-15T22:26:44.932 INFO:tasks.workunit.client.0.smithi001.stdout:6/421: fdatasync d0/df/d24/f58 0 2024-09-15T22:26:44.936 INFO:tasks.workunit.client.0.smithi001.stdout:9/370: creat d5/de/d15/f74 x:0 0 0 2024-09-15T22:26:44.936 INFO:tasks.workunit.client.0.smithi001.stdout:2/418: dwrite d2/d14/f2d [4194304,4194304] 0 2024-09-15T22:26:44.943 INFO:tasks.workunit.client.0.smithi001.stdout:2/419: dread d2/d12/f61 [0,4194304] 0 2024-09-15T22:26:44.949 INFO:tasks.workunit.client.0.smithi001.stdout:4/532: dwrite d0/d5d/d7c/dba/f66 [0,4194304] 0 2024-09-15T22:26:44.949 INFO:tasks.workunit.client.0.smithi001.stdout:4/533: write d0/d5d/d44/d65/d6a/f6d [1361532,13732] 0 2024-09-15T22:26:44.975 INFO:tasks.workunit.client.0.smithi001.stdout:7/428: dwrite d0/d8e/f37 [0,4194304] 0 2024-09-15T22:26:44.975 INFO:tasks.workunit.client.0.smithi001.stdout:6/422: dread d0/df/d24/f34 [0,4194304] 0 2024-09-15T22:26:44.975 INFO:tasks.workunit.client.0.smithi001.stdout:7/429: chown d0/d7/d44/f80 253 1 2024-09-15T22:26:44.975 INFO:tasks.workunit.client.0.smithi001.stdout:1/482: sync 2024-09-15T22:26:44.977 INFO:tasks.workunit.client.0.smithi001.stdout:7/430: unlink d0/f76 0 2024-09-15T22:26:44.977 INFO:tasks.workunit.client.0.smithi001.stdout:6/423: rmdir d0/d6/d5d 39 2024-09-15T22:26:44.977 INFO:tasks.workunit.client.0.smithi001.stdout:8/363: sync 2024-09-15T22:26:44.977 INFO:tasks.workunit.client.0.smithi001.stdout:7/431: dread - d0/d7/d44/f78 zero size 2024-09-15T22:26:44.977 INFO:tasks.workunit.client.0.smithi001.stdout:7/432: chown d0/d7/d21/d6b/c65 233667795 1 2024-09-15T22:26:44.977 INFO:tasks.workunit.client.0.smithi001.stdout:5/442: sync 2024-09-15T22:26:44.978 INFO:tasks.workunit.client.0.smithi001.stdout:7/433: chown d0/d7/d21/c4e 1272851913 1 2024-09-15T22:26:44.978 INFO:tasks.workunit.client.0.smithi001.stdout:8/364: symlink d9/d19/d29/d50/l65 0 2024-09-15T22:26:44.978 INFO:tasks.workunit.client.0.smithi001.stdout:7/434: write d0/d7/d21/d6b/f29 [7531099,118373] 0 2024-09-15T22:26:44.979 INFO:tasks.workunit.client.0.smithi001.stdout:5/443: link d3/d6/f59 d3/d27/f90 0 2024-09-15T22:26:44.979 INFO:tasks.workunit.client.0.smithi001.stdout:0/405: dwrite d0/d6/d77/d78/f7a [0,4194304] 0 2024-09-15T22:26:44.980 INFO:tasks.workunit.client.0.smithi001.stdout:7/435: rename d0/d7/d44/f11 to d0/d7/d21/d6b/d93/f95 0 2024-09-15T22:26:44.981 INFO:tasks.workunit.client.0.smithi001.stdout:5/444: mkdir d3/d6/d41/d4d/d91 0 2024-09-15T22:26:44.984 INFO:tasks.workunit.client.0.smithi001.stdout:0/406: rmdir d0/d6 39 2024-09-15T22:26:44.985 INFO:tasks.workunit.client.0.smithi001.stdout:0/407: write d0/d6/f2a [2265206,120999] 0 2024-09-15T22:26:44.985 INFO:tasks.workunit.client.0.smithi001.stdout:5/445: link d3/d6/d41/l63 d3/d6/d25/l92 0 2024-09-15T22:26:44.985 INFO:tasks.workunit.client.0.smithi001.stdout:5/446: rename d3/f4f to d3/d6/d41/d4d/f93 0 2024-09-15T22:26:44.992 INFO:tasks.workunit.client.0.smithi001.stdout:2/420: dwrite d2/d12/d62/f86 [0,4194304] 0 2024-09-15T22:26:44.996 INFO:tasks.workunit.client.0.smithi001.stdout:2/421: dread d2/f79 [0,4194304] 0 2024-09-15T22:26:44.996 INFO:tasks.workunit.client.0.smithi001.stdout:2/422: write d2/f5a [229567,48006] 0 2024-09-15T22:26:44.998 INFO:tasks.workunit.client.0.smithi001.stdout:2/423: symlink d2/d12/d62/d64/d76/d7f/l8c 0 2024-09-15T22:26:45.001 INFO:tasks.workunit.client.0.smithi001.stdout:8/365: read d9/d19/f3c [3105984,59898] 0 2024-09-15T22:26:45.001 INFO:tasks.workunit.client.0.smithi001.stdout:0/408: write d0/d6/f2a [2119782,130236] 0 2024-09-15T22:26:45.004 INFO:tasks.workunit.client.0.smithi001.stdout:8/366: link d9/d19/d58/f4e d9/d19/d40/d5f/d61/f66 0 2024-09-15T22:26:45.008 INFO:tasks.workunit.client.0.smithi001.stdout:8/367: rename f8 to d9/d19/d40/d5f/d61/f67 0 2024-09-15T22:26:45.011 INFO:tasks.workunit.client.0.smithi001.stdout:8/368: creat d9/d19/d58/f68 x:0 0 0 2024-09-15T22:26:45.013 INFO:tasks.workunit.client.0.smithi001.stdout:8/369: mknod d9/d19/d34/c69 0 2024-09-15T22:26:45.015 INFO:tasks.workunit.client.0.smithi001.stdout:8/370: rmdir d9/d19/d40/d5f 39 2024-09-15T22:26:45.020 INFO:tasks.workunit.client.0.smithi001.stdout:2/424: write d2/f5e [2573781,54175] 0 2024-09-15T22:26:45.020 INFO:tasks.workunit.client.0.smithi001.stdout:2/425: fdatasync d2/d12/d56/f23 0 2024-09-15T22:26:45.022 INFO:tasks.workunit.client.0.smithi001.stdout:2/426: symlink d2/d12/d56/d74/l8d 0 2024-09-15T22:26:45.022 INFO:tasks.workunit.client.0.smithi001.stdout:4/534: dread d0/d5d/d44/d65/f7d [0,4194304] 0 2024-09-15T22:26:45.025 INFO:tasks.workunit.client.0.smithi001.stdout:4/535: getdents d0/d5d/d7c 0 2024-09-15T22:26:45.026 INFO:tasks.workunit.client.0.smithi001.stdout:7/436: dread d0/d7/d2e/f63 [0,4194304] 0 2024-09-15T22:26:45.028 INFO:tasks.workunit.client.0.smithi001.stdout:0/409: write d0/dd/d1b/f5e [385593,91418] 0 2024-09-15T22:26:45.031 INFO:tasks.workunit.client.0.smithi001.stdout:5/447: dread d3/d27/d5c/f6f [0,4194304] 0 2024-09-15T22:26:45.033 INFO:tasks.workunit.client.0.smithi001.stdout:8/371: write d9/d19/f1e [1940890,111155] 0 2024-09-15T22:26:45.033 INFO:tasks.workunit.client.0.smithi001.stdout:4/536: getdents d0/d5d/d7c/dba/d20/d29/d34/d84/d95 0 2024-09-15T22:26:45.033 INFO:tasks.workunit.client.0.smithi001.stdout:8/372: write d9/d19/f3f [4721544,35059] 0 2024-09-15T22:26:45.033 INFO:tasks.workunit.client.0.smithi001.stdout:7/437: mkdir d0/d7/d44/d96 0 2024-09-15T22:26:45.033 INFO:tasks.workunit.client.0.smithi001.stdout:7/438: dread - d0/d7/d44/d36/f84 zero size 2024-09-15T22:26:45.034 INFO:tasks.workunit.client.0.smithi001.stdout:4/537: write d0/d5d/d44/d65/d6a/f6d [1165569,42851] 0 2024-09-15T22:26:45.034 INFO:tasks.workunit.client.0.smithi001.stdout:7/439: creat d0/d7/d7c/f97 x:0 0 0 2024-09-15T22:26:45.035 INFO:tasks.workunit.client.0.smithi001.stdout:4/538: creat d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d73/dc0/fc5 x:0 0 0 2024-09-15T22:26:45.036 INFO:tasks.workunit.client.0.smithi001.stdout:4/539: chown d0/l46 419 1 2024-09-15T22:26:45.037 INFO:tasks.workunit.client.0.smithi001.stdout:7/440: mkdir d0/d98 0 2024-09-15T22:26:45.037 INFO:tasks.workunit.client.0.smithi001.stdout:6/424: dwrite d0/df/d24/d2e/d43/f4a [0,4194304] 0 2024-09-15T22:26:45.037 INFO:tasks.workunit.client.0.smithi001.stdout:6/425: dread - d0/df/f89 zero size 2024-09-15T22:26:45.037 INFO:tasks.workunit.client.0.smithi001.stdout:4/540: getdents d0/d5d/d44/d65 0 2024-09-15T22:26:45.040 INFO:tasks.workunit.client.0.smithi001.stdout:0/410: write d0/f46 [2234300,121233] 0 2024-09-15T22:26:45.043 INFO:tasks.workunit.client.0.smithi001.stdout:1/483: dwrite d3/f5e [0,4194304] 0 2024-09-15T22:26:45.043 INFO:tasks.workunit.client.0.smithi001.stdout:6/426: mknod d0/df/d24/c96 0 2024-09-15T22:26:45.043 INFO:tasks.workunit.client.0.smithi001.stdout:9/371: dwrite d5/de/d1a/d1b/d22/d2c/f6a [0,4194304] 0 2024-09-15T22:26:45.044 INFO:tasks.workunit.client.0.smithi001.stdout:1/484: rmdir d3/d8d 39 2024-09-15T22:26:45.044 INFO:tasks.workunit.client.0.smithi001.stdout:1/485: write d3/f42 [4696605,58954] 0 2024-09-15T22:26:45.044 INFO:tasks.workunit.client.0.smithi001.stdout:5/448: write d3/d1d/f29 [1247680,19074] 0 2024-09-15T22:26:45.044 INFO:tasks.workunit.client.0.smithi001.stdout:1/486: fdatasync d3/f5 0 2024-09-15T22:26:45.045 INFO:tasks.workunit.client.0.smithi001.stdout:0/411: mkdir d0/d84 0 2024-09-15T22:26:45.045 INFO:tasks.workunit.client.0.smithi001.stdout:0/412: getdents d0/d6/d6a 0 2024-09-15T22:26:45.045 INFO:tasks.workunit.client.0.smithi001.stdout:5/449: symlink d3/d6/d57/d87/d8c/l94 0 2024-09-15T22:26:45.046 INFO:tasks.workunit.client.0.smithi001.stdout:5/450: dread - d3/d6/d25/f7f zero size 2024-09-15T22:26:45.046 INFO:tasks.workunit.client.0.smithi001.stdout:0/413: write d0/d9/d1a/d36/f45 [790000,108976] 0 2024-09-15T22:26:45.046 INFO:tasks.workunit.client.0.smithi001.stdout:0/414: getdents d0/d6/d6a 0 2024-09-15T22:26:45.047 INFO:tasks.workunit.client.0.smithi001.stdout:4/541: creat d0/d5d/d7c/dba/d20/d29/d34/d3a/fc6 x:0 0 0 2024-09-15T22:26:45.047 INFO:tasks.workunit.client.0.smithi001.stdout:1/487: symlink d3/l96 0 2024-09-15T22:26:45.047 INFO:tasks.workunit.client.0.smithi001.stdout:1/488: stat d3/dd/d14/d23/l62 0 2024-09-15T22:26:45.047 INFO:tasks.workunit.client.0.smithi001.stdout:4/542: creat d0/d5d/d7c/dba/d20/d29/d34/dbc/dbf/fc7 x:0 0 0 2024-09-15T22:26:45.048 INFO:tasks.workunit.client.0.smithi001.stdout:0/415: fdatasync d0/dd/d1b/f5e 0 2024-09-15T22:26:45.049 INFO:tasks.workunit.client.0.smithi001.stdout:1/489: creat d3/dd/d14/d1b/d2b/d68/d8a/f97 x:0 0 0 2024-09-15T22:26:45.049 INFO:tasks.workunit.client.0.smithi001.stdout:1/490: chown d3/dd/d14/d1b/f6d 15 1 2024-09-15T22:26:45.049 INFO:tasks.workunit.client.0.smithi001.stdout:1/491: truncate d3/dd/d14/d23/d4b/f70 692236 0 2024-09-15T22:26:45.049 INFO:tasks.workunit.client.0.smithi001.stdout:1/492: readlink d3/dd/d3c/l8c 0 2024-09-15T22:26:45.050 INFO:tasks.workunit.client.0.smithi001.stdout:6/427: mkdir d0/df/d97 0 2024-09-15T22:26:45.051 INFO:tasks.workunit.client.0.smithi001.stdout:9/372: creat d5/de/d1a/d1b/d22/d2c/f75 x:0 0 0 2024-09-15T22:26:45.051 INFO:tasks.workunit.client.0.smithi001.stdout:6/428: symlink d0/d6/d5d/d67/d53/l98 0 2024-09-15T22:26:45.053 INFO:tasks.workunit.client.0.smithi001.stdout:9/373: creat d5/de/d1a/d1b/d22/d2c/d21/d68/f76 x:0 0 0 2024-09-15T22:26:45.053 INFO:tasks.workunit.client.0.smithi001.stdout:9/374: chown d5/de/d1a/d1b/d22/d2c/d21/f25 45751 1 2024-09-15T22:26:45.053 INFO:tasks.workunit.client.0.smithi001.stdout:9/375: dread - d5/de/d1a/d1b/d22/d2c/d21/d24/f6e zero size 2024-09-15T22:26:45.053 INFO:tasks.workunit.client.0.smithi001.stdout:9/376: fdatasync d5/de/d1a/d1b/f3a 0 2024-09-15T22:26:45.054 INFO:tasks.workunit.client.0.smithi001.stdout:1/493: mkdir d3/dd/d14/d1b/d98 0 2024-09-15T22:26:45.057 INFO:tasks.workunit.client.0.smithi001.stdout:6/429: mknod d0/d6/d5d/c99 0 2024-09-15T22:26:45.067 INFO:tasks.workunit.client.0.smithi001.stdout:6/430: link d0/df/d24/l52 d0/d6/l9a 0 2024-09-15T22:26:45.071 INFO:tasks.workunit.client.0.smithi001.stdout:5/451: dread d3/d6/f59 [0,4194304] 0 2024-09-15T22:26:45.071 INFO:tasks.workunit.client.0.smithi001.stdout:1/494: dread d3/dd/d14/d1b/f2f [0,4194304] 0 2024-09-15T22:26:45.071 INFO:tasks.workunit.client.0.smithi001.stdout:5/452: readlink d3/l15 0 2024-09-15T22:26:45.071 INFO:tasks.workunit.client.0.smithi001.stdout:5/453: creat d3/d49/f95 x:0 0 0 2024-09-15T22:26:45.073 INFO:tasks.workunit.client.0.smithi001.stdout:5/454: rename d3/d27/d5c/f6f to d3/d6/d41/d4d/d5a/f96 0 2024-09-15T22:26:45.074 INFO:tasks.workunit.client.0.smithi001.stdout:5/455: creat d3/d6/d57/d87/d8c/f97 x:0 0 0 2024-09-15T22:26:45.088 INFO:tasks.workunit.client.0.smithi001.stdout:8/373: dwrite d9/fa [0,4194304] 0 2024-09-15T22:26:45.097 INFO:tasks.workunit.client.0.smithi001.stdout:8/374: read d9/f18 [1219774,105652] 0 2024-09-15T22:26:45.108 INFO:tasks.workunit.client.0.smithi001.stdout:8/375: write d9/d19/f2b [189394,20867] 0 2024-09-15T22:26:45.112 INFO:tasks.workunit.client.0.smithi001.stdout:8/376: truncate f4 63543 0 2024-09-15T22:26:45.121 INFO:tasks.workunit.client.0.smithi001.stdout:0/416: dwrite d0/dd/d1b/f72 [0,4194304] 0 2024-09-15T22:26:45.121 INFO:tasks.workunit.client.0.smithi001.stdout:0/417: chown d0/dd/d1b/f72 0 1 2024-09-15T22:26:45.126 INFO:tasks.workunit.client.0.smithi001.stdout:2/427: dwrite d2/f10 [0,4194304] 0 2024-09-15T22:26:45.142 INFO:tasks.workunit.client.0.smithi001.stdout:8/377: write d9/f21 [1130430,7519] 0 2024-09-15T22:26:45.143 INFO:tasks.workunit.client.0.smithi001.stdout:4/543: dwrite d0/d5d/d7c/dba/d20/f9f [0,4194304] 0 2024-09-15T22:26:45.144 INFO:tasks.workunit.client.0.smithi001.stdout:1/495: dwrite d3/d12/f40 [0,4194304] 0 2024-09-15T22:26:45.145 INFO:tasks.workunit.client.0.smithi001.stdout:4/544: truncate d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d73/fa8 2364295 0 2024-09-15T22:26:45.146 INFO:tasks.workunit.client.0.smithi001.stdout:8/378: rename d9/d19/d29/d35/f39 to d9/d19/d29/d33/d63/f6a 0 2024-09-15T22:26:45.147 INFO:tasks.workunit.client.0.smithi001.stdout:4/545: mkdir d0/d5d/d7c/dba/d20/d29/d40/dc8 0 2024-09-15T22:26:45.148 INFO:tasks.workunit.client.0.smithi001.stdout:4/546: mknod d0/d27/d94/cc9 0 2024-09-15T22:26:45.150 INFO:tasks.workunit.client.0.smithi001.stdout:6/431: dwrite d0/d6/d5d/d67/f26 [8388608,4194304] 0 2024-09-15T22:26:45.150 INFO:tasks.workunit.client.0.smithi001.stdout:3/415: sync 2024-09-15T22:26:45.151 INFO:tasks.workunit.client.0.smithi001.stdout:7/441: dwrite d0/f2f [0,4194304] 0 2024-09-15T22:26:45.152 INFO:tasks.workunit.client.0.smithi001.stdout:6/432: symlink d0/df/d24/d49/l9b 0 2024-09-15T22:26:45.152 INFO:tasks.workunit.client.0.smithi001.stdout:4/547: link d0/d5d/d7c/dba/d20/d29/d40/fa5 d0/d27/fca 0 2024-09-15T22:26:45.153 INFO:tasks.workunit.client.0.smithi001.stdout:6/433: dread - d0/df/d24/d2e/d43/f3c zero size 2024-09-15T22:26:45.153 INFO:tasks.workunit.client.0.smithi001.stdout:6/434: stat d0/df/d24/f7f 0 2024-09-15T22:26:45.154 INFO:tasks.workunit.client.0.smithi001.stdout:7/442: creat d0/d7/d44/d36/f99 x:0 0 0 2024-09-15T22:26:45.155 INFO:tasks.workunit.client.0.smithi001.stdout:7/443: readlink d0/d8e/d3e/l43 0 2024-09-15T22:26:45.155 INFO:tasks.workunit.client.0.smithi001.stdout:7/444: truncate d0/d7/d21/d6b/d93/f95 7065327 0 2024-09-15T22:26:45.155 INFO:tasks.workunit.client.0.smithi001.stdout:7/445: chown d0/d8e/f4a 54289 1 2024-09-15T22:26:45.156 INFO:tasks.workunit.client.0.smithi001.stdout:7/446: getdents d0/d7/d7c 0 2024-09-15T22:26:45.156 INFO:tasks.workunit.client.0.smithi001.stdout:7/447: stat d0/d7/d21/d6b/c25 0 2024-09-15T22:26:45.156 INFO:tasks.workunit.client.0.smithi001.stdout:4/548: truncate d0/d5d/d7c/dba/d20/f63 5941858 0 2024-09-15T22:26:45.160 INFO:tasks.workunit.client.0.smithi001.stdout:6/435: unlink d0/c3f 0 2024-09-15T22:26:45.160 INFO:tasks.workunit.client.0.smithi001.stdout:6/436: write d0/df/d24/d2e/d43/f93 [684145,32039] 0 2024-09-15T22:26:45.162 INFO:tasks.workunit.client.0.smithi001.stdout:4/549: unlink d0/d27/fa1 0 2024-09-15T22:26:45.181 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:44 smithi001 ceph-mon[30843]: pgmap v412: 97 pgs: 97 active+clean; 387 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 MiB/s rd, 51 MiB/s wr, 1.63k op/s 2024-09-15T22:26:45.190 INFO:tasks.workunit.client.0.smithi001.stdout:9/377: dwrite d5/de/d1a/d1b/d22/d2c/f61 [0,4194304] 0 2024-09-15T22:26:45.197 INFO:tasks.workunit.client.0.smithi001.stdout:9/378: rmdir d5/de/d51/d53 39 2024-09-15T22:26:45.197 INFO:tasks.workunit.client.0.smithi001.stdout:9/379: write d5/de/d1a/f42 [860,8227] 0 2024-09-15T22:26:45.197 INFO:tasks.workunit.client.0.smithi001.stdout:9/380: truncate d5/de/d1a/d1b/d22/f2f 2521092 0 2024-09-15T22:26:45.199 INFO:tasks.workunit.client.0.smithi001.stdout:9/381: link d5/de/d1a/d1b/d22/d2c/d21/d24/c34 d5/de/d15/d27/d63/c77 0 2024-09-15T22:26:45.199 INFO:tasks.workunit.client.0.smithi001.stdout:9/382: readlink d5/de/d1a/d1b/d22/d2c/d21/l66 0 2024-09-15T22:26:45.205 INFO:tasks.workunit.client.0.smithi001.stdout:8/379: dwrite d9/f21 [0,4194304] 0 2024-09-15T22:26:45.208 INFO:tasks.workunit.client.0.smithi001.stdout:7/448: dwrite d0/d8e/d3e/f41 [0,4194304] 0 2024-09-15T22:26:45.210 INFO:tasks.workunit.client.0.smithi001.stdout:7/449: symlink d0/d7/d2e/d60/l9a 0 2024-09-15T22:26:45.238 INFO:tasks.workunit.client.0.smithi001.stdout:6/437: dwrite d0/df/d24/d2e/d43/f93 [0,4194304] 0 2024-09-15T22:26:45.238 INFO:tasks.workunit.client.0.smithi001.stdout:6/438: truncate d0/df/d24/f84 478800 0 2024-09-15T22:26:45.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:44 smithi012 ceph-mon[34883]: pgmap v412: 97 pgs: 97 active+clean; 387 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 MiB/s rd, 51 MiB/s wr, 1.63k op/s 2024-09-15T22:26:45.247 INFO:tasks.workunit.client.0.smithi001.stdout:9/383: dwrite d5/de/d1a/d1b/d22/f4a [0,4194304] 0 2024-09-15T22:26:45.247 INFO:tasks.workunit.client.0.smithi001.stdout:6/439: dread d0/df/d24/f7f [0,4194304] 0 2024-09-15T22:26:45.248 INFO:tasks.workunit.client.0.smithi001.stdout:9/384: creat d5/de/d1a/d1b/d2a/f78 x:0 0 0 2024-09-15T22:26:45.249 INFO:tasks.workunit.client.0.smithi001.stdout:6/440: mknod d0/d6/d5d/c9c 0 2024-09-15T22:26:45.250 INFO:tasks.workunit.client.0.smithi001.stdout:9/385: creat d5/de/d15/d27/d63/f79 x:0 0 0 2024-09-15T22:26:45.251 INFO:tasks.workunit.client.0.smithi001.stdout:6/441: creat d0/d6/d5d/f9d x:0 0 0 2024-09-15T22:26:45.252 INFO:tasks.workunit.client.0.smithi001.stdout:9/386: symlink d5/de/d51/d53/l7a 0 2024-09-15T22:26:45.252 INFO:tasks.workunit.client.0.smithi001.stdout:9/387: dread - d5/de/d1a/d1b/d22/d2c/d21/d68/f76 zero size 2024-09-15T22:26:45.252 INFO:tasks.workunit.client.0.smithi001.stdout:9/388: chown d5/de/d51/c5c 1806867 1 2024-09-15T22:26:45.254 INFO:tasks.workunit.client.0.smithi001.stdout:6/442: creat d0/d6/d5d/f9e x:0 0 0 2024-09-15T22:26:45.254 INFO:tasks.workunit.client.0.smithi001.stdout:6/443: dread - d0/d6/d5d/f9d zero size 2024-09-15T22:26:45.291 INFO:tasks.workunit.client.0.smithi001.stdout:6/444: dwrite d0/d6/d5d/d67/f26 [4194304,4194304] 0 2024-09-15T22:26:45.292 INFO:tasks.workunit.client.0.smithi001.stdout:7/450: dwrite d0/d7/d44/d3f/d49/f59 [0,4194304] 0 2024-09-15T22:26:45.297 INFO:tasks.workunit.client.0.smithi001.stdout:6/445: dread d0/df/d24/f7f [0,4194304] 0 2024-09-15T22:26:45.305 INFO:tasks.workunit.client.0.smithi001.stdout:6/446: dread d0/d6/d5d/d67/d53/f72 [0,4194304] 0 2024-09-15T22:26:45.306 INFO:tasks.workunit.client.0.smithi001.stdout:6/447: rmdir d0/df/d24/d2e/d43/d30 39 2024-09-15T22:26:45.307 INFO:tasks.workunit.client.0.smithi001.stdout:6/448: mknod d0/d6/d5d/d67/c9f 0 2024-09-15T22:26:45.307 INFO:tasks.workunit.client.0.smithi001.stdout:6/449: truncate d0/df/d24/f6b 283910 0 2024-09-15T22:26:45.308 INFO:tasks.workunit.client.0.smithi001.stdout:6/450: mkdir d0/d6/d5d/d67/d53/da0 0 2024-09-15T22:26:45.308 INFO:tasks.workunit.client.0.smithi001.stdout:6/451: getdents d0/d6/d5d/d67/d53/da0 0 2024-09-15T22:26:45.308 INFO:tasks.workunit.client.0.smithi001.stdout:6/452: write d0/d6/d5d/d67/f38 [959311,110230] 0 2024-09-15T22:26:45.309 INFO:tasks.workunit.client.0.smithi001.stdout:6/453: creat d0/d6/d5d/d8c/fa1 x:0 0 0 2024-09-15T22:26:45.310 INFO:tasks.workunit.client.0.smithi001.stdout:5/456: sync 2024-09-15T22:26:45.310 INFO:tasks.workunit.client.0.smithi001.stdout:1/496: sync 2024-09-15T22:26:45.310 INFO:tasks.workunit.client.0.smithi001.stdout:2/428: sync 2024-09-15T22:26:45.310 INFO:tasks.workunit.client.0.smithi001.stdout:0/418: sync 2024-09-15T22:26:45.310 INFO:tasks.workunit.client.0.smithi001.stdout:3/416: sync 2024-09-15T22:26:45.310 INFO:tasks.workunit.client.0.smithi001.stdout:3/417: fsync f6 0 2024-09-15T22:26:45.310 INFO:tasks.workunit.client.0.smithi001.stdout:5/457: truncate d3/d27/f42 5083513 0 2024-09-15T22:26:45.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:44 smithi098 ceph-mon[35514]: pgmap v412: 97 pgs: 97 active+clean; 387 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 MiB/s rd, 51 MiB/s wr, 1.63k op/s 2024-09-15T22:26:45.315 INFO:tasks.workunit.client.0.smithi001.stdout:1/497: creat d3/f99 x:0 0 0 2024-09-15T22:26:45.315 INFO:tasks.workunit.client.0.smithi001.stdout:6/454: link d0/d6/d5d/d8c/f8d d0/d7e/fa2 0 2024-09-15T22:26:45.315 INFO:tasks.workunit.client.0.smithi001.stdout:9/389: dwrite d5/f11 [0,4194304] 0 2024-09-15T22:26:45.315 INFO:tasks.workunit.client.0.smithi001.stdout:9/390: fsync d5/de/d1a/d1b/f3a 0 2024-09-15T22:26:45.315 INFO:tasks.workunit.client.0.smithi001.stdout:9/391: dread - d5/de/d15/d27/d63/f79 zero size 2024-09-15T22:26:45.315 INFO:tasks.workunit.client.0.smithi001.stdout:9/392: dread - d5/de/d15/d27/f50 zero size 2024-09-15T22:26:45.315 INFO:tasks.workunit.client.0.smithi001.stdout:9/393: dread - d5/de/d15/d27/d63/f79 zero size 2024-09-15T22:26:45.315 INFO:tasks.workunit.client.0.smithi001.stdout:9/394: read - d5/de/d1a/d1b/d22/d2c/f75 zero size 2024-09-15T22:26:45.315 INFO:tasks.workunit.client.0.smithi001.stdout:7/451: dread d0/d7/d44/d3f/d49/f59 [0,4194304] 0 2024-09-15T22:26:45.315 INFO:tasks.workunit.client.0.smithi001.stdout:9/395: chown d5/de/d1a/d1b/d22/d2c/f6a 5413 1 2024-09-15T22:26:45.315 INFO:tasks.workunit.client.0.smithi001.stdout:5/458: dread d3/d1d/d54/d56/f55 [0,4194304] 0 2024-09-15T22:26:45.319 INFO:tasks.workunit.client.0.smithi001.stdout:6/455: getdents d0/d6/d5d 0 2024-09-15T22:26:45.319 INFO:tasks.workunit.client.0.smithi001.stdout:1/498: rename d3/dd/d14/f5a to d3/dd/d3c/d4c/f9a 0 2024-09-15T22:26:45.319 INFO:tasks.workunit.client.0.smithi001.stdout:9/396: creat d5/de/d15/d27/d63/f7b x:0 0 0 2024-09-15T22:26:45.319 INFO:tasks.workunit.client.0.smithi001.stdout:1/499: mknod d3/dd/d3c/d4c/c9b 0 2024-09-15T22:26:45.319 INFO:tasks.workunit.client.0.smithi001.stdout:1/500: chown d3/dd/f58 40 1 2024-09-15T22:26:45.320 INFO:tasks.workunit.client.0.smithi001.stdout:9/397: creat d5/de/d15/d27/f7c x:0 0 0 2024-09-15T22:26:45.322 INFO:tasks.workunit.client.0.smithi001.stdout:1/501: rename d3/d12/d79/f80 to d3/dd/d3c/f9c 0 2024-09-15T22:26:45.324 INFO:tasks.workunit.client.0.smithi001.stdout:1/502: unlink d3/dd/d3c/d64/c83 0 2024-09-15T22:26:45.332 INFO:tasks.workunit.client.0.smithi001.stdout:5/459: dread d3/d6/d41/f4c [0,4194304] 0 2024-09-15T22:26:45.337 INFO:tasks.workunit.client.0.smithi001.stdout:1/503: link d3/dd/d14/d1b/f6c d3/dd/d14/d23/f9d 0 2024-09-15T22:26:45.338 INFO:tasks.workunit.client.0.smithi001.stdout:5/460: mknod d3/d6/d41/d65/c98 0 2024-09-15T22:26:45.338 INFO:tasks.workunit.client.0.smithi001.stdout:0/419: dread d0/d9/db/f19 [0,4194304] 0 2024-09-15T22:26:45.339 INFO:tasks.workunit.client.0.smithi001.stdout:1/504: rename d3/dd/d14/d1b/l66 to d3/d12/d21/d82/l9e 0 2024-09-15T22:26:45.340 INFO:tasks.workunit.client.0.smithi001.stdout:0/420: creat d0/d6/d77/d78/f85 x:0 0 0 2024-09-15T22:26:45.340 INFO:tasks.workunit.client.0.smithi001.stdout:0/421: stat d0/d9/f2c 0 2024-09-15T22:26:45.347 INFO:tasks.workunit.client.0.smithi001.stdout:1/505: mknod d3/dd/d14/d23/d4b/c9f 0 2024-09-15T22:26:45.347 INFO:tasks.workunit.client.0.smithi001.stdout:1/506: readlink d3/l6e 0 2024-09-15T22:26:45.351 INFO:tasks.workunit.client.0.smithi001.stdout:4/550: sync 2024-09-15T22:26:45.351 INFO:tasks.workunit.client.0.smithi001.stdout:4/551: stat d0/d5d/c96 0 2024-09-15T22:26:45.351 INFO:tasks.workunit.client.0.smithi001.stdout:4/552: write d0/d27/d35/f58 [3882365,34039] 0 2024-09-15T22:26:45.353 INFO:tasks.workunit.client.0.smithi001.stdout:4/553: rename d0/d27/f36 to d0/d5d/d7c/dba/d20/d29/d40/dc8/fcb 0 2024-09-15T22:26:45.357 INFO:tasks.workunit.client.0.smithi001.stdout:5/461: read d3/d6/d25/f2c [446238,98549] 0 2024-09-15T22:26:45.357 INFO:tasks.workunit.client.0.smithi001.stdout:5/462: write d3/d27/f42 [6002040,14872] 0 2024-09-15T22:26:45.358 INFO:tasks.workunit.client.0.smithi001.stdout:5/463: mknod d3/d27/d7a/c99 0 2024-09-15T22:26:45.358 INFO:tasks.workunit.client.0.smithi001.stdout:5/464: chown d3/d1d/d54/l5d 3 1 2024-09-15T22:26:45.359 INFO:tasks.workunit.client.0.smithi001.stdout:5/465: symlink d3/d6/d41/d4d/d5a/l9a 0 2024-09-15T22:26:45.359 INFO:tasks.workunit.client.0.smithi001.stdout:5/466: rmdir d3/d1d/d54/d56/d52 39 2024-09-15T22:26:45.359 INFO:tasks.workunit.client.0.smithi001.stdout:5/467: truncate d3/d49/f7e 270472 0 2024-09-15T22:26:45.360 INFO:tasks.workunit.client.0.smithi001.stdout:5/468: chown d3/d6/d25/f38 2 1 2024-09-15T22:26:45.399 INFO:tasks.workunit.client.0.smithi001.stdout:4/554: dread d0/d27/d35/d74/f99 [4194304,4194304] 0 2024-09-15T22:26:45.402 INFO:tasks.workunit.client.0.smithi001.stdout:6/456: dwrite d0/d6/d5d/d67/f44 [0,4194304] 0 2024-09-15T22:26:45.405 INFO:tasks.workunit.client.0.smithi001.stdout:4/555: truncate d0/d5d/d44/d65/f7d 282528 0 2024-09-15T22:26:45.405 INFO:tasks.workunit.client.0.smithi001.stdout:6/457: mkdir d0/df/d97/da3 0 2024-09-15T22:26:45.406 INFO:tasks.workunit.client.0.smithi001.stdout:4/556: rmdir d0/d5d/d44/dac 0 2024-09-15T22:26:45.406 INFO:tasks.workunit.client.0.smithi001.stdout:3/418: dwrite da/d3b/d1b/f60 [4194304,4194304] 0 2024-09-15T22:26:45.407 INFO:tasks.workunit.client.0.smithi001.stdout:6/458: rename d0/d6/d5d/d67/f60 to d0/d6/d5d/d67/d53/fa4 0 2024-09-15T22:26:45.410 INFO:tasks.workunit.client.0.smithi001.stdout:3/419: link da/d16/ff da/d1f/d46/f8a 0 2024-09-15T22:26:45.411 INFO:tasks.workunit.client.0.smithi001.stdout:3/420: mkdir da/d3b/d8b 0 2024-09-15T22:26:45.413 INFO:tasks.workunit.client.0.smithi001.stdout:5/469: dwrite d3/d6/d41/f5e [4194304,4194304] 0 2024-09-15T22:26:45.413 INFO:tasks.workunit.client.0.smithi001.stdout:3/421: rename da/d16/f38 to da/d3d/d43/d41/d70/d7f/f8c 0 2024-09-15T22:26:45.414 INFO:tasks.workunit.client.0.smithi001.stdout:9/398: dwrite d5/de/d1a/f56 [0,4194304] 0 2024-09-15T22:26:45.415 INFO:tasks.workunit.client.0.smithi001.stdout:9/399: write d5/de/d1a/d1b/d22/d2c/f75 [910402,112886] 0 2024-09-15T22:26:45.417 INFO:tasks.workunit.client.0.smithi001.stdout:5/470: creat d3/d27/d4e/d89/f9b x:0 0 0 2024-09-15T22:26:45.417 INFO:tasks.workunit.client.0.smithi001.stdout:5/471: chown d3/d6/d57/d87/d8c/l94 11839727 1 2024-09-15T22:26:45.420 INFO:tasks.workunit.client.0.smithi001.stdout:3/422: read da/d3b/d1b/d6a/d6f/f71 [91188,34735] 0 2024-09-15T22:26:45.422 INFO:tasks.workunit.client.0.smithi001.stdout:2/429: dwrite d2/d14/d1a/d1b/f78 [0,4194304] 0 2024-09-15T22:26:45.422 INFO:tasks.workunit.client.0.smithi001.stdout:2/430: write d2/d14/d1a/f7a [414930,111244] 0 2024-09-15T22:26:45.423 INFO:tasks.workunit.client.0.smithi001.stdout:1/507: dwrite d3/f7 [4194304,4194304] 0 2024-09-15T22:26:45.423 INFO:tasks.workunit.client.0.smithi001.stdout:7/452: dwrite d0/d8e/d3e/f41 [0,4194304] 0 2024-09-15T22:26:45.423 INFO:tasks.workunit.client.0.smithi001.stdout:1/508: readlink d3/l96 0 2024-09-15T22:26:45.426 INFO:tasks.workunit.client.0.smithi001.stdout:2/431: symlink d2/d12/d62/d64/d76/l8e 0 2024-09-15T22:26:45.426 INFO:tasks.workunit.client.0.smithi001.stdout:1/509: mknod d3/d12/d90/ca0 0 2024-09-15T22:26:45.427 INFO:tasks.workunit.client.0.smithi001.stdout:2/432: mknod d2/d12/d56/c8f 0 2024-09-15T22:26:45.435 INFO:tasks.workunit.client.0.smithi001.stdout:2/433: mknod d2/d12/d62/d1f/d6f/d70/c90 0 2024-09-15T22:26:45.435 INFO:tasks.workunit.client.0.smithi001.stdout:2/434: chown d2/d12/d62/d1f 34 1 2024-09-15T22:26:45.437 INFO:tasks.workunit.client.0.smithi001.stdout:7/453: unlink d0/d7/d44/d3f/d49/f89 0 2024-09-15T22:26:45.441 INFO:tasks.workunit.client.0.smithi001.stdout:5/472: read d3/d6/d25/f38 [1689236,109515] 0 2024-09-15T22:26:45.441 INFO:tasks.workunit.client.0.smithi001.stdout:5/473: chown d3/d6/d41/d4d/d5a/f96 7 1 2024-09-15T22:26:45.441 INFO:tasks.workunit.client.0.smithi001.stdout:5/474: chown d3/c34 59 1 2024-09-15T22:26:45.443 INFO:tasks.workunit.client.0.smithi001.stdout:0/422: dwrite d0/dd/d33/f5b [4194304,4194304] 0 2024-09-15T22:26:45.443 INFO:tasks.workunit.client.0.smithi001.stdout:0/423: truncate d0/d6/d77/d78/f7e 569486 0 2024-09-15T22:26:45.445 INFO:tasks.workunit.client.0.smithi001.stdout:0/424: write d0/f16 [5267661,85663] 0 2024-09-15T22:26:45.445 INFO:tasks.workunit.client.0.smithi001.stdout:0/425: fdatasync d0/d6/d77/d78/f7e 0 2024-09-15T22:26:45.445 INFO:tasks.workunit.client.0.smithi001.stdout:0/426: chown d0/d9/f56 1484 1 2024-09-15T22:26:45.448 INFO:tasks.workunit.client.0.smithi001.stdout:4/557: dwrite d0/d5d/d7c/dba/f2d [0,4194304] 0 2024-09-15T22:26:45.450 INFO:tasks.workunit.client.0.smithi001.stdout:5/475: mknod d3/d1d/d54/d56/d52/c9c 0 2024-09-15T22:26:45.450 INFO:tasks.workunit.client.0.smithi001.stdout:5/476: stat d3/d27/l85 0 2024-09-15T22:26:45.450 INFO:tasks.workunit.client.0.smithi001.stdout:5/477: chown d3/d27/f39 29169958 1 2024-09-15T22:26:45.450 INFO:tasks.workunit.client.0.smithi001.stdout:5/478: dread - d3/d6/d57/f7c zero size 2024-09-15T22:26:45.451 INFO:tasks.workunit.client.0.smithi001.stdout:5/479: write d3/d6/d57/d87/d8c/f97 [747705,15084] 0 2024-09-15T22:26:45.451 INFO:tasks.workunit.client.0.smithi001.stdout:5/480: fdatasync d3/d6/f59 0 2024-09-15T22:26:45.451 INFO:tasks.workunit.client.0.smithi001.stdout:5/481: readlink d3/d6/d41/l8e 0 2024-09-15T22:26:45.454 INFO:tasks.workunit.client.0.smithi001.stdout:5/482: creat d3/d6/d41/f9d x:0 0 0 2024-09-15T22:26:45.454 INFO:tasks.workunit.client.0.smithi001.stdout:5/483: fdatasync d3/d6/d25/f7f 0 2024-09-15T22:26:45.454 INFO:tasks.workunit.client.0.smithi001.stdout:5/484: write d3/d6/d41/d4d/d5a/f96 [2553809,39554] 0 2024-09-15T22:26:45.457 INFO:tasks.workunit.client.0.smithi001.stdout:5/485: unlink d3/c2b 0 2024-09-15T22:26:45.467 INFO:tasks.workunit.client.0.smithi001.stdout:6/459: dwrite d0/d6/d5d/d67/f54 [0,4194304] 0 2024-09-15T22:26:45.467 INFO:tasks.workunit.client.0.smithi001.stdout:8/380: sync 2024-09-15T22:26:45.469 INFO:tasks.workunit.client.0.smithi001.stdout:6/460: symlink d0/df/d24/d49/la5 0 2024-09-15T22:26:45.483 INFO:tasks.workunit.client.0.smithi001.stdout:7/454: dwrite d0/d7/d21/f3d [0,4194304] 0 2024-09-15T22:26:45.483 INFO:tasks.workunit.client.0.smithi001.stdout:7/455: fsync d0/d7/d44/d36/f83 0 2024-09-15T22:26:45.487 INFO:tasks.workunit.client.0.smithi001.stdout:7/456: unlink d0/d7/d44/d3f/d49/f86 0 2024-09-15T22:26:45.489 INFO:tasks.workunit.client.0.smithi001.stdout:7/457: creat d0/d7/d21/f9b x:0 0 0 2024-09-15T22:26:45.502 INFO:tasks.workunit.client.0.smithi001.stdout:2/435: dwrite d2/d12/d62/d1f/f3c [0,4194304] 0 2024-09-15T22:26:45.506 INFO:tasks.workunit.client.0.smithi001.stdout:2/436: symlink d2/d12/d62/l91 0 2024-09-15T22:26:45.509 INFO:tasks.workunit.client.0.smithi001.stdout:2/437: mknod d2/c92 0 2024-09-15T22:26:45.510 INFO:tasks.workunit.client.0.smithi001.stdout:1/510: dwrite d3/dd/d14/d1b/f2f [0,4194304] 0 2024-09-15T22:26:45.510 INFO:tasks.workunit.client.0.smithi001.stdout:1/511: stat d3/dd/d3c/f43 0 2024-09-15T22:26:45.516 INFO:tasks.workunit.client.0.smithi001.stdout:2/438: rename d2/d14/d1a/d1b/l5d to d2/d12/d62/d1f/d6f/l93 0 2024-09-15T22:26:45.520 INFO:tasks.workunit.client.0.smithi001.stdout:7/458: write d0/d7/d21/f3d [1770012,67196] 0 2024-09-15T22:26:45.521 INFO:tasks.workunit.client.0.smithi001.stdout:6/461: dread d0/f22 [0,4194304] 0 2024-09-15T22:26:45.523 INFO:tasks.workunit.client.0.smithi001.stdout:7/459: rename d0/d7/d21/d6b/f2d to d0/d7/d2e/f9c 0 2024-09-15T22:26:45.525 INFO:tasks.workunit.client.0.smithi001.stdout:6/462: mkdir d0/d6/d5d/da6 0 2024-09-15T22:26:45.525 INFO:tasks.workunit.client.0.smithi001.stdout:7/460: unlink d0/d8e/d3e/f41 0 2024-09-15T22:26:45.525 INFO:tasks.workunit.client.0.smithi001.stdout:7/461: dread - d0/d7/d44/f8d zero size 2024-09-15T22:26:45.526 INFO:tasks.workunit.client.0.smithi001.stdout:2/439: dread d2/d14/d1a/d1b/f26 [0,4194304] 0 2024-09-15T22:26:45.527 INFO:tasks.workunit.client.0.smithi001.stdout:6/463: mkdir d0/df/d24/d2e/d43/d30/da7 0 2024-09-15T22:26:45.527 INFO:tasks.workunit.client.0.smithi001.stdout:6/464: stat d0/df/d24/d2e/d43/f59 0 2024-09-15T22:26:45.527 INFO:tasks.workunit.client.0.smithi001.stdout:2/440: creat d2/d14/d1a/d8a/f94 x:0 0 0 2024-09-15T22:26:45.528 INFO:tasks.workunit.client.0.smithi001.stdout:2/441: creat d2/d12/d62/d1f/f95 x:0 0 0 2024-09-15T22:26:45.528 INFO:tasks.workunit.client.0.smithi001.stdout:6/465: creat d0/d6/d5d/d67/d53/fa8 x:0 0 0 2024-09-15T22:26:45.528 INFO:tasks.workunit.client.0.smithi001.stdout:6/466: dread - d0/df/d24/f2c zero size 2024-09-15T22:26:45.530 INFO:tasks.workunit.client.0.smithi001.stdout:2/442: creat d2/d14/f96 x:0 0 0 2024-09-15T22:26:45.530 INFO:tasks.workunit.client.0.smithi001.stdout:2/443: dread - d2/d12/d62/d1f/f75 zero size 2024-09-15T22:26:45.530 INFO:tasks.workunit.client.0.smithi001.stdout:2/444: readlink d2/d12/d62/d1f/l6c 0 2024-09-15T22:26:45.530 INFO:tasks.workunit.client.0.smithi001.stdout:5/486: dwrite d3/d6/f59 [0,4194304] 0 2024-09-15T22:26:45.532 INFO:tasks.workunit.client.0.smithi001.stdout:5/487: creat d3/d1d/d54/f9e x:0 0 0 2024-09-15T22:26:45.534 INFO:tasks.workunit.client.0.smithi001.stdout:2/445: rename d2/d12/d56 to d2/d14/d1a/d1b/d82/d97 0 2024-09-15T22:26:45.537 INFO:tasks.workunit.client.0.smithi001.stdout:9/400: dwrite d5/de/d1a/d1b/f33 [0,4194304] 0 2024-09-15T22:26:45.537 INFO:tasks.workunit.client.0.smithi001.stdout:9/401: truncate d5/de/d1a/d1b/f70 83293 0 2024-09-15T22:26:45.540 INFO:tasks.workunit.client.0.smithi001.stdout:2/446: write d2/d14/d1a/d1b/f26 [629423,89663] 0 2024-09-15T22:26:45.542 INFO:tasks.workunit.client.0.smithi001.stdout:7/462: write d0/d7/d44/d3f/f75 [3231959,98690] 0 2024-09-15T22:26:45.545 INFO:tasks.workunit.client.0.smithi001.stdout:7/463: creat d0/d7/d44/d94/f9d x:0 0 0 2024-09-15T22:26:45.549 INFO:tasks.workunit.client.0.smithi001.stdout:4/558: dwrite d0/d5d/d7c/dba/d20/f9f [0,4194304] 0 2024-09-15T22:26:45.551 INFO:tasks.workunit.client.0.smithi001.stdout:4/559: rmdir d0/d27 39 2024-09-15T22:26:45.561 INFO:tasks.workunit.client.0.smithi001.stdout:1/512: dwrite d3/dd/d3c/d4c/f5c [0,4194304] 0 2024-09-15T22:26:45.561 INFO:tasks.workunit.client.0.smithi001.stdout:1/513: chown d3/l96 869998 1 2024-09-15T22:26:45.561 INFO:tasks.workunit.client.0.smithi001.stdout:1/514: chown d3/f42 1287654 1 2024-09-15T22:26:45.561 INFO:tasks.workunit.client.0.smithi001.stdout:1/515: write d3/dd/d14/d1b/d2b/d68/f7a [913165,56527] 0 2024-09-15T22:26:45.569 INFO:tasks.workunit.client.0.smithi001.stdout:1/516: rmdir d3/dd/d14/d1b/d2b/d68 39 2024-09-15T22:26:45.570 INFO:tasks.workunit.client.0.smithi001.stdout:1/517: mkdir d3/dd/d14/d23/da1 0 2024-09-15T22:26:45.571 INFO:tasks.workunit.client.0.smithi001.stdout:1/518: chown d3/f99 1 1 2024-09-15T22:26:45.578 INFO:tasks.workunit.client.0.smithi001.stdout:6/467: write d0/d6/d5d/d67/f2b [5577021,96679] 0 2024-09-15T22:26:45.578 INFO:tasks.workunit.client.0.smithi001.stdout:6/468: chown d0/d6/d5d/f63 137 1 2024-09-15T22:26:45.578 INFO:tasks.workunit.client.0.smithi001.stdout:0/427: dwrite d0/d9/f2c [0,4194304] 0 2024-09-15T22:26:45.582 INFO:tasks.workunit.client.0.smithi001.stdout:0/428: truncate d0/d9/d1a/f64 3083998 0 2024-09-15T22:26:45.583 INFO:tasks.workunit.client.0.smithi001.stdout:1/519: write d3/dd/d14/d1b/f2f [4005125,128525] 0 2024-09-15T22:26:45.584 INFO:tasks.workunit.client.0.smithi001.stdout:1/520: mkdir d3/dd/d14/d23/da1/da2 0 2024-09-15T22:26:45.587 INFO:tasks.workunit.client.0.smithi001.stdout:0/429: write d0/d9/d1a/f58 [386955,69453] 0 2024-09-15T22:26:45.592 INFO:tasks.workunit.client.0.smithi001.stdout:0/430: unlink d0/d6/d77/d78/f7e 0 2024-09-15T22:26:45.604 INFO:tasks.workunit.client.0.smithi001.stdout:4/560: dread d0/d5d/d7c/dba/f43 [4194304,4194304] 0 2024-09-15T22:26:45.607 INFO:tasks.workunit.client.0.smithi001.stdout:4/561: symlink d0/d5d/d44/d65/d6a/lcc 0 2024-09-15T22:26:45.608 INFO:tasks.workunit.client.0.smithi001.stdout:4/562: stat d0/d5d/d7c/dba/d20/d29/d40/f85 0 2024-09-15T22:26:45.609 INFO:tasks.workunit.client.0.smithi001.stdout:4/563: mknod d0/d27/d35/ccd 0 2024-09-15T22:26:45.611 INFO:tasks.workunit.client.0.smithi001.stdout:4/564: rename d0/d5d/d7c/dba/d20/d29/d40/c47 to d0/d27/d35/d59/cce 0 2024-09-15T22:26:45.618 INFO:tasks.workunit.client.0.smithi001.stdout:6/469: dwrite d0/d6/d5d/d8c/f8e [0,4194304] 0 2024-09-15T22:26:45.620 INFO:tasks.workunit.client.0.smithi001.stdout:6/470: truncate d0/df/d24/d2e/f1d 3107853 0 2024-09-15T22:26:45.620 INFO:tasks.workunit.client.0.smithi001.stdout:6/471: fsync d0/d6/d5d/f75 0 2024-09-15T22:26:45.621 INFO:tasks.workunit.client.0.smithi001.stdout:6/472: symlink d0/df/d24/d7b/la9 0 2024-09-15T22:26:45.621 INFO:tasks.workunit.client.0.smithi001.stdout:6/473: write d0/d6/d5d/f9e [522873,36080] 0 2024-09-15T22:26:45.632 INFO:tasks.workunit.client.0.smithi001.stdout:6/474: mknod d0/d6/d5d/da6/caa 0 2024-09-15T22:26:45.639 INFO:tasks.workunit.client.0.smithi001.stdout:7/464: dwrite d0/d8e/f37 [0,4194304] 0 2024-09-15T22:26:45.641 INFO:tasks.workunit.client.0.smithi001.stdout:7/465: rename d0/d7/d44/c7d to d0/d6a/c9e 0 2024-09-15T22:26:45.641 INFO:tasks.workunit.client.0.smithi001.stdout:3/423: sync 2024-09-15T22:26:45.641 INFO:tasks.workunit.client.0.smithi001.stdout:8/381: sync 2024-09-15T22:26:45.643 INFO:tasks.workunit.client.0.smithi001.stdout:8/382: mknod d9/d19/d40/d5f/c6b 0 2024-09-15T22:26:45.643 INFO:tasks.workunit.client.0.smithi001.stdout:8/383: write d9/d19/d58/f4d [290012,41741] 0 2024-09-15T22:26:45.643 INFO:tasks.workunit.client.0.smithi001.stdout:8/384: fdatasync d9/d19/d34/f43 0 2024-09-15T22:26:45.643 INFO:tasks.workunit.client.0.smithi001.stdout:3/424: rmdir da/d16 39 2024-09-15T22:26:45.643 INFO:tasks.workunit.client.0.smithi001.stdout:3/425: truncate da/d3d/d43/d41/d70/d7f/f8c 1242381 0 2024-09-15T22:26:45.644 INFO:tasks.workunit.client.0.smithi001.stdout:8/385: mknod d9/d19/d40/d5f/d61/c6c 0 2024-09-15T22:26:45.644 INFO:tasks.workunit.client.0.smithi001.stdout:3/426: stat da/d3d/d43/l1a 0 2024-09-15T22:26:45.645 INFO:tasks.workunit.client.0.smithi001.stdout:8/386: rename d9/d19/d40/d5f/d61/f66 to d9/f6d 0 2024-09-15T22:26:45.645 INFO:tasks.workunit.client.0.smithi001.stdout:8/387: readlink d9/d19/d29/d50/l53 0 2024-09-15T22:26:45.646 INFO:tasks.workunit.client.0.smithi001.stdout:3/427: rename da/d16/l5b to da/d16/l8d 0 2024-09-15T22:26:45.654 INFO:tasks.workunit.client.0.smithi001.stdout:9/402: dwrite d5/d3e/f52 [0,4194304] 0 2024-09-15T22:26:45.654 INFO:tasks.workunit.client.0.smithi001.stdout:9/403: dread - d5/de/d15/d27/d63/f79 zero size 2024-09-15T22:26:45.659 INFO:tasks.workunit.client.0.smithi001.stdout:9/404: link d5/de/d51/d53/l7a d5/de/d15/l7d 0 2024-09-15T22:26:45.659 INFO:tasks.workunit.client.0.smithi001.stdout:9/405: readlink d5/de/d1a/l1e 0 2024-09-15T22:26:45.667 INFO:tasks.workunit.client.0.smithi001.stdout:7/466: dread d0/f5c [0,4194304] 0 2024-09-15T22:26:45.670 INFO:tasks.workunit.client.0.smithi001.stdout:7/467: symlink d0/d7/d44/d3f/d49/d4f/l9f 0 2024-09-15T22:26:45.673 INFO:tasks.workunit.client.0.smithi001.stdout:7/468: unlink d0/d8e/f4a 0 2024-09-15T22:26:45.673 INFO:tasks.workunit.client.0.smithi001.stdout:3/428: write da/d3b/f25 [823410,104715] 0 2024-09-15T22:26:45.678 INFO:tasks.workunit.client.0.smithi001.stdout:0/431: dwrite d0/d9/d1a/f28 [0,4194304] 0 2024-09-15T22:26:45.692 INFO:tasks.workunit.client.0.smithi001.stdout:5/488: dwrite d3/d1d/d54/d56/f4a [0,4194304] 0 2024-09-15T22:26:45.694 INFO:tasks.workunit.client.0.smithi001.stdout:6/475: dwrite d0/f19 [4194304,4194304] 0 2024-09-15T22:26:45.694 INFO:tasks.workunit.client.0.smithi001.stdout:6/476: fdatasync d0/f9 0 2024-09-15T22:26:45.694 INFO:tasks.workunit.client.0.smithi001.stdout:5/489: mkdir d3/d1d/d54/d56/d52/d9f 0 2024-09-15T22:26:45.695 INFO:tasks.workunit.client.0.smithi001.stdout:6/477: rmdir d0/d7e 39 2024-09-15T22:26:45.696 INFO:tasks.workunit.client.0.smithi001.stdout:5/490: creat d3/d49/fa0 x:0 0 0 2024-09-15T22:26:45.697 INFO:tasks.workunit.client.0.smithi001.stdout:6/478: creat d0/df/d24/d2e/d43/fab x:0 0 0 2024-09-15T22:26:45.698 INFO:tasks.workunit.client.0.smithi001.stdout:5/491: rmdir d3/d6/d25 39 2024-09-15T22:26:45.698 INFO:tasks.workunit.client.0.smithi001.stdout:5/492: chown d3/d1d/d54/d56/d52/d61 59 1 2024-09-15T22:26:45.704 INFO:tasks.workunit.client.0.smithi001.stdout:4/565: dwrite d0/d5d/d7c/dba/d20/fc3 [0,4194304] 0 2024-09-15T22:26:45.708 INFO:tasks.workunit.client.0.smithi001.stdout:4/566: rename d0/d5d/d44/d65/cb3 to d0/d27/ccf 0 2024-09-15T22:26:45.718 INFO:tasks.workunit.client.0.smithi001.stdout:7/469: dwrite d0/d8e/f7f [0,4194304] 0 2024-09-15T22:26:45.720 INFO:tasks.workunit.client.0.smithi001.stdout:9/406: dread d5/de/d1a/d1b/d22/d2c/d21/f25 [0,4194304] 0 2024-09-15T22:26:45.723 INFO:tasks.workunit.client.0.smithi001.stdout:9/407: link d5/de/d1a/d1b/d22/d2c/d21/d24/l3f d5/de/d1a/d1b/d22/d2c/d21/d23/l7e 0 2024-09-15T22:26:45.723 INFO:tasks.workunit.client.0.smithi001.stdout:9/408: stat d5/de/d1a/d1b/d22/d2c/cd 0 2024-09-15T22:26:45.725 INFO:tasks.workunit.client.0.smithi001.stdout:6/479: dread d0/d6/f3e [0,4194304] 0 2024-09-15T22:26:45.725 INFO:tasks.workunit.client.0.smithi001.stdout:6/480: fsync d0/d6/d5d/d67/d53/f72 0 2024-09-15T22:26:45.726 INFO:tasks.workunit.client.0.smithi001.stdout:9/409: symlink d5/de/d1a/d1b/d2a/l7f 0 2024-09-15T22:26:45.735 INFO:tasks.workunit.client.0.smithi001.stdout:4/567: dread d0/d5d/d7c/dba/d20/d29/d34/d84/d95/f5f [0,4194304] 0 2024-09-15T22:26:45.737 INFO:tasks.workunit.client.0.smithi001.stdout:4/568: getdents d0/d27/d35/d59/d67 0 2024-09-15T22:26:45.737 INFO:tasks.workunit.client.0.smithi001.stdout:4/569: chown d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d73 1 1 2024-09-15T22:26:45.738 INFO:tasks.workunit.client.0.smithi001.stdout:9/410: dread d5/de/d1a/d1b/d22/d2c/f31 [0,4194304] 0 2024-09-15T22:26:45.739 INFO:tasks.workunit.client.0.smithi001.stdout:4/570: link d0/d5d/d7c/dba/f43 d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d73/fd0 0 2024-09-15T22:26:45.759 INFO:tasks.workunit.client.0.smithi001.stdout:8/388: dwrite d9/d19/d40/f4f [0,4194304] 0 2024-09-15T22:26:45.764 INFO:tasks.workunit.client.0.smithi001.stdout:8/389: unlink d9/d19/d40/d5f/d61/c6c 0 2024-09-15T22:26:45.768 INFO:tasks.workunit.client.0.smithi001.stdout:7/470: dread d0/d7/d2e/f63 [0,4194304] 0 2024-09-15T22:26:45.770 INFO:tasks.workunit.client.0.smithi001.stdout:6/481: dwrite d0/df/d24/d2e/f1d [0,4194304] 0 2024-09-15T22:26:45.771 INFO:tasks.workunit.client.0.smithi001.stdout:6/482: write d0/df/d24/d2e/d43/fab [6001,125370] 0 2024-09-15T22:26:45.777 INFO:tasks.workunit.client.0.smithi001.stdout:8/390: creat d9/d19/d34/d41/f6e x:0 0 0 2024-09-15T22:26:45.777 INFO:tasks.workunit.client.0.smithi001.stdout:2/447: sync 2024-09-15T22:26:45.777 INFO:tasks.workunit.client.0.smithi001.stdout:2/448: fsync d2/f9 0 2024-09-15T22:26:45.777 INFO:tasks.workunit.client.0.smithi001.stdout:2/449: fdatasync d2/f79 0 2024-09-15T22:26:45.777 INFO:tasks.workunit.client.0.smithi001.stdout:7/471: truncate d0/f2a 617095 0 2024-09-15T22:26:45.778 INFO:tasks.workunit.client.0.smithi001.stdout:7/472: chown d0/f7a 204 1 2024-09-15T22:26:45.778 INFO:tasks.workunit.client.0.smithi001.stdout:7/473: chown d0/d7/d21/d6b/d93 2132 1 2024-09-15T22:26:45.778 INFO:tasks.workunit.client.0.smithi001.stdout:7/474: chown d0/d7/l33 1220 1 2024-09-15T22:26:45.778 INFO:tasks.workunit.client.0.smithi001.stdout:7/475: stat d0/d7/d44/d3f/d49/d4f 0 2024-09-15T22:26:45.778 INFO:tasks.workunit.client.0.smithi001.stdout:2/450: getdents d2/d14/d1a/d8a 0 2024-09-15T22:26:45.779 INFO:tasks.workunit.client.0.smithi001.stdout:8/391: rmdir d9/d19/d40/d5f 39 2024-09-15T22:26:45.779 INFO:tasks.workunit.client.0.smithi001.stdout:7/476: mknod d0/d7/d44/d3f/d49/ca0 0 2024-09-15T22:26:45.780 INFO:tasks.workunit.client.0.smithi001.stdout:8/392: symlink d9/l6f 0 2024-09-15T22:26:45.780 INFO:tasks.workunit.client.0.smithi001.stdout:8/393: chown d9/f11 16732281 1 2024-09-15T22:26:45.783 INFO:tasks.workunit.client.0.smithi001.stdout:8/394: getdents d9/d19/d29/d35 0 2024-09-15T22:26:45.783 INFO:tasks.workunit.client.0.smithi001.stdout:6/483: dread d0/df/d24/f7f [0,4194304] 0 2024-09-15T22:26:45.783 INFO:tasks.workunit.client.0.smithi001.stdout:3/429: dwrite da/d3b/f32 [4194304,4194304] 0 2024-09-15T22:26:45.788 INFO:tasks.workunit.client.0.smithi001.stdout:6/484: symlink d0/d6/d5d/da6/lac 0 2024-09-15T22:26:45.788 INFO:tasks.workunit.client.0.smithi001.stdout:3/430: mkdir da/d1f/d46/d8e 0 2024-09-15T22:26:45.788 INFO:tasks.workunit.client.0.smithi001.stdout:3/431: chown da/d16/c57 1 1 2024-09-15T22:26:45.788 INFO:tasks.workunit.client.0.smithi001.stdout:3/432: fsync da/d3b/f66 0 2024-09-15T22:26:45.788 INFO:tasks.workunit.client.0.smithi001.stdout:3/433: dread - da/d3d/d43/f2a zero size 2024-09-15T22:26:45.789 INFO:tasks.workunit.client.0.smithi001.stdout:6/485: creat d0/df/d24/fad x:0 0 0 2024-09-15T22:26:45.798 INFO:tasks.workunit.client.0.smithi001.stdout:2/451: write d2/d12/d62/d1f/f3c [1185116,64420] 0 2024-09-15T22:26:45.798 INFO:tasks.workunit.client.0.smithi001.stdout:2/452: truncate d2/d14/d1a/f7a 1288728 0 2024-09-15T22:26:45.800 INFO:tasks.workunit.client.0.smithi001.stdout:8/395: read d9/fa [1910446,13185] 0 2024-09-15T22:26:45.800 INFO:tasks.workunit.client.0.smithi001.stdout:2/453: truncate d2/f3 2742648 0 2024-09-15T22:26:45.800 INFO:tasks.workunit.client.0.smithi001.stdout:8/396: fsync d9/d19/d58/f49 0 2024-09-15T22:26:45.800 INFO:tasks.workunit.client.0.smithi001.stdout:6/486: write d0/d6/d5d/d67/f38 [265931,31762] 0 2024-09-15T22:26:45.801 INFO:tasks.workunit.client.0.smithi001.stdout:2/454: mkdir d2/d14/d1a/d1b/d98 0 2024-09-15T22:26:45.803 INFO:tasks.workunit.client.0.smithi001.stdout:2/455: rename d2/d12/d62/d64/d76/d7f/l8c to d2/d14/d1a/d1b/d82/d83/l99 0 2024-09-15T22:26:45.803 INFO:tasks.workunit.client.0.smithi001.stdout:8/397: unlink d9/c28 0 2024-09-15T22:26:45.807 INFO:tasks.workunit.client.0.smithi001.stdout:6/487: symlink d0/lae 0 2024-09-15T22:26:45.808 INFO:tasks.workunit.client.0.smithi001.stdout:6/488: unlink d0/df/f6e 0 2024-09-15T22:26:45.809 INFO:tasks.workunit.client.0.smithi001.stdout:6/489: write d0/f2 [2927887,15795] 0 2024-09-15T22:26:45.811 INFO:tasks.workunit.client.0.smithi001.stdout:9/411: dwrite d5/de/d1a/d1b/d22/d2c/d21/f25 [0,4194304] 0 2024-09-15T22:26:45.811 INFO:tasks.workunit.client.0.smithi001.stdout:9/412: write d5/de/d1a/d1b/f70 [181409,72037] 0 2024-09-15T22:26:45.811 INFO:tasks.workunit.client.0.smithi001.stdout:9/413: rename d5/de/d1a/d1b to d5/de/d1a/d1b/d22/d2c/d21/d4d/d80 22 2024-09-15T22:26:45.812 INFO:tasks.workunit.client.0.smithi001.stdout:9/414: mknod d5/c81 0 2024-09-15T22:26:45.812 INFO:tasks.workunit.client.0.smithi001.stdout:9/415: dread - d5/de/d15/d27/d63/f73 zero size 2024-09-15T22:26:45.817 INFO:tasks.workunit.client.0.smithi001.stdout:3/434: dread da/d3b/f3c [0,4194304] 0 2024-09-15T22:26:45.822 INFO:tasks.workunit.client.0.smithi001.stdout:9/416: write d5/f59 [1043715,84012] 0 2024-09-15T22:26:45.824 INFO:tasks.workunit.client.0.smithi001.stdout:8/398: write d9/d19/f3d [4015556,44848] 0 2024-09-15T22:26:45.826 INFO:tasks.workunit.client.0.smithi001.stdout:3/435: truncate da/d3d/d43/d7c/d3f/f63 1951119 0 2024-09-15T22:26:45.827 INFO:tasks.workunit.client.0.smithi001.stdout:9/417: rename d5/de/d51/d53/f6d to d5/de/d1a/d1b/d22/f82 0 2024-09-15T22:26:45.827 INFO:tasks.workunit.client.0.smithi001.stdout:9/418: chown d5/de/d1a/d1b/d22/d2c/f75 2 1 2024-09-15T22:26:45.828 INFO:tasks.workunit.client.0.smithi001.stdout:8/399: mkdir d9/d19/d29/d50/d70 0 2024-09-15T22:26:45.828 INFO:tasks.workunit.client.0.smithi001.stdout:8/400: write d9/d19/d58/f49 [4309705,107360] 0 2024-09-15T22:26:45.829 INFO:tasks.workunit.client.0.smithi001.stdout:3/436: mknod da/d3b/d58/c8f 0 2024-09-15T22:26:45.830 INFO:tasks.workunit.client.0.smithi001.stdout:9/419: creat d5/d3e/f83 x:0 0 0 2024-09-15T22:26:45.830 INFO:tasks.workunit.client.0.smithi001.stdout:9/420: chown d5/de/d15/d27/d63/c77 2877331 1 2024-09-15T22:26:45.830 INFO:tasks.workunit.client.0.smithi001.stdout:9/421: chown d5/de/d1a/d38/c6c 11167417 1 2024-09-15T22:26:45.833 INFO:tasks.workunit.client.0.smithi001.stdout:7/477: dwrite d0/f5c [4194304,4194304] 0 2024-09-15T22:26:45.833 INFO:tasks.workunit.client.0.smithi001.stdout:7/478: readlink d0/d7/l14 0 2024-09-15T22:26:45.834 INFO:tasks.workunit.client.0.smithi001.stdout:9/422: getdents d5/de/d1a/d1b/d22/d2c/d21/d24 0 2024-09-15T22:26:45.834 INFO:tasks.workunit.client.0.smithi001.stdout:9/423: write d5/de/d15/d27/d63/f7b [188446,130976] 0 2024-09-15T22:26:45.835 INFO:tasks.workunit.client.0.smithi001.stdout:7/479: getdents d0/d7/d2e/d60 0 2024-09-15T22:26:45.835 INFO:tasks.workunit.client.0.smithi001.stdout:7/480: dread - d0/d7/d21/f9b zero size 2024-09-15T22:26:45.844 INFO:tasks.workunit.client.0.smithi001.stdout:9/424: rename d5/de/d1a/d1b/d22/d2c/d21/l32 to d5/de/d1a/l84 0 2024-09-15T22:26:45.844 INFO:tasks.workunit.client.0.smithi001.stdout:9/425: fdatasync d5/de/d1a/d1b/d22/d2c/d21/d24/f4c 0 2024-09-15T22:26:45.845 INFO:tasks.workunit.client.0.smithi001.stdout:8/401: dread d9/d19/f3d [0,4194304] 0 2024-09-15T22:26:45.880 INFO:tasks.workunit.client.0.smithi001.stdout:3/437: dread da/d16/f4b [4194304,4194304] 0 2024-09-15T22:26:45.880 INFO:tasks.workunit.client.0.smithi001.stdout:2/456: dwrite d2/d14/d1a/d1b/f78 [0,4194304] 0 2024-09-15T22:26:45.881 INFO:tasks.workunit.client.0.smithi001.stdout:7/481: dwrite d0/d8e/f7f [0,4194304] 0 2024-09-15T22:26:45.881 INFO:tasks.workunit.client.0.smithi001.stdout:2/457: creat d2/d14/f9a x:0 0 0 2024-09-15T22:26:45.882 INFO:tasks.workunit.client.0.smithi001.stdout:7/482: chown d0/d7/d21/f3d 1206023 1 2024-09-15T22:26:45.882 INFO:tasks.workunit.client.0.smithi001.stdout:7/483: fsync d0/f5c 0 2024-09-15T22:26:45.882 INFO:tasks.workunit.client.0.smithi001.stdout:2/458: symlink d2/d12/d62/l9b 0 2024-09-15T22:26:45.884 INFO:tasks.workunit.client.0.smithi001.stdout:7/484: symlink d0/d7/d7c/la1 0 2024-09-15T22:26:45.884 INFO:tasks.workunit.client.0.smithi001.stdout:7/485: fdatasync d0/d8e/d3e/f51 0 2024-09-15T22:26:45.896 INFO:tasks.workunit.client.0.smithi001.stdout:1/521: sync 2024-09-15T22:26:45.896 INFO:tasks.workunit.client.0.smithi001.stdout:1/522: fsync d3/dd/d14/d1b/f3b 0 2024-09-15T22:26:45.898 INFO:tasks.workunit.client.0.smithi001.stdout:1/523: creat d3/dd/d53/fa3 x:0 0 0 2024-09-15T22:26:45.898 INFO:tasks.workunit.client.0.smithi001.stdout:1/524: chown d3/dd/d3c/l8c 0 1 2024-09-15T22:26:45.898 INFO:tasks.workunit.client.0.smithi001.stdout:3/438: write da/d3b/d1b/f60 [6990804,70257] 0 2024-09-15T22:26:45.899 INFO:tasks.workunit.client.0.smithi001.stdout:1/525: link d3/dd/d14/d1b/d2b/d68/l71 d3/dd/d14/d23/la4 0 2024-09-15T22:26:45.901 INFO:tasks.workunit.client.0.smithi001.stdout:1/526: creat d3/dd/d14/fa5 x:0 0 0 2024-09-15T22:26:45.902 INFO:tasks.workunit.client.0.smithi001.stdout:1/527: link d3/dd/d14/d1b/f6d d3/dd/d3c/d64/fa6 0 2024-09-15T22:26:45.902 INFO:tasks.workunit.client.0.smithi001.stdout:1/528: write d3/dd/d14/d23/f9d [19021,10970] 0 2024-09-15T22:26:45.903 INFO:tasks.workunit.client.0.smithi001.stdout:1/529: rmdir d3/dd/d14/d1b/d2b/d68/d8a 39 2024-09-15T22:26:45.903 INFO:tasks.workunit.client.0.smithi001.stdout:1/530: chown d3/dd/d14/d1b/c93 12627282 1 2024-09-15T22:26:45.904 INFO:tasks.workunit.client.0.smithi001.stdout:1/531: symlink d3/dd/d14/la7 0 2024-09-15T22:26:45.905 INFO:tasks.workunit.client.0.smithi001.stdout:1/532: creat d3/dd/d14/d1b/fa8 x:0 0 0 2024-09-15T22:26:45.906 INFO:tasks.workunit.client.0.smithi001.stdout:1/533: creat d3/d8d/d91/fa9 x:0 0 0 2024-09-15T22:26:45.910 INFO:tasks.workunit.client.0.smithi001.stdout:8/402: dwrite d9/d19/d29/d33/d63/f64 [0,4194304] 0 2024-09-15T22:26:45.910 INFO:tasks.workunit.client.0.smithi001.stdout:8/403: fdatasync d9/d19/d29/f3e 0 2024-09-15T22:26:45.918 INFO:tasks.workunit.client.0.smithi001.stdout:3/439: dread da/f13 [0,4194304] 0 2024-09-15T22:26:45.918 INFO:tasks.workunit.client.0.smithi001.stdout:3/440: truncate da/fe 424169 0 2024-09-15T22:26:45.921 INFO:tasks.workunit.client.0.smithi001.stdout:2/459: dwrite d2/d12/d62/d64/f2a [4194304,4194304] 0 2024-09-15T22:26:45.923 INFO:tasks.workunit.client.0.smithi001.stdout:2/460: mknod d2/d12/d62/d4c/c9c 0 2024-09-15T22:26:45.923 INFO:tasks.workunit.client.0.smithi001.stdout:2/461: truncate d2/d12/d62/f2c 7178814 0 2024-09-15T22:26:45.924 INFO:tasks.workunit.client.0.smithi001.stdout:8/404: rename l2 to d9/d19/d58/l71 0 2024-09-15T22:26:45.924 INFO:tasks.workunit.client.0.smithi001.stdout:2/462: mkdir d2/d12/d62/d4c/d9d 0 2024-09-15T22:26:45.925 INFO:tasks.workunit.client.0.smithi001.stdout:8/405: symlink d9/d19/l72 0 2024-09-15T22:26:45.926 INFO:tasks.workunit.client.0.smithi001.stdout:3/441: dread f6 [0,4194304] 0 2024-09-15T22:26:45.926 INFO:tasks.workunit.client.0.smithi001.stdout:8/406: dread - d9/d19/d58/f4e zero size 2024-09-15T22:26:45.927 INFO:tasks.workunit.client.0.smithi001.stdout:3/442: rename da/d3b/d1b/d6a to da/d90 0 2024-09-15T22:26:45.928 INFO:tasks.workunit.client.0.smithi001.stdout:3/443: symlink da/d3d/d43/d41/d70/l91 0 2024-09-15T22:26:45.929 INFO:tasks.workunit.client.0.smithi001.stdout:3/444: mkdir da/d90/d92 0 2024-09-15T22:26:45.930 INFO:tasks.workunit.client.0.smithi001.stdout:3/445: symlink da/d1f/d46/l93 0 2024-09-15T22:26:45.940 INFO:tasks.workunit.client.0.smithi001.stdout:8/407: dread d9/d19/d58/f4d [0,4194304] 0 2024-09-15T22:26:45.941 INFO:tasks.workunit.client.0.smithi001.stdout:2/463: dread d2/d14/d1a/d1b/d82/d97/f23 [0,4194304] 0 2024-09-15T22:26:45.943 INFO:tasks.workunit.client.0.smithi001.stdout:8/408: rename d9/d19/d34/f5e to d9/d19/d29/d50/f73 0 2024-09-15T22:26:45.961 INFO:tasks.workunit.client.0.smithi001.stdout:7/486: dwrite d0/d7/f53 [0,4194304] 0 2024-09-15T22:26:45.964 INFO:tasks.workunit.client.0.smithi001.stdout:7/487: truncate d0/d8e/f7f 697096 0 2024-09-15T22:26:45.971 INFO:tasks.workunit.client.0.smithi001.stdout:3/446: dwrite da/d3d/d43/d7c/f55 [0,4194304] 0 2024-09-15T22:26:45.972 INFO:tasks.workunit.client.0.smithi001.stdout:3/447: fdatasync da/d3b/f40 0 2024-09-15T22:26:45.972 INFO:tasks.workunit.client.0.smithi001.stdout:3/448: chown da/d3d/d43/f5a 115096788 1 2024-09-15T22:26:45.972 INFO:tasks.workunit.client.0.smithi001.stdout:3/449: getdents da/d90/d92 0 2024-09-15T22:26:45.974 INFO:tasks.workunit.client.0.smithi001.stdout:3/450: rename da/d3d/d43/d7c/d3f/c59 to da/d3d/d43/d41/d70/d7f/c94 0 2024-09-15T22:26:45.974 INFO:tasks.workunit.client.0.smithi001.stdout:3/451: truncate da/d3b/d1b/f76 624508 0 2024-09-15T22:26:45.975 INFO:tasks.workunit.client.0.smithi001.stdout:3/452: creat da/d3b/d1b/f95 x:0 0 0 2024-09-15T22:26:45.975 INFO:tasks.workunit.client.0.smithi001.stdout:3/453: stat da/d3d/d43/d7c/d3f/f87 0 2024-09-15T22:26:45.975 INFO:tasks.workunit.client.0.smithi001.stdout:3/454: fdatasync da/d3b/d1b/f2c 0 2024-09-15T22:26:45.976 INFO:tasks.workunit.client.0.smithi001.stdout:3/455: creat da/d1f/d46/d8e/f96 x:0 0 0 2024-09-15T22:26:45.977 INFO:tasks.workunit.client.0.smithi001.stdout:3/456: mkdir da/d3d/d43/d7c/d53/d72/d97 0 2024-09-15T22:26:45.977 INFO:tasks.workunit.client.0.smithi001.stdout:3/457: chown da/d3d/d43/d41/d70/d7f/c94 7 1 2024-09-15T22:26:45.982 INFO:tasks.workunit.client.0.smithi001.stdout:7/488: dread d0/d7/d44/f1c [4194304,4194304] 0 2024-09-15T22:26:45.984 INFO:tasks.workunit.client.0.smithi001.stdout:7/489: creat d0/d6a/fa2 x:0 0 0 2024-09-15T22:26:45.986 INFO:tasks.workunit.client.0.smithi001.stdout:7/490: link d0/d7/d21/f55 d0/d7/d44/d96/fa3 0 2024-09-15T22:26:46.003 INFO:tasks.workunit.client.0.smithi001.stdout:8/409: dwrite d9/d19/d29/d50/f52 [0,4194304] 0 2024-09-15T22:26:46.004 INFO:tasks.workunit.client.0.smithi001.stdout:8/410: symlink d9/d19/d29/d35/l74 0 2024-09-15T22:26:46.006 INFO:tasks.workunit.client.0.smithi001.stdout:8/411: symlink d9/d19/d29/d50/d70/l75 0 2024-09-15T22:26:46.010 INFO:tasks.workunit.client.0.smithi001.stdout:2/464: dwrite d2/d12/d62/d64/f4a [0,4194304] 0 2024-09-15T22:26:46.012 INFO:tasks.workunit.client.0.smithi001.stdout:2/465: creat d2/d12/d62/d4c/d9d/f9e x:0 0 0 2024-09-15T22:26:46.017 INFO:tasks.workunit.client.0.smithi001.stdout:0/432: sync 2024-09-15T22:26:46.017 INFO:tasks.workunit.client.0.smithi001.stdout:5/493: sync 2024-09-15T22:26:46.019 INFO:tasks.workunit.client.0.smithi001.stdout:3/458: dwrite da/d3b/d1b/f76 [0,4194304] 0 2024-09-15T22:26:46.019 INFO:tasks.workunit.client.0.smithi001.stdout:3/459: readlink da/d3d/d43/l89 0 2024-09-15T22:26:46.019 INFO:tasks.workunit.client.0.smithi001.stdout:3/460: fdatasync da/d3d/d43/d7c/d3f/f87 0 2024-09-15T22:26:46.019 INFO:tasks.workunit.client.0.smithi001.stdout:5/494: creat d3/d27/d4e/d89/fa1 x:0 0 0 2024-09-15T22:26:46.025 INFO:tasks.workunit.client.0.smithi001.stdout:8/412: dread d9/d19/d29/f3e [0,4194304] 0 2024-09-15T22:26:46.026 INFO:tasks.workunit.client.0.smithi001.stdout:8/413: getdents d9/d19/d34 0 2024-09-15T22:26:46.026 INFO:tasks.workunit.client.0.smithi001.stdout:8/414: stat d9/d19/d29/d33/c44 0 2024-09-15T22:26:46.026 INFO:tasks.workunit.client.0.smithi001.stdout:8/415: truncate d9/d19/d29/d33/d63/f6a 4437474 0 2024-09-15T22:26:46.026 INFO:tasks.workunit.client.0.smithi001.stdout:8/416: stat l1 0 2024-09-15T22:26:46.027 INFO:tasks.workunit.client.0.smithi001.stdout:8/417: chown d9/c3b 81239 1 2024-09-15T22:26:46.031 INFO:tasks.workunit.client.0.smithi001.stdout:7/491: dwrite d0/d7/d44/f87 [0,4194304] 0 2024-09-15T22:26:46.031 INFO:tasks.workunit.client.0.smithi001.stdout:8/418: mkdir d9/d19/d29/d50/d70/d76 0 2024-09-15T22:26:46.031 INFO:tasks.workunit.client.0.smithi001.stdout:2/466: dread d2/f10 [0,4194304] 0 2024-09-15T22:26:46.031 INFO:tasks.workunit.client.0.smithi001.stdout:2/467: write d2/d12/d62/f4e [1743618,44242] 0 2024-09-15T22:26:46.031 INFO:tasks.workunit.client.0.smithi001.stdout:2/468: write d2/f43 [4675508,127015] 0 2024-09-15T22:26:46.033 INFO:tasks.workunit.client.0.smithi001.stdout:8/419: creat d9/d19/f77 x:0 0 0 2024-09-15T22:26:46.034 INFO:tasks.workunit.client.0.smithi001.stdout:8/420: truncate f7 305960 0 2024-09-15T22:26:46.037 INFO:tasks.workunit.client.0.smithi001.stdout:8/421: read d9/d19/f1f [1902725,10013] 0 2024-09-15T22:26:46.040 INFO:tasks.workunit.client.0.smithi001.stdout:8/422: symlink d9/d19/d40/d5f/l78 0 2024-09-15T22:26:46.040 INFO:tasks.workunit.client.0.smithi001.stdout:2/469: creat d2/d14/d1a/d8a/f9f x:0 0 0 2024-09-15T22:26:46.041 INFO:tasks.workunit.client.0.smithi001.stdout:8/423: rename d9/c14 to d9/d19/c79 0 2024-09-15T22:26:46.044 INFO:tasks.workunit.client.0.smithi001.stdout:2/470: symlink d2/d14/d1a/d8a/la0 0 2024-09-15T22:26:46.044 INFO:tasks.workunit.client.0.smithi001.stdout:2/471: chown d2/d12/d62/d1f/f95 191698 1 2024-09-15T22:26:46.044 INFO:tasks.workunit.client.0.smithi001.stdout:9/426: sync 2024-09-15T22:26:46.044 INFO:tasks.workunit.client.0.smithi001.stdout:1/534: sync 2024-09-15T22:26:46.044 INFO:tasks.workunit.client.0.smithi001.stdout:4/571: sync 2024-09-15T22:26:46.048 INFO:tasks.workunit.client.0.smithi001.stdout:6/490: sync 2024-09-15T22:26:46.048 INFO:tasks.workunit.client.0.smithi001.stdout:5/495: dread d3/d1d/d54/d56/f4b [0,4194304] 0 2024-09-15T22:26:46.048 INFO:tasks.workunit.client.0.smithi001.stdout:2/472: write d2/d14/d1a/d1b/f26 [518436,109383] 0 2024-09-15T22:26:46.048 INFO:tasks.workunit.client.0.smithi001.stdout:7/492: dread d0/f5c [0,4194304] 0 2024-09-15T22:26:46.048 INFO:tasks.workunit.client.0.smithi001.stdout:7/493: chown d0/d7/d21/l22 13124 1 2024-09-15T22:26:46.048 INFO:tasks.workunit.client.0.smithi001.stdout:7/494: fsync d0/d7/d2e/f9c 0 2024-09-15T22:26:46.048 INFO:tasks.workunit.client.0.smithi001.stdout:8/424: creat d9/d19/d29/d50/d70/d76/f7a x:0 0 0 2024-09-15T22:26:46.048 INFO:tasks.workunit.client.0.smithi001.stdout:0/433: write d0/f4 [2278709,96763] 0 2024-09-15T22:26:46.048 INFO:tasks.workunit.client.0.smithi001.stdout:2/473: symlink d2/la1 0 2024-09-15T22:26:46.048 INFO:tasks.workunit.client.0.smithi001.stdout:2/474: readlink d2/d14/d1a/d1b/d82/d97/l24 0 2024-09-15T22:26:46.049 INFO:tasks.workunit.client.0.smithi001.stdout:9/427: symlink d5/de/d51/d53/l85 0 2024-09-15T22:26:46.049 INFO:tasks.workunit.client.0.smithi001.stdout:9/428: truncate d5/de/d1a/d1b/d22/d2c/d21/d4d/f5d 77658 0 2024-09-15T22:26:46.049 INFO:tasks.workunit.client.0.smithi001.stdout:9/429: read - d5/de/d15/d27/f7c zero size 2024-09-15T22:26:46.049 INFO:tasks.workunit.client.0.smithi001.stdout:7/495: readlink d0/d7/lb 0 2024-09-15T22:26:46.051 INFO:tasks.workunit.client.0.smithi001.stdout:9/430: mkdir d5/de/d1a/d1b/d22/d2c/d21/d24/d86 0 2024-09-15T22:26:46.052 INFO:tasks.workunit.client.0.smithi001.stdout:0/434: link d0/c17 d0/d51/c86 0 2024-09-15T22:26:46.054 INFO:tasks.workunit.client.0.smithi001.stdout:2/475: rename d2/d12/d62/d1f to d2/d14/d1a/d1b/d82/d97/da2 0 2024-09-15T22:26:46.058 INFO:tasks.workunit.client.0.smithi001.stdout:2/476: creat d2/d14/d1a/d1b/d82/d97/da2/fa3 x:0 0 0 2024-09-15T22:26:46.060 INFO:tasks.workunit.client.0.smithi001.stdout:2/477: mknod d2/d14/d1a/d1b/d82/d97/da2/ca4 0 2024-09-15T22:26:46.061 INFO:tasks.workunit.client.0.smithi001.stdout:5/496: write d3/d27/d4e/f58 [902697,121528] 0 2024-09-15T22:26:46.062 INFO:tasks.workunit.client.0.smithi001.stdout:2/478: truncate d2/d12/d62/d64/f4a 2769537 0 2024-09-15T22:26:46.063 INFO:tasks.workunit.client.0.smithi001.stdout:2/479: write d2/d14/d1a/d1b/d82/d97/da2/f3c [346533,41809] 0 2024-09-15T22:26:46.063 INFO:tasks.workunit.client.0.smithi001.stdout:2/480: readlink d2/d14/l33 0 2024-09-15T22:26:46.065 INFO:tasks.workunit.client.0.smithi001.stdout:2/481: creat d2/d12/d62/d64/fa5 x:0 0 0 2024-09-15T22:26:46.065 INFO:tasks.workunit.client.0.smithi001.stdout:2/482: chown d2/d12/d62/f40 2 1 2024-09-15T22:26:46.068 INFO:tasks.workunit.client.0.smithi001.stdout:8/425: dread d9/d19/d58/f49 [0,4194304] 0 2024-09-15T22:26:46.070 INFO:tasks.workunit.client.0.smithi001.stdout:8/426: creat d9/d19/d58/f7b x:0 0 0 2024-09-15T22:26:46.070 INFO:tasks.workunit.client.0.smithi001.stdout:9/431: dread d5/de/d1a/d1b/d22/f82 [0,4194304] 0 2024-09-15T22:26:46.072 INFO:tasks.workunit.client.0.smithi001.stdout:9/432: mkdir d5/de/d1a/d1b/d22/d2c/d21/d24/d86/d87 0 2024-09-15T22:26:46.072 INFO:tasks.workunit.client.0.smithi001.stdout:9/433: chown d5/de/d15/f62 43308 1 2024-09-15T22:26:46.074 INFO:tasks.workunit.client.0.smithi001.stdout:9/434: rmdir d5/de/d1a/d1b 39 2024-09-15T22:26:46.075 INFO:tasks.workunit.client.0.smithi001.stdout:9/435: creat d5/de/d1a/f88 x:0 0 0 2024-09-15T22:26:46.076 INFO:tasks.workunit.client.0.smithi001.stdout:7/496: dread d0/d7/d21/f3d [0,4194304] 0 2024-09-15T22:26:46.076 INFO:tasks.workunit.client.0.smithi001.stdout:7/497: read d0/d7/f79 [6395526,74109] 0 2024-09-15T22:26:46.079 INFO:tasks.workunit.client.0.smithi001.stdout:4/572: dwrite d0/d27/d35/f69 [4194304,4194304] 0 2024-09-15T22:26:46.079 INFO:tasks.workunit.client.0.smithi001.stdout:4/573: stat d0/d27/d35/d59/d67/lc4 0 2024-09-15T22:26:46.082 INFO:tasks.workunit.client.0.smithi001.stdout:9/436: getdents d5/de/d1a/d1b/d22/d2c/d21/d24/d86 0 2024-09-15T22:26:46.082 INFO:tasks.workunit.client.0.smithi001.stdout:9/437: read d5/de/d1a/d1b/d22/f2f [72728,23584] 0 2024-09-15T22:26:46.082 INFO:tasks.workunit.client.0.smithi001.stdout:9/438: truncate d5/de/d15/d27/d63/f73 372460 0 2024-09-15T22:26:46.084 INFO:tasks.workunit.client.0.smithi001.stdout:9/439: getdents d5/de/d1a/d1b/d22/d2c 0 2024-09-15T22:26:46.084 INFO:tasks.workunit.client.0.smithi001.stdout:9/440: write d5/de/d15/f62 [571868,122874] 0 2024-09-15T22:26:46.094 INFO:tasks.workunit.client.0.smithi001.stdout:8/427: dread d9/d19/d29/d50/f52 [0,4194304] 0 2024-09-15T22:26:46.096 INFO:tasks.workunit.client.0.smithi001.stdout:8/428: mkdir d9/d19/d29/d7c 0 2024-09-15T22:26:46.096 INFO:tasks.workunit.client.0.smithi001.stdout:8/429: dread - d9/d19/d29/f45 zero size 2024-09-15T22:26:46.101 INFO:tasks.workunit.client.0.smithi001.stdout:3/461: dwrite da/d16/f52 [4194304,4194304] 0 2024-09-15T22:26:46.104 INFO:tasks.workunit.client.0.smithi001.stdout:3/462: creat da/d3d/d43/d41/d70/f98 x:0 0 0 2024-09-15T22:26:46.106 INFO:tasks.workunit.client.0.smithi001.stdout:3/463: symlink da/d3d/d43/d7c/d53/d73/l99 0 2024-09-15T22:26:46.107 INFO:tasks.workunit.client.0.smithi001.stdout:3/464: link da/d3d/c7d da/d3d/d43/d7c/d3f/c9a 0 2024-09-15T22:26:46.108 INFO:tasks.workunit.client.0.smithi001.stdout:3/465: mknod da/d3b/d8b/c9b 0 2024-09-15T22:26:46.109 INFO:tasks.workunit.client.0.smithi001.stdout:3/466: mknod da/d1f/c9c 0 2024-09-15T22:26:46.110 INFO:tasks.workunit.client.0.smithi001.stdout:3/467: truncate da/d3b/f40 9808174 0 2024-09-15T22:26:46.110 INFO:tasks.workunit.client.0.smithi001.stdout:3/468: write f6 [1176677,69569] 0 2024-09-15T22:26:46.110 INFO:tasks.workunit.client.0.smithi001.stdout:3/469: write da/d3b/f66 [1024993,90356] 0 2024-09-15T22:26:46.111 INFO:tasks.workunit.client.0.smithi001.stdout:3/470: getdents da/d3b/d58 0 2024-09-15T22:26:46.111 INFO:tasks.workunit.client.0.smithi001.stdout:8/430: dread d9/d19/d29/f2a [0,4194304] 0 2024-09-15T22:26:46.113 INFO:tasks.workunit.client.0.smithi001.stdout:9/441: read d5/de/d1a/d1b/d22/d2c/f6a [2324830,44490] 0 2024-09-15T22:26:46.113 INFO:tasks.workunit.client.0.smithi001.stdout:9/442: getdents d5/de/d1a/d1b/d22/d2c 0 2024-09-15T22:26:46.113 INFO:tasks.workunit.client.0.smithi001.stdout:3/471: mknod da/d1f/c9d 0 2024-09-15T22:26:46.113 INFO:tasks.workunit.client.0.smithi001.stdout:6/491: dwrite d0/d6/d5d/d67/d53/fa8 [0,4194304] 0 2024-09-15T22:26:46.113 INFO:tasks.workunit.client.0.smithi001.stdout:8/431: mkdir d9/d19/d29/d50/d70/d76/d7d 0 2024-09-15T22:26:46.113 INFO:tasks.workunit.client.0.smithi001.stdout:8/432: fdatasync d9/d19/f1e 0 2024-09-15T22:26:46.114 INFO:tasks.workunit.client.0.smithi001.stdout:3/472: mkdir da/d9e 0 2024-09-15T22:26:46.117 INFO:tasks.workunit.client.0.smithi001.stdout:5/497: dwrite d3/d49/fa0 [0,4194304] 0 2024-09-15T22:26:46.118 INFO:tasks.workunit.client.0.smithi001.stdout:8/433: unlink d9/d19/f1f 0 2024-09-15T22:26:46.120 INFO:tasks.workunit.client.0.smithi001.stdout:5/498: mkdir d3/d6/d57/d87/d8c/da2 0 2024-09-15T22:26:46.120 INFO:tasks.workunit.client.0.smithi001.stdout:5/499: fdatasync d3/d6/d25/f2c 0 2024-09-15T22:26:46.120 INFO:tasks.workunit.client.0.smithi001.stdout:5/500: dread - d3/d27/d4e/d89/f9b zero size 2024-09-15T22:26:46.121 INFO:tasks.workunit.client.0.smithi001.stdout:5/501: mkdir d3/d6/d41/d88/da3 0 2024-09-15T22:26:46.121 INFO:tasks.workunit.client.0.smithi001.stdout:5/502: write d3/d27/d4e/f58 [2218804,101905] 0 2024-09-15T22:26:46.125 INFO:tasks.workunit.client.0.smithi001.stdout:5/503: mkdir d3/d1d/d54/d56/d52/d9f/da4 0 2024-09-15T22:26:46.132 INFO:tasks.workunit.client.0.smithi001.stdout:4/574: dread d0/d27/d35/d59/d67/dab/f8d [0,4194304] 0 2024-09-15T22:26:46.132 INFO:tasks.workunit.client.0.smithi001.stdout:5/504: rename d3/d6/d41/d65 to d3/d6/d41/d88/da5 0 2024-09-15T22:26:46.135 INFO:tasks.workunit.client.0.smithi001.stdout:4/575: rename d0/d5d/d7c/dba/d20/d29/d34/da0 to d0/d5d/d7c/dd1 0 2024-09-15T22:26:46.135 INFO:tasks.workunit.client.0.smithi001.stdout:4/576: write d0/d27/d35/f4a [1075762,92237] 0 2024-09-15T22:26:46.136 INFO:tasks.workunit.client.0.smithi001.stdout:8/434: write d9/f21 [4112115,18465] 0 2024-09-15T22:26:46.137 INFO:tasks.workunit.client.0.smithi001.stdout:4/577: write d0/d5d/d7c/dba/d20/d29/d34/d84/fc1 [662000,67936] 0 2024-09-15T22:26:46.137 INFO:tasks.workunit.client.0.smithi001.stdout:8/435: rmdir d9/d19/d29/d35 39 2024-09-15T22:26:46.137 INFO:tasks.workunit.client.0.smithi001.stdout:8/436: read - d9/d19/d29/f45 zero size 2024-09-15T22:26:46.138 INFO:tasks.workunit.client.0.smithi001.stdout:9/443: dread d5/de/d1a/f56 [0,4194304] 0 2024-09-15T22:26:46.139 INFO:tasks.workunit.client.0.smithi001.stdout:4/578: link d0/d5d/c49 d0/d5d/d7c/dba/d20/d29/d34/d9c/cd2 0 2024-09-15T22:26:46.140 INFO:tasks.workunit.client.0.smithi001.stdout:4/579: truncate d0/d27/d35/d59/d67/d7b/f87 609197 0 2024-09-15T22:26:46.141 INFO:tasks.workunit.client.0.smithi001.stdout:4/580: mkdir d0/d5d/d7c/dba/d20/d29/d34/d84/d95/dd3 0 2024-09-15T22:26:46.141 INFO:tasks.workunit.client.0.smithi001.stdout:4/581: chown d0/d5d/d44/caf 14 1 2024-09-15T22:26:46.142 INFO:tasks.workunit.client.0.smithi001.stdout:4/582: mknod d0/d5d/d7c/dba/d20/d29/d34/d84/d95/cd4 0 2024-09-15T22:26:46.143 INFO:tasks.workunit.client.0.smithi001.stdout:4/583: creat d0/d27/d35/d59/fd5 x:0 0 0 2024-09-15T22:26:46.144 INFO:tasks.workunit.client.0.smithi001.stdout:4/584: mknod d0/d5d/d7c/dba/d20/d29/d34/d84/cd6 0 2024-09-15T22:26:46.149 INFO:tasks.workunit.client.0.smithi001.stdout:9/444: dread d5/de/d1a/d1b/f70 [0,4194304] 0 2024-09-15T22:26:46.151 INFO:tasks.workunit.client.0.smithi001.stdout:2/483: dwrite d2/d12/d62/f40 [0,4194304] 0 2024-09-15T22:26:46.153 INFO:tasks.workunit.client.0.smithi001.stdout:2/484: symlink d2/d14/d1a/d1b/la6 0 2024-09-15T22:26:46.153 INFO:tasks.workunit.client.0.smithi001.stdout:2/485: truncate d2/d12/d62/d64/f19 5012826 0 2024-09-15T22:26:46.157 INFO:tasks.workunit.client.0.smithi001.stdout:2/486: creat d2/d12/d62/d64/fa7 x:0 0 0 2024-09-15T22:26:46.157 INFO:tasks.workunit.client.0.smithi001.stdout:2/487: truncate d2/d12/d62/d64/f47 1874551 0 2024-09-15T22:26:46.158 INFO:tasks.workunit.client.0.smithi001.stdout:2/488: creat d2/d14/d1a/d8a/fa8 x:0 0 0 2024-09-15T22:26:46.163 INFO:tasks.workunit.client.0.smithi001.stdout:4/585: dread d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d73/f81 [0,4194304] 0 2024-09-15T22:26:46.163 INFO:tasks.workunit.client.0.smithi001.stdout:4/586: dread - d0/d5d/d7c/dba/d20/d29/d34/db2/fa9 zero size 2024-09-15T22:26:46.164 INFO:tasks.workunit.client.0.smithi001.stdout:4/587: creat d0/d27/d35/d59/d67/fd7 x:0 0 0 2024-09-15T22:26:46.164 INFO:tasks.workunit.client.0.smithi001.stdout:4/588: fsync d0/d27/d35/f58 0 2024-09-15T22:26:46.165 INFO:tasks.workunit.client.0.smithi001.stdout:3/473: dwrite da/f31 [0,4194304] 0 2024-09-15T22:26:46.166 INFO:tasks.workunit.client.0.smithi001.stdout:4/589: rmdir d0/d5d/d44/d65 39 2024-09-15T22:26:46.167 INFO:tasks.workunit.client.0.smithi001.stdout:3/474: link da/d3b/f40 da/d3d/d43/d7c/d53/d72/f9f 0 2024-09-15T22:26:46.167 INFO:tasks.workunit.client.0.smithi001.stdout:4/590: mkdir d0/d5d/d7c/dba/d20/d29/d40/dc8/dd8 0 2024-09-15T22:26:46.168 INFO:tasks.workunit.client.0.smithi001.stdout:4/591: creat d0/d5d/d7c/dba/d20/d29/d34/fd9 x:0 0 0 2024-09-15T22:26:46.168 INFO:tasks.workunit.client.0.smithi001.stdout:3/475: creat da/d3d/d43/d41/d70/d7f/fa0 x:0 0 0 2024-09-15T22:26:46.169 INFO:tasks.workunit.client.0.smithi001.stdout:4/592: write d0/d27/d35/f4a [2124744,14408] 0 2024-09-15T22:26:46.170 INFO:tasks.workunit.client.0.smithi001.stdout:4/593: creat d0/d5d/d7c/dba/d20/d29/d34/d9c/fda x:0 0 0 2024-09-15T22:26:46.170 INFO:tasks.workunit.client.0.smithi001.stdout:4/594: write d0/d27/d35/f9d [642805,56873] 0 2024-09-15T22:26:46.171 INFO:tasks.workunit.client.0.smithi001.stdout:3/476: symlink da/d3d/d43/d41/la1 0 2024-09-15T22:26:46.172 INFO:tasks.workunit.client.0.smithi001.stdout:3/477: creat da/d1f/fa2 x:0 0 0 2024-09-15T22:26:46.173 INFO:tasks.workunit.client.0.smithi001.stdout:3/478: mkdir da/d90/da3 0 2024-09-15T22:26:46.177 INFO:tasks.workunit.client.0.smithi001.stdout:4/595: fsync d0/d27/d35/f4a 0 2024-09-15T22:26:46.177 INFO:tasks.workunit.client.0.smithi001.stdout:3/479: creat da/d9e/fa4 x:0 0 0 2024-09-15T22:26:46.177 INFO:tasks.workunit.client.0.smithi001.stdout:3/480: read - da/d3d/d43/d7c/f5f zero size 2024-09-15T22:26:46.177 INFO:tasks.workunit.client.0.smithi001.stdout:3/481: chown da/d90/d92 50 1 2024-09-15T22:26:46.178 INFO:tasks.workunit.client.0.smithi001.stdout:9/445: dread d5/f11 [0,4194304] 0 2024-09-15T22:26:46.178 INFO:tasks.workunit.client.0.smithi001.stdout:3/482: creat da/fa5 x:0 0 0 2024-09-15T22:26:46.178 INFO:tasks.workunit.client.0.smithi001.stdout:3/483: fsync da/d1f/d46/d8e/f96 0 2024-09-15T22:26:46.178 INFO:tasks.workunit.client.0.smithi001.stdout:3/484: truncate da/f31 4603518 0 2024-09-15T22:26:46.179 INFO:tasks.workunit.client.0.smithi001.stdout:3/485: mkdir da/d90/d6f/da6 0 2024-09-15T22:26:46.181 INFO:tasks.workunit.client.0.smithi001.stdout:4/596: symlink d0/d27/d35/ldb 0 2024-09-15T22:26:46.191 INFO:tasks.workunit.client.0.smithi001.stdout:9/446: dread d5/de/d1a/d1b/d22/d2c/f31 [0,4194304] 0 2024-09-15T22:26:46.193 INFO:tasks.workunit.client.0.smithi001.stdout:3/486: dread da/d16/f30 [0,4194304] 0 2024-09-15T22:26:46.194 INFO:tasks.workunit.client.0.smithi001.stdout:9/447: creat d5/de/d1a/d1b/f89 x:0 0 0 2024-09-15T22:26:46.194 INFO:tasks.workunit.client.0.smithi001.stdout:5/505: dwrite d3/d6/d41/f5e [4194304,4194304] 0 2024-09-15T22:26:46.194 INFO:tasks.workunit.client.0.smithi001.stdout:5/506: write d3/d27/d4e/d89/f9b [651365,123426] 0 2024-09-15T22:26:46.194 INFO:tasks.workunit.client.0.smithi001.stdout:5/507: fdatasync d3/d49/f7e 0 2024-09-15T22:26:46.194 INFO:tasks.workunit.client.0.smithi001.stdout:5/508: chown d3/d6/f59 8097 1 2024-09-15T22:26:46.194 INFO:tasks.workunit.client.0.smithi001.stdout:5/509: fsync d3/d27/f46 0 2024-09-15T22:26:46.194 INFO:tasks.workunit.client.0.smithi001.stdout:3/487: rename da/d3d/d43/d41/d70/f98 to da/d3d/d43/d41/fa7 0 2024-09-15T22:26:46.198 INFO:tasks.workunit.client.0.smithi001.stdout:9/448: link d5/de/d1a/d1b/d22/d2c/d21/d23/c43 d5/de/d1a/d1b/d22/d2c/d21/d24/d86/c8a 0 2024-09-15T22:26:46.200 INFO:tasks.workunit.client.0.smithi001.stdout:9/449: rename d5/de/d15/f62 to d5/de/d1a/f8b 0 2024-09-15T22:26:46.213 INFO:tasks.workunit.client.0.smithi001.stdout:5/510: write d3/d6/d41/f5e [6020041,11594] 0 2024-09-15T22:26:46.214 INFO:tasks.workunit.client.0.smithi001.stdout:3/488: dread da/d3b/f40 [4194304,4194304] 0 2024-09-15T22:26:46.214 INFO:tasks.workunit.client.0.smithi001.stdout:3/489: stat da/d3b/c4c 0 2024-09-15T22:26:46.214 INFO:tasks.workunit.client.0.smithi001.stdout:9/450: dread d5/de/d1a/f8b [0,4194304] 0 2024-09-15T22:26:46.214 INFO:tasks.workunit.client.0.smithi001.stdout:8/437: dwrite d9/d19/d34/d41/f4b [0,4194304] 0 2024-09-15T22:26:46.216 INFO:tasks.workunit.client.0.smithi001.stdout:3/490: mkdir da/d3d/d43/d7c/d53/d73/da8 0 2024-09-15T22:26:46.217 INFO:tasks.workunit.client.0.smithi001.stdout:8/438: rename d9/d19/l42 to d9/l7e 0 2024-09-15T22:26:46.217 INFO:tasks.workunit.client.0.smithi001.stdout:3/491: getdents da/d3d/d43 0 2024-09-15T22:26:46.219 INFO:tasks.workunit.client.0.smithi001.stdout:8/439: mknod d9/d19/d29/d35/c7f 0 2024-09-15T22:26:46.220 INFO:tasks.workunit.client.0.smithi001.stdout:3/492: symlink da/d3b/d8b/la9 0 2024-09-15T22:26:46.221 INFO:tasks.workunit.client.0.smithi001.stdout:8/440: symlink d9/d19/d29/d33/l80 0 2024-09-15T22:26:46.225 INFO:tasks.workunit.client.0.smithi001.stdout:0/435: sync 2024-09-15T22:26:46.225 INFO:tasks.workunit.client.0.smithi001.stdout:1/535: sync 2024-09-15T22:26:46.227 INFO:tasks.workunit.client.0.smithi001.stdout:1/536: mkdir d3/dd/d14/daa 0 2024-09-15T22:26:46.228 INFO:tasks.workunit.client.0.smithi001.stdout:1/537: rename d3/dd/d14/d23/l77 to d3/dd/d86/lab 0 2024-09-15T22:26:46.228 INFO:tasks.workunit.client.0.smithi001.stdout:1/538: write d3/dd/d14/f1c [1399714,14515] 0 2024-09-15T22:26:46.229 INFO:tasks.workunit.client.0.smithi001.stdout:8/441: dread f4 [0,4194304] 0 2024-09-15T22:26:46.229 INFO:tasks.workunit.client.0.smithi001.stdout:1/539: link d3/dd/d53/fa3 d3/fac 0 2024-09-15T22:26:46.229 INFO:tasks.workunit.client.0.smithi001.stdout:1/540: truncate d3/f11 2851669 0 2024-09-15T22:26:46.230 INFO:tasks.workunit.client.0.smithi001.stdout:8/442: symlink d9/d19/d29/d50/d70/d76/l81 0 2024-09-15T22:26:46.230 INFO:tasks.workunit.client.0.smithi001.stdout:1/541: creat d3/dd/d3c/d7d/fad x:0 0 0 2024-09-15T22:26:46.231 INFO:tasks.workunit.client.0.smithi001.stdout:8/443: mknod d9/d19/d29/d50/c82 0 2024-09-15T22:26:46.231 INFO:tasks.workunit.client.0.smithi001.stdout:8/444: chown d9/d19/d29/d33/c44 32154 1 2024-09-15T22:26:46.232 INFO:tasks.workunit.client.0.smithi001.stdout:1/542: unlink d3/d12/d21/f22 0 2024-09-15T22:26:46.232 INFO:tasks.workunit.client.0.smithi001.stdout:8/445: truncate d9/d19/d29/d33/d63/f6a 3584606 0 2024-09-15T22:26:46.233 INFO:tasks.workunit.client.0.smithi001.stdout:8/446: stat d9/d19/d34/f47 0 2024-09-15T22:26:46.234 INFO:tasks.workunit.client.0.smithi001.stdout:8/447: rmdir d9/d19/d29/d7c 0 2024-09-15T22:26:46.234 INFO:tasks.workunit.client.0.smithi001.stdout:1/543: rmdir d3/d12 39 2024-09-15T22:26:46.236 INFO:tasks.workunit.client.0.smithi001.stdout:1/544: rename d3/dd/d14/d23/d4b to d3/d8d/dae 0 2024-09-15T22:26:46.236 INFO:tasks.workunit.client.0.smithi001.stdout:1/545: readlink d3/l6e 0 2024-09-15T22:26:46.237 INFO:tasks.workunit.client.0.smithi001.stdout:1/546: mknod d3/d8d/dae/caf 0 2024-09-15T22:26:46.239 INFO:tasks.workunit.client.0.smithi001.stdout:1/547: unlink d3/dd/d14/d1b/d2b/d68/f7a 0 2024-09-15T22:26:46.239 INFO:tasks.workunit.client.0.smithi001.stdout:1/548: fdatasync d3/dd/d3c/f43 0 2024-09-15T22:26:46.250 INFO:tasks.workunit.client.0.smithi001.stdout:8/448: write d9/d19/d40/d5f/d61/f67 [532315,121623] 0 2024-09-15T22:26:46.250 INFO:tasks.workunit.client.0.smithi001.stdout:8/449: readlink d9/d19/d29/d50/l53 0 2024-09-15T22:26:46.252 INFO:tasks.workunit.client.0.smithi001.stdout:8/450: getdents d9/d19/d40/d5f 0 2024-09-15T22:26:46.253 INFO:tasks.workunit.client.0.smithi001.stdout:8/451: mknod d9/d19/d29/d50/c83 0 2024-09-15T22:26:46.253 INFO:tasks.workunit.client.0.smithi001.stdout:5/511: dwrite d3/d27/f3a [0,4194304] 0 2024-09-15T22:26:46.253 INFO:tasks.workunit.client.0.smithi001.stdout:1/549: read d3/dd/d3c/f43 [4615843,15207] 0 2024-09-15T22:26:46.254 INFO:tasks.workunit.client.0.smithi001.stdout:8/452: link f4 d9/d19/d40/d5f/f84 0 2024-09-15T22:26:46.254 INFO:tasks.workunit.client.0.smithi001.stdout:8/453: write d9/f6d [124701,111] 0 2024-09-15T22:26:46.254 INFO:tasks.workunit.client.0.smithi001.stdout:4/597: dwrite d0/d5d/d44/d65/f7d [0,4194304] 0 2024-09-15T22:26:46.255 INFO:tasks.workunit.client.0.smithi001.stdout:5/512: creat d3/d27/fa6 x:0 0 0 2024-09-15T22:26:46.258 INFO:tasks.workunit.client.0.smithi001.stdout:1/550: symlink d3/dd/d14/d1b/lb0 0 2024-09-15T22:26:46.263 INFO:tasks.workunit.client.0.smithi001.stdout:5/513: creat d3/d1d/fa7 x:0 0 0 2024-09-15T22:26:46.263 INFO:tasks.workunit.client.0.smithi001.stdout:5/514: write d3/f16 [441895,71571] 0 2024-09-15T22:26:46.264 INFO:tasks.workunit.client.0.smithi001.stdout:1/551: write d3/d12/d21/f57 [2381955,81316] 0 2024-09-15T22:26:46.266 INFO:tasks.workunit.client.0.smithi001.stdout:5/515: creat d3/d27/d7a/fa8 x:0 0 0 2024-09-15T22:26:46.268 INFO:tasks.workunit.client.0.smithi001.stdout:4/598: dread d0/d5d/d7c/dd1/fb6 [0,4194304] 0 2024-09-15T22:26:46.268 INFO:tasks.workunit.client.0.smithi001.stdout:5/516: creat d3/d1d/d54/d56/d52/d9f/da4/fa9 x:0 0 0 2024-09-15T22:26:46.268 INFO:tasks.workunit.client.0.smithi001.stdout:8/454: write d9/f31 [299839,58631] 0 2024-09-15T22:26:46.272 INFO:tasks.workunit.client.0.smithi001.stdout:4/599: mknod d0/d5d/d7c/dba/d20/d29/d34/db2/cdc 0 2024-09-15T22:26:46.274 INFO:tasks.workunit.client.0.smithi001.stdout:4/600: symlink d0/d5d/d44/ldd 0 2024-09-15T22:26:46.274 INFO:tasks.workunit.client.0.smithi001.stdout:4/601: truncate d0/d5d/d7c/dba/d20/d29/d34/f62 1162354 0 2024-09-15T22:26:46.284 INFO:tasks.workunit.client.0.smithi001.stdout:4/602: symlink d0/d5d/lde 0 2024-09-15T22:26:46.287 INFO:tasks.workunit.client.0.smithi001.stdout:7/498: sync 2024-09-15T22:26:46.293 INFO:tasks.workunit.client.0.smithi001.stdout:7/499: link d0/d8e/f7f d0/d7/fa4 0 2024-09-15T22:26:46.293 INFO:tasks.workunit.client.0.smithi001.stdout:5/517: dread d3/d1d/d54/d56/f55 [0,4194304] 0 2024-09-15T22:26:46.293 INFO:tasks.workunit.client.0.smithi001.stdout:5/518: symlink d3/d6/d41/d4d/d91/laa 0 2024-09-15T22:26:46.293 INFO:tasks.workunit.client.0.smithi001.stdout:5/519: stat d3/d1d/l8b 0 2024-09-15T22:26:46.293 INFO:tasks.workunit.client.0.smithi001.stdout:5/520: dread - d3/d6/d25/f7f zero size 2024-09-15T22:26:46.296 INFO:tasks.workunit.client.0.smithi001.stdout:4/603: dread d0/d5d/d7c/dba/d20/d29/d40/f71 [0,4194304] 0 2024-09-15T22:26:46.297 INFO:tasks.workunit.client.0.smithi001.stdout:4/604: symlink d0/d5d/d44/d65/d6a/ldf 0 2024-09-15T22:26:46.307 INFO:tasks.workunit.client.0.smithi001.stdout:1/552: dwrite d3/d8d/dae/f70 [0,4194304] 0 2024-09-15T22:26:46.309 INFO:tasks.workunit.client.0.smithi001.stdout:7/500: read d0/d8e/f32 [677893,83120] 0 2024-09-15T22:26:46.309 INFO:tasks.workunit.client.0.smithi001.stdout:1/553: rename d3/dd/d14/d1b/d2b/d68/f8e to d3/dd/d14/d1b/d2b/fb1 0 2024-09-15T22:26:46.309 INFO:tasks.workunit.client.0.smithi001.stdout:1/554: stat d3/dd/d14/d23/l62 0 2024-09-15T22:26:46.309 INFO:tasks.workunit.client.0.smithi001.stdout:1/555: stat d3/d12 0 2024-09-15T22:26:46.310 INFO:tasks.workunit.client.0.smithi001.stdout:4/605: write d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d73/f81 [2206902,70930] 0 2024-09-15T22:26:46.310 INFO:tasks.workunit.client.0.smithi001.stdout:7/501: mkdir d0/d7/d44/d3f/d49/da5 0 2024-09-15T22:26:46.311 INFO:tasks.workunit.client.0.smithi001.stdout:4/606: mkdir d0/d5d/d7c/dba/d20/d29/de0 0 2024-09-15T22:26:46.311 INFO:tasks.workunit.client.0.smithi001.stdout:4/607: write d0/d5d/d7c/dba/f22 [2033783,51984] 0 2024-09-15T22:26:46.312 INFO:tasks.workunit.client.0.smithi001.stdout:4/608: mkdir d0/d27/d35/da4/de1 0 2024-09-15T22:26:46.312 INFO:tasks.workunit.client.0.smithi001.stdout:4/609: dread - d0/d5d/d7c/dba/d20/d29/fb1 zero size 2024-09-15T22:26:46.312 INFO:tasks.workunit.client.0.smithi001.stdout:4/610: truncate d0/d5d/d44/d65/d6a/f6e 553853 0 2024-09-15T22:26:46.313 INFO:tasks.workunit.client.0.smithi001.stdout:5/521: dread d3/d27/f3a [0,4194304] 0 2024-09-15T22:26:46.313 INFO:tasks.workunit.client.0.smithi001.stdout:5/522: read d3/d27/f2d [29391,25455] 0 2024-09-15T22:26:46.313 INFO:tasks.workunit.client.0.smithi001.stdout:5/523: dread - d3/d27/d7a/fa8 zero size 2024-09-15T22:26:46.314 INFO:tasks.workunit.client.0.smithi001.stdout:7/502: write d0/d7/d44/d3f/f75 [4562432,106015] 0 2024-09-15T22:26:46.316 INFO:tasks.workunit.client.0.smithi001.stdout:8/455: dwrite d9/d19/d58/f49 [0,4194304] 0 2024-09-15T22:26:46.323 INFO:tasks.workunit.client.0.smithi001.stdout:6/492: sync 2024-09-15T22:26:46.323 INFO:tasks.workunit.client.0.smithi001.stdout:2/489: sync 2024-09-15T22:26:46.324 INFO:tasks.workunit.client.0.smithi001.stdout:8/456: dread d9/d19/d58/f4d [0,4194304] 0 2024-09-15T22:26:46.325 INFO:tasks.workunit.client.0.smithi001.stdout:8/457: mknod d9/d19/d29/d33/c85 0 2024-09-15T22:26:46.325 INFO:tasks.workunit.client.0.smithi001.stdout:7/503: dread d0/d8e/d3e/f67 [0,4194304] 0 2024-09-15T22:26:46.326 INFO:tasks.workunit.client.0.smithi001.stdout:7/504: creat d0/d7/d44/d3f/fa6 x:0 0 0 2024-09-15T22:26:46.326 INFO:tasks.workunit.client.0.smithi001.stdout:2/490: creat d2/d14/d1a/d1b/d82/d83/fa9 x:0 0 0 2024-09-15T22:26:46.327 INFO:tasks.workunit.client.0.smithi001.stdout:8/458: creat d9/d19/d29/d50/d70/f86 x:0 0 0 2024-09-15T22:26:46.328 INFO:tasks.workunit.client.0.smithi001.stdout:7/505: symlink d0/d6a/la7 0 2024-09-15T22:26:46.329 INFO:tasks.workunit.client.0.smithi001.stdout:5/524: dread d3/d27/f90 [0,4194304] 0 2024-09-15T22:26:46.329 INFO:tasks.workunit.client.0.smithi001.stdout:2/491: rename d2/d12/d62/l9b to d2/d12/laa 0 2024-09-15T22:26:46.329 INFO:tasks.workunit.client.0.smithi001.stdout:2/492: stat d2/d14/d1a/d8a/f94 0 2024-09-15T22:26:46.331 INFO:tasks.workunit.client.0.smithi001.stdout:2/493: symlink d2/d14/d1a/d1b/lab 0 2024-09-15T22:26:46.331 INFO:tasks.workunit.client.0.smithi001.stdout:8/459: creat d9/d19/d40/d5f/f87 x:0 0 0 2024-09-15T22:26:46.332 INFO:tasks.workunit.client.0.smithi001.stdout:4/611: read d0/d27/d35/d59/d67/dab/f8d [3681031,18047] 0 2024-09-15T22:26:46.336 INFO:tasks.workunit.client.0.smithi001.stdout:2/494: getdents d2/d12/d62/d4c/d71 0 2024-09-15T22:26:46.338 INFO:tasks.workunit.client.0.smithi001.stdout:2/495: symlink d2/d14/d1a/d1b/d82/d83/lac 0 2024-09-15T22:26:46.342 INFO:tasks.workunit.client.0.smithi001.stdout:7/506: write d0/d7/d21/d6b/d93/f95 [6758263,64621] 0 2024-09-15T22:26:46.344 INFO:tasks.workunit.client.0.smithi001.stdout:6/493: write d0/d6/d5d/d67/d53/f8a [3737283,3646] 0 2024-09-15T22:26:46.359 INFO:tasks.workunit.client.0.smithi001.stdout:2/496: dread d2/f10 [0,4194304] 0 2024-09-15T22:26:46.359 INFO:tasks.workunit.client.0.smithi001.stdout:2/497: write d2/d14/d1a/f69 [358267,59500] 0 2024-09-15T22:26:46.367 INFO:tasks.workunit.client.0.smithi001.stdout:2/498: dread d2/d14/d1a/f7a [0,4194304] 0 2024-09-15T22:26:46.369 INFO:tasks.workunit.client.0.smithi001.stdout:2/499: creat d2/d12/d62/d64/fad x:0 0 0 2024-09-15T22:26:46.395 INFO:tasks.workunit.client.0.smithi001.stdout:1/556: dwrite d3/dd/d3c/d7d/f88 [0,4194304] 0 2024-09-15T22:26:46.397 INFO:tasks.workunit.client.0.smithi001.stdout:1/557: rename d3/dd/d14/d1b/f7f to d3/dd/d14/daa/fb2 0 2024-09-15T22:26:46.398 INFO:tasks.workunit.client.0.smithi001.stdout:1/558: mknod d3/dd/d14/d1b/d2b/cb3 0 2024-09-15T22:26:46.399 INFO:tasks.workunit.client.0.smithi001.stdout:1/559: read d3/dd/d14/d23/f9d [7242,110979] 0 2024-09-15T22:26:46.404 INFO:tasks.workunit.client.0.smithi001.stdout:8/460: dwrite d9/d19/d58/f4d [0,4194304] 0 2024-09-15T22:26:46.420 INFO:tasks.workunit.client.0.smithi001.stdout:5/525: dwrite d3/d6/d57/f7c [0,4194304] 0 2024-09-15T22:26:46.420 INFO:tasks.workunit.client.0.smithi001.stdout:5/526: chown d3/d1d/d54/d56/d52/d9f/da4 39427 1 2024-09-15T22:26:46.420 INFO:tasks.workunit.client.0.smithi001.stdout:5/527: chown d3/d1d/d54/d56/d52/d61/l70 382 1 2024-09-15T22:26:46.424 INFO:tasks.workunit.client.0.smithi001.stdout:5/528: rename d3/d6/d41/d4d/d5a/f96 to d3/d6/d57/d87/d8c/fab 0 2024-09-15T22:26:46.424 INFO:tasks.workunit.client.0.smithi001.stdout:5/529: readlink d3/d1d/d54/d56/d52/d61/l8d 0 2024-09-15T22:26:46.424 INFO:tasks.workunit.client.0.smithi001.stdout:9/451: sync 2024-09-15T22:26:46.425 INFO:tasks.workunit.client.0.smithi001.stdout:3/493: sync 2024-09-15T22:26:46.425 INFO:tasks.workunit.client.0.smithi001.stdout:3/494: stat da/d90/d6f 0 2024-09-15T22:26:46.426 INFO:tasks.workunit.client.0.smithi001.stdout:9/452: rename d5/de/d1a/f42 to d5/de/d1a/f8c 0 2024-09-15T22:26:46.437 INFO:tasks.workunit.client.0.smithi001.stdout:7/507: write d0/d7/d2e/f9c [1904113,7766] 0 2024-09-15T22:26:46.437 INFO:tasks.workunit.client.0.smithi001.stdout:7/508: chown d0/le 140 1 2024-09-15T22:26:46.439 INFO:tasks.workunit.client.0.smithi001.stdout:4/612: dwrite d0/f51 [0,4194304] 0 2024-09-15T22:26:46.442 INFO:tasks.workunit.client.0.smithi001.stdout:3/495: dread da/d3d/d43/d41/f80 [0,4194304] 0 2024-09-15T22:26:46.442 INFO:tasks.workunit.client.0.smithi001.stdout:4/613: symlink d0/d5d/d7c/dba/le2 0 2024-09-15T22:26:46.443 INFO:tasks.workunit.client.0.smithi001.stdout:6/494: dwrite d0/d6/d5d/d67/f4e [0,4194304] 0 2024-09-15T22:26:46.443 INFO:tasks.workunit.client.0.smithi001.stdout:6/495: chown d0/df/d24/f7f 416908 1 2024-09-15T22:26:46.444 INFO:tasks.workunit.client.0.smithi001.stdout:4/614: creat d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d73/dc0/fe3 x:0 0 0 2024-09-15T22:26:46.446 INFO:tasks.workunit.client.0.smithi001.stdout:0/436: sync 2024-09-15T22:26:46.447 INFO:tasks.workunit.client.0.smithi001.stdout:4/615: symlink d0/d27/d35/d59/d67/dab/le4 0 2024-09-15T22:26:46.448 INFO:tasks.workunit.client.0.smithi001.stdout:0/437: rmdir d0/d9/db/d5d/d6d 39 2024-09-15T22:26:46.448 INFO:tasks.workunit.client.0.smithi001.stdout:4/616: rmdir d0/d27/d35/d59/d67/d7b 39 2024-09-15T22:26:46.449 INFO:tasks.workunit.client.0.smithi001.stdout:4/617: write d0/d5d/d44/d65/d6a/f6e [709632,76107] 0 2024-09-15T22:26:46.450 INFO:tasks.workunit.client.0.smithi001.stdout:4/618: mkdir d0/d27/d35/d74/de5 0 2024-09-15T22:26:46.452 INFO:tasks.workunit.client.0.smithi001.stdout:4/619: creat d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d73/dc0/fe6 x:0 0 0 2024-09-15T22:26:46.454 INFO:tasks.workunit.client.0.smithi001.stdout:8/461: dwrite d9/d19/d29/d50/f52 [0,4194304] 0 2024-09-15T22:26:46.455 INFO:tasks.workunit.client.0.smithi001.stdout:8/462: dread - d9/d19/d29/d50/d70/d76/f7a zero size 2024-09-15T22:26:46.458 INFO:tasks.workunit.client.0.smithi001.stdout:8/463: mkdir d9/d19/d58/d88 0 2024-09-15T22:26:46.458 INFO:tasks.workunit.client.0.smithi001.stdout:8/464: write d9/d19/d29/d50/d70/f86 [748099,31542] 0 2024-09-15T22:26:46.482 INFO:tasks.workunit.client.0.smithi001.stdout:7/509: dwrite d0/d7/d44/f74 [0,4194304] 0 2024-09-15T22:26:46.522 INFO:tasks.workunit.client.0.smithi001.stdout:1/560: dwrite d3/dd/d3c/f43 [4194304,4194304] 0 2024-09-15T22:26:46.522 INFO:tasks.workunit.client.0.smithi001.stdout:1/561: rename d3/f5 to d3/d8d/d91/fb4 0 2024-09-15T22:26:46.522 INFO:tasks.workunit.client.0.smithi001.stdout:1/562: creat d3/dd/d14/d1b/d2b/d68/fb5 x:0 0 0 2024-09-15T22:26:46.522 INFO:tasks.workunit.client.0.smithi001.stdout:1/563: truncate d3/f5e 159503 0 2024-09-15T22:26:46.522 INFO:tasks.workunit.client.0.smithi001.stdout:1/564: rename d3/l3a to d3/lb6 0 2024-09-15T22:26:46.522 INFO:tasks.workunit.client.0.smithi001.stdout:2/500: dwrite d2/d14/f9a [0,4194304] 0 2024-09-15T22:26:46.522 INFO:tasks.workunit.client.0.smithi001.stdout:2/501: dread - d2/d12/d62/d64/fad zero size 2024-09-15T22:26:46.522 INFO:tasks.workunit.client.0.smithi001.stdout:0/438: dwrite d0/d9/f38 [0,4194304] 0 2024-09-15T22:26:46.522 INFO:tasks.workunit.client.0.smithi001.stdout:1/565: dread d3/dd/d14/d23/f9d [0,4194304] 0 2024-09-15T22:26:46.522 INFO:tasks.workunit.client.0.smithi001.stdout:1/566: truncate d3/dd/d3c/d7d/fad 646554 0 2024-09-15T22:26:46.523 INFO:tasks.workunit.client.0.smithi001.stdout:1/567: fsync d3/d12/f40 0 2024-09-15T22:26:46.523 INFO:tasks.workunit.client.0.smithi001.stdout:1/568: creat d3/d12/fb7 x:0 0 0 2024-09-15T22:26:46.523 INFO:tasks.workunit.client.0.smithi001.stdout:1/569: chown d3/dd/d14/la7 31901 1 2024-09-15T22:26:46.523 INFO:tasks.workunit.client.0.smithi001.stdout:1/570: chown d3/dd/d3c/f43 317690 1 2024-09-15T22:26:46.523 INFO:tasks.workunit.client.0.smithi001.stdout:1/571: write d3/dd/d14/f44 [1344738,104534] 0 2024-09-15T22:26:46.523 INFO:tasks.workunit.client.0.smithi001.stdout:9/453: dwrite d5/de/d1a/d1b/d22/d2c/d21/d4d/f5d [0,4194304] 0 2024-09-15T22:26:46.523 INFO:tasks.workunit.client.0.smithi001.stdout:9/454: fsync d5/de/d15/d27/d63/f7b 0 2024-09-15T22:26:46.523 INFO:tasks.workunit.client.0.smithi001.stdout:6/496: dwrite d0/df/d24/d2e/f6f [4194304,4194304] 0 2024-09-15T22:26:46.523 INFO:tasks.workunit.client.0.smithi001.stdout:6/497: rename d0/df/d24/l51 to d0/d6/d5d/laf 0 2024-09-15T22:26:46.523 INFO:tasks.workunit.client.0.smithi001.stdout:6/498: link d0/d6/d5d/d67/f4e d0/df/d24/d2e/d43/fb0 0 2024-09-15T22:26:46.547 INFO:tasks.workunit.client.0.smithi001.stdout:2/502: dwrite d2/d12/d62/d64/fa5 [0,4194304] 0 2024-09-15T22:26:46.547 INFO:tasks.workunit.client.0.smithi001.stdout:2/503: getdents d2/d14/d1a/d1b/d98 0 2024-09-15T22:26:46.551 INFO:tasks.workunit.client.0.smithi001.stdout:2/504: creat d2/d14/d1a/d80/fae x:0 0 0 2024-09-15T22:26:46.551 INFO:tasks.workunit.client.0.smithi001.stdout:2/505: rename d2/d14 to d2/d14/d1a/d1b/d82/d97/da2/daf 22 2024-09-15T22:26:46.554 INFO:tasks.workunit.client.0.smithi001.stdout:1/572: dwrite d3/dd/d14/f44 [0,4194304] 0 2024-09-15T22:26:46.554 INFO:tasks.workunit.client.0.smithi001.stdout:1/573: write d3/f11 [878085,80666] 0 2024-09-15T22:26:46.556 INFO:tasks.workunit.client.0.smithi001.stdout:1/574: creat d3/d12/d79/d89/fb8 x:0 0 0 2024-09-15T22:26:46.557 INFO:tasks.workunit.client.0.smithi001.stdout:1/575: dread - d3/dd/d3c/d4c/f4e zero size 2024-09-15T22:26:46.562 INFO:tasks.workunit.client.0.smithi001.stdout:3/496: dwrite f6 [0,4194304] 0 2024-09-15T22:26:46.563 INFO:tasks.workunit.client.0.smithi001.stdout:3/497: readlink da/d1f/d46/l93 0 2024-09-15T22:26:46.564 INFO:tasks.workunit.client.0.smithi001.stdout:3/498: symlink da/d90/d6f/laa 0 2024-09-15T22:26:46.569 INFO:tasks.workunit.client.0.smithi001.stdout:7/510: dwrite d0/f2a [0,4194304] 0 2024-09-15T22:26:46.569 INFO:tasks.workunit.client.0.smithi001.stdout:7/511: write d0/d7/f24 [101463,33813] 0 2024-09-15T22:26:46.570 INFO:tasks.workunit.client.0.smithi001.stdout:7/512: write d0/d8e/f7f [1646841,71989] 0 2024-09-15T22:26:46.570 INFO:tasks.workunit.client.0.smithi001.stdout:7/513: readlink d0/d8e/d3e/l43 0 2024-09-15T22:26:46.570 INFO:tasks.workunit.client.0.smithi001.stdout:7/514: truncate d0/d7/d44/f78 620753 0 2024-09-15T22:26:46.570 INFO:tasks.workunit.client.0.smithi001.stdout:7/515: chown d0/l6d 22480935 1 2024-09-15T22:26:46.572 INFO:tasks.workunit.client.0.smithi001.stdout:7/516: rename d0/d7/d7c/f97 to d0/d7/d21/d6b/fa8 0 2024-09-15T22:26:46.572 INFO:tasks.workunit.client.0.smithi001.stdout:7/517: chown d0/f7a 8 1 2024-09-15T22:26:46.575 INFO:tasks.workunit.client.0.smithi001.stdout:5/530: sync 2024-09-15T22:26:46.575 INFO:tasks.workunit.client.0.smithi001.stdout:5/531: getdents d3/d27/d7a/d80 0 2024-09-15T22:26:46.576 INFO:tasks.workunit.client.0.smithi001.stdout:5/532: creat d3/d27/d7a/d80/fac x:0 0 0 2024-09-15T22:26:46.579 INFO:tasks.workunit.client.0.smithi001.stdout:0/439: dwrite d0/d9/d1a/d36/f45 [0,4194304] 0 2024-09-15T22:26:46.585 INFO:tasks.workunit.client.0.smithi001.stdout:7/518: dread d0/d8e/f32 [0,4194304] 0 2024-09-15T22:26:46.585 INFO:tasks.workunit.client.0.smithi001.stdout:7/519: chown d0/d7 50 1 2024-09-15T22:26:46.585 INFO:tasks.workunit.client.0.smithi001.stdout:7/520: fdatasync d0/d7/d44/d94/f9d 0 2024-09-15T22:26:46.585 INFO:tasks.workunit.client.0.smithi001.stdout:7/521: readlink d0/d7/d2e/d60/l9a 0 2024-09-15T22:26:46.592 INFO:tasks.workunit.client.0.smithi001.stdout:0/440: write d0/d9/f26 [2019097,99079] 0 2024-09-15T22:26:46.611 INFO:tasks.workunit.client.0.smithi001.stdout:7/522: write d0/d8e/f37 [1883850,121563] 0 2024-09-15T22:26:46.612 INFO:tasks.workunit.client.0.smithi001.stdout:7/523: symlink d0/d7/d21/la9 0 2024-09-15T22:26:46.614 INFO:tasks.workunit.client.0.smithi001.stdout:7/524: rename d0/d7/d21/d6b/d93/f95 to d0/d7/d44/d3f/d49/da5/faa 0 2024-09-15T22:26:46.617 INFO:tasks.workunit.client.0.smithi001.stdout:0/441: dread d0/dd/d1b/f5e [0,4194304] 0 2024-09-15T22:26:46.617 INFO:tasks.workunit.client.0.smithi001.stdout:0/442: readlink d0/d9/d1a/l7f 0 2024-09-15T22:26:46.618 INFO:tasks.workunit.client.0.smithi001.stdout:0/443: creat d0/d9/d1a/d70/f87 x:0 0 0 2024-09-15T22:26:46.619 INFO:tasks.workunit.client.0.smithi001.stdout:5/533: dwrite d3/d6/f59 [4194304,4194304] 0 2024-09-15T22:26:46.621 INFO:tasks.workunit.client.0.smithi001.stdout:0/444: unlink d0/d9/db/l6f 0 2024-09-15T22:26:46.621 INFO:tasks.workunit.client.0.smithi001.stdout:2/506: dwrite d2/f10 [0,4194304] 0 2024-09-15T22:26:46.622 INFO:tasks.workunit.client.0.smithi001.stdout:0/445: symlink d0/d84/l88 0 2024-09-15T22:26:46.630 INFO:tasks.workunit.client.0.smithi001.stdout:2/507: dread d2/d14/d1a/f69 [0,4194304] 0 2024-09-15T22:26:46.632 INFO:tasks.workunit.client.0.smithi001.stdout:3/499: dwrite da/d3d/d43/d41/f80 [4194304,4194304] 0 2024-09-15T22:26:46.632 INFO:tasks.workunit.client.0.smithi001.stdout:3/500: write da/d1f/d46/d8e/f96 [515301,61292] 0 2024-09-15T22:26:46.632 INFO:tasks.workunit.client.0.smithi001.stdout:2/508: mkdir d2/d14/d1a/d1b/d82/db0 0 2024-09-15T22:26:46.634 INFO:tasks.workunit.client.0.smithi001.stdout:3/501: getdents da 0 2024-09-15T22:26:46.634 INFO:tasks.workunit.client.0.smithi001.stdout:3/502: read da/d16/f4b [3570174,12492] 0 2024-09-15T22:26:46.635 INFO:tasks.workunit.client.0.smithi001.stdout:3/503: symlink da/lab 0 2024-09-15T22:26:46.637 INFO:tasks.workunit.client.0.smithi001.stdout:3/504: mknod da/d3d/d43/d7c/d53/d72/cac 0 2024-09-15T22:26:46.638 INFO:tasks.workunit.client.0.smithi001.stdout:3/505: creat da/d90/d92/fad x:0 0 0 2024-09-15T22:26:46.639 INFO:tasks.workunit.client.0.smithi001.stdout:3/506: truncate da/d3b/d1b/f2c 3243882 0 2024-09-15T22:26:46.643 INFO:tasks.workunit.client.0.smithi001.stdout:0/446: dread d0/d9/db/f6b [0,4194304] 0 2024-09-15T22:26:46.658 INFO:tasks.workunit.client.0.smithi001.stdout:0/447: link d0/dd/d33/f5b d0/d6/f89 0 2024-09-15T22:26:46.665 INFO:tasks.workunit.client.0.smithi001.stdout:7/525: dwrite d0/d7/d44/d3f/fa6 [0,4194304] 0 2024-09-15T22:26:46.665 INFO:tasks.workunit.client.0.smithi001.stdout:7/526: chown d0/d7/d44/d3f/f75 529596 1 2024-09-15T22:26:46.674 INFO:tasks.workunit.client.0.smithi001.stdout:7/527: truncate d0/d7/d44/d3f/fa6 1348833 0 2024-09-15T22:26:46.674 INFO:tasks.workunit.client.0.smithi001.stdout:8/465: sync 2024-09-15T22:26:46.674 INFO:tasks.workunit.client.0.smithi001.stdout:4/620: sync 2024-09-15T22:26:46.675 INFO:tasks.workunit.client.0.smithi001.stdout:4/621: readlink d0/d5d/lde 0 2024-09-15T22:26:46.675 INFO:tasks.workunit.client.0.smithi001.stdout:4/622: stat d0/d5d/d7c/dba/d20 0 2024-09-15T22:26:46.676 INFO:tasks.workunit.client.0.smithi001.stdout:7/528: creat d0/d7/d44/d3f/d49/fab x:0 0 0 2024-09-15T22:26:46.676 INFO:tasks.workunit.client.0.smithi001.stdout:4/623: creat d0/d27/d35/fe7 x:0 0 0 2024-09-15T22:26:46.676 INFO:tasks.workunit.client.0.smithi001.stdout:4/624: write d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d73/f81 [1300089,62617] 0 2024-09-15T22:26:46.676 INFO:tasks.workunit.client.0.smithi001.stdout:8/466: write d9/d19/d58/f54 [597466,28846] 0 2024-09-15T22:26:46.676 INFO:tasks.workunit.client.0.smithi001.stdout:0/448: dread d0/d9/d1a/f28 [0,4194304] 0 2024-09-15T22:26:46.681 INFO:tasks.workunit.client.0.smithi001.stdout:8/467: mkdir d9/d19/d29/d50/d89 0 2024-09-15T22:26:46.681 INFO:tasks.workunit.client.0.smithi001.stdout:7/529: truncate d0/d7/d44/d36/f72 80148 0 2024-09-15T22:26:46.681 INFO:tasks.workunit.client.0.smithi001.stdout:7/530: truncate d0/d7/d44/f8d 757839 0 2024-09-15T22:26:46.682 INFO:tasks.workunit.client.0.smithi001.stdout:7/531: fsync d0/d7/d44/d36/f84 0 2024-09-15T22:26:46.682 INFO:tasks.workunit.client.0.smithi001.stdout:7/532: mkdir d0/d6a/dac 0 2024-09-15T22:26:46.682 INFO:tasks.workunit.client.0.smithi001.stdout:5/534: dwrite d3/d27/fa6 [0,4194304] 0 2024-09-15T22:26:46.683 INFO:tasks.workunit.client.0.smithi001.stdout:7/533: rename d0/d6a/c9e to d0/d7/d7c/cad 0 2024-09-15T22:26:46.683 INFO:tasks.workunit.client.0.smithi001.stdout:7/534: symlink d0/d7/d44/d3f/lae 0 2024-09-15T22:26:46.684 INFO:tasks.workunit.client.0.smithi001.stdout:4/625: dread d0/d5d/d7c/dba/d20/d29/d34/f39 [0,4194304] 0 2024-09-15T22:26:46.684 INFO:tasks.workunit.client.0.smithi001.stdout:4/626: chown d0/d5d/d7c/dba/l1e 19909337 1 2024-09-15T22:26:46.685 INFO:tasks.workunit.client.0.smithi001.stdout:5/535: rename d3/d6/d41/l63 to d3/d1d/d54/lad 0 2024-09-15T22:26:46.685 INFO:tasks.workunit.client.0.smithi001.stdout:7/535: creat d0/d7/d44/d3f/faf x:0 0 0 2024-09-15T22:26:46.687 INFO:tasks.workunit.client.0.smithi001.stdout:7/536: mknod d0/d7/d2e/d60/cb0 0 2024-09-15T22:26:46.687 INFO:tasks.workunit.client.0.smithi001.stdout:5/536: getdents d3/d1d/d54/d56 0 2024-09-15T22:26:46.688 INFO:tasks.workunit.client.0.smithi001.stdout:5/537: chown d3/d1d/d54/d56/d52/d61 7 1 2024-09-15T22:26:46.689 INFO:tasks.workunit.client.0.smithi001.stdout:7/537: symlink d0/d7/d44/d94/lb1 0 2024-09-15T22:26:46.695 INFO:tasks.workunit.client.0.smithi001.stdout:0/449: dread d0/d6/f89 [4194304,4194304] 0 2024-09-15T22:26:46.696 INFO:tasks.workunit.client.0.smithi001.stdout:0/450: symlink d0/d9/d1a/d70/l8a 0 2024-09-15T22:26:46.697 INFO:tasks.workunit.client.0.smithi001.stdout:0/451: creat d0/d6/d77/d78/f8b x:0 0 0 2024-09-15T22:26:46.698 INFO:tasks.workunit.client.0.smithi001.stdout:0/452: symlink d0/d9/db/d5d/d6d/l8c 0 2024-09-15T22:26:46.699 INFO:tasks.workunit.client.0.smithi001.stdout:5/538: mkdir d3/d27/d4e/d89/dae 0 2024-09-15T22:26:46.700 INFO:tasks.workunit.client.0.smithi001.stdout:4/627: rename d0/d5d/d7c/dba/d20/d29/d34/d3a to d0/d5d/d7c/de8 0 2024-09-15T22:26:46.700 INFO:tasks.workunit.client.0.smithi001.stdout:8/468: dread d9/d19/d29/d33/d63/f64 [0,4194304] 0 2024-09-15T22:26:46.701 INFO:tasks.workunit.client.0.smithi001.stdout:4/628: mknod d0/d5d/d7c/dba/d20/d29/d34/d84/ce9 0 2024-09-15T22:26:46.701 INFO:tasks.workunit.client.0.smithi001.stdout:8/469: rmdir d9/d19/d29/d50/d70/d76 39 2024-09-15T22:26:46.702 INFO:tasks.workunit.client.0.smithi001.stdout:5/539: creat d3/d27/d7a/d80/faf x:0 0 0 2024-09-15T22:26:46.703 INFO:tasks.workunit.client.0.smithi001.stdout:4/629: getdents d0/d5d/d44 0 2024-09-15T22:26:46.703 INFO:tasks.workunit.client.0.smithi001.stdout:4/630: fdatasync d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d73/fa8 0 2024-09-15T22:26:46.704 INFO:tasks.workunit.client.0.smithi001.stdout:5/540: mkdir d3/d6/d41/d88/db0 0 2024-09-15T22:26:46.706 INFO:tasks.workunit.client.0.smithi001.stdout:3/507: dwrite da/d3b/f40 [0,4194304] 0 2024-09-15T22:26:46.707 INFO:tasks.workunit.client.0.smithi001.stdout:5/541: mknod d3/d1d/d54/d56/d52/d61/cb1 0 2024-09-15T22:26:46.709 INFO:tasks.workunit.client.0.smithi001.stdout:4/631: unlink d0/d5d/d7c/de8/f8a 0 2024-09-15T22:26:46.710 INFO:tasks.workunit.client.0.smithi001.stdout:3/508: rename da/d1f/d46 to da/dae 0 2024-09-15T22:26:46.715 INFO:tasks.workunit.client.0.smithi001.stdout:5/542: link d3/d27/l85 d3/d27/d7a/d80/lb2 0 2024-09-15T22:26:46.718 INFO:tasks.workunit.client.0.smithi001.stdout:6/499: sync 2024-09-15T22:26:46.718 INFO:tasks.workunit.client.0.smithi001.stdout:9/455: sync 2024-09-15T22:26:46.718 INFO:tasks.workunit.client.0.smithi001.stdout:2/509: sync 2024-09-15T22:26:46.718 INFO:tasks.workunit.client.0.smithi001.stdout:1/576: sync 2024-09-15T22:26:46.718 INFO:tasks.workunit.client.0.smithi001.stdout:6/500: write d0/df/d24/d2e/f6f [708995,51713] 0 2024-09-15T22:26:46.718 INFO:tasks.workunit.client.0.smithi001.stdout:5/543: rmdir d3/d27/d7a 39 2024-09-15T22:26:46.719 INFO:tasks.workunit.client.0.smithi001.stdout:1/577: mkdir d3/dd/d14/db9 0 2024-09-15T22:26:46.719 INFO:tasks.workunit.client.0.smithi001.stdout:2/510: unlink d2/f5a 0 2024-09-15T22:26:46.719 INFO:tasks.workunit.client.0.smithi001.stdout:9/456: truncate d5/de/d1a/d1b/d22/d2c/f6a 1394342 0 2024-09-15T22:26:46.729 INFO:tasks.workunit.client.0.smithi001.stdout:3/509: read da/d3b/d1b/f2c [1480981,110319] 0 2024-09-15T22:26:46.730 INFO:tasks.workunit.client.0.smithi001.stdout:3/510: getdents da/d90 0 2024-09-15T22:26:46.742 INFO:tasks.workunit.client.0.smithi001.stdout:3/511: unlink da/d3d/d43/d7c/d53/d73/c86 0 2024-09-15T22:26:46.746 INFO:tasks.workunit.client.0.smithi001.stdout:3/512: rmdir da/d3d/d43/d7c/d53/d72 39 2024-09-15T22:26:46.747 INFO:tasks.workunit.client.0.smithi001.stdout:3/513: read - da/fa5 zero size 2024-09-15T22:26:46.748 INFO:tasks.workunit.client.0.smithi001.stdout:3/514: creat da/d3b/d58/faf x:0 0 0 2024-09-15T22:26:46.748 INFO:tasks.workunit.client.0.smithi001.stdout:3/515: chown da/d16 248675660 1 2024-09-15T22:26:46.754 INFO:tasks.workunit.client.0.smithi001.stdout:2/511: write d2/d14/d1a/d1b/f78 [1359130,121895] 0 2024-09-15T22:26:46.754 INFO:tasks.workunit.client.0.smithi001.stdout:3/516: truncate da/d1f/f22 565826 0 2024-09-15T22:26:46.754 INFO:tasks.workunit.client.0.smithi001.stdout:3/517: readlink da/d1f/l4e 0 2024-09-15T22:26:46.754 INFO:tasks.workunit.client.0.smithi001.stdout:3/518: dread - da/d90/d92/fad zero size 2024-09-15T22:26:46.754 INFO:tasks.workunit.client.0.smithi001.stdout:3/519: chown da/d1f 40888 1 2024-09-15T22:26:46.754 INFO:tasks.workunit.client.0.smithi001.stdout:2/512: getdents d2/d14/d1a/d1b/d82/d83 0 2024-09-15T22:26:46.773 INFO:tasks.workunit.client.0.smithi001.stdout:2/513: dread d2/d14/d1a/d1b/d82/d97/f51 [0,4194304] 0 2024-09-15T22:26:46.773 INFO:tasks.workunit.client.0.smithi001.stdout:2/514: chown d2/d14/d1a/d1b/d82/d97/f51 195 1 2024-09-15T22:26:46.773 INFO:tasks.workunit.client.0.smithi001.stdout:2/515: chown d2/d14/d1a/f69 18443998 1 2024-09-15T22:26:46.774 INFO:tasks.workunit.client.0.smithi001.stdout:2/516: mknod d2/d12/cb1 0 2024-09-15T22:26:46.776 INFO:tasks.workunit.client.0.smithi001.stdout:2/517: creat d2/d14/d1a/d1b/d82/d97/da2/d6f/fb2 x:0 0 0 2024-09-15T22:26:46.776 INFO:tasks.workunit.client.0.smithi001.stdout:2/518: rmdir d2/d12/d62/d4c/d9d 39 2024-09-15T22:26:46.778 INFO:tasks.workunit.client.0.smithi001.stdout:0/453: dwrite d0/dd/d33/f73 [0,4194304] 0 2024-09-15T22:26:46.784 INFO:tasks.workunit.client.0.smithi001.stdout:1/578: dwrite d3/dd/d14/daa/fb2 [0,4194304] 0 2024-09-15T22:26:46.784 INFO:tasks.workunit.client.0.smithi001.stdout:1/579: dread - d3/dd/d14/d1b/d2b/d68/fb5 zero size 2024-09-15T22:26:46.784 INFO:tasks.workunit.client.0.smithi001.stdout:1/580: readlink d3/lb6 0 2024-09-15T22:26:46.786 INFO:tasks.workunit.client.0.smithi001.stdout:1/581: rmdir d3/d8d/d91 39 2024-09-15T22:26:46.786 INFO:tasks.workunit.client.0.smithi001.stdout:1/582: fdatasync d3/dd/d14/d1b/d2b/fb1 0 2024-09-15T22:26:46.786 INFO:tasks.workunit.client.0.smithi001.stdout:1/583: readlink d3/l94 0 2024-09-15T22:26:46.794 INFO:tasks.workunit.client.0.smithi001.stdout:3/520: dread da/d3b/f40 [0,4194304] 0 2024-09-15T22:26:46.794 INFO:tasks.workunit.client.0.smithi001.stdout:3/521: chown da/d3b/f25 100710 1 2024-09-15T22:26:46.797 INFO:tasks.workunit.client.0.smithi001.stdout:2/519: write d2/d12/d62/d64/fa5 [3633581,29927] 0 2024-09-15T22:26:46.797 INFO:tasks.workunit.client.0.smithi001.stdout:2/520: write d2/d14/d1a/d1b/d82/d97/da2/f3c [375962,60755] 0 2024-09-15T22:26:46.797 INFO:tasks.workunit.client.0.smithi001.stdout:2/521: write d2/d12/d62/d64/fa7 [349336,125356] 0 2024-09-15T22:26:46.798 INFO:tasks.workunit.client.0.smithi001.stdout:3/522: link da/d3d/d43/d41/d70/f84 da/d1f/fb0 0 2024-09-15T22:26:46.799 INFO:tasks.workunit.client.0.smithi001.stdout:3/523: readlink da/d3d/d43/l79 0 2024-09-15T22:26:46.799 INFO:tasks.workunit.client.0.smithi001.stdout:3/524: chown da/d3d/d43/d7c/d53/d72/f9f 19 1 2024-09-15T22:26:46.801 INFO:tasks.workunit.client.0.smithi001.stdout:3/525: unlink da/d3d/d43/c15 0 2024-09-15T22:26:46.803 INFO:tasks.workunit.client.0.smithi001.stdout:3/526: creat da/d90/fb1 x:0 0 0 2024-09-15T22:26:46.803 INFO:tasks.workunit.client.0.smithi001.stdout:3/527: fdatasync da/d3d/d43/d41/f54 0 2024-09-15T22:26:46.804 INFO:tasks.workunit.client.0.smithi001.stdout:3/528: symlink da/d16/lb2 0 2024-09-15T22:26:46.806 INFO:tasks.workunit.client.0.smithi001.stdout:5/544: dwrite d3/d27/d7a/fa8 [0,4194304] 0 2024-09-15T22:26:46.806 INFO:tasks.workunit.client.0.smithi001.stdout:5/545: readlink d3/d1d/l8b 0 2024-09-15T22:26:46.806 INFO:tasks.workunit.client.0.smithi001.stdout:5/546: dread - d3/d6/d25/f7f zero size 2024-09-15T22:26:46.809 INFO:tasks.workunit.client.0.smithi001.stdout:3/529: mkdir da/db3 0 2024-09-15T22:26:46.818 INFO:tasks.workunit.client.0.smithi001.stdout:9/457: dwrite d5/de/d1a/d1b/d22/d2c/d21/d4d/f4e [0,4194304] 0 2024-09-15T22:26:46.819 INFO:tasks.workunit.client.0.smithi001.stdout:5/547: mknod d3/d1d/d54/d56/d52/d61/cb3 0 2024-09-15T22:26:46.828 INFO:tasks.workunit.client.0.smithi001.stdout:9/458: dread d5/de/d1a/f8c [0,4194304] 0 2024-09-15T22:26:46.829 INFO:tasks.workunit.client.0.smithi001.stdout:9/459: mkdir d5/d8d 0 2024-09-15T22:26:46.829 INFO:tasks.workunit.client.0.smithi001.stdout:9/460: chown d5/de/d1a/d1b/d22/d2c/c45 14558 1 2024-09-15T22:26:46.831 INFO:tasks.workunit.client.0.smithi001.stdout:9/461: rmdir d5/de/d1a/d1b/d22/d2c/d21/d24/d86/d87 0 2024-09-15T22:26:46.831 INFO:tasks.workunit.client.0.smithi001.stdout:9/462: write d5/de/d1a/d1b/f70 [619004,3896] 0 2024-09-15T22:26:46.831 INFO:tasks.workunit.client.0.smithi001.stdout:9/463: chown d5/de/d1a/d1b/f89 330245579 1 2024-09-15T22:26:46.833 INFO:tasks.workunit.client.0.smithi001.stdout:9/464: creat d5/de/d1a/d1b/d22/d2c/d21/f8e x:0 0 0 2024-09-15T22:26:46.833 INFO:tasks.workunit.client.0.smithi001.stdout:9/465: fsync d5/de/d15/d27/d63/f79 0 2024-09-15T22:26:46.848 INFO:tasks.workunit.client.0.smithi001.stdout:9/466: dread d5/f59 [0,4194304] 0 2024-09-15T22:26:46.854 INFO:tasks.workunit.client.0.smithi001.stdout:7/538: dwrite d0/d8e/d3e/f4b [4194304,4194304] 0 2024-09-15T22:26:46.854 INFO:tasks.workunit.client.0.smithi001.stdout:2/522: dwrite d2/d12/d62/d64/f19 [0,4194304] 0 2024-09-15T22:26:46.854 INFO:tasks.workunit.client.0.smithi001.stdout:8/470: dwrite d9/d19/f77 [0,4194304] 0 2024-09-15T22:26:46.857 INFO:tasks.workunit.client.0.smithi001.stdout:2/523: rename d2/la1 to d2/d14/d1a/d80/lb3 0 2024-09-15T22:26:46.857 INFO:tasks.workunit.client.0.smithi001.stdout:0/454: dwrite d0/dd/d1b/f5e [4194304,4194304] 0 2024-09-15T22:26:46.857 INFO:tasks.workunit.client.0.smithi001.stdout:2/524: write d2/d14/f6e [541603,58556] 0 2024-09-15T22:26:46.857 INFO:tasks.workunit.client.0.smithi001.stdout:7/539: symlink d0/d7/d44/d94/lb2 0 2024-09-15T22:26:46.858 INFO:tasks.workunit.client.0.smithi001.stdout:2/525: mkdir d2/d12/d62/d64/d76/db4 0 2024-09-15T22:26:46.859 INFO:tasks.workunit.client.0.smithi001.stdout:8/471: symlink d9/d19/l8a 0 2024-09-15T22:26:46.859 INFO:tasks.workunit.client.0.smithi001.stdout:8/472: dread - d9/d19/d58/f7b zero size 2024-09-15T22:26:46.859 INFO:tasks.workunit.client.0.smithi001.stdout:8/473: readlink d9/d19/d29/l5a 0 2024-09-15T22:26:46.864 INFO:tasks.workunit.client.0.smithi001.stdout:7/540: mkdir d0/db3 0 2024-09-15T22:26:46.864 INFO:tasks.workunit.client.0.smithi001.stdout:0/455: creat d0/d6/d6a/f8d x:0 0 0 2024-09-15T22:26:46.865 INFO:tasks.workunit.client.0.smithi001.stdout:8/474: symlink d9/d19/d58/d88/l8b 0 2024-09-15T22:26:46.866 INFO:tasks.workunit.client.0.smithi001.stdout:7/541: rename d0/d6a/l6e to d0/d7/d44/d3f/lb4 0 2024-09-15T22:26:46.868 INFO:tasks.workunit.client.0.smithi001.stdout:8/475: mknod d9/c8c 0 2024-09-15T22:26:46.868 INFO:tasks.workunit.client.0.smithi001.stdout:8/476: read d9/f21 [3581844,65243] 0 2024-09-15T22:26:46.868 INFO:tasks.workunit.client.0.smithi001.stdout:8/477: chown l3 389 1 2024-09-15T22:26:46.868 INFO:tasks.workunit.client.0.smithi001.stdout:7/542: creat d0/d7/d44/d36/fb5 x:0 0 0 2024-09-15T22:26:46.868 INFO:tasks.workunit.client.0.smithi001.stdout:7/543: chown d0/d7/d44/d96 7611852 1 2024-09-15T22:26:46.869 INFO:tasks.workunit.client.0.smithi001.stdout:8/478: symlink d9/d19/d29/d33/d63/l8d 0 2024-09-15T22:26:46.871 INFO:tasks.workunit.client.0.smithi001.stdout:8/479: mkdir d9/d19/d58/d8e 0 2024-09-15T22:26:46.872 INFO:tasks.workunit.client.0.smithi001.stdout:8/480: creat d9/d19/d29/d35/f8f x:0 0 0 2024-09-15T22:26:46.873 INFO:tasks.workunit.client.0.smithi001.stdout:8/481: link d9/d19/c22 d9/d19/d34/c90 0 2024-09-15T22:26:46.874 INFO:tasks.workunit.client.0.smithi001.stdout:9/467: dread f4 [0,4194304] 0 2024-09-15T22:26:46.879 INFO:tasks.workunit.client.0.smithi001.stdout:1/584: dwrite d3/f99 [0,4194304] 0 2024-09-15T22:26:46.879 INFO:tasks.workunit.client.0.smithi001.stdout:1/585: truncate d3/dd/d69/f92 303273 0 2024-09-15T22:26:46.879 INFO:tasks.workunit.client.0.smithi001.stdout:1/586: write d3/dd/d3c/d64/fa6 [954022,30375] 0 2024-09-15T22:26:46.882 INFO:tasks.workunit.client.0.smithi001.stdout:3/530: write da/d3d/d43/d41/f80 [7692249,111736] 0 2024-09-15T22:26:46.883 INFO:tasks.workunit.client.0.smithi001.stdout:6/501: dwrite d0/f4 [0,4194304] 0 2024-09-15T22:26:46.890 INFO:tasks.workunit.client.0.smithi001.stdout:9/468: dread d5/f59 [0,4194304] 0 2024-09-15T22:26:46.891 INFO:tasks.workunit.client.0.smithi001.stdout:9/469: write d5/de/d1a/f8b [1156809,46009] 0 2024-09-15T22:26:46.891 INFO:tasks.workunit.client.0.smithi001.stdout:8/482: dread d9/fa [0,4194304] 0 2024-09-15T22:26:46.892 INFO:tasks.workunit.client.0.smithi001.stdout:6/502: rename d0/df/d97/da3 to d0/df/d24/db1 0 2024-09-15T22:26:46.893 INFO:tasks.workunit.client.0.smithi001.stdout:7/544: dread d0/d8e/d3e/f4b [4194304,4194304] 0 2024-09-15T22:26:46.898 INFO:tasks.workunit.client.0.smithi001.stdout:9/470: symlink d5/de/d51/d53/l8f 0 2024-09-15T22:26:46.899 INFO:tasks.workunit.client.0.smithi001.stdout:6/503: unlink d0/d6/d5d/d67/c39 0 2024-09-15T22:26:46.899 INFO:tasks.workunit.client.0.smithi001.stdout:8/483: rename d9/d19/d29/d50/l53 to d9/d19/d29/d50/d70/d76/l91 0 2024-09-15T22:26:46.899 INFO:tasks.workunit.client.0.smithi001.stdout:4/632: sync 2024-09-15T22:26:46.900 INFO:tasks.workunit.client.0.smithi001.stdout:4/633: creat d0/fea x:0 0 0 2024-09-15T22:26:46.900 INFO:tasks.workunit.client.0.smithi001.stdout:4/634: chown d0/d5d 3 1 2024-09-15T22:26:46.901 INFO:tasks.workunit.client.0.smithi001.stdout:4/635: rename d0/d27/d35/da4/faa to d0/d5d/d7c/dba/d20/feb 0 2024-09-15T22:26:46.901 INFO:tasks.workunit.client.0.smithi001.stdout:4/636: readlink d0/d27/d35/d59/d67/dab/le4 0 2024-09-15T22:26:46.903 INFO:tasks.workunit.client.0.smithi001.stdout:9/471: mkdir d5/d90 0 2024-09-15T22:26:46.903 INFO:tasks.workunit.client.0.smithi001.stdout:9/472: getdents d5/d8d 0 2024-09-15T22:26:46.903 INFO:tasks.workunit.client.0.smithi001.stdout:9/473: fdatasync d5/de/d1a/d1b/d22/d2c/d21/d24/f69 0 2024-09-15T22:26:46.903 INFO:tasks.workunit.client.0.smithi001.stdout:9/474: chown d5/de/d51/d53/l6b 15120 1 2024-09-15T22:26:46.903 INFO:tasks.workunit.client.0.smithi001.stdout:8/484: creat d9/d19/d29/d50/d89/f92 x:0 0 0 2024-09-15T22:26:46.904 INFO:tasks.workunit.client.0.smithi001.stdout:4/637: unlink d0/d27/d35/c80 0 2024-09-15T22:26:46.905 INFO:tasks.workunit.client.0.smithi001.stdout:4/638: getdents d0/d5d/d7c/dba/d20/d29/d34/db2 0 2024-09-15T22:26:46.908 INFO:tasks.workunit.client.0.smithi001.stdout:6/504: dread d0/d6/d5d/f9e [0,4194304] 0 2024-09-15T22:26:46.908 INFO:tasks.workunit.client.0.smithi001.stdout:6/505: chown d0/f19 52 1 2024-09-15T22:26:46.909 INFO:tasks.workunit.client.0.smithi001.stdout:6/506: mkdir d0/df/d24/d7b/db2 0 2024-09-15T22:26:46.909 INFO:tasks.workunit.client.0.smithi001.stdout:6/507: write d0/d6/f3e [4860524,55536] 0 2024-09-15T22:26:46.910 INFO:tasks.workunit.client.0.smithi001.stdout:6/508: link d0/d6/f76 d0/df/fb3 0 2024-09-15T22:26:46.911 INFO:tasks.workunit.client.0.smithi001.stdout:6/509: symlink d0/df/d24/d7b/db2/lb4 0 2024-09-15T22:26:46.913 INFO:tasks.workunit.client.0.smithi001.stdout:6/510: link d0/df/l1f d0/df/d24/d49/lb5 0 2024-09-15T22:26:46.913 INFO:tasks.workunit.client.0.smithi001.stdout:6/511: dread - d0/df/d24/d2e/d43/f73 zero size 2024-09-15T22:26:46.913 INFO:tasks.workunit.client.0.smithi001.stdout:6/512: truncate d0/d6/d5d/d67/f38 237338 0 2024-09-15T22:26:46.914 INFO:tasks.workunit.client.0.smithi001.stdout:9/475: dread d5/de/d1a/d1b/d22/d2c/f6a [0,4194304] 0 2024-09-15T22:26:46.915 INFO:tasks.workunit.client.0.smithi001.stdout:9/476: chown d5/de/d15/d27/d63/f73 0 1 2024-09-15T22:26:46.915 INFO:tasks.workunit.client.0.smithi001.stdout:9/477: fdatasync d5/de/d15/d27/d63/f7b 0 2024-09-15T22:26:46.915 INFO:tasks.workunit.client.0.smithi001.stdout:6/513: truncate d0/d6/d5d/d67/f2b 6581186 0 2024-09-15T22:26:46.916 INFO:tasks.workunit.client.0.smithi001.stdout:9/478: creat d5/de/d1a/d1b/d22/f91 x:0 0 0 2024-09-15T22:26:46.916 INFO:tasks.workunit.client.0.smithi001.stdout:9/479: fsync d5/de/d15/d27/d63/f79 0 2024-09-15T22:26:46.917 INFO:tasks.workunit.client.0.smithi001.stdout:9/480: rename d5/d3e/f83 to d5/de/d15/d27/d63/f92 0 2024-09-15T22:26:46.934 INFO:tasks.workunit.client.0.smithi001.stdout:3/531: dwrite da/d9e/fa4 [0,4194304] 0 2024-09-15T22:26:46.934 INFO:tasks.workunit.client.0.smithi001.stdout:4/639: dread d0/d5d/d7c/dba/f5b [0,4194304] 0 2024-09-15T22:26:46.934 INFO:tasks.workunit.client.0.smithi001.stdout:3/532: dread - da/dae/f83 zero size 2024-09-15T22:26:46.934 INFO:tasks.workunit.client.0.smithi001.stdout:3/533: fdatasync da/d1f/f22 0 2024-09-15T22:26:46.935 INFO:tasks.workunit.client.0.smithi001.stdout:9/481: dread d5/de/d15/d27/d63/f73 [0,4194304] 0 2024-09-15T22:26:46.935 INFO:tasks.workunit.client.0.smithi001.stdout:9/482: write d5/de/d1a/d1b/d22/d2c/d21/d24/f4c [1851716,95682] 0 2024-09-15T22:26:46.935 INFO:tasks.workunit.client.0.smithi001.stdout:9/483: dread - d5/de/d1a/d1b/d22/d2c/d21/f8e zero size 2024-09-15T22:26:46.935 INFO:tasks.workunit.client.0.smithi001.stdout:9/484: truncate d5/de/d1a/d1b/d22/d2c/f6a 2665307 0 2024-09-15T22:26:46.938 INFO:tasks.workunit.client.0.smithi001.stdout:3/534: creat da/d3b/d58/fb4 x:0 0 0 2024-09-15T22:26:46.952 INFO:tasks.workunit.client.0.smithi001.stdout:1/587: dwrite d3/dd/d3c/d4c/f4e [0,4194304] 0 2024-09-15T22:26:46.956 INFO:tasks.workunit.client.0.smithi001.stdout:4/640: read d0/fd [3952929,116446] 0 2024-09-15T22:26:46.964 INFO:tasks.workunit.client.0.smithi001.stdout:7/545: dwrite d0/f7a [0,4194304] 0 2024-09-15T22:26:46.967 INFO:tasks.workunit.client.0.smithi001.stdout:4/641: mkdir d0/d5d/d7c/de8/dec 0 2024-09-15T22:26:46.972 INFO:tasks.workunit.client.0.smithi001.stdout:4/642: symlink d0/d5d/d44/d65/led 0 2024-09-15T22:26:46.972 INFO:tasks.workunit.client.0.smithi001.stdout:5/548: sync 2024-09-15T22:26:46.974 INFO:tasks.workunit.client.0.smithi001.stdout:4/643: rename d0/d5d/d7c/dba/f66 to d0/d27/d35/d59/d67/fee 0 2024-09-15T22:26:46.974 INFO:tasks.workunit.client.0.smithi001.stdout:4/644: stat d0/d5d/d7c/dba/f5b 0 2024-09-15T22:26:46.974 INFO:tasks.workunit.client.0.smithi001.stdout:4/645: chown d0/d5d/d7c/dba/d20 2490 1 2024-09-15T22:26:46.974 INFO:tasks.workunit.client.0.smithi001.stdout:4/646: chown d0/d5d/d7c/dba/d20/d29/fa7 131354 1 2024-09-15T22:26:46.977 INFO:tasks.workunit.client.0.smithi001.stdout:5/549: truncate d3/d6/d41/d4d/f93 6742997 0 2024-09-15T22:26:46.979 INFO:tasks.workunit.client.0.smithi001.stdout:5/550: mknod d3/d1d/d54/d56/d8a/cb4 0 2024-09-15T22:26:46.980 INFO:tasks.workunit.client.0.smithi001.stdout:5/551: mknod d3/d1d/d54/d56/d52/d9f/cb5 0 2024-09-15T22:26:46.981 INFO:tasks.workunit.client.0.smithi001.stdout:5/552: link d3/d6/d57/f7c d3/d6/d57/d87/d8c/da2/fb6 0 2024-09-15T22:26:46.982 INFO:tasks.workunit.client.0.smithi001.stdout:5/553: chown d3/d6/d41/d4d/c50 15476026 1 2024-09-15T22:26:46.992 INFO:tasks.workunit.client.0.smithi001.stdout:4/647: dread d0/d5d/fb4 [0,4194304] 0 2024-09-15T22:26:46.996 INFO:tasks.workunit.client.0.smithi001.stdout:4/648: rename d0/d5d/d44/caf to d0/cef 0 2024-09-15T22:26:47.001 INFO:tasks.workunit.client.0.smithi001.stdout:1/588: dwrite d3/dd/f19 [8388608,4194304] 0 2024-09-15T22:26:47.001 INFO:tasks.workunit.client.0.smithi001.stdout:1/589: read - d3/dd/d14/d1b/d2b/fb1 zero size 2024-09-15T22:26:47.001 INFO:tasks.workunit.client.0.smithi001.stdout:1/590: write d3/f11 [3494651,34270] 0 2024-09-15T22:26:47.002 INFO:tasks.workunit.client.0.smithi001.stdout:3/535: dwrite da/d3d/d43/d7c/d3f/f63 [0,4194304] 0 2024-09-15T22:26:47.002 INFO:tasks.workunit.client.0.smithi001.stdout:3/536: write da/d3b/f32 [1068078,109555] 0 2024-09-15T22:26:47.002 INFO:tasks.workunit.client.0.smithi001.stdout:3/537: truncate da/d3b/d1b/f95 420628 0 2024-09-15T22:26:47.002 INFO:tasks.workunit.client.0.smithi001.stdout:1/591: getdents d3/dd/d3c/d64 0 2024-09-15T22:26:47.011 INFO:tasks.workunit.client.0.smithi001.stdout:9/485: dwrite d5/de/d1a/d1b/d22/d2c/d21/d4d/f5d [0,4194304] 0 2024-09-15T22:26:47.013 INFO:tasks.workunit.client.0.smithi001.stdout:9/486: creat d5/de/d1a/d1b/d22/d2c/d21/d24/d86/f93 x:0 0 0 2024-09-15T22:26:47.013 INFO:tasks.workunit.client.0.smithi001.stdout:9/487: chown d5/de/d1a/d1b/d22/d2c/d21/d23/c43 161 1 2024-09-15T22:26:47.014 INFO:tasks.workunit.client.0.smithi001.stdout:9/488: symlink d5/de/d15/l94 0 2024-09-15T22:26:47.017 INFO:tasks.workunit.client.0.smithi001.stdout:2/526: sync 2024-09-15T22:26:47.017 INFO:tasks.workunit.client.0.smithi001.stdout:4/649: dread d0/d5d/d7c/dd1/fad [0,4194304] 0 2024-09-15T22:26:47.019 INFO:tasks.workunit.client.0.smithi001.stdout:4/650: creat d0/d5d/d7c/dba/d20/ff0 x:0 0 0 2024-09-15T22:26:47.025 INFO:tasks.workunit.client.0.smithi001.stdout:4/651: dread d0/f11 [0,4194304] 0 2024-09-15T22:26:47.026 INFO:tasks.workunit.client.0.smithi001.stdout:4/652: mkdir d0/d27/d94/df1 0 2024-09-15T22:26:47.028 INFO:tasks.workunit.client.0.smithi001.stdout:4/653: creat d0/d5d/d44/d65/ff2 x:0 0 0 2024-09-15T22:26:47.029 INFO:tasks.workunit.client.0.smithi001.stdout:4/654: rename d0/d5d/d44/c68 to d0/d5d/d44/d65/d6a/cf3 0 2024-09-15T22:26:47.031 INFO:tasks.workunit.client.0.smithi001.stdout:4/655: rmdir d0/d5d/d44/d65/d6a 39 2024-09-15T22:26:47.031 INFO:tasks.workunit.client.0.smithi001.stdout:4/656: chown d0/d5d/d7c/dba/d20/d29/de0 309846 1 2024-09-15T22:26:47.031 INFO:tasks.workunit.client.0.smithi001.stdout:4/657: fdatasync d0/d27/d35/f9d 0 2024-09-15T22:26:47.031 INFO:tasks.workunit.client.0.smithi001.stdout:4/658: truncate d0/d27/d35/d59/fd5 449649 0 2024-09-15T22:26:47.031 INFO:tasks.workunit.client.0.smithi001.stdout:4/659: chown d0/d5d/d7c/dba/d20/d29/fa7 34660963 1 2024-09-15T22:26:47.031 INFO:tasks.workunit.client.0.smithi001.stdout:4/660: symlink d0/d27/d35/d59/d67/lf4 0 2024-09-15T22:26:47.033 INFO:tasks.workunit.client.0.smithi001.stdout:4/661: rmdir d0/d27/d35/d59/d67/dab 39 2024-09-15T22:26:47.033 INFO:tasks.workunit.client.0.smithi001.stdout:4/662: fsync d0/d27/d35/f58 0 2024-09-15T22:26:47.033 INFO:tasks.workunit.client.0.smithi001.stdout:4/663: write d0/d5d/d7c/dba/f22 [1715157,124317] 0 2024-09-15T22:26:47.044 INFO:tasks.workunit.client.0.smithi001.stdout:3/538: dwrite da/f31 [4194304,4194304] 0 2024-09-15T22:26:47.077 INFO:tasks.workunit.client.0.smithi001.stdout:4/664: dwrite d0/d5d/d7c/dba/d20/d29/d34/f41 [0,4194304] 0 2024-09-15T22:26:47.078 INFO:tasks.workunit.client.0.smithi001.stdout:4/665: truncate d0/d5d/d44/d65/d6a/f6d 156618 0 2024-09-15T22:26:47.078 INFO:tasks.workunit.client.0.smithi001.stdout:4/666: write d0/d5d/d44/d65/ff2 [545740,26722] 0 2024-09-15T22:26:47.079 INFO:tasks.workunit.client.0.smithi001.stdout:4/667: creat d0/d5d/d7c/dba/d20/d29/d34/dbc/dbf/ff5 x:0 0 0 2024-09-15T22:26:47.080 INFO:tasks.workunit.client.0.smithi001.stdout:4/668: mkdir d0/d5d/d7c/dba/d20/df6 0 2024-09-15T22:26:47.081 INFO:tasks.workunit.client.0.smithi001.stdout:4/669: mkdir d0/d5d/d44/df7 0 2024-09-15T22:26:47.085 INFO:tasks.workunit.client.0.smithi001.stdout:4/670: creat d0/d27/d94/ff8 x:0 0 0 2024-09-15T22:26:47.085 INFO:tasks.workunit.client.0.smithi001.stdout:4/671: write d0/d5d/f9b [1154349,16878] 0 2024-09-15T22:26:47.085 INFO:tasks.workunit.client.0.smithi001.stdout:4/672: truncate d0/d5d/d7c/dba/d20/f26 4708361 0 2024-09-15T22:26:47.089 INFO:tasks.workunit.client.0.smithi001.stdout:4/673: unlink d0/d5d/d7c/dba/d20/d29/d40/f85 0 2024-09-15T22:26:47.090 INFO:tasks.workunit.client.0.smithi001.stdout:4/674: mkdir d0/d27/d94/df9 0 2024-09-15T22:26:47.092 INFO:tasks.workunit.client.0.smithi001.stdout:4/675: getdents d0 0 2024-09-15T22:26:47.093 INFO:tasks.workunit.client.0.smithi001.stdout:4/676: creat d0/d27/d94/df1/ffa x:0 0 0 2024-09-15T22:26:47.105 INFO:tasks.workunit.client.0.smithi001.stdout:0/456: sync 2024-09-15T22:26:47.105 INFO:tasks.workunit.client.0.smithi001.stdout:8/485: sync 2024-09-15T22:26:47.105 INFO:tasks.workunit.client.0.smithi001.stdout:6/514: sync 2024-09-15T22:26:47.122 INFO:tasks.workunit.client.0.smithi001.stdout:6/515: dread d0/df/f4d [0,4194304] 0 2024-09-15T22:26:47.122 INFO:tasks.workunit.client.0.smithi001.stdout:6/516: read - d0/d6/f76 zero size 2024-09-15T22:26:47.125 INFO:tasks.workunit.client.0.smithi001.stdout:6/517: link d0/df/d24/f3a d0/df/d24/d2e/d43/fb6 0 2024-09-15T22:26:47.125 INFO:tasks.workunit.client.0.smithi001.stdout:6/518: write d0/df/d24/f34 [4304343,9140] 0 2024-09-15T22:26:47.127 INFO:tasks.workunit.client.0.smithi001.stdout:6/519: creat d0/d6/fb7 x:0 0 0 2024-09-15T22:26:47.127 INFO:tasks.workunit.client.0.smithi001.stdout:8/486: dread d9/d19/f3f [0,4194304] 0 2024-09-15T22:26:47.128 INFO:tasks.workunit.client.0.smithi001.stdout:6/520: link d0/df/d24/l52 d0/df/d24/d49/lb8 0 2024-09-15T22:26:47.128 INFO:tasks.workunit.client.0.smithi001.stdout:6/521: fsync d0/d6/d5d/f9e 0 2024-09-15T22:26:47.128 INFO:tasks.workunit.client.0.smithi001.stdout:8/487: symlink d9/d19/d29/l93 0 2024-09-15T22:26:47.129 INFO:tasks.workunit.client.0.smithi001.stdout:6/522: link d0/d6/d5d/da6/caa d0/d6/d5d/da6/cb9 0 2024-09-15T22:26:47.130 INFO:tasks.workunit.client.0.smithi001.stdout:4/677: dwrite d0/d5d/d44/d65/d6a/f6e [0,4194304] 0 2024-09-15T22:26:47.130 INFO:tasks.workunit.client.0.smithi001.stdout:8/488: creat d9/d19/d29/d50/f94 x:0 0 0 2024-09-15T22:26:47.130 INFO:tasks.workunit.client.0.smithi001.stdout:8/489: chown d9/fa 6 1 2024-09-15T22:26:47.130 INFO:tasks.workunit.client.0.smithi001.stdout:8/490: chown d9/d19/l26 361358080 1 2024-09-15T22:26:47.132 INFO:tasks.workunit.client.0.smithi001.stdout:4/678: creat d0/d27/ffb x:0 0 0 2024-09-15T22:26:47.133 INFO:tasks.workunit.client.0.smithi001.stdout:4/679: mknod d0/d27/d35/da4/de1/cfc 0 2024-09-15T22:26:47.134 INFO:tasks.workunit.client.0.smithi001.stdout:4/680: mknod d0/d5d/d7c/dba/d20/d29/de0/cfd 0 2024-09-15T22:26:47.136 INFO:tasks.workunit.client.0.smithi001.stdout:8/491: dread d9/d19/f2b [0,4194304] 0 2024-09-15T22:26:47.137 INFO:tasks.workunit.client.0.smithi001.stdout:8/492: creat d9/d19/d58/f95 x:0 0 0 2024-09-15T22:26:47.137 INFO:tasks.workunit.client.0.smithi001.stdout:4/681: unlink d0/d5d/d7c/dba/d20/d29/d34/fd9 0 2024-09-15T22:26:47.138 INFO:tasks.workunit.client.0.smithi001.stdout:8/493: write d9/d19/d58/f68 [785248,107821] 0 2024-09-15T22:26:47.164 INFO:tasks.workunit.client.0.smithi001.stdout:6/523: dwrite d0/d6/f4b [0,4194304] 0 2024-09-15T22:26:47.164 INFO:tasks.workunit.client.0.smithi001.stdout:6/524: getdents d0/df/d24/d2e/d43/d30/da7 0 2024-09-15T22:26:47.166 INFO:tasks.workunit.client.0.smithi001.stdout:6/525: creat d0/d7e/fba x:0 0 0 2024-09-15T22:26:47.167 INFO:tasks.workunit.client.0.smithi001.stdout:6/526: symlink d0/df/d24/d2e/d43/d30/lbb 0 2024-09-15T22:26:47.168 INFO:tasks.workunit.client.0.smithi001.stdout:6/527: rename d0/d6/d5d/c9c to d0/df/cbc 0 2024-09-15T22:26:47.168 INFO:tasks.workunit.client.0.smithi001.stdout:6/528: chown d0/d6/d5d/d67/d53 3502652 1 2024-09-15T22:26:47.180 INFO:tasks.workunit.client.0.smithi001.stdout:1/592: sync 2024-09-15T22:26:47.181 INFO:tasks.workunit.client.0.smithi001.stdout:9/489: sync 2024-09-15T22:26:47.181 INFO:tasks.workunit.client.0.smithi001.stdout:5/554: sync 2024-09-15T22:26:47.181 INFO:tasks.workunit.client.0.smithi001.stdout:7/546: sync 2024-09-15T22:26:47.181 INFO:tasks.workunit.client.0.smithi001.stdout:3/539: sync 2024-09-15T22:26:47.181 INFO:tasks.workunit.client.0.smithi001.stdout:2/527: sync 2024-09-15T22:26:47.181 INFO:tasks.workunit.client.0.smithi001.stdout:1/593: write d3/dd/d86/f87 [255417,102764] 0 2024-09-15T22:26:47.181 INFO:tasks.workunit.client.0.smithi001.stdout:2/528: read - d2/d14/d1a/d8a/fa8 zero size 2024-09-15T22:26:47.182 INFO:tasks.workunit.client.0.smithi001.stdout:5/555: rmdir d3/d27/d4e/d89 39 2024-09-15T22:26:47.182 INFO:tasks.workunit.client.0.smithi001.stdout:7/547: symlink d0/db3/lb6 0 2024-09-15T22:26:47.182 INFO:tasks.workunit.client.0.smithi001.stdout:1/594: mknod d3/d8d/dae/cba 0 2024-09-15T22:26:47.182 INFO:tasks.workunit.client.0.smithi001.stdout:2/529: truncate d2/d12/d62/d64/fa5 2655627 0 2024-09-15T22:26:47.183 INFO:tasks.workunit.client.0.smithi001.stdout:3/540: rmdir da/d90/d6f/da6 0 2024-09-15T22:26:47.183 INFO:tasks.workunit.client.0.smithi001.stdout:7/548: rmdir d0/d7/d21/d6b 39 2024-09-15T22:26:47.185 INFO:tasks.workunit.client.0.smithi001.stdout:3/541: rename da/d3d/d43/d7c/d53/d73/da8 to da/d3d/d43/d7c/d3f/db5 0 2024-09-15T22:26:47.185 INFO:tasks.workunit.client.0.smithi001.stdout:1/595: creat d3/dd/d3c/d64/fbb x:0 0 0 2024-09-15T22:26:47.185 INFO:tasks.workunit.client.0.smithi001.stdout:1/596: chown d3/dd/d14/d1b/f6c 6280766 1 2024-09-15T22:26:47.186 INFO:tasks.workunit.client.0.smithi001.stdout:7/549: mknod d0/d98/cb7 0 2024-09-15T22:26:47.186 INFO:tasks.workunit.client.0.smithi001.stdout:5/556: mknod d3/d6/cb7 0 2024-09-15T22:26:47.186 INFO:tasks.workunit.client.0.smithi001.stdout:5/557: chown d3/d6/lb 3836 1 2024-09-15T22:26:47.186 INFO:tasks.workunit.client.0.smithi001.stdout:5/558: chown d3/d1d/d54/d56/d52/c74 594 1 2024-09-15T22:26:47.186 INFO:tasks.workunit.client.0.smithi001.stdout:5/559: stat d3/d6/d57/d87/d8c/f97 0 2024-09-15T22:26:47.187 INFO:tasks.workunit.client.0.smithi001.stdout:3/542: creat da/d90/fb6 x:0 0 0 2024-09-15T22:26:47.187 INFO:tasks.workunit.client.0.smithi001.stdout:3/543: dread - da/d90/d92/fad zero size 2024-09-15T22:26:47.187 INFO:tasks.workunit.client.0.smithi001.stdout:5/560: rmdir d3/d27/d7a 39 2024-09-15T22:26:47.190 INFO:tasks.workunit.client.0.smithi001.stdout:3/544: creat da/d16/fb7 x:0 0 0 2024-09-15T22:26:47.191 INFO:tasks.workunit.client.0.smithi001.stdout:9/490: dread d5/de/d1a/f8b [0,4194304] 0 2024-09-15T22:26:47.192 INFO:tasks.workunit.client.0.smithi001.stdout:9/491: symlink d5/de/d1a/d1b/d22/l95 0 2024-09-15T22:26:47.193 INFO:tasks.workunit.client.0.smithi001.stdout:9/492: symlink d5/de/d1a/d1b/d22/d2c/l96 0 2024-09-15T22:26:47.193 INFO:tasks.workunit.client.0.smithi001.stdout:9/493: read - d5/de/d15/d27/f7c zero size 2024-09-15T22:26:47.204 INFO:tasks.workunit.client.0.smithi001.stdout:5/561: write d3/d6/d57/f7c [315860,126853] 0 2024-09-15T22:26:47.204 INFO:tasks.workunit.client.0.smithi001.stdout:5/562: chown d3/d6/d41/d88/db0 49 1 2024-09-15T22:26:47.207 INFO:tasks.workunit.client.0.smithi001.stdout:3/545: dread da/d3b/d1b/f60 [0,4194304] 0 2024-09-15T22:26:47.207 INFO:tasks.workunit.client.0.smithi001.stdout:3/546: dread - da/d3d/d43/d41/d70/f84 zero size 2024-09-15T22:26:47.207 INFO:tasks.workunit.client.0.smithi001.stdout:2/530: dread d2/d12/d62/d64/f4a [0,4194304] 0 2024-09-15T22:26:47.208 INFO:tasks.workunit.client.0.smithi001.stdout:2/531: creat d2/d14/d1a/d1b/d82/d97/d74/fb5 x:0 0 0 2024-09-15T22:26:47.228 INFO:tasks.workunit.client.0.smithi001.stdout:3/547: write da/f1c [2026596,107804] 0 2024-09-15T22:26:47.228 INFO:tasks.workunit.client.0.smithi001.stdout:3/548: read - da/d3d/d43/d7c/f5f zero size 2024-09-15T22:26:47.229 INFO:tasks.workunit.client.0.smithi001.stdout:3/549: truncate da/d3b/f32 9379809 0 2024-09-15T22:26:47.231 INFO:tasks.workunit.client.0.smithi001.stdout:5/563: dread d3/d1d/d54/d56/f4b [0,4194304] 0 2024-09-15T22:26:47.231 INFO:tasks.workunit.client.0.smithi001.stdout:5/564: chown d3/d1d/d54/d56/d52 3 1 2024-09-15T22:26:47.232 INFO:tasks.workunit.client.0.smithi001.stdout:5/565: mkdir d3/d1d/d54/d56/d52/db8 0 2024-09-15T22:26:47.234 INFO:tasks.workunit.client.0.smithi001.stdout:6/529: dwrite d0/d6/fd [0,4194304] 0 2024-09-15T22:26:47.236 INFO:tasks.workunit.client.0.smithi001.stdout:6/530: truncate d0/f22 969394 0 2024-09-15T22:26:47.236 INFO:tasks.workunit.client.0.smithi001.stdout:5/566: creat d3/d6/d41/fb9 x:0 0 0 2024-09-15T22:26:47.236 INFO:tasks.workunit.client.0.smithi001.stdout:5/567: chown d3/d1d/d54/d56/d52/d61 170 1 2024-09-15T22:26:47.236 INFO:tasks.workunit.client.0.smithi001.stdout:5/568: write d3/d6/d57/f8f [212506,11730] 0 2024-09-15T22:26:47.236 INFO:tasks.workunit.client.0.smithi001.stdout:5/569: readlink d3/d6/lb 0 2024-09-15T22:26:47.237 INFO:tasks.workunit.client.0.smithi001.stdout:6/531: unlink d0/df/d24/d2e/d43/d30/f64 0 2024-09-15T22:26:47.239 INFO:tasks.workunit.client.0.smithi001.stdout:6/532: link d0/df/d24/d2e/d43/fb0 d0/df/d24/d2e/fbd 0 2024-09-15T22:26:47.239 INFO:tasks.workunit.client.0.smithi001.stdout:5/570: rename d3/d1d/d54/d56/d52/d9f/cb5 to d3/d1d/d54/d56/d52/cba 0 2024-09-15T22:26:47.240 INFO:tasks.workunit.client.0.smithi001.stdout:3/550: dread da/d16/f4b [0,4194304] 0 2024-09-15T22:26:47.240 INFO:tasks.workunit.client.0.smithi001.stdout:7/550: dwrite d0/d7/d44/f87 [0,4194304] 0 2024-09-15T22:26:47.241 INFO:tasks.workunit.client.0.smithi001.stdout:5/571: rename d3/d27/f39 to d3/d6/d41/d4d/d91/fbb 0 2024-09-15T22:26:47.245 INFO:tasks.workunit.client.0.smithi001.stdout:7/551: link d0/d7/d44/d3f/d49/c7b d0/d7/d2e/d60/cb8 0 2024-09-15T22:26:47.245 INFO:tasks.workunit.client.0.smithi001.stdout:6/533: rename d0/df/d24/f3a to d0/df/d24/d2e/fbe 0 2024-09-15T22:26:47.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:46 smithi012 ceph-mon[34883]: pgmap v413: 97 pgs: 97 active+clean; 878 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 110 MiB/s rd, 138 MiB/s wr, 1.76k op/s 2024-09-15T22:26:47.246 INFO:tasks.workunit.client.0.smithi001.stdout:6/534: creat d0/df/fbf x:0 0 0 2024-09-15T22:26:47.253 INFO:tasks.workunit.client.0.smithi001.stdout:5/572: dread d3/d6/d41/d4d/f73 [4194304,4194304] 0 2024-09-15T22:26:47.256 INFO:tasks.workunit.client.0.smithi001.stdout:5/573: mknod d3/d1d/cbc 0 2024-09-15T22:26:47.256 INFO:tasks.workunit.client.0.smithi001.stdout:3/551: dread da/d16/ff [4194304,4194304] 0 2024-09-15T22:26:47.256 INFO:tasks.workunit.client.0.smithi001.stdout:9/494: dwrite d5/de/d15/d27/d63/f7b [0,4194304] 0 2024-09-15T22:26:47.262 INFO:tasks.workunit.client.0.smithi001.stdout:3/552: symlink da/d9e/lb8 0 2024-09-15T22:26:47.265 INFO:tasks.workunit.client.0.smithi001.stdout:7/552: dread d0/f2a [0,4194304] 0 2024-09-15T22:26:47.267 INFO:tasks.workunit.client.0.smithi001.stdout:3/553: chown da/c6e 383936 1 2024-09-15T22:26:47.270 INFO:tasks.workunit.client.0.smithi001.stdout:7/553: rename d0/db3/lb6 to d0/d7/d7c/lb9 0 2024-09-15T22:26:47.271 INFO:tasks.workunit.client.0.smithi001.stdout:7/554: dread - d0/d7/d44/d3f/d49/fab zero size 2024-09-15T22:26:47.272 INFO:tasks.workunit.client.0.smithi001.stdout:9/495: dread d5/f11 [0,4194304] 0 2024-09-15T22:26:47.272 INFO:tasks.workunit.client.0.smithi001.stdout:9/496: write d5/de/d1a/d1b/d22/d2c/f17 [84796,96538] 0 2024-09-15T22:26:47.272 INFO:tasks.workunit.client.0.smithi001.stdout:9/497: dread - d5/de/d1a/d1b/d2a/f78 zero size 2024-09-15T22:26:47.274 INFO:tasks.workunit.client.0.smithi001.stdout:3/554: truncate da/d9e/fa4 3854367 0 2024-09-15T22:26:47.274 INFO:tasks.workunit.client.0.smithi001.stdout:3/555: fdatasync da/d3d/d43/d41/fa7 0 2024-09-15T22:26:47.276 INFO:tasks.workunit.client.0.smithi001.stdout:4/682: sync 2024-09-15T22:26:47.276 INFO:tasks.workunit.client.0.smithi001.stdout:0/457: sync 2024-09-15T22:26:47.276 INFO:tasks.workunit.client.0.smithi001.stdout:8/494: sync 2024-09-15T22:26:47.276 INFO:tasks.workunit.client.0.smithi001.stdout:8/495: chown d9/d19/d29/d50/d70/d76/l81 175161 1 2024-09-15T22:26:47.276 INFO:tasks.workunit.client.0.smithi001.stdout:8/496: write d9/d19/d58/f4e [294448,12647] 0 2024-09-15T22:26:47.277 INFO:tasks.workunit.client.0.smithi001.stdout:7/555: creat d0/d7/d21/d6b/fba x:0 0 0 2024-09-15T22:26:47.277 INFO:tasks.workunit.client.0.smithi001.stdout:7/556: truncate d0/d7/d44/f78 1375918 0 2024-09-15T22:26:47.277 INFO:tasks.workunit.client.0.smithi001.stdout:4/683: link d0/d5d/d7c/dba/d20/d29/f92 d0/d5d/d7c/dba/d20/df6/ffe 0 2024-09-15T22:26:47.278 INFO:tasks.workunit.client.0.smithi001.stdout:4/684: mknod d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d73/dc0/cff 0 2024-09-15T22:26:47.278 INFO:tasks.workunit.client.0.smithi001.stdout:4/685: fsync d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d73/f81 0 2024-09-15T22:26:47.279 INFO:tasks.workunit.client.0.smithi001.stdout:3/556: mkdir da/d3d/db9 0 2024-09-15T22:26:47.279 INFO:tasks.workunit.client.0.smithi001.stdout:3/557: readlink da/d3d/d43/d7c/d53/d73/l99 0 2024-09-15T22:26:47.280 INFO:tasks.workunit.client.0.smithi001.stdout:7/557: creat d0/d6a/fbb x:0 0 0 2024-09-15T22:26:47.280 INFO:tasks.workunit.client.0.smithi001.stdout:7/558: dread - d0/d7/d21/f9b zero size 2024-09-15T22:26:47.280 INFO:tasks.workunit.client.0.smithi001.stdout:9/498: dread d5/de/d1a/d1b/f70 [0,4194304] 0 2024-09-15T22:26:47.281 INFO:tasks.workunit.client.0.smithi001.stdout:3/558: creat da/d16/fba x:0 0 0 2024-09-15T22:26:47.282 INFO:tasks.workunit.client.0.smithi001.stdout:7/559: unlink d0/d8e/d3e/f4b 0 2024-09-15T22:26:47.282 INFO:tasks.workunit.client.0.smithi001.stdout:7/560: fsync d0/d8e/d3e/f51 0 2024-09-15T22:26:47.283 INFO:tasks.workunit.client.0.smithi001.stdout:9/499: mkdir d5/de/d1a/d1b/d22/d97 0 2024-09-15T22:26:47.290 INFO:tasks.workunit.client.0.smithi001.stdout:3/559: mknod da/cbb 0 2024-09-15T22:26:47.290 INFO:tasks.workunit.client.0.smithi001.stdout:8/497: read d9/f27 [685763,15477] 0 2024-09-15T22:26:47.290 INFO:tasks.workunit.client.0.smithi001.stdout:2/532: dwrite d2/d12/f65 [0,4194304] 0 2024-09-15T22:26:47.290 INFO:tasks.workunit.client.0.smithi001.stdout:8/498: unlink d9/d19/d40/d5f/f84 0 2024-09-15T22:26:47.291 INFO:tasks.workunit.client.0.smithi001.stdout:8/499: write d9/d19/f3d [621665,111205] 0 2024-09-15T22:26:47.292 INFO:tasks.workunit.client.0.smithi001.stdout:8/500: rename d9/f21 to d9/d19/f96 0 2024-09-15T22:26:47.296 INFO:tasks.workunit.client.0.smithi001.stdout:8/501: read d9/d19/d58/f54 [406625,1042] 0 2024-09-15T22:26:47.296 INFO:tasks.workunit.client.0.smithi001.stdout:5/574: dwrite d3/d1d/d54/d56/f55 [0,4194304] 0 2024-09-15T22:26:47.297 INFO:tasks.workunit.client.0.smithi001.stdout:7/561: dread d0/d7/d2e/f34 [0,4194304] 0 2024-09-15T22:26:47.297 INFO:tasks.workunit.client.0.smithi001.stdout:6/535: dwrite d0/df/d24/d2e/d43/f93 [0,4194304] 0 2024-09-15T22:26:47.298 INFO:tasks.workunit.client.0.smithi001.stdout:8/502: mknod d9/d19/d29/d50/d70/d76/d7d/c97 0 2024-09-15T22:26:47.300 INFO:tasks.workunit.client.0.smithi001.stdout:6/536: rename d0/df/d24/d7b/l7c to d0/df/d97/lc0 0 2024-09-15T22:26:47.300 INFO:tasks.workunit.client.0.smithi001.stdout:5/575: mkdir d3/d1d/d54/d56/d8a/dbd 0 2024-09-15T22:26:47.301 INFO:tasks.workunit.client.0.smithi001.stdout:8/503: mknod d9/d19/d29/d50/d70/d76/d7d/c98 0 2024-09-15T22:26:47.301 INFO:tasks.workunit.client.0.smithi001.stdout:8/504: write d9/d19/d29/d50/f73 [873459,43919] 0 2024-09-15T22:26:47.305 INFO:tasks.workunit.client.0.smithi001.stdout:6/537: symlink d0/df/d24/d7b/db2/lc1 0 2024-09-15T22:26:47.305 INFO:tasks.workunit.client.0.smithi001.stdout:6/538: chown d0/d7e/fba 62 1 2024-09-15T22:26:47.305 INFO:tasks.workunit.client.0.smithi001.stdout:6/539: write d0/df/fbf [651689,82127] 0 2024-09-15T22:26:47.305 INFO:tasks.workunit.client.0.smithi001.stdout:5/576: unlink d3/c34 0 2024-09-15T22:26:47.305 INFO:tasks.workunit.client.0.smithi001.stdout:5/577: read d3/d6/d25/f38 [1994419,86324] 0 2024-09-15T22:26:47.306 INFO:tasks.workunit.client.0.smithi001.stdout:6/540: unlink d0/df/f4d 0 2024-09-15T22:26:47.306 INFO:tasks.workunit.client.0.smithi001.stdout:6/541: dread - d0/df/f89 zero size 2024-09-15T22:26:47.306 INFO:tasks.workunit.client.0.smithi001.stdout:6/542: truncate d0/df/d24/d49/f6a 174173 0 2024-09-15T22:26:47.306 INFO:tasks.workunit.client.0.smithi001.stdout:5/578: unlink d3/d6/d41/d4d/c50 0 2024-09-15T22:26:47.307 INFO:tasks.workunit.client.0.smithi001.stdout:6/543: mkdir d0/df/d24/d2e/d43/d30/dc2 0 2024-09-15T22:26:47.307 INFO:tasks.workunit.client.0.smithi001.stdout:6/544: chown d0/d6/fd 1802968 1 2024-09-15T22:26:47.307 INFO:tasks.workunit.client.0.smithi001.stdout:6/545: chown d0/d6/d5d/d67/f44 14460 1 2024-09-15T22:26:47.308 INFO:tasks.workunit.client.0.smithi001.stdout:6/546: mkdir d0/d6/d5d/d67/d53/da0/dc3 0 2024-09-15T22:26:47.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:46 smithi098 ceph-mon[35514]: pgmap v413: 97 pgs: 97 active+clean; 878 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 110 MiB/s rd, 138 MiB/s wr, 1.76k op/s 2024-09-15T22:26:47.313 INFO:tasks.workunit.client.0.smithi001.stdout:8/505: dread d9/f3a [0,4194304] 0 2024-09-15T22:26:47.314 INFO:tasks.workunit.client.0.smithi001.stdout:8/506: chown l6 1030629 1 2024-09-15T22:26:47.314 INFO:tasks.workunit.client.0.smithi001.stdout:8/507: stat d9/d19/f3c 0 2024-09-15T22:26:47.320 INFO:tasks.workunit.client.0.smithi001.stdout:6/547: mkdir d0/d6/d5d/d67/dc4 0 2024-09-15T22:26:47.324 INFO:tasks.workunit.client.0.smithi001.stdout:4/686: dwrite d0/d5d/d7c/dba/d20/f25 [4194304,4194304] 0 2024-09-15T22:26:47.325 INFO:tasks.workunit.client.0.smithi001.stdout:6/548: creat d0/df/d24/d49/fc5 x:0 0 0 2024-09-15T22:26:47.325 INFO:tasks.workunit.client.0.smithi001.stdout:4/687: write d0/d5d/d7c/dba/d20/d29/fb1 [646807,63608] 0 2024-09-15T22:26:47.326 INFO:tasks.workunit.client.0.smithi001.stdout:6/549: mknod d0/df/d24/d7b/db2/cc6 0 2024-09-15T22:26:47.326 INFO:tasks.workunit.client.0.smithi001.stdout:8/508: unlink d9/d19/d29/l5a 0 2024-09-15T22:26:47.328 INFO:tasks.workunit.client.0.smithi001.stdout:4/688: creat d0/d27/d94/df9/f100 x:0 0 0 2024-09-15T22:26:47.328 INFO:tasks.workunit.client.0.smithi001.stdout:6/550: mkdir d0/df/d24/d49/dc7 0 2024-09-15T22:26:47.328 INFO:tasks.workunit.client.0.smithi001.stdout:8/509: mkdir d9/d19/d34/d41/d99 0 2024-09-15T22:26:47.329 INFO:tasks.workunit.client.0.smithi001.stdout:6/551: unlink d0/df/d24/f58 0 2024-09-15T22:26:47.330 INFO:tasks.workunit.client.0.smithi001.stdout:8/510: rename d9/d19/c22 to d9/d19/d29/d50/d70/d76/d7d/c9a 0 2024-09-15T22:26:47.335 INFO:tasks.workunit.client.0.smithi001.stdout:2/533: write d2/f9 [1624241,19328] 0 2024-09-15T22:26:47.335 INFO:tasks.workunit.client.0.smithi001.stdout:6/552: unlink d0/df/l25 0 2024-09-15T22:26:47.335 INFO:tasks.workunit.client.0.smithi001.stdout:2/534: write d2/d12/d62/d64/f60 [4512579,109937] 0 2024-09-15T22:26:47.336 INFO:tasks.workunit.client.0.smithi001.stdout:2/535: dread - d2/d14/d1a/d1b/d82/d97/da2/f95 zero size 2024-09-15T22:26:47.336 INFO:tasks.workunit.client.0.smithi001.stdout:2/536: write d2/d14/d1a/d1b/d82/d97/da2/f4b [802771,72775] 0 2024-09-15T22:26:47.336 INFO:tasks.workunit.client.0.smithi001.stdout:0/458: dwrite d0/f2 [0,4194304] 0 2024-09-15T22:26:47.338 INFO:tasks.workunit.client.0.smithi001.stdout:2/537: write d2/d12/d62/f40 [4319551,22621] 0 2024-09-15T22:26:47.343 INFO:tasks.workunit.client.0.smithi001.stdout:1/597: sync 2024-09-15T22:26:47.344 INFO:tasks.workunit.client.0.smithi001.stdout:1/598: mknod d3/dd/d14/d23/da1/da2/cbc 0 2024-09-15T22:26:47.359 INFO:tasks.workunit.client.0.smithi001.stdout:6/553: dread d0/d6/d5d/d67/f4e [0,4194304] 0 2024-09-15T22:26:47.368 INFO:tasks.workunit.client.0.smithi001.stdout:3/560: dwrite da/d16/f52 [4194304,4194304] 0 2024-09-15T22:26:47.368 INFO:tasks.workunit.client.0.smithi001.stdout:1/599: dread d3/f7 [0,4194304] 0 2024-09-15T22:26:47.375 INFO:tasks.workunit.client.0.smithi001.stdout:2/538: write d2/f2b [283370,86188] 0 2024-09-15T22:26:47.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:46 smithi001 ceph-mon[30843]: pgmap v413: 97 pgs: 97 active+clean; 878 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 110 MiB/s rd, 138 MiB/s wr, 1.76k op/s 2024-09-15T22:26:47.377 INFO:tasks.workunit.client.0.smithi001.stdout:2/539: link d2/d14/d1a/d1b/c42 d2/d14/d1a/cb6 0 2024-09-15T22:26:47.378 INFO:tasks.workunit.client.0.smithi001.stdout:2/540: mknod d2/d14/d1a/cb7 0 2024-09-15T22:26:47.380 INFO:tasks.workunit.client.0.smithi001.stdout:4/689: dwrite d0/d5d/d7c/dba/d20/ff0 [0,4194304] 0 2024-09-15T22:26:47.380 INFO:tasks.workunit.client.0.smithi001.stdout:4/690: chown d0/d5d/d7c/dba/d20/d29/d34/dbc/dbf/ff5 54 1 2024-09-15T22:26:47.405 INFO:tasks.workunit.client.0.smithi001.stdout:7/562: dwrite d0/d8e/d3e/f67 [0,4194304] 0 2024-09-15T22:26:47.406 INFO:tasks.workunit.client.0.smithi001.stdout:4/691: write d0/d5d/d7c/dba/d20/fc3 [1691049,41713] 0 2024-09-15T22:26:47.406 INFO:tasks.workunit.client.0.smithi001.stdout:8/511: dwrite d9/d19/d34/f43 [0,4194304] 0 2024-09-15T22:26:47.407 INFO:tasks.workunit.client.0.smithi001.stdout:7/563: truncate d0/d8e/d3e/f51 3396665 0 2024-09-15T22:26:47.409 INFO:tasks.workunit.client.0.smithi001.stdout:4/692: symlink d0/d5d/d44/l101 0 2024-09-15T22:26:47.413 INFO:tasks.workunit.client.0.smithi001.stdout:4/693: unlink d0/d5d/d44/d65/d6a/lcc 0 2024-09-15T22:26:47.413 INFO:tasks.workunit.client.0.smithi001.stdout:4/694: write d0/d5d/f9b [2102433,66038] 0 2024-09-15T22:26:47.425 INFO:tasks.workunit.client.0.smithi001.stdout:2/541: read d2/f43 [327891,48200] 0 2024-09-15T22:26:47.427 INFO:tasks.workunit.client.0.smithi001.stdout:2/542: creat d2/d14/d1a/d1b/d82/fb8 x:0 0 0 2024-09-15T22:26:47.431 INFO:tasks.workunit.client.0.smithi001.stdout:2/543: mkdir d2/d12/d62/db9 0 2024-09-15T22:26:47.433 INFO:tasks.workunit.client.0.smithi001.stdout:8/512: dread d9/fb [0,4194304] 0 2024-09-15T22:26:47.434 INFO:tasks.workunit.client.0.smithi001.stdout:3/561: dwrite da/d3b/f25 [4194304,4194304] 0 2024-09-15T22:26:47.435 INFO:tasks.workunit.client.0.smithi001.stdout:8/513: read d9/fd [1986160,90471] 0 2024-09-15T22:26:47.436 INFO:tasks.workunit.client.0.smithi001.stdout:3/562: link da/d3d/d43/d41/d70/d7f/f8c da/d3b/d8b/fbc 0 2024-09-15T22:26:47.437 INFO:tasks.workunit.client.0.smithi001.stdout:8/514: creat d9/d19/d58/d88/f9b x:0 0 0 2024-09-15T22:26:47.437 INFO:tasks.workunit.client.0.smithi001.stdout:3/563: link da/d3d/d43/l79 da/d3d/d43/d7c/d53/lbd 0 2024-09-15T22:26:47.439 INFO:tasks.workunit.client.0.smithi001.stdout:2/544: write d2/d14/d1a/d1b/d82/d97/f23 [96875,91140] 0 2024-09-15T22:26:47.440 INFO:tasks.workunit.client.0.smithi001.stdout:8/515: mkdir d9/d19/d58/d8e/d9c 0 2024-09-15T22:26:47.441 INFO:tasks.workunit.client.0.smithi001.stdout:3/564: mkdir da/d3b/d8b/dbe 0 2024-09-15T22:26:47.441 INFO:tasks.workunit.client.0.smithi001.stdout:3/565: read - da/d3b/d58/faf zero size 2024-09-15T22:26:47.441 INFO:tasks.workunit.client.0.smithi001.stdout:3/566: fsync f8 0 2024-09-15T22:26:47.442 INFO:tasks.workunit.client.0.smithi001.stdout:2/545: mknod d2/d14/cba 0 2024-09-15T22:26:47.443 INFO:tasks.workunit.client.0.smithi001.stdout:2/546: symlink d2/d14/d1a/lbb 0 2024-09-15T22:26:47.448 INFO:tasks.workunit.client.0.smithi001.stdout:8/516: dread d9/f27 [0,4194304] 0 2024-09-15T22:26:47.449 INFO:tasks.workunit.client.0.smithi001.stdout:8/517: getdents d9/d19/d29/d50/d70/d76/d7d 0 2024-09-15T22:26:47.449 INFO:tasks.workunit.client.0.smithi001.stdout:8/518: stat d9/c8c 0 2024-09-15T22:26:47.458 INFO:tasks.workunit.client.0.smithi001.stdout:7/564: dwrite d0/d7/d44/d3f/f75 [0,4194304] 0 2024-09-15T22:26:47.460 INFO:tasks.workunit.client.0.smithi001.stdout:8/519: rename d9/d19/d40/f4f to d9/d19/d58/d8e/f9d 0 2024-09-15T22:26:47.461 INFO:tasks.workunit.client.0.smithi001.stdout:8/520: write d9/d19/d58/f68 [1839765,130858] 0 2024-09-15T22:26:47.462 INFO:tasks.workunit.client.0.smithi001.stdout:5/579: dwrite d3/f16 [0,4194304] 0 2024-09-15T22:26:47.462 INFO:tasks.workunit.client.0.smithi001.stdout:7/565: mknod d0/d7/d21/d6b/cbc 0 2024-09-15T22:26:47.462 INFO:tasks.workunit.client.0.smithi001.stdout:5/580: stat d3/d6/d57/d87 0 2024-09-15T22:26:47.462 INFO:tasks.workunit.client.0.smithi001.stdout:5/581: chown d3/d6/d41/f82 249 1 2024-09-15T22:26:47.463 INFO:tasks.workunit.client.0.smithi001.stdout:7/566: mkdir d0/d7/d2e/d60/dbd 0 2024-09-15T22:26:47.480 INFO:tasks.workunit.client.0.smithi001.stdout:5/582: dread d3/d1d/d54/d56/f4b [0,4194304] 0 2024-09-15T22:26:47.482 INFO:tasks.workunit.client.0.smithi001.stdout:3/567: dwrite da/d3d/d43/d7c/d3f/f87 [0,4194304] 0 2024-09-15T22:26:47.484 INFO:tasks.workunit.client.0.smithi001.stdout:3/568: unlink da/d3b/f33 0 2024-09-15T22:26:47.486 INFO:tasks.workunit.client.0.smithi001.stdout:7/567: dread d0/d7/fa4 [0,4194304] 0 2024-09-15T22:26:47.486 INFO:tasks.workunit.client.0.smithi001.stdout:3/569: creat da/d90/fbf x:0 0 0 2024-09-15T22:26:47.489 INFO:tasks.workunit.client.0.smithi001.stdout:3/570: symlink da/lc0 0 2024-09-15T22:26:47.490 INFO:tasks.workunit.client.0.smithi001.stdout:3/571: rmdir da/d90 39 2024-09-15T22:26:47.491 INFO:tasks.workunit.client.0.smithi001.stdout:3/572: symlink da/d1f/lc1 0 2024-09-15T22:26:47.493 INFO:tasks.workunit.client.0.smithi001.stdout:3/573: truncate da/fe 319077 0 2024-09-15T22:26:47.496 INFO:tasks.workunit.client.0.smithi001.stdout:5/583: write d3/d27/fa6 [3299270,63962] 0 2024-09-15T22:26:47.496 INFO:tasks.workunit.client.0.smithi001.stdout:3/574: symlink da/d3d/d43/d41/lc2 0 2024-09-15T22:26:47.496 INFO:tasks.workunit.client.0.smithi001.stdout:3/575: fdatasync da/d3b/d1b/f60 0 2024-09-15T22:26:47.497 INFO:tasks.workunit.client.0.smithi001.stdout:3/576: mknod da/d3d/d43/d7c/cc3 0 2024-09-15T22:26:47.497 INFO:tasks.workunit.client.0.smithi001.stdout:3/577: readlink da/d3b/d58/l77 0 2024-09-15T22:26:47.498 INFO:tasks.workunit.client.0.smithi001.stdout:3/578: rmdir da/d3d/db9 0 2024-09-15T22:26:47.498 INFO:tasks.workunit.client.0.smithi001.stdout:3/579: readlink da/d3b/d8b/la9 0 2024-09-15T22:26:47.498 INFO:tasks.workunit.client.0.smithi001.stdout:3/580: chown da/d3d/d43/d41/f5e 86 1 2024-09-15T22:26:47.499 INFO:tasks.workunit.client.0.smithi001.stdout:3/581: dread - da/d3d/d43/f2a zero size 2024-09-15T22:26:47.499 INFO:tasks.workunit.client.0.smithi001.stdout:3/582: write da/d3d/d43/d41/d70/f84 [573196,129541] 0 2024-09-15T22:26:47.499 INFO:tasks.workunit.client.0.smithi001.stdout:3/583: fsync da/d1f/f3e 0 2024-09-15T22:26:47.500 INFO:tasks.workunit.client.0.smithi001.stdout:3/584: link da/d3b/d1b/l50 da/d16/lc4 0 2024-09-15T22:26:47.501 INFO:tasks.workunit.client.0.smithi001.stdout:3/585: creat da/d3d/d43/d41/d70/d7f/fc5 x:0 0 0 2024-09-15T22:26:47.501 INFO:tasks.workunit.client.0.smithi001.stdout:3/586: chown da/d3d/d43/d7c/d3f 362953 1 2024-09-15T22:26:47.501 INFO:tasks.workunit.client.0.smithi001.stdout:5/584: rename d3/d1d/d54 to d3/d6/d41/d4d/dbe 0 2024-09-15T22:26:47.501 INFO:tasks.workunit.client.0.smithi001.stdout:5/585: write d3/d27/f2d [4249235,60360] 0 2024-09-15T22:26:47.503 INFO:tasks.workunit.client.0.smithi001.stdout:5/586: rename d3/c51 to d3/d6/d41/d4d/dbe/d56/d52/d9f/da4/cbf 0 2024-09-15T22:26:47.503 INFO:tasks.workunit.client.0.smithi001.stdout:5/587: chown d3/d49/l60 2067 1 2024-09-15T22:26:47.506 INFO:tasks.workunit.client.0.smithi001.stdout:8/521: write d9/d19/d58/f30 [422584,97570] 0 2024-09-15T22:26:47.506 INFO:tasks.workunit.client.0.smithi001.stdout:8/522: stat d9/d19/d40/d5f 0 2024-09-15T22:26:47.506 INFO:tasks.workunit.client.0.smithi001.stdout:8/523: chown d9/d19/f3f 1891086379 1 2024-09-15T22:26:47.507 INFO:tasks.workunit.client.0.smithi001.stdout:8/524: mkdir d9/d19/d40/d9e 0 2024-09-15T22:26:47.508 INFO:tasks.workunit.client.0.smithi001.stdout:2/547: dwrite d2/d14/f66 [0,4194304] 0 2024-09-15T22:26:47.513 INFO:tasks.workunit.client.0.smithi001.stdout:3/587: dread da/d1f/f28 [0,4194304] 0 2024-09-15T22:26:47.513 INFO:tasks.workunit.client.0.smithi001.stdout:6/554: dread d0/df/d24/f84 [0,4194304] 0 2024-09-15T22:26:47.513 INFO:tasks.workunit.client.0.smithi001.stdout:0/459: dwrite d0/d9/d1a/f28 [0,4194304] 0 2024-09-15T22:26:47.513 INFO:tasks.workunit.client.0.smithi001.stdout:2/548: creat d2/d14/d1a/d8a/fbc x:0 0 0 2024-09-15T22:26:47.513 INFO:tasks.workunit.client.0.smithi001.stdout:2/549: readlink d2/d14/d1a/d1b/d82/d97/l2e 0 2024-09-15T22:26:47.516 INFO:tasks.workunit.client.0.smithi001.stdout:5/588: dread d3/d27/d4e/d89/f9b [0,4194304] 0 2024-09-15T22:26:47.516 INFO:tasks.workunit.client.0.smithi001.stdout:3/588: mknod da/dae/d8e/cc6 0 2024-09-15T22:26:47.516 INFO:tasks.workunit.client.0.smithi001.stdout:3/589: fdatasync da/d3b/d8b/fbc 0 2024-09-15T22:26:47.516 INFO:tasks.workunit.client.0.smithi001.stdout:3/590: chown da/d3b/c88 111968 1 2024-09-15T22:26:47.517 INFO:tasks.workunit.client.0.smithi001.stdout:0/460: creat d0/d9/f8e x:0 0 0 2024-09-15T22:26:47.517 INFO:tasks.workunit.client.0.smithi001.stdout:0/461: write d0/d9/db/f19 [1117302,67803] 0 2024-09-15T22:26:47.517 INFO:tasks.workunit.client.0.smithi001.stdout:0/462: fdatasync d0/d9/f2c 0 2024-09-15T22:26:47.517 INFO:tasks.workunit.client.0.smithi001.stdout:5/589: getdents d3/d6/d41/d4d/dbe/d56/d52/db8 0 2024-09-15T22:26:47.517 INFO:tasks.workunit.client.0.smithi001.stdout:3/591: mkdir da/d90/d6f/dc7 0 2024-09-15T22:26:47.519 INFO:tasks.workunit.client.0.smithi001.stdout:0/463: mknod d0/d9/d1a/d36/c8f 0 2024-09-15T22:26:47.523 INFO:tasks.workunit.client.0.smithi001.stdout:3/592: creat da/d3d/d43/d41/fc8 x:0 0 0 2024-09-15T22:26:47.532 INFO:tasks.workunit.client.0.smithi001.stdout:8/525: write d9/d19/d34/d41/f4b [1215199,127978] 0 2024-09-15T22:26:47.532 INFO:tasks.workunit.client.0.smithi001.stdout:2/550: dread d2/f2b [0,4194304] 0 2024-09-15T22:26:47.533 INFO:tasks.workunit.client.0.smithi001.stdout:8/526: stat d9/d19/l51 0 2024-09-15T22:26:47.534 INFO:tasks.workunit.client.0.smithi001.stdout:9/500: sync 2024-09-15T22:26:47.534 INFO:tasks.workunit.client.0.smithi001.stdout:8/527: mkdir d9/d19/d40/d5f/d61/d9f 0 2024-09-15T22:26:47.535 INFO:tasks.workunit.client.0.smithi001.stdout:2/551: creat d2/d14/d1a/d1b/d82/db0/fbd x:0 0 0 2024-09-15T22:26:47.537 INFO:tasks.workunit.client.0.smithi001.stdout:2/552: write d2/f2b [3032845,26369] 0 2024-09-15T22:26:47.537 INFO:tasks.workunit.client.0.smithi001.stdout:2/553: fdatasync d2/d14/d1a/d1b/d82/d83/f89 0 2024-09-15T22:26:47.538 INFO:tasks.workunit.client.0.smithi001.stdout:2/554: chown d2/d14/f66 5198733 1 2024-09-15T22:26:47.538 INFO:tasks.workunit.client.0.smithi001.stdout:2/555: stat d2/d12/d62/l3e 0 2024-09-15T22:26:47.538 INFO:tasks.workunit.client.0.smithi001.stdout:2/556: chown d2/d12/f59 40599009 1 2024-09-15T22:26:47.539 INFO:tasks.workunit.client.0.smithi001.stdout:8/528: creat d9/d19/d29/d33/fa0 x:0 0 0 2024-09-15T22:26:47.539 INFO:tasks.workunit.client.0.smithi001.stdout:8/529: stat d9/d19/d29/d50/d89 0 2024-09-15T22:26:47.540 INFO:tasks.workunit.client.0.smithi001.stdout:5/590: dread d3/d6/d41/d4d/dbe/d56/f4b [0,4194304] 0 2024-09-15T22:26:47.541 INFO:tasks.workunit.client.0.smithi001.stdout:2/557: creat d2/fbe x:0 0 0 2024-09-15T22:26:47.541 INFO:tasks.workunit.client.0.smithi001.stdout:8/530: unlink f7 0 2024-09-15T22:26:47.541 INFO:tasks.workunit.client.0.smithi001.stdout:5/591: mkdir d3/d6/d41/d4d/dc0 0 2024-09-15T22:26:47.543 INFO:tasks.workunit.client.0.smithi001.stdout:5/592: getdents d3/d6/d41/d4d/d91 0 2024-09-15T22:26:47.544 INFO:tasks.workunit.client.0.smithi001.stdout:5/593: getdents d3/d6/d41 0 2024-09-15T22:26:47.548 INFO:tasks.workunit.client.0.smithi001.stdout:5/594: write d3/d27/d4e/d89/fa1 [514308,93803] 0 2024-09-15T22:26:47.552 INFO:tasks.workunit.client.0.smithi001.stdout:3/593: write f5 [6412531,4011] 0 2024-09-15T22:26:47.554 INFO:tasks.workunit.client.0.smithi001.stdout:4/695: dwrite d0/fea [0,4194304] 0 2024-09-15T22:26:47.554 INFO:tasks.workunit.client.0.smithi001.stdout:3/594: creat da/d3d/fc9 x:0 0 0 2024-09-15T22:26:47.562 INFO:tasks.workunit.client.0.smithi001.stdout:4/696: mkdir d0/d27/d94/d102 0 2024-09-15T22:26:47.563 INFO:tasks.workunit.client.0.smithi001.stdout:4/697: fsync d0/d5d/d7c/dba/d20/d29/d34/f70 0 2024-09-15T22:26:47.563 INFO:tasks.workunit.client.0.smithi001.stdout:4/698: truncate d0/d5d/d44/d65/d6a/f6e 5038323 0 2024-09-15T22:26:47.563 INFO:tasks.workunit.client.0.smithi001.stdout:4/699: chown d0/d27/fca 90814298 1 2024-09-15T22:26:47.572 INFO:tasks.workunit.client.0.smithi001.stdout:5/595: read d3/d6/f59 [4400238,74059] 0 2024-09-15T22:26:47.572 INFO:tasks.workunit.client.0.smithi001.stdout:5/596: fsync d3/d6/d25/f7f 0 2024-09-15T22:26:47.572 INFO:tasks.workunit.client.0.smithi001.stdout:5/597: read - d3/d6/d41/d4d/dbe/f7b zero size 2024-09-15T22:26:47.575 INFO:tasks.workunit.client.0.smithi001.stdout:4/700: mkdir d0/d27/d35/d59/d67/dab/d103 0 2024-09-15T22:26:47.581 INFO:tasks.workunit.client.0.smithi001.stdout:5/598: creat d3/d49/fc1 x:0 0 0 2024-09-15T22:26:47.581 INFO:tasks.workunit.client.0.smithi001.stdout:5/599: creat d3/d6/d41/d4d/d91/fc2 x:0 0 0 2024-09-15T22:26:47.581 INFO:tasks.workunit.client.0.smithi001.stdout:8/531: dread d9/d19/f96 [0,4194304] 0 2024-09-15T22:26:47.581 INFO:tasks.workunit.client.0.smithi001.stdout:1/600: sync 2024-09-15T22:26:47.581 INFO:tasks.workunit.client.0.smithi001.stdout:1/601: chown d3/dd/d14/d23/da1/da2 7113 1 2024-09-15T22:26:47.582 INFO:tasks.workunit.client.0.smithi001.stdout:1/602: write d3/dd/d14/d1b/f3b [48442,118320] 0 2024-09-15T22:26:47.582 INFO:tasks.workunit.client.0.smithi001.stdout:7/568: dwrite d0/d8e/d3e/f51 [0,4194304] 0 2024-09-15T22:26:47.582 INFO:tasks.workunit.client.0.smithi001.stdout:7/569: write d0/d8e/f91 [770306,69667] 0 2024-09-15T22:26:47.584 INFO:tasks.workunit.client.0.smithi001.stdout:7/570: symlink d0/d8e/d3e/lbe 0 2024-09-15T22:26:47.589 INFO:tasks.workunit.client.0.smithi001.stdout:1/603: mkdir d3/d12/dbd 0 2024-09-15T22:26:47.589 INFO:tasks.workunit.client.0.smithi001.stdout:1/604: readlink d3/dd/d14/l5d 0 2024-09-15T22:26:47.589 INFO:tasks.workunit.client.0.smithi001.stdout:6/555: dwrite d0/df/d24/f2c [0,4194304] 0 2024-09-15T22:26:47.590 INFO:tasks.workunit.client.0.smithi001.stdout:6/556: fdatasync d0/f9 0 2024-09-15T22:26:47.591 INFO:tasks.workunit.client.0.smithi001.stdout:6/557: fdatasync d0/df/d24/d2e/d43/fb6 0 2024-09-15T22:26:47.604 INFO:tasks.workunit.client.0.smithi001.stdout:5/600: dread d3/d6/d25/f2c [0,4194304] 0 2024-09-15T22:26:47.605 INFO:tasks.workunit.client.0.smithi001.stdout:5/601: write d3/d6/d41/fb9 [356669,85472] 0 2024-09-15T22:26:47.613 INFO:tasks.workunit.client.0.smithi001.stdout:0/464: dwrite d0/d6/d77/d78/f85 [0,4194304] 0 2024-09-15T22:26:47.613 INFO:tasks.workunit.client.0.smithi001.stdout:0/465: truncate d0/f46 3751733 0 2024-09-15T22:26:47.615 INFO:tasks.workunit.client.0.smithi001.stdout:0/466: unlink d0/d51/c61 0 2024-09-15T22:26:47.617 INFO:tasks.workunit.client.0.smithi001.stdout:0/467: creat d0/dd/d33/f90 x:0 0 0 2024-09-15T22:26:47.618 INFO:tasks.workunit.client.0.smithi001.stdout:8/532: write d9/d19/d58/f4d [2701104,40249] 0 2024-09-15T22:26:47.621 INFO:tasks.workunit.client.0.smithi001.stdout:8/533: read d9/d19/d58/f4e [292680,129836] 0 2024-09-15T22:26:47.622 INFO:tasks.workunit.client.0.smithi001.stdout:1/605: read d3/dd/d3c/d4c/f4e [834956,99674] 0 2024-09-15T22:26:47.623 INFO:tasks.workunit.client.0.smithi001.stdout:1/606: truncate d3/f3f 238523 0 2024-09-15T22:26:47.623 INFO:tasks.workunit.client.0.smithi001.stdout:9/501: dwrite d5/de/d1a/d1b/d22/d2c/f17 [0,4194304] 0 2024-09-15T22:26:47.636 INFO:tasks.workunit.client.0.smithi001.stdout:0/468: dread d0/d9/db/f6b [0,4194304] 0 2024-09-15T22:26:47.640 INFO:tasks.workunit.client.0.smithi001.stdout:2/558: dwrite d2/d14/d1a/d1b/d82/d97/f51 [0,4194304] 0 2024-09-15T22:26:47.642 INFO:tasks.workunit.client.0.smithi001.stdout:0/469: mknod d0/dd/d63/c91 0 2024-09-15T22:26:47.642 INFO:tasks.workunit.client.0.smithi001.stdout:7/571: dwrite d0/d7/d44/f8d [0,4194304] 0 2024-09-15T22:26:47.643 INFO:tasks.workunit.client.0.smithi001.stdout:0/470: symlink d0/d51/l92 0 2024-09-15T22:26:47.646 INFO:tasks.workunit.client.0.smithi001.stdout:7/572: write d0/d7/d44/d3f/d49/f66 [2031068,99353] 0 2024-09-15T22:26:47.646 INFO:tasks.workunit.client.0.smithi001.stdout:0/471: stat d0/dd/d33/l60 0 2024-09-15T22:26:47.646 INFO:tasks.workunit.client.0.smithi001.stdout:0/472: chown d0/d9/d1a/d70/f87 25 1 2024-09-15T22:26:47.646 INFO:tasks.workunit.client.0.smithi001.stdout:0/473: chown d0/d9/db/c62 45 1 2024-09-15T22:26:47.646 INFO:tasks.workunit.client.0.smithi001.stdout:0/474: dread - d0/d9/db/f25 zero size 2024-09-15T22:26:47.646 INFO:tasks.workunit.client.0.smithi001.stdout:4/701: dwrite d0/d27/d94/df1/ffa [0,4194304] 0 2024-09-15T22:26:47.648 INFO:tasks.workunit.client.0.smithi001.stdout:4/702: mkdir d0/d5d/d7c/dd1/d104 0 2024-09-15T22:26:47.652 INFO:tasks.workunit.client.0.smithi001.stdout:7/573: symlink d0/d8e/lbf 0 2024-09-15T22:26:47.653 INFO:tasks.workunit.client.0.smithi001.stdout:4/703: unlink d0/d27/c2a 0 2024-09-15T22:26:47.653 INFO:tasks.workunit.client.0.smithi001.stdout:4/704: chown d0/l46 65988620 1 2024-09-15T22:26:47.654 INFO:tasks.workunit.client.0.smithi001.stdout:4/705: read - d0/d5d/d7c/dba/d20/d29/d34/d9c/fda zero size 2024-09-15T22:26:47.654 INFO:tasks.workunit.client.0.smithi001.stdout:4/706: write d0/d5d/d7c/dba/d20/d29/d40/f4d [753449,68110] 0 2024-09-15T22:26:47.661 INFO:tasks.workunit.client.0.smithi001.stdout:5/602: dwrite d3/d6/d41/f4c [0,4194304] 0 2024-09-15T22:26:47.661 INFO:tasks.workunit.client.0.smithi001.stdout:5/603: fdatasync d3/d27/f46 0 2024-09-15T22:26:47.661 INFO:tasks.workunit.client.0.smithi001.stdout:5/604: write d3/d6/d57/d87/d8c/fab [3574007,7796] 0 2024-09-15T22:26:47.669 INFO:tasks.workunit.client.0.smithi001.stdout:5/605: getdents d3/d6/d25 0 2024-09-15T22:26:47.669 INFO:tasks.workunit.client.0.smithi001.stdout:7/574: write d0/f2a [3749650,65024] 0 2024-09-15T22:26:47.671 INFO:tasks.workunit.client.0.smithi001.stdout:5/606: truncate d3/d27/f42 1056137 0 2024-09-15T22:26:47.677 INFO:tasks.workunit.client.0.smithi001.stdout:5/607: link d3/d6/d41/f82 d3/d6/d41/d4d/dbe/d56/d52/d9f/fc3 0 2024-09-15T22:26:47.678 INFO:tasks.workunit.client.0.smithi001.stdout:8/534: dwrite d9/d19/d58/f68 [0,4194304] 0 2024-09-15T22:26:47.680 INFO:tasks.workunit.client.0.smithi001.stdout:5/608: rename d3/d6/d41/d4d/dbe/d56/d52/f75 to d3/d6/fc4 0 2024-09-15T22:26:47.680 INFO:tasks.workunit.client.0.smithi001.stdout:5/609: chown d3/d6/d41/d4d/dbe/d56/f4a 8026403 1 2024-09-15T22:26:47.680 INFO:tasks.workunit.client.0.smithi001.stdout:5/610: stat d3/d27/f3a 0 2024-09-15T22:26:47.682 INFO:tasks.workunit.client.0.smithi001.stdout:5/611: link d3/d6/d41/d4d/dbe/d56/d52/d61/l70 d3/d6/d41/d4d/dc0/lc5 0 2024-09-15T22:26:47.683 INFO:tasks.workunit.client.0.smithi001.stdout:4/707: getdents d0/d27 0 2024-09-15T22:26:47.684 INFO:tasks.workunit.client.0.smithi001.stdout:1/607: dwrite d3/dd/d14/fa5 [0,4194304] 0 2024-09-15T22:26:47.685 INFO:tasks.workunit.client.0.smithi001.stdout:5/612: symlink d3/d6/d41/d4d/dbe/d56/d52/d9f/lc6 0 2024-09-15T22:26:47.686 INFO:tasks.workunit.client.0.smithi001.stdout:4/708: mknod d0/d5d/d44/d65/c105 0 2024-09-15T22:26:47.686 INFO:tasks.workunit.client.0.smithi001.stdout:4/709: getdents d0/d27/d35/d59/d67/dab/d103 0 2024-09-15T22:26:47.689 INFO:tasks.workunit.client.0.smithi001.stdout:1/608: symlink d3/d8d/dae/lbe 0 2024-09-15T22:26:47.696 INFO:tasks.workunit.client.0.smithi001.stdout:4/710: mknod d0/d5d/d7c/dba/d20/d29/d34/dbc/dbf/c106 0 2024-09-15T22:26:47.696 INFO:tasks.workunit.client.0.smithi001.stdout:4/711: dread - d0/d5d/d7c/dba/d20/f8c zero size 2024-09-15T22:26:47.696 INFO:tasks.workunit.client.0.smithi001.stdout:5/613: creat d3/d1d/fc7 x:0 0 0 2024-09-15T22:26:47.696 INFO:tasks.workunit.client.0.smithi001.stdout:5/614: write d3/d6/d57/d87/d8c/da2/fb6 [2880781,13082] 0 2024-09-15T22:26:47.698 INFO:tasks.workunit.client.0.smithi001.stdout:5/615: creat d3/d6/d41/d4d/d5a/fc8 x:0 0 0 2024-09-15T22:26:47.699 INFO:tasks.workunit.client.0.smithi001.stdout:8/535: dread d9/fb [0,4194304] 0 2024-09-15T22:26:47.700 INFO:tasks.workunit.client.0.smithi001.stdout:5/616: mknod d3/d6/d41/cc9 0 2024-09-15T22:26:47.708 INFO:tasks.workunit.client.0.smithi001.stdout:4/712: dread d0/f11 [0,4194304] 0 2024-09-15T22:26:47.709 INFO:tasks.workunit.client.0.smithi001.stdout:4/713: mkdir d0/d5d/d7c/de8/dec/d107 0 2024-09-15T22:26:47.711 INFO:tasks.workunit.client.0.smithi001.stdout:9/502: dwrite d5/de/d1a/d1b/d22/f91 [0,4194304] 0 2024-09-15T22:26:47.711 INFO:tasks.workunit.client.0.smithi001.stdout:4/714: link d0/d5d/d44/d65/d6a/ldf d0/d5d/d7c/dba/d20/d29/d34/dbc/l108 0 2024-09-15T22:26:47.711 INFO:tasks.workunit.client.0.smithi001.stdout:4/715: dread - d0/d5d/d7c/dba/d20/d29/d34/dbc/dbf/fc7 zero size 2024-09-15T22:26:47.716 INFO:tasks.workunit.client.0.smithi001.stdout:9/503: symlink d5/de/d1a/d1b/d22/d97/l98 0 2024-09-15T22:26:47.716 INFO:tasks.workunit.client.0.smithi001.stdout:5/617: write d3/d49/fa0 [765563,93636] 0 2024-09-15T22:26:47.718 INFO:tasks.workunit.client.0.smithi001.stdout:7/575: dwrite d0/d7/d44/d36/fb5 [0,4194304] 0 2024-09-15T22:26:47.719 INFO:tasks.workunit.client.0.smithi001.stdout:0/475: dwrite d0/dd/ff [0,4194304] 0 2024-09-15T22:26:47.719 INFO:tasks.workunit.client.0.smithi001.stdout:0/476: fdatasync d0/d9/db/f83 0 2024-09-15T22:26:47.721 INFO:tasks.workunit.client.0.smithi001.stdout:7/576: getdents d0/d7/d21/d6b/d93 0 2024-09-15T22:26:47.722 INFO:tasks.workunit.client.0.smithi001.stdout:8/536: dread d9/d19/f32 [0,4194304] 0 2024-09-15T22:26:47.723 INFO:tasks.workunit.client.0.smithi001.stdout:1/609: dread d3/d12/d79/f81 [0,4194304] 0 2024-09-15T22:26:47.725 INFO:tasks.workunit.client.0.smithi001.stdout:5/618: rename d3/d27/f46 to d3/d6/d41/d4d/dbe/d56/d52/db8/fca 0 2024-09-15T22:26:47.727 INFO:tasks.workunit.client.0.smithi001.stdout:0/477: mkdir d0/dd/d93 0 2024-09-15T22:26:47.727 INFO:tasks.workunit.client.0.smithi001.stdout:0/478: chown d0/dd/d63 478150118 1 2024-09-15T22:26:47.727 INFO:tasks.workunit.client.0.smithi001.stdout:9/504: getdents d5/de/d1a/d1b/d22/d97 0 2024-09-15T22:26:47.727 INFO:tasks.workunit.client.0.smithi001.stdout:9/505: dread - d5/de/d15/d27/d63/f79 zero size 2024-09-15T22:26:47.727 INFO:tasks.workunit.client.0.smithi001.stdout:4/716: dread d0/d27/d35/f4a [0,4194304] 0 2024-09-15T22:26:47.727 INFO:tasks.workunit.client.0.smithi001.stdout:4/717: truncate d0/d5d/d7c/dba/d20/f8c 887577 0 2024-09-15T22:26:47.729 INFO:tasks.workunit.client.0.smithi001.stdout:4/718: creat d0/d5d/d7c/dba/d20/d29/f109 x:0 0 0 2024-09-15T22:26:47.729 INFO:tasks.workunit.client.0.smithi001.stdout:5/619: rmdir d3/d6 39 2024-09-15T22:26:47.729 INFO:tasks.workunit.client.0.smithi001.stdout:5/620: truncate d3/d6/d41/fb9 510714 0 2024-09-15T22:26:47.731 INFO:tasks.workunit.client.0.smithi001.stdout:8/537: mknod d9/d19/d34/d41/ca1 0 2024-09-15T22:26:47.732 INFO:tasks.workunit.client.0.smithi001.stdout:0/479: mknod d0/d6/d77/d78/c94 0 2024-09-15T22:26:47.732 INFO:tasks.workunit.client.0.smithi001.stdout:0/480: chown d0/d9/db/d5d/d6d/l8c 2235081 1 2024-09-15T22:26:47.735 INFO:tasks.workunit.client.0.smithi001.stdout:3/595: sync 2024-09-15T22:26:47.735 INFO:tasks.workunit.client.0.smithi001.stdout:2/559: sync 2024-09-15T22:26:47.735 INFO:tasks.workunit.client.0.smithi001.stdout:6/558: sync 2024-09-15T22:26:47.741 INFO:tasks.workunit.client.0.smithi001.stdout:2/560: write d2/d12/f59 [4512169,40902] 0 2024-09-15T22:26:47.743 INFO:tasks.workunit.client.0.smithi001.stdout:0/481: link d0/l52 d0/d6/d77/d78/l95 0 2024-09-15T22:26:47.743 INFO:tasks.workunit.client.0.smithi001.stdout:0/482: write d0/d9/f39 [638084,98761] 0 2024-09-15T22:26:47.743 INFO:tasks.workunit.client.0.smithi001.stdout:0/483: fsync d0/d9/d1a/f28 0 2024-09-15T22:26:47.743 INFO:tasks.workunit.client.0.smithi001.stdout:8/538: truncate d9/fa 3612198 0 2024-09-15T22:26:47.743 INFO:tasks.workunit.client.0.smithi001.stdout:9/506: dread d5/de/d1a/f56 [0,4194304] 0 2024-09-15T22:26:47.745 INFO:tasks.workunit.client.0.smithi001.stdout:6/559: fsync d0/df/d24/d2e/d43/f73 0 2024-09-15T22:26:47.745 INFO:tasks.workunit.client.0.smithi001.stdout:0/484: mknod d0/d9/d1a/c96 0 2024-09-15T22:26:47.745 INFO:tasks.workunit.client.0.smithi001.stdout:7/577: dread d0/d7/d21/f55 [0,4194304] 0 2024-09-15T22:26:47.745 INFO:tasks.workunit.client.0.smithi001.stdout:3/596: mknod da/d3d/d43/d7c/d53/cca 0 2024-09-15T22:26:47.746 INFO:tasks.workunit.client.0.smithi001.stdout:6/560: truncate d0/df/d24/d49/f6a 141935 0 2024-09-15T22:26:47.746 INFO:tasks.workunit.client.0.smithi001.stdout:6/561: read - d0/f88 zero size 2024-09-15T22:26:47.746 INFO:tasks.workunit.client.0.smithi001.stdout:6/562: fsync d0/d6/d5d/d67/f54 0 2024-09-15T22:26:47.746 INFO:tasks.workunit.client.0.smithi001.stdout:6/563: fsync d0/df/d24/d49/f81 0 2024-09-15T22:26:47.749 INFO:tasks.workunit.client.0.smithi001.stdout:4/719: dread d0/fd [0,4194304] 0 2024-09-15T22:26:47.756 INFO:tasks.workunit.client.0.smithi001.stdout:2/561: dread d2/d12/d62/d64/fa5 [0,4194304] 0 2024-09-15T22:26:47.761 INFO:tasks.workunit.client.0.smithi001.stdout:4/720: dread d0/d5d/d7c/dba/f21 [0,4194304] 0 2024-09-15T22:26:47.761 INFO:tasks.workunit.client.0.smithi001.stdout:7/578: rename d0/d7/d44/c81 to d0/d7/d44/cc0 0 2024-09-15T22:26:47.761 INFO:tasks.workunit.client.0.smithi001.stdout:4/721: write d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d73/dc0/fc5 [969475,101089] 0 2024-09-15T22:26:47.761 INFO:tasks.workunit.client.0.smithi001.stdout:4/722: stat d0/d27/d35/d59/d67/d7b/c7f 0 2024-09-15T22:26:47.761 INFO:tasks.workunit.client.0.smithi001.stdout:5/621: write d3/d6/d41/d4d/dbe/d56/f4a [3942965,44075] 0 2024-09-15T22:26:47.762 INFO:tasks.workunit.client.0.smithi001.stdout:5/622: read - d3/d49/f95 zero size 2024-09-15T22:26:47.764 INFO:tasks.workunit.client.0.smithi001.stdout:4/723: rename d0/d5d/d44/d65/c105 to d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d73/dc0/c10a 0 2024-09-15T22:26:47.764 INFO:tasks.workunit.client.0.smithi001.stdout:4/724: write d0/d5d/d7c/dd1/fb6 [2846459,129075] 0 2024-09-15T22:26:47.764 INFO:tasks.workunit.client.0.smithi001.stdout:5/623: creat d3/d6/d41/d4d/fcb x:0 0 0 2024-09-15T22:26:47.765 INFO:tasks.workunit.client.0.smithi001.stdout:5/624: creat d3/d27/fcc x:0 0 0 2024-09-15T22:26:47.767 INFO:tasks.workunit.client.0.smithi001.stdout:0/485: write d0/d9/d1a/d36/f45 [1596354,77344] 0 2024-09-15T22:26:47.769 INFO:tasks.workunit.client.0.smithi001.stdout:2/562: symlink d2/lbf 0 2024-09-15T22:26:47.782 INFO:tasks.workunit.client.0.smithi001.stdout:7/579: dread d0/f5c [0,4194304] 0 2024-09-15T22:26:47.784 INFO:tasks.workunit.client.0.smithi001.stdout:7/580: creat d0/d7/d44/d3f/d49/fc1 x:0 0 0 2024-09-15T22:26:47.785 INFO:tasks.workunit.client.0.smithi001.stdout:7/581: write d0/d7/d21/d6b/fa8 [813762,119436] 0 2024-09-15T22:26:47.785 INFO:tasks.workunit.client.0.smithi001.stdout:7/582: dread - d0/d7/d44/d36/f84 zero size 2024-09-15T22:26:47.804 INFO:tasks.workunit.client.0.smithi001.stdout:7/583: write d0/f5c [3101464,58590] 0 2024-09-15T22:26:47.809 INFO:tasks.workunit.client.0.smithi001.stdout:0/486: dwrite d0/f2 [0,4194304] 0 2024-09-15T22:26:47.810 INFO:tasks.workunit.client.0.smithi001.stdout:0/487: truncate d0/d9/f1c 2802817 0 2024-09-15T22:26:47.810 INFO:tasks.workunit.client.0.smithi001.stdout:0/488: chown d0/d6/c59 876 1 2024-09-15T22:26:47.813 INFO:tasks.workunit.client.0.smithi001.stdout:0/489: truncate d0/d9/f26 305549 0 2024-09-15T22:26:47.824 INFO:tasks.workunit.client.0.smithi001.stdout:2/563: dwrite d2/d14/d1a/d8a/fa8 [0,4194304] 0 2024-09-15T22:26:47.825 INFO:tasks.workunit.client.0.smithi001.stdout:2/564: chown d2/d14/d1a/d1b/d82/d97/da2/d6f/c7d 765056 1 2024-09-15T22:26:47.830 INFO:tasks.workunit.client.0.smithi001.stdout:7/584: dread d0/d7/d44/d3f/d49/f59 [0,4194304] 0 2024-09-15T22:26:47.831 INFO:tasks.workunit.client.0.smithi001.stdout:7/585: symlink d0/db3/lc2 0 2024-09-15T22:26:47.833 INFO:tasks.workunit.client.0.smithi001.stdout:2/565: truncate d2/d14/d1a/d1b/f26 1961267 0 2024-09-15T22:26:47.834 INFO:tasks.workunit.client.0.smithi001.stdout:2/566: chown d2/fbe 92702 1 2024-09-15T22:26:47.835 INFO:tasks.workunit.client.0.smithi001.stdout:2/567: link d2/d12/d62/f4e d2/d14/d1a/fc0 0 2024-09-15T22:26:47.836 INFO:tasks.workunit.client.0.smithi001.stdout:2/568: getdents d2/d12/d62/d64 0 2024-09-15T22:26:47.846 INFO:tasks.workunit.client.0.smithi001.stdout:9/507: dwrite d5/de/d1a/f64 [0,4194304] 0 2024-09-15T22:26:47.846 INFO:tasks.workunit.client.0.smithi001.stdout:9/508: fdatasync d5/de/d1a/d1b/f70 0 2024-09-15T22:26:47.848 INFO:tasks.workunit.client.0.smithi001.stdout:9/509: mknod d5/de/d1a/d1b/d22/d2c/d21/d4d/c99 0 2024-09-15T22:26:47.848 INFO:tasks.workunit.client.0.smithi001.stdout:9/510: readlink d5/de/d1a/l1e 0 2024-09-15T22:26:47.853 INFO:tasks.workunit.client.0.smithi001.stdout:9/511: dread d5/de/d1a/d1b/d22/f65 [0,4194304] 0 2024-09-15T22:26:47.853 INFO:tasks.workunit.client.0.smithi001.stdout:9/512: write d5/de/d15/d27/f7c [799204,37342] 0 2024-09-15T22:26:47.854 INFO:tasks.workunit.client.0.smithi001.stdout:9/513: stat d5/de/d1a/d1b/f33 0 2024-09-15T22:26:47.854 INFO:tasks.workunit.client.0.smithi001.stdout:9/514: creat d5/de/d1a/d38/f9a x:0 0 0 2024-09-15T22:26:47.855 INFO:tasks.workunit.client.0.smithi001.stdout:9/515: truncate d5/de/d15/d27/d63/f7b 1610828 0 2024-09-15T22:26:47.855 INFO:tasks.workunit.client.0.smithi001.stdout:9/516: read - d5/de/d1a/d1b/d22/d2c/d21/d68/f76 zero size 2024-09-15T22:26:47.855 INFO:tasks.workunit.client.0.smithi001.stdout:9/517: write d5/de/d1a/f88 [260849,82198] 0 2024-09-15T22:26:47.856 INFO:tasks.workunit.client.0.smithi001.stdout:9/518: fdatasync d5/de/d1a/d38/f72 0 2024-09-15T22:26:47.862 INFO:tasks.workunit.client.0.smithi001.stdout:6/564: dwrite d0/df/fb3 [0,4194304] 0 2024-09-15T22:26:47.864 INFO:tasks.workunit.client.0.smithi001.stdout:6/565: mknod d0/df/d24/d2e/d43/cc8 0 2024-09-15T22:26:47.865 INFO:tasks.workunit.client.0.smithi001.stdout:6/566: creat d0/d6/d5d/da6/fc9 x:0 0 0 2024-09-15T22:26:47.886 INFO:tasks.workunit.client.0.smithi001.stdout:6/567: dread d0/df/d24/f2c [0,4194304] 0 2024-09-15T22:26:47.886 INFO:tasks.workunit.client.0.smithi001.stdout:0/490: dwrite d0/f46 [0,4194304] 0 2024-09-15T22:26:47.887 INFO:tasks.workunit.client.0.smithi001.stdout:0/491: write d0/dd/f47 [50847,63938] 0 2024-09-15T22:26:47.891 INFO:tasks.workunit.client.0.smithi001.stdout:6/568: link d0/d6/c94 d0/df/d24/d2e/d43/d30/dc2/cca 0 2024-09-15T22:26:47.891 INFO:tasks.workunit.client.0.smithi001.stdout:6/569: chown d0/df/d24/f6b 1186394971 1 2024-09-15T22:26:47.892 INFO:tasks.workunit.client.0.smithi001.stdout:0/492: creat d0/dd/d63/f97 x:0 0 0 2024-09-15T22:26:47.893 INFO:tasks.workunit.client.0.smithi001.stdout:0/493: symlink d0/d6/d77/l98 0 2024-09-15T22:26:47.895 INFO:tasks.workunit.client.0.smithi001.stdout:9/519: dwrite d5/de/d15/f74 [0,4194304] 0 2024-09-15T22:26:47.897 INFO:tasks.workunit.client.0.smithi001.stdout:6/570: dread d0/d6/d5d/f9e [0,4194304] 0 2024-09-15T22:26:47.899 INFO:tasks.workunit.client.0.smithi001.stdout:9/520: rename f4 to d5/de/f9b 0 2024-09-15T22:26:47.901 INFO:tasks.workunit.client.0.smithi001.stdout:9/521: rename d5/c71 to d5/c9c 0 2024-09-15T22:26:47.901 INFO:tasks.workunit.client.0.smithi001.stdout:0/494: truncate d0/f2 947120 0 2024-09-15T22:26:47.902 INFO:tasks.workunit.client.0.smithi001.stdout:9/522: getdents d5/de/d15/d27/d63 0 2024-09-15T22:26:47.904 INFO:tasks.workunit.client.0.smithi001.stdout:0/495: creat d0/d51/f99 x:0 0 0 2024-09-15T22:26:47.904 INFO:tasks.workunit.client.0.smithi001.stdout:0/496: chown d0/d51 62 1 2024-09-15T22:26:47.907 INFO:tasks.workunit.client.0.smithi001.stdout:0/497: creat d0/d9/db/d5d/d6d/f9a x:0 0 0 2024-09-15T22:26:47.907 INFO:tasks.workunit.client.0.smithi001.stdout:6/571: write d0/df/d24/f2c [199052,66323] 0 2024-09-15T22:26:47.907 INFO:tasks.workunit.client.0.smithi001.stdout:0/498: write d0/d9/db/d5d/f76 [84589,75525] 0 2024-09-15T22:26:47.910 INFO:tasks.workunit.client.0.smithi001.stdout:1/610: sync 2024-09-15T22:26:47.912 INFO:tasks.workunit.client.0.smithi001.stdout:0/499: creat d0/d6/d77/d78/f9b x:0 0 0 2024-09-15T22:26:47.912 INFO:tasks.workunit.client.0.smithi001.stdout:0/500: dread - d0/d9/db/f83 zero size 2024-09-15T22:26:47.932 INFO:tasks.workunit.client.0.smithi001.stdout:0/501: dread d0/d9/f38 [0,4194304] 0 2024-09-15T22:26:47.973 INFO:tasks.workunit.client.0.smithi001.stdout:0/502: dwrite d0/d6/d77/d78/f8b [0,4194304] 0 2024-09-15T22:26:47.975 INFO:tasks.workunit.client.0.smithi001.stdout:6/572: dwrite d0/d6/d5d/d67/f2b [0,4194304] 0 2024-09-15T22:26:47.975 INFO:tasks.workunit.client.0.smithi001.stdout:0/503: symlink d0/d9/db/l9c 0 2024-09-15T22:26:47.975 INFO:tasks.workunit.client.0.smithi001.stdout:0/504: fsync d0/f4 0 2024-09-15T22:26:47.978 INFO:tasks.workunit.client.0.smithi001.stdout:0/505: creat d0/dd/f9d x:0 0 0 2024-09-15T22:26:47.982 INFO:tasks.workunit.client.0.smithi001.stdout:0/506: getdents d0/dd 0 2024-09-15T22:26:47.986 INFO:tasks.workunit.client.0.smithi001.stdout:1/611: dwrite d3/dd/d3c/d4c/f9a [0,4194304] 0 2024-09-15T22:26:47.989 INFO:tasks.workunit.client.0.smithi001.stdout:1/612: link d3/dd/d3c/d64/fa6 d3/dd/d86/fbf 0 2024-09-15T22:26:47.990 INFO:tasks.workunit.client.0.smithi001.stdout:5/625: sync 2024-09-15T22:26:47.990 INFO:tasks.workunit.client.0.smithi001.stdout:8/539: sync 2024-09-15T22:26:47.990 INFO:tasks.workunit.client.0.smithi001.stdout:3/597: sync 2024-09-15T22:26:47.990 INFO:tasks.workunit.client.0.smithi001.stdout:2/569: sync 2024-09-15T22:26:47.990 INFO:tasks.workunit.client.0.smithi001.stdout:7/586: sync 2024-09-15T22:26:47.990 INFO:tasks.workunit.client.0.smithi001.stdout:5/626: truncate d3/d6/d25/f7f 689200 0 2024-09-15T22:26:47.990 INFO:tasks.workunit.client.0.smithi001.stdout:7/587: truncate d0/d7/d44/d36/f99 512970 0 2024-09-15T22:26:47.990 INFO:tasks.workunit.client.0.smithi001.stdout:7/588: fdatasync d0/d7/d21/f9b 0 2024-09-15T22:26:47.991 INFO:tasks.workunit.client.0.smithi001.stdout:5/627: symlink d3/d27/d7a/d80/lcd 0 2024-09-15T22:26:47.991 INFO:tasks.workunit.client.0.smithi001.stdout:8/540: link d9/d19/d34/f4a d9/d19/d29/d50/fa2 0 2024-09-15T22:26:47.991 INFO:tasks.workunit.client.0.smithi001.stdout:8/541: chown d9/d19/d29/d33/c44 418778564 1 2024-09-15T22:26:47.991 INFO:tasks.workunit.client.0.smithi001.stdout:5/628: fsync d3/d27/d4e/d89/fa1 0 2024-09-15T22:26:47.991 INFO:tasks.workunit.client.0.smithi001.stdout:8/542: read d9/d19/d58/f4d [566427,5156] 0 2024-09-15T22:26:47.991 INFO:tasks.workunit.client.0.smithi001.stdout:8/543: readlink l3 0 2024-09-15T22:26:47.992 INFO:tasks.workunit.client.0.smithi001.stdout:3/598: symlink da/d3d/d43/lcb 0 2024-09-15T22:26:47.992 INFO:tasks.workunit.client.0.smithi001.stdout:3/599: write da/d90/d6f/f71 [1117816,78210] 0 2024-09-15T22:26:47.992 INFO:tasks.workunit.client.0.smithi001.stdout:3/600: write da/d16/fba [919399,94148] 0 2024-09-15T22:26:47.992 INFO:tasks.workunit.client.0.smithi001.stdout:7/589: symlink d0/d7/d21/lc3 0 2024-09-15T22:26:47.992 INFO:tasks.workunit.client.0.smithi001.stdout:7/590: stat d0/d7/d21/l54 0 2024-09-15T22:26:47.993 INFO:tasks.workunit.client.0.smithi001.stdout:7/591: getdents d0/d6a/dac 0 2024-09-15T22:26:47.993 INFO:tasks.workunit.client.0.smithi001.stdout:7/592: write d0/d7/d44/d36/f99 [782258,91669] 0 2024-09-15T22:26:47.993 INFO:tasks.workunit.client.0.smithi001.stdout:8/544: creat d9/d19/d40/fa3 x:0 0 0 2024-09-15T22:26:47.994 INFO:tasks.workunit.client.0.smithi001.stdout:8/545: readlink d9/d19/d29/d50/d70/l75 0 2024-09-15T22:26:47.994 INFO:tasks.workunit.client.0.smithi001.stdout:8/546: write d9/d19/d58/d8e/f9d [4272326,24425] 0 2024-09-15T22:26:47.994 INFO:tasks.workunit.client.0.smithi001.stdout:8/547: read - d9/d19/d58/f7b zero size 2024-09-15T22:26:47.994 INFO:tasks.workunit.client.0.smithi001.stdout:1/613: rename d3/d8d/dae/f52 to d3/fc0 0 2024-09-15T22:26:47.994 INFO:tasks.workunit.client.0.smithi001.stdout:1/614: chown d3/dd/d14/d1b/f6d 4952612 1 2024-09-15T22:26:47.994 INFO:tasks.workunit.client.0.smithi001.stdout:8/548: write d9/d19/d29/d33/d63/f6a [3975123,98048] 0 2024-09-15T22:26:47.995 INFO:tasks.workunit.client.0.smithi001.stdout:7/593: rename d0/d7/d21/d6b/cbc to d0/d7/d44/d94/cc4 0 2024-09-15T22:26:47.995 INFO:tasks.workunit.client.0.smithi001.stdout:5/629: creat d3/d27/d7a/d80/fce x:0 0 0 2024-09-15T22:26:47.995 INFO:tasks.workunit.client.0.smithi001.stdout:5/630: truncate d3/d6/d41/d4d/dbe/d56/d52/d9f/fc3 520142 0 2024-09-15T22:26:47.995 INFO:tasks.workunit.client.0.smithi001.stdout:8/549: mkdir d9/d19/d34/da4 0 2024-09-15T22:26:47.995 INFO:tasks.workunit.client.0.smithi001.stdout:5/631: dread - d3/d6/d41/f9d zero size 2024-09-15T22:26:47.995 INFO:tasks.workunit.client.0.smithi001.stdout:5/632: readlink d3/d27/d7a/d80/lcd 0 2024-09-15T22:26:47.996 INFO:tasks.workunit.client.0.smithi001.stdout:7/594: rename d0/d7/d44/d3f/d49/f66 to d0/d98/fc5 0 2024-09-15T22:26:47.996 INFO:tasks.workunit.client.0.smithi001.stdout:5/633: rename d3/d6/d41/d4d/dbe/d56/d52/d9f/da4 to d3/d6/d41/d4d/dbe/d56/d52/d9f/da4/dcf 22 2024-09-15T22:26:47.999 INFO:tasks.workunit.client.0.smithi001.stdout:7/595: getdents d0/d7 0 2024-09-15T22:26:48.008 INFO:tasks.workunit.client.0.smithi001.stdout:7/596: rename d0/d7/d44/d94 to d0/d7/dc6 0 2024-09-15T22:26:48.011 INFO:tasks.workunit.client.0.smithi001.stdout:7/597: getdents d0/d7/d44/d3f/d49/d4f 0 2024-09-15T22:26:48.011 INFO:tasks.workunit.client.0.smithi001.stdout:7/598: fsync d0/d7/d21/f9b 0 2024-09-15T22:26:48.011 INFO:tasks.workunit.client.0.smithi001.stdout:7/599: chown d0/d7/d21/d6b 1 1 2024-09-15T22:26:48.012 INFO:tasks.workunit.client.0.smithi001.stdout:7/600: creat d0/d7/d44/d3f/d49/fc7 x:0 0 0 2024-09-15T22:26:48.014 INFO:tasks.workunit.client.0.smithi001.stdout:7/601: link d0/d7/f24 d0/d8e/fc8 0 2024-09-15T22:26:48.019 INFO:tasks.workunit.client.0.smithi001.stdout:3/601: dread da/d3b/f40 [0,4194304] 0 2024-09-15T22:26:48.020 INFO:tasks.workunit.client.0.smithi001.stdout:3/602: rmdir da/d1f/d7e 0 2024-09-15T22:26:48.021 INFO:tasks.workunit.client.0.smithi001.stdout:1/615: dread d3/f99 [0,4194304] 0 2024-09-15T22:26:48.021 INFO:tasks.workunit.client.0.smithi001.stdout:3/603: creat da/dae/d8e/fcc x:0 0 0 2024-09-15T22:26:48.022 INFO:tasks.workunit.client.0.smithi001.stdout:3/604: unlink f5 0 2024-09-15T22:26:48.023 INFO:tasks.workunit.client.0.smithi001.stdout:1/616: mknod d3/dd/d14/d1b/d2b/d68/cc1 0 2024-09-15T22:26:48.024 INFO:tasks.workunit.client.0.smithi001.stdout:3/605: rename da/dae/d8e/fcc to da/d3d/d43/d41/d70/d7f/fcd 0 2024-09-15T22:26:48.024 INFO:tasks.workunit.client.0.smithi001.stdout:3/606: dread - da/fa5 zero size 2024-09-15T22:26:48.024 INFO:tasks.workunit.client.0.smithi001.stdout:3/607: readlink da/d3b/d8b/la9 0 2024-09-15T22:26:48.024 INFO:tasks.workunit.client.0.smithi001.stdout:3/608: chown f8 4051313 1 2024-09-15T22:26:48.025 INFO:tasks.workunit.client.0.smithi001.stdout:6/573: dwrite d0/df/d24/d2e/d43/f93 [4194304,4194304] 0 2024-09-15T22:26:48.025 INFO:tasks.workunit.client.0.smithi001.stdout:3/609: mkdir da/d3d/d43/d7c/d3f/db5/dce 0 2024-09-15T22:26:48.026 INFO:tasks.workunit.client.0.smithi001.stdout:1/617: creat d3/d8d/fc2 x:0 0 0 2024-09-15T22:26:48.026 INFO:tasks.workunit.client.0.smithi001.stdout:1/618: write d3/d8d/d91/fa9 [155313,63761] 0 2024-09-15T22:26:48.027 INFO:tasks.workunit.client.0.smithi001.stdout:6/574: symlink d0/d6/lcb 0 2024-09-15T22:26:48.028 INFO:tasks.workunit.client.0.smithi001.stdout:3/610: rename da/d3d/d43/d7c/d53/d72/d97 to da/d3b/d1b/dcf 0 2024-09-15T22:26:48.029 INFO:tasks.workunit.client.0.smithi001.stdout:3/611: read - da/d90/d92/fad zero size 2024-09-15T22:26:48.030 INFO:tasks.workunit.client.0.smithi001.stdout:6/575: rename d0/df/d24/d49/lb5 to d0/d6/d5d/d67/dc4/lcc 0 2024-09-15T22:26:48.030 INFO:tasks.workunit.client.0.smithi001.stdout:1/619: mknod d3/d12/d21/cc3 0 2024-09-15T22:26:48.031 INFO:tasks.workunit.client.0.smithi001.stdout:1/620: truncate d3/dd/d3c/d4c/f6b 327601 0 2024-09-15T22:26:48.031 INFO:tasks.workunit.client.0.smithi001.stdout:1/621: chown d3/d12/d21/cc3 1852602 1 2024-09-15T22:26:48.031 INFO:tasks.workunit.client.0.smithi001.stdout:1/622: dread - d3/dd/d3c/d64/f7e zero size 2024-09-15T22:26:48.032 INFO:tasks.workunit.client.0.smithi001.stdout:1/623: creat d3/d12/d21/fc4 x:0 0 0 2024-09-15T22:26:48.032 INFO:tasks.workunit.client.0.smithi001.stdout:1/624: fsync d3/dd/d3c/f43 0 2024-09-15T22:26:48.032 INFO:tasks.workunit.client.0.smithi001.stdout:1/625: truncate d3/d8d/fc2 641989 0 2024-09-15T22:26:48.032 INFO:tasks.workunit.client.0.smithi001.stdout:1/626: readlink d3/d12/d21/d82/l9e 0 2024-09-15T22:26:48.041 INFO:tasks.workunit.client.0.smithi001.stdout:3/612: rmdir da/d3d/d43/d7c/d53/d73 39 2024-09-15T22:26:48.041 INFO:tasks.workunit.client.0.smithi001.stdout:6/576: creat d0/d6/d5d/d67/d53/fcd x:0 0 0 2024-09-15T22:26:48.043 INFO:tasks.workunit.client.0.smithi001.stdout:7/602: write d0/d7/d44/f28 [3217525,74083] 0 2024-09-15T22:26:48.043 INFO:tasks.workunit.client.0.smithi001.stdout:2/570: dwrite d2/d14/d1a/d1b/d82/fb8 [0,4194304] 0 2024-09-15T22:26:48.043 INFO:tasks.workunit.client.0.smithi001.stdout:2/571: read d2/d12/d62/d64/f13 [1744067,106086] 0 2024-09-15T22:26:48.043 INFO:tasks.workunit.client.0.smithi001.stdout:2/572: write d2/d14/d1a/d8a/fbc [180015,82519] 0 2024-09-15T22:26:48.053 INFO:tasks.workunit.client.0.smithi001.stdout:8/550: dread d9/f11 [0,4194304] 0 2024-09-15T22:26:48.053 INFO:tasks.workunit.client.0.smithi001.stdout:6/577: creat d0/df/d24/d49/dc7/fce x:0 0 0 2024-09-15T22:26:48.056 INFO:tasks.workunit.client.0.smithi001.stdout:7/603: rename d0/l6d to d0/d7/d21/d6b/d93/lc9 0 2024-09-15T22:26:48.056 INFO:tasks.workunit.client.0.smithi001.stdout:7/604: dread - d0/d7/d44/d36/f64 zero size 2024-09-15T22:26:48.056 INFO:tasks.workunit.client.0.smithi001.stdout:8/551: mknod d9/d19/d58/d8e/ca5 0 2024-09-15T22:26:48.056 INFO:tasks.workunit.client.0.smithi001.stdout:8/552: chown d9/d19/d40/d5f/d61/d9f 13 1 2024-09-15T22:26:48.058 INFO:tasks.workunit.client.0.smithi001.stdout:6/578: creat d0/d6/d5d/d67/fcf x:0 0 0 2024-09-15T22:26:48.058 INFO:tasks.workunit.client.0.smithi001.stdout:7/605: creat d0/d98/fca x:0 0 0 2024-09-15T22:26:48.062 INFO:tasks.workunit.client.0.smithi001.stdout:0/507: dwrite d0/dd/f47 [0,4194304] 0 2024-09-15T22:26:48.064 INFO:tasks.workunit.client.0.smithi001.stdout:2/573: write d2/f10 [1786729,75546] 0 2024-09-15T22:26:48.064 INFO:tasks.workunit.client.0.smithi001.stdout:2/574: readlink d2/d12/d62/d64/d76/l81 0 2024-09-15T22:26:48.064 INFO:tasks.workunit.client.0.smithi001.stdout:7/606: symlink d0/d7/d21/d6b/d93/lcb 0 2024-09-15T22:26:48.064 INFO:tasks.workunit.client.0.smithi001.stdout:7/607: fdatasync d0/d7/d44/f74 0 2024-09-15T22:26:48.064 INFO:tasks.workunit.client.0.smithi001.stdout:0/508: link d0/c12 d0/d6/d77/c9e 0 2024-09-15T22:26:48.065 INFO:tasks.workunit.client.0.smithi001.stdout:7/608: creat d0/d7/d2e/d60/dbd/fcc x:0 0 0 2024-09-15T22:26:48.072 INFO:tasks.workunit.client.0.smithi001.stdout:7/609: rmdir d0/d7/d44/d3f/d49/d4f 39 2024-09-15T22:26:48.073 INFO:tasks.workunit.client.0.smithi001.stdout:8/553: truncate d9/d19/d29/d33/d63/f6a 2413924 0 2024-09-15T22:26:48.073 INFO:tasks.workunit.client.0.smithi001.stdout:7/610: mknod d0/d7/d44/d36/ccd 0 2024-09-15T22:26:48.074 INFO:tasks.workunit.client.0.smithi001.stdout:7/611: write d0/d7/d21/f9b [729995,44684] 0 2024-09-15T22:26:48.076 INFO:tasks.workunit.client.0.smithi001.stdout:8/554: symlink d9/d19/d29/d50/d70/d76/d7d/la6 0 2024-09-15T22:26:48.077 INFO:tasks.workunit.client.0.smithi001.stdout:7/612: link d0/l5 d0/d7/d44/d3f/lce 0 2024-09-15T22:26:48.078 INFO:tasks.workunit.client.0.smithi001.stdout:8/555: rename d9/d19/d34/c69 to d9/d19/d58/d8e/d9c/ca7 0 2024-09-15T22:26:48.083 INFO:tasks.workunit.client.0.smithi001.stdout:8/556: symlink d9/d19/d34/d41/la8 0 2024-09-15T22:26:48.083 INFO:tasks.workunit.client.0.smithi001.stdout:8/557: fsync d9/d19/d58/d88/f9b 0 2024-09-15T22:26:48.083 INFO:tasks.workunit.client.0.smithi001.stdout:8/558: dread - d9/d19/d29/f45 zero size 2024-09-15T22:26:48.083 INFO:tasks.workunit.client.0.smithi001.stdout:8/559: chown d9/d19/d29/d50/f52 22 1 2024-09-15T22:26:48.090 INFO:tasks.workunit.client.0.smithi001.stdout:0/509: dread d0/dd/d1b/f5e [0,4194304] 0 2024-09-15T22:26:48.090 INFO:tasks.workunit.client.0.smithi001.stdout:0/510: dread - d0/dd/d33/f90 zero size 2024-09-15T22:26:48.092 INFO:tasks.workunit.client.0.smithi001.stdout:0/511: rmdir d0/d9/db 39 2024-09-15T22:26:48.093 INFO:tasks.workunit.client.0.smithi001.stdout:8/560: write d9/d19/d34/f47 [823581,119490] 0 2024-09-15T22:26:48.095 INFO:tasks.workunit.client.0.smithi001.stdout:8/561: rename d9/f3a to d9/d19/d29/d33/d63/fa9 0 2024-09-15T22:26:48.097 INFO:tasks.workunit.client.0.smithi001.stdout:8/562: truncate d9/d19/d58/f30 915281 0 2024-09-15T22:26:48.097 INFO:tasks.workunit.client.0.smithi001.stdout:8/563: fdatasync d9/d19/d29/d50/d89/f92 0 2024-09-15T22:26:48.098 INFO:tasks.workunit.client.0.smithi001.stdout:8/564: symlink d9/d19/laa 0 2024-09-15T22:26:48.101 INFO:tasks.workunit.client.0.smithi001.stdout:1/627: dwrite d3/dd/d3c/d64/f7e [0,4194304] 0 2024-09-15T22:26:48.102 INFO:tasks.workunit.client.0.smithi001.stdout:8/565: creat d9/d19/d58/d8e/fab x:0 0 0 2024-09-15T22:26:48.103 INFO:tasks.workunit.client.0.smithi001.stdout:1/628: mknod d3/d12/cc5 0 2024-09-15T22:26:48.104 INFO:tasks.workunit.client.0.smithi001.stdout:8/566: rmdir d9/d19/d29/d50/d70/d76/d7d 39 2024-09-15T22:26:48.106 INFO:tasks.workunit.client.0.smithi001.stdout:8/567: creat d9/d19/d58/d8e/fac x:0 0 0 2024-09-15T22:26:48.106 INFO:tasks.workunit.client.0.smithi001.stdout:8/568: chown d9/d19/d29/d35/f8f 49614869 1 2024-09-15T22:26:48.106 INFO:tasks.workunit.client.0.smithi001.stdout:8/569: stat d9/f59 0 2024-09-15T22:26:48.106 INFO:tasks.workunit.client.0.smithi001.stdout:8/570: write d9/d19/f3d [3288848,93061] 0 2024-09-15T22:26:48.107 INFO:tasks.workunit.client.0.smithi001.stdout:8/571: mknod d9/d19/cad 0 2024-09-15T22:26:48.108 INFO:tasks.workunit.client.0.smithi001.stdout:6/579: dwrite d0/df/d24/f34 [0,4194304] 0 2024-09-15T22:26:48.108 INFO:tasks.workunit.client.0.smithi001.stdout:6/580: dread - d0/df/f89 zero size 2024-09-15T22:26:48.108 INFO:tasks.workunit.client.0.smithi001.stdout:6/581: chown d0/d6/d5d/d67/f44 0 1 2024-09-15T22:26:48.108 INFO:tasks.workunit.client.0.smithi001.stdout:6/582: dread - d0/d7e/fba zero size 2024-09-15T22:26:48.108 INFO:tasks.workunit.client.0.smithi001.stdout:6/583: truncate d0/d6/d5d/d67/fcf 788348 0 2024-09-15T22:26:48.108 INFO:tasks.workunit.client.0.smithi001.stdout:8/572: truncate d9/d19/d34/d41/f6e 900340 0 2024-09-15T22:26:48.109 INFO:tasks.workunit.client.0.smithi001.stdout:0/512: dread d0/d6/f2a [0,4194304] 0 2024-09-15T22:26:48.110 INFO:tasks.workunit.client.0.smithi001.stdout:3/613: dwrite da/d3d/d43/f5a [4194304,4194304] 0 2024-09-15T22:26:48.111 INFO:tasks.workunit.client.0.smithi001.stdout:0/513: rmdir d0/d6/d77/d78 39 2024-09-15T22:26:48.111 INFO:tasks.workunit.client.0.smithi001.stdout:9/523: sync 2024-09-15T22:26:48.111 INFO:tasks.workunit.client.0.smithi001.stdout:4/725: sync 2024-09-15T22:26:48.112 INFO:tasks.workunit.client.0.smithi001.stdout:0/514: write d0/d9/db/f83 [809171,113103] 0 2024-09-15T22:26:48.113 INFO:tasks.workunit.client.0.smithi001.stdout:4/726: creat d0/d5d/d7c/dba/d20/d29/d34/f10b x:0 0 0 2024-09-15T22:26:48.113 INFO:tasks.workunit.client.0.smithi001.stdout:4/727: truncate d0/d5d/d7c/dba/d20/d29/d40/f90 1042903 0 2024-09-15T22:26:48.114 INFO:tasks.workunit.client.0.smithi001.stdout:3/614: creat da/d90/d6f/dc7/fd0 x:0 0 0 2024-09-15T22:26:48.114 INFO:tasks.workunit.client.0.smithi001.stdout:3/615: stat da/d3b/d1b/c34 0 2024-09-15T22:26:48.116 INFO:tasks.workunit.client.0.smithi001.stdout:9/524: symlink d5/de/d15/d27/d63/l9d 0 2024-09-15T22:26:48.118 INFO:tasks.workunit.client.0.smithi001.stdout:0/515: rename d0/dd/d1b/f72 to d0/d84/f9f 0 2024-09-15T22:26:48.118 INFO:tasks.workunit.client.0.smithi001.stdout:0/516: readlink d0/d9/d1a/d70/l8a 0 2024-09-15T22:26:48.118 INFO:tasks.workunit.client.0.smithi001.stdout:3/616: mkdir da/d3d/d43/d7c/d3f/db5/dd1 0 2024-09-15T22:26:48.120 INFO:tasks.workunit.client.0.smithi001.stdout:3/617: rename da/d3d/d43/d41/d70/f84 to da/d3d/d43/d7c/d53/fd2 0 2024-09-15T22:26:48.120 INFO:tasks.workunit.client.0.smithi001.stdout:3/618: read - da/dae/f83 zero size 2024-09-15T22:26:48.122 INFO:tasks.workunit.client.0.smithi001.stdout:3/619: creat da/d90/d6f/dc7/fd3 x:0 0 0 2024-09-15T22:26:48.122 INFO:tasks.workunit.client.0.smithi001.stdout:3/620: write da/d3d/d43/d7c/d53/fd2 [1091325,29237] 0 2024-09-15T22:26:48.124 INFO:tasks.workunit.client.0.smithi001.stdout:3/621: unlink da/d3d/d43/l85 0 2024-09-15T22:26:48.126 INFO:tasks.workunit.client.0.smithi001.stdout:2/575: dwrite d2/d12/d62/d4c/d9d/f9e [0,4194304] 0 2024-09-15T22:26:48.126 INFO:tasks.workunit.client.0.smithi001.stdout:3/622: symlink da/d90/da3/ld4 0 2024-09-15T22:26:48.132 INFO:tasks.workunit.client.0.smithi001.stdout:6/584: dread d0/d6/d5d/d67/d53/f72 [0,4194304] 0 2024-09-15T22:26:48.132 INFO:tasks.workunit.client.0.smithi001.stdout:6/585: write d0/d7e/fa2 [417662,3950] 0 2024-09-15T22:26:48.133 INFO:tasks.workunit.client.0.smithi001.stdout:6/586: dread - d0/d6/d5d/da6/fc9 zero size 2024-09-15T22:26:48.133 INFO:tasks.workunit.client.0.smithi001.stdout:6/587: truncate d0/d6/d5d/d8c/f8e 4344813 0 2024-09-15T22:26:48.133 INFO:tasks.workunit.client.0.smithi001.stdout:3/623: creat da/d3b/d1b/dcf/fd5 x:0 0 0 2024-09-15T22:26:48.133 INFO:tasks.workunit.client.0.smithi001.stdout:4/728: write d0/d27/d35/f69 [5837689,62218] 0 2024-09-15T22:26:48.133 INFO:tasks.workunit.client.0.smithi001.stdout:3/624: fdatasync da/d9e/fa4 0 2024-09-15T22:26:48.133 INFO:tasks.workunit.client.0.smithi001.stdout:3/625: readlink da/d3d/d43/d41/lc2 0 2024-09-15T22:26:48.133 INFO:tasks.workunit.client.0.smithi001.stdout:4/729: truncate d0/d27/d94/ff8 573674 0 2024-09-15T22:26:48.133 INFO:tasks.workunit.client.0.smithi001.stdout:2/576: rmdir d2/d12/d62/db9 0 2024-09-15T22:26:48.134 INFO:tasks.workunit.client.0.smithi001.stdout:3/626: link da/d3d/d43/d41/fc8 da/d3d/d43/d7c/d53/fd6 0 2024-09-15T22:26:48.137 INFO:tasks.workunit.client.0.smithi001.stdout:3/627: truncate da/d16/f4b 2808799 0 2024-09-15T22:26:48.137 INFO:tasks.workunit.client.0.smithi001.stdout:3/628: readlink da/dae/l68 0 2024-09-15T22:26:48.145 INFO:tasks.workunit.client.0.smithi001.stdout:7/613: dwrite d0/d7/d44/f47 [4194304,4194304] 0 2024-09-15T22:26:48.152 INFO:tasks.workunit.client.0.smithi001.stdout:3/629: write da/d16/fba [566095,54995] 0 2024-09-15T22:26:48.153 INFO:tasks.workunit.client.0.smithi001.stdout:3/630: mknod da/dae/d8e/cd7 0 2024-09-15T22:26:48.154 INFO:tasks.workunit.client.0.smithi001.stdout:3/631: getdents da/d3d/d43/d41 0 2024-09-15T22:26:48.154 INFO:tasks.workunit.client.0.smithi001.stdout:3/632: write da/d1f/f5c [380909,89840] 0 2024-09-15T22:26:48.170 INFO:tasks.workunit.client.0.smithi001.stdout:3/633: dread da/f13 [0,4194304] 0 2024-09-15T22:26:48.183 INFO:tasks.workunit.client.0.smithi001.stdout:0/517: dwrite d0/d9/db/d5d/f76 [0,4194304] 0 2024-09-15T22:26:48.183 INFO:tasks.workunit.client.0.smithi001.stdout:0/518: read - d0/d9/db/f80 zero size 2024-09-15T22:26:48.183 INFO:tasks.workunit.client.0.smithi001.stdout:0/519: read - d0/dd/f9d zero size 2024-09-15T22:26:48.184 INFO:tasks.workunit.client.0.smithi001.stdout:3/634: dread da/d16/f4b [0,4194304] 0 2024-09-15T22:26:48.184 INFO:tasks.workunit.client.0.smithi001.stdout:3/635: chown da/d3d/d43/c42 4276520 1 2024-09-15T22:26:48.185 INFO:tasks.workunit.client.0.smithi001.stdout:0/520: creat d0/d9/db/d5d/d79/fa0 x:0 0 0 2024-09-15T22:26:48.186 INFO:tasks.workunit.client.0.smithi001.stdout:3/636: mknod da/d3d/d43/d7c/d3f/db5/cd8 0 2024-09-15T22:26:48.206 INFO:tasks.workunit.client.0.smithi001.stdout:6/588: dwrite d0/df/d24/d49/f56 [0,4194304] 0 2024-09-15T22:26:48.208 INFO:tasks.workunit.client.0.smithi001.stdout:6/589: getdents d0/d6/d5d/da6 0 2024-09-15T22:26:48.210 INFO:tasks.workunit.client.0.smithi001.stdout:0/521: dread d0/d6/d77/d78/f85 [0,4194304] 0 2024-09-15T22:26:48.210 INFO:tasks.workunit.client.0.smithi001.stdout:6/590: link d0/df/d24/d2e/d43/l35 d0/d7e/ld0 0 2024-09-15T22:26:48.210 INFO:tasks.workunit.client.0.smithi001.stdout:6/591: chown d0/df/d24/l52 25 1 2024-09-15T22:26:48.210 INFO:tasks.workunit.client.0.smithi001.stdout:6/592: chown d0/df/d24/c96 213690 1 2024-09-15T22:26:48.211 INFO:tasks.workunit.client.0.smithi001.stdout:7/614: dwrite d0/d8e/f37 [4194304,4194304] 0 2024-09-15T22:26:48.211 INFO:tasks.workunit.client.0.smithi001.stdout:0/522: mkdir d0/d6/d77/d78/da1 0 2024-09-15T22:26:48.212 INFO:tasks.workunit.client.0.smithi001.stdout:8/573: dwrite d9/fb [4194304,4194304] 0 2024-09-15T22:26:48.212 INFO:tasks.workunit.client.0.smithi001.stdout:8/574: truncate d9/d19/d58/d8e/fab 299669 0 2024-09-15T22:26:48.212 INFO:tasks.workunit.client.0.smithi001.stdout:8/575: read - d9/d19/d29/d50/d70/d76/f7a zero size 2024-09-15T22:26:48.212 INFO:tasks.workunit.client.0.smithi001.stdout:6/593: mknod d0/d6/d5d/d67/dc4/cd1 0 2024-09-15T22:26:48.215 INFO:tasks.workunit.client.0.smithi001.stdout:7/615: creat d0/d7/d44/d3f/d49/da5/fcf x:0 0 0 2024-09-15T22:26:48.219 INFO:tasks.workunit.client.0.smithi001.stdout:7/616: rmdir d0/d7/d7c 39 2024-09-15T22:26:48.223 INFO:tasks.workunit.client.0.smithi001.stdout:2/577: dwrite d2/d12/d62/d64/fad [0,4194304] 0 2024-09-15T22:26:48.228 INFO:tasks.workunit.client.0.smithi001.stdout:6/594: write d0/d6/d5d/d67/f54 [1007451,44670] 0 2024-09-15T22:26:48.228 INFO:tasks.workunit.client.0.smithi001.stdout:6/595: dread - d0/df/d24/fad zero size 2024-09-15T22:26:48.238 INFO:tasks.workunit.client.0.smithi001.stdout:1/629: dwrite d3/d12/f40 [0,4194304] 0 2024-09-15T22:26:48.239 INFO:tasks.workunit.client.0.smithi001.stdout:9/525: dwrite d5/de/d1a/d1b/d2a/f78 [0,4194304] 0 2024-09-15T22:26:48.240 INFO:tasks.workunit.client.0.smithi001.stdout:9/526: fdatasync d5/de/d1a/d1b/d22/d2c/d21/d4d/f5d 0 2024-09-15T22:26:48.241 INFO:tasks.workunit.client.0.smithi001.stdout:2/578: dread d2/d14/d1a/d1b/d82/d97/da2/f25 [0,4194304] 0 2024-09-15T22:26:48.266 INFO:tasks.workunit.client.0.smithi001.stdout:2/579: dread d2/d14/d1a/f69 [0,4194304] 0 2024-09-15T22:26:48.266 INFO:tasks.workunit.client.0.smithi001.stdout:2/580: chown d2/d14/d1a/d1b/d82/d97/c6a 7169975 1 2024-09-15T22:26:48.282 INFO:tasks.workunit.client.0.smithi001.stdout:8/576: dwrite d9/d19/d34/f47 [0,4194304] 0 2024-09-15T22:26:48.283 INFO:tasks.workunit.client.0.smithi001.stdout:8/577: creat d9/d19/d58/d8e/d9c/fae x:0 0 0 2024-09-15T22:26:48.289 INFO:tasks.workunit.client.0.smithi001.stdout:4/730: dwrite d0/d5d/d7c/dba/d20/d29/d40/f5a [0,4194304] 0 2024-09-15T22:26:48.291 INFO:tasks.workunit.client.0.smithi001.stdout:4/731: creat d0/d5d/d7c/de8/dec/d107/f10c x:0 0 0 2024-09-15T22:26:48.293 INFO:tasks.workunit.client.0.smithi001.stdout:4/732: truncate d0/fea 1789371 0 2024-09-15T22:26:48.293 INFO:tasks.workunit.client.0.smithi001.stdout:4/733: write d0/d27/d35/d59/d67/d7b/f87 [1306171,83052] 0 2024-09-15T22:26:48.306 INFO:tasks.workunit.client.0.smithi001.stdout:7/617: dwrite d0/d7/d44/d3f/faf [0,4194304] 0 2024-09-15T22:26:48.306 INFO:tasks.workunit.client.0.smithi001.stdout:8/578: dread d9/d19/d34/f47 [0,4194304] 0 2024-09-15T22:26:48.307 INFO:tasks.workunit.client.0.smithi001.stdout:1/630: dwrite d3/dd/d86/fbf [0,4194304] 0 2024-09-15T22:26:48.307 INFO:tasks.workunit.client.0.smithi001.stdout:0/523: dwrite d0/d9/f1c [0,4194304] 0 2024-09-15T22:26:48.307 INFO:tasks.workunit.client.0.smithi001.stdout:6/596: dwrite d0/d6/d5d/d67/d53/f65 [0,4194304] 0 2024-09-15T22:26:48.308 INFO:tasks.workunit.client.0.smithi001.stdout:7/618: unlink d0/l46 0 2024-09-15T22:26:48.309 INFO:tasks.workunit.client.0.smithi001.stdout:9/527: dwrite d5/de/d1a/f56 [0,4194304] 0 2024-09-15T22:26:48.309 INFO:tasks.workunit.client.0.smithi001.stdout:9/528: write d5/de/d1a/d1b/d22/d2c/d21/f8e [580659,10103] 0 2024-09-15T22:26:48.310 INFO:tasks.workunit.client.0.smithi001.stdout:1/631: mkdir d3/dd/d14/d23/da1/dc6 0 2024-09-15T22:26:48.310 INFO:tasks.workunit.client.0.smithi001.stdout:8/579: creat d9/d19/d58/d8e/d9c/faf x:0 0 0 2024-09-15T22:26:48.311 INFO:tasks.workunit.client.0.smithi001.stdout:1/632: mkdir d3/dd/d53/dc7 0 2024-09-15T22:26:48.312 INFO:tasks.workunit.client.0.smithi001.stdout:1/633: dread - d3/dd/d14/d1b/d2b/f61 zero size 2024-09-15T22:26:48.315 INFO:tasks.workunit.client.0.smithi001.stdout:0/524: link d0/dd/c20 d0/d6/ca2 0 2024-09-15T22:26:48.315 INFO:tasks.workunit.client.0.smithi001.stdout:6/597: symlink d0/df/d24/d2e/d43/d30/da7/ld2 0 2024-09-15T22:26:48.316 INFO:tasks.workunit.client.0.smithi001.stdout:6/598: chown d0/df/d24/l52 130948 1 2024-09-15T22:26:48.316 INFO:tasks.workunit.client.0.smithi001.stdout:1/634: dread d3/dd/d14/d1b/f3b [0,4194304] 0 2024-09-15T22:26:48.317 INFO:tasks.workunit.client.0.smithi001.stdout:1/635: truncate d3/d8d/dae/f70 5072400 0 2024-09-15T22:26:48.319 INFO:tasks.workunit.client.0.smithi001.stdout:7/619: unlink d0/d7/d44/l6c 0 2024-09-15T22:26:48.320 INFO:tasks.workunit.client.0.smithi001.stdout:9/529: mknod d5/d3e/c9e 0 2024-09-15T22:26:48.321 INFO:tasks.workunit.client.0.smithi001.stdout:8/580: symlink d9/d19/d58/d88/lb0 0 2024-09-15T22:26:48.321 INFO:tasks.workunit.client.0.smithi001.stdout:8/581: readlink d9/d19/d58/d88/lb0 0 2024-09-15T22:26:48.322 INFO:tasks.workunit.client.0.smithi001.stdout:2/581: dwrite d2/f10 [0,4194304] 0 2024-09-15T22:26:48.324 INFO:tasks.workunit.client.0.smithi001.stdout:0/525: creat d0/d9/db/d5d/fa3 x:0 0 0 2024-09-15T22:26:48.324 INFO:tasks.workunit.client.0.smithi001.stdout:6/599: fsync d0/df/d24/d2e/d43/f59 0 2024-09-15T22:26:48.324 INFO:tasks.workunit.client.0.smithi001.stdout:7/620: mknod d0/db3/cd0 0 2024-09-15T22:26:48.325 INFO:tasks.workunit.client.0.smithi001.stdout:0/526: chown d0/d6/d77/l98 14157 1 2024-09-15T22:26:48.325 INFO:tasks.workunit.client.0.smithi001.stdout:6/600: dread - d0/d6/f71 zero size 2024-09-15T22:26:48.325 INFO:tasks.workunit.client.0.smithi001.stdout:8/582: rmdir d9/d19/d29/d50/d70/d76/d7d 39 2024-09-15T22:26:48.325 INFO:tasks.workunit.client.0.smithi001.stdout:8/583: stat d9/d19/d34/da4 0 2024-09-15T22:26:48.326 INFO:tasks.workunit.client.0.smithi001.stdout:2/582: mknod d2/d12/d62/d64/d76/db4/cc1 0 2024-09-15T22:26:48.327 INFO:tasks.workunit.client.0.smithi001.stdout:2/583: symlink d2/d12/d62/d64/d76/db4/lc2 0 2024-09-15T22:26:48.328 INFO:tasks.workunit.client.0.smithi001.stdout:2/584: getdents d2/d14 0 2024-09-15T22:26:48.329 INFO:tasks.workunit.client.0.smithi001.stdout:6/601: symlink d0/df/d24/d2e/d43/d30/da7/ld3 0 2024-09-15T22:26:48.330 INFO:tasks.workunit.client.0.smithi001.stdout:2/585: creat d2/d14/d1a/d1b/d82/d97/da2/fc3 x:0 0 0 2024-09-15T22:26:48.333 INFO:tasks.workunit.client.0.smithi001.stdout:2/586: rename d2/d14/d1a/d1b/d82/d97/da2/l6c to d2/d12/d62/lc4 0 2024-09-15T22:26:48.333 INFO:tasks.workunit.client.0.smithi001.stdout:2/587: write d2/d12/d62/d64/f19 [5100356,31928] 0 2024-09-15T22:26:48.336 INFO:tasks.workunit.client.0.smithi001.stdout:2/588: write d2/d14/f6e [195484,107110] 0 2024-09-15T22:26:48.341 INFO:tasks.workunit.client.0.smithi001.stdout:1/636: write d3/dd/d3c/d64/f7e [3096435,930] 0 2024-09-15T22:26:48.341 INFO:tasks.workunit.client.0.smithi001.stdout:1/637: write d3/dd/d14/f1c [2366933,83892] 0 2024-09-15T22:26:48.342 INFO:tasks.workunit.client.0.smithi001.stdout:5/634: sync 2024-09-15T22:26:48.344 INFO:tasks.workunit.client.0.smithi001.stdout:3/637: sync 2024-09-15T22:26:48.346 INFO:tasks.workunit.client.0.smithi001.stdout:1/638: creat d3/d12/d79/d89/fc8 x:0 0 0 2024-09-15T22:26:48.351 INFO:tasks.workunit.client.0.smithi001.stdout:0/527: dread d0/d9/db/d5d/f76 [0,4194304] 0 2024-09-15T22:26:48.352 INFO:tasks.workunit.client.0.smithi001.stdout:5/635: symlink d3/d6/d41/d4d/dbe/d56/d52/d9f/da4/ld0 0 2024-09-15T22:26:48.353 INFO:tasks.workunit.client.0.smithi001.stdout:0/528: symlink d0/dd/d33/la4 0 2024-09-15T22:26:48.353 INFO:tasks.workunit.client.0.smithi001.stdout:0/529: write d0/d9/d1a/f58 [1443688,48425] 0 2024-09-15T22:26:48.353 INFO:tasks.workunit.client.0.smithi001.stdout:0/530: chown d0/d51 453529490 1 2024-09-15T22:26:48.354 INFO:tasks.workunit.client.0.smithi001.stdout:5/636: mknod d3/d6/d41/d4d/dbe/d56/d52/db8/cd1 0 2024-09-15T22:26:48.354 INFO:tasks.workunit.client.0.smithi001.stdout:5/637: readlink d3/d6/d41/d4d/dbe/l5d 0 2024-09-15T22:26:48.357 INFO:tasks.workunit.client.0.smithi001.stdout:0/531: creat d0/d9/db/d5d/d79/fa5 x:0 0 0 2024-09-15T22:26:48.368 INFO:tasks.workunit.client.0.smithi001.stdout:9/530: dwrite d5/f59 [0,4194304] 0 2024-09-15T22:26:48.370 INFO:tasks.workunit.client.0.smithi001.stdout:9/531: mkdir d5/de/d51/d53/d9f 0 2024-09-15T22:26:48.377 INFO:tasks.workunit.client.0.smithi001.stdout:2/589: dread d2/d12/d62/d64/f60 [0,4194304] 0 2024-09-15T22:26:48.377 INFO:tasks.workunit.client.0.smithi001.stdout:2/590: readlink d2/d14/d1a/l87 0 2024-09-15T22:26:48.377 INFO:tasks.workunit.client.0.smithi001.stdout:2/591: write d2/d12/d62/f2c [4261814,27088] 0 2024-09-15T22:26:48.380 INFO:tasks.workunit.client.0.smithi001.stdout:5/638: dread d3/d6/d41/f4c [0,4194304] 0 2024-09-15T22:26:48.381 INFO:tasks.workunit.client.0.smithi001.stdout:5/639: mknod d3/d6/d57/d87/d8c/cd2 0 2024-09-15T22:26:48.382 INFO:tasks.workunit.client.0.smithi001.stdout:5/640: creat d3/d27/d4e/d89/dae/fd3 x:0 0 0 2024-09-15T22:26:48.382 INFO:tasks.workunit.client.0.smithi001.stdout:5/641: write d3/d6/d57/f7c [170490,77573] 0 2024-09-15T22:26:48.383 INFO:tasks.workunit.client.0.smithi001.stdout:5/642: getdents d3 0 2024-09-15T22:26:48.383 INFO:tasks.workunit.client.0.smithi001.stdout:5/643: chown d3/d6/d41/f4c 55225057 1 2024-09-15T22:26:48.385 INFO:tasks.workunit.client.0.smithi001.stdout:5/644: symlink d3/d6/d41/d4d/dbe/d56/d52/d9f/da4/ld4 0 2024-09-15T22:26:48.385 INFO:tasks.workunit.client.0.smithi001.stdout:6/602: dwrite d0/d7e/fba [0,4194304] 0 2024-09-15T22:26:48.394 INFO:tasks.workunit.client.0.smithi001.stdout:9/532: dread d5/de/d1a/d1b/d22/d2c/f6a [0,4194304] 0 2024-09-15T22:26:48.394 INFO:tasks.workunit.client.0.smithi001.stdout:9/533: chown d5/de/d1a/d1b/d22/d2c 249851 1 2024-09-15T22:26:48.396 INFO:tasks.workunit.client.0.smithi001.stdout:6/603: unlink d0/df/d24/d2e/fbd 0 2024-09-15T22:26:48.398 INFO:tasks.workunit.client.0.smithi001.stdout:6/604: creat d0/df/d24/fd4 x:0 0 0 2024-09-15T22:26:48.401 INFO:tasks.workunit.client.0.smithi001.stdout:7/621: dwrite d0/d6a/fbb [0,4194304] 0 2024-09-15T22:26:48.416 INFO:tasks.workunit.client.0.smithi001.stdout:3/638: dwrite da/d1f/f5c [0,4194304] 0 2024-09-15T22:26:48.416 INFO:tasks.workunit.client.0.smithi001.stdout:3/639: chown da/d16/l6d 0 1 2024-09-15T22:26:48.416 INFO:tasks.workunit.client.0.smithi001.stdout:3/640: chown da/d3d/d43/d7c 472997518 1 2024-09-15T22:26:48.417 INFO:tasks.workunit.client.0.smithi001.stdout:3/641: creat da/dae/fd9 x:0 0 0 2024-09-15T22:26:48.423 INFO:tasks.workunit.client.0.smithi001.stdout:7/622: dread d0/d7/d44/d3f/d49/da5/faa [0,4194304] 0 2024-09-15T22:26:48.425 INFO:tasks.workunit.client.0.smithi001.stdout:7/623: creat d0/d7/d7c/fd1 x:0 0 0 2024-09-15T22:26:48.426 INFO:tasks.workunit.client.0.smithi001.stdout:1/639: write d3/dd/f33 [2233263,55369] 0 2024-09-15T22:26:48.428 INFO:tasks.workunit.client.0.smithi001.stdout:1/640: truncate d3/dd/f38 649165 0 2024-09-15T22:26:48.428 INFO:tasks.workunit.client.0.smithi001.stdout:1/641: dread - d3/fac zero size 2024-09-15T22:26:48.432 INFO:tasks.workunit.client.0.smithi001.stdout:8/584: dwrite d9/d19/d34/f43 [0,4194304] 0 2024-09-15T22:26:48.433 INFO:tasks.workunit.client.0.smithi001.stdout:8/585: creat d9/d19/d58/d8e/fb1 x:0 0 0 2024-09-15T22:26:48.436 INFO:tasks.workunit.client.0.smithi001.stdout:8/586: rename d9/d19/d29/d50/d70/d76/f7a to d9/d19/d29/d50/d70/fb2 0 2024-09-15T22:26:48.436 INFO:tasks.workunit.client.0.smithi001.stdout:2/592: dwrite d2/d12/f59 [0,4194304] 0 2024-09-15T22:26:48.442 INFO:tasks.workunit.client.0.smithi001.stdout:9/534: dread d5/d3e/f52 [0,4194304] 0 2024-09-15T22:26:48.442 INFO:tasks.workunit.client.0.smithi001.stdout:0/532: dwrite d0/d6/d77/d78/f7a [0,4194304] 0 2024-09-15T22:26:48.442 INFO:tasks.workunit.client.0.smithi001.stdout:6/605: dwrite d0/df/d24/d2e/fbe [0,4194304] 0 2024-09-15T22:26:48.445 INFO:tasks.workunit.client.0.smithi001.stdout:0/533: creat d0/d6/d77/d78/fa6 x:0 0 0 2024-09-15T22:26:48.446 INFO:tasks.workunit.client.0.smithi001.stdout:6/606: symlink d0/df/d24/d49/ld5 0 2024-09-15T22:26:48.447 INFO:tasks.workunit.client.0.smithi001.stdout:6/607: mkdir d0/d6/d5d/d8c/dd6 0 2024-09-15T22:26:48.450 INFO:tasks.workunit.client.0.smithi001.stdout:2/593: dread d2/f43 [0,4194304] 0 2024-09-15T22:26:48.450 INFO:tasks.workunit.client.0.smithi001.stdout:2/594: read d2/f2b [482111,20334] 0 2024-09-15T22:26:48.450 INFO:tasks.workunit.client.0.smithi001.stdout:4/734: sync 2024-09-15T22:26:48.451 INFO:tasks.workunit.client.0.smithi001.stdout:4/735: truncate d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d73/dc0/fc5 2028113 0 2024-09-15T22:26:48.452 INFO:tasks.workunit.client.0.smithi001.stdout:4/736: mkdir d0/d27/d94/df9/d10d 0 2024-09-15T22:26:48.452 INFO:tasks.workunit.client.0.smithi001.stdout:2/595: rename d2/d14/d1a/d1b/d82/l8b to d2/d14/d1a/d8a/lc5 0 2024-09-15T22:26:48.452 INFO:tasks.workunit.client.0.smithi001.stdout:4/737: write d0/d5d/d7c/dba/d20/d29/d34/dbc/dbf/ff5 [126010,69192] 0 2024-09-15T22:26:48.452 INFO:tasks.workunit.client.0.smithi001.stdout:2/596: chown d2/d14/d1a/d1b/d82/d97/da2/ca4 653017 1 2024-09-15T22:26:48.453 INFO:tasks.workunit.client.0.smithi001.stdout:2/597: unlink d2/d12/d62/d64/f47 0 2024-09-15T22:26:48.454 INFO:tasks.workunit.client.0.smithi001.stdout:2/598: mknod d2/d14/d1a/d1b/d82/d97/d74/cc6 0 2024-09-15T22:26:48.454 INFO:tasks.workunit.client.0.smithi001.stdout:2/599: stat d2/d14/d1a/d8a/fbc 0 2024-09-15T22:26:48.455 INFO:tasks.workunit.client.0.smithi001.stdout:2/600: creat d2/d12/d62/d64/d76/d7f/fc7 x:0 0 0 2024-09-15T22:26:48.456 INFO:tasks.workunit.client.0.smithi001.stdout:3/642: dwrite da/d16/f4b [0,4194304] 0 2024-09-15T22:26:48.456 INFO:tasks.workunit.client.0.smithi001.stdout:3/643: readlink da/lab 0 2024-09-15T22:26:48.464 INFO:tasks.workunit.client.0.smithi001.stdout:2/601: mkdir d2/d12/dc8 0 2024-09-15T22:26:48.470 INFO:tasks.workunit.client.0.smithi001.stdout:2/602: rename d2/d14/d1a/d1b/d82/d97/da2 to d2/d14/d1a/d1b/d82/dc9 0 2024-09-15T22:26:48.471 INFO:tasks.workunit.client.0.smithi001.stdout:2/603: dread - d2/d14/d1a/d1b/d82/dc9/f95 zero size 2024-09-15T22:26:48.478 INFO:tasks.workunit.client.0.smithi001.stdout:6/608: dread d0/d6/d5d/d67/f4e [0,4194304] 0 2024-09-15T22:26:48.495 INFO:tasks.workunit.client.0.smithi001.stdout:1/642: dwrite d3/dd/f19 [12582912,4194304] 0 2024-09-15T22:26:48.495 INFO:tasks.workunit.client.0.smithi001.stdout:1/643: write d3/dd/d14/d1b/d2b/d68/fb5 [551726,111295] 0 2024-09-15T22:26:48.495 INFO:tasks.workunit.client.0.smithi001.stdout:1/644: dread - d3/dd/d14/d1b/fa8 zero size 2024-09-15T22:26:48.504 INFO:tasks.workunit.client.0.smithi001.stdout:1/645: creat d3/fc9 x:0 0 0 2024-09-15T22:26:48.505 INFO:tasks.workunit.client.0.smithi001.stdout:2/604: dread d2/d12/d62/d64/f2a [0,4194304] 0 2024-09-15T22:26:48.505 INFO:tasks.workunit.client.0.smithi001.stdout:2/605: dread - d2/d14/d1a/d1b/d82/dc9/fa3 zero size 2024-09-15T22:26:48.505 INFO:tasks.workunit.client.0.smithi001.stdout:2/606: fsync d2/d14/d1a/d8a/fbc 0 2024-09-15T22:26:48.506 INFO:tasks.workunit.client.0.smithi001.stdout:2/607: chown d2/d12/c3f 53246 1 2024-09-15T22:26:48.507 INFO:tasks.workunit.client.0.smithi001.stdout:9/535: dwrite d5/de/d1a/f88 [0,4194304] 0 2024-09-15T22:26:48.507 INFO:tasks.workunit.client.0.smithi001.stdout:9/536: readlink d5/de/d1a/d1b/d22/l95 0 2024-09-15T22:26:48.509 INFO:tasks.workunit.client.0.smithi001.stdout:6/609: write d0/df/d24/d2e/d43/f93 [5918364,49914] 0 2024-09-15T22:26:48.509 INFO:tasks.workunit.client.0.smithi001.stdout:6/610: write d0/d6/d5d/d67/d53/f8a [2362638,71364] 0 2024-09-15T22:26:48.510 INFO:tasks.workunit.client.0.smithi001.stdout:2/608: rename d2/d14/d1a/d1b/d82/dc9/c3b to d2/d12/d62/d4c/d9d/cca 0 2024-09-15T22:26:48.512 INFO:tasks.workunit.client.0.smithi001.stdout:3/644: dwrite da/d16/fba [0,4194304] 0 2024-09-15T22:26:48.515 INFO:tasks.workunit.client.0.smithi001.stdout:3/645: mkdir da/d90/da3/dda 0 2024-09-15T22:26:48.515 INFO:tasks.workunit.client.0.smithi001.stdout:3/646: write da/d3d/d43/f2a [226817,74549] 0 2024-09-15T22:26:48.519 INFO:tasks.workunit.client.0.smithi001.stdout:1/646: read d3/d12/d79/f81 [2915204,95043] 0 2024-09-15T22:26:48.538 INFO:tasks.workunit.client.0.smithi001.stdout:6/611: write d0/f5 [3714817,81923] 0 2024-09-15T22:26:48.538 INFO:tasks.workunit.client.0.smithi001.stdout:7/624: dwrite d0/d7/d7c/fd1 [0,4194304] 0 2024-09-15T22:26:48.540 INFO:tasks.workunit.client.0.smithi001.stdout:6/612: rename d0/df/d24/d49/la5 to d0/df/ld7 0 2024-09-15T22:26:48.540 INFO:tasks.workunit.client.0.smithi001.stdout:7/625: creat d0/d7/d21/d6b/fd2 x:0 0 0 2024-09-15T22:26:48.541 INFO:tasks.workunit.client.0.smithi001.stdout:2/609: dread d2/f10 [0,4194304] 0 2024-09-15T22:26:48.542 INFO:tasks.workunit.client.0.smithi001.stdout:6/613: rename d0/d6/d5d/d67/d53/da0/dc3 to d0/d6/d5d/dd8 0 2024-09-15T22:26:48.543 INFO:tasks.workunit.client.0.smithi001.stdout:2/610: mknod d2/d12/d62/ccb 0 2024-09-15T22:26:48.543 INFO:tasks.workunit.client.0.smithi001.stdout:4/738: dwrite d0/fea [0,4194304] 0 2024-09-15T22:26:48.546 INFO:tasks.workunit.client.0.smithi001.stdout:7/626: mkdir d0/dd3 0 2024-09-15T22:26:48.546 INFO:tasks.workunit.client.0.smithi001.stdout:6/614: creat d0/d7e/fd9 x:0 0 0 2024-09-15T22:26:48.550 INFO:tasks.workunit.client.0.smithi001.stdout:7/627: link d0/d7/d21/d6b/d93/lc9 d0/d7/d44/d96/ld4 0 2024-09-15T22:26:48.550 INFO:tasks.workunit.client.0.smithi001.stdout:6/615: link d0/d6/d5d/d67/fcf d0/d6/d5d/d67/d53/fda 0 2024-09-15T22:26:48.550 INFO:tasks.workunit.client.0.smithi001.stdout:6/616: getdents d0/d6/d5d/dd8 0 2024-09-15T22:26:48.552 INFO:tasks.workunit.client.0.smithi001.stdout:7/628: mkdir d0/d7/dd5 0 2024-09-15T22:26:48.552 INFO:tasks.workunit.client.0.smithi001.stdout:9/537: write d5/de/d1a/d1b/d22/d2c/d21/d4d/f5d [1714213,40988] 0 2024-09-15T22:26:48.552 INFO:tasks.workunit.client.0.smithi001.stdout:0/534: dwrite d0/dd/d33/f90 [0,4194304] 0 2024-09-15T22:26:48.552 INFO:tasks.workunit.client.0.smithi001.stdout:0/535: chown d0/d6/d77/d78/fa6 124201025 1 2024-09-15T22:26:48.553 INFO:tasks.workunit.client.0.smithi001.stdout:6/617: creat d0/df/fdb x:0 0 0 2024-09-15T22:26:48.559 INFO:tasks.workunit.client.0.smithi001.stdout:7/629: mkdir d0/db3/dd6 0 2024-09-15T22:26:48.560 INFO:tasks.workunit.client.0.smithi001.stdout:0/536: creat d0/d9/db/fa7 x:0 0 0 2024-09-15T22:26:48.560 INFO:tasks.workunit.client.0.smithi001.stdout:6/618: creat d0/d6/d5d/fdc x:0 0 0 2024-09-15T22:26:48.560 INFO:tasks.workunit.client.0.smithi001.stdout:4/739: dread d0/d5d/d7c/dba/f2d [0,4194304] 0 2024-09-15T22:26:48.563 INFO:tasks.workunit.client.0.smithi001.stdout:7/630: unlink d0/d7/d21/d6b/d93/lc9 0 2024-09-15T22:26:48.564 INFO:tasks.workunit.client.0.smithi001.stdout:6/619: mkdir d0/df/d24/d49/dc7/ddd 0 2024-09-15T22:26:48.567 INFO:tasks.workunit.client.0.smithi001.stdout:7/631: rename d0/d7/d2e/f9c to d0/d7/d44/d3f/fd7 0 2024-09-15T22:26:48.570 INFO:tasks.workunit.client.0.smithi001.stdout:6/620: rmdir d0/d6/d5d/d8c/dd6 0 2024-09-15T22:26:48.570 INFO:tasks.workunit.client.0.smithi001.stdout:6/621: fdatasync d0/f19 0 2024-09-15T22:26:48.570 INFO:tasks.workunit.client.0.smithi001.stdout:6/622: write d0/d6/d5d/f9e [1385567,19381] 0 2024-09-15T22:26:48.570 INFO:tasks.workunit.client.0.smithi001.stdout:6/623: dread - d0/d6/d5d/d67/f68 zero size 2024-09-15T22:26:48.584 INFO:tasks.workunit.client.0.smithi001.stdout:7/632: dread d0/f2f [0,4194304] 0 2024-09-15T22:26:48.585 INFO:tasks.workunit.client.0.smithi001.stdout:0/537: dread d0/dd/d33/f73 [0,4194304] 0 2024-09-15T22:26:48.586 INFO:tasks.workunit.client.0.smithi001.stdout:7/633: creat d0/db3/fd8 x:0 0 0 2024-09-15T22:26:48.588 INFO:tasks.workunit.client.0.smithi001.stdout:0/538: unlink d0/d6/d77/d78/f7a 0 2024-09-15T22:26:48.588 INFO:tasks.workunit.client.0.smithi001.stdout:0/539: chown d0/d9/db/c62 26049 1 2024-09-15T22:26:48.589 INFO:tasks.workunit.client.0.smithi001.stdout:0/540: unlink d0/dd/d1b/c48 0 2024-09-15T22:26:48.591 INFO:tasks.workunit.client.0.smithi001.stdout:0/541: creat d0/d9/d1a/fa8 x:0 0 0 2024-09-15T22:26:48.592 INFO:tasks.workunit.client.0.smithi001.stdout:0/542: unlink d0/d9/db/f80 0 2024-09-15T22:26:48.593 INFO:tasks.workunit.client.0.smithi001.stdout:0/543: rmdir d0/d6/d77/d78/da1 0 2024-09-15T22:26:48.594 INFO:tasks.workunit.client.0.smithi001.stdout:7/634: dread d0/d8e/f32 [0,4194304] 0 2024-09-15T22:26:48.595 INFO:tasks.workunit.client.0.smithi001.stdout:7/635: symlink d0/d7/d7c/ld9 0 2024-09-15T22:26:48.596 INFO:tasks.workunit.client.0.smithi001.stdout:7/636: write d0/d7/dc6/f9d [7190,61784] 0 2024-09-15T22:26:48.607 INFO:tasks.workunit.client.0.smithi001.stdout:4/740: dread d0/d5d/d44/d65/f7d [0,4194304] 0 2024-09-15T22:26:48.608 INFO:tasks.workunit.client.0.smithi001.stdout:4/741: creat d0/f10e x:0 0 0 2024-09-15T22:26:48.608 INFO:tasks.workunit.client.0.smithi001.stdout:4/742: fsync d0/f8e 0 2024-09-15T22:26:48.610 INFO:tasks.workunit.client.0.smithi001.stdout:3/647: dwrite da/d90/fb1 [0,4194304] 0 2024-09-15T22:26:48.610 INFO:tasks.workunit.client.0.smithi001.stdout:3/648: fdatasync da/d1f/f28 0 2024-09-15T22:26:48.613 INFO:tasks.workunit.client.0.smithi001.stdout:3/649: creat da/d3d/d43/d7c/d53/d73/fdb x:0 0 0 2024-09-15T22:26:48.613 INFO:tasks.workunit.client.0.smithi001.stdout:3/650: readlink da/dae/l93 0 2024-09-15T22:26:48.613 INFO:tasks.workunit.client.0.smithi001.stdout:3/651: dread - da/d3d/d43/d41/d70/d7f/fa0 zero size 2024-09-15T22:26:48.614 INFO:tasks.workunit.client.0.smithi001.stdout:3/652: mkdir da/d90/da3/dda/ddc 0 2024-09-15T22:26:48.614 INFO:tasks.workunit.client.0.smithi001.stdout:3/653: chown f8 21 1 2024-09-15T22:26:48.614 INFO:tasks.workunit.client.0.smithi001.stdout:2/611: dwrite d2/d12/f52 [0,4194304] 0 2024-09-15T22:26:48.618 INFO:tasks.workunit.client.0.smithi001.stdout:3/654: symlink da/d3d/d43/d41/d70/d7f/ldd 0 2024-09-15T22:26:48.618 INFO:tasks.workunit.client.0.smithi001.stdout:9/538: dwrite d5/de/d1a/d1b/d22/d2c/f31 [4194304,4194304] 0 2024-09-15T22:26:48.618 INFO:tasks.workunit.client.0.smithi001.stdout:9/539: fdatasync d5/de/d1a/d1b/d22/d2c/d21/d24/d86/f93 0 2024-09-15T22:26:48.618 INFO:tasks.workunit.client.0.smithi001.stdout:0/544: write d0/d6/f89 [5502208,68396] 0 2024-09-15T22:26:48.618 INFO:tasks.workunit.client.0.smithi001.stdout:0/545: chown d0/f50 14628144 1 2024-09-15T22:26:48.618 INFO:tasks.workunit.client.0.smithi001.stdout:9/540: link d5/de/d1a/d1b/d22/d2c/d21/d24/c34 d5/de/d1a/d1b/d22/d97/ca0 0 2024-09-15T22:26:48.620 INFO:tasks.workunit.client.0.smithi001.stdout:0/546: unlink d0/d6/d77/c9e 0 2024-09-15T22:26:48.621 INFO:tasks.workunit.client.0.smithi001.stdout:9/541: mkdir d5/de/d51/d53/d9f/da1 0 2024-09-15T22:26:48.624 INFO:tasks.workunit.client.0.smithi001.stdout:7/637: rename d0/d7/d44/d96 to d0/d6a/dac/dda 0 2024-09-15T22:26:48.624 INFO:tasks.workunit.client.0.smithi001.stdout:7/638: dread - d0/d7/d44/d3f/d49/fc7 zero size 2024-09-15T22:26:48.631 INFO:tasks.workunit.client.0.smithi001.stdout:4/743: write d0/d5d/fb4 [1860382,101905] 0 2024-09-15T22:26:48.631 INFO:tasks.workunit.client.0.smithi001.stdout:4/744: chown d0/d27/d94/d102 302343 1 2024-09-15T22:26:48.639 INFO:tasks.workunit.client.0.smithi001.stdout:4/745: symlink d0/d5d/d44/d65/l10f 0 2024-09-15T22:26:48.639 INFO:tasks.workunit.client.0.smithi001.stdout:4/746: chown d0/d5d/d7c/dba/d20/c4b 0 1 2024-09-15T22:26:48.641 INFO:tasks.workunit.client.0.smithi001.stdout:4/747: creat d0/d5d/d7c/dd1/f110 x:0 0 0 2024-09-15T22:26:48.641 INFO:tasks.workunit.client.0.smithi001.stdout:4/748: mknod d0/d5d/d44/d65/c111 0 2024-09-15T22:26:48.642 INFO:tasks.workunit.client.0.smithi001.stdout:4/749: truncate d0/f51 1543092 0 2024-09-15T22:26:48.644 INFO:tasks.workunit.client.0.smithi001.stdout:4/750: rename d0/d5d/d7c/dba/d20/d29/f109 to d0/d5d/d7c/de8/dec/d107/f112 0 2024-09-15T22:26:48.665 INFO:tasks.workunit.client.0.smithi001.stdout:2/612: dwrite d2/d14/d1a/d1b/d82/dc9/f95 [0,4194304] 0 2024-09-15T22:26:48.665 INFO:tasks.workunit.client.0.smithi001.stdout:2/613: write d2/d14/d1a/d1b/d82/dc9/f77 [3753330,129785] 0 2024-09-15T22:26:48.666 INFO:tasks.workunit.client.0.smithi001.stdout:2/614: creat d2/d12/d62/d4c/d9d/fcc x:0 0 0 2024-09-15T22:26:48.671 INFO:tasks.workunit.client.0.smithi001.stdout:9/542: dwrite d5/de/d15/d27/d63/f79 [0,4194304] 0 2024-09-15T22:26:48.673 INFO:tasks.workunit.client.0.smithi001.stdout:9/543: creat d5/de/d1a/d1b/d22/d2c/d21/d24/fa2 x:0 0 0 2024-09-15T22:26:48.673 INFO:tasks.workunit.client.0.smithi001.stdout:9/544: chown d5/de/d15/d27/d63/f7b 441302 1 2024-09-15T22:26:48.673 INFO:tasks.workunit.client.0.smithi001.stdout:9/545: chown d5/de/f9b 1004 1 2024-09-15T22:26:48.674 INFO:tasks.workunit.client.0.smithi001.stdout:9/546: getdents d5/de/d1a/d1b/d22/d2c/d21 0 2024-09-15T22:26:48.675 INFO:tasks.workunit.client.0.smithi001.stdout:7/639: dwrite d0/d7/d44/d3f/faf [4194304,4194304] 0 2024-09-15T22:26:48.678 INFO:tasks.workunit.client.0.smithi001.stdout:9/547: unlink d5/de/d1a/d1b/d22/d2c/d21/d24/fa2 0 2024-09-15T22:26:48.680 INFO:tasks.workunit.client.0.smithi001.stdout:2/615: dread d2/d14/d1a/d1b/d82/fb8 [0,4194304] 0 2024-09-15T22:26:48.680 INFO:tasks.workunit.client.0.smithi001.stdout:2/616: write d2/d14/d1a/d1b/f78 [4004991,108606] 0 2024-09-15T22:26:48.680 INFO:tasks.workunit.client.0.smithi001.stdout:2/617: readlink d2/d12/d62/lc4 0 2024-09-15T22:26:48.683 INFO:tasks.workunit.client.0.smithi001.stdout:2/618: truncate d2/d14/d1a/d1b/d82/dc9/f6b 253821 0 2024-09-15T22:26:48.684 INFO:tasks.workunit.client.0.smithi001.stdout:7/640: dread d0/d7/d21/f9b [0,4194304] 0 2024-09-15T22:26:48.684 INFO:tasks.workunit.client.0.smithi001.stdout:7/641: fsync d0/d7/d44/d3f/f75 0 2024-09-15T22:26:48.684 INFO:tasks.workunit.client.0.smithi001.stdout:2/619: rmdir d2/d12/dc8 0 2024-09-15T22:26:48.684 INFO:tasks.workunit.client.0.smithi001.stdout:7/642: symlink d0/d7/dd5/ldb 0 2024-09-15T22:26:48.684 INFO:tasks.workunit.client.0.smithi001.stdout:7/643: creat d0/d7/d44/d3f/d49/da5/fdc x:0 0 0 2024-09-15T22:26:48.693 INFO:tasks.workunit.client.0.smithi001.stdout:8/587: sync 2024-09-15T22:26:48.693 INFO:tasks.workunit.client.0.smithi001.stdout:5/645: sync 2024-09-15T22:26:48.693 INFO:tasks.workunit.client.0.smithi001.stdout:8/588: fsync d9/d19/d29/d50/f52 0 2024-09-15T22:26:48.697 INFO:tasks.workunit.client.0.smithi001.stdout:8/589: truncate d9/d19/f96 1719862 0 2024-09-15T22:26:48.697 INFO:tasks.workunit.client.0.smithi001.stdout:8/590: readlink l6 0 2024-09-15T22:26:48.697 INFO:tasks.workunit.client.0.smithi001.stdout:8/591: dread - d9/d19/d34/f4a zero size 2024-09-15T22:26:48.697 INFO:tasks.workunit.client.0.smithi001.stdout:8/592: stat d9/d19/d29/d50/d70/d76/d7d/c97 0 2024-09-15T22:26:48.698 INFO:tasks.workunit.client.0.smithi001.stdout:5/646: unlink d3/d1d/cbc 0 2024-09-15T22:26:48.698 INFO:tasks.workunit.client.0.smithi001.stdout:5/647: read d3/d6/d57/f7c [3201010,70799] 0 2024-09-15T22:26:48.701 INFO:tasks.workunit.client.0.smithi001.stdout:5/648: unlink d3/f16 0 2024-09-15T22:26:48.703 INFO:tasks.workunit.client.0.smithi001.stdout:5/649: rename d3/d6/d41/d4d/f73 to d3/d6/d41/d4d/dc0/fd5 0 2024-09-15T22:26:48.704 INFO:tasks.workunit.client.0.smithi001.stdout:9/548: dread d5/de/d15/d27/d63/f79 [0,4194304] 0 2024-09-15T22:26:48.705 INFO:tasks.workunit.client.0.smithi001.stdout:5/650: mkdir d3/d27/d5c/dd6 0 2024-09-15T22:26:48.705 INFO:tasks.workunit.client.0.smithi001.stdout:5/651: chown d3/d6/d41/d4d/d91 5492720 1 2024-09-15T22:26:48.706 INFO:tasks.workunit.client.0.smithi001.stdout:5/652: write d3/d6/d41/f9d [443063,11629] 0 2024-09-15T22:26:48.707 INFO:tasks.workunit.client.0.smithi001.stdout:9/549: creat d5/de/d1a/d1b/d22/d2c/d21/d23/d3d/fa3 x:0 0 0 2024-09-15T22:26:48.713 INFO:tasks.workunit.client.0.smithi001.stdout:9/550: getdents d5/de/d51/d53 0 2024-09-15T22:26:48.713 INFO:tasks.workunit.client.0.smithi001.stdout:9/551: chown d5/de/d15/l36 2472 1 2024-09-15T22:26:48.715 INFO:tasks.workunit.client.0.smithi001.stdout:9/552: unlink d5/de/d1a/d1b/d22/d2c/d21/d23/l7e 0 2024-09-15T22:26:48.715 INFO:tasks.workunit.client.0.smithi001.stdout:9/553: chown d5/de/d1a/d1b/d22/d2c/d21/d4d/c99 449176141 1 2024-09-15T22:26:48.720 INFO:tasks.workunit.client.0.smithi001.stdout:9/554: readlink d5/de/d1a/d1b/d22/d2c/l1f 0 2024-09-15T22:26:48.720 INFO:tasks.workunit.client.0.smithi001.stdout:3/655: dwrite f6 [0,4194304] 0 2024-09-15T22:26:48.724 INFO:tasks.workunit.client.0.smithi001.stdout:3/656: rename da/d3b/d8b/la9 to da/d3d/d43/d7c/d53/d72/lde 0 2024-09-15T22:26:48.746 INFO:tasks.workunit.client.0.smithi001.stdout:2/620: dwrite d2/d12/d62/d64/f19 [4194304,4194304] 0 2024-09-15T22:26:48.753 INFO:tasks.workunit.client.0.smithi001.stdout:5/653: dwrite d3/d49/fc1 [0,4194304] 0 2024-09-15T22:26:48.753 INFO:tasks.workunit.client.0.smithi001.stdout:5/654: chown d3/d6/d41/d4d/dbe/l5d 29368172 1 2024-09-15T22:26:48.756 INFO:tasks.workunit.client.0.smithi001.stdout:5/655: rename d3/d6/d41/d4d/dbe/d56/d52/c6c to d3/d6/d41/d4d/d5a/cd7 0 2024-09-15T22:26:48.779 INFO:tasks.workunit.client.0.smithi001.stdout:1/647: sync 2024-09-15T22:26:48.782 INFO:tasks.workunit.client.0.smithi001.stdout:1/648: link d3/dd/d3c/c5f d3/dd/d69/cca 0 2024-09-15T22:26:48.786 INFO:tasks.workunit.client.0.smithi001.stdout:8/593: dwrite d9/d19/d34/f47 [4194304,4194304] 0 2024-09-15T22:26:48.788 INFO:tasks.workunit.client.0.smithi001.stdout:7/644: dwrite d0/d7/d21/d6b/fba [0,4194304] 0 2024-09-15T22:26:48.791 INFO:tasks.workunit.client.0.smithi001.stdout:7/645: creat d0/d7/d2e/d60/dbd/fdd x:0 0 0 2024-09-15T22:26:48.791 INFO:tasks.workunit.client.0.smithi001.stdout:6/624: sync 2024-09-15T22:26:48.791 INFO:tasks.workunit.client.0.smithi001.stdout:7/646: write d0/d7/d44/d36/f83 [269856,122709] 0 2024-09-15T22:26:48.791 INFO:tasks.workunit.client.0.smithi001.stdout:7/647: fsync d0/d7/d44/d3f/fa6 0 2024-09-15T22:26:48.791 INFO:tasks.workunit.client.0.smithi001.stdout:7/648: chown d0/d7/d44/l31 93 1 2024-09-15T22:26:48.792 INFO:tasks.workunit.client.0.smithi001.stdout:7/649: symlink d0/d98/lde 0 2024-09-15T22:26:48.794 INFO:tasks.workunit.client.0.smithi001.stdout:3/657: dwrite da/d1f/fa2 [0,4194304] 0 2024-09-15T22:26:48.803 INFO:tasks.workunit.client.0.smithi001.stdout:2/621: dwrite d2/d12/d62/d64/fa5 [0,4194304] 0 2024-09-15T22:26:48.803 INFO:tasks.workunit.client.0.smithi001.stdout:6/625: dread d0/df/d24/d2e/d43/f59 [0,4194304] 0 2024-09-15T22:26:48.804 INFO:tasks.workunit.client.0.smithi001.stdout:6/626: creat d0/d6/fde x:0 0 0 2024-09-15T22:26:48.804 INFO:tasks.workunit.client.0.smithi001.stdout:2/622: unlink d2/d14/d1a/d8a/fa8 0 2024-09-15T22:26:48.805 INFO:tasks.workunit.client.0.smithi001.stdout:2/623: mknod d2/d14/d1a/ccd 0 2024-09-15T22:26:48.805 INFO:tasks.workunit.client.0.smithi001.stdout:2/624: write d2/d14/d1a/d1b/d82/dc9/f3c [3984538,115980] 0 2024-09-15T22:26:48.805 INFO:tasks.workunit.client.0.smithi001.stdout:2/625: fdatasync d2/d14/d1a/d1b/d82/d97/d74/fb5 0 2024-09-15T22:26:48.816 INFO:tasks.workunit.client.0.smithi001.stdout:7/650: write d0/d6a/dac/dda/fa3 [1474738,69064] 0 2024-09-15T22:26:48.817 INFO:tasks.workunit.client.0.smithi001.stdout:3/658: write da/d9e/fa4 [413280,1276] 0 2024-09-15T22:26:48.817 INFO:tasks.workunit.client.0.smithi001.stdout:3/659: fsync da/d90/fbf 0 2024-09-15T22:26:48.821 INFO:tasks.workunit.client.0.smithi001.stdout:3/660: rename da/f61 to da/d90/da3/fdf 0 2024-09-15T22:26:48.822 INFO:tasks.workunit.client.0.smithi001.stdout:2/626: dread d2/d12/d62/d64/f4a [0,4194304] 0 2024-09-15T22:26:48.823 INFO:tasks.workunit.client.0.smithi001.stdout:3/661: creat da/d3d/d43/d7c/d53/fe0 x:0 0 0 2024-09-15T22:26:48.826 INFO:tasks.workunit.client.0.smithi001.stdout:3/662: rename da/d3d/d43/d7c/d53/fe0 to da/d90/fe1 0 2024-09-15T22:26:48.826 INFO:tasks.workunit.client.0.smithi001.stdout:2/627: unlink d2/d12/d62/d4c/c9c 0 2024-09-15T22:26:48.827 INFO:tasks.workunit.client.0.smithi001.stdout:3/663: creat da/dae/d8e/fe2 x:0 0 0 2024-09-15T22:26:48.829 INFO:tasks.workunit.client.0.smithi001.stdout:3/664: mknod da/d1f/ce3 0 2024-09-15T22:26:48.829 INFO:tasks.workunit.client.0.smithi001.stdout:2/628: truncate d2/d14/d1a/d1b/d82/dc9/f77 2302210 0 2024-09-15T22:26:48.831 INFO:tasks.workunit.client.0.smithi001.stdout:2/629: creat d2/d12/d62/d64/d76/db4/fce x:0 0 0 2024-09-15T22:26:48.831 INFO:tasks.workunit.client.0.smithi001.stdout:3/665: link da/d3b/d1b/l50 da/d3d/d43/d7c/d3f/db5/dd1/le4 0 2024-09-15T22:26:48.831 INFO:tasks.workunit.client.0.smithi001.stdout:2/630: readlink d2/d14/d1a/l53 0 2024-09-15T22:26:48.831 INFO:tasks.workunit.client.0.smithi001.stdout:6/627: dread d0/d6/f29 [0,4194304] 0 2024-09-15T22:26:48.832 INFO:tasks.workunit.client.0.smithi001.stdout:6/628: fdatasync d0/d6/d5d/d67/f4e 0 2024-09-15T22:26:48.832 INFO:tasks.workunit.client.0.smithi001.stdout:2/631: creat d2/d14/d1a/fcf x:0 0 0 2024-09-15T22:26:48.832 INFO:tasks.workunit.client.0.smithi001.stdout:3/666: symlink da/db3/le5 0 2024-09-15T22:26:48.838 INFO:tasks.workunit.client.0.smithi001.stdout:8/594: dwrite d9/d19/d34/d41/f4b [0,4194304] 0 2024-09-15T22:26:48.839 INFO:tasks.workunit.client.0.smithi001.stdout:8/595: getdents d9/d19/d29/d50/d89 0 2024-09-15T22:26:48.840 INFO:tasks.workunit.client.0.smithi001.stdout:5/656: dwrite d3/d49/f7e [0,4194304] 0 2024-09-15T22:26:48.842 INFO:tasks.workunit.client.0.smithi001.stdout:8/596: truncate d9/d19/d58/f68 2134925 0 2024-09-15T22:26:48.844 INFO:tasks.workunit.client.0.smithi001.stdout:8/597: truncate d9/f31 1860385 0 2024-09-15T22:26:48.850 INFO:tasks.workunit.client.0.smithi001.stdout:8/598: mkdir d9/d19/d40/d5f/d61/d9f/db3 0 2024-09-15T22:26:48.850 INFO:tasks.workunit.client.0.smithi001.stdout:8/599: chown d9/l13 8756 1 2024-09-15T22:26:48.859 INFO:tasks.workunit.client.0.smithi001.stdout:6/629: write d0/d6/f4b [2302831,58566] 0 2024-09-15T22:26:48.860 INFO:tasks.workunit.client.0.smithi001.stdout:6/630: getdents d0/df/d24 0 2024-09-15T22:26:48.862 INFO:tasks.workunit.client.0.smithi001.stdout:3/667: write da/d3d/d43/d7c/d3f/f63 [3380376,114319] 0 2024-09-15T22:26:48.863 INFO:tasks.workunit.client.0.smithi001.stdout:6/631: creat d0/df/d97/fdf x:0 0 0 2024-09-15T22:26:48.865 INFO:tasks.workunit.client.0.smithi001.stdout:6/632: symlink d0/df/d24/d49/dc7/ddd/le0 0 2024-09-15T22:26:48.865 INFO:tasks.workunit.client.0.smithi001.stdout:6/633: chown d0/df/d24/d2e/l8b 7 1 2024-09-15T22:26:48.867 INFO:tasks.workunit.client.0.smithi001.stdout:6/634: symlink d0/df/d24/d49/dc7/le1 0 2024-09-15T22:26:48.867 INFO:tasks.workunit.client.0.smithi001.stdout:6/635: stat d0/d6/f76 0 2024-09-15T22:26:48.867 INFO:tasks.workunit.client.0.smithi001.stdout:6/636: chown d0/df/d24/d2e/l66 4189 1 2024-09-15T22:26:48.867 INFO:tasks.workunit.client.0.smithi001.stdout:6/637: chown d0/d6/f76 245411 1 2024-09-15T22:26:48.867 INFO:tasks.workunit.client.0.smithi001.stdout:6/638: readlink d0/d6/d5d/laf 0 2024-09-15T22:26:48.869 INFO:tasks.workunit.client.0.smithi001.stdout:6/639: creat d0/fe2 x:0 0 0 2024-09-15T22:26:48.871 INFO:tasks.workunit.client.0.smithi001.stdout:8/600: dread d9/d19/d34/f47 [4194304,4194304] 0 2024-09-15T22:26:48.871 INFO:tasks.workunit.client.0.smithi001.stdout:6/640: mknod d0/df/d24/d7b/db2/ce3 0 2024-09-15T22:26:48.872 INFO:tasks.workunit.client.0.smithi001.stdout:6/641: creat d0/df/d24/db1/fe4 x:0 0 0 2024-09-15T22:26:48.874 INFO:tasks.workunit.client.0.smithi001.stdout:6/642: creat d0/df/d24/db1/fe5 x:0 0 0 2024-09-15T22:26:48.884 INFO:tasks.workunit.client.0.smithi001.stdout:5/657: dwrite d3/d6/d41/d4d/dbe/f9e [0,4194304] 0 2024-09-15T22:26:48.884 INFO:tasks.workunit.client.0.smithi001.stdout:7/651: dwrite d0/d7/f24 [0,4194304] 0 2024-09-15T22:26:48.886 INFO:tasks.workunit.client.0.smithi001.stdout:5/658: mkdir d3/d6/dd8 0 2024-09-15T22:26:48.894 INFO:tasks.workunit.client.0.smithi001.stdout:9/555: sync 2024-09-15T22:26:48.894 INFO:tasks.workunit.client.0.smithi001.stdout:4/751: sync 2024-09-15T22:26:48.894 INFO:tasks.workunit.client.0.smithi001.stdout:4/752: chown d0/d5d/d7c/dba/d20/d29/d34/dbc 175308 1 2024-09-15T22:26:48.894 INFO:tasks.workunit.client.0.smithi001.stdout:4/753: chown d0/d27/d35/d59/d67/fd7 12592676 1 2024-09-15T22:26:48.894 INFO:tasks.workunit.client.0.smithi001.stdout:4/754: stat d0/d27/d35/d59/d67/lc4 0 2024-09-15T22:26:48.894 INFO:tasks.workunit.client.0.smithi001.stdout:9/556: write d5/de/d1a/d1b/d2a/f78 [4809546,50862] 0 2024-09-15T22:26:48.895 INFO:tasks.workunit.client.0.smithi001.stdout:0/547: sync 2024-09-15T22:26:48.899 INFO:tasks.workunit.client.0.smithi001.stdout:9/557: symlink d5/de/d1a/d1b/d22/d2c/d21/d68/la4 0 2024-09-15T22:26:48.899 INFO:tasks.workunit.client.0.smithi001.stdout:9/558: rename d5/de/d1a to d5/de/d1a/da5 22 2024-09-15T22:26:48.899 INFO:tasks.workunit.client.0.smithi001.stdout:9/559: fsync d5/de/d15/d27/d63/f79 0 2024-09-15T22:26:48.899 INFO:tasks.workunit.client.0.smithi001.stdout:4/755: dread d0/d5d/d7c/dba/d20/f8c [0,4194304] 0 2024-09-15T22:26:48.901 INFO:tasks.workunit.client.0.smithi001.stdout:0/548: creat d0/dd/d63/fa9 x:0 0 0 2024-09-15T22:26:48.902 INFO:tasks.workunit.client.0.smithi001.stdout:4/756: mkdir d0/d5d/d44/d65/d6a/d113 0 2024-09-15T22:26:48.903 INFO:tasks.workunit.client.0.smithi001.stdout:4/757: stat d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d73 0 2024-09-15T22:26:48.903 INFO:tasks.workunit.client.0.smithi001.stdout:4/758: write d0/d5d/d7c/dba/d20/d29/d34/dbc/dbf/ff5 [745978,40283] 0 2024-09-15T22:26:48.903 INFO:tasks.workunit.client.0.smithi001.stdout:0/549: getdents d0/d9/db/d5d/d6d 0 2024-09-15T22:26:48.904 INFO:tasks.workunit.client.0.smithi001.stdout:0/550: creat d0/d9/d1a/d70/faa x:0 0 0 2024-09-15T22:26:48.904 INFO:tasks.workunit.client.0.smithi001.stdout:0/551: fsync d0/dd/d63/f97 0 2024-09-15T22:26:48.904 INFO:tasks.workunit.client.0.smithi001.stdout:4/759: creat d0/d27/d35/d74/de5/f114 x:0 0 0 2024-09-15T22:26:48.905 INFO:tasks.workunit.client.0.smithi001.stdout:0/552: mknod d0/d9/cab 0 2024-09-15T22:26:48.905 INFO:tasks.workunit.client.0.smithi001.stdout:0/553: fdatasync d0/dd/f9d 0 2024-09-15T22:26:48.905 INFO:tasks.workunit.client.0.smithi001.stdout:4/760: truncate d0/d5d/d7c/dd1/fad 308079 0 2024-09-15T22:26:48.911 INFO:tasks.workunit.client.0.smithi001.stdout:2/632: dwrite d2/d12/d62/f40 [0,4194304] 0 2024-09-15T22:26:48.911 INFO:tasks.workunit.client.0.smithi001.stdout:2/633: chown d2/d12/d62/d64/f13 1840900 1 2024-09-15T22:26:48.913 INFO:tasks.workunit.client.0.smithi001.stdout:2/634: link d2/d14/f66 d2/d12/d62/d4c/fd0 0 2024-09-15T22:26:48.914 INFO:tasks.workunit.client.0.smithi001.stdout:2/635: truncate d2/d14/d1a/fcf 429467 0 2024-09-15T22:26:48.915 INFO:tasks.workunit.client.0.smithi001.stdout:2/636: creat d2/d12/d62/d64/d76/db4/fd1 x:0 0 0 2024-09-15T22:26:48.915 INFO:tasks.workunit.client.0.smithi001.stdout:2/637: symlink d2/d14/d1a/d8a/ld2 0 2024-09-15T22:26:48.917 INFO:tasks.workunit.client.0.smithi001.stdout:2/638: mknod d2/d14/d1a/d1b/d98/cd3 0 2024-09-15T22:26:48.918 INFO:tasks.workunit.client.0.smithi001.stdout:2/639: stat d2/d12/d62/d4c/d9d/cca 0 2024-09-15T22:26:48.920 INFO:tasks.workunit.client.0.smithi001.stdout:2/640: truncate d2/d14/d1a/d1b/f78 1555118 0 2024-09-15T22:26:48.928 INFO:tasks.workunit.client.0.smithi001.stdout:9/560: write d5/de/d1a/d1b/d22/d2c/f31 [6725575,96158] 0 2024-09-15T22:26:48.928 INFO:tasks.workunit.client.0.smithi001.stdout:9/561: write d5/de/d1a/d1b/f89 [588621,109426] 0 2024-09-15T22:26:48.933 INFO:tasks.workunit.client.0.smithi001.stdout:9/562: write d5/de/d15/d27/f7c [771591,42327] 0 2024-09-15T22:26:48.933 INFO:tasks.workunit.client.0.smithi001.stdout:9/563: write d5/de/d1a/d1b/d22/d2c/d21/d4d/f4e [7865041,43816] 0 2024-09-15T22:26:48.934 INFO:tasks.workunit.client.0.smithi001.stdout:9/564: symlink d5/de/d1a/d1b/d22/d2c/d21/la6 0 2024-09-15T22:26:48.937 INFO:tasks.workunit.client.0.smithi001.stdout:1/649: sync 2024-09-15T22:26:48.944 INFO:tasks.workunit.client.0.smithi001.stdout:9/565: mknod d5/ca7 0 2024-09-15T22:26:48.944 INFO:tasks.workunit.client.0.smithi001.stdout:2/641: read d2/d12/d62/f40 [647083,26503] 0 2024-09-15T22:26:48.952 INFO:tasks.workunit.client.0.smithi001.stdout:6/643: dwrite d0/df/d24/d2e/d43/f59 [0,4194304] 0 2024-09-15T22:26:48.961 INFO:tasks.workunit.client.0.smithi001.stdout:5/659: dwrite d3/d1d/fc7 [0,4194304] 0 2024-09-15T22:26:48.961 INFO:tasks.workunit.client.0.smithi001.stdout:5/660: write d3/d6/d41/d4d/dbe/d56/d52/d9f/fc3 [752605,70866] 0 2024-09-15T22:26:48.962 INFO:tasks.workunit.client.0.smithi001.stdout:5/661: fsync d3/d6/d57/d87/d8c/fab 0 2024-09-15T22:26:48.963 INFO:tasks.workunit.client.0.smithi001.stdout:5/662: symlink d3/d6/d41/d4d/dc0/ld9 0 2024-09-15T22:26:48.963 INFO:tasks.workunit.client.0.smithi001.stdout:5/663: fdatasync d3/d6/d41/f4c 0 2024-09-15T22:26:48.966 INFO:tasks.workunit.client.0.smithi001.stdout:5/664: creat d3/d6/d57/d87/d8c/da2/fda x:0 0 0 2024-09-15T22:26:48.968 INFO:tasks.workunit.client.0.smithi001.stdout:5/665: symlink d3/d6/d41/d88/da5/ldb 0 2024-09-15T22:26:48.968 INFO:tasks.workunit.client.0.smithi001.stdout:5/666: chown d3/d6/d41/d4d/dbe/d56/d52/d61/l8d 1 1 2024-09-15T22:26:48.970 INFO:tasks.workunit.client.0.smithi001.stdout:5/667: mkdir d3/d6/d41/d4d/dbe/d56/ddc 0 2024-09-15T22:26:48.972 INFO:tasks.workunit.client.0.smithi001.stdout:5/668: rename d3/d6/d41/d4d/dbe/d56/d52/d61/l8d to d3/d6/d41/d88/ldd 0 2024-09-15T22:26:48.981 INFO:tasks.workunit.client.0.smithi001.stdout:6/644: read d0/d6/d5d/d67/d53/fa4 [1082902,65391] 0 2024-09-15T22:26:48.982 INFO:tasks.workunit.client.0.smithi001.stdout:6/645: fdatasync d0/d7e/fd9 0 2024-09-15T22:26:48.982 INFO:tasks.workunit.client.0.smithi001.stdout:6/646: getdents d0/d6/d5d/da6 0 2024-09-15T22:26:48.982 INFO:tasks.workunit.client.0.smithi001.stdout:5/669: rename d3/d6/d41/d4d/dbe/d56/d52/d61/cb1 to d3/d27/d5c/cde 0 2024-09-15T22:26:48.982 INFO:tasks.workunit.client.0.smithi001.stdout:5/670: mknod d3/d6/d57/d87/d8c/da2/cdf 0 2024-09-15T22:26:48.982 INFO:tasks.workunit.client.0.smithi001.stdout:5/671: fsync d3/d6/d41/d4d/dbe/d56/f55 0 2024-09-15T22:26:48.982 INFO:tasks.workunit.client.0.smithi001.stdout:7/652: dwrite d0/d7/d44/f87 [0,4194304] 0 2024-09-15T22:26:48.982 INFO:tasks.workunit.client.0.smithi001.stdout:5/672: mknod d3/d6/d41/d88/db0/ce0 0 2024-09-15T22:26:48.982 INFO:tasks.workunit.client.0.smithi001.stdout:9/566: dread d5/de/d15/d27/d63/f79 [0,4194304] 0 2024-09-15T22:26:48.984 INFO:tasks.workunit.client.0.smithi001.stdout:5/673: truncate d3/d27/f90 6871131 0 2024-09-15T22:26:48.984 INFO:tasks.workunit.client.0.smithi001.stdout:5/674: fsync d3/d49/fc1 0 2024-09-15T22:26:48.985 INFO:tasks.workunit.client.0.smithi001.stdout:5/675: rmdir d3/d6/d41/d4d/dbe/d56/d52 39 2024-09-15T22:26:48.987 INFO:tasks.workunit.client.0.smithi001.stdout:3/668: dwrite da/d3d/d43/d41/d70/d7f/fa0 [0,4194304] 0 2024-09-15T22:26:48.987 INFO:tasks.workunit.client.0.smithi001.stdout:3/669: fdatasync da/d3b/d58/faf 0 2024-09-15T22:26:48.987 INFO:tasks.workunit.client.0.smithi001.stdout:5/676: rename d3/c68 to d3/d6/d41/d4d/ce1 0 2024-09-15T22:26:48.990 INFO:tasks.workunit.client.0.smithi001.stdout:5/677: creat d3/d27/d5c/dd6/fe2 x:0 0 0 2024-09-15T22:26:48.990 INFO:tasks.workunit.client.0.smithi001.stdout:3/670: creat da/d90/d6f/fe6 x:0 0 0 2024-09-15T22:26:48.990 INFO:tasks.workunit.client.0.smithi001.stdout:3/671: fdatasync da/d3d/d43/d7c/d53/d72/f9f 0 2024-09-15T22:26:48.991 INFO:tasks.workunit.client.0.smithi001.stdout:3/672: readlink da/d9e/lb8 0 2024-09-15T22:26:48.991 INFO:tasks.workunit.client.0.smithi001.stdout:3/673: chown da/d3d/d43/d7c/d3f/db5/dd1/le4 1318242134 1 2024-09-15T22:26:48.991 INFO:tasks.workunit.client.0.smithi001.stdout:3/674: fdatasync da/d3d/d43/d7c/d53/d72/f9f 0 2024-09-15T22:26:48.992 INFO:tasks.workunit.client.0.smithi001.stdout:5/678: creat d3/d6/d41/fe3 x:0 0 0 2024-09-15T22:26:48.992 INFO:tasks.workunit.client.0.smithi001.stdout:3/675: creat da/d3d/d43/d7c/d3f/db5/fe7 x:0 0 0 2024-09-15T22:26:48.995 INFO:tasks.workunit.client.0.smithi001.stdout:5/679: symlink d3/d6/d41/d4d/dbe/d56/d8a/dbd/le4 0 2024-09-15T22:26:48.998 INFO:tasks.workunit.client.0.smithi001.stdout:5/680: write d3/d6/d57/d87/d8c/f97 [1556825,104404] 0 2024-09-15T22:26:48.999 INFO:tasks.workunit.client.0.smithi001.stdout:5/681: dread - d3/d6/d57/d87/d8c/da2/fda zero size 2024-09-15T22:26:48.999 INFO:tasks.workunit.client.0.smithi001.stdout:5/682: write d3/d6/d25/f2c [298016,88764] 0 2024-09-15T22:26:48.999 INFO:tasks.workunit.client.0.smithi001.stdout:5/683: dread - d3/d27/d4e/d89/dae/fd3 zero size 2024-09-15T22:26:48.999 INFO:tasks.workunit.client.0.smithi001.stdout:5/684: read - d3/d49/f95 zero size 2024-09-15T22:26:49.012 INFO:tasks.workunit.client.0.smithi001.stdout:0/554: dwrite d0/dd/d1b/f5e [0,4194304] 0 2024-09-15T22:26:49.028 INFO:tasks.workunit.client.0.smithi001.stdout:2/642: dwrite d2/d14/d1a/d1b/d82/fb8 [0,4194304] 0 2024-09-15T22:26:49.029 INFO:tasks.workunit.client.0.smithi001.stdout:1/650: dwrite d3/dd/d3c/d64/fbb [0,4194304] 0 2024-09-15T22:26:49.030 INFO:tasks.workunit.client.0.smithi001.stdout:2/643: mkdir d2/d14/d1a/d8a/dd4 0 2024-09-15T22:26:49.031 INFO:tasks.workunit.client.0.smithi001.stdout:1/651: getdents d3/d12/d90 0 2024-09-15T22:26:49.032 INFO:tasks.workunit.client.0.smithi001.stdout:1/652: dread - d3/fac zero size 2024-09-15T22:26:49.033 INFO:tasks.workunit.client.0.smithi001.stdout:2/644: write d2/d14/d1a/fcf [166896,5283] 0 2024-09-15T22:26:49.033 INFO:tasks.workunit.client.0.smithi001.stdout:1/653: creat d3/dd/d53/fcb x:0 0 0 2024-09-15T22:26:49.033 INFO:tasks.workunit.client.0.smithi001.stdout:1/654: fdatasync d3/fc0 0 2024-09-15T22:26:49.035 INFO:tasks.workunit.client.0.smithi001.stdout:1/655: mkdir d3/dd/d3c/d4c/dcc 0 2024-09-15T22:26:49.037 INFO:tasks.workunit.client.0.smithi001.stdout:1/656: rmdir d3/dd/d14 39 2024-09-15T22:26:49.038 INFO:tasks.workunit.client.0.smithi001.stdout:1/657: chown d3/dd/d14/d1b/f6c 664 1 2024-09-15T22:26:49.038 INFO:tasks.workunit.client.0.smithi001.stdout:1/658: rmdir d3/dd/d14/daa 39 2024-09-15T22:26:49.039 INFO:tasks.workunit.client.0.smithi001.stdout:1/659: chown d3/d12/d21 0 1 2024-09-15T22:26:49.040 INFO:tasks.workunit.client.0.smithi001.stdout:3/676: dwrite da/d1f/fa2 [0,4194304] 0 2024-09-15T22:26:49.041 INFO:tasks.workunit.client.0.smithi001.stdout:1/660: rename d3/dd/d14/d23/la4 to d3/dd/d3c/d4c/dcc/lcd 0 2024-09-15T22:26:49.048 INFO:tasks.workunit.client.0.smithi001.stdout:3/677: dread da/dae/d8e/f96 [0,4194304] 0 2024-09-15T22:26:49.049 INFO:tasks.workunit.client.0.smithi001.stdout:3/678: creat da/d9e/fe8 x:0 0 0 2024-09-15T22:26:49.052 INFO:tasks.workunit.client.0.smithi001.stdout:6/647: dwrite d0/df/d24/d2e/d43/fb6 [4194304,4194304] 0 2024-09-15T22:26:49.052 INFO:tasks.workunit.client.0.smithi001.stdout:5/685: dread d3/d6/d41/f5e [0,4194304] 0 2024-09-15T22:26:49.052 INFO:tasks.workunit.client.0.smithi001.stdout:9/567: dwrite d5/de/d1a/d1b/d22/f2f [0,4194304] 0 2024-09-15T22:26:49.053 INFO:tasks.workunit.client.0.smithi001.stdout:6/648: mkdir d0/df/d24/d2e/d43/d30/dc2/de6 0 2024-09-15T22:26:49.054 INFO:tasks.workunit.client.0.smithi001.stdout:5/686: link d3/d6/d57/d87/d8c/da2/fb6 d3/d6/d57/fe5 0 2024-09-15T22:26:49.054 INFO:tasks.workunit.client.0.smithi001.stdout:5/687: read - d3/d1d/fa7 zero size 2024-09-15T22:26:49.054 INFO:tasks.workunit.client.0.smithi001.stdout:5/688: stat d3/d27/d4e 0 2024-09-15T22:26:49.055 INFO:tasks.workunit.client.0.smithi001.stdout:6/649: mknod d0/df/d24/d2e/d43/ce7 0 2024-09-15T22:26:49.056 INFO:tasks.workunit.client.0.smithi001.stdout:6/650: fdatasync d0/fb 0 2024-09-15T22:26:49.057 INFO:tasks.workunit.client.0.smithi001.stdout:1/661: rename d3/dd to d3/d12/d79/dce 0 2024-09-15T22:26:49.057 INFO:tasks.workunit.client.0.smithi001.stdout:1/662: symlink d3/d12/d79/dce/d14/d1b/d2b/d68/d8a/lcf 0 2024-09-15T22:26:49.058 INFO:tasks.workunit.client.0.smithi001.stdout:1/663: write d3/d12/d79/dce/d14/d1b/d2b/d68/d8a/f97 [11444,24055] 0 2024-09-15T22:26:49.058 INFO:tasks.workunit.client.0.smithi001.stdout:1/664: dread - d3/d12/d79/dce/d53/fcb zero size 2024-09-15T22:26:49.060 INFO:tasks.workunit.client.0.smithi001.stdout:1/665: write d3/d12/d79/dce/d14/d1b/d2b/d68/fb5 [165460,35514] 0 2024-09-15T22:26:49.061 INFO:tasks.workunit.client.0.smithi001.stdout:1/666: mknod d3/d12/d79/dce/d14/d23/da1/dc6/cd0 0 2024-09-15T22:26:49.065 INFO:tasks.workunit.client.0.smithi001.stdout:1/667: readlink d3/d12/d21/d82/l9e 0 2024-09-15T22:26:49.067 INFO:tasks.workunit.client.0.smithi001.stdout:3/679: write da/d3d/d43/d7c/f55 [1676025,120135] 0 2024-09-15T22:26:49.068 INFO:tasks.workunit.client.0.smithi001.stdout:6/651: symlink d0/d6/d5d/d8c/le8 0 2024-09-15T22:26:49.068 INFO:tasks.workunit.client.0.smithi001.stdout:6/652: symlink d0/df/d24/d49/le9 0 2024-09-15T22:26:49.070 INFO:tasks.workunit.client.0.smithi001.stdout:6/653: truncate d0/d6/d5d/d67/d53/f72 398163 0 2024-09-15T22:26:49.073 INFO:tasks.workunit.client.0.smithi001.stdout:4/761: dwrite d0/d5d/d44/d65/d6a/f6d [0,4194304] 0 2024-09-15T22:26:49.076 INFO:tasks.workunit.client.0.smithi001.stdout:4/762: mknod d0/d5d/d7c/de8/c115 0 2024-09-15T22:26:49.079 INFO:tasks.workunit.client.0.smithi001.stdout:4/763: rmdir d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d73 39 2024-09-15T22:26:49.098 INFO:tasks.workunit.client.0.smithi001.stdout:8/601: sync 2024-09-15T22:26:49.100 INFO:tasks.workunit.client.0.smithi001.stdout:8/602: rmdir d9/d19/d34 39 2024-09-15T22:26:49.100 INFO:tasks.workunit.client.0.smithi001.stdout:8/603: dread - d9/d19/d40/f57 zero size 2024-09-15T22:26:49.102 INFO:tasks.workunit.client.0.smithi001.stdout:8/604: rename d9/d19/d58/d8e/ca5 to d9/d19/d58/d8e/d9c/cb4 0 2024-09-15T22:26:49.102 INFO:tasks.workunit.client.0.smithi001.stdout:8/605: fdatasync d9/d19/d29/d50/f73 0 2024-09-15T22:26:49.103 INFO:tasks.workunit.client.0.smithi001.stdout:8/606: unlink l1 0 2024-09-15T22:26:49.106 INFO:tasks.workunit.client.0.smithi001.stdout:8/607: write d9/d19/d58/d8e/f9d [4283480,107342] 0 2024-09-15T22:26:49.112 INFO:tasks.workunit.client.0.smithi001.stdout:2/645: dwrite d2/d14/d1a/d8a/fbc [0,4194304] 0 2024-09-15T22:26:49.131 INFO:tasks.workunit.client.0.smithi001.stdout:0/555: dwrite d0/d9/d1a/f28 [0,4194304] 0 2024-09-15T22:26:49.133 INFO:tasks.workunit.client.0.smithi001.stdout:0/556: creat d0/dd/d63/fac x:0 0 0 2024-09-15T22:26:49.137 INFO:tasks.workunit.client.0.smithi001.stdout:4/764: dread d0/d5d/d7c/dba/d20/d29/d40/f4d [0,4194304] 0 2024-09-15T22:26:49.137 INFO:tasks.workunit.client.0.smithi001.stdout:9/568: dwrite d5/f11 [0,4194304] 0 2024-09-15T22:26:49.137 INFO:tasks.workunit.client.0.smithi001.stdout:9/569: mkdir d5/de/d1a/da8 0 2024-09-15T22:26:49.138 INFO:tasks.workunit.client.0.smithi001.stdout:9/570: mkdir d5/de/da9 0 2024-09-15T22:26:49.141 INFO:tasks.workunit.client.0.smithi001.stdout:5/689: dwrite d3/d6/d25/f7f [0,4194304] 0 2024-09-15T22:26:49.141 INFO:tasks.workunit.client.0.smithi001.stdout:5/690: chown d3/d6/d41/d4d/d91/laa 15803444 1 2024-09-15T22:26:49.142 INFO:tasks.workunit.client.0.smithi001.stdout:5/691: dread - d3/d27/d4e/d89/dae/fd3 zero size 2024-09-15T22:26:49.142 INFO:tasks.workunit.client.0.smithi001.stdout:4/765: rename d0/d5d/d7c/dba/d20/d29/fb1 to d0/d5d/d44/d65/d6a/f116 0 2024-09-15T22:26:49.145 INFO:tasks.workunit.client.0.smithi001.stdout:5/692: rename d3/d6/d41/d4d/dbe/d56/d8a/dbd to d3/d6/d41/d4d/dbe/de6 0 2024-09-15T22:26:49.152 INFO:tasks.workunit.client.0.smithi001.stdout:2/646: dwrite d2/f79 [0,4194304] 0 2024-09-15T22:26:49.153 INFO:tasks.workunit.client.0.smithi001.stdout:2/647: write d2/d14/f66 [4784109,66328] 0 2024-09-15T22:26:49.153 INFO:tasks.workunit.client.0.smithi001.stdout:4/766: dread d0/d5d/d7c/dba/d20/f8c [0,4194304] 0 2024-09-15T22:26:49.153 INFO:tasks.workunit.client.0.smithi001.stdout:2/648: creat d2/d14/d1a/fd5 x:0 0 0 2024-09-15T22:26:49.165 INFO:tasks.workunit.client.0.smithi001.stdout:8/608: dwrite d9/fa [0,4194304] 0 2024-09-15T22:26:49.165 INFO:tasks.workunit.client.0.smithi001.stdout:8/609: chown d9/d19/d34 783 1 2024-09-15T22:26:49.165 INFO:tasks.workunit.client.0.smithi001.stdout:4/767: dread d0/d5d/d7c/dba/d20/f8c [0,4194304] 0 2024-09-15T22:26:49.167 INFO:tasks.workunit.client.0.smithi001.stdout:6/654: dwrite d0/fb [0,4194304] 0 2024-09-15T22:26:49.167 INFO:tasks.workunit.client.0.smithi001.stdout:4/768: creat d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d73/f117 x:0 0 0 2024-09-15T22:26:49.167 INFO:tasks.workunit.client.0.smithi001.stdout:4/769: readlink d0/d5d/lde 0 2024-09-15T22:26:49.174 INFO:tasks.workunit.client.0.smithi001.stdout:8/610: dread d9/d19/d58/f4e [0,4194304] 0 2024-09-15T22:26:49.182 INFO:tasks.workunit.client.0.smithi001.stdout:1/668: dwrite d3/f39 [0,4194304] 0 2024-09-15T22:26:49.182 INFO:tasks.workunit.client.0.smithi001.stdout:1/669: truncate d3/d12/d79/dce/d14/d23/f9d 802310 0 2024-09-15T22:26:49.189 INFO:tasks.workunit.client.0.smithi001.stdout:6/655: write d0/fb [1328562,50499] 0 2024-09-15T22:26:49.189 INFO:tasks.workunit.client.0.smithi001.stdout:2/649: dwrite d2/d12/d62/d64/f19 [0,4194304] 0 2024-09-15T22:26:49.193 INFO:tasks.workunit.client.0.smithi001.stdout:2/650: symlink d2/d12/d62/d64/d76/db4/ld6 0 2024-09-15T22:26:49.193 INFO:tasks.workunit.client.0.smithi001.stdout:2/651: write d2/d14/d1a/d1b/d82/d83/fa9 [444993,57327] 0 2024-09-15T22:26:49.193 INFO:tasks.workunit.client.0.smithi001.stdout:2/652: chown d2/d12/d62/d4c 112 1 2024-09-15T22:26:49.193 INFO:tasks.workunit.client.0.smithi001.stdout:2/653: write d2/d14/d1a/d8a/f94 [1034359,20908] 0 2024-09-15T22:26:49.193 INFO:tasks.workunit.client.0.smithi001.stdout:2/654: fsync d2/d14/d1a/d1b/d82/d97/d74/fb5 0 2024-09-15T22:26:49.193 INFO:tasks.workunit.client.0.smithi001.stdout:2/655: write d2/d14/d1a/d80/fae [956118,62364] 0 2024-09-15T22:26:49.194 INFO:tasks.workunit.client.0.smithi001.stdout:8/611: read d9/d19/d29/d33/d63/f6a [1385713,52233] 0 2024-09-15T22:26:49.194 INFO:tasks.workunit.client.0.smithi001.stdout:5/693: dwrite d3/d6/d57/f8f [0,4194304] 0 2024-09-15T22:26:49.195 INFO:tasks.workunit.client.0.smithi001.stdout:2/656: unlink d2/d12/f65 0 2024-09-15T22:26:49.196 INFO:tasks.workunit.client.0.smithi001.stdout:8/612: mknod d9/d19/d29/d50/d70/d76/cb5 0 2024-09-15T22:26:49.196 INFO:tasks.workunit.client.0.smithi001.stdout:8/613: fsync d9/f11 0 2024-09-15T22:26:49.196 INFO:tasks.workunit.client.0.smithi001.stdout:8/614: write d9/d19/d58/d8e/fac [186296,60232] 0 2024-09-15T22:26:49.196 INFO:tasks.workunit.client.0.smithi001.stdout:5/694: chown d3/d1d/c31 125 1 2024-09-15T22:26:49.196 INFO:tasks.workunit.client.0.smithi001.stdout:5/695: write d3/d6/d41/f9d [1023106,117452] 0 2024-09-15T22:26:49.197 INFO:tasks.workunit.client.0.smithi001.stdout:2/657: mknod d2/d14/d1a/d1b/d98/cd7 0 2024-09-15T22:26:49.198 INFO:tasks.workunit.client.0.smithi001.stdout:5/696: rename d3/d6/d41/d4d/dbe/d56/d52/db8/fca to d3/d6/d57/d87/d8c/fe7 0 2024-09-15T22:26:49.199 INFO:tasks.workunit.client.0.smithi001.stdout:5/697: rename d3/d49/l60 to d3/d6/d41/d4d/dbe/d56/d8a/le8 0 2024-09-15T22:26:49.208 INFO:tasks.workunit.client.0.smithi001.stdout:8/615: mknod d9/d19/d29/d33/d63/cb6 0 2024-09-15T22:26:49.208 INFO:tasks.workunit.client.0.smithi001.stdout:6/656: dread d0/f5 [0,4194304] 0 2024-09-15T22:26:49.211 INFO:tasks.workunit.client.0.smithi001.stdout:8/616: mkdir d9/d19/d34/da4/db7 0 2024-09-15T22:26:49.213 INFO:tasks.workunit.client.0.smithi001.stdout:6/657: truncate d0/df/d24/f34 873234 0 2024-09-15T22:26:49.215 INFO:tasks.workunit.client.0.smithi001.stdout:6/658: chown d0/c47 1017384 1 2024-09-15T22:26:49.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:48 smithi012 ceph-mon[34883]: pgmap v414: 97 pgs: 97 active+clean; 942 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 116 MiB/s rd, 141 MiB/s wr, 1.16k op/s 2024-09-15T22:26:49.251 INFO:tasks.workunit.client.0.smithi001.stdout:2/658: dwrite d2/d14/d1a/d1b/d82/dc9/f75 [0,4194304] 0 2024-09-15T22:26:49.252 INFO:tasks.workunit.client.0.smithi001.stdout:9/571: dwrite d5/de/d1a/d1b/f33 [0,4194304] 0 2024-09-15T22:26:49.252 INFO:tasks.workunit.client.0.smithi001.stdout:9/572: stat d5/de/d1a/d1b/d22/d2c/d21/d24/f4c 0 2024-09-15T22:26:49.254 INFO:tasks.workunit.client.0.smithi001.stdout:5/698: dwrite d3/d6/d57/d87/d8c/fe7 [0,4194304] 0 2024-09-15T22:26:49.254 INFO:tasks.workunit.client.0.smithi001.stdout:1/670: dwrite d3/d12/d79/dce/d3c/d7d/f88 [0,4194304] 0 2024-09-15T22:26:49.257 INFO:tasks.workunit.client.0.smithi001.stdout:5/699: mkdir d3/d6/d41/d4d/dbe/d56/ddc/de9 0 2024-09-15T22:26:49.258 INFO:tasks.workunit.client.0.smithi001.stdout:6/659: dread d0/d6/d5d/d67/f44 [0,4194304] 0 2024-09-15T22:26:49.258 INFO:tasks.workunit.client.0.smithi001.stdout:6/660: readlink d0/df/d24/l95 0 2024-09-15T22:26:49.260 INFO:tasks.workunit.client.0.smithi001.stdout:5/700: link d3/d6/d25/f2c d3/d1d/fea 0 2024-09-15T22:26:49.261 INFO:tasks.workunit.client.0.smithi001.stdout:5/701: mknod d3/d6/d41/d4d/ceb 0 2024-09-15T22:26:49.269 INFO:tasks.workunit.client.0.smithi001.stdout:5/702: dread d3/d27/f42 [0,4194304] 0 2024-09-15T22:26:49.270 INFO:tasks.workunit.client.0.smithi001.stdout:8/617: dwrite d9/d19/d58/f95 [0,4194304] 0 2024-09-15T22:26:49.270 INFO:tasks.workunit.client.0.smithi001.stdout:8/618: read d9/f31 [1508658,5734] 0 2024-09-15T22:26:49.270 INFO:tasks.workunit.client.0.smithi001.stdout:8/619: dread - d9/d19/d34/f4a zero size 2024-09-15T22:26:49.270 INFO:tasks.workunit.client.0.smithi001.stdout:4/770: dwrite d0/fd [0,4194304] 0 2024-09-15T22:26:49.270 INFO:tasks.workunit.client.0.smithi001.stdout:1/671: write d3/f7 [5433271,100783] 0 2024-09-15T22:26:49.270 INFO:tasks.workunit.client.0.smithi001.stdout:4/771: truncate d0/d5d/d44/d65/fae 304379 0 2024-09-15T22:26:49.273 INFO:tasks.workunit.client.0.smithi001.stdout:6/661: creat d0/d6/d5d/d67/d53/fea x:0 0 0 2024-09-15T22:26:49.273 INFO:tasks.workunit.client.0.smithi001.stdout:5/703: link d3/d6/d41/d4d/ceb d3/d6/d41/d4d/dbe/d56/d52/d61/cec 0 2024-09-15T22:26:49.275 INFO:tasks.workunit.client.0.smithi001.stdout:4/772: mkdir d0/d5d/d7c/de8/d118 0 2024-09-15T22:26:49.276 INFO:tasks.workunit.client.0.smithi001.stdout:5/704: creat d3/d6/d57/d87/d8c/da2/fed x:0 0 0 2024-09-15T22:26:49.277 INFO:tasks.workunit.client.0.smithi001.stdout:4/773: creat d0/d5d/d7c/dba/d20/f119 x:0 0 0 2024-09-15T22:26:49.279 INFO:tasks.workunit.client.0.smithi001.stdout:5/705: mkdir d3/d6/d41/d4d/dbe/d56/d52/d61/dee 0 2024-09-15T22:26:49.279 INFO:tasks.workunit.client.0.smithi001.stdout:5/706: chown d3/d27/l85 191490692 1 2024-09-15T22:26:49.289 INFO:tasks.workunit.client.0.smithi001.stdout:0/557: sync 2024-09-15T22:26:49.289 INFO:tasks.workunit.client.0.smithi001.stdout:3/680: sync 2024-09-15T22:26:49.289 INFO:tasks.workunit.client.0.smithi001.stdout:5/707: mkdir d3/d6/d41/d4d/dbe/d56/d52/d61/dee/def 0 2024-09-15T22:26:49.289 INFO:tasks.workunit.client.0.smithi001.stdout:5/708: mkdir d3/d6/d41/d88/df0 0 2024-09-15T22:26:49.289 INFO:tasks.workunit.client.0.smithi001.stdout:5/709: mknod d3/d6/d41/d4d/dbe/d56/d52/d61/dee/def/cf1 0 2024-09-15T22:26:49.290 INFO:tasks.workunit.client.0.smithi001.stdout:5/710: fdatasync d3/d6/d57/d87/d8c/f97 0 2024-09-15T22:26:49.290 INFO:tasks.workunit.client.0.smithi001.stdout:7/653: sync 2024-09-15T22:26:49.290 INFO:tasks.workunit.client.0.smithi001.stdout:4/774: dread d0/d5d/f9b [0,4194304] 0 2024-09-15T22:26:49.300 INFO:tasks.workunit.client.0.smithi001.stdout:3/681: rename da/d1f/c9d to da/d90/da3/dda/ce9 0 2024-09-15T22:26:49.301 INFO:tasks.workunit.client.0.smithi001.stdout:6/662: dread d0/f33 [0,4194304] 0 2024-09-15T22:26:49.302 INFO:tasks.workunit.client.0.smithi001.stdout:3/682: creat da/db3/fea x:0 0 0 2024-09-15T22:26:49.302 INFO:tasks.workunit.client.0.smithi001.stdout:3/683: chown da/d3d/d43/d7c/c51 15 1 2024-09-15T22:26:49.302 INFO:tasks.workunit.client.0.smithi001.stdout:2/659: dwrite d2/d14/d1a/d1b/d82/dc9/f4b [0,4194304] 0 2024-09-15T22:26:49.302 INFO:tasks.workunit.client.0.smithi001.stdout:6/663: rmdir d0/d6/d5d/d67/dc4 39 2024-09-15T22:26:49.304 INFO:tasks.workunit.client.0.smithi001.stdout:3/684: creat da/d3d/d43/d7c/d53/d72/feb x:0 0 0 2024-09-15T22:26:49.304 INFO:tasks.workunit.client.0.smithi001.stdout:3/685: chown da/d1f/f22 60516 1 2024-09-15T22:26:49.306 INFO:tasks.workunit.client.0.smithi001.stdout:3/686: getdents da/d3d/d43/d41/d70/d7f 0 2024-09-15T22:26:49.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:48 smithi098 ceph-mon[35514]: pgmap v414: 97 pgs: 97 active+clean; 942 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 116 MiB/s rd, 141 MiB/s wr, 1.16k op/s 2024-09-15T22:26:49.311 INFO:tasks.workunit.client.0.smithi001.stdout:7/654: dread d0/d7/d21/d6b/fa8 [0,4194304] 0 2024-09-15T22:26:49.313 INFO:tasks.workunit.client.0.smithi001.stdout:7/655: creat d0/d7/fdf x:0 0 0 2024-09-15T22:26:49.314 INFO:tasks.workunit.client.0.smithi001.stdout:7/656: creat d0/d7/d2e/d60/dbd/fe0 x:0 0 0 2024-09-15T22:26:49.319 INFO:tasks.workunit.client.0.smithi001.stdout:7/657: write d0/d7/fa4 [1032709,122814] 0 2024-09-15T22:26:49.319 INFO:tasks.workunit.client.0.smithi001.stdout:0/558: dread d0/dd/f29 [0,4194304] 0 2024-09-15T22:26:49.331 INFO:tasks.workunit.client.0.smithi001.stdout:5/711: dread d3/d27/f2d [0,4194304] 0 2024-09-15T22:26:49.341 INFO:tasks.workunit.client.0.smithi001.stdout:8/620: dwrite d9/d19/d58/d8e/f9d [0,4194304] 0 2024-09-15T22:26:49.345 INFO:tasks.workunit.client.0.smithi001.stdout:0/559: dread d0/d9/d1a/d36/f45 [0,4194304] 0 2024-09-15T22:26:49.352 INFO:tasks.workunit.client.0.smithi001.stdout:0/560: creat d0/dd/d63/fad x:0 0 0 2024-09-15T22:26:49.355 INFO:tasks.workunit.client.0.smithi001.stdout:8/621: dread d9/d19/d29/f2a [0,4194304] 0 2024-09-15T22:26:49.355 INFO:tasks.workunit.client.0.smithi001.stdout:7/658: dread d0/d7/d44/f28 [0,4194304] 0 2024-09-15T22:26:49.355 INFO:tasks.workunit.client.0.smithi001.stdout:7/659: fsync d0/d7/f53 0 2024-09-15T22:26:49.355 INFO:tasks.workunit.client.0.smithi001.stdout:7/660: write d0/d7/d44/d3f/d49/da5/fdc [777435,76572] 0 2024-09-15T22:26:49.357 INFO:tasks.workunit.client.0.smithi001.stdout:1/672: dwrite d3/d8d/fc2 [0,4194304] 0 2024-09-15T22:26:49.357 INFO:tasks.workunit.client.0.smithi001.stdout:2/660: dread d2/d12/d62/d64/f2a [0,4194304] 0 2024-09-15T22:26:49.357 INFO:tasks.workunit.client.0.smithi001.stdout:2/661: stat d2/d12/d62/f4e 0 2024-09-15T22:26:49.369 INFO:tasks.workunit.client.0.smithi001.stdout:3/687: dwrite da/d3d/d43/d7c/f55 [0,4194304] 0 2024-09-15T22:26:49.369 INFO:tasks.workunit.client.0.smithi001.stdout:3/688: stat da/d3d/d43/d41/la1 0 2024-09-15T22:26:49.369 INFO:tasks.workunit.client.0.smithi001.stdout:3/689: chown da/d3d/d43/d41/c75 226 1 2024-09-15T22:26:49.370 INFO:tasks.workunit.client.0.smithi001.stdout:3/690: write da/d3d/d43/d41/f54 [1926582,110678] 0 2024-09-15T22:26:49.370 INFO:tasks.workunit.client.0.smithi001.stdout:3/691: stat da/d90/fe1 0 2024-09-15T22:26:49.374 INFO:tasks.workunit.client.0.smithi001.stdout:8/622: write d9/d19/d58/f68 [1111547,23264] 0 2024-09-15T22:26:49.374 INFO:tasks.workunit.client.0.smithi001.stdout:8/623: rename d9 to d9/d19/d29/d35/db8 22 2024-09-15T22:26:49.374 INFO:tasks.workunit.client.0.smithi001.stdout:3/692: creat da/d3b/fec x:0 0 0 2024-09-15T22:26:49.375 INFO:tasks.workunit.client.0.smithi001.stdout:8/624: dread - d9/d19/d29/d33/fa0 zero size 2024-09-15T22:26:49.375 INFO:tasks.workunit.client.0.smithi001.stdout:8/625: chown d9/d19/d29/d33/d63/fa9 0 1 2024-09-15T22:26:49.375 INFO:tasks.workunit.client.0.smithi001.stdout:0/561: dread d0/dd/d33/f73 [0,4194304] 0 2024-09-15T22:26:49.375 INFO:tasks.workunit.client.0.smithi001.stdout:3/693: symlink da/d3d/d43/d41/led 0 2024-09-15T22:26:49.377 INFO:tasks.workunit.client.0.smithi001.stdout:3/694: rename da/d1f to da/d3b/d8b/dee 0 2024-09-15T22:26:49.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:48 smithi001 ceph-mon[30843]: pgmap v414: 97 pgs: 97 active+clean; 942 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 116 MiB/s rd, 141 MiB/s wr, 1.16k op/s 2024-09-15T22:26:49.377 INFO:tasks.workunit.client.0.smithi001.stdout:3/695: readlink da/d90/d6f/laa 0 2024-09-15T22:26:49.377 INFO:tasks.workunit.client.0.smithi001.stdout:1/673: dread d3/d12/d79/dce/d14/d1b/f30 [0,4194304] 0 2024-09-15T22:26:49.379 INFO:tasks.workunit.client.0.smithi001.stdout:4/775: dwrite d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d73/fa8 [0,4194304] 0 2024-09-15T22:26:49.379 INFO:tasks.workunit.client.0.smithi001.stdout:4/776: chown d0/d27/d35/da4 2073992686 1 2024-09-15T22:26:49.379 INFO:tasks.workunit.client.0.smithi001.stdout:3/696: rename da/d16/f52 to da/d3d/d43/d7c/d3f/db5/fef 0 2024-09-15T22:26:49.379 INFO:tasks.workunit.client.0.smithi001.stdout:3/697: chown da/d90/da3/dda/ce9 90 1 2024-09-15T22:26:49.381 INFO:tasks.workunit.client.0.smithi001.stdout:4/777: creat d0/d5d/d7c/de8/dec/d107/f11a x:0 0 0 2024-09-15T22:26:49.381 INFO:tasks.workunit.client.0.smithi001.stdout:3/698: rename f8 to da/d3d/d43/d41/d70/ff0 0 2024-09-15T22:26:49.381 INFO:tasks.workunit.client.0.smithi001.stdout:0/562: dread d0/d9/d1a/d36/f3a [0,4194304] 0 2024-09-15T22:26:49.382 INFO:tasks.workunit.client.0.smithi001.stdout:4/778: read d0/d5d/d7c/dba/d20/d29/d34/d84/d95/f5f [284537,45901] 0 2024-09-15T22:26:49.384 INFO:tasks.workunit.client.0.smithi001.stdout:4/779: mkdir d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d11b 0 2024-09-15T22:26:49.385 INFO:tasks.workunit.client.0.smithi001.stdout:4/780: creat d0/d5d/d7c/dba/d20/df6/f11c x:0 0 0 2024-09-15T22:26:49.386 INFO:tasks.workunit.client.0.smithi001.stdout:4/781: dread - d0/d5d/d7c/dba/d20/d29/d34/db2/fa9 zero size 2024-09-15T22:26:49.386 INFO:tasks.workunit.client.0.smithi001.stdout:4/782: read - d0/d5d/d7c/dba/d20/d29/d34/f10b zero size 2024-09-15T22:26:49.386 INFO:tasks.workunit.client.0.smithi001.stdout:4/783: truncate d0/d27/d35/fe7 863699 0 2024-09-15T22:26:49.386 INFO:tasks.workunit.client.0.smithi001.stdout:4/784: stat d0/d5d/d7c/dba/f19 0 2024-09-15T22:26:49.391 INFO:tasks.workunit.client.0.smithi001.stdout:2/662: dread d2/d14/d1a/f69 [0,4194304] 0 2024-09-15T22:26:49.391 INFO:tasks.workunit.client.0.smithi001.stdout:3/699: rename da/d3d/d43/d41/d70 to da/d3d/d43/d41/df1 0 2024-09-15T22:26:49.391 INFO:tasks.workunit.client.0.smithi001.stdout:2/663: write d2/d14/f96 [988345,97757] 0 2024-09-15T22:26:49.392 INFO:tasks.workunit.client.0.smithi001.stdout:3/700: getdents da/d90/da3/dda 0 2024-09-15T22:26:49.393 INFO:tasks.workunit.client.0.smithi001.stdout:3/701: creat da/d3d/d43/d7c/d53/ff2 x:0 0 0 2024-09-15T22:26:49.400 INFO:tasks.workunit.client.0.smithi001.stdout:4/785: dread d0/d5d/d7c/dba/d20/d29/d34/f39 [0,4194304] 0 2024-09-15T22:26:49.401 INFO:tasks.workunit.client.0.smithi001.stdout:7/661: dwrite d0/f2a [0,4194304] 0 2024-09-15T22:26:49.409 INFO:tasks.workunit.client.0.smithi001.stdout:7/662: truncate d0/f7a 3910841 0 2024-09-15T22:26:49.413 INFO:tasks.workunit.client.0.smithi001.stdout:4/786: read d0/d5d/d7c/dba/f2d [1845430,30056] 0 2024-09-15T22:26:49.414 INFO:tasks.workunit.client.0.smithi001.stdout:4/787: fsync d0/d5d/d7c/dba/d20/d29/d40/f5a 0 2024-09-15T22:26:49.415 INFO:tasks.workunit.client.0.smithi001.stdout:1/674: write d3/d12/d79/dce/d3c/d64/fa6 [745200,106071] 0 2024-09-15T22:26:49.416 INFO:tasks.workunit.client.0.smithi001.stdout:1/675: mkdir d3/d12/d79/dce/d3c/d4c/dcc/dd1 0 2024-09-15T22:26:49.418 INFO:tasks.workunit.client.0.smithi001.stdout:1/676: mknod d3/d12/d79/dce/d14/d1b/d2b/cd2 0 2024-09-15T22:26:49.419 INFO:tasks.workunit.client.0.smithi001.stdout:8/626: dwrite d9/d19/d58/d8e/fb1 [0,4194304] 0 2024-09-15T22:26:49.419 INFO:tasks.workunit.client.0.smithi001.stdout:8/627: readlink d9/d19/d58/d88/l8b 0 2024-09-15T22:26:49.420 INFO:tasks.workunit.client.0.smithi001.stdout:6/664: dwrite d0/d6/d5d/d8c/f8d [0,4194304] 0 2024-09-15T22:26:49.420 INFO:tasks.workunit.client.0.smithi001.stdout:7/663: dread d0/d7/d44/d3f/fa6 [0,4194304] 0 2024-09-15T22:26:49.428 INFO:tasks.workunit.client.0.smithi001.stdout:6/665: getdents d0/d6/d5d/d67 0 2024-09-15T22:26:49.428 INFO:tasks.workunit.client.0.smithi001.stdout:1/677: fdatasync d3/d12/d79/dce/d86/fbf 0 2024-09-15T22:26:49.428 INFO:tasks.workunit.client.0.smithi001.stdout:6/666: mkdir d0/d6/d5d/d67/d53/da0/deb 0 2024-09-15T22:26:49.429 INFO:tasks.workunit.client.0.smithi001.stdout:6/667: write d0/df/d24/db1/fe5 [953332,43482] 0 2024-09-15T22:26:49.429 INFO:tasks.workunit.client.0.smithi001.stdout:1/678: mkdir d3/d12/d79/dd3 0 2024-09-15T22:26:49.429 INFO:tasks.workunit.client.0.smithi001.stdout:1/679: dread - d3/d12/d79/dce/d53/fcb zero size 2024-09-15T22:26:49.429 INFO:tasks.workunit.client.0.smithi001.stdout:1/680: write d3/d12/d79/dce/f19 [2008541,95523] 0 2024-09-15T22:26:49.429 INFO:tasks.workunit.client.0.smithi001.stdout:1/681: chown d3/d12/d79/dce/d14/d23/c28 37 1 2024-09-15T22:26:49.429 INFO:tasks.workunit.client.0.smithi001.stdout:1/682: mkdir d3/d8d/dd4 0 2024-09-15T22:26:49.430 INFO:tasks.workunit.client.0.smithi001.stdout:1/683: mknod d3/d12/d79/d89/cd5 0 2024-09-15T22:26:49.432 INFO:tasks.workunit.client.0.smithi001.stdout:1/684: link d3/d12/l20 d3/d12/d79/dce/d53/dc7/ld6 0 2024-09-15T22:26:49.447 INFO:tasks.workunit.client.0.smithi001.stdout:0/563: dwrite d0/dd/d33/f90 [0,4194304] 0 2024-09-15T22:26:49.449 INFO:tasks.workunit.client.0.smithi001.stdout:3/702: dread da/d3d/d43/f5a [0,4194304] 0 2024-09-15T22:26:49.450 INFO:tasks.workunit.client.0.smithi001.stdout:3/703: write da/d3d/fc9 [291002,119255] 0 2024-09-15T22:26:49.452 INFO:tasks.workunit.client.0.smithi001.stdout:3/704: creat da/d3d/d43/d7c/d53/d73/ff3 x:0 0 0 2024-09-15T22:26:49.456 INFO:tasks.workunit.client.0.smithi001.stdout:0/564: write d0/d6/f2a [875639,86182] 0 2024-09-15T22:26:49.460 INFO:tasks.workunit.client.0.smithi001.stdout:0/565: mkdir d0/d6/dae 0 2024-09-15T22:26:49.465 INFO:tasks.workunit.client.0.smithi001.stdout:0/566: rename d0/d9/db/l4a to d0/d9/laf 0 2024-09-15T22:26:49.471 INFO:tasks.workunit.client.0.smithi001.stdout:8/628: dwrite d9/d19/f77 [0,4194304] 0 2024-09-15T22:26:49.471 INFO:tasks.workunit.client.0.smithi001.stdout:8/629: dread - d9/d19/d58/d88/f9b zero size 2024-09-15T22:26:49.471 INFO:tasks.workunit.client.0.smithi001.stdout:8/630: fsync d9/d19/d58/d8e/fab 0 2024-09-15T22:26:49.471 INFO:tasks.workunit.client.0.smithi001.stdout:8/631: dread - d9/d19/d58/d8e/d9c/fae zero size 2024-09-15T22:26:49.472 INFO:tasks.workunit.client.0.smithi001.stdout:4/788: dread d0/d5d/d7c/dba/d20/f26 [0,4194304] 0 2024-09-15T22:26:49.472 INFO:tasks.workunit.client.0.smithi001.stdout:4/789: readlink d0/d5d/d7c/dba/le2 0 2024-09-15T22:26:49.472 INFO:tasks.workunit.client.0.smithi001.stdout:4/790: write d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d73/f117 [628843,99467] 0 2024-09-15T22:26:49.472 INFO:tasks.workunit.client.0.smithi001.stdout:4/791: stat d0/d5d/d7c/dba/d20/d29/d34 0 2024-09-15T22:26:49.472 INFO:tasks.workunit.client.0.smithi001.stdout:8/632: unlink d9/d19/d40/d5f/d61/f67 0 2024-09-15T22:26:49.473 INFO:tasks.workunit.client.0.smithi001.stdout:8/633: write d9/d19/d40/d5f/f87 [391211,59865] 0 2024-09-15T22:26:49.473 INFO:tasks.workunit.client.0.smithi001.stdout:8/634: stat d9/l6f 0 2024-09-15T22:26:49.473 INFO:tasks.workunit.client.0.smithi001.stdout:8/635: readlink d9/d19/d29/d50/d70/d76/d7d/la6 0 2024-09-15T22:26:49.474 INFO:tasks.workunit.client.0.smithi001.stdout:5/712: sync 2024-09-15T22:26:49.474 INFO:tasks.workunit.client.0.smithi001.stdout:9/573: sync 2024-09-15T22:26:49.474 INFO:tasks.workunit.client.0.smithi001.stdout:8/636: mknod d9/d19/d29/d50/d70/cb9 0 2024-09-15T22:26:49.475 INFO:tasks.workunit.client.0.smithi001.stdout:5/713: creat d3/d6/d41/d4d/dbe/d56/ddc/ff2 x:0 0 0 2024-09-15T22:26:49.478 INFO:tasks.workunit.client.0.smithi001.stdout:5/714: unlink d3/d6/d41/d88/da5/c98 0 2024-09-15T22:26:49.478 INFO:tasks.workunit.client.0.smithi001.stdout:2/664: dwrite d2/d14/d1a/d1b/f4d [0,4194304] 0 2024-09-15T22:26:49.488 INFO:tasks.workunit.client.0.smithi001.stdout:6/668: dread d0/df/d24/d2e/f1d [0,4194304] 0 2024-09-15T22:26:49.490 INFO:tasks.workunit.client.0.smithi001.stdout:2/665: rename d2/d14/f9a to d2/d14/d1a/d1b/d82/dc9/d6f/d70/fd8 0 2024-09-15T22:26:49.490 INFO:tasks.workunit.client.0.smithi001.stdout:4/792: dread d0/d5d/fb4 [0,4194304] 0 2024-09-15T22:26:49.491 INFO:tasks.workunit.client.0.smithi001.stdout:7/664: dwrite d0/d7/d21/f3d [0,4194304] 0 2024-09-15T22:26:49.492 INFO:tasks.workunit.client.0.smithi001.stdout:4/793: creat d0/d5d/d7c/dba/d20/d29/d40/dc8/f11d x:0 0 0 2024-09-15T22:26:49.493 INFO:tasks.workunit.client.0.smithi001.stdout:4/794: creat d0/d27/d35/d59/d67/d7b/f11e x:0 0 0 2024-09-15T22:26:49.497 INFO:tasks.workunit.client.0.smithi001.stdout:6/669: creat d0/df/d24/d49/dc7/fec x:0 0 0 2024-09-15T22:26:49.497 INFO:tasks.workunit.client.0.smithi001.stdout:4/795: creat d0/d5d/d7c/dba/d20/f11f x:0 0 0 2024-09-15T22:26:49.499 INFO:tasks.workunit.client.0.smithi001.stdout:5/715: dread d3/d6/f59 [0,4194304] 0 2024-09-15T22:26:49.499 INFO:tasks.workunit.client.0.smithi001.stdout:7/665: rename d0/d7/d44/d36/ccd to d0/d6a/dac/ce1 0 2024-09-15T22:26:49.500 INFO:tasks.workunit.client.0.smithi001.stdout:6/670: symlink d0/df/d24/db1/led 0 2024-09-15T22:26:49.500 INFO:tasks.workunit.client.0.smithi001.stdout:8/637: dread d9/d19/d29/d33/d63/fa9 [0,4194304] 0 2024-09-15T22:26:49.500 INFO:tasks.workunit.client.0.smithi001.stdout:4/796: symlink d0/d27/d94/df9/l120 0 2024-09-15T22:26:49.500 INFO:tasks.workunit.client.0.smithi001.stdout:4/797: getdents d0/d5d/d7c/dba/d20/d29/d40/dc8/dd8 0 2024-09-15T22:26:49.500 INFO:tasks.workunit.client.0.smithi001.stdout:5/716: mknod d3/d27/d4e/cf3 0 2024-09-15T22:26:49.503 INFO:tasks.workunit.client.0.smithi001.stdout:7/666: rename d0/f2a to d0/d7/d21/d6b/fe2 0 2024-09-15T22:26:49.503 INFO:tasks.workunit.client.0.smithi001.stdout:6/671: stat d0/d7e/ld0 0 2024-09-15T22:26:49.503 INFO:tasks.workunit.client.0.smithi001.stdout:7/667: chown d0/d7/d44/f28 685798 1 2024-09-15T22:26:49.503 INFO:tasks.workunit.client.0.smithi001.stdout:6/672: write d0/df/d24/d2e/f6f [989115,111179] 0 2024-09-15T22:26:49.504 INFO:tasks.workunit.client.0.smithi001.stdout:6/673: creat d0/d6/d5d/dd8/fee x:0 0 0 2024-09-15T22:26:49.504 INFO:tasks.workunit.client.0.smithi001.stdout:4/798: symlink d0/d5d/d7c/dba/d20/d29/l121 0 2024-09-15T22:26:49.506 INFO:tasks.workunit.client.0.smithi001.stdout:5/717: mknod d3/d6/d57/d87/d8c/da2/cf4 0 2024-09-15T22:26:49.506 INFO:tasks.workunit.client.0.smithi001.stdout:5/718: stat d3/d49/fc1 0 2024-09-15T22:26:49.506 INFO:tasks.workunit.client.0.smithi001.stdout:6/674: mkdir d0/df/d24/d49/dc7/def 0 2024-09-15T22:26:49.506 INFO:tasks.workunit.client.0.smithi001.stdout:4/799: unlink d0/d5d/d7c/dba/d20/fc3 0 2024-09-15T22:26:49.506 INFO:tasks.workunit.client.0.smithi001.stdout:6/675: rmdir d0/d6/d5d/d67/d53 39 2024-09-15T22:26:49.506 INFO:tasks.workunit.client.0.smithi001.stdout:6/676: write d0/d6/d5d/d67/f26 [13382970,73459] 0 2024-09-15T22:26:49.507 INFO:tasks.workunit.client.0.smithi001.stdout:6/677: mkdir d0/d6/d5d/d67/df0 0 2024-09-15T22:26:49.507 INFO:tasks.workunit.client.0.smithi001.stdout:4/800: unlink d0/d5d/d7c/dba/d20/f63 0 2024-09-15T22:26:49.507 INFO:tasks.workunit.client.0.smithi001.stdout:7/668: write d0/d7/d44/f78 [445719,44823] 0 2024-09-15T22:26:49.508 INFO:tasks.workunit.client.0.smithi001.stdout:6/678: creat d0/df/d24/d7b/db2/ff1 x:0 0 0 2024-09-15T22:26:49.508 INFO:tasks.workunit.client.0.smithi001.stdout:6/679: readlink d0/df/d24/d2e/d43/l35 0 2024-09-15T22:26:49.509 INFO:tasks.workunit.client.0.smithi001.stdout:4/801: link d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d73/fa8 d0/d5d/d7c/dba/d20/d29/d34/d9c/f122 0 2024-09-15T22:26:49.510 INFO:tasks.workunit.client.0.smithi001.stdout:6/680: unlink d0/d7e/ld0 0 2024-09-15T22:26:49.510 INFO:tasks.workunit.client.0.smithi001.stdout:6/681: dread - d0/df/d24/d49/dc7/fce zero size 2024-09-15T22:26:49.511 INFO:tasks.workunit.client.0.smithi001.stdout:4/802: creat d0/d5d/d7c/dd1/f123 x:0 0 0 2024-09-15T22:26:49.511 INFO:tasks.workunit.client.0.smithi001.stdout:4/803: fdatasync d0/f11 0 2024-09-15T22:26:49.511 INFO:tasks.workunit.client.0.smithi001.stdout:4/804: chown d0/f51 868 1 2024-09-15T22:26:49.511 INFO:tasks.workunit.client.0.smithi001.stdout:4/805: chown d0/d27/d35/d59/d67/d7b/c7f 4 1 2024-09-15T22:26:49.512 INFO:tasks.workunit.client.0.smithi001.stdout:2/666: dread d2/f3 [0,4194304] 0 2024-09-15T22:26:49.518 INFO:tasks.workunit.client.0.smithi001.stdout:1/685: dwrite d3/d12/d79/dce/d3c/d4c/f4e [4194304,4194304] 0 2024-09-15T22:26:49.518 INFO:tasks.workunit.client.0.smithi001.stdout:1/686: stat d3/d12/d79/dce/d3c/d64/f7e 0 2024-09-15T22:26:49.519 INFO:tasks.workunit.client.0.smithi001.stdout:3/705: dread da/d3b/f32 [8388608,4194304] 0 2024-09-15T22:26:49.526 INFO:tasks.workunit.client.0.smithi001.stdout:4/806: fsync d0/d5d/d7c/dba/d20/d29/d40/dc8/f11d 0 2024-09-15T22:26:49.530 INFO:tasks.workunit.client.0.smithi001.stdout:0/567: dwrite d0/d9/db/d5d/fa3 [0,4194304] 0 2024-09-15T22:26:49.532 INFO:tasks.workunit.client.0.smithi001.stdout:1/687: rename d3/d12/d79/dce/d3c/d64/f6a to d3/d8d/dd4/fd7 0 2024-09-15T22:26:49.532 INFO:tasks.workunit.client.0.smithi001.stdout:1/688: chown d3/d12/d21 3 1 2024-09-15T22:26:49.534 INFO:tasks.workunit.client.0.smithi001.stdout:1/689: getdents d3/d12/d79/dce/d14/d1b 0 2024-09-15T22:26:49.535 INFO:tasks.workunit.client.0.smithi001.stdout:1/690: mknod d3/d12/d79/dce/d14/db9/cd8 0 2024-09-15T22:26:49.536 INFO:tasks.workunit.client.0.smithi001.stdout:9/574: dwrite d5/de/d1a/d1b/d22/d2c/f61 [4194304,4194304] 0 2024-09-15T22:26:49.536 INFO:tasks.workunit.client.0.smithi001.stdout:1/691: creat d3/d12/dbd/fd9 x:0 0 0 2024-09-15T22:26:49.541 INFO:tasks.workunit.client.0.smithi001.stdout:9/575: symlink d5/de/d1a/da8/laa 0 2024-09-15T22:26:49.541 INFO:tasks.workunit.client.0.smithi001.stdout:0/568: creat d0/d84/fb0 x:0 0 0 2024-09-15T22:26:49.553 INFO:tasks.workunit.client.0.smithi001.stdout:1/692: dread d3/d12/d79/dce/d14/d23/f4f [0,4194304] 0 2024-09-15T22:26:49.554 INFO:tasks.workunit.client.0.smithi001.stdout:1/693: truncate d3/d12/d79/dce/d3c/d4c/f6b 926569 0 2024-09-15T22:26:49.557 INFO:tasks.workunit.client.0.smithi001.stdout:1/694: write d3/d12/d79/dce/d69/f92 [138881,70906] 0 2024-09-15T22:26:49.558 INFO:tasks.workunit.client.0.smithi001.stdout:1/695: creat d3/d12/d79/dce/d14/d1b/d98/fda x:0 0 0 2024-09-15T22:26:49.560 INFO:tasks.workunit.client.0.smithi001.stdout:1/696: mkdir d3/d12/d79/dce/d53/dc7/ddb 0 2024-09-15T22:26:49.563 INFO:tasks.workunit.client.0.smithi001.stdout:8/638: dwrite d9/d19/f3c [4194304,4194304] 0 2024-09-15T22:26:49.564 INFO:tasks.workunit.client.0.smithi001.stdout:1/697: symlink d3/d12/d79/dce/d14/d1b/ldc 0 2024-09-15T22:26:49.566 INFO:tasks.workunit.client.0.smithi001.stdout:1/698: mkdir d3/d12/d79/dce/d14/daa/ddd 0 2024-09-15T22:26:49.566 INFO:tasks.workunit.client.0.smithi001.stdout:1/699: chown d3/d12/d21 14225985 1 2024-09-15T22:26:49.579 INFO:tasks.workunit.client.0.smithi001.stdout:8/639: dread d9/d19/d58/d8e/fb1 [0,4194304] 0 2024-09-15T22:26:49.580 INFO:tasks.workunit.client.0.smithi001.stdout:8/640: dread - d9/d19/d29/d50/d89/f92 zero size 2024-09-15T22:26:49.587 INFO:tasks.workunit.client.0.smithi001.stdout:2/667: dwrite d2/fbe [0,4194304] 0 2024-09-15T22:26:49.588 INFO:tasks.workunit.client.0.smithi001.stdout:7/669: dwrite d0/d7/d44/d36/f72 [0,4194304] 0 2024-09-15T22:26:49.589 INFO:tasks.workunit.client.0.smithi001.stdout:3/706: dread da/d3d/d43/f5a [0,4194304] 0 2024-09-15T22:26:49.589 INFO:tasks.workunit.client.0.smithi001.stdout:5/719: dwrite d3/d27/d7a/fa8 [0,4194304] 0 2024-09-15T22:26:49.590 INFO:tasks.workunit.client.0.smithi001.stdout:8/641: unlink d9/d19/d58/f7b 0 2024-09-15T22:26:49.590 INFO:tasks.workunit.client.0.smithi001.stdout:5/720: chown d3/d6/d41/f4c 287909 1 2024-09-15T22:26:49.590 INFO:tasks.workunit.client.0.smithi001.stdout:2/668: creat d2/d14/d1a/d1b/d82/fd9 x:0 0 0 2024-09-15T22:26:49.591 INFO:tasks.workunit.client.0.smithi001.stdout:4/807: dread d0/d27/d35/f72 [0,4194304] 0 2024-09-15T22:26:49.591 INFO:tasks.workunit.client.0.smithi001.stdout:8/642: rename d9/d19/d29/d33/l80 to d9/lba 0 2024-09-15T22:26:49.592 INFO:tasks.workunit.client.0.smithi001.stdout:8/643: creat d9/d19/d29/fbb x:0 0 0 2024-09-15T22:26:49.595 INFO:tasks.workunit.client.0.smithi001.stdout:5/721: rmdir d3/d6/d41/d4d/dbe/d56/ddc 39 2024-09-15T22:26:49.595 INFO:tasks.workunit.client.0.smithi001.stdout:5/722: fsync d3/d27/f42 0 2024-09-15T22:26:49.595 INFO:tasks.workunit.client.0.smithi001.stdout:5/723: write d3/d6/d25/f2c [615618,28680] 0 2024-09-15T22:26:49.596 INFO:tasks.workunit.client.0.smithi001.stdout:4/808: getdents d0/d27/d35/d59/d67 0 2024-09-15T22:26:49.596 INFO:tasks.workunit.client.0.smithi001.stdout:4/809: chown d0/d5d/d7c/dba/d20/f119 594934830 1 2024-09-15T22:26:49.596 INFO:tasks.workunit.client.0.smithi001.stdout:5/724: creat d3/d6/d41/d4d/dbe/d56/d52/d61/dee/ff5 x:0 0 0 2024-09-15T22:26:49.598 INFO:tasks.workunit.client.0.smithi001.stdout:5/725: rename d3/d6/d41/d4d/dbe/d56/d52/d9f to d3/d6/d41/d4d/dbe/d56/ddc/de9/df6 0 2024-09-15T22:26:49.598 INFO:tasks.workunit.client.0.smithi001.stdout:5/726: chown d3/d49/f7e 59017 1 2024-09-15T22:26:49.603 INFO:tasks.workunit.client.0.smithi001.stdout:8/644: dread d9/d19/d29/d50/d70/f86 [0,4194304] 0 2024-09-15T22:26:49.606 INFO:tasks.workunit.client.0.smithi001.stdout:8/645: creat d9/d19/d40/d5f/fbc x:0 0 0 2024-09-15T22:26:49.606 INFO:tasks.workunit.client.0.smithi001.stdout:3/707: write da/d16/fba [1076746,22635] 0 2024-09-15T22:26:49.607 INFO:tasks.workunit.client.0.smithi001.stdout:3/708: dread - da/fa5 zero size 2024-09-15T22:26:49.609 INFO:tasks.workunit.client.0.smithi001.stdout:8/646: rename d9/d19/d58/d88/lb0 to d9/d19/d34/da4/db7/lbd 0 2024-09-15T22:26:49.609 INFO:tasks.workunit.client.0.smithi001.stdout:8/647: fsync d9/f31 0 2024-09-15T22:26:49.609 INFO:tasks.workunit.client.0.smithi001.stdout:7/670: dread d0/d6a/dac/dda/fa3 [0,4194304] 0 2024-09-15T22:26:49.609 INFO:tasks.workunit.client.0.smithi001.stdout:8/648: write d9/d19/d34/d41/f6e [1650720,59515] 0 2024-09-15T22:26:49.609 INFO:tasks.workunit.client.0.smithi001.stdout:3/709: getdents da/d3d/d43/d7c/d53/d73 0 2024-09-15T22:26:49.609 INFO:tasks.workunit.client.0.smithi001.stdout:7/671: write d0/d7/d21/d6b/fd2 [409379,111347] 0 2024-09-15T22:26:49.609 INFO:tasks.workunit.client.0.smithi001.stdout:3/710: chown da/d3d/d43/f5a 4723418 1 2024-09-15T22:26:49.615 INFO:tasks.workunit.client.0.smithi001.stdout:2/669: dread d2/d14/d1a/d1b/f22 [0,4194304] 0 2024-09-15T22:26:49.615 INFO:tasks.workunit.client.0.smithi001.stdout:2/670: write d2/d14/d1a/d1b/d82/dc9/fc3 [269412,40063] 0 2024-09-15T22:26:49.615 INFO:tasks.workunit.client.0.smithi001.stdout:2/671: chown d2/d14/d1a/f7a 10 1 2024-09-15T22:26:49.615 INFO:tasks.workunit.client.0.smithi001.stdout:2/672: chown d2/d12/d62/l91 42112 1 2024-09-15T22:26:49.615 INFO:tasks.workunit.client.0.smithi001.stdout:7/672: mknod d0/d8e/ce3 0 2024-09-15T22:26:49.625 INFO:tasks.workunit.client.0.smithi001.stdout:7/673: mknod d0/d7/d7c/ce4 0 2024-09-15T22:26:49.625 INFO:tasks.workunit.client.0.smithi001.stdout:7/674: stat d0/d7/d2e/f85 0 2024-09-15T22:26:49.627 INFO:tasks.workunit.client.0.smithi001.stdout:7/675: creat d0/db3/dd6/fe5 x:0 0 0 2024-09-15T22:26:49.628 INFO:tasks.workunit.client.0.smithi001.stdout:7/676: unlink d0/d7/d44/d3f/fd7 0 2024-09-15T22:26:49.628 INFO:tasks.workunit.client.0.smithi001.stdout:7/677: write d0/d7/d2e/d60/dbd/fcc [145963,26163] 0 2024-09-15T22:26:49.629 INFO:tasks.workunit.client.0.smithi001.stdout:7/678: creat d0/d7/d44/d36/fe6 x:0 0 0 2024-09-15T22:26:49.637 INFO:tasks.workunit.client.0.smithi001.stdout:0/569: dwrite d0/d6/f15 [0,4194304] 0 2024-09-15T22:26:49.645 INFO:tasks.workunit.client.0.smithi001.stdout:0/570: rename d0/d9/db/d5d/c67 to d0/dd/d33/cb1 0 2024-09-15T22:26:49.649 INFO:tasks.workunit.client.0.smithi001.stdout:2/673: dread d2/d12/d62/d64/fad [0,4194304] 0 2024-09-15T22:26:49.649 INFO:tasks.workunit.client.0.smithi001.stdout:3/711: dwrite da/d3d/d43/d7c/d3f/f87 [0,4194304] 0 2024-09-15T22:26:49.652 INFO:tasks.workunit.client.0.smithi001.stdout:3/712: symlink da/d3d/d43/d41/df1/d7f/lf4 0 2024-09-15T22:26:49.654 INFO:tasks.workunit.client.0.smithi001.stdout:3/713: symlink da/d3d/d43/d41/df1/d7f/lf5 0 2024-09-15T22:26:49.655 INFO:tasks.workunit.client.0.smithi001.stdout:4/810: dwrite d0/d27/d94/df9/f100 [0,4194304] 0 2024-09-15T22:26:49.657 INFO:tasks.workunit.client.0.smithi001.stdout:3/714: symlink da/d3b/d58/lf6 0 2024-09-15T22:26:49.657 INFO:tasks.workunit.client.0.smithi001.stdout:3/715: getdents da/d3d/d43/d7c/d53/d73 0 2024-09-15T22:26:49.657 INFO:tasks.workunit.client.0.smithi001.stdout:7/679: dread d0/d7/d21/d6b/fe2 [0,4194304] 0 2024-09-15T22:26:49.659 INFO:tasks.workunit.client.0.smithi001.stdout:3/716: mknod da/d90/d92/cf7 0 2024-09-15T22:26:49.660 INFO:tasks.workunit.client.0.smithi001.stdout:7/680: rename d0/d7/d44/l31 to d0/d8e/le7 0 2024-09-15T22:26:49.661 INFO:tasks.workunit.client.0.smithi001.stdout:3/717: unlink da/f1c 0 2024-09-15T22:26:49.665 INFO:tasks.workunit.client.0.smithi001.stdout:0/571: dread d0/d9/db/f83 [0,4194304] 0 2024-09-15T22:26:49.665 INFO:tasks.workunit.client.0.smithi001.stdout:0/572: chown d0/d9/db/d5d/d6d/c7c 152 1 2024-09-15T22:26:49.665 INFO:tasks.workunit.client.0.smithi001.stdout:7/681: mknod d0/d7/d21/ce8 0 2024-09-15T22:26:49.668 INFO:tasks.workunit.client.0.smithi001.stdout:5/727: dwrite d3/d6/d25/f2c [0,4194304] 0 2024-09-15T22:26:49.674 INFO:tasks.workunit.client.0.smithi001.stdout:0/573: truncate d0/d9/f1c 3171389 0 2024-09-15T22:26:49.676 INFO:tasks.workunit.client.0.smithi001.stdout:4/811: dread d0/d5d/d44/d65/f9a [0,4194304] 0 2024-09-15T22:26:49.683 INFO:tasks.workunit.client.0.smithi001.stdout:0/574: creat d0/d9/fb2 x:0 0 0 2024-09-15T22:26:49.683 INFO:tasks.workunit.client.0.smithi001.stdout:4/812: rename d0/d27/d35 to d0/d5d/d7c/dba/d20/d29/d124 0 2024-09-15T22:26:49.683 INFO:tasks.workunit.client.0.smithi001.stdout:4/813: mknod d0/d27/c125 0 2024-09-15T22:26:49.687 INFO:tasks.workunit.client.0.smithi001.stdout:2/674: dwrite d2/d14/f96 [0,4194304] 0 2024-09-15T22:26:49.688 INFO:tasks.workunit.client.0.smithi001.stdout:2/675: unlink d2/d12/d62/d64/c57 0 2024-09-15T22:26:49.689 INFO:tasks.workunit.client.0.smithi001.stdout:2/676: creat d2/d14/d1a/d1b/d82/fda x:0 0 0 2024-09-15T22:26:49.693 INFO:tasks.workunit.client.0.smithi001.stdout:3/718: dread da/d16/fba [0,4194304] 0 2024-09-15T22:26:49.695 INFO:tasks.workunit.client.0.smithi001.stdout:3/719: creat da/d90/da3/dda/ff8 x:0 0 0 2024-09-15T22:26:49.695 INFO:tasks.workunit.client.0.smithi001.stdout:3/720: readlink da/d3d/d43/l79 0 2024-09-15T22:26:49.696 INFO:tasks.workunit.client.0.smithi001.stdout:3/721: truncate da/dae/d8e/f96 360173 0 2024-09-15T22:26:49.706 INFO:tasks.workunit.client.0.smithi001.stdout:0/575: write d0/d6/f15 [3599988,34750] 0 2024-09-15T22:26:49.707 INFO:tasks.workunit.client.0.smithi001.stdout:4/814: dread d0/f1f [0,4194304] 0 2024-09-15T22:26:49.707 INFO:tasks.workunit.client.0.smithi001.stdout:8/649: dwrite d9/d19/d58/d8e/d9c/fae [0,4194304] 0 2024-09-15T22:26:49.707 INFO:tasks.workunit.client.0.smithi001.stdout:4/815: symlink d0/d27/d94/d102/l126 0 2024-09-15T22:26:49.716 INFO:tasks.workunit.client.0.smithi001.stdout:9/576: sync 2024-09-15T22:26:49.716 INFO:tasks.workunit.client.0.smithi001.stdout:6/682: sync 2024-09-15T22:26:49.716 INFO:tasks.workunit.client.0.smithi001.stdout:1/700: sync 2024-09-15T22:26:49.717 INFO:tasks.workunit.client.0.smithi001.stdout:6/683: chown d0/df/d24 112 1 2024-09-15T22:26:49.717 INFO:tasks.workunit.client.0.smithi001.stdout:6/684: chown d0/d6/d5d/d8c/le8 228842820 1 2024-09-15T22:26:49.723 INFO:tasks.workunit.client.0.smithi001.stdout:7/682: dwrite d0/d7/d44/d3f/f75 [0,4194304] 0 2024-09-15T22:26:49.726 INFO:tasks.workunit.client.0.smithi001.stdout:4/816: write d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d73/fd0 [6904605,128072] 0 2024-09-15T22:26:49.726 INFO:tasks.workunit.client.0.smithi001.stdout:4/817: chown d0/d5d/d7c/de8/dec/d107/f10c 2 1 2024-09-15T22:26:49.726 INFO:tasks.workunit.client.0.smithi001.stdout:6/685: creat d0/df/d24/d2e/d43/d30/ff2 x:0 0 0 2024-09-15T22:26:49.730 INFO:tasks.workunit.client.0.smithi001.stdout:0/576: dread d0/d9/db/d5d/f76 [0,4194304] 0 2024-09-15T22:26:49.731 INFO:tasks.workunit.client.0.smithi001.stdout:1/701: dread d3/d12/d79/dce/d3c/d7d/fad [0,4194304] 0 2024-09-15T22:26:49.732 INFO:tasks.workunit.client.0.smithi001.stdout:1/702: getdents d3/d12/d79/dce/d14/d1b/d98 0 2024-09-15T22:26:49.740 INFO:tasks.workunit.client.0.smithi001.stdout:7/683: mknod d0/d98/ce9 0 2024-09-15T22:26:49.744 INFO:tasks.workunit.client.0.smithi001.stdout:0/577: link d0/d6/d77/d78/fa6 d0/d6/d77/fb3 0 2024-09-15T22:26:49.744 INFO:tasks.workunit.client.0.smithi001.stdout:7/684: symlink d0/lea 0 2024-09-15T22:26:49.745 INFO:tasks.workunit.client.0.smithi001.stdout:0/578: unlink d0/d9/f26 0 2024-09-15T22:26:49.746 INFO:tasks.workunit.client.0.smithi001.stdout:6/686: dread d0/d6/d5d/d67/d53/fa4 [0,4194304] 0 2024-09-15T22:26:49.746 INFO:tasks.workunit.client.0.smithi001.stdout:7/685: unlink d0/d7/d2e/f85 0 2024-09-15T22:26:49.746 INFO:tasks.workunit.client.0.smithi001.stdout:7/686: write d0/d8e/d3e/f67 [4277770,85154] 0 2024-09-15T22:26:49.748 INFO:tasks.workunit.client.0.smithi001.stdout:1/703: dread d3/d12/d79/dce/f55 [0,4194304] 0 2024-09-15T22:26:49.748 INFO:tasks.workunit.client.0.smithi001.stdout:6/687: creat d0/d6/d5d/dd8/ff3 x:0 0 0 2024-09-15T22:26:49.749 INFO:tasks.workunit.client.0.smithi001.stdout:7/687: mknod d0/d7/d2e/ceb 0 2024-09-15T22:26:49.751 INFO:tasks.workunit.client.0.smithi001.stdout:7/688: unlink d0/d6a/fa2 0 2024-09-15T22:26:49.752 INFO:tasks.workunit.client.0.smithi001.stdout:8/650: write d9/d19/d29/f3e [439126,12061] 0 2024-09-15T22:26:49.752 INFO:tasks.workunit.client.0.smithi001.stdout:8/651: stat d9/d19/d40/d9e 0 2024-09-15T22:26:49.761 INFO:tasks.workunit.client.0.smithi001.stdout:3/722: dwrite da/d3d/d43/d7c/d53/d73/fdb [0,4194304] 0 2024-09-15T22:26:49.761 INFO:tasks.workunit.client.0.smithi001.stdout:3/723: write da/d3d/d43/d41/df1/d7f/fc5 [912834,62854] 0 2024-09-15T22:26:49.761 INFO:tasks.workunit.client.0.smithi001.stdout:3/724: write da/dae/f83 [334983,60509] 0 2024-09-15T22:26:49.761 INFO:tasks.workunit.client.0.smithi001.stdout:7/689: creat d0/d7/d2e/fec x:0 0 0 2024-09-15T22:26:49.763 INFO:tasks.workunit.client.0.smithi001.stdout:9/577: dread d5/de/d1a/d1b/d2a/f78 [0,4194304] 0 2024-09-15T22:26:49.765 INFO:tasks.workunit.client.0.smithi001.stdout:7/690: creat d0/d7/d21/d6b/fed x:0 0 0 2024-09-15T22:26:49.770 INFO:tasks.workunit.client.0.smithi001.stdout:0/579: dread d0/d9/f1c [0,4194304] 0 2024-09-15T22:26:49.770 INFO:tasks.workunit.client.0.smithi001.stdout:2/677: dwrite d2/d12/d62/d64/d76/db4/fce [0,4194304] 0 2024-09-15T22:26:49.773 INFO:tasks.workunit.client.0.smithi001.stdout:3/725: rename da/d90/da3 to da/d3d/d43/d7c/d3f/db5/df9 0 2024-09-15T22:26:49.774 INFO:tasks.workunit.client.0.smithi001.stdout:9/578: truncate d5/de/f18 3425243 0 2024-09-15T22:26:49.776 INFO:tasks.workunit.client.0.smithi001.stdout:4/818: dwrite d0/d5d/d7c/dba/f5b [0,4194304] 0 2024-09-15T22:26:49.776 INFO:tasks.workunit.client.0.smithi001.stdout:4/819: chown d0/d5d/d7c/dba/d20/d29/d34/dbc/dbf/c106 6198 1 2024-09-15T22:26:49.779 INFO:tasks.workunit.client.0.smithi001.stdout:3/726: unlink da/d3d/d43/d7c/d53/cca 0 2024-09-15T22:26:49.779 INFO:tasks.workunit.client.0.smithi001.stdout:7/691: rename d0/d8e/f32 to d0/d6a/fee 0 2024-09-15T22:26:49.783 INFO:tasks.workunit.client.0.smithi001.stdout:9/579: read d5/de/d1a/d1b/d22/d2c/d21/f8e [229930,55733] 0 2024-09-15T22:26:49.785 INFO:tasks.workunit.client.0.smithi001.stdout:7/692: creat d0/d7/d44/d3f/fef x:0 0 0 2024-09-15T22:26:49.786 INFO:tasks.workunit.client.0.smithi001.stdout:9/580: mkdir d5/de/d1a/d1b/d22/d2c/dab 0 2024-09-15T22:26:49.787 INFO:tasks.workunit.client.0.smithi001.stdout:9/581: fsync d5/de/d1a/d1b/d22/d2c/d21/d24/f69 0 2024-09-15T22:26:49.791 INFO:tasks.workunit.client.0.smithi001.stdout:4/820: dread d0/d5d/d7c/dba/d20/d29/d124/d59/d67/fee [0,4194304] 0 2024-09-15T22:26:49.791 INFO:tasks.workunit.client.0.smithi001.stdout:4/821: write d0/d5d/d7c/dd1/fad [869233,6174] 0 2024-09-15T22:26:49.791 INFO:tasks.workunit.client.0.smithi001.stdout:4/822: truncate d0/d5d/d7c/dba/d20/d29/d34/db2/fa9 608661 0 2024-09-15T22:26:49.791 INFO:tasks.workunit.client.0.smithi001.stdout:4/823: chown d0/d5d/d7c/dba/d20/d29/d34/dbc/dbf/ff5 42162 1 2024-09-15T22:26:49.799 INFO:tasks.workunit.client.0.smithi001.stdout:4/824: mknod d0/d5d/d7c/dba/d20/df6/c127 0 2024-09-15T22:26:49.800 INFO:tasks.workunit.client.0.smithi001.stdout:4/825: creat d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d73/f128 x:0 0 0 2024-09-15T22:26:49.801 INFO:tasks.workunit.client.0.smithi001.stdout:4/826: mkdir d0/d5d/d7c/dba/d20/d29/d34/d84/d95/dd3/d129 0 2024-09-15T22:26:49.804 INFO:tasks.workunit.client.0.smithi001.stdout:3/727: dread da/d3d/d43/f2a [0,4194304] 0 2024-09-15T22:26:49.804 INFO:tasks.workunit.client.0.smithi001.stdout:3/728: chown da/d3b/d8b/dee/fa2 128932299 1 2024-09-15T22:26:49.810 INFO:tasks.workunit.client.0.smithi001.stdout:7/693: dread d0/d7/d44/d3f/faf [4194304,4194304] 0 2024-09-15T22:26:49.811 INFO:tasks.workunit.client.0.smithi001.stdout:7/694: chown d0/d7/d2e/l8a 18026 1 2024-09-15T22:26:49.813 INFO:tasks.workunit.client.0.smithi001.stdout:7/695: rename d0/d7/d44/f47 to d0/d7/d44/d3f/d49/d4f/ff0 0 2024-09-15T22:26:49.814 INFO:tasks.workunit.client.0.smithi001.stdout:7/696: creat d0/d7/d7c/ff1 x:0 0 0 2024-09-15T22:26:49.815 INFO:tasks.workunit.client.0.smithi001.stdout:7/697: rename d0/f2f to d0/dd3/ff2 0 2024-09-15T22:26:49.816 INFO:tasks.workunit.client.0.smithi001.stdout:7/698: getdents d0/d98 0 2024-09-15T22:26:49.817 INFO:tasks.workunit.client.0.smithi001.stdout:7/699: mkdir d0/d7/df3 0 2024-09-15T22:26:49.819 INFO:tasks.workunit.client.0.smithi001.stdout:7/700: write d0/d7/d44/d3f/d49/fc1 [638280,102077] 0 2024-09-15T22:26:49.829 INFO:tasks.workunit.client.0.smithi001.stdout:9/582: write d5/de/d1a/d1b/d22/d2c/f61 [7153225,47972] 0 2024-09-15T22:26:49.829 INFO:tasks.workunit.client.0.smithi001.stdout:9/583: truncate d5/de/d1a/f8c 64541 0 2024-09-15T22:26:49.829 INFO:tasks.workunit.client.0.smithi001.stdout:9/584: readlink d5/de/d15/d27/d63/l9d 0 2024-09-15T22:26:49.830 INFO:tasks.workunit.client.0.smithi001.stdout:9/585: creat d5/de/d1a/d1b/d22/d2c/d21/d23/fac x:0 0 0 2024-09-15T22:26:49.835 INFO:tasks.workunit.client.0.smithi001.stdout:3/729: dread da/f13 [0,4194304] 0 2024-09-15T22:26:49.835 INFO:tasks.workunit.client.0.smithi001.stdout:3/730: write da/d9e/fa4 [2160756,118895] 0 2024-09-15T22:26:49.836 INFO:tasks.workunit.client.0.smithi001.stdout:1/704: dwrite d3/d12/d79/dce/d14/d1b/d98/fda [0,4194304] 0 2024-09-15T22:26:49.837 INFO:tasks.workunit.client.0.smithi001.stdout:3/731: creat da/d3d/d43/d7c/d3f/db5/dce/ffa x:0 0 0 2024-09-15T22:26:49.839 INFO:tasks.workunit.client.0.smithi001.stdout:1/705: creat d3/d8d/dd4/fde x:0 0 0 2024-09-15T22:26:49.848 INFO:tasks.workunit.client.0.smithi001.stdout:6/688: dwrite d0/d6/f71 [0,4194304] 0 2024-09-15T22:26:49.856 INFO:tasks.workunit.client.0.smithi001.stdout:7/701: dread d0/d7/d44/d3f/d49/da5/faa [4194304,4194304] 0 2024-09-15T22:26:49.856 INFO:tasks.workunit.client.0.smithi001.stdout:7/702: chown d0/d7/d2e/f63 6501868 1 2024-09-15T22:26:49.857 INFO:tasks.workunit.client.0.smithi001.stdout:2/678: dwrite d2/d14/d1a/d80/fae [0,4194304] 0 2024-09-15T22:26:49.858 INFO:tasks.workunit.client.0.smithi001.stdout:7/703: rename d0/d7/d21/d6b/d93/lcb to d0/d7/d44/d3f/d49/d4f/lf4 0 2024-09-15T22:26:49.859 INFO:tasks.workunit.client.0.smithi001.stdout:7/704: mkdir d0/db3/dd6/df5 0 2024-09-15T22:26:49.860 INFO:tasks.workunit.client.0.smithi001.stdout:7/705: mkdir d0/db3/dd6/df5/df6 0 2024-09-15T22:26:49.863 INFO:tasks.workunit.client.0.smithi001.stdout:7/706: truncate d0/d7/d44/d3f/f75 1808132 0 2024-09-15T22:26:49.863 INFO:tasks.workunit.client.0.smithi001.stdout:7/707: write d0/d7/d44/d3f/fa6 [2171297,107531] 0 2024-09-15T22:26:49.864 INFO:tasks.workunit.client.0.smithi001.stdout:7/708: fdatasync d0/d98/fca 0 2024-09-15T22:26:49.873 INFO:tasks.workunit.client.0.smithi001.stdout:4/827: dwrite d0/d5d/d7c/dba/d20/d29/d124/f69 [4194304,4194304] 0 2024-09-15T22:26:49.873 INFO:tasks.workunit.client.0.smithi001.stdout:4/828: stat d0/d5d/d7c/dba/d20/d29/d40/f5a 0 2024-09-15T22:26:49.875 INFO:tasks.workunit.client.0.smithi001.stdout:4/829: symlink d0/d5d/d7c/dba/d20/d29/d34/dbc/l12a 0 2024-09-15T22:26:49.875 INFO:tasks.workunit.client.0.smithi001.stdout:4/830: chown d0/d5d/d7c/dba/d20/d29/d34/dbc/dbf/c106 1 1 2024-09-15T22:26:49.875 INFO:tasks.workunit.client.0.smithi001.stdout:4/831: write d0/d5d/d7c/dba/d20/df6/f11c [221647,105649] 0 2024-09-15T22:26:49.876 INFO:tasks.workunit.client.0.smithi001.stdout:4/832: write d0/d5d/d7c/dba/d20/d29/d124/d59/fb0 [1232673,86039] 0 2024-09-15T22:26:49.876 INFO:tasks.workunit.client.0.smithi001.stdout:0/580: dwrite d0/dd/d33/f90 [0,4194304] 0 2024-09-15T22:26:49.882 INFO:tasks.workunit.client.0.smithi001.stdout:0/581: creat d0/d9/db/d5d/d6d/fb4 x:0 0 0 2024-09-15T22:26:49.883 INFO:tasks.workunit.client.0.smithi001.stdout:0/582: mknod d0/d84/cb5 0 2024-09-15T22:26:49.884 INFO:tasks.workunit.client.0.smithi001.stdout:0/583: readlink d0/d9/d1a/d36/l57 0 2024-09-15T22:26:49.886 INFO:tasks.workunit.client.0.smithi001.stdout:1/706: dwrite d3/d12/d79/dce/d14/d1b/fa8 [0,4194304] 0 2024-09-15T22:26:49.886 INFO:tasks.workunit.client.0.smithi001.stdout:1/707: write d3/d12/d79/dce/d14/f1c [2962503,105571] 0 2024-09-15T22:26:49.887 INFO:tasks.workunit.client.0.smithi001.stdout:0/584: mkdir d0/dd/d63/db6 0 2024-09-15T22:26:49.891 INFO:tasks.workunit.client.0.smithi001.stdout:1/708: creat d3/d12/d79/dce/d14/fdf x:0 0 0 2024-09-15T22:26:49.893 INFO:tasks.workunit.client.0.smithi001.stdout:6/689: dwrite d0/df/d24/d49/f6a [0,4194304] 0 2024-09-15T22:26:49.893 INFO:tasks.workunit.client.0.smithi001.stdout:6/690: truncate d0/df/d97/fdf 657477 0 2024-09-15T22:26:49.893 INFO:tasks.workunit.client.0.smithi001.stdout:6/691: dread - d0/d6/d5d/dd8/fee zero size 2024-09-15T22:26:49.893 INFO:tasks.workunit.client.0.smithi001.stdout:6/692: truncate d0/df/d24/d49/dc7/fce 508520 0 2024-09-15T22:26:49.901 INFO:tasks.workunit.client.0.smithi001.stdout:6/693: rmdir d0/df/d24/d7b 39 2024-09-15T22:26:49.904 INFO:tasks.workunit.client.0.smithi001.stdout:6/694: write d0/d6/d5d/d8c/f8e [288663,65543] 0 2024-09-15T22:26:49.908 INFO:tasks.workunit.client.0.smithi001.stdout:6/695: write d0/d6/d5d/d67/f38 [605854,77257] 0 2024-09-15T22:26:49.917 INFO:tasks.workunit.client.0.smithi001.stdout:7/709: dwrite d0/d7/d44/f1c [8388608,4194304] 0 2024-09-15T22:26:49.951 INFO:tasks.workunit.client.0.smithi001.stdout:9/586: dwrite d5/d3e/f52 [0,4194304] 0 2024-09-15T22:26:49.951 INFO:tasks.workunit.client.0.smithi001.stdout:6/696: dwrite d0/f19 [4194304,4194304] 0 2024-09-15T22:26:49.951 INFO:tasks.workunit.client.0.smithi001.stdout:6/697: write d0/df/d24/f7f [1114871,77877] 0 2024-09-15T22:26:49.951 INFO:tasks.workunit.client.0.smithi001.stdout:6/698: write d0/d6/d5d/f63 [1604162,58483] 0 2024-09-15T22:26:49.952 INFO:tasks.workunit.client.0.smithi001.stdout:6/699: fdatasync d0/df/fb3 0 2024-09-15T22:26:49.952 INFO:tasks.workunit.client.0.smithi001.stdout:2/679: write d2/d12/d62/d64/fad [2714149,20339] 0 2024-09-15T22:26:49.953 INFO:tasks.workunit.client.0.smithi001.stdout:3/732: dwrite da/d90/fb6 [0,4194304] 0 2024-09-15T22:26:49.954 INFO:tasks.workunit.client.0.smithi001.stdout:2/680: mknod d2/d14/d1a/d1b/cdb 0 2024-09-15T22:26:49.954 INFO:tasks.workunit.client.0.smithi001.stdout:2/681: fdatasync d2/d14/d1a/d1b/d82/dc9/f7e 0 2024-09-15T22:26:49.956 INFO:tasks.workunit.client.0.smithi001.stdout:6/700: mkdir d0/d6/d5d/d67/d53/da0/df4 0 2024-09-15T22:26:49.959 INFO:tasks.workunit.client.0.smithi001.stdout:1/709: dwrite d3/f39 [4194304,4194304] 0 2024-09-15T22:26:49.963 INFO:tasks.workunit.client.0.smithi001.stdout:8/652: sync 2024-09-15T22:26:49.963 INFO:tasks.workunit.client.0.smithi001.stdout:5/728: sync 2024-09-15T22:26:49.963 INFO:tasks.workunit.client.0.smithi001.stdout:5/729: chown d3/d6/d41/f82 896 1 2024-09-15T22:26:49.964 INFO:tasks.workunit.client.0.smithi001.stdout:5/730: mknod d3/d6/d57/d87/d8c/cf7 0 2024-09-15T22:26:49.964 INFO:tasks.workunit.client.0.smithi001.stdout:5/731: write d3/d6/d25/f2c [4771355,84879] 0 2024-09-15T22:26:49.965 INFO:tasks.workunit.client.0.smithi001.stdout:8/653: rename d9/f27 to d9/d19/fbe 0 2024-09-15T22:26:49.965 INFO:tasks.workunit.client.0.smithi001.stdout:8/654: dread - d9/d19/d40/fa3 zero size 2024-09-15T22:26:49.965 INFO:tasks.workunit.client.0.smithi001.stdout:5/732: creat d3/d6/d25/ff8 x:0 0 0 2024-09-15T22:26:49.968 INFO:tasks.workunit.client.0.smithi001.stdout:8/655: creat d9/d19/d34/d41/fbf x:0 0 0 2024-09-15T22:26:49.972 INFO:tasks.workunit.client.0.smithi001.stdout:4/833: dwrite d0/d5d/d7c/dba/d20/f25 [0,4194304] 0 2024-09-15T22:26:49.972 INFO:tasks.workunit.client.0.smithi001.stdout:5/733: creat d3/d27/d4e/d89/dae/ff9 x:0 0 0 2024-09-15T22:26:49.976 INFO:tasks.workunit.client.0.smithi001.stdout:8/656: creat d9/d19/d34/d41/d99/fc0 x:0 0 0 2024-09-15T22:26:49.978 INFO:tasks.workunit.client.0.smithi001.stdout:6/701: write d0/d6/d5d/d8c/f8d [2002996,43733] 0 2024-09-15T22:26:49.979 INFO:tasks.workunit.client.0.smithi001.stdout:2/682: read d2/f3 [2648175,84495] 0 2024-09-15T22:26:49.983 INFO:tasks.workunit.client.0.smithi001.stdout:1/710: write d3/d12/d79/dce/f38 [249938,117385] 0 2024-09-15T22:26:49.983 INFO:tasks.workunit.client.0.smithi001.stdout:1/711: stat d3/d12/d79/dce/d14/d1b/d2b/d68/d8a/lcf 0 2024-09-15T22:26:49.984 INFO:tasks.workunit.client.0.smithi001.stdout:1/712: chown d3/d12/dbd/fd9 2 1 2024-09-15T22:26:49.984 INFO:tasks.workunit.client.0.smithi001.stdout:1/713: chown d3/f99 8168 1 2024-09-15T22:26:49.984 INFO:tasks.workunit.client.0.smithi001.stdout:4/834: dread d0/d5d/d7c/dba/d20/d29/d34/f52 [0,4194304] 0 2024-09-15T22:26:49.984 INFO:tasks.workunit.client.0.smithi001.stdout:6/702: rmdir d0/df/d97 39 2024-09-15T22:26:49.984 INFO:tasks.workunit.client.0.smithi001.stdout:1/714: mknod d3/d12/d79/d85/ce0 0 2024-09-15T22:26:49.985 INFO:tasks.workunit.client.0.smithi001.stdout:8/657: mknod d9/d19/d58/cc1 0 2024-09-15T22:26:49.986 INFO:tasks.workunit.client.0.smithi001.stdout:1/715: getdents d3/d12/d79/dce/d14/d1b/d2b 0 2024-09-15T22:26:49.989 INFO:tasks.workunit.client.0.smithi001.stdout:5/734: write d3/d6/d25/f7f [2337213,91522] 0 2024-09-15T22:26:49.989 INFO:tasks.workunit.client.0.smithi001.stdout:5/735: stat d3/d6/d41/d4d/l64 0 2024-09-15T22:26:49.990 INFO:tasks.workunit.client.0.smithi001.stdout:1/716: getdents d3/d12/d79 0 2024-09-15T22:26:49.990 INFO:tasks.workunit.client.0.smithi001.stdout:3/733: dwrite da/dae/fd9 [0,4194304] 0 2024-09-15T22:26:49.991 INFO:tasks.workunit.client.0.smithi001.stdout:3/734: mkdir da/d3b/d8b/dbe/dfb 0 2024-09-15T22:26:49.993 INFO:tasks.workunit.client.0.smithi001.stdout:3/735: rename da/d9e/fa4 to da/d90/d6f/ffc 0 2024-09-15T22:26:49.996 INFO:tasks.workunit.client.0.smithi001.stdout:3/736: stat da/d3b/d8b/dbe 0 2024-09-15T22:26:50.005 INFO:tasks.workunit.client.0.smithi001.stdout:1/717: rmdir d3/d12/d21/d8f 0 2024-09-15T22:26:50.008 INFO:tasks.workunit.client.0.smithi001.stdout:1/718: rename d3/d12/d79/dce/d14/d1b/d98/fda to d3/d12/d79/dce/d69/fe1 0 2024-09-15T22:26:50.008 INFO:tasks.workunit.client.0.smithi001.stdout:1/719: write d3/d12/d79/dce/d3c/f43 [6216776,87369] 0 2024-09-15T22:26:50.010 INFO:tasks.workunit.client.0.smithi001.stdout:1/720: symlink d3/d12/d79/dce/d14/d23/da1/dc6/le2 0 2024-09-15T22:26:50.010 INFO:tasks.workunit.client.0.smithi001.stdout:1/721: chown d3/d12/d79/dce/d14/daa/fb2 27490948 1 2024-09-15T22:26:50.011 INFO:tasks.workunit.client.0.smithi001.stdout:0/585: dwrite d0/d9/f32 [0,4194304] 0 2024-09-15T22:26:50.011 INFO:tasks.workunit.client.0.smithi001.stdout:0/586: chown d0/d9/d1a/fa8 0 1 2024-09-15T22:26:50.025 INFO:tasks.workunit.client.0.smithi001.stdout:1/722: mknod d3/d12/d79/dce/ce3 0 2024-09-15T22:26:50.025 INFO:tasks.workunit.client.0.smithi001.stdout:1/723: truncate d3/d12/d79/dce/f38 1200673 0 2024-09-15T22:26:50.026 INFO:tasks.workunit.client.0.smithi001.stdout:1/724: mkdir d3/d12/de4 0 2024-09-15T22:26:50.027 INFO:tasks.workunit.client.0.smithi001.stdout:1/725: creat d3/d12/d79/dce/d53/fe5 x:0 0 0 2024-09-15T22:26:50.029 INFO:tasks.workunit.client.0.smithi001.stdout:1/726: mkdir d3/d12/d79/dce/d14/d1b/d2b/de6 0 2024-09-15T22:26:50.031 INFO:tasks.workunit.client.0.smithi001.stdout:1/727: link d3/d12/d79/dce/d14/d23/l75 d3/d12/d79/d85/le7 0 2024-09-15T22:26:50.031 INFO:tasks.workunit.client.0.smithi001.stdout:1/728: write d3/fc0 [2606518,48375] 0 2024-09-15T22:26:50.053 INFO:tasks.workunit.client.0.smithi001.stdout:5/736: dwrite d3/d6/d57/f8f [0,4194304] 0 2024-09-15T22:26:50.053 INFO:tasks.workunit.client.0.smithi001.stdout:5/737: write d3/d6/d41/fb9 [1128388,67890] 0 2024-09-15T22:26:50.053 INFO:tasks.workunit.client.0.smithi001.stdout:5/738: stat d3/d6/d25/f7f 0 2024-09-15T22:26:50.060 INFO:tasks.workunit.client.0.smithi001.stdout:4/835: dwrite d0/f51 [0,4194304] 0 2024-09-15T22:26:50.064 INFO:tasks.workunit.client.0.smithi001.stdout:5/739: dread d3/d27/d4e/d89/f9b [0,4194304] 0 2024-09-15T22:26:50.065 INFO:tasks.workunit.client.0.smithi001.stdout:9/587: dwrite d5/de/d1a/d1b/d22/f2f [0,4194304] 0 2024-09-15T22:26:50.065 INFO:tasks.workunit.client.0.smithi001.stdout:9/588: chown d5/de/d1a/d1b/d22/d2c/c29 3 1 2024-09-15T22:26:50.065 INFO:tasks.workunit.client.0.smithi001.stdout:9/589: write d5/de/d1a/d1b/d22/d2c/d21/d23/fac [134944,59321] 0 2024-09-15T22:26:50.067 INFO:tasks.workunit.client.0.smithi001.stdout:9/590: symlink d5/de/da9/lad 0 2024-09-15T22:26:50.068 INFO:tasks.workunit.client.0.smithi001.stdout:5/740: write d3/d6/f7 [4281665,40590] 0 2024-09-15T22:26:50.069 INFO:tasks.workunit.client.0.smithi001.stdout:8/658: dwrite d9/d19/d58/f4e [0,4194304] 0 2024-09-15T22:26:50.069 INFO:tasks.workunit.client.0.smithi001.stdout:0/587: dread d0/dd/f29 [0,4194304] 0 2024-09-15T22:26:50.069 INFO:tasks.workunit.client.0.smithi001.stdout:0/588: truncate d0/d6/f2a 2514955 0 2024-09-15T22:26:50.071 INFO:tasks.workunit.client.0.smithi001.stdout:9/591: symlink d5/de/d1a/d1b/d22/d2c/d21/lae 0 2024-09-15T22:26:50.073 INFO:tasks.workunit.client.0.smithi001.stdout:0/589: creat d0/d6/d77/d78/fb7 x:0 0 0 2024-09-15T22:26:50.074 INFO:tasks.workunit.client.0.smithi001.stdout:9/592: mkdir d5/de/d1a/da8/daf 0 2024-09-15T22:26:50.074 INFO:tasks.workunit.client.0.smithi001.stdout:9/593: readlink d5/de/d51/d53/l85 0 2024-09-15T22:26:50.074 INFO:tasks.workunit.client.0.smithi001.stdout:9/594: readlink d5/de/d1a/d1b/d22/d2c/l96 0 2024-09-15T22:26:50.074 INFO:tasks.workunit.client.0.smithi001.stdout:9/595: read d5/de/d15/d27/f7c [293788,36606] 0 2024-09-15T22:26:50.075 INFO:tasks.workunit.client.0.smithi001.stdout:0/590: read - d0/d9/f8e zero size 2024-09-15T22:26:50.076 INFO:tasks.workunit.client.0.smithi001.stdout:9/596: creat d5/d3e/fb0 x:0 0 0 2024-09-15T22:26:50.076 INFO:tasks.workunit.client.0.smithi001.stdout:9/597: chown d5/de/d1a/d1b/d22/d2c/d21/f8e 27 1 2024-09-15T22:26:50.077 INFO:tasks.workunit.client.0.smithi001.stdout:0/591: symlink d0/d9/d1a/lb8 0 2024-09-15T22:26:50.078 INFO:tasks.workunit.client.0.smithi001.stdout:9/598: symlink d5/de/d1a/d1b/d22/lb1 0 2024-09-15T22:26:50.081 INFO:tasks.workunit.client.0.smithi001.stdout:9/599: rename d5/de/d1a/d1b/f33 to d5/de/d1a/d1b/d22/d2c/d21/d23/fb2 0 2024-09-15T22:26:50.082 INFO:tasks.workunit.client.0.smithi001.stdout:6/703: dwrite d0/df/d24/d7b/db2/ff1 [0,4194304] 0 2024-09-15T22:26:50.095 INFO:tasks.workunit.client.0.smithi001.stdout:9/600: mknod d5/de/d1a/d1b/d22/d2c/d21/d23/d3d/cb3 0 2024-09-15T22:26:50.095 INFO:tasks.workunit.client.0.smithi001.stdout:8/659: write d9/d19/d34/f43 [3841891,60130] 0 2024-09-15T22:26:50.096 INFO:tasks.workunit.client.0.smithi001.stdout:3/737: dwrite da/d3d/d43/d41/df1/d7f/fc5 [0,4194304] 0 2024-09-15T22:26:50.096 INFO:tasks.workunit.client.0.smithi001.stdout:3/738: fsync da/d3b/f3c 0 2024-09-15T22:26:50.096 INFO:tasks.workunit.client.0.smithi001.stdout:3/739: dread - da/d90/fe1 zero size 2024-09-15T22:26:50.097 INFO:tasks.workunit.client.0.smithi001.stdout:6/704: rename d0/df/d24/f69 to d0/df/d24/d2e/d43/d30/da7/ff5 0 2024-09-15T22:26:50.100 INFO:tasks.workunit.client.0.smithi001.stdout:8/660: rmdir d9/d19/d34/d41 39 2024-09-15T22:26:50.102 INFO:tasks.workunit.client.0.smithi001.stdout:3/740: creat da/db3/ffd x:0 0 0 2024-09-15T22:26:50.102 INFO:tasks.workunit.client.0.smithi001.stdout:3/741: chown da/d3d/d43/d7c/d53/d73/l99 4 1 2024-09-15T22:26:50.102 INFO:tasks.workunit.client.0.smithi001.stdout:3/742: truncate da/d16/fb7 184279 0 2024-09-15T22:26:50.102 INFO:tasks.workunit.client.0.smithi001.stdout:3/743: write da/d3d/d43/d7c/d3f/db5/df9/dda/ff8 [1324,119059] 0 2024-09-15T22:26:50.102 INFO:tasks.workunit.client.0.smithi001.stdout:3/744: stat da/d3d/d43/d7c/d3f/db5/df9/dda/ff8 0 2024-09-15T22:26:50.104 INFO:tasks.workunit.client.0.smithi001.stdout:3/745: creat da/d3d/d43/ffe x:0 0 0 2024-09-15T22:26:50.104 INFO:tasks.workunit.client.0.smithi001.stdout:7/710: sync 2024-09-15T22:26:50.105 INFO:tasks.workunit.client.0.smithi001.stdout:7/711: mkdir d0/d7/d2e/d60/df7 0 2024-09-15T22:26:50.106 INFO:tasks.workunit.client.0.smithi001.stdout:2/683: sync 2024-09-15T22:26:50.106 INFO:tasks.workunit.client.0.smithi001.stdout:2/684: truncate d2/d14/d1a/d8a/f9f 584070 0 2024-09-15T22:26:50.107 INFO:tasks.workunit.client.0.smithi001.stdout:2/685: creat d2/d12/d62/d64/fdc x:0 0 0 2024-09-15T22:26:50.107 INFO:tasks.workunit.client.0.smithi001.stdout:7/712: unlink d0/d7/dc6/lb2 0 2024-09-15T22:26:50.109 INFO:tasks.workunit.client.0.smithi001.stdout:4/836: dwrite d0/d5d/d44/d65/d6a/f6e [0,4194304] 0 2024-09-15T22:26:50.109 INFO:tasks.workunit.client.0.smithi001.stdout:2/686: creat d2/d12/d62/d4c/d71/fdd x:0 0 0 2024-09-15T22:26:50.109 INFO:tasks.workunit.client.0.smithi001.stdout:2/687: dread - d2/d14/d1a/fd5 zero size 2024-09-15T22:26:50.109 INFO:tasks.workunit.client.0.smithi001.stdout:7/713: unlink d0/d7/d44/d3f/d49/d4f/ff0 0 2024-09-15T22:26:50.110 INFO:tasks.workunit.client.0.smithi001.stdout:7/714: readlink d0/d6a/dac/dda/ld4 0 2024-09-15T22:26:50.110 INFO:tasks.workunit.client.0.smithi001.stdout:2/688: mkdir d2/d12/d62/d64/d76/db4/dde 0 2024-09-15T22:26:50.111 INFO:tasks.workunit.client.0.smithi001.stdout:7/715: truncate d0/d7/d2e/d60/dbd/fcc 157376 0 2024-09-15T22:26:50.112 INFO:tasks.workunit.client.0.smithi001.stdout:2/689: rmdir d2/d14/d1a/d8a/dd4 0 2024-09-15T22:26:50.113 INFO:tasks.workunit.client.0.smithi001.stdout:6/705: write d0/df/d24/d2e/fbe [5301206,65066] 0 2024-09-15T22:26:50.113 INFO:tasks.workunit.client.0.smithi001.stdout:6/706: chown d0/df/d24/c96 544433525 1 2024-09-15T22:26:50.114 INFO:tasks.workunit.client.0.smithi001.stdout:6/707: creat d0/df/d24/d7b/ff6 x:0 0 0 2024-09-15T22:26:50.116 INFO:tasks.workunit.client.0.smithi001.stdout:6/708: creat d0/d7e/ff7 x:0 0 0 2024-09-15T22:26:50.116 INFO:tasks.workunit.client.0.smithi001.stdout:6/709: chown d0/d6/lcb 501212492 1 2024-09-15T22:26:50.118 INFO:tasks.workunit.client.0.smithi001.stdout:6/710: mknod d0/d6/d5d/d67/cf8 0 2024-09-15T22:26:50.118 INFO:tasks.workunit.client.0.smithi001.stdout:4/837: mkdir d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d73/dc0/d12b 0 2024-09-15T22:26:50.119 INFO:tasks.workunit.client.0.smithi001.stdout:6/711: symlink d0/d7e/lf9 0 2024-09-15T22:26:50.120 INFO:tasks.workunit.client.0.smithi001.stdout:4/838: rename d0/d5d/d44/d65/fae to d0/d5d/f12c 0 2024-09-15T22:26:50.121 INFO:tasks.workunit.client.0.smithi001.stdout:4/839: symlink d0/d5d/d7c/l12d 0 2024-09-15T22:26:50.121 INFO:tasks.workunit.client.0.smithi001.stdout:6/712: symlink d0/d6/d5d/d67/d53/lfa 0 2024-09-15T22:26:50.122 INFO:tasks.workunit.client.0.smithi001.stdout:4/840: mknod d0/d5d/d7c/dba/d20/d29/d124/d59/d67/d7b/c12e 0 2024-09-15T22:26:50.123 INFO:tasks.workunit.client.0.smithi001.stdout:6/713: creat d0/df/d24/d2e/d43/ffb x:0 0 0 2024-09-15T22:26:50.130 INFO:tasks.workunit.client.0.smithi001.stdout:6/714: mkdir d0/d6/d5d/d67/d53/da0/dfc 0 2024-09-15T22:26:50.131 INFO:tasks.workunit.client.0.smithi001.stdout:6/715: chown d0/df/d24 5 1 2024-09-15T22:26:50.132 INFO:tasks.workunit.client.0.smithi001.stdout:6/716: truncate d0/df/d24/f7f 882815 0 2024-09-15T22:26:50.132 INFO:tasks.workunit.client.0.smithi001.stdout:6/717: read d0/d6/d5d/f63 [1775922,21722] 0 2024-09-15T22:26:50.133 INFO:tasks.workunit.client.0.smithi001.stdout:6/718: creat d0/df/d24/d49/ffd x:0 0 0 2024-09-15T22:26:50.135 INFO:tasks.workunit.client.0.smithi001.stdout:7/716: dread d0/d8e/f37 [0,4194304] 0 2024-09-15T22:26:50.136 INFO:tasks.workunit.client.0.smithi001.stdout:6/719: mknod d0/cfe 0 2024-09-15T22:26:50.136 INFO:tasks.workunit.client.0.smithi001.stdout:6/720: read - d0/df/fdb zero size 2024-09-15T22:26:50.137 INFO:tasks.workunit.client.0.smithi001.stdout:7/717: rename d0/d7/c1e to d0/d7/d44/d3f/d49/d4f/cf8 0 2024-09-15T22:26:50.138 INFO:tasks.workunit.client.0.smithi001.stdout:7/718: mkdir d0/dd3/df9 0 2024-09-15T22:26:50.138 INFO:tasks.workunit.client.0.smithi001.stdout:7/719: creat d0/d7/d2e/d60/ffa x:0 0 0 2024-09-15T22:26:50.140 INFO:tasks.workunit.client.0.smithi001.stdout:7/720: link d0/d7/d2e/d60/ffa d0/d7/d44/d3f/d49/da5/ffb 0 2024-09-15T22:26:50.141 INFO:tasks.workunit.client.0.smithi001.stdout:7/721: creat d0/d7/d44/d3f/ffc x:0 0 0 2024-09-15T22:26:50.146 INFO:tasks.workunit.client.0.smithi001.stdout:0/592: dwrite d0/d6/d6a/f8d [0,4194304] 0 2024-09-15T22:26:50.146 INFO:tasks.workunit.client.0.smithi001.stdout:8/661: dwrite d9/d19/d29/d50/f52 [4194304,4194304] 0 2024-09-15T22:26:50.147 INFO:tasks.workunit.client.0.smithi001.stdout:8/662: chown d9/d19/d29/d50/c83 84 1 2024-09-15T22:26:50.147 INFO:tasks.workunit.client.0.smithi001.stdout:8/663: truncate d9/d19/d29/f45 565428 0 2024-09-15T22:26:50.153 INFO:tasks.workunit.client.0.smithi001.stdout:0/593: truncate d0/f7 1976774 0 2024-09-15T22:26:50.153 INFO:tasks.workunit.client.0.smithi001.stdout:0/594: readlink d0/dd/d33/la4 0 2024-09-15T22:26:50.153 INFO:tasks.workunit.client.0.smithi001.stdout:8/664: rmdir d9 39 2024-09-15T22:26:50.154 INFO:tasks.workunit.client.0.smithi001.stdout:0/595: mknod d0/d9/db/d5d/d79/cb9 0 2024-09-15T22:26:50.154 INFO:tasks.workunit.client.0.smithi001.stdout:0/596: dread - d0/d9/db/d5d/d79/fa5 zero size 2024-09-15T22:26:50.154 INFO:tasks.workunit.client.0.smithi001.stdout:8/665: mkdir d9/d19/d40/d9e/dc2 0 2024-09-15T22:26:50.162 INFO:tasks.workunit.client.0.smithi001.stdout:7/722: dread d0/d7/d44/d3f/d49/da5/fdc [0,4194304] 0 2024-09-15T22:26:50.163 INFO:tasks.workunit.client.0.smithi001.stdout:2/690: dwrite d2/d14/d1a/d8a/f9f [0,4194304] 0 2024-09-15T22:26:50.164 INFO:tasks.workunit.client.0.smithi001.stdout:7/723: link d0/l1d d0/d7/d44/d3f/d49/da5/lfd 0 2024-09-15T22:26:50.173 INFO:tasks.workunit.client.0.smithi001.stdout:4/841: dwrite d0/d27/fca [0,4194304] 0 2024-09-15T22:26:50.174 INFO:tasks.workunit.client.0.smithi001.stdout:4/842: truncate d0/d5d/f45 292127 0 2024-09-15T22:26:50.176 INFO:tasks.workunit.client.0.smithi001.stdout:4/843: creat d0/d5d/d44/d65/f12f x:0 0 0 2024-09-15T22:26:50.176 INFO:tasks.workunit.client.0.smithi001.stdout:4/844: chown d0/d5d/d7c/dba/d20/d29/d124/da4/de1/cfc 7271 1 2024-09-15T22:26:50.177 INFO:tasks.workunit.client.0.smithi001.stdout:4/845: symlink d0/d5d/d7c/dba/d20/d29/d34/dbc/dbf/l130 0 2024-09-15T22:26:50.177 INFO:tasks.workunit.client.0.smithi001.stdout:4/846: write d0/d5d/d7c/dd1/f110 [344147,50559] 0 2024-09-15T22:26:50.178 INFO:tasks.workunit.client.0.smithi001.stdout:2/691: creat d2/d12/d62/d4c/d9d/fdf x:0 0 0 2024-09-15T22:26:50.178 INFO:tasks.workunit.client.0.smithi001.stdout:2/692: chown d2/d14/d1a/d1b/f22 4877 1 2024-09-15T22:26:50.178 INFO:tasks.workunit.client.0.smithi001.stdout:0/597: dread d0/d9/db/f6b [0,4194304] 0 2024-09-15T22:26:50.178 INFO:tasks.workunit.client.0.smithi001.stdout:0/598: fsync d0/dd/d63/fac 0 2024-09-15T22:26:50.181 INFO:tasks.workunit.client.0.smithi001.stdout:4/847: mknod d0/d5d/d7c/dba/c131 0 2024-09-15T22:26:50.182 INFO:tasks.workunit.client.0.smithi001.stdout:4/848: chown d0/d5d/d7c/dba/f22 37 1 2024-09-15T22:26:50.182 INFO:tasks.workunit.client.0.smithi001.stdout:4/849: mknod d0/d5d/d7c/dd1/d104/c132 0 2024-09-15T22:26:50.182 INFO:tasks.workunit.client.0.smithi001.stdout:4/850: fdatasync d0/d5d/d7c/dba/d20/d29/d124/d59/d67/f9e 0 2024-09-15T22:26:50.205 INFO:tasks.workunit.client.0.smithi001.stdout:2/693: dread d2/d14/f96 [0,4194304] 0 2024-09-15T22:26:50.206 INFO:tasks.workunit.client.0.smithi001.stdout:9/601: dwrite d5/de/d1a/d38/f9a [0,4194304] 0 2024-09-15T22:26:50.212 INFO:tasks.workunit.client.0.smithi001.stdout:9/602: creat d5/de/d1a/d1b/d22/d2c/d21/d4d/fb4 x:0 0 0 2024-09-15T22:26:50.214 INFO:tasks.workunit.client.0.smithi001.stdout:0/599: dwrite d0/d9/d1a/f64 [0,4194304] 0 2024-09-15T22:26:50.219 INFO:tasks.workunit.client.0.smithi001.stdout:8/666: write d9/d19/d34/d41/f6e [1491265,18717] 0 2024-09-15T22:26:50.220 INFO:tasks.workunit.client.0.smithi001.stdout:8/667: creat d9/d19/d58/d8e/fc3 x:0 0 0 2024-09-15T22:26:50.223 INFO:tasks.workunit.client.0.smithi001.stdout:6/721: write d0/d6/f29 [2745352,62481] 0 2024-09-15T22:26:50.223 INFO:tasks.workunit.client.0.smithi001.stdout:6/722: getdents d0/d6/d5d/d67/df0 0 2024-09-15T22:26:50.225 INFO:tasks.workunit.client.0.smithi001.stdout:6/723: rename d0/df/d24/d2e/f1d to d0/df/fff 0 2024-09-15T22:26:50.226 INFO:tasks.workunit.client.0.smithi001.stdout:6/724: creat d0/d6/f100 x:0 0 0 2024-09-15T22:26:50.229 INFO:tasks.workunit.client.0.smithi001.stdout:4/851: dwrite d0/d5d/d7c/dba/d20/d29/d40/f4d [0,4194304] 0 2024-09-15T22:26:50.238 INFO:tasks.workunit.client.0.smithi001.stdout:4/852: truncate d0/d5d/d7c/dba/d20/d29/d34/d84/d95/f5f 2210226 0 2024-09-15T22:26:50.238 INFO:tasks.workunit.client.0.smithi001.stdout:4/853: chown d0/d5d/d7c/dba/d20/d29/d124/d74/f99 1562 1 2024-09-15T22:26:50.239 INFO:tasks.workunit.client.0.smithi001.stdout:4/854: stat d0/d5d/d7c/dba/d20/d29 0 2024-09-15T22:26:50.239 INFO:tasks.workunit.client.0.smithi001.stdout:0/600: write d0/d9/f2c [1411952,88283] 0 2024-09-15T22:26:50.242 INFO:tasks.workunit.client.0.smithi001.stdout:0/601: link d0/l52 d0/dd/lba 0 2024-09-15T22:26:50.242 INFO:tasks.workunit.client.0.smithi001.stdout:8/668: dread d9/d19/d58/f95 [0,4194304] 0 2024-09-15T22:26:50.242 INFO:tasks.workunit.client.0.smithi001.stdout:4/855: write d0/d5d/d44/d65/d6a/f6e [4921125,51156] 0 2024-09-15T22:26:50.243 INFO:tasks.workunit.client.0.smithi001.stdout:8/669: rmdir d9/d19/d29/d35 39 2024-09-15T22:26:50.243 INFO:tasks.workunit.client.0.smithi001.stdout:8/670: stat d9/d19/d40/d5f/f87 0 2024-09-15T22:26:50.244 INFO:tasks.workunit.client.0.smithi001.stdout:8/671: rmdir d9/d19/d58/d88 39 2024-09-15T22:26:50.244 INFO:tasks.workunit.client.0.smithi001.stdout:8/672: fdatasync f4 0 2024-09-15T22:26:50.252 INFO:tasks.workunit.client.0.smithi001.stdout:9/603: dwrite d5/de/d1a/d1b/d22/d2c/f31 [0,4194304] 0 2024-09-15T22:26:50.253 INFO:tasks.workunit.client.0.smithi001.stdout:6/725: dread d0/df/fff [0,4194304] 0 2024-09-15T22:26:50.254 INFO:tasks.workunit.client.0.smithi001.stdout:6/726: stat d0/d6/d5d/d67/d53/fea 0 2024-09-15T22:26:50.254 INFO:tasks.workunit.client.0.smithi001.stdout:9/604: getdents d5/de/d15/d27/d63 0 2024-09-15T22:26:50.255 INFO:tasks.workunit.client.0.smithi001.stdout:9/605: creat d5/de/d1a/d1b/d22/d2c/d21/d23/d3d/fb5 x:0 0 0 2024-09-15T22:26:50.255 INFO:tasks.workunit.client.0.smithi001.stdout:9/606: readlink d5/de/d1a/d38/l47 0 2024-09-15T22:26:50.256 INFO:tasks.workunit.client.0.smithi001.stdout:9/607: truncate d5/de/d15/d27/f7c 1342821 0 2024-09-15T22:26:50.259 INFO:tasks.workunit.client.0.smithi001.stdout:4/856: dread d0/d5d/d7c/dba/d20/d29/d34/f52 [0,4194304] 0 2024-09-15T22:26:50.260 INFO:tasks.workunit.client.0.smithi001.stdout:4/857: truncate d0/d5d/d7c/dba/d20/d29/d124/f4a 433027 0 2024-09-15T22:26:50.266 INFO:tasks.workunit.client.0.smithi001.stdout:8/673: dread d9/d19/f77 [0,4194304] 0 2024-09-15T22:26:50.267 INFO:tasks.workunit.client.0.smithi001.stdout:9/608: mkdir d5/de/d15/d27/d63/db6 0 2024-09-15T22:26:50.268 INFO:tasks.workunit.client.0.smithi001.stdout:9/609: write d5/de/d15/d27/f7c [1424981,13380] 0 2024-09-15T22:26:50.268 INFO:tasks.workunit.client.0.smithi001.stdout:9/610: write d5/de/d1a/d1b/f3a [1900665,37788] 0 2024-09-15T22:26:50.275 INFO:tasks.workunit.client.0.smithi001.stdout:3/746: dwrite da/d3b/f64 [0,4194304] 0 2024-09-15T22:26:50.280 INFO:tasks.workunit.client.0.smithi001.stdout:3/747: mkdir da/d3d/d43/d41/dff 0 2024-09-15T22:26:50.281 INFO:tasks.workunit.client.0.smithi001.stdout:9/611: write d5/f59 [2776535,37189] 0 2024-09-15T22:26:50.281 INFO:tasks.workunit.client.0.smithi001.stdout:3/748: getdents da/d90/d6f 0 2024-09-15T22:26:50.281 INFO:tasks.workunit.client.0.smithi001.stdout:3/749: stat da/d3b/d58/l77 0 2024-09-15T22:26:50.281 INFO:tasks.workunit.client.0.smithi001.stdout:3/750: chown da/db3/ffd 5696 1 2024-09-15T22:26:50.282 INFO:tasks.workunit.client.0.smithi001.stdout:3/751: readlink da/d3b/d58/l77 0 2024-09-15T22:26:50.282 INFO:tasks.workunit.client.0.smithi001.stdout:9/612: mknod d5/de/d15/d27/cb7 0 2024-09-15T22:26:50.282 INFO:tasks.workunit.client.0.smithi001.stdout:3/752: symlink da/d90/d6f/dc7/l100 0 2024-09-15T22:26:50.283 INFO:tasks.workunit.client.0.smithi001.stdout:9/613: mknod d5/de/d1a/d1b/d22/d2c/d21/d23/d3d/cb8 0 2024-09-15T22:26:50.285 INFO:tasks.workunit.client.0.smithi001.stdout:3/753: rename da/d3b/d8b/dbe/dfb to da/d101 0 2024-09-15T22:26:50.285 INFO:tasks.workunit.client.0.smithi001.stdout:3/754: write da/f13 [4979955,62668] 0 2024-09-15T22:26:50.294 INFO:tasks.workunit.client.0.smithi001.stdout:6/727: dwrite d0/df/fbf [0,4194304] 0 2024-09-15T22:26:50.299 INFO:tasks.workunit.client.0.smithi001.stdout:0/602: write d0/dd/d33/f90 [530218,79205] 0 2024-09-15T22:26:50.299 INFO:tasks.workunit.client.0.smithi001.stdout:0/603: chown d0/dd/d63/db6 550757 1 2024-09-15T22:26:50.300 INFO:tasks.workunit.client.0.smithi001.stdout:2/694: dwrite d2/d14/d1a/f7a [0,4194304] 0 2024-09-15T22:26:50.300 INFO:tasks.workunit.client.0.smithi001.stdout:2/695: stat d2/d14/d1a/d1b/d82/dc9/d6f/fb2 0 2024-09-15T22:26:50.303 INFO:tasks.workunit.client.0.smithi001.stdout:2/696: creat d2/d14/d1a/d1b/d82/fe0 x:0 0 0 2024-09-15T22:26:50.303 INFO:tasks.workunit.client.0.smithi001.stdout:2/697: readlink d2/d12/d62/d64/d76/db4/lc2 0 2024-09-15T22:26:50.303 INFO:tasks.workunit.client.0.smithi001.stdout:2/698: stat d2/d14/d1a/l87 0 2024-09-15T22:26:50.304 INFO:tasks.workunit.client.0.smithi001.stdout:2/699: unlink d2/d14/d1a/d1b/d82/fb8 0 2024-09-15T22:26:50.305 INFO:tasks.workunit.client.0.smithi001.stdout:2/700: mkdir d2/d14/de1 0 2024-09-15T22:26:50.306 INFO:tasks.workunit.client.0.smithi001.stdout:0/604: fsync d0/d9/f2c 0 2024-09-15T22:26:50.308 INFO:tasks.workunit.client.0.smithi001.stdout:0/605: link d0/d51/f7d d0/d51/fbb 0 2024-09-15T22:26:50.350 INFO:tasks.workunit.client.0.smithi001.stdout:3/755: dwrite da/dae/f83 [0,4194304] 0 2024-09-15T22:26:50.350 INFO:tasks.workunit.client.0.smithi001.stdout:6/728: dread d0/df/d24/d7b/db2/ff1 [0,4194304] 0 2024-09-15T22:26:50.352 INFO:tasks.workunit.client.0.smithi001.stdout:3/756: mkdir da/d90/d6f/d102 0 2024-09-15T22:26:50.352 INFO:tasks.workunit.client.0.smithi001.stdout:3/757: chown da/d16 47402 1 2024-09-15T22:26:50.352 INFO:tasks.workunit.client.0.smithi001.stdout:3/758: fdatasync da/d3b/f3c 0 2024-09-15T22:26:50.354 INFO:tasks.workunit.client.0.smithi001.stdout:3/759: mknod da/d3d/d43/d7c/d53/c103 0 2024-09-15T22:26:50.354 INFO:tasks.workunit.client.0.smithi001.stdout:6/729: mkdir d0/d6/d5d/d101 0 2024-09-15T22:26:50.355 INFO:tasks.workunit.client.0.smithi001.stdout:5/741: sync 2024-09-15T22:26:50.355 INFO:tasks.workunit.client.0.smithi001.stdout:1/729: sync 2024-09-15T22:26:50.356 INFO:tasks.workunit.client.0.smithi001.stdout:6/730: rename d0/d6/d5d/d67/f26 to d0/d6/d5d/da6/f102 0 2024-09-15T22:26:50.356 INFO:tasks.workunit.client.0.smithi001.stdout:6/731: write d0/df/d24/d2e/f6f [3189337,38878] 0 2024-09-15T22:26:50.356 INFO:tasks.workunit.client.0.smithi001.stdout:3/760: rmdir da/d3d/d43/d41/df1 39 2024-09-15T22:26:50.357 INFO:tasks.workunit.client.0.smithi001.stdout:6/732: creat d0/df/d24/d49/dc7/f103 x:0 0 0 2024-09-15T22:26:50.359 INFO:tasks.workunit.client.0.smithi001.stdout:4/858: dwrite d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d73/dc0/fe6 [0,4194304] 0 2024-09-15T22:26:50.359 INFO:tasks.workunit.client.0.smithi001.stdout:1/730: rename d3/d12/d79/dce/d14/d23/da1/dc6/cd0 to d3/d12/d79/dce/d3c/d4c/dcc/dd1/ce8 0 2024-09-15T22:26:50.359 INFO:tasks.workunit.client.0.smithi001.stdout:3/761: unlink da/dae/c67 0 2024-09-15T22:26:50.363 INFO:tasks.workunit.client.0.smithi001.stdout:2/701: dwrite d2/d14/d1a/d8a/f9f [0,4194304] 0 2024-09-15T22:26:50.363 INFO:tasks.workunit.client.0.smithi001.stdout:3/762: symlink da/d90/d92/l104 0 2024-09-15T22:26:50.363 INFO:tasks.workunit.client.0.smithi001.stdout:3/763: mkdir da/d3d/d43/d41/dff/d105 0 2024-09-15T22:26:50.363 INFO:tasks.workunit.client.0.smithi001.stdout:4/859: getdents d0/d5d/d7c/dba/d20/d29/d40/dc8 0 2024-09-15T22:26:50.364 INFO:tasks.workunit.client.0.smithi001.stdout:9/614: dwrite d5/f44 [4194304,4194304] 0 2024-09-15T22:26:50.365 INFO:tasks.workunit.client.0.smithi001.stdout:1/731: mkdir d3/d12/d79/dce/d14/d23/da1/de9 0 2024-09-15T22:26:50.365 INFO:tasks.workunit.client.0.smithi001.stdout:1/732: chown d3/d12/d79/dce/d14/d1b 750 1 2024-09-15T22:26:50.365 INFO:tasks.workunit.client.0.smithi001.stdout:3/764: creat da/f106 x:0 0 0 2024-09-15T22:26:50.365 INFO:tasks.workunit.client.0.smithi001.stdout:3/765: write da/d90/d6f/dc7/fd3 [908465,12219] 0 2024-09-15T22:26:50.365 INFO:tasks.workunit.client.0.smithi001.stdout:3/766: readlink da/d3d/d43/l1a 0 2024-09-15T22:26:50.370 INFO:tasks.workunit.client.0.smithi001.stdout:9/615: mknod d5/d3e/cb9 0 2024-09-15T22:26:50.370 INFO:tasks.workunit.client.0.smithi001.stdout:3/767: mknod da/d16/c107 0 2024-09-15T22:26:50.370 INFO:tasks.workunit.client.0.smithi001.stdout:3/768: write da/dae/d8e/f96 [772956,68024] 0 2024-09-15T22:26:50.370 INFO:tasks.workunit.client.0.smithi001.stdout:3/769: symlink da/d3d/d43/d41/dff/l108 0 2024-09-15T22:26:50.371 INFO:tasks.workunit.client.0.smithi001.stdout:3/770: unlink da/lab 0 2024-09-15T22:26:50.372 INFO:tasks.workunit.client.0.smithi001.stdout:8/674: dwrite d9/d19/d29/d50/fa2 [0,4194304] 0 2024-09-15T22:26:50.377 INFO:tasks.workunit.client.0.smithi001.stdout:3/771: symlink da/d3d/d43/d7c/l109 0 2024-09-15T22:26:50.379 INFO:tasks.workunit.client.0.smithi001.stdout:8/675: getdents d9/d19/d58/d8e 0 2024-09-15T22:26:50.380 INFO:tasks.workunit.client.0.smithi001.stdout:3/772: rename da/dae/d8e/cc6 to da/d90/d6f/c10a 0 2024-09-15T22:26:50.381 INFO:tasks.workunit.client.0.smithi001.stdout:3/773: chown da/d3b/c88 1716 1 2024-09-15T22:26:50.381 INFO:tasks.workunit.client.0.smithi001.stdout:3/774: write da/d3d/d43/d41/df1/d7f/f8c [1421899,86811] 0 2024-09-15T22:26:50.381 INFO:tasks.workunit.client.0.smithi001.stdout:2/702: write d2/d14/d1a/d1b/d82/dc9/d6f/d70/fd8 [3899973,74299] 0 2024-09-15T22:26:50.381 INFO:tasks.workunit.client.0.smithi001.stdout:2/703: write d2/d14/d1a/d1b/d82/db0/fbd [300070,67822] 0 2024-09-15T22:26:50.382 INFO:tasks.workunit.client.0.smithi001.stdout:2/704: symlink d2/d14/de1/le2 0 2024-09-15T22:26:50.383 INFO:tasks.workunit.client.0.smithi001.stdout:8/676: creat d9/d19/d34/fc4 x:0 0 0 2024-09-15T22:26:50.383 INFO:tasks.workunit.client.0.smithi001.stdout:2/705: symlink d2/d12/d62/d64/d76/le3 0 2024-09-15T22:26:50.385 INFO:tasks.workunit.client.0.smithi001.stdout:8/677: symlink d9/d19/d29/d50/d70/d76/d7d/lc5 0 2024-09-15T22:26:50.385 INFO:tasks.workunit.client.0.smithi001.stdout:8/678: fsync d9/d19/d58/d8e/d9c/faf 0 2024-09-15T22:26:50.385 INFO:tasks.workunit.client.0.smithi001.stdout:8/679: fdatasync d9/f59 0 2024-09-15T22:26:50.385 INFO:tasks.workunit.client.0.smithi001.stdout:8/680: chown d9/d19/d29/d50/d70/d76/d7d/c9a 42 1 2024-09-15T22:26:50.385 INFO:tasks.workunit.client.0.smithi001.stdout:2/706: mknod d2/d14/d1a/d1b/d82/db0/ce4 0 2024-09-15T22:26:50.385 INFO:tasks.workunit.client.0.smithi001.stdout:2/707: truncate d2/d14/d1a/d1b/d82/fd9 970644 0 2024-09-15T22:26:50.385 INFO:tasks.workunit.client.0.smithi001.stdout:2/708: read - d2/d14/d1a/d1b/d82/d97/d74/fb5 zero size 2024-09-15T22:26:50.386 INFO:tasks.workunit.client.0.smithi001.stdout:9/616: write d5/f11 [2639162,91018] 0 2024-09-15T22:26:50.386 INFO:tasks.workunit.client.0.smithi001.stdout:8/681: mknod d9/d19/d34/da4/cc6 0 2024-09-15T22:26:50.386 INFO:tasks.workunit.client.0.smithi001.stdout:7/724: sync 2024-09-15T22:26:50.387 INFO:tasks.workunit.client.0.smithi001.stdout:8/682: dread - d9/d19/d58/d8e/fc3 zero size 2024-09-15T22:26:50.388 INFO:tasks.workunit.client.0.smithi001.stdout:9/617: rename d5/de/d1a/c2e to d5/de/d1a/cba 0 2024-09-15T22:26:50.388 INFO:tasks.workunit.client.0.smithi001.stdout:9/618: chown d5/de/d1a/d1b/d22/d2c/c29 593620 1 2024-09-15T22:26:50.389 INFO:tasks.workunit.client.0.smithi001.stdout:8/683: mkdir d9/d19/d58/d8e/dc7 0 2024-09-15T22:26:50.389 INFO:tasks.workunit.client.0.smithi001.stdout:9/619: creat d5/d90/fbb x:0 0 0 2024-09-15T22:26:50.390 INFO:tasks.workunit.client.0.smithi001.stdout:7/725: rmdir d0/d7 39 2024-09-15T22:26:50.390 INFO:tasks.workunit.client.0.smithi001.stdout:7/726: readlink d0/d6a/la7 0 2024-09-15T22:26:50.391 INFO:tasks.workunit.client.0.smithi001.stdout:8/684: link d9/d19/d34/da4/db7/lbd d9/d19/d29/d33/lc8 0 2024-09-15T22:26:50.391 INFO:tasks.workunit.client.0.smithi001.stdout:9/620: creat d5/de/d1a/d1b/fbc x:0 0 0 2024-09-15T22:26:50.392 INFO:tasks.workunit.client.0.smithi001.stdout:7/727: unlink d0/d7/d21/d6b/c65 0 2024-09-15T22:26:50.394 INFO:tasks.workunit.client.0.smithi001.stdout:9/621: rename d5/de/d15/d27/f7c to d5/de/d15/d27/d63/db6/fbd 0 2024-09-15T22:26:50.394 INFO:tasks.workunit.client.0.smithi001.stdout:7/728: link d0/d7/d2e/d60/dbd/fcc d0/dd3/df9/ffe 0 2024-09-15T22:26:50.395 INFO:tasks.workunit.client.0.smithi001.stdout:9/622: mkdir d5/de/d51/d53/dbe 0 2024-09-15T22:26:50.396 INFO:tasks.workunit.client.0.smithi001.stdout:9/623: write d5/de/d15/d27/d63/f92 [225791,118467] 0 2024-09-15T22:26:50.396 INFO:tasks.workunit.client.0.smithi001.stdout:7/729: creat d0/d7/fff x:0 0 0 2024-09-15T22:26:50.396 INFO:tasks.workunit.client.0.smithi001.stdout:7/730: write d0/d98/fca [339763,51674] 0 2024-09-15T22:26:50.397 INFO:tasks.workunit.client.0.smithi001.stdout:7/731: symlink d0/dd3/l100 0 2024-09-15T22:26:50.398 INFO:tasks.workunit.client.0.smithi001.stdout:9/624: truncate d5/de/d1a/d1b/d22/f82 1378919 0 2024-09-15T22:26:50.398 INFO:tasks.workunit.client.0.smithi001.stdout:7/732: mknod d0/dd3/c101 0 2024-09-15T22:26:50.399 INFO:tasks.workunit.client.0.smithi001.stdout:7/733: write d0/d7/d21/d6b/f3b [801520,10487] 0 2024-09-15T22:26:50.399 INFO:tasks.workunit.client.0.smithi001.stdout:7/734: fdatasync d0/dd3/ff2 0 2024-09-15T22:26:50.400 INFO:tasks.workunit.client.0.smithi001.stdout:7/735: rmdir d0/db3 39 2024-09-15T22:26:50.400 INFO:tasks.workunit.client.0.smithi001.stdout:7/736: fsync d0/d7/d44/d3f/f75 0 2024-09-15T22:26:50.401 INFO:tasks.workunit.client.0.smithi001.stdout:7/737: mknod d0/d7/d44/d3f/d49/d4f/c102 0 2024-09-15T22:26:50.402 INFO:tasks.workunit.client.0.smithi001.stdout:7/738: truncate d0/d7/d44/d36/f99 476635 0 2024-09-15T22:26:50.403 INFO:tasks.workunit.client.0.smithi001.stdout:7/739: dread - d0/d7/d2e/d60/dbd/fdd zero size 2024-09-15T22:26:50.404 INFO:tasks.workunit.client.0.smithi001.stdout:7/740: unlink d0/d7/f53 0 2024-09-15T22:26:50.404 INFO:tasks.workunit.client.0.smithi001.stdout:7/741: fdatasync d0/d7/d44/d3f/d49/fc7 0 2024-09-15T22:26:50.405 INFO:tasks.workunit.client.0.smithi001.stdout:2/709: dread d2/d12/d62/d64/f13 [0,4194304] 0 2024-09-15T22:26:50.406 INFO:tasks.workunit.client.0.smithi001.stdout:9/625: dread d5/de/d1a/d1b/f89 [0,4194304] 0 2024-09-15T22:26:50.407 INFO:tasks.workunit.client.0.smithi001.stdout:2/710: mknod d2/d12/d62/d64/d76/d7f/ce5 0 2024-09-15T22:26:50.408 INFO:tasks.workunit.client.0.smithi001.stdout:9/626: creat d5/de/d1a/d1b/d22/d2c/d21/d24/fbf x:0 0 0 2024-09-15T22:26:50.408 INFO:tasks.workunit.client.0.smithi001.stdout:9/627: chown d5/de/d1a/l84 52982 1 2024-09-15T22:26:50.409 INFO:tasks.workunit.client.0.smithi001.stdout:8/685: dread d9/d19/d34/d41/f4b [0,4194304] 0 2024-09-15T22:26:50.409 INFO:tasks.workunit.client.0.smithi001.stdout:8/686: chown d9/d19/fbe 779518 1 2024-09-15T22:26:50.409 INFO:tasks.workunit.client.0.smithi001.stdout:2/711: creat d2/d14/d1a/d1b/d82/d97/d74/fe6 x:0 0 0 2024-09-15T22:26:50.409 INFO:tasks.workunit.client.0.smithi001.stdout:9/628: creat d5/de/d15/d27/fc0 x:0 0 0 2024-09-15T22:26:50.410 INFO:tasks.workunit.client.0.smithi001.stdout:9/629: stat d5/de/d15/d27/d63/l9d 0 2024-09-15T22:26:50.410 INFO:tasks.workunit.client.0.smithi001.stdout:9/630: fsync d5/de/d15/d27/d63/f73 0 2024-09-15T22:26:50.410 INFO:tasks.workunit.client.0.smithi001.stdout:2/712: symlink d2/d14/d1a/d8a/le7 0 2024-09-15T22:26:50.410 INFO:tasks.workunit.client.0.smithi001.stdout:2/713: getdents d2/d14 0 2024-09-15T22:26:50.411 INFO:tasks.workunit.client.0.smithi001.stdout:9/631: rename d5/de/d1a/d38/c67 to d5/de/d1a/d1b/d22/d2c/d21/d24/d86/cc1 0 2024-09-15T22:26:50.411 INFO:tasks.workunit.client.0.smithi001.stdout:2/714: stat d2/f5e 0 2024-09-15T22:26:50.412 INFO:tasks.workunit.client.0.smithi001.stdout:6/733: dwrite d0/df/d24/d2e/d43/f59 [0,4194304] 0 2024-09-15T22:26:50.412 INFO:tasks.workunit.client.0.smithi001.stdout:6/734: chown d0/df/d24/l52 19873791 1 2024-09-15T22:26:50.419 INFO:tasks.workunit.client.0.smithi001.stdout:2/715: truncate d2/f5e 3972658 0 2024-09-15T22:26:50.419 INFO:tasks.workunit.client.0.smithi001.stdout:2/716: write d2/d14/d1a/d1b/d82/dc9/f6b [841358,70846] 0 2024-09-15T22:26:50.423 INFO:tasks.workunit.client.0.smithi001.stdout:8/687: dread d9/d19/d34/d41/f4b [0,4194304] 0 2024-09-15T22:26:50.424 INFO:tasks.workunit.client.0.smithi001.stdout:9/632: unlink d5/de/f9b 0 2024-09-15T22:26:50.424 INFO:tasks.workunit.client.0.smithi001.stdout:6/735: write d0/df/d24/d2e/d43/fab [851296,28775] 0 2024-09-15T22:26:50.429 INFO:tasks.workunit.client.0.smithi001.stdout:8/688: dread d9/d19/d58/d8e/fac [0,4194304] 0 2024-09-15T22:26:50.430 INFO:tasks.workunit.client.0.smithi001.stdout:8/689: creat d9/d19/d29/d50/d89/fc9 x:0 0 0 2024-09-15T22:26:50.431 INFO:tasks.workunit.client.0.smithi001.stdout:8/690: getdents d9/d19/d40/d9e/dc2 0 2024-09-15T22:26:50.438 INFO:tasks.workunit.client.0.smithi001.stdout:9/633: write d5/de/d1a/d1b/d22/f4a [982079,8398] 0 2024-09-15T22:26:50.446 INFO:tasks.workunit.client.0.smithi001.stdout:1/733: dwrite d3/d12/d79/dce/d14/d1b/f2f [0,4194304] 0 2024-09-15T22:26:50.446 INFO:tasks.workunit.client.0.smithi001.stdout:1/734: fdatasync d3/d12/d79/dce/d14/d23/f9d 0 2024-09-15T22:26:50.458 INFO:tasks.workunit.client.0.smithi001.stdout:9/634: read d5/de/d1a/d1b/d22/f65 [627289,82006] 0 2024-09-15T22:26:50.459 INFO:tasks.workunit.client.0.smithi001.stdout:3/775: dwrite da/d3d/d43/d41/df1/d7f/fcd [0,4194304] 0 2024-09-15T22:26:50.478 INFO:tasks.workunit.client.0.smithi001.stdout:1/735: dwrite d3/d12/d79/dce/d14/d1b/d2b/d68/f8b [0,4194304] 0 2024-09-15T22:26:50.478 INFO:tasks.workunit.client.0.smithi001.stdout:1/736: fsync d3/d12/d79/dce/f19 0 2024-09-15T22:26:50.478 INFO:tasks.workunit.client.0.smithi001.stdout:1/737: write d3/d12/d79/dce/d14/d1b/d2b/f56 [9412872,63196] 0 2024-09-15T22:26:50.478 INFO:tasks.workunit.client.0.smithi001.stdout:1/738: write d3/d12/d79/dce/d14/d1b/f30 [2154002,103830] 0 2024-09-15T22:26:50.510 INFO:tasks.workunit.client.0.smithi001.stdout:5/742: sync 2024-09-15T22:26:50.510 INFO:tasks.workunit.client.0.smithi001.stdout:4/860: sync 2024-09-15T22:26:50.510 INFO:tasks.workunit.client.0.smithi001.stdout:5/743: dread - d3/d27/d4e/d89/dae/fd3 zero size 2024-09-15T22:26:50.512 INFO:tasks.workunit.client.0.smithi001.stdout:0/606: sync 2024-09-15T22:26:50.512 INFO:tasks.workunit.client.0.smithi001.stdout:0/607: dread - d0/d9/d1a/fa8 zero size 2024-09-15T22:26:50.515 INFO:tasks.workunit.client.0.smithi001.stdout:5/744: unlink d3/d6/d25/f7f 0 2024-09-15T22:26:50.515 INFO:tasks.workunit.client.0.smithi001.stdout:5/745: chown d3/d6/d41/d4d/dbe/d56/f55 3520285 1 2024-09-15T22:26:50.516 INFO:tasks.workunit.client.0.smithi001.stdout:5/746: rename d3/d27 to d3/d27/d5c/dfa 22 2024-09-15T22:26:50.520 INFO:tasks.workunit.client.0.smithi001.stdout:6/736: dwrite d0/d6/d5d/d67/fcf [0,4194304] 0 2024-09-15T22:26:50.528 INFO:tasks.workunit.client.0.smithi001.stdout:1/739: dwrite d3/fac [0,4194304] 0 2024-09-15T22:26:50.528 INFO:tasks.workunit.client.0.smithi001.stdout:7/742: dwrite d0/d7/d44/d3f/ffc [0,4194304] 0 2024-09-15T22:26:50.530 INFO:tasks.workunit.client.0.smithi001.stdout:2/717: dwrite d2/d14/d1a/d1b/d82/d83/fa9 [0,4194304] 0 2024-09-15T22:26:50.531 INFO:tasks.workunit.client.0.smithi001.stdout:7/743: link d0/db3/lc2 d0/d7/d2e/d60/l103 0 2024-09-15T22:26:50.533 INFO:tasks.workunit.client.0.smithi001.stdout:8/691: dwrite d9/d19/d58/d8e/d9c/faf [0,4194304] 0 2024-09-15T22:26:50.533 INFO:tasks.workunit.client.0.smithi001.stdout:7/744: creat d0/d7/d21/d6b/d93/f104 x:0 0 0 2024-09-15T22:26:50.533 INFO:tasks.workunit.client.0.smithi001.stdout:7/745: stat d0/db3/cd0 0 2024-09-15T22:26:50.537 INFO:tasks.workunit.client.0.smithi001.stdout:1/740: link d3/d12/d79/dce/d3c/d4c/f5c d3/d12/d79/dce/d14/d1b/d2b/de6/fea 0 2024-09-15T22:26:50.537 INFO:tasks.workunit.client.0.smithi001.stdout:8/692: truncate d9/d19/f3f 4520164 0 2024-09-15T22:26:50.537 INFO:tasks.workunit.client.0.smithi001.stdout:2/718: stat d2/d14/d1a/d80/lb3 0 2024-09-15T22:26:50.537 INFO:tasks.workunit.client.0.smithi001.stdout:7/746: mkdir d0/d7/dc6/d105 0 2024-09-15T22:26:50.538 INFO:tasks.workunit.client.0.smithi001.stdout:1/741: symlink d3/d12/d79/dce/d3c/d4c/dcc/dd1/leb 0 2024-09-15T22:26:50.538 INFO:tasks.workunit.client.0.smithi001.stdout:8/693: mknod d9/d19/d34/da4/cca 0 2024-09-15T22:26:50.538 INFO:tasks.workunit.client.0.smithi001.stdout:1/742: chown d3/d12/d79/d85/ce0 56704 1 2024-09-15T22:26:50.538 INFO:tasks.workunit.client.0.smithi001.stdout:1/743: stat d3/f99 0 2024-09-15T22:26:50.538 INFO:tasks.workunit.client.0.smithi001.stdout:1/744: truncate d3/f5e 1072057 0 2024-09-15T22:26:50.539 INFO:tasks.workunit.client.0.smithi001.stdout:8/694: write d9/d19/d58/f30 [1683024,28964] 0 2024-09-15T22:26:50.539 INFO:tasks.workunit.client.0.smithi001.stdout:8/695: readlink d9/d19/l26 0 2024-09-15T22:26:50.539 INFO:tasks.workunit.client.0.smithi001.stdout:2/719: mkdir d2/d14/d1a/d1b/de8 0 2024-09-15T22:26:50.539 INFO:tasks.workunit.client.0.smithi001.stdout:8/696: unlink d9/d19/l2e 0 2024-09-15T22:26:50.541 INFO:tasks.workunit.client.0.smithi001.stdout:2/720: creat d2/d14/d1a/d1b/de8/fe9 x:0 0 0 2024-09-15T22:26:50.542 INFO:tasks.workunit.client.0.smithi001.stdout:1/745: rename l1 to d3/d12/lec 0 2024-09-15T22:26:50.542 INFO:tasks.workunit.client.0.smithi001.stdout:1/746: chown d3/d12/d79/dce/d14/d23/da1/de9 25 1 2024-09-15T22:26:50.543 INFO:tasks.workunit.client.0.smithi001.stdout:8/697: mkdir d9/d19/d29/d33/d63/dcb 0 2024-09-15T22:26:50.543 INFO:tasks.workunit.client.0.smithi001.stdout:2/721: creat d2/fea x:0 0 0 2024-09-15T22:26:50.543 INFO:tasks.workunit.client.0.smithi001.stdout:1/747: rmdir d3/d12/d79/d89 39 2024-09-15T22:26:50.544 INFO:tasks.workunit.client.0.smithi001.stdout:7/747: write d0/d7/d44/d3f/fa6 [2024176,45693] 0 2024-09-15T22:26:50.544 INFO:tasks.workunit.client.0.smithi001.stdout:1/748: symlink d3/d12/d79/dce/d53/dc7/led 0 2024-09-15T22:26:50.545 INFO:tasks.workunit.client.0.smithi001.stdout:2/722: creat d2/d14/feb x:0 0 0 2024-09-15T22:26:50.545 INFO:tasks.workunit.client.0.smithi001.stdout:2/723: fdatasync d2/d14/feb 0 2024-09-15T22:26:50.545 INFO:tasks.workunit.client.0.smithi001.stdout:8/698: creat d9/d19/d58/fcc x:0 0 0 2024-09-15T22:26:50.546 INFO:tasks.workunit.client.0.smithi001.stdout:3/776: dwrite da/d3b/d8b/fbc [0,4194304] 0 2024-09-15T22:26:50.546 INFO:tasks.workunit.client.0.smithi001.stdout:3/777: write da/d3b/d8b/dee/fb0 [1444813,98225] 0 2024-09-15T22:26:50.546 INFO:tasks.workunit.client.0.smithi001.stdout:8/699: creat d9/d19/d58/d8e/d9c/fcd x:0 0 0 2024-09-15T22:26:50.546 INFO:tasks.workunit.client.0.smithi001.stdout:8/700: chown d9/d19/d34/da4 682469 1 2024-09-15T22:26:50.546 INFO:tasks.workunit.client.0.smithi001.stdout:2/724: mkdir d2/d12/dec 0 2024-09-15T22:26:50.546 INFO:tasks.workunit.client.0.smithi001.stdout:2/725: chown d2/d14/d1a/d8a/lc5 7057 1 2024-09-15T22:26:50.548 INFO:tasks.workunit.client.0.smithi001.stdout:8/701: rmdir d9/d19/d40/d5f/d61/d9f 39 2024-09-15T22:26:50.548 INFO:tasks.workunit.client.0.smithi001.stdout:8/702: write d9/d19/d29/d35/f8f [798110,91948] 0 2024-09-15T22:26:50.550 INFO:tasks.workunit.client.0.smithi001.stdout:3/778: mknod da/d3d/d43/d41/df1/c10b 0 2024-09-15T22:26:50.550 INFO:tasks.workunit.client.0.smithi001.stdout:2/726: getdents d2/d14/d1a/d1b/d82/dc9/d6f/d70 0 2024-09-15T22:26:50.550 INFO:tasks.workunit.client.0.smithi001.stdout:8/703: unlink d9/d19/d34/da4/cc6 0 2024-09-15T22:26:50.551 INFO:tasks.workunit.client.0.smithi001.stdout:8/704: chown d9/d19/fbe 24989968 1 2024-09-15T22:26:50.552 INFO:tasks.workunit.client.0.smithi001.stdout:3/779: rename da/db3/fea to da/d3b/d8b/dbe/f10c 0 2024-09-15T22:26:50.552 INFO:tasks.workunit.client.0.smithi001.stdout:3/780: chown da/d3b/c23 2 1 2024-09-15T22:26:50.552 INFO:tasks.workunit.client.0.smithi001.stdout:0/608: dwrite d0/dd/d63/fa9 [0,4194304] 0 2024-09-15T22:26:50.557 INFO:tasks.workunit.client.0.smithi001.stdout:9/635: dwrite d5/de/d1a/d1b/d22/d2c/d21/d23/fb2 [0,4194304] 0 2024-09-15T22:26:50.557 INFO:tasks.workunit.client.0.smithi001.stdout:3/781: rename da/d3d/d43/d7c/d53/d73/l99 to da/d3d/d43/d7c/d3f/db5/l10d 0 2024-09-15T22:26:50.564 INFO:tasks.workunit.client.0.smithi001.stdout:9/636: unlink d5/de/d1a/d1b/d22/d2c/d21/lae 0 2024-09-15T22:26:50.564 INFO:tasks.workunit.client.0.smithi001.stdout:8/705: dread d9/d19/d34/f47 [4194304,4194304] 0 2024-09-15T22:26:50.568 INFO:tasks.workunit.client.0.smithi001.stdout:2/727: dread d2/d14/d1a/d8a/f94 [0,4194304] 0 2024-09-15T22:26:50.569 INFO:tasks.workunit.client.0.smithi001.stdout:1/749: dread d3/d12/d79/dce/d14/d1b/d2b/f56 [4194304,4194304] 0 2024-09-15T22:26:50.569 INFO:tasks.workunit.client.0.smithi001.stdout:1/750: dread - d3/d12/d79/dce/d53/fe5 zero size 2024-09-15T22:26:50.570 INFO:tasks.workunit.client.0.smithi001.stdout:2/728: rmdir d2/d12/d62/d64/d76/d7f 39 2024-09-15T22:26:50.572 INFO:tasks.workunit.client.0.smithi001.stdout:2/729: rename d2/d14/d1a/d1b/d82/d83/fa9 to d2/d14/fed 0 2024-09-15T22:26:50.572 INFO:tasks.workunit.client.0.smithi001.stdout:1/751: creat d3/fee x:0 0 0 2024-09-15T22:26:50.573 INFO:tasks.workunit.client.0.smithi001.stdout:1/752: dread - d3/d12/d79/dce/d53/fcb zero size 2024-09-15T22:26:50.574 INFO:tasks.workunit.client.0.smithi001.stdout:1/753: creat d3/d12/fef x:0 0 0 2024-09-15T22:26:50.574 INFO:tasks.workunit.client.0.smithi001.stdout:2/730: rename d2/f5e to d2/d14/d1a/d1b/d82/d83/fee 0 2024-09-15T22:26:50.575 INFO:tasks.workunit.client.0.smithi001.stdout:2/731: truncate d2/d12/d62/d4c/d9d/f9e 118181 0 2024-09-15T22:26:50.577 INFO:tasks.workunit.client.0.smithi001.stdout:2/732: mkdir d2/d12/d62/d64/d76/db4/def 0 2024-09-15T22:26:50.578 INFO:tasks.workunit.client.0.smithi001.stdout:2/733: rename d2/d14/d1a/d8a/f9f to d2/d12/ff0 0 2024-09-15T22:26:50.578 INFO:tasks.workunit.client.0.smithi001.stdout:2/734: readlink d2/d14/d1a/l53 0 2024-09-15T22:26:50.580 INFO:tasks.workunit.client.0.smithi001.stdout:2/735: truncate d2/d12/d62/d64/f13 910649 0 2024-09-15T22:26:50.580 INFO:tasks.workunit.client.0.smithi001.stdout:2/736: chown d2/d14/d1a/d1b/d82/dc9/d6f/d70 356921429 1 2024-09-15T22:26:50.581 INFO:tasks.workunit.client.0.smithi001.stdout:0/609: dread d0/d9/d1a/d36/f45 [0,4194304] 0 2024-09-15T22:26:50.581 INFO:tasks.workunit.client.0.smithi001.stdout:2/737: symlink d2/d14/d1a/lf1 0 2024-09-15T22:26:50.583 INFO:tasks.workunit.client.0.smithi001.stdout:2/738: mknod d2/d14/d1a/d1b/d82/cf2 0 2024-09-15T22:26:50.589 INFO:tasks.workunit.client.0.smithi001.stdout:6/737: dread d0/df/d24/db1/fe5 [0,4194304] 0 2024-09-15T22:26:50.589 INFO:tasks.workunit.client.0.smithi001.stdout:4/861: dwrite d0/d27/d94/df9/f100 [0,4194304] 0 2024-09-15T22:26:50.605 INFO:tasks.workunit.client.0.smithi001.stdout:4/862: mknod d0/d27/d94/df9/c133 0 2024-09-15T22:26:50.605 INFO:tasks.workunit.client.0.smithi001.stdout:7/748: read d0/d8e/d3e/f51 [470058,40753] 0 2024-09-15T22:26:50.607 INFO:tasks.workunit.client.0.smithi001.stdout:2/739: dread d2/d12/f1c [0,4194304] 0 2024-09-15T22:26:50.608 INFO:tasks.workunit.client.0.smithi001.stdout:5/747: dwrite d3/d27/d5c/dd6/fe2 [0,4194304] 0 2024-09-15T22:26:50.608 INFO:tasks.workunit.client.0.smithi001.stdout:5/748: truncate d3/d6/d57/d87/d8c/da2/fed 924725 0 2024-09-15T22:26:50.608 INFO:tasks.workunit.client.0.smithi001.stdout:4/863: creat d0/d5d/d7c/dba/d20/d29/d124/d74/f134 x:0 0 0 2024-09-15T22:26:50.609 INFO:tasks.workunit.client.0.smithi001.stdout:2/740: link d2/d12/d62/d64/d76/db4/lc2 d2/d12/d62/d64/d76/db4/lf3 0 2024-09-15T22:26:50.609 INFO:tasks.workunit.client.0.smithi001.stdout:2/741: truncate d2/d12/f61 822513 0 2024-09-15T22:26:50.609 INFO:tasks.workunit.client.0.smithi001.stdout:2/742: fsync d2/d14/d1a/d1b/d82/fe0 0 2024-09-15T22:26:50.610 INFO:tasks.workunit.client.0.smithi001.stdout:5/749: creat d3/d6/ffb x:0 0 0 2024-09-15T22:26:50.610 INFO:tasks.workunit.client.0.smithi001.stdout:4/864: symlink d0/d5d/d7c/dba/d20/d29/l135 0 2024-09-15T22:26:50.610 INFO:tasks.workunit.client.0.smithi001.stdout:4/865: dread - d0/d5d/d7c/dba/d20/d29/d124/d59/d67/f9e zero size 2024-09-15T22:26:50.615 INFO:tasks.workunit.client.0.smithi001.stdout:3/782: dwrite da/f31 [0,4194304] 0 2024-09-15T22:26:50.615 INFO:tasks.workunit.client.0.smithi001.stdout:7/749: unlink d0/d8e/fc8 0 2024-09-15T22:26:50.617 INFO:tasks.workunit.client.0.smithi001.stdout:3/783: creat da/d3d/d43/d7c/d3f/db5/df9/dda/ddc/f10e x:0 0 0 2024-09-15T22:26:50.617 INFO:tasks.workunit.client.0.smithi001.stdout:3/784: truncate da/d3b/d8b/dee/f28 2023096 0 2024-09-15T22:26:50.617 INFO:tasks.workunit.client.0.smithi001.stdout:7/750: mknod d0/dd3/c106 0 2024-09-15T22:26:50.620 INFO:tasks.workunit.client.0.smithi001.stdout:3/785: getdents da/d16 0 2024-09-15T22:26:50.621 INFO:tasks.workunit.client.0.smithi001.stdout:9/637: dwrite d5/de/d1a/d1b/d22/d2c/d21/d24/d86/f93 [0,4194304] 0 2024-09-15T22:26:50.621 INFO:tasks.workunit.client.0.smithi001.stdout:9/638: truncate d5/de/d15/d27/d63/db6/fbd 2395193 0 2024-09-15T22:26:50.626 INFO:tasks.workunit.client.0.smithi001.stdout:3/786: symlink da/d3d/d43/d7c/d3f/db5/df9/l10f 0 2024-09-15T22:26:50.626 INFO:tasks.workunit.client.0.smithi001.stdout:4/866: dread d0/d5d/d7c/dba/f21 [0,4194304] 0 2024-09-15T22:26:50.627 INFO:tasks.workunit.client.0.smithi001.stdout:9/639: unlink d5/c81 0 2024-09-15T22:26:50.630 INFO:tasks.workunit.client.0.smithi001.stdout:3/787: creat da/dae/f110 x:0 0 0 2024-09-15T22:26:50.631 INFO:tasks.workunit.client.0.smithi001.stdout:9/640: creat d5/de/d1a/da8/fc2 x:0 0 0 2024-09-15T22:26:50.633 INFO:tasks.workunit.client.0.smithi001.stdout:3/788: symlink da/d3d/d43/d7c/d3f/db5/dd1/l111 0 2024-09-15T22:26:50.633 INFO:tasks.workunit.client.0.smithi001.stdout:3/789: dread - da/dae/f110 zero size 2024-09-15T22:26:50.634 INFO:tasks.workunit.client.0.smithi001.stdout:4/867: mkdir d0/d5d/d7c/dba/d20/d29/d34/d84/d136 0 2024-09-15T22:26:50.635 INFO:tasks.workunit.client.0.smithi001.stdout:4/868: chown d0/d5d/d7c/dba/d20/f11f 671 1 2024-09-15T22:26:50.635 INFO:tasks.workunit.client.0.smithi001.stdout:6/738: dwrite d0/d6/f13 [0,4194304] 0 2024-09-15T22:26:50.636 INFO:tasks.workunit.client.0.smithi001.stdout:4/869: creat d0/d5d/d7c/dba/d20/d29/d124/da4/f137 x:0 0 0 2024-09-15T22:26:50.637 INFO:tasks.workunit.client.0.smithi001.stdout:4/870: rmdir d0/d5d/d7c/dba/d20/d29/d34/d84 39 2024-09-15T22:26:50.638 INFO:tasks.workunit.client.0.smithi001.stdout:4/871: getdents d0/d5d/d7c/dba/d20/d29 0 2024-09-15T22:26:50.645 INFO:tasks.workunit.client.0.smithi001.stdout:6/739: dread d0/d6/d5d/d67/f38 [0,4194304] 0 2024-09-15T22:26:50.651 INFO:tasks.workunit.client.0.smithi001.stdout:9/641: dread d5/d3e/f52 [0,4194304] 0 2024-09-15T22:26:50.653 INFO:tasks.workunit.client.0.smithi001.stdout:6/740: dread d0/df/d24/f7f [0,4194304] 0 2024-09-15T22:26:50.658 INFO:tasks.workunit.client.0.smithi001.stdout:6/741: mkdir d0/df/d24/d2e/d104 0 2024-09-15T22:26:50.666 INFO:tasks.workunit.client.0.smithi001.stdout:4/872: dread d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d73/dc0/fe6 [0,4194304] 0 2024-09-15T22:26:50.669 INFO:tasks.workunit.client.0.smithi001.stdout:3/790: dwrite da/d90/fe1 [0,4194304] 0 2024-09-15T22:26:50.672 INFO:tasks.workunit.client.0.smithi001.stdout:4/873: truncate d0/d5d/d7c/dba/d20/f9f 1246451 0 2024-09-15T22:26:50.674 INFO:tasks.workunit.client.0.smithi001.stdout:4/874: mkdir d0/d5d/d7c/dba/d20/d29/d124/d59/d67/dab/d138 0 2024-09-15T22:26:50.674 INFO:tasks.workunit.client.0.smithi001.stdout:4/875: write d0/d5d/d7c/dba/d20/d29/d34/f10b [822700,93084] 0 2024-09-15T22:26:50.675 INFO:tasks.workunit.client.0.smithi001.stdout:4/876: link d0/d5d/d7c/dba/d20/d29/d40/dc8/f11d d0/d5d/d7c/dba/d20/df6/f139 0 2024-09-15T22:26:50.676 INFO:tasks.workunit.client.0.smithi001.stdout:4/877: rmdir d0/d5d/d7c/dba/d20/df6 39 2024-09-15T22:26:50.677 INFO:tasks.workunit.client.0.smithi001.stdout:4/878: symlink d0/d5d/d44/d65/d6a/d113/l13a 0 2024-09-15T22:26:50.677 INFO:tasks.workunit.client.0.smithi001.stdout:4/879: write d0/d5d/d7c/dba/f43 [5076492,34972] 0 2024-09-15T22:26:50.678 INFO:tasks.workunit.client.0.smithi001.stdout:4/880: creat d0/d27/d94/f13b x:0 0 0 2024-09-15T22:26:50.685 INFO:tasks.workunit.client.0.smithi001.stdout:5/750: dwrite d3/d27/d7a/d80/faf [0,4194304] 0 2024-09-15T22:26:50.685 INFO:tasks.workunit.client.0.smithi001.stdout:5/751: rename d3/d6 to d3/d6/d41/d88/df0/dfc 22 2024-09-15T22:26:50.694 INFO:tasks.workunit.client.0.smithi001.stdout:5/752: creat d3/d6/dd8/ffd x:0 0 0 2024-09-15T22:26:50.700 INFO:tasks.workunit.client.0.smithi001.stdout:9/642: dread d5/de/d1a/d1b/d22/d2c/d21/d24/f4c [0,4194304] 0 2024-09-15T22:26:50.703 INFO:tasks.workunit.client.0.smithi001.stdout:9/643: rename d5/c54 to d5/cc3 0 2024-09-15T22:26:50.703 INFO:tasks.workunit.client.0.smithi001.stdout:5/753: dread d3/d27/d4e/d89/f9b [0,4194304] 0 2024-09-15T22:26:50.704 INFO:tasks.workunit.client.0.smithi001.stdout:9/644: link d5/de/d15/f74 d5/de/d1a/d1b/d22/d2c/d21/d23/d3d/fc4 0 2024-09-15T22:26:50.706 INFO:tasks.workunit.client.0.smithi001.stdout:2/743: dwrite d2/d14/d1a/d1b/f4d [0,4194304] 0 2024-09-15T22:26:50.709 INFO:tasks.workunit.client.0.smithi001.stdout:2/744: creat d2/d14/d1a/d1b/d82/dc9/d6f/d70/ff4 x:0 0 0 2024-09-15T22:26:50.710 INFO:tasks.workunit.client.0.smithi001.stdout:2/745: rename d2/d12/f52 to d2/d14/d1a/d1b/d82/dc9/ff5 0 2024-09-15T22:26:50.713 INFO:tasks.workunit.client.0.smithi001.stdout:2/746: unlink d2/d12/d62/d64/f4a 0 2024-09-15T22:26:50.714 INFO:tasks.workunit.client.0.smithi001.stdout:3/791: dwrite da/d3d/d43/d7c/d53/d72/feb [0,4194304] 0 2024-09-15T22:26:50.714 INFO:tasks.workunit.client.0.smithi001.stdout:3/792: truncate da/d3d/d43/d7c/d53/d73/ff3 891966 0 2024-09-15T22:26:50.715 INFO:tasks.workunit.client.0.smithi001.stdout:2/747: truncate d2/d12/d62/f40 2546638 0 2024-09-15T22:26:50.717 INFO:tasks.workunit.client.0.smithi001.stdout:2/748: mkdir d2/d14/d1a/d1b/d82/db0/df6 0 2024-09-15T22:26:50.717 INFO:tasks.workunit.client.0.smithi001.stdout:2/749: read - d2/d12/d62/d64/d76/d7f/fc7 zero size 2024-09-15T22:26:50.724 INFO:tasks.workunit.client.0.smithi001.stdout:8/706: sync 2024-09-15T22:26:50.724 INFO:tasks.workunit.client.0.smithi001.stdout:2/750: mknod d2/d12/d62/d4c/cf7 0 2024-09-15T22:26:50.724 INFO:tasks.workunit.client.0.smithi001.stdout:2/751: chown d2/d14/d1a/d1b/c46 15710946 1 2024-09-15T22:26:50.724 INFO:tasks.workunit.client.0.smithi001.stdout:2/752: mkdir d2/d14/d1a/d1b/d82/db0/df6/df8 0 2024-09-15T22:26:50.724 INFO:tasks.workunit.client.0.smithi001.stdout:2/753: write d2/d14/d1a/d1b/d82/dc9/fa3 [552574,41562] 0 2024-09-15T22:26:50.724 INFO:tasks.workunit.client.0.smithi001.stdout:2/754: truncate d2/d14/d1a/d1b/d82/d97/d74/fe6 539346 0 2024-09-15T22:26:50.727 INFO:tasks.workunit.client.0.smithi001.stdout:6/742: dwrite d0/d6/d5d/f91 [0,4194304] 0 2024-09-15T22:26:50.730 INFO:tasks.workunit.client.0.smithi001.stdout:6/743: truncate d0/df/d24/f2c 2214380 0 2024-09-15T22:26:50.731 INFO:tasks.workunit.client.0.smithi001.stdout:6/744: symlink d0/df/d24/d49/dc7/l105 0 2024-09-15T22:26:50.733 INFO:tasks.workunit.client.0.smithi001.stdout:6/745: unlink d0/df/f89 0 2024-09-15T22:26:50.733 INFO:tasks.workunit.client.0.smithi001.stdout:1/754: sync 2024-09-15T22:26:50.734 INFO:tasks.workunit.client.0.smithi001.stdout:1/755: truncate d3/f5e 576734 0 2024-09-15T22:26:50.734 INFO:tasks.workunit.client.0.smithi001.stdout:1/756: write d3/f7 [7819192,23199] 0 2024-09-15T22:26:50.734 INFO:tasks.workunit.client.0.smithi001.stdout:1/757: chown d3/d12/d79/dce/d14/d1b/l67 55658 1 2024-09-15T22:26:50.734 INFO:tasks.workunit.client.0.smithi001.stdout:1/758: fdatasync d3/d12/d79/dce/d14/d1b/d2b/d68/fb5 0 2024-09-15T22:26:50.738 INFO:tasks.workunit.client.0.smithi001.stdout:6/746: rename d0/d6/d5d/d67/f4e to d0/df/d24/d2e/d43/f106 0 2024-09-15T22:26:50.739 INFO:tasks.workunit.client.0.smithi001.stdout:6/747: unlink d0/df/d24/d2e/d43/d30/da7/ld3 0 2024-09-15T22:26:50.742 INFO:tasks.workunit.client.0.smithi001.stdout:6/748: truncate d0/d7e/fa2 1613790 0 2024-09-15T22:26:50.743 INFO:tasks.workunit.client.0.smithi001.stdout:6/749: creat d0/df/d97/f107 x:0 0 0 2024-09-15T22:26:50.745 INFO:tasks.workunit.client.0.smithi001.stdout:7/751: sync 2024-09-15T22:26:50.745 INFO:tasks.workunit.client.0.smithi001.stdout:0/610: sync 2024-09-15T22:26:50.745 INFO:tasks.workunit.client.0.smithi001.stdout:7/752: chown d0/d7/d21/c4e 56092 1 2024-09-15T22:26:50.745 INFO:tasks.workunit.client.0.smithi001.stdout:7/753: write d0/d7/fdf [238645,99518] 0 2024-09-15T22:26:50.748 INFO:tasks.workunit.client.0.smithi001.stdout:0/611: rename d0/dd/d33/l4d to d0/d9/d1a/d70/lbc 0 2024-09-15T22:26:50.748 INFO:tasks.workunit.client.0.smithi001.stdout:0/612: chown d0/d6/f89 54 1 2024-09-15T22:26:50.748 INFO:tasks.workunit.client.0.smithi001.stdout:0/613: readlink d0/d9/d1a/l68 0 2024-09-15T22:26:50.749 INFO:tasks.workunit.client.0.smithi001.stdout:2/755: read d2/d14/f2d [6358780,29797] 0 2024-09-15T22:26:50.749 INFO:tasks.workunit.client.0.smithi001.stdout:2/756: dread - d2/d12/d62/d4c/d71/fdd zero size 2024-09-15T22:26:50.751 INFO:tasks.workunit.client.0.smithi001.stdout:7/754: mkdir d0/d7/d21/d6b/d107 0 2024-09-15T22:26:50.751 INFO:tasks.workunit.client.0.smithi001.stdout:7/755: write d0/d7/d44/d36/f84 [908267,70049] 0 2024-09-15T22:26:50.753 INFO:tasks.workunit.client.0.smithi001.stdout:2/757: symlink d2/lf9 0 2024-09-15T22:26:50.756 INFO:tasks.workunit.client.0.smithi001.stdout:4/881: dwrite d0/d5d/d7c/dba/d20/d29/d34/d9c/f122 [0,4194304] 0 2024-09-15T22:26:50.756 INFO:tasks.workunit.client.0.smithi001.stdout:4/882: rename d0/d5d/d7c/dba/d20/d29/d124/f9d to d0/d5d/d7c/dba/d20/d29/d124/d74/f13c 0 2024-09-15T22:26:50.758 INFO:tasks.workunit.client.0.smithi001.stdout:4/883: mkdir d0/d5d/d7c/dba/d20/d29/d34/d84/d136/d13d 0 2024-09-15T22:26:50.759 INFO:tasks.workunit.client.0.smithi001.stdout:4/884: rmdir d0/d5d/d7c/dba/d20/d29/d124/d74/de5 39 2024-09-15T22:26:50.761 INFO:tasks.workunit.client.0.smithi001.stdout:4/885: rename d0/d5d/d7c/dba/d20/d29/d34/fb7 to d0/d5d/d7c/dba/d20/d29/d124/da4/de1/f13e 0 2024-09-15T22:26:50.761 INFO:tasks.workunit.client.0.smithi001.stdout:5/754: read d3/d27/f3a [1057047,50463] 0 2024-09-15T22:26:50.761 INFO:tasks.workunit.client.0.smithi001.stdout:5/755: readlink d3/d6/d41/l83 0 2024-09-15T22:26:50.762 INFO:tasks.workunit.client.0.smithi001.stdout:4/886: mknod d0/d5d/d7c/dba/d20/d29/d124/d59/d67/dab/d138/c13f 0 2024-09-15T22:26:50.763 INFO:tasks.workunit.client.0.smithi001.stdout:4/887: write d0/d5d/d7c/dba/d20/d29/d34/f41 [4701424,9996] 0 2024-09-15T22:26:50.766 INFO:tasks.workunit.client.0.smithi001.stdout:5/756: mkdir d3/d27/d4e/d89/dfe 0 2024-09-15T22:26:50.766 INFO:tasks.workunit.client.0.smithi001.stdout:7/756: creat d0/d7/d2e/d60/df7/f108 x:0 0 0 2024-09-15T22:26:50.766 INFO:tasks.workunit.client.0.smithi001.stdout:4/888: symlink d0/d5d/d7c/dba/d20/d29/l140 0 2024-09-15T22:26:50.777 INFO:tasks.workunit.client.0.smithi001.stdout:4/889: dread d0/f11 [0,4194304] 0 2024-09-15T22:26:50.781 INFO:tasks.workunit.client.0.smithi001.stdout:4/890: rename d0/d5d/d7c/dba/d20/c82 to d0/d5d/d7c/dba/d20/d29/d124/d59/d67/c141 0 2024-09-15T22:26:50.784 INFO:tasks.workunit.client.0.smithi001.stdout:4/891: link d0/d5d/d7c/l12d d0/d5d/d7c/dd1/l142 0 2024-09-15T22:26:50.785 INFO:tasks.workunit.client.0.smithi001.stdout:4/892: truncate d0/d5d/d7c/dba/d20/d29/d124/d59/d67/dab/f8d 3798929 0 2024-09-15T22:26:50.803 INFO:tasks.workunit.client.0.smithi001.stdout:9/645: dwrite d5/f11 [4194304,4194304] 0 2024-09-15T22:26:50.803 INFO:tasks.workunit.client.0.smithi001.stdout:3/793: dwrite da/d3d/d43/d41/fa7 [0,4194304] 0 2024-09-15T22:26:50.806 INFO:tasks.workunit.client.0.smithi001.stdout:9/646: creat d5/de/d1a/d1b/d22/d2c/d21/fc5 x:0 0 0 2024-09-15T22:26:50.815 INFO:tasks.workunit.client.0.smithi001.stdout:8/707: dwrite d9/d19/d58/f49 [0,4194304] 0 2024-09-15T22:26:50.815 INFO:tasks.workunit.client.0.smithi001.stdout:8/708: fsync d9/d19/f3c 0 2024-09-15T22:26:50.815 INFO:tasks.workunit.client.0.smithi001.stdout:8/709: dread - d9/d19/d58/d8e/d9c/fcd zero size 2024-09-15T22:26:50.833 INFO:tasks.workunit.client.0.smithi001.stdout:3/794: dread da/d3d/d43/d7c/d3f/db5/df9/fdf [0,4194304] 0 2024-09-15T22:26:50.834 INFO:tasks.workunit.client.0.smithi001.stdout:5/757: dwrite d3/d49/fa0 [0,4194304] 0 2024-09-15T22:26:50.835 INFO:tasks.workunit.client.0.smithi001.stdout:3/795: creat da/d3d/d43/d7c/d3f/db5/df9/f112 x:0 0 0 2024-09-15T22:26:50.835 INFO:tasks.workunit.client.0.smithi001.stdout:3/796: chown da/d90/d6f/d102 0 1 2024-09-15T22:26:50.835 INFO:tasks.workunit.client.0.smithi001.stdout:3/797: chown da/d3d/d43/d41/df1/l91 131171 1 2024-09-15T22:26:50.835 INFO:tasks.workunit.client.0.smithi001.stdout:5/758: getdents d3/d6/d41/d4d/dbe/d56/ddc/de9/df6 0 2024-09-15T22:26:50.837 INFO:tasks.workunit.client.0.smithi001.stdout:3/798: creat da/d101/f113 x:0 0 0 2024-09-15T22:26:50.837 INFO:tasks.workunit.client.0.smithi001.stdout:5/759: symlink d3/d6/d41/d4d/d5a/d84/lff 0 2024-09-15T22:26:50.838 INFO:tasks.workunit.client.0.smithi001.stdout:5/760: rename d3/d6/d41/d88/da5/l6d to d3/d6/d41/d4d/l100 0 2024-09-15T22:26:50.841 INFO:tasks.workunit.client.0.smithi001.stdout:3/799: symlink da/l114 0 2024-09-15T22:26:50.841 INFO:tasks.workunit.client.0.smithi001.stdout:3/800: write da/d3d/d43/d41/f5e [1871299,71200] 0 2024-09-15T22:26:50.841 INFO:tasks.workunit.client.0.smithi001.stdout:5/761: symlink d3/d6/d41/d4d/dbe/d56/l101 0 2024-09-15T22:26:50.849 INFO:tasks.workunit.client.0.smithi001.stdout:2/758: dwrite d2/d14/d1a/d1b/d82/d97/d74/fe6 [0,4194304] 0 2024-09-15T22:26:50.851 INFO:tasks.workunit.client.0.smithi001.stdout:2/759: creat d2/d12/d62/d64/d76/d7f/ffa x:0 0 0 2024-09-15T22:26:50.852 INFO:tasks.workunit.client.0.smithi001.stdout:7/757: dwrite d0/d7/d44/f27 [0,4194304] 0 2024-09-15T22:26:50.852 INFO:tasks.workunit.client.0.smithi001.stdout:7/758: readlink d0/d7/d44/d3f/d49/da5/lfd 0 2024-09-15T22:26:50.852 INFO:tasks.workunit.client.0.smithi001.stdout:7/759: dread - d0/d7/d44/d3f/fef zero size 2024-09-15T22:26:50.852 INFO:tasks.workunit.client.0.smithi001.stdout:0/614: dwrite d0/d6/f30 [0,4194304] 0 2024-09-15T22:26:50.852 INFO:tasks.workunit.client.0.smithi001.stdout:2/760: mknod d2/d12/d62/d4c/d9d/cfb 0 2024-09-15T22:26:50.852 INFO:tasks.workunit.client.0.smithi001.stdout:2/761: write d2/f3 [1130022,70863] 0 2024-09-15T22:26:50.852 INFO:tasks.workunit.client.0.smithi001.stdout:6/750: dwrite d0/d6/d5d/da6/f102 [0,4194304] 0 2024-09-15T22:26:50.853 INFO:tasks.workunit.client.0.smithi001.stdout:7/760: mkdir d0/d7/d2e/d109 0 2024-09-15T22:26:50.853 INFO:tasks.workunit.client.0.smithi001.stdout:7/761: truncate d0/d7/d44/d3f/d49/fc7 608121 0 2024-09-15T22:26:50.854 INFO:tasks.workunit.client.0.smithi001.stdout:0/615: creat d0/d6/fbd x:0 0 0 2024-09-15T22:26:50.857 INFO:tasks.workunit.client.0.smithi001.stdout:3/801: dread da/d3b/d1b/f95 [0,4194304] 0 2024-09-15T22:26:50.857 INFO:tasks.workunit.client.0.smithi001.stdout:2/762: symlink d2/d14/d1a/d1b/d82/dc9/lfc 0 2024-09-15T22:26:50.859 INFO:tasks.workunit.client.0.smithi001.stdout:2/763: read - d2/d14/d1a/d1b/d82/dc9/d6f/fb2 zero size 2024-09-15T22:26:50.859 INFO:tasks.workunit.client.0.smithi001.stdout:2/764: chown d2/d14/d1a/d1b/de8 1798 1 2024-09-15T22:26:50.860 INFO:tasks.workunit.client.0.smithi001.stdout:2/765: read d2/d14/d1a/d1b/d82/dc9/f7e [167839,58138] 0 2024-09-15T22:26:50.861 INFO:tasks.workunit.client.0.smithi001.stdout:3/802: write da/d3b/d8b/dee/fb0 [212430,94219] 0 2024-09-15T22:26:50.861 INFO:tasks.workunit.client.0.smithi001.stdout:2/766: mknod d2/d14/d1a/d1b/d82/d97/cfd 0 2024-09-15T22:26:50.866 INFO:tasks.workunit.client.0.smithi001.stdout:3/803: creat da/d3b/f115 x:0 0 0 2024-09-15T22:26:50.868 INFO:tasks.workunit.client.0.smithi001.stdout:2/767: getdents d2/d14/d1a/d1b/d82/dc9 0 2024-09-15T22:26:50.879 INFO:tasks.workunit.client.0.smithi001.stdout:8/710: dwrite d9/d19/d58/f68 [0,4194304] 0 2024-09-15T22:26:50.883 INFO:tasks.workunit.client.0.smithi001.stdout:6/751: write d0/d6/f71 [102444,65730] 0 2024-09-15T22:26:50.886 INFO:tasks.workunit.client.0.smithi001.stdout:9/647: dwrite d5/de/f18 [0,4194304] 0 2024-09-15T22:26:50.896 INFO:tasks.workunit.client.0.smithi001.stdout:8/711: dread d9/d19/f3f [0,4194304] 0 2024-09-15T22:26:50.897 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.895+0000 7fd4b9c00640 1 -- 172.21.15.1:0/4159929219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4b41084c0 msgr2=0x7fd4b41088c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:50.897 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.895+0000 7fd4b9c00640 1 --2- 172.21.15.1:0/4159929219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4b41084c0 0x7fd4b41088c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0009890 tx=0x7fd4a002a370 comp rx=0 tx=0).stop 2024-09-15T22:26:50.897 INFO:tasks.workunit.client.0.smithi001.stdout:8/712: creat d9/d19/d58/d8e/d9c/fce x:0 0 0 2024-09-15T22:26:50.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.896+0000 7fd4b9c00640 1 -- 172.21.15.1:0/4159929219 shutdown_connections 2024-09-15T22:26:50.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.896+0000 7fd4b9c00640 1 --2- 172.21.15.1:0/4159929219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4b4109d40 0x7fd4b41105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:50.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.896+0000 7fd4b9c00640 1 --2- 172.21.15.1:0/4159929219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4b4109380 0x7fd4b4109800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:50.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.896+0000 7fd4b9c00640 1 --2- 172.21.15.1:0/4159929219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4b41084c0 0x7fd4b41088c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:50.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.896+0000 7fd4b9c00640 1 -- 172.21.15.1:0/4159929219 >> 172.21.15.1:0/4159929219 conn(0x7fd4b4077490 msgr2=0x7fd4b40798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:50.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.896+0000 7fd4b9c00640 1 -- 172.21.15.1:0/4159929219 shutdown_connections 2024-09-15T22:26:50.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.896+0000 7fd4b9c00640 1 -- 172.21.15.1:0/4159929219 wait complete. 2024-09-15T22:26:50.899 INFO:tasks.workunit.client.0.smithi001.stdout:8/713: symlink d9/d19/d40/d5f/lcf 0 2024-09-15T22:26:50.899 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.897+0000 7fd4b9c00640 1 Processor -- start 2024-09-15T22:26:50.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.898+0000 7fd4b9c00640 1 -- start start 2024-09-15T22:26:50.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.898+0000 7fd4b9c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4b41084c0 0x7fd4b419e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:50.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.898+0000 7fd4b9c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4b4109380 0x7fd4b419ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:50.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.898+0000 7fd4b9c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4b4109d40 0x7fd4b41a5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:50.901 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.898+0000 7fd4b9c00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b4113e20 con 0x7fd4b4109d40 2024-09-15T22:26:50.901 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.898+0000 7fd4b9c00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b4113ca0 con 0x7fd4b41084c0 2024-09-15T22:26:50.901 INFO:tasks.workunit.client.0.smithi001.stdout:8/714: rmdir d9/d19/d34 39 2024-09-15T22:26:50.901 INFO:tasks.workunit.client.0.smithi001.stdout:8/715: chown d9/d19/d40/fa3 9 1 2024-09-15T22:26:50.901 INFO:tasks.workunit.client.0.smithi001.stdout:6/752: dread d0/d7e/fba [0,4194304] 0 2024-09-15T22:26:50.901 INFO:tasks.workunit.client.0.smithi001.stdout:8/716: write d9/d19/d29/d50/d70/f86 [1692806,131054] 0 2024-09-15T22:26:50.901 INFO:tasks.workunit.client.0.smithi001.stdout:8/717: fdatasync d9/d19/d29/d50/fa2 0 2024-09-15T22:26:50.901 INFO:tasks.workunit.client.0.smithi001.stdout:8/718: chown d9/d19/d58/fcc 276423 1 2024-09-15T22:26:50.901 INFO:tasks.workunit.client.0.smithi001.stdout:8/719: chown d9/f18 398 1 2024-09-15T22:26:50.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.898+0000 7fd4b9c00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b4113fa0 con 0x7fd4b4109380 2024-09-15T22:26:50.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.898+0000 7fd4b3400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4b4109d40 0x7fd4b41a5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:50.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.899+0000 7fd4b3400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4b4109d40 0x7fd4b41a5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56870/0 (socket says 172.21.15.1:56870) 2024-09-15T22:26:50.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.899+0000 7fd4b3400640 1 -- 172.21.15.1:0/1115337282 learned_addr learned my addr 172.21.15.1:0/1115337282 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:26:50.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.899+0000 7fd4b2a00640 1 --2- 172.21.15.1:0/1115337282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4b41084c0 0x7fd4b419e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:50.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.899+0000 7fd4b2000640 1 --2- 172.21.15.1:0/1115337282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4b4109380 0x7fd4b419ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:50.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.899+0000 7fd4b3400640 1 -- 172.21.15.1:0/1115337282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4b4109380 msgr2=0x7fd4b419ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:50.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.899+0000 7fd4b3400640 1 --2- 172.21.15.1:0/1115337282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4b4109380 0x7fd4b419ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:50.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.899+0000 7fd4b3400640 1 -- 172.21.15.1:0/1115337282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4b41084c0 msgr2=0x7fd4b419e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:50.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.899+0000 7fd4b3400640 1 --2- 172.21.15.1:0/1115337282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4b41084c0 0x7fd4b419e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:50.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.899+0000 7fd4b3400640 1 -- 172.21.15.1:0/1115337282 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b406bd40 con 0x7fd4b4109d40 2024-09-15T22:26:50.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.899+0000 7fd4b2000640 1 --2- 172.21.15.1:0/1115337282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4b4109380 0x7fd4b419ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:26:50.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.899+0000 7fd4b2a00640 1 --2- 172.21.15.1:0/1115337282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4b41084c0 0x7fd4b419e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:26:50.903 INFO:tasks.workunit.client.0.smithi001.stdout:6/753: mknod d0/d6/d5d/d67/d53/da0/dfc/c108 0 2024-09-15T22:26:50.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.899+0000 7fd4b3400640 1 --2- 172.21.15.1:0/1115337282 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4b4109d40 0x7fd4b41a5af0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac00efc0 tx=0x7fd4ac00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:50.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.900+0000 7fd4ab400640 1 -- 172.21.15.1:0/1115337282 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac003970 con 0x7fd4b4109d40 2024-09-15T22:26:50.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.900+0000 7fd4b9c00640 1 -- 172.21.15.1:0/1115337282 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4b406c030 con 0x7fd4b4109d40 2024-09-15T22:26:50.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.900+0000 7fd4ab400640 1 -- 172.21.15.1:0/1115337282 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4ac004020 con 0x7fd4b4109d40 2024-09-15T22:26:50.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.900+0000 7fd4ab400640 1 -- 172.21.15.1:0/1115337282 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac00b9f0 con 0x7fd4b4109d40 2024-09-15T22:26:50.904 INFO:tasks.workunit.client.0.smithi001.stdout:8/720: mkdir d9/d19/d40/d9e/dd0 0 2024-09-15T22:26:50.904 INFO:tasks.workunit.client.0.smithi001.stdout:8/721: fdatasync d9/d19/d29/d33/d63/fa9 0 2024-09-15T22:26:50.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.901+0000 7fd4b9c00640 1 -- 172.21.15.1:0/1115337282 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4b406c580 con 0x7fd4b4109d40 2024-09-15T22:26:50.905 INFO:tasks.workunit.client.0.smithi001.stdout:6/754: symlink d0/d6/d5d/d67/d53/da0/dfc/l109 0 2024-09-15T22:26:50.906 INFO:tasks.workunit.client.0.smithi001.stdout:8/722: mknod d9/d19/d29/d33/cd1 0 2024-09-15T22:26:50.906 INFO:tasks.workunit.client.0.smithi001.stdout:3/804: write da/d3d/fc9 [202249,81832] 0 2024-09-15T22:26:50.906 INFO:tasks.workunit.client.0.smithi001.stdout:7/762: dwrite d0/d98/fc5 [0,4194304] 0 2024-09-15T22:26:50.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.905+0000 7fd4bc9fc740 1 Processor -- start 2024-09-15T22:26:50.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.905+0000 7fd4ab400640 1 -- 172.21.15.1:0/1115337282 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fd4ac01d020 con 0x7fd4b4109d40 2024-09-15T22:26:50.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.905+0000 7fd4bc9fc740 1 -- start start 2024-09-15T22:26:50.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.907+0000 7fd4bc9fc740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7dca01090 0x55c7dca01490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:50.908 INFO:tasks.workunit.client.0.smithi001.stdout:7/763: symlink d0/db3/dd6/df5/df6/l10a 0 2024-09-15T22:26:50.908 INFO:tasks.workunit.client.0.smithi001.stdout:6/755: getdents d0/df/d24 0 2024-09-15T22:26:50.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.907+0000 7fd4bc9fc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7dca019d0 0x55c7dca06490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:50.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.907+0000 7fd4bc9fc740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7dca06a60 0x55c7dca08f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:50.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.907+0000 7fd4bc9fc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c7dc966100 con 0x55c7dca019d0 2024-09-15T22:26:50.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.907+0000 7fd4bc9fc740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c7dc90e1b0 con 0x55c7dca01090 2024-09-15T22:26:50.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.907+0000 7fd4bc9fc740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c7dc9620c0 con 0x55c7dca06a60 2024-09-15T22:26:50.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.907+0000 7fd4b2000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7dca01090 0x55c7dca01490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:50.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.907+0000 7fd4b2000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7dca01090 0x55c7dca01490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:46928/0 (socket says 172.21.15.1:46928) 2024-09-15T22:26:50.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.907+0000 7fd4b2000640 1 -- 172.21.15.1:0/1033729579 learned_addr learned my addr 172.21.15.1:0/1033729579 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:26:50.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.907+0000 7fd4b2000640 1 --2- 172.21.15.1:0/1033729579 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7dca06a60 0x55c7dca08f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:50.910 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.908+0000 7fd4b2000640 1 -- 172.21.15.1:0/1033729579 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7dca06a60 msgr2=0x55c7dca08f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:50.910 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.908+0000 7fd4b2000640 1 --2- 172.21.15.1:0/1033729579 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7dca06a60 0x55c7dca08f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:50.910 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.908+0000 7fd4b2000640 1 -- 172.21.15.1:0/1033729579 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7dca019d0 msgr2=0x55c7dca06490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:26:50.911 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.908+0000 7fd4ab400640 1 --2- 172.21.15.1:0/1115337282 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fd4980a3340 0x7fd4980a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:50.911 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.908+0000 7fd4ab400640 1 -- 172.21.15.1:0/1115337282 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7fd4ac0cf8e0 con 0x7fd4b4109d40 2024-09-15T22:26:50.911 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.908+0000 7fd4b2a00640 1 --2- 172.21.15.1:0/1033729579 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7dca019d0 0x55c7dca06490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:50.911 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.908+0000 7fd4b2000640 1 --2- 172.21.15.1:0/1033729579 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7dca019d0 0x55c7dca06490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:50.911 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.908+0000 7fd4b2000640 1 -- 172.21.15.1:0/1033729579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7dc679210 con 0x55c7dca01090 2024-09-15T22:26:50.911 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.909+0000 7fd4b2000640 1 --2- 172.21.15.1:0/1115337282 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fd4980a3340 0x7fd4980a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:50.911 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.910+0000 7fd4b2000640 1 --2- 172.21.15.1:0/1033729579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7dca01090 0x55c7dca01490 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4014a30 tx=0x7fd4a400c570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=debf4614442a3466 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:50.912 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.910+0000 7fd49fe00640 1 -- 172.21.15.1:0/1033729579 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a400fcf0 con 0x55c7dca01090 2024-09-15T22:26:50.912 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.910+0000 7fd4b2000640 1 --2- 172.21.15.1:0/1115337282 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fd4980a3340 0x7fd4980a5800 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4022000 tx=0x7fd4a401f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:50.912 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.910+0000 7fd49fe00640 1 -- 172.21.15.1:0/1033729579 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4a400fe90 con 0x55c7dca01090 2024-09-15T22:26:50.912 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.910+0000 7fd49fe00640 1 -- 172.21.15.1:0/1033729579 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a4023780 con 0x55c7dca01090 2024-09-15T22:26:50.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.911+0000 7fd4bc9fc740 1 -- 172.21.15.1:0/1033729579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7dca01090 msgr2=0x55c7dca01490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:50.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.911+0000 7fd4bc9fc740 1 --2- 172.21.15.1:0/1033729579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7dca01090 0x55c7dca01490 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4014a30 tx=0x7fd4a400c570 comp rx=0 tx=0).stop 2024-09-15T22:26:50.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.912+0000 7fd4bc9fc740 1 -- 172.21.15.1:0/1033729579 shutdown_connections 2024-09-15T22:26:50.914 INFO:tasks.workunit.client.0.smithi001.stdout:8/723: dread d9/d19/f2b [0,4194304] 0 2024-09-15T22:26:50.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.912+0000 7fd4bc9fc740 1 --2- 172.21.15.1:0/1033729579 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7dca06a60 0x55c7dca08f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:50.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.912+0000 7fd4bc9fc740 1 --2- 172.21.15.1:0/1033729579 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7dca019d0 0x55c7dca06490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:50.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.912+0000 7fd4bc9fc740 1 --2- 172.21.15.1:0/1033729579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7dca01090 0x55c7dca01490 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:50.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.912+0000 7fd4bc9fc740 1 -- 172.21.15.1:0/1033729579 >> 172.21.15.1:0/1033729579 conn(0x55c7dc9fc700 msgr2=0x55c7dc9fcb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:50.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.913+0000 7fd4bc9fc740 1 -- 172.21.15.1:0/1033729579 shutdown_connections 2024-09-15T22:26:50.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.913+0000 7fd4bc9fc740 1 -- 172.21.15.1:0/1033729579 wait complete. 2024-09-15T22:26:50.915 INFO:tasks.workunit.client.0.smithi001.stdout:7/764: mknod d0/db3/c10b 0 2024-09-15T22:26:50.915 INFO:tasks.workunit.client.0.smithi001.stdout:9/648: write d5/de/d1a/d1b/d22/d2c/f61 [1269594,37846] 0 2024-09-15T22:26:50.915 INFO:tasks.workunit.client.0.smithi001.stdout:6/756: creat d0/df/d24/f10a x:0 0 0 2024-09-15T22:26:50.915 INFO:tasks.workunit.client.0.smithi001.stdout:6/757: dread - d0/d6/d5d/dd8/ff3 zero size 2024-09-15T22:26:50.916 INFO:tasks.workunit.client.0.smithi001.stdout:6/758: truncate d0/df/d24/d2e/f86 944514 0 2024-09-15T22:26:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.913+0000 7fd4bc9fc740 1 -- start start 2024-09-15T22:26:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.914+0000 7fd4bc9fc740 1 Processor -- start 2024-09-15T22:26:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.914+0000 7fd4bc9fc740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7dca01090 0x55c7dca0b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.914+0000 7fd4bc9fc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7dca019d0 0x55c7dca0b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:50.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.914+0000 7fd4bc9fc740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7dca06a60 0x55c7dca12790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:50.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.914+0000 7fd4bc9fc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c7dca09a30 con 0x55c7dca019d0 2024-09-15T22:26:50.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.914+0000 7fd4bc9fc740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c7dc8ef090 con 0x55c7dca06a60 2024-09-15T22:26:50.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.914+0000 7fd4bc9fc740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c7dca09bb0 con 0x55c7dca01090 2024-09-15T22:26:50.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.914+0000 7fd4bc9fc740 10 client.0 _ll_register_callbacks cb 0x55c7dc943f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:26:50.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.914+0000 7fd4b2a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7dca01090 0x55c7dca0b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:50.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.914+0000 7fd4b2a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7dca01090 0x55c7dca0b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:40314/0 (socket says 172.21.15.1:40314) 2024-09-15T22:26:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.914+0000 7fd4b2a00640 1 -- 172.21.15.1:0/1305558552 learned_addr learned my addr 172.21.15.1:0/1305558552 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:26:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.915+0000 7fd4b3400640 1 --2- 172.21.15.1:0/1305558552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7dca06a60 0x55c7dca12790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.915+0000 7fd4b2a00640 1 -- 172.21.15.1:0/1305558552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7dca06a60 msgr2=0x55c7dca12790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.915+0000 7fd4b2a00640 1 --2- 172.21.15.1:0/1305558552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7dca06a60 0x55c7dca12790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.915+0000 7fd4b2a00640 1 -- 172.21.15.1:0/1305558552 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7dca019d0 msgr2=0x55c7dca0b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.915+0000 7fd4b2a00640 1 --2- 172.21.15.1:0/1305558552 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7dca019d0 0x55c7dca0b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.915+0000 7fd4b2a00640 1 -- 172.21.15.1:0/1305558552 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7dc745620 con 0x55c7dca01090 2024-09-15T22:26:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.915+0000 7fd4b3400640 1 --2- 172.21.15.1:0/1305558552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7dca06a60 0x55c7dca12790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:26:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.915+0000 7fd4b2a00640 1 --2- 172.21.15.1:0/1305558552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7dca01090 0x55c7dca0b210 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd4a002a960 tx=0x7fd4a0004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5fa0c6d0ea6265c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.915+0000 7fd49cc00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-15T22:26:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.915+0000 7fd49cc00640 1 -- 172.21.15.1:0/1305558552 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a0037040 con 0x55c7dca01090 2024-09-15T22:26:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.916+0000 7fd4bc9fc740 1 -- 172.21.15.1:0/1305558552 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4a400fe90 con 0x55c7dca01090 2024-09-15T22:26:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.916+0000 7fd49cc00640 1 -- 172.21.15.1:0/1305558552 <== mon.1 v2:172.21.15.98:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7fd4a0005030 con 0x55c7dca01090 2024-09-15T22:26:50.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.916+0000 7fd49cc00640 1 -- 172.21.15.1:0/1305558552 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd4a0009440 con 0x55c7dca01090 2024-09-15T22:26:50.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.916+0000 7fd4bc9fc740 10 client.25210 fetch_fsmap learned FSMap version 27 2024-09-15T22:26:50.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.916+0000 7fd4bc9fc740 1 -- 172.21.15.1:0/1305558552 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c7dca15640 con 0x55c7dca01090 2024-09-15T22:26:50.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.917+0000 7fd49cc00640 1 -- 172.21.15.1:0/1305558552 <== mon.1 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4a400fe90 con 0x55c7dca01090 2024-09-15T22:26:50.921 INFO:tasks.workunit.client.0.smithi001.stdout:8/724: unlink d9/d19/d34/f4a 0 2024-09-15T22:26:50.921 INFO:tasks.workunit.client.0.smithi001.stdout:7/765: creat d0/d7/d21/f10c x:0 0 0 2024-09-15T22:26:50.921 INFO:tasks.workunit.client.0.smithi001.stdout:9/649: mkdir d5/de/d15/d27/dc6 0 2024-09-15T22:26:50.921 INFO:tasks.workunit.client.0.smithi001.stdout:9/650: fdatasync d5/de/d1a/d1b/d22/d2c/f75 0 2024-09-15T22:26:50.921 INFO:tasks.workunit.client.0.smithi001.stdout:3/805: write da/f13 [2485514,123384] 0 2024-09-15T22:26:50.921 INFO:tasks.workunit.client.0.smithi001.stdout:6/759: getdents d0/d6 0 2024-09-15T22:26:50.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.917+0000 7fd49cc00640 1 -- 172.21.15.1:0/1305558552 <== mon.1 v2:172.21.15.98:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fd4a00035f0 con 0x55c7dca01090 2024-09-15T22:26:50.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.918+0000 7fd4bc9fc740 10 client.25210 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:26:50.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.918+0000 7fd4bc9fc740 10 client.25210 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T22:26:50.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.918+0000 7fd4bc9fc740 20 client.25210 populate_metadata read hostname 'smithi001' 2024-09-15T22:26:50.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.918+0000 7fd4bc9fc740 1 --2- 172.21.15.1:0/1305558552 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55c7dca16ce0 0x55c7dca19160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:50.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.918+0000 7fd4bc9fc740 4 client.25210 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:26:50.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.918+0000 7fd4bc9fc740 1 -- 172.21.15.1:0/1305558552 --> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c7dc973830 con 0x55c7dca16ce0 2024-09-15T22:26:50.923 INFO:tasks.workunit.client.0.smithi001.stdout:0/616: dwrite d0/dd/d63/f97 [0,4194304] 0 2024-09-15T22:26:50.923 INFO:tasks.workunit.client.0.smithi001.stdout:0/617: dread - d0/d84/fb0 zero size 2024-09-15T22:26:50.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.918+0000 7fd4b2000640 1 --2- 172.21.15.1:0/1305558552 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55c7dca16ce0 0x55c7dca19160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:50.924 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.919+0000 7fd4b2000640 1 --2- 172.21.15.1:0/1305558552 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55c7dca16ce0 0x55c7dca19160 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67c5246fe0a3496a server_cookie=4c66c9a3aee648ba in_seq=0 out_seq=0 2024-09-15T22:26:50.924 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.919+0000 7fd49cc00640 10 client.25210 ms_handle_connect on v2:172.21.15.98:6838/2831161859 2024-09-15T22:26:50.924 INFO:tasks.workunit.client.0.smithi001.stdout:3/806: rename da/d3d/fc9 to da/d3b/d8b/dbe/f116 0 2024-09-15T22:26:50.924 INFO:tasks.workunit.client.0.smithi001.stdout:3/807: dread - da/d3b/d58/fb4 zero size 2024-09-15T22:26:50.924 INFO:tasks.workunit.client.0.smithi001.stdout:3/808: read - da/f106 zero size 2024-09-15T22:26:50.925 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.921+0000 7fd49cc00640 1 -- 172.21.15.1:0/1305558552 <== mds.0 v2:172.21.15.98:6838/2831161859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c7dc973830 con 0x55c7dca16ce0 2024-09-15T22:26:50.925 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.921+0000 7fd49cc00640 10 client.25210 handle_command_reply: tid=0 2024-09-15T22:26:50.925 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.921+0000 7fd4bc9fc740 1 client.25210 shutdown 2024-09-15T22:26:50.925 INFO:tasks.workunit.client.0.smithi001.stdout:6/760: mknod d0/df/d24/c10b 0 2024-09-15T22:26:50.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.921+0000 7fd4bc9fc740 1 -- 172.21.15.1:0/1305558552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7dca01090 msgr2=0x55c7dca0b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:50.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.921+0000 7fd4bc9fc740 1 --2- 172.21.15.1:0/1305558552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7dca01090 0x55c7dca0b210 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd4a002a960 tx=0x7fd4a0004270 comp rx=0 tx=0).stop 2024-09-15T22:26:50.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.921+0000 7fd4bc9fc740 1 -- 172.21.15.1:0/1305558552 shutdown_connections 2024-09-15T22:26:50.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.921+0000 7fd4bc9fc740 1 --2- 172.21.15.1:0/1305558552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7dca06a60 0x55c7dca12790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:50.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.921+0000 7fd4bc9fc740 1 --2- 172.21.15.1:0/1305558552 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55c7dca16ce0 0x55c7dca19160 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:50.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.921+0000 7fd4bc9fc740 1 --2- 172.21.15.1:0/1305558552 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7dca019d0 0x55c7dca0b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:50.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.921+0000 7fd4bc9fc740 1 --2- 172.21.15.1:0/1305558552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7dca01090 0x55c7dca0b210 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:50.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.921+0000 7fd49cc00640 0 client.25210 ms_handle_reset on v2:172.21.15.98:6838/2831161859 2024-09-15T22:26:50.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.921+0000 7fd4bc9fc740 1 -- 172.21.15.1:0/1305558552 >> 172.21.15.1:0/1305558552 conn(0x55c7dc9fc700 msgr2=0x55c7dc9fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:50.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.922+0000 7fd4bc9fc740 1 -- 172.21.15.1:0/1305558552 shutdown_connections 2024-09-15T22:26:50.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.922+0000 7fd4bc9fc740 1 -- 172.21.15.1:0/1305558552 wait complete. 2024-09-15T22:26:50.927 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.922+0000 7fd4bc9fc740 20 client.25210 trim_cache size 0 max 16384 2024-09-15T22:26:50.931 INFO:tasks.workunit.client.0.smithi001.stdout:6/761: rename d0/cfe to d0/d6/d5d/d67/df0/c10c 0 2024-09-15T22:26:50.931 INFO:tasks.workunit.client.0.smithi001.stdout:6/762: stat d0/df/c20 0 2024-09-15T22:26:50.931 INFO:tasks.workunit.client.0.smithi001.stdout:6/763: chown d0/d6/d5d/d67/d53/fa8 809512 1 2024-09-15T22:26:50.937 INFO:tasks.workunit.client.0.smithi001.stdout:6/764: link d0/d6/d5d/d8c/l8f d0/df/d24/d49/l10d 0 2024-09-15T22:26:50.937 INFO:tasks.workunit.client.0.smithi001.stdout:8/725: write d9/fb [6896554,41519] 0 2024-09-15T22:26:50.938 INFO:tasks.workunit.client.0.smithi001.stdout:9/651: dread d5/de/d1a/d1b/d22/f2f [0,4194304] 0 2024-09-15T22:26:50.940 INFO:tasks.workunit.client.0.smithi001.stdout:6/765: symlink d0/df/d24/d2e/d43/d30/da7/l10e 0 2024-09-15T22:26:50.940 INFO:tasks.workunit.client.0.smithi001.stdout:6/766: readlink d0/df/l5c 0 2024-09-15T22:26:50.944 INFO:tasks.workunit.client.0.smithi001.stdout:1/759: sync 2024-09-15T22:26:50.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.944+0000 7fd4bc9fc740 1 Processor -- start 2024-09-15T22:26:50.946 INFO:tasks.workunit.client.0.smithi001.stdout:0/618: dread d0/d9/f38 [0,4194304] 0 2024-09-15T22:26:50.947 INFO:tasks.workunit.client.0.smithi001.stdout:1/760: unlink d3/d12/d79/dce/f55 0 2024-09-15T22:26:50.947 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.945+0000 7fd4bc9fc740 1 -- start start 2024-09-15T22:26:50.947 INFO:tasks.workunit.client.0.smithi001.stdout:0/619: mknod d0/d6/cbe 0 2024-09-15T22:26:50.948 INFO:tasks.workunit.client.0.smithi001.stdout:1/761: truncate d3/d12/d79/dce/d14/d1b/fa8 146758 0 2024-09-15T22:26:50.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.948+0000 7fd4bc9fc740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7dca01090 0x55c7dca0b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:50.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.948+0000 7fd4bc9fc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7dca019d0 0x55c7dca12750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:50.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.948+0000 7fd4bc9fc740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7dca06a60 0x55c7dc9fdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:50.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.948+0000 7fd4bc9fc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b41ba950 con 0x55c7dca019d0 2024-09-15T22:26:50.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.948+0000 7fd4bc9fc740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b41b8220 con 0x55c7dca01090 2024-09-15T22:26:50.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.948+0000 7fd4bc9fc740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b4073450 con 0x55c7dca06a60 2024-09-15T22:26:50.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.948+0000 7fd4b2a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7dca01090 0x55c7dca0b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:50.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.948+0000 7fd4b2a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7dca01090 0x55c7dca0b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:46956/0 (socket says 172.21.15.1:46956) 2024-09-15T22:26:50.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.948+0000 7fd4b2a00640 1 -- 172.21.15.1:0/1706839573 learned_addr learned my addr 172.21.15.1:0/1706839573 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:26:50.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.949+0000 7fd4b2a00640 1 -- 172.21.15.1:0/1706839573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7dca06a60 msgr2=0x55c7dc9fdd80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:26:50.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.949+0000 7fd4b2a00640 1 --2- 172.21.15.1:0/1706839573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7dca06a60 0x55c7dc9fdd80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:50.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.949+0000 7fd4b2a00640 1 -- 172.21.15.1:0/1706839573 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7dca019d0 msgr2=0x55c7dca12750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:26:50.952 INFO:tasks.workunit.client.0.smithi001.stdout:1/762: symlink d3/d12/d79/dce/d86/lf0 0 2024-09-15T22:26:50.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.950+0000 7fd4b2000640 1 --2- 172.21.15.1:0/1706839573 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7dca019d0 0x55c7dca12750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:50.953 INFO:tasks.workunit.client.0.smithi001.stdout:1/763: truncate d3/d12/d79/dce/d3c/d4c/f5c 2487638 0 2024-09-15T22:26:50.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.951+0000 7fd4b2a00640 1 --2- 172.21.15.1:0/1706839573 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7dca019d0 0x55c7dca12750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:50.953 INFO:tasks.workunit.client.0.smithi001.stdout:3/809: write da/d3d/d43/d41/fa7 [1789727,110428] 0 2024-09-15T22:26:50.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.951+0000 7fd4b2a00640 1 -- 172.21.15.1:0/1706839573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7dca197e0 con 0x55c7dca01090 2024-09-15T22:26:50.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.953+0000 7fd4b2000640 1 --2- 172.21.15.1:0/1706839573 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7dca019d0 0x55c7dca12750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:26:50.962 INFO:tasks.workunit.client.0.smithi001.stdout:6/767: dread d0/d6/d5d/d8c/f8e [0,4194304] 0 2024-09-15T22:26:50.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.963+0000 7fd4b2a00640 1 --2- 172.21.15.1:0/1706839573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7dca01090 0x55c7dca0b7e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0049040 tx=0x7fd4a002a370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e87063bcb38a0a8c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:50.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.967+0000 7fd49f400640 1 -- 172.21.15.1:0/1706839573 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a0054070 con 0x55c7dca01090 2024-09-15T22:26:50.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.967+0000 7fd49f400640 1 -- 172.21.15.1:0/1706839573 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4a0004ba0 con 0x55c7dca01090 2024-09-15T22:26:50.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.967+0000 7fd49f400640 1 -- 172.21.15.1:0/1706839573 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a0037040 con 0x55c7dca01090 2024-09-15T22:26:50.972 INFO:tasks.workunit.client.0.smithi001.stdout:0/620: dread d0/d84/f9f [0,4194304] 0 2024-09-15T22:26:50.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.970+0000 7fd4bc9fc740 1 -- 172.21.15.1:0/1706839573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7dca01090 msgr2=0x55c7dca0b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:50.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.970+0000 7fd4bc9fc740 1 --2- 172.21.15.1:0/1706839573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7dca01090 0x55c7dca0b7e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0049040 tx=0x7fd4a002a370 comp rx=0 tx=0).stop 2024-09-15T22:26:50.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.970+0000 7fd4bc9fc740 1 -- 172.21.15.1:0/1706839573 shutdown_connections 2024-09-15T22:26:50.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.970+0000 7fd4bc9fc740 1 --2- 172.21.15.1:0/1706839573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7dca06a60 0x55c7dc9fdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:50.974 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.970+0000 7fd4bc9fc740 1 --2- 172.21.15.1:0/1706839573 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7dca019d0 0x55c7dca12750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:50.974 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.970+0000 7fd4bc9fc740 1 --2- 172.21.15.1:0/1706839573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7dca01090 0x55c7dca0b7e0 secure :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0049040 tx=0x7fd4a002a370 comp rx=0 tx=0).stop 2024-09-15T22:26:50.974 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.971+0000 7fd4bc9fc740 1 -- 172.21.15.1:0/1706839573 >> 172.21.15.1:0/1706839573 conn(0x55c7dc9fc700 msgr2=0x55c7dc9fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:50.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.973+0000 7fd4bc9fc740 1 -- 172.21.15.1:0/1706839573 shutdown_connections 2024-09-15T22:26:50.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.973+0000 7fd4bc9fc740 1 -- 172.21.15.1:0/1706839573 wait complete. 2024-09-15T22:26:50.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.974+0000 7fd4bc9fc740 1 -- start start 2024-09-15T22:26:50.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.974+0000 7fd4bc9fc740 1 Processor -- start 2024-09-15T22:26:50.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.975+0000 7fd4bc9fc740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7dca019d0 0x55c7dca0fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:50.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.975+0000 7fd4bc9fc740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7dca06a60 0x55c7dca10130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:50.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.975+0000 7fd4bc9fc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7dca11140 0x55c7dca115a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:50.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.976+0000 7fd4b2a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7dca019d0 0x55c7dca0fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:50.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.976+0000 7fd4bc9fc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b4073ac0 con 0x55c7dca11140 2024-09-15T22:26:50.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.976+0000 7fd4b2a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7dca019d0 0x55c7dca0fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:46962/0 (socket says 172.21.15.1:46962) 2024-09-15T22:26:50.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.976+0000 7fd4b2a00640 1 -- 172.21.15.1:0/2009711226 learned_addr learned my addr 172.21.15.1:0/2009711226 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:26:50.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.976+0000 7fd4bc9fc740 1 -- 172.21.15.1:0/2009711226 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b41b7b50 con 0x55c7dca019d0 2024-09-15T22:26:50.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.976+0000 7fd4bc9fc740 1 -- 172.21.15.1:0/2009711226 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b4074190 con 0x55c7dca06a60 2024-09-15T22:26:50.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.976+0000 7fd4bc9fc740 10 client.0 _ll_register_callbacks cb 0x7fd4ac009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:26:50.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.976+0000 7fd4b3400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7dca11140 0x55c7dca115a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:50.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.976+0000 7fd4b2a00640 1 -- 172.21.15.1:0/2009711226 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7dca06a60 msgr2=0x55c7dca10130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:26:50.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.976+0000 7fd4b2a00640 1 --2- 172.21.15.1:0/2009711226 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7dca06a60 0x55c7dca10130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:50.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.976+0000 7fd4b2a00640 1 -- 172.21.15.1:0/2009711226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7dca11140 msgr2=0x55c7dca115a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:50.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.977+0000 7fd4b2a00640 1 --2- 172.21.15.1:0/2009711226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7dca11140 0x55c7dca115a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:50.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.977+0000 7fd4b2a00640 1 -- 172.21.15.1:0/2009711226 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7dca11b30 con 0x55c7dca019d0 2024-09-15T22:26:50.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.977+0000 7fd4b2a00640 1 --2- 172.21.15.1:0/2009711226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7dca019d0 0x55c7dca0fbf0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0034000 tx=0x7fd4a00045b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dae75de22bef7c01 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:50.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.977+0000 7fd4b3400640 1 --2- 172.21.15.1:0/2009711226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7dca11140 0x55c7dca115a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:26:50.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.977+0000 7fd49cc00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-15T22:26:50.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.977+0000 7fd49cc00640 1 -- 172.21.15.1:0/2009711226 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a0054070 con 0x55c7dca019d0 2024-09-15T22:26:50.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.978+0000 7fd49cc00640 1 -- 172.21.15.1:0/2009711226 <== mon.2 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7fd4a0004d50 con 0x55c7dca019d0 2024-09-15T22:26:50.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.978+0000 7fd4bc9fc740 1 -- 172.21.15.1:0/2009711226 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4a0004ba0 con 0x55c7dca019d0 2024-09-15T22:26:50.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.978+0000 7fd49cc00640 1 -- 172.21.15.1:0/2009711226 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd4a0037040 con 0x55c7dca019d0 2024-09-15T22:26:50.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.978+0000 7fd4bc9fc740 10 client.25181 fetch_fsmap learned FSMap version 27 2024-09-15T22:26:50.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.978+0000 7fd4bc9fc740 1 -- 172.21.15.1:0/2009711226 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c7dca81b00 con 0x55c7dca019d0 2024-09-15T22:26:50.981 INFO:tasks.workunit.client.0.smithi001.stdout:1/764: dread d3/d12/d79/dce/d14/d1b/fa8 [0,4194304] 0 2024-09-15T22:26:50.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.979+0000 7fd49cc00640 1 -- 172.21.15.1:0/2009711226 <== mon.2 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4a0004ba0 con 0x55c7dca019d0 2024-09-15T22:26:50.982 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.980+0000 7fd49cc00640 1 -- 172.21.15.1:0/2009711226 <== mon.2 v2:172.21.15.12:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fd4a003d9d0 con 0x55c7dca019d0 2024-09-15T22:26:50.982 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.980+0000 7fd4bc9fc740 10 client.25181 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:26:50.982 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.980+0000 7fd4bc9fc740 10 client.25181 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T22:26:50.982 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.980+0000 7fd4bc9fc740 20 client.25181 populate_metadata read hostname 'smithi001' 2024-09-15T22:26:50.982 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.980+0000 7fd4bc9fc740 1 --2- 172.21.15.1:0/2009711226 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55c7dca823e0 0x55c7dca84800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:50.982 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.980+0000 7fd4bc9fc740 4 client.25181 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:26:50.982 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.980+0000 7fd4bc9fc740 1 -- 172.21.15.1:0/2009711226 --> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c7dc96db80 con 0x55c7dca823e0 2024-09-15T22:26:50.983 INFO:tasks.workunit.client.0.smithi001.stdout:1/765: mknod d3/d12/d79/dce/d14/d23/da1/da2/cf1 0 2024-09-15T22:26:50.983 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.980+0000 7fd4b2000640 1 --2- 172.21.15.1:0/2009711226 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55c7dca823e0 0x55c7dca84800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:50.983 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.981+0000 7fd4b2000640 1 --2- 172.21.15.1:0/2009711226 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55c7dca823e0 0x55c7dca84800 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1845097d57d05153 server_cookie=c1a5589f962893ba in_seq=0 out_seq=0 2024-09-15T22:26:50.983 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:50.981+0000 7fd49cc00640 10 client.25181 ms_handle_connect on v2:172.21.15.98:6838/2831161859 2024-09-15T22:26:50.984 INFO:tasks.workunit.client.0.smithi001.stdout:1/766: link d3/d12/d79/dce/d14/d23/da1/da2/cf1 d3/d12/dbd/cf2 0 2024-09-15T22:26:50.985 INFO:tasks.workunit.client.0.smithi001.stdout:1/767: mkdir d3/d12/df3 0 2024-09-15T22:26:50.986 INFO:tasks.workunit.client.0.smithi001.stdout:1/768: mkdir d3/d12/d79/dce/d14/daa/ddd/df4 0 2024-09-15T22:26:50.986 INFO:tasks.workunit.client.0.smithi001.stdout:1/769: stat d3/d12/d79/dce/d14/d23/f9d 0 2024-09-15T22:26:50.987 INFO:tasks.workunit.client.0.smithi001.stdout:1/770: chown d3/d12/d79/dce/d53/dc7/ddb 124158 1 2024-09-15T22:26:50.991 INFO:tasks.workunit.client.0.smithi001.stdout:9/652: write d5/de/d15/f74 [2506614,45637] 0 2024-09-15T22:26:50.991 INFO:tasks.workunit.client.0.smithi001.stdout:6/768: dread d0/df/d24/d7b/db2/ff1 [0,4194304] 0 2024-09-15T22:26:50.991 INFO:tasks.workunit.client.0.smithi001.stdout:6/769: truncate d0/f88 491153 0 2024-09-15T22:26:50.992 INFO:tasks.workunit.client.0.smithi001.stdout:7/766: dwrite d0/d7/d2e/d60/dbd/fdd [0,4194304] 0 2024-09-15T22:26:51.002 INFO:tasks.workunit.client.0.smithi001.stdout:8/726: dwrite d9/d19/d58/d8e/fb1 [0,4194304] 0 2024-09-15T22:26:51.002 INFO:tasks.workunit.client.0.smithi001.stdout:0/621: write d0/d9/d1a/f64 [1086089,89146] 0 2024-09-15T22:26:51.015 INFO:tasks.workunit.client.0.smithi001.stdout:8/727: read d9/d19/f77 [619349,24979] 0 2024-09-15T22:26:51.018 INFO:tasks.workunit.client.0.smithi001.stdout:3/810: dwrite da/d3b/d1b/f76 [0,4194304] 0 2024-09-15T22:26:51.018 INFO:tasks.workunit.client.0.smithi001.stdout:3/811: fsync da/d3d/d43/d7c/d53/d72/f9f 0 2024-09-15T22:26:51.035 INFO:tasks.workunit.client.0.smithi001.stdout:6/770: dwrite d0/d6/d5d/dd8/fee [0,4194304] 0 2024-09-15T22:26:51.045 INFO:tasks.workunit.client.0.smithi001.stdout:6/771: dread d0/d6/d5d/d8c/f8d [0,4194304] 0 2024-09-15T22:26:51.059 INFO:tasks.workunit.client.0.smithi001.stdout:8/728: dwrite d9/f59 [0,4194304] 0 2024-09-15T22:26:51.077 INFO:tasks.workunit.client.0.smithi001.stdout:9/653: creat d5/de/d1a/da8/daf/fc7 x:0 0 0 2024-09-15T22:26:51.077 INFO:tasks.workunit.client.0.smithi001.stdout:9/654: chown d5/de/d1a/d1b 432960 1 2024-09-15T22:26:51.078 INFO:tasks.workunit.client.0.smithi001.stdout:0/622: creat d0/d6/dae/fbf x:0 0 0 2024-09-15T22:26:51.078 INFO:tasks.workunit.client.0.smithi001.stdout:0/623: fdatasync d0/d9/f38 0 2024-09-15T22:26:51.078 INFO:tasks.workunit.client.0.smithi001.stdout:7/767: truncate d0/d7/d21/d6b/f3b 677373 0 2024-09-15T22:26:51.086 INFO:tasks.workunit.client.0.smithi001.stdout:3/812: symlink da/d90/d6f/dc7/l117 0 2024-09-15T22:26:51.086 INFO:tasks.workunit.client.0.smithi001.stdout:6/772: mkdir d0/df/d10f 0 2024-09-15T22:26:51.087 INFO:tasks.workunit.client.0.smithi001.stdout:6/773: fsync d0/df/fb3 0 2024-09-15T22:26:51.087 INFO:tasks.workunit.client.0.smithi001.stdout:6/774: truncate d0/df/d24/d2e/d43/f93 9132166 0 2024-09-15T22:26:51.095 INFO:tasks.workunit.client.0.smithi001.stdout:6/775: symlink d0/df/d24/d2e/d43/d30/dc2/l110 0 2024-09-15T22:26:51.107 INFO:tasks.workunit.client.0.smithi001.stdout:6/776: symlink d0/d6/d5d/d67/dc4/l111 0 2024-09-15T22:26:51.108 INFO:tasks.workunit.client.0.smithi001.stdout:6/777: write d0/d6/fb7 [997411,39835] 0 2024-09-15T22:26:51.108 INFO:tasks.workunit.client.0.smithi001.stdout:9/655: dread d5/de/d1a/d1b/d22/d2c/d21/d4d/f5d [0,4194304] 0 2024-09-15T22:26:51.108 INFO:tasks.workunit.client.0.smithi001.stdout:9/656: truncate d5/de/d1a/d1b/d22/d2c/d21/d23/d3d/fb5 238725 0 2024-09-15T22:26:51.118 INFO:tasks.workunit.client.0.smithi001.stdout:9/657: mknod d5/de/d1a/da8/daf/cc8 0 2024-09-15T22:26:51.132 INFO:tasks.workunit.client.0.smithi001.stdout:1/771: rename d3/d12/d79/dce/d14/d1b/d2b to d3/d8d/d91/df5 0 2024-09-15T22:26:51.164 INFO:tasks.workunit.client.0.smithi001.stdout:6/778: write d0/f19 [7842430,100212] 0 2024-09-15T22:26:51.177 INFO:tasks.workunit.client.0.smithi001.stdout:1/772: dread d3/d12/d79/dce/d14/daa/fb2 [0,4194304] 0 2024-09-15T22:26:51.205 INFO:tasks.workunit.client.0.smithi001.stdout:8/729: dwrite d9/d19/d58/d8e/d9c/fae [0,4194304] 0 2024-09-15T22:26:51.205 INFO:tasks.workunit.client.0.smithi001.stdout:8/730: write d9/d19/d58/d8e/d9c/fcd [63701,46396] 0 2024-09-15T22:26:51.231 INFO:tasks.workunit.client.0.smithi001.stdout:8/731: write d9/d19/f3f [1520281,11201] 0 2024-09-15T22:26:51.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:50 smithi012 ceph-mon[34883]: pgmap v415: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 149 MiB/s rd, 177 MiB/s wr, 1.13k op/s 2024-09-15T22:26:51.247 INFO:tasks.workunit.client.0.smithi001.stdout:1/773: dwrite d3/d8d/d91/fb4 [0,4194304] 0 2024-09-15T22:26:51.249 INFO:tasks.workunit.client.0.smithi001.stdout:0/624: dwrite d0/d51/f99 [0,4194304] 0 2024-09-15T22:26:51.249 INFO:tasks.workunit.client.0.smithi001.stdout:0/625: write d0/d6/f2a [2268300,24544] 0 2024-09-15T22:26:51.249 INFO:tasks.workunit.client.0.smithi001.stdout:6/779: dwrite d0/df/d24/d7b/db2/ff1 [0,4194304] 0 2024-09-15T22:26:51.249 INFO:tasks.workunit.client.0.smithi001.stdout:6/780: write d0/d6/d5d/d67/d53/fcd [82720,117779] 0 2024-09-15T22:26:51.251 INFO:tasks.workunit.client.0.smithi001.stdout:1/774: creat d3/d12/d79/dce/d14/daa/ff6 x:0 0 0 2024-09-15T22:26:51.251 INFO:tasks.workunit.client.0.smithi001.stdout:0/626: creat d0/dd/d93/fc0 x:0 0 0 2024-09-15T22:26:51.251 INFO:tasks.workunit.client.0.smithi001.stdout:0/627: read - d0/d84/fb0 zero size 2024-09-15T22:26:51.251 INFO:tasks.workunit.client.0.smithi001.stdout:0/628: truncate d0/d9/db/f25 67447 0 2024-09-15T22:26:51.251 INFO:tasks.workunit.client.0.smithi001.stdout:8/732: dread d9/d19/d29/f3e [0,4194304] 0 2024-09-15T22:26:51.252 INFO:tasks.workunit.client.0.smithi001.stdout:6/781: link d0/d6/d5d/f75 d0/d6/d5d/dd8/f112 0 2024-09-15T22:26:51.253 INFO:tasks.workunit.client.0.smithi001.stdout:6/782: fdatasync d0/d6/d5d/d8c/f8d 0 2024-09-15T22:26:51.277 INFO:tasks.workunit.client.0.smithi001.stdout:9/658: link d5/de/d1a/d1b/d22/d2c/c45 d5/de/d1a/d1b/d22/d2c/d21/d24/cc9 0 2024-09-15T22:26:51.279 INFO:tasks.workunit.client.0.smithi001.stdout:9/659: write d5/de/d1a/d1b/d22/d2c/f6a [1528136,119653] 0 2024-09-15T22:26:51.280 INFO:tasks.workunit.client.0.smithi001.stdout:9/660: mkdir d5/de/d1a/d1b/d22/d2c/d21/d4d/dca 0 2024-09-15T22:26:51.282 INFO:tasks.workunit.client.0.smithi001.stdout:0/629: creat d0/d9/d1a/fc1 x:0 0 0 2024-09-15T22:26:51.282 INFO:tasks.workunit.client.0.smithi001.stdout:0/630: fdatasync d0/d9/db/d5d/fa3 0 2024-09-15T22:26:51.283 INFO:tasks.workunit.client.0.smithi001.stdout:9/661: mkdir d5/de/d15/d27/dcb 0 2024-09-15T22:26:51.284 INFO:tasks.workunit.client.0.smithi001.stdout:9/662: getdents d5/d90 0 2024-09-15T22:26:51.284 INFO:tasks.workunit.client.0.smithi001.stdout:9/663: chown d5/de/d1a/d1b/d22/d2c/l1f 44 1 2024-09-15T22:26:51.288 INFO:tasks.workunit.client.0.smithi001.stdout:9/664: creat d5/de/d1a/da8/fcc x:0 0 0 2024-09-15T22:26:51.290 INFO:tasks.workunit.client.0.smithi001.stdout:9/665: creat d5/de/d1a/d1b/d22/fcd x:0 0 0 2024-09-15T22:26:51.290 INFO:tasks.workunit.client.0.smithi001.stdout:9/666: stat d5/de/d15/d27/cb7 0 2024-09-15T22:26:51.294 INFO:tasks.workunit.client.0.smithi001.stdout:7/768: rename d0/d6a to d0/d7/d2e/d60/d10d 0 2024-09-15T22:26:51.296 INFO:tasks.workunit.client.0.smithi001.stdout:3/813: rename da/d3d/d43/d41/df1/c10b to da/dae/c118 0 2024-09-15T22:26:51.296 INFO:tasks.workunit.client.0.smithi001.stdout:7/769: getdents d0/d7/dd5 0 2024-09-15T22:26:51.298 INFO:tasks.workunit.client.0.smithi001.stdout:1/775: rename d3/d12/d79/f81 to d3/d8d/d91/df5/d68/d8a/ff7 0 2024-09-15T22:26:51.300 INFO:tasks.workunit.client.0.smithi001.stdout:1/776: creat d3/d8d/dae/ff8 x:0 0 0 2024-09-15T22:26:51.300 INFO:tasks.workunit.client.0.smithi001.stdout:3/814: link da/d3b/d58/c69 da/d90/d6f/d102/c119 0 2024-09-15T22:26:51.302 INFO:tasks.workunit.client.0.smithi001.stdout:6/783: dwrite d0/f88 [0,4194304] 0 2024-09-15T22:26:51.302 INFO:tasks.workunit.client.0.smithi001.stdout:6/784: write d0/df/d24/d49/fc5 [386347,11620] 0 2024-09-15T22:26:51.303 INFO:tasks.workunit.client.0.smithi001.stdout:6/785: write d0/d6/d5d/d8c/fa1 [499983,27387] 0 2024-09-15T22:26:51.303 INFO:tasks.workunit.client.0.smithi001.stdout:6/786: chown d0/df/d24/d7b/l80 1931289 1 2024-09-15T22:26:51.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:51.308+0000 7fd49cc00640 1 -- 172.21.15.1:0/2009711226 <== mds.0 v2:172.21.15.98:6838/2831161859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c7dc96db80 con 0x55c7dca823e0 2024-09-15T22:26:51.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:51.308+0000 7fd49cc00640 10 client.25181 handle_command_reply: tid=0 2024-09-15T22:26:51.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:51.308+0000 7fd4bc9fc740 1 client.25181 shutdown 2024-09-15T22:26:51.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:50 smithi098 ceph-mon[35514]: pgmap v415: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 149 MiB/s rd, 177 MiB/s wr, 1.13k op/s 2024-09-15T22:26:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:51.309+0000 7fd4bc9fc740 1 -- 172.21.15.1:0/2009711226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7dca019d0 msgr2=0x55c7dca0fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:51.309+0000 7fd4bc9fc740 1 --2- 172.21.15.1:0/2009711226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7dca019d0 0x55c7dca0fbf0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0034000 tx=0x7fd4a00045b0 comp rx=0 tx=0).stop 2024-09-15T22:26:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:51.309+0000 7fd4bc9fc740 1 -- 172.21.15.1:0/2009711226 shutdown_connections 2024-09-15T22:26:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:51.309+0000 7fd4bc9fc740 1 --2- 172.21.15.1:0/2009711226 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55c7dca823e0 0x55c7dca84800 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:51.309+0000 7fd4bc9fc740 1 --2- 172.21.15.1:0/2009711226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7dca11140 0x55c7dca115a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:51.309+0000 7fd4bc9fc740 1 --2- 172.21.15.1:0/2009711226 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7dca06a60 0x55c7dca10130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:51.309+0000 7fd4bc9fc740 1 --2- 172.21.15.1:0/2009711226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7dca019d0 0x55c7dca0fbf0 secure :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0034000 tx=0x7fd4a00045b0 comp rx=0 tx=0).stop 2024-09-15T22:26:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:51.309+0000 7fd4bc9fc740 1 -- 172.21.15.1:0/2009711226 >> 172.21.15.1:0/2009711226 conn(0x55c7dc9fc700 msgr2=0x55c7dc9fb880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:51.309+0000 7fd49cc00640 0 client.25181 ms_handle_reset on v2:172.21.15.98:6838/2831161859 2024-09-15T22:26:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:51.309+0000 7fd4bc9fc740 1 -- 172.21.15.1:0/2009711226 shutdown_connections 2024-09-15T22:26:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:51.310+0000 7fd4bc9fc740 1 -- 172.21.15.1:0/2009711226 wait complete. 2024-09-15T22:26:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:51.310+0000 7fd4bc9fc740 20 client.25181 trim_cache size 0 max 16384 2024-09-15T22:26:51.313 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-15T22:26:51.313 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-15T22:26:51.313 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-15T22:26:51.313 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-15T22:26:51.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:51.311+0000 7fd4b9c00640 1 -- 172.21.15.1:0/1115337282 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fd4980a3340 msgr2=0x7fd4980a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:51.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:51.311+0000 7fd4b9c00640 1 --2- 172.21.15.1:0/1115337282 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fd4980a3340 0x7fd4980a5800 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4022000 tx=0x7fd4a401f000 comp rx=0 tx=0).stop 2024-09-15T22:26:51.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:51.311+0000 7fd4b9c00640 1 -- 172.21.15.1:0/1115337282 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4b4109d40 msgr2=0x7fd4b41a5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:51.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:51.311+0000 7fd4b9c00640 1 --2- 172.21.15.1:0/1115337282 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4b4109d40 0x7fd4b41a5af0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac00efc0 tx=0x7fd4ac00c800 comp rx=0 tx=0).stop 2024-09-15T22:26:51.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:51.312+0000 7fd4b9c00640 1 -- 172.21.15.1:0/1115337282 shutdown_connections 2024-09-15T22:26:51.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:51.312+0000 7fd4b9c00640 1 --2- 172.21.15.1:0/1115337282 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fd4980a3340 0x7fd4980a5800 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:51.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:51.312+0000 7fd4b9c00640 1 --2- 172.21.15.1:0/1115337282 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4b4109d40 0x7fd4b41a5af0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:51.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:51.312+0000 7fd4b9c00640 1 --2- 172.21.15.1:0/1115337282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4b4109380 0x7fd4b419ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:51.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:51.312+0000 7fd4b9c00640 1 --2- 172.21.15.1:0/1115337282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4b41084c0 0x7fd4b419e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:51.315 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:51.312+0000 7fd4b9c00640 1 -- 172.21.15.1:0/1115337282 >> 172.21.15.1:0/1115337282 conn(0x7fd4b4077490 msgr2=0x7fd4b410c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:51.315 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:51.312+0000 7fd4b9c00640 1 -- 172.21.15.1:0/1115337282 shutdown_connections 2024-09-15T22:26:51.315 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:26:51.312+0000 7fd4b9c00640 1 -- 172.21.15.1:0/1115337282 wait complete. 2024-09-15T22:26:51.317 INFO:tasks.workunit.client.0.smithi001.stdout:8/733: rename d9/d19/d29/d33/d63/fa9 to d9/d19/d29/d50/d70/d76/fd2 0 2024-09-15T22:26:51.319 INFO:tasks.workunit.client.0.smithi001.stdout:8/734: getdents d9/d19/d40/d5f/d61/d9f 0 2024-09-15T22:26:51.321 INFO:tasks.workunit.client.0.smithi001.stdout:8/735: symlink d9/d19/d29/d33/d63/dcb/ld3 0 2024-09-15T22:26:51.323 INFO:tasks.workunit.client.0.smithi001.stdout:8/736: rename d9/d19/l26 to d9/d19/d34/da4/db7/ld4 0 2024-09-15T22:26:51.327 INFO:tasks.workunit.client.0.smithi001.stdout:8/737: rename d9/d19/d29/d33/d63/dcb/ld3 to d9/d19/d40/d5f/d61/d9f/db3/ld5 0 2024-09-15T22:26:51.334 INFO:tasks.workunit.client.0.smithi001.stdout:0/631: dwrite d0/dd/d93/fc0 [0,4194304] 0 2024-09-15T22:26:51.337 INFO:tasks.workunit.client.0.smithi001.stdout:6/787: dread d0/d6/d5d/d67/fcf [0,4194304] 0 2024-09-15T22:26:51.337 INFO:tasks.workunit.client.0.smithi001.stdout:6/788: fdatasync d0/d6/d5d/f91 0 2024-09-15T22:26:51.341 INFO:tasks.workunit.client.0.smithi001.stdout:9/667: dwrite d5/de/d1a/d1b/d22/f4a [4194304,4194304] 0 2024-09-15T22:26:51.341 INFO:tasks.workunit.client.0.smithi001.stdout:9/668: stat d5/de/d1a/d38 0 2024-09-15T22:26:51.341 INFO:tasks.workunit.client.0.smithi001.stdout:8/738: dread d9/d19/d29/d33/d63/f6a [0,4194304] 0 2024-09-15T22:26:51.345 INFO:tasks.workunit.client.0.smithi001.stdout:9/669: rmdir d5/de/d1a/d1b/d22/d2c/d21/d4d 39 2024-09-15T22:26:51.345 INFO:tasks.workunit.client.0.smithi001.stdout:8/739: creat d9/d19/d40/d9e/fd6 x:0 0 0 2024-09-15T22:26:51.346 INFO:tasks.workunit.client.0.smithi001.stdout:9/670: getdents d5/de/d1a 0 2024-09-15T22:26:51.346 INFO:tasks.workunit.client.0.smithi001.stdout:6/789: dread d0/f9 [0,4194304] 0 2024-09-15T22:26:51.346 INFO:tasks.workunit.client.0.smithi001.stdout:6/790: getdents d0/d6/d5d/d101 0 2024-09-15T22:26:51.349 INFO:tasks.workunit.client.0.smithi001.stdout:8/740: read d9/d19/d29/d35/f8f [787904,70630] 0 2024-09-15T22:26:51.350 INFO:tasks.workunit.client.0.smithi001.stdout:8/741: truncate d9/d19/d29/d35/f8f 50753 0 2024-09-15T22:26:51.358 INFO:tasks.workunit.client.0.smithi001.stdout:0/632: write d0/f46 [1437952,31433] 0 2024-09-15T22:26:51.362 INFO:tasks.workunit.client.0.smithi001.stdout:6/791: dread d0/d6/d5d/dd8/fee [0,4194304] 0 2024-09-15T22:26:51.363 INFO:tasks.workunit.client.0.smithi001.stdout:0/633: write d0/f16 [4989544,94880] 0 2024-09-15T22:26:51.363 INFO:tasks.workunit.client.0.smithi001.stdout:0/634: dread - d0/d9/db/fa7 zero size 2024-09-15T22:26:51.363 INFO:tasks.workunit.client.0.smithi001.stdout:6/792: rmdir d0/d6/d5d/d67/d53 39 2024-09-15T22:26:51.366 INFO:tasks.workunit.client.0.smithi001.stdout:0/635: fsync d0/f16 0 2024-09-15T22:26:51.366 INFO:tasks.workunit.client.0.smithi001.stdout:0/636: fsync d0/dd/d33/f73 0 2024-09-15T22:26:51.366 INFO:tasks.workunit.client.0.smithi001.stdout:0/637: truncate d0/dd/f47 4423560 0 2024-09-15T22:26:51.367 INFO:tasks.workunit.client.0.smithi001.stdout:0/638: symlink d0/d6/lc2 0 2024-09-15T22:26:51.369 INFO:tasks.workunit.client.0.smithi001.stdout:0/639: mkdir d0/d9/db/d5d/d79/dc3 0 2024-09-15T22:26:51.369 INFO:tasks.workunit.client.0.smithi001.stdout:0/640: write d0/d9/db/f25 [853305,47956] 0 2024-09-15T22:26:51.370 INFO:tasks.workunit.client.0.smithi001.stdout:0/641: rmdir d0/d84 39 2024-09-15T22:26:51.370 INFO:tasks.workunit.client.0.smithi001.stdout:0/642: truncate d0/dd/d63/fac 428956 0 2024-09-15T22:26:51.371 INFO:tasks.workunit.client.0.smithi001.stdout:0/643: mknod d0/dd/d63/db6/cc4 0 2024-09-15T22:26:51.372 INFO:tasks.workunit.client.0.smithi001.stdout:6/793: dread d0/d7e/fa2 [0,4194304] 0 2024-09-15T22:26:51.373 INFO:tasks.workunit.client.0.smithi001.stdout:0/644: truncate d0/d9/f56 375045 0 2024-09-15T22:26:51.374 INFO:tasks.workunit.client.0.smithi001.stdout:0/645: fdatasync d0/d6/f30 0 2024-09-15T22:26:51.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:50 smithi001 ceph-mon[30843]: pgmap v415: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 149 MiB/s rd, 177 MiB/s wr, 1.13k op/s 2024-09-15T22:26:51.395 INFO:tasks.workunit.client.0.smithi001.stdout:9/671: dwrite d5/de/d1a/f8c [0,4194304] 0 2024-09-15T22:26:51.395 INFO:tasks.workunit.client.0.smithi001.stdout:9/672: write d5/de/d1a/d1b/d22/d2c/d21/d68/f76 [1010933,40809] 0 2024-09-15T22:26:51.395 INFO:tasks.workunit.client.0.smithi001.stdout:9/673: fsync d5/de/d1a/d1b/d22/f2f 0 2024-09-15T22:26:51.397 INFO:tasks.workunit.client.0.smithi001.stdout:1/777: dwrite d3/d12/d79/dce/d14/daa/ff6 [0,4194304] 0 2024-09-15T22:26:51.398 INFO:tasks.workunit.client.0.smithi001.stdout:0/646: dread d0/d9/d1a/d36/f41 [0,4194304] 0 2024-09-15T22:26:51.399 INFO:tasks.workunit.client.0.smithi001.stdout:9/674: rmdir d5/de/d1a/d1b/d22/d2c/d21/d4d 39 2024-09-15T22:26:51.400 INFO:tasks.workunit.client.0.smithi001.stdout:9/675: chown d5/de/d1a/d1b/d22/d2c/d21/d24/cc9 1 1 2024-09-15T22:26:51.400 INFO:tasks.workunit.client.0.smithi001.stdout:1/778: symlink d3/d12/d79/dce/d14/daa/ddd/df4/lf9 0 2024-09-15T22:26:51.400 INFO:tasks.workunit.client.0.smithi001.stdout:9/676: write d5/de/d1a/d1b/d22/d2c/f75 [1959161,122544] 0 2024-09-15T22:26:51.402 INFO:tasks.workunit.client.0.smithi001.stdout:9/677: creat d5/de/d15/fce x:0 0 0 2024-09-15T22:26:51.402 INFO:tasks.workunit.client.0.smithi001.stdout:9/678: chown d5/de/d1a/d1b/d22/d2c/dab 408037 1 2024-09-15T22:26:51.402 INFO:tasks.workunit.client.0.smithi001.stdout:2/768: sync 2024-09-15T22:26:51.402 INFO:tasks.workunit.client.0.smithi001.stdout:5/762: sync 2024-09-15T22:26:51.402 INFO:tasks.workunit.client.0.smithi001.stdout:4/893: sync 2024-09-15T22:26:51.402 INFO:tasks.workunit.client.0.smithi001.stdout:5/763: stat d3/d6/d57/d87/d8c 0 2024-09-15T22:26:51.403 INFO:tasks.workunit.client.0.smithi001.stdout:4/894: mknod d0/d27/d94/df9/d10d/c143 0 2024-09-15T22:26:51.403 INFO:tasks.workunit.client.0.smithi001.stdout:2/769: creat d2/d14/d1a/d1b/d82/dc9/ffe x:0 0 0 2024-09-15T22:26:51.404 INFO:tasks.workunit.client.0.smithi001.stdout:9/679: getdents d5/de/d15/d27/d63 0 2024-09-15T22:26:51.405 INFO:tasks.workunit.client.0.smithi001.stdout:4/895: mkdir d0/d27/d94/d102/d144 0 2024-09-15T22:26:51.406 INFO:tasks.workunit.client.0.smithi001.stdout:4/896: chown d0/d27/d94/df9/c133 112 1 2024-09-15T22:26:51.407 INFO:tasks.workunit.client.0.smithi001.stdout:4/897: mkdir d0/d5d/d7c/dba/d145 0 2024-09-15T22:26:51.407 INFO:tasks.workunit.client.0.smithi001.stdout:4/898: fsync d0/d5d/d7c/dba/d20/d29/d124/fbd 0 2024-09-15T22:26:51.407 INFO:tasks.workunit.client.0.smithi001.stdout:2/770: symlink d2/d14/d1a/d8a/lff 0 2024-09-15T22:26:51.407 INFO:tasks.workunit.client.0.smithi001.stdout:2/771: readlink d2/d14/l33 0 2024-09-15T22:26:51.409 INFO:tasks.workunit.client.0.smithi001.stdout:2/772: creat d2/d12/d62/f100 x:0 0 0 2024-09-15T22:26:51.412 INFO:tasks.workunit.client.0.smithi001.stdout:6/794: dwrite d0/d6/d5d/f9d [0,4194304] 0 2024-09-15T22:26:51.427 INFO:tasks.workunit.client.0.smithi001.stdout:6/795: dread d0/df/d24/d2e/d43/f59 [0,4194304] 0 2024-09-15T22:26:51.428 INFO:tasks.workunit.client.0.smithi001.stdout:6/796: rename d0/df/c2d to d0/d6/d5d/d8c/c113 0 2024-09-15T22:26:51.428 INFO:tasks.workunit.client.0.smithi001.stdout:6/797: fdatasync d0/d6/d5d/d67/d53/fa8 0 2024-09-15T22:26:51.429 INFO:tasks.workunit.client.0.smithi001.stdout:6/798: link d0/d6/d5d/d67/d53/fea d0/d6/d5d/da6/f114 0 2024-09-15T22:26:51.437 INFO:tasks.workunit.client.0.smithi001.stdout:4/899: write d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d73/fd0 [204569,4048] 0 2024-09-15T22:26:51.438 INFO:tasks.workunit.client.0.smithi001.stdout:4/900: mknod d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d73/c146 0 2024-09-15T22:26:51.440 INFO:tasks.workunit.client.0.smithi001.stdout:4/901: symlink d0/d5d/d7c/dba/d20/d29/d34/d84/d136/d13d/l147 0 2024-09-15T22:26:51.441 INFO:tasks.workunit.client.0.smithi001.stdout:9/680: write d5/de/d1a/d1b/f89 [397298,130343] 0 2024-09-15T22:26:51.447 INFO:tasks.workunit.client.0.smithi001.stdout:0/647: dwrite d0/d6/f30 [0,4194304] 0 2024-09-15T22:26:51.476 INFO:tasks.workunit.client.0.smithi001.stdout:6/799: dwrite d0/d6/f100 [0,4194304] 0 2024-09-15T22:26:51.478 INFO:tasks.workunit.client.0.smithi001.stdout:6/800: getdents d0/d6/d5d/d67/df0 0 2024-09-15T22:26:51.479 INFO:tasks.workunit.client.0.smithi001.stdout:6/801: rmdir d0/df/d24/d7b 39 2024-09-15T22:26:51.490 INFO:tasks.workunit.client.0.smithi001.stdout:6/802: dread d0/d7e/fa2 [0,4194304] 0 2024-09-15T22:26:51.492 INFO:tasks.workunit.client.0.smithi001.stdout:6/803: link d0/d6/fd d0/df/d24/d2e/d43/d30/dc2/de6/f115 0 2024-09-15T22:26:51.492 INFO:tasks.workunit.client.0.smithi001.stdout:6/804: fsync d0/df/d24/d2e/f86 0 2024-09-15T22:26:51.492 INFO:tasks.workunit.client.0.smithi001.stdout:6/805: dread - d0/df/d24/fad zero size 2024-09-15T22:26:51.492 INFO:tasks.workunit.client.0.smithi001.stdout:6/806: readlink d0/d6/lcb 0 2024-09-15T22:26:51.517 INFO:tasks.workunit.client.0.smithi001.stdout:5/764: dwrite d3/d1d/fc7 [0,4194304] 0 2024-09-15T22:26:51.517 INFO:tasks.workunit.client.0.smithi001.stdout:4/902: dread d0/d5d/d7c/dba/d20/d29/d124/d59/d67/dab/f8d [0,4194304] 0 2024-09-15T22:26:51.520 INFO:tasks.workunit.client.0.smithi001.stdout:5/765: link d3/d6/d41/d4d/dbe/de6/le4 d3/d6/d41/d4d/dbe/de6/l102 0 2024-09-15T22:26:51.522 INFO:tasks.workunit.client.0.smithi001.stdout:5/766: rmdir d3 39 2024-09-15T22:26:51.524 INFO:tasks.workunit.client.0.smithi001.stdout:1/779: dwrite d3/d12/d79/dce/d53/fe5 [0,4194304] 0 2024-09-15T22:26:51.524 INFO:tasks.workunit.client.0.smithi001.stdout:5/767: write d3/d6/d41/fe3 [448532,20763] 0 2024-09-15T22:26:51.524 INFO:tasks.workunit.client.0.smithi001.stdout:5/768: chown d3/d6/d41/d88 3 1 2024-09-15T22:26:51.524 INFO:tasks.workunit.client.0.smithi001.stdout:5/769: chown d3/d6/d57/d87/d8c 0 1 2024-09-15T22:26:51.528 INFO:tasks.workunit.client.0.smithi001.stdout:1/780: link d3/d12/d79/dce/ce3 d3/d12/cfa 0 2024-09-15T22:26:51.529 INFO:tasks.workunit.client.0.smithi001.stdout:5/770: rmdir d3/d27/d4e 39 2024-09-15T22:26:51.538 INFO:tasks.workunit.client.0.smithi001.stdout:2/773: dwrite d2/d12/f1c [0,4194304] 0 2024-09-15T22:26:51.539 INFO:tasks.workunit.client.0.smithi001.stdout:2/774: readlink d2/lbf 0 2024-09-15T22:26:51.561 INFO:tasks.workunit.client.0.smithi001.stdout:5/771: dread d3/d6/d57/f7c [0,4194304] 0 2024-09-15T22:26:51.571 INFO:tasks.workunit.client.0.smithi001.stdout:5/772: dread d3/d6/d41/fb9 [0,4194304] 0 2024-09-15T22:26:51.571 INFO:tasks.workunit.client.0.smithi001.stdout:5/773: fsync d3/d6/d41/d4d/fcb 0 2024-09-15T22:26:51.571 INFO:tasks.workunit.client.0.smithi001.stdout:5/774: readlink d3/l3d 0 2024-09-15T22:26:51.572 INFO:tasks.workunit.client.0.smithi001.stdout:5/775: write d3/d6/d41/f82 [1775484,79039] 0 2024-09-15T22:26:51.574 INFO:tasks.workunit.client.0.smithi001.stdout:5/776: mkdir d3/d6/d41/d4d/dbe/d56/ddc/de9/df6/d103 0 2024-09-15T22:26:51.574 INFO:tasks.workunit.client.0.smithi001.stdout:5/777: write d3/d6/d41/d4d/dbe/d56/ddc/de9/df6/fc3 [2222621,47378] 0 2024-09-15T22:26:51.583 INFO:tasks.workunit.client.0.smithi001.stdout:4/903: dwrite d0/f48 [0,4194304] 0 2024-09-15T22:26:51.595 INFO:tasks.workunit.client.0.smithi001.stdout:1/781: dwrite d3/d12/d79/dce/d3c/d64/f7e [0,4194304] 0 2024-09-15T22:26:51.598 INFO:tasks.workunit.client.0.smithi001.stdout:0/648: dwrite d0/d6/d77/d78/f8b [0,4194304] 0 2024-09-15T22:26:51.600 INFO:tasks.workunit.client.0.smithi001.stdout:9/681: dwrite d5/de/d1a/d1b/d22/fcd [0,4194304] 0 2024-09-15T22:26:51.615 INFO:tasks.workunit.client.0.smithi001.stdout:0/649: unlink d0/d9/db/f83 0 2024-09-15T22:26:51.615 INFO:tasks.workunit.client.0.smithi001.stdout:0/650: chown d0/d9/db/f19 820277 1 2024-09-15T22:26:51.618 INFO:tasks.workunit.client.0.smithi001.stdout:9/682: rename d5/de/d1a/da8/daf/cc8 to d5/de/d1a/d1b/d22/d2c/d21/d23/d3d/ccf 0 2024-09-15T22:26:51.618 INFO:tasks.workunit.client.0.smithi001.stdout:9/683: stat d5/de/d1a/d1b/d22/d2c/d21/d24/f69 0 2024-09-15T22:26:51.619 INFO:tasks.workunit.client.0.smithi001.stdout:0/651: rmdir d0/dd/d63/db6 39 2024-09-15T22:26:51.621 INFO:tasks.workunit.client.0.smithi001.stdout:0/652: mkdir d0/d9/db/dc5 0 2024-09-15T22:26:51.621 INFO:tasks.workunit.client.0.smithi001.stdout:0/653: stat d0/d9/d1a/fa8 0 2024-09-15T22:26:51.621 INFO:tasks.workunit.client.0.smithi001.stdout:0/654: write d0/d6/f2a [88137,39617] 0 2024-09-15T22:26:51.622 INFO:tasks.workunit.client.0.smithi001.stdout:0/655: mknod d0/dd/cc6 0 2024-09-15T22:26:51.624 INFO:tasks.workunit.client.0.smithi001.stdout:0/656: mknod d0/cc7 0 2024-09-15T22:26:51.624 INFO:tasks.workunit.client.0.smithi001.stdout:0/657: write d0/d9/db/d5d/d6d/fb4 [1014970,83138] 0 2024-09-15T22:26:51.625 INFO:tasks.workunit.client.0.smithi001.stdout:0/658: symlink d0/d6/d77/lc8 0 2024-09-15T22:26:51.629 INFO:tasks.workunit.client.0.smithi001.stdout:4/904: dwrite d0/d5d/d7c/dba/d20/d29/d40/dc8/fcb [0,4194304] 0 2024-09-15T22:26:51.642 INFO:tasks.workunit.client.0.smithi001.stdout:6/807: dwrite d0/d6/f71 [0,4194304] 0 2024-09-15T22:26:51.644 INFO:tasks.workunit.client.0.smithi001.stdout:6/808: symlink d0/l116 0 2024-09-15T22:26:51.645 INFO:tasks.workunit.client.0.smithi001.stdout:6/809: symlink d0/d6/d5d/da6/l117 0 2024-09-15T22:26:51.657 INFO:tasks.workunit.client.0.smithi001.stdout:5/778: dread d3/d6/d57/d87/d8c/fe7 [0,4194304] 0 2024-09-15T22:26:51.665 INFO:tasks.workunit.client.0.smithi001.stdout:2/775: dwrite d2/d12/d62/d64/f19 [4194304,4194304] 0 2024-09-15T22:26:51.665 INFO:tasks.workunit.client.0.smithi001.stdout:2/776: chown d2/fea 11 1 2024-09-15T22:26:51.667 INFO:tasks.workunit.client.0.smithi001.stdout:2/777: creat d2/d12/d62/d4c/f101 x:0 0 0 2024-09-15T22:26:51.667 INFO:tasks.workunit.client.0.smithi001.stdout:2/778: stat d2/d14/d1a/d1b/d82/d97 0 2024-09-15T22:26:51.667 INFO:tasks.workunit.client.0.smithi001.stdout:5/779: mknod d3/d6/d41/d4d/dbe/d56/ddc/de9/df6/da4/c104 0 2024-09-15T22:26:51.667 INFO:tasks.workunit.client.0.smithi001.stdout:6/810: write d0/df/d24/d2e/d43/f93 [1789787,79124] 0 2024-09-15T22:26:51.667 INFO:tasks.workunit.client.0.smithi001.stdout:2/779: fdatasync d2/d14/d1a/d1b/d82/dc9/fc3 0 2024-09-15T22:26:51.668 INFO:tasks.workunit.client.0.smithi001.stdout:1/782: dwrite d3/d12/d79/dce/d3c/d4c/f5c [0,4194304] 0 2024-09-15T22:26:51.668 INFO:tasks.workunit.client.0.smithi001.stdout:2/780: mkdir d2/d12/dec/d102 0 2024-09-15T22:26:51.669 INFO:tasks.workunit.client.0.smithi001.stdout:6/811: truncate d0/df/d24/f84 275806 0 2024-09-15T22:26:51.670 INFO:tasks.workunit.client.0.smithi001.stdout:1/783: creat d3/d12/d79/dce/d14/d23/da1/dc6/ffb x:0 0 0 2024-09-15T22:26:51.671 INFO:tasks.workunit.client.0.smithi001.stdout:2/781: creat d2/d14/d1a/d1b/d82/dc9/d6f/d70/f103 x:0 0 0 2024-09-15T22:26:51.671 INFO:tasks.workunit.client.0.smithi001.stdout:6/812: truncate d0/df/d24/d2e/d43/f78 4732575 0 2024-09-15T22:26:51.675 INFO:tasks.workunit.client.0.smithi001.stdout:6/813: symlink d0/df/d24/d2e/d43/d30/da7/l118 0 2024-09-15T22:26:51.675 INFO:tasks.workunit.client.0.smithi001.stdout:6/814: write d0/df/d24/d49/dc7/f103 [891107,11903] 0 2024-09-15T22:26:51.675 INFO:tasks.workunit.client.0.smithi001.stdout:6/815: rename d0/df/d24 to d0/df/d24/d49/dc7/def/d119 22 2024-09-15T22:26:51.677 INFO:tasks.workunit.client.0.smithi001.stdout:6/816: symlink d0/d6/d5d/d67/d53/da0/l11a 0 2024-09-15T22:26:51.679 INFO:tasks.workunit.client.0.smithi001.stdout:6/817: unlink d0/d6/d5d/d67/d53/fa4 0 2024-09-15T22:26:51.679 INFO:tasks.workunit.client.0.smithi001.stdout:6/818: write d0/d6/fde [854170,23051] 0 2024-09-15T22:26:51.680 INFO:tasks.workunit.client.0.smithi001.stdout:6/819: chown d0/df/d24/c82 97267 1 2024-09-15T22:26:51.680 INFO:tasks.workunit.client.0.smithi001.stdout:9/684: dwrite d5/de/d1a/d1b/d22/f4a [0,4194304] 0 2024-09-15T22:26:51.680 INFO:tasks.workunit.client.0.smithi001.stdout:9/685: fdatasync d5/d90/fbb 0 2024-09-15T22:26:51.681 INFO:tasks.workunit.client.0.smithi001.stdout:9/686: truncate d5/de/f18 8640950 0 2024-09-15T22:26:51.681 INFO:tasks.workunit.client.0.smithi001.stdout:9/687: dread - d5/d90/fbb zero size 2024-09-15T22:26:51.681 INFO:tasks.workunit.client.0.smithi001.stdout:8/742: sync 2024-09-15T22:26:51.681 INFO:tasks.workunit.client.0.smithi001.stdout:8/743: stat d9/d19/d58/d8e/dc7 0 2024-09-15T22:26:51.681 INFO:tasks.workunit.client.0.smithi001.stdout:3/815: sync 2024-09-15T22:26:51.682 INFO:tasks.workunit.client.0.smithi001.stdout:6/820: creat d0/df/d24/d49/dc7/def/f11b x:0 0 0 2024-09-15T22:26:51.682 INFO:tasks.workunit.client.0.smithi001.stdout:3/816: read da/d3b/f25 [2686106,55684] 0 2024-09-15T22:26:51.682 INFO:tasks.workunit.client.0.smithi001.stdout:9/688: getdents d5/de/d15 0 2024-09-15T22:26:51.682 INFO:tasks.workunit.client.0.smithi001.stdout:9/689: read - d5/d3e/fb0 zero size 2024-09-15T22:26:51.682 INFO:tasks.workunit.client.0.smithi001.stdout:8/744: symlink d9/d19/d29/d33/d63/ld7 0 2024-09-15T22:26:51.683 INFO:tasks.workunit.client.0.smithi001.stdout:8/745: dread - d9/d19/d29/d50/d70/fb2 zero size 2024-09-15T22:26:51.683 INFO:tasks.workunit.client.0.smithi001.stdout:3/817: symlink da/d3d/d43/d41/dff/l11a 0 2024-09-15T22:26:51.686 INFO:tasks.workunit.client.0.smithi001.stdout:7/770: sync 2024-09-15T22:26:51.686 INFO:tasks.workunit.client.0.smithi001.stdout:7/771: write d0/d7/d21/d6b/fed [885897,62042] 0 2024-09-15T22:26:51.686 INFO:tasks.workunit.client.0.smithi001.stdout:7/772: fsync d0/d7/d2e/f63 0 2024-09-15T22:26:51.686 INFO:tasks.workunit.client.0.smithi001.stdout:7/773: stat d0/d98/lde 0 2024-09-15T22:26:51.686 INFO:tasks.workunit.client.0.smithi001.stdout:9/690: symlink d5/d3e/ld0 0 2024-09-15T22:26:51.687 INFO:tasks.workunit.client.0.smithi001.stdout:9/691: write d5/de/d1a/d1b/d22/d2c/d21/d24/fbf [70780,55962] 0 2024-09-15T22:26:51.687 INFO:tasks.workunit.client.0.smithi001.stdout:9/692: truncate d5/de/d15/d27/d63/db6/fbd 3153221 0 2024-09-15T22:26:51.687 INFO:tasks.workunit.client.0.smithi001.stdout:9/693: chown d5/de/d1a/d1b/d22/d2c/cd 627 1 2024-09-15T22:26:51.687 INFO:tasks.workunit.client.0.smithi001.stdout:1/784: dread d3/d12/d79/dce/d14/f44 [0,4194304] 0 2024-09-15T22:26:51.687 INFO:tasks.workunit.client.0.smithi001.stdout:7/774: write d0/d7/d44/d3f/d49/fc1 [154014,15094] 0 2024-09-15T22:26:51.690 INFO:tasks.workunit.client.0.smithi001.stdout:8/746: rename d9/d19/d34/d41/ca1 to d9/d19/d40/d9e/dd0/cd8 0 2024-09-15T22:26:51.690 INFO:tasks.workunit.client.0.smithi001.stdout:8/747: chown d9/c8c 3245 1 2024-09-15T22:26:51.690 INFO:tasks.workunit.client.0.smithi001.stdout:3/818: symlink da/d3d/d43/d7c/d3f/l11b 0 2024-09-15T22:26:51.691 INFO:tasks.workunit.client.0.smithi001.stdout:0/659: dwrite d0/d51/fbb [0,4194304] 0 2024-09-15T22:26:51.692 INFO:tasks.workunit.client.0.smithi001.stdout:6/821: dread d0/d6/d5d/f75 [0,4194304] 0 2024-09-15T22:26:51.699 INFO:tasks.workunit.client.0.smithi001.stdout:4/905: dwrite d0/d5d/d7c/dba/d20/d29/d34/f62 [0,4194304] 0 2024-09-15T22:26:51.700 INFO:tasks.workunit.client.0.smithi001.stdout:0/660: dread d0/dd/d63/fac [0,4194304] 0 2024-09-15T22:26:51.700 INFO:tasks.workunit.client.0.smithi001.stdout:9/694: creat d5/de/d15/d27/dcb/fd1 x:0 0 0 2024-09-15T22:26:51.700 INFO:tasks.workunit.client.0.smithi001.stdout:7/775: rmdir d0/d7/d2e/d60/dbd 39 2024-09-15T22:26:51.701 INFO:tasks.workunit.client.0.smithi001.stdout:8/748: unlink d9/d19/d34/d41/d99/fc0 0 2024-09-15T22:26:51.702 INFO:tasks.workunit.client.0.smithi001.stdout:4/906: mkdir d0/d5d/d148 0 2024-09-15T22:26:51.702 INFO:tasks.workunit.client.0.smithi001.stdout:4/907: getdents d0/d5d/d7c/dba/d20/d29/d40/dc8 0 2024-09-15T22:26:51.703 INFO:tasks.workunit.client.0.smithi001.stdout:2/782: dread d2/d14/d1a/d1b/d82/d97/d74/fe6 [0,4194304] 0 2024-09-15T22:26:51.704 INFO:tasks.workunit.client.0.smithi001.stdout:6/822: creat d0/df/d24/d7b/db2/f11c x:0 0 0 2024-09-15T22:26:51.704 INFO:tasks.workunit.client.0.smithi001.stdout:0/661: symlink d0/d84/lc9 0 2024-09-15T22:26:51.704 INFO:tasks.workunit.client.0.smithi001.stdout:9/695: rename d5/de/d1a/d38/f9a to d5/de/d1a/d1b/d22/d2c/d21/d23/fd2 0 2024-09-15T22:26:51.704 INFO:tasks.workunit.client.0.smithi001.stdout:4/908: link d0/d27/ffb d0/d27/f149 0 2024-09-15T22:26:51.705 INFO:tasks.workunit.client.0.smithi001.stdout:4/909: mknod d0/d5d/d7c/dba/d20/d29/d34/d84/d136/c14a 0 2024-09-15T22:26:51.705 INFO:tasks.workunit.client.0.smithi001.stdout:4/910: write d0/d5d/d7c/dba/d20/d29/d124/d59/d67/d7b/f87 [2340884,9369] 0 2024-09-15T22:26:51.706 INFO:tasks.workunit.client.0.smithi001.stdout:4/911: chown d0/d5d/d7c/dba/d20/d29/d40/f5a 1236 1 2024-09-15T22:26:51.707 INFO:tasks.workunit.client.0.smithi001.stdout:9/696: link d5/de/d1a/d1b/d22/d2c/d21/la6 d5/de/d1a/d1b/d22/d2c/d21/d4d/ld3 0 2024-09-15T22:26:51.708 INFO:tasks.workunit.client.0.smithi001.stdout:9/697: chown d5/de/d1a/d1b/d22/d2c/d21/d24 5237484 1 2024-09-15T22:26:51.708 INFO:tasks.workunit.client.0.smithi001.stdout:2/783: mknod d2/d12/d62/d64/d76/c104 0 2024-09-15T22:26:51.708 INFO:tasks.workunit.client.0.smithi001.stdout:2/784: chown d2/d14/d1a/c54 381621 1 2024-09-15T22:26:51.708 INFO:tasks.workunit.client.0.smithi001.stdout:0/662: creat d0/dd/d63/fca x:0 0 0 2024-09-15T22:26:51.709 INFO:tasks.workunit.client.0.smithi001.stdout:0/663: chown d0/d9/db/f6b 1 1 2024-09-15T22:26:51.713 INFO:tasks.workunit.client.0.smithi001.stdout:0/664: creat d0/d9/db/d5d/d6d/fcb x:0 0 0 2024-09-15T22:26:51.713 INFO:tasks.workunit.client.0.smithi001.stdout:0/665: chown d0/d9/f2c 25246 1 2024-09-15T22:26:51.713 INFO:tasks.workunit.client.0.smithi001.stdout:9/698: rmdir d5/de/d1a 39 2024-09-15T22:26:51.714 INFO:tasks.workunit.client.0.smithi001.stdout:9/699: truncate d5/de/d1a/d1b/f89 382352 0 2024-09-15T22:26:51.714 INFO:tasks.workunit.client.0.smithi001.stdout:9/700: truncate d5/d3e/fb0 569442 0 2024-09-15T22:26:51.716 INFO:tasks.workunit.client.0.smithi001.stdout:9/701: truncate d5/de/d15/f74 155339 0 2024-09-15T22:26:51.716 INFO:tasks.workunit.client.0.smithi001.stdout:9/702: write d5/de/d1a/d1b/d22/d2c/d21/d23/fac [900816,101686] 0 2024-09-15T22:26:51.727 INFO:tasks.workunit.client.0.smithi001.stdout:9/703: dread d5/de/d1a/d1b/d22/d2c/d21/d4d/f4e [0,4194304] 0 2024-09-15T22:26:51.727 INFO:tasks.workunit.client.0.smithi001.stdout:6/823: write d0/df/fff [2382010,53372] 0 2024-09-15T22:26:51.731 INFO:tasks.workunit.client.0.smithi001.stdout:6/824: symlink d0/d6/d5d/d67/d53/da0/deb/l11d 0 2024-09-15T22:26:51.759 INFO:tasks.workunit.client.0.smithi001.stdout:0/666: dread d0/d9/f32 [0,4194304] 0 2024-09-15T22:26:51.759 INFO:tasks.workunit.client.0.smithi001.stdout:6/825: dread d0/d6/f100 [0,4194304] 0 2024-09-15T22:26:51.759 INFO:tasks.workunit.client.0.smithi001.stdout:6/826: truncate d0/f9 1334411 0 2024-09-15T22:26:51.764 INFO:tasks.workunit.client.0.smithi001.stdout:8/749: dwrite d9/d19/d34/d41/f4b [0,4194304] 0 2024-09-15T22:26:51.764 INFO:tasks.workunit.client.0.smithi001.stdout:8/750: stat d9/d19/d29 0 2024-09-15T22:26:51.764 INFO:tasks.workunit.client.0.smithi001.stdout:3/819: dwrite da/d3d/d43/d7c/d3f/db5/df9/f112 [0,4194304] 0 2024-09-15T22:26:51.764 INFO:tasks.workunit.client.0.smithi001.stdout:1/785: dwrite d3/d12/d79/dce/d3c/d7d/f88 [0,4194304] 0 2024-09-15T22:26:51.775 INFO:tasks.workunit.client.0.smithi001.stdout:4/912: dwrite d0/d5d/d7c/dba/d20/f26 [0,4194304] 0 2024-09-15T22:26:51.777 INFO:tasks.workunit.client.0.smithi001.stdout:5/780: dwrite d3/d6/d41/fb9 [0,4194304] 0 2024-09-15T22:26:51.787 INFO:tasks.workunit.client.0.smithi001.stdout:2/785: dwrite d2/d14/d1a/d1b/d82/dc9/ff5 [4194304,4194304] 0 2024-09-15T22:26:51.787 INFO:tasks.workunit.client.0.smithi001.stdout:2/786: dread - d2/d14/d1a/d1b/d82/fda zero size 2024-09-15T22:26:51.789 INFO:tasks.workunit.client.0.smithi001.stdout:9/704: fsync d5/de/d1a/d1b/d22/d2c/d21/d24/fbf 0 2024-09-15T22:26:51.790 INFO:tasks.workunit.client.0.smithi001.stdout:4/913: creat d0/d5d/d7c/dba/d20/d29/d34/d84/d95/dd3/f14b x:0 0 0 2024-09-15T22:26:51.795 INFO:tasks.workunit.client.0.smithi001.stdout:4/914: symlink d0/l14c 0 2024-09-15T22:26:51.795 INFO:tasks.workunit.client.0.smithi001.stdout:8/751: read d9/d19/f32 [633991,34130] 0 2024-09-15T22:26:51.795 INFO:tasks.workunit.client.0.smithi001.stdout:4/915: chown d0/d5d/d7c/dba/d20/d29/d34/f39 2368749 1 2024-09-15T22:26:51.799 INFO:tasks.workunit.client.0.smithi001.stdout:9/705: creat d5/fd4 x:0 0 0 2024-09-15T22:26:51.800 INFO:tasks.workunit.client.0.smithi001.stdout:8/752: truncate d9/d19/d58/d8e/fb1 3475753 0 2024-09-15T22:26:51.803 INFO:tasks.workunit.client.0.smithi001.stdout:9/706: rename d5/de/d1a/d1b/d22/d2c/d21/d4d/ld3 to d5/de/d15/ld5 0 2024-09-15T22:26:51.805 INFO:tasks.workunit.client.0.smithi001.stdout:8/753: mkdir d9/d19/d29/d33/d63/dcb/dd9 0 2024-09-15T22:26:51.807 INFO:tasks.workunit.client.0.smithi001.stdout:1/786: dwrite d3/f11 [0,4194304] 0 2024-09-15T22:26:51.808 INFO:tasks.workunit.client.0.smithi001.stdout:1/787: readlink d3/d8d/d91/df5/d68/l71 0 2024-09-15T22:26:51.810 INFO:tasks.workunit.client.0.smithi001.stdout:9/707: creat d5/de/d1a/fd6 x:0 0 0 2024-09-15T22:26:51.814 INFO:tasks.workunit.client.0.smithi001.stdout:4/916: dread d0/d5d/d7c/dba/d20/d29/d34/f41 [0,4194304] 0 2024-09-15T22:26:51.815 INFO:tasks.workunit.client.0.smithi001.stdout:4/917: rename d0/d5d/d44/d65/c111 to d0/d5d/d44/c14d 0 2024-09-15T22:26:51.816 INFO:tasks.workunit.client.0.smithi001.stdout:4/918: mknod d0/d5d/d7c/dba/d20/d29/d40/dc8/c14e 0 2024-09-15T22:26:51.817 INFO:tasks.workunit.client.0.smithi001.stdout:4/919: creat d0/d5d/d7c/dba/d20/d29/d124/d59/d67/dab/f14f x:0 0 0 2024-09-15T22:26:51.822 INFO:tasks.workunit.client.0.smithi001.stdout:3/820: dwrite da/d3d/d43/d7c/f55 [0,4194304] 0 2024-09-15T22:26:51.823 INFO:tasks.workunit.client.0.smithi001.stdout:3/821: mkdir da/d90/d6f/d102/d11c 0 2024-09-15T22:26:51.824 INFO:tasks.workunit.client.0.smithi001.stdout:3/822: creat da/d3d/d43/f11d x:0 0 0 2024-09-15T22:26:51.825 INFO:tasks.workunit.client.0.smithi001.stdout:3/823: creat da/d90/d92/f11e x:0 0 0 2024-09-15T22:26:51.825 INFO:tasks.workunit.client.0.smithi001.stdout:3/824: chown da/d3d/d43/d7c/f5f 1846071828 1 2024-09-15T22:26:51.826 INFO:tasks.workunit.client.0.smithi001.stdout:4/920: creat d0/d27/d94/df1/f150 x:0 0 0 2024-09-15T22:26:51.826 INFO:tasks.workunit.client.0.smithi001.stdout:4/921: chown d0/d5d/d7c/l12d 240 1 2024-09-15T22:26:51.826 INFO:tasks.workunit.client.0.smithi001.stdout:3/825: creat da/d3d/d43/d7c/d53/d72/f11f x:0 0 0 2024-09-15T22:26:51.827 INFO:tasks.workunit.client.0.smithi001.stdout:3/826: creat da/d90/d6f/f120 x:0 0 0 2024-09-15T22:26:51.829 INFO:tasks.workunit.client.0.smithi001.stdout:3/827: rename da/d3d/d43/lcb to da/d3d/d43/d41/l121 0 2024-09-15T22:26:51.830 INFO:tasks.workunit.client.0.smithi001.stdout:4/922: rmdir d0/d5d/d44/df7 0 2024-09-15T22:26:51.831 INFO:tasks.workunit.client.0.smithi001.stdout:4/923: mkdir d0/d27/d94/d151 0 2024-09-15T22:26:51.832 INFO:tasks.workunit.client.0.smithi001.stdout:4/924: rename d0/d27/l37 to d0/d27/d94/d151/l152 0 2024-09-15T22:26:51.833 INFO:tasks.workunit.client.0.smithi001.stdout:4/925: mknod d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d11b/c153 0 2024-09-15T22:26:51.834 INFO:tasks.workunit.client.0.smithi001.stdout:4/926: write d0/d5d/d7c/dba/f22 [2094829,109442] 0 2024-09-15T22:26:51.834 INFO:tasks.workunit.client.0.smithi001.stdout:4/927: readlink d0/d5d/d44/d65/led 0 2024-09-15T22:26:51.834 INFO:tasks.workunit.client.0.smithi001.stdout:4/928: symlink d0/d5d/d7c/dd1/l154 0 2024-09-15T22:26:51.838 INFO:tasks.workunit.client.0.smithi001.stdout:9/708: dread d5/de/d1a/d1b/d22/d2c/d21/d23/d3d/fb5 [0,4194304] 0 2024-09-15T22:26:51.841 INFO:tasks.workunit.client.0.smithi001.stdout:5/781: dwrite d3/d6/d41/d4d/dbe/d56/d52/d61/dee/ff5 [0,4194304] 0 2024-09-15T22:26:51.842 INFO:tasks.workunit.client.0.smithi001.stdout:3/828: write da/d16/f4b [1582162,121175] 0 2024-09-15T22:26:51.842 INFO:tasks.workunit.client.0.smithi001.stdout:3/829: fdatasync da/d3b/d8b/dee/f28 0 2024-09-15T22:26:51.844 INFO:tasks.workunit.client.0.smithi001.stdout:3/830: symlink da/d3d/d43/d7c/d3f/db5/df9/l122 0 2024-09-15T22:26:51.844 INFO:tasks.workunit.client.0.smithi001.stdout:3/831: stat da/d3b/d8b/dbe/f10c 0 2024-09-15T22:26:51.844 INFO:tasks.workunit.client.0.smithi001.stdout:3/832: readlink da/d3d/d43/d7c/d3f/db5/dd1/l111 0 2024-09-15T22:26:51.845 INFO:tasks.workunit.client.0.smithi001.stdout:3/833: symlink da/d3d/d43/d7c/d53/d73/l123 0 2024-09-15T22:26:51.845 INFO:tasks.workunit.client.0.smithi001.stdout:3/834: chown da/d3d/d43/f5a 8 1 2024-09-15T22:26:51.845 INFO:tasks.workunit.client.0.smithi001.stdout:4/929: getdents d0/d27/d94/d151 0 2024-09-15T22:26:51.846 INFO:tasks.workunit.client.0.smithi001.stdout:4/930: chown d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d73/dc0/fe6 43839 1 2024-09-15T22:26:51.846 INFO:tasks.workunit.client.0.smithi001.stdout:4/931: chown d0/d5d/d7c/dba/d20/d29/d124/d74 2095313933 1 2024-09-15T22:26:51.849 INFO:tasks.workunit.client.0.smithi001.stdout:4/932: rename d0/d5d/d7c/dd1/d104/c132 to d0/d5d/d7c/dba/d20/d29/d124/d74/c155 0 2024-09-15T22:26:51.850 INFO:tasks.workunit.client.0.smithi001.stdout:3/835: rmdir da/d3d 39 2024-09-15T22:26:51.851 INFO:tasks.workunit.client.0.smithi001.stdout:4/933: link d0/d5d/d7c/dba/d20/d29/d34/db2/cdc d0/d5d/d7c/dba/d20/d29/d124/d59/d67/dab/c156 0 2024-09-15T22:26:51.851 INFO:tasks.workunit.client.0.smithi001.stdout:4/934: truncate d0/d5d/d7c/dba/d20/d29/d124/d74/f134 164970 0 2024-09-15T22:26:51.852 INFO:tasks.workunit.client.0.smithi001.stdout:4/935: mkdir d0/d5d/d7c/dba/d20/d29/d34/d84/d95/dd3/d129/d157 0 2024-09-15T22:26:51.853 INFO:tasks.workunit.client.0.smithi001.stdout:4/936: mknod d0/d5d/d7c/dba/d20/d29/d124/da4/de1/c158 0 2024-09-15T22:26:51.854 INFO:tasks.workunit.client.0.smithi001.stdout:1/788: dwrite d3/d12/d79/dce/d3c/d64/fbb [0,4194304] 0 2024-09-15T22:26:51.854 INFO:tasks.workunit.client.0.smithi001.stdout:1/789: readlink d3/d12/d79/dce/d14/d1b/ldc 0 2024-09-15T22:26:51.854 INFO:tasks.workunit.client.0.smithi001.stdout:4/937: creat d0/d5d/d7c/dba/d20/d29/d34/d84/d95/dd3/d129/f159 x:0 0 0 2024-09-15T22:26:51.855 INFO:tasks.workunit.client.0.smithi001.stdout:1/790: rename d3/d12/d79/dce/d53/c95 to d3/d12/d21/d82/cfc 0 2024-09-15T22:26:51.856 INFO:tasks.workunit.client.0.smithi001.stdout:4/938: mknod d0/d5d/d7c/dba/d20/d29/d34/d84/c15a 0 2024-09-15T22:26:51.857 INFO:tasks.workunit.client.0.smithi001.stdout:4/939: symlink d0/d5d/d7c/dba/d20/d29/d124/da4/de1/l15b 0 2024-09-15T22:26:51.869 INFO:tasks.workunit.client.0.smithi001.stdout:4/940: dread d0/d5d/d7c/dba/d20/d29/d124/d74/f134 [0,4194304] 0 2024-09-15T22:26:51.870 INFO:tasks.workunit.client.0.smithi001.stdout:4/941: fdatasync d0/fea 0 2024-09-15T22:26:51.870 INFO:tasks.workunit.client.0.smithi001.stdout:4/942: chown d0/d5d/d7c/dba/d20/d29/d124/d59/d67/dab/d138 0 1 2024-09-15T22:26:51.871 INFO:tasks.workunit.client.0.smithi001.stdout:4/943: mknod d0/d5d/d7c/dba/d20/c15c 0 2024-09-15T22:26:51.871 INFO:tasks.workunit.client.0.smithi001.stdout:4/944: readlink d0/d5d/d44/d65/d6a/l8b 0 2024-09-15T22:26:51.873 INFO:tasks.workunit.client.0.smithi001.stdout:4/945: write d0/d5d/d7c/dba/d20/d29/d34/dbc/dbf/ff5 [711730,6320] 0 2024-09-15T22:26:51.874 INFO:tasks.workunit.client.0.smithi001.stdout:4/946: creat d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d11b/f15d x:0 0 0 2024-09-15T22:26:51.875 INFO:tasks.workunit.client.0.smithi001.stdout:4/947: creat d0/d27/d94/d102/f15e x:0 0 0 2024-09-15T22:26:51.876 INFO:tasks.workunit.client.0.smithi001.stdout:4/948: rmdir d0/d5d/d7c/dd1 39 2024-09-15T22:26:51.876 INFO:tasks.workunit.client.0.smithi001.stdout:4/949: readlink d0/d5d/lb8 0 2024-09-15T22:26:51.877 INFO:tasks.workunit.client.0.smithi001.stdout:4/950: mkdir d0/d5d/d7c/dba/d20/d29/d34/d15f 0 2024-09-15T22:26:51.879 INFO:tasks.workunit.client.0.smithi001.stdout:4/951: creat d0/d5d/d7c/dba/d20/d29/d34/db2/f160 x:0 0 0 2024-09-15T22:26:51.891 INFO:tasks.workunit.client.0.smithi001.stdout:9/709: dwrite d5/de/d1a/d1b/d22/f2f [4194304,4194304] 0 2024-09-15T22:26:51.893 INFO:tasks.workunit.client.0.smithi001.stdout:5/782: dwrite d3/f33 [0,4194304] 0 2024-09-15T22:26:51.895 INFO:tasks.workunit.client.0.smithi001.stdout:5/783: creat d3/d6/d41/d4d/dbe/d56/ddc/de9/df6/da4/f105 x:0 0 0 2024-09-15T22:26:51.896 INFO:tasks.workunit.client.0.smithi001.stdout:4/952: write d0/d5d/d7c/dba/d20/d29/d40/dc8/fcb [3585191,121960] 0 2024-09-15T22:26:51.896 INFO:tasks.workunit.client.0.smithi001.stdout:4/953: chown d0/d5d/d7c/dba/d20/d29/d124/d74/f13c 26607 1 2024-09-15T22:26:51.896 INFO:tasks.workunit.client.0.smithi001.stdout:4/954: chown d0/d5d/d7c/dba/f19 24 1 2024-09-15T22:26:51.897 INFO:tasks.workunit.client.0.smithi001.stdout:5/784: write d3/d6/d41/d4d/dbe/d56/ddc/de9/df6/fc3 [1181191,27248] 0 2024-09-15T22:26:51.898 INFO:tasks.workunit.client.0.smithi001.stdout:4/955: rename d0/d27/l31 to d0/d5d/d7c/dba/d20/d29/d40/dc8/l161 0 2024-09-15T22:26:51.904 INFO:tasks.workunit.client.0.smithi001.stdout:0/667: sync 2024-09-15T22:26:51.907 INFO:tasks.workunit.client.0.smithi001.stdout:5/785: rename d3/fc to d3/d6/d57/d87/f106 0 2024-09-15T22:26:51.907 INFO:tasks.workunit.client.0.smithi001.stdout:2/787: sync 2024-09-15T22:26:51.907 INFO:tasks.workunit.client.0.smithi001.stdout:7/776: sync 2024-09-15T22:26:51.907 INFO:tasks.workunit.client.0.smithi001.stdout:6/827: sync 2024-09-15T22:26:51.907 INFO:tasks.workunit.client.0.smithi001.stdout:7/777: stat d0/d7/d21/d6b/fa8 0 2024-09-15T22:26:51.908 INFO:tasks.workunit.client.0.smithi001.stdout:6/828: read d0/d6/f29 [2539760,45015] 0 2024-09-15T22:26:51.908 INFO:tasks.workunit.client.0.smithi001.stdout:6/829: readlink d0/df/l28 0 2024-09-15T22:26:51.908 INFO:tasks.workunit.client.0.smithi001.stdout:6/830: chown d0/df/fff 7 1 2024-09-15T22:26:51.908 INFO:tasks.workunit.client.0.smithi001.stdout:2/788: mknod d2/d12/dec/c105 0 2024-09-15T22:26:51.908 INFO:tasks.workunit.client.0.smithi001.stdout:2/789: unlink d2/d12/d62/d64/d76/c104 0 2024-09-15T22:26:51.918 INFO:tasks.workunit.client.0.smithi001.stdout:7/778: write d0/d8e/f37 [7600716,22245] 0 2024-09-15T22:26:51.925 INFO:tasks.workunit.client.0.smithi001.stdout:2/790: write d2/d12/d62/d64/f60 [2037155,120167] 0 2024-09-15T22:26:51.925 INFO:tasks.workunit.client.0.smithi001.stdout:7/779: creat d0/d7/d21/d6b/d107/f10e x:0 0 0 2024-09-15T22:26:51.926 INFO:tasks.workunit.client.0.smithi001.stdout:2/791: mkdir d2/d14/d1a/d106 0 2024-09-15T22:26:51.928 INFO:tasks.workunit.client.0.smithi001.stdout:2/792: creat d2/d14/d1a/d1b/d82/f107 x:0 0 0 2024-09-15T22:26:51.929 INFO:tasks.workunit.client.0.smithi001.stdout:2/793: rename d2/d12/d62/d4c/d9d/fcc to d2/d14/d1a/d1b/d82/d97/f108 0 2024-09-15T22:26:51.929 INFO:tasks.workunit.client.0.smithi001.stdout:2/794: dread - d2/d14/d1a/d1b/de8/fe9 zero size 2024-09-15T22:26:51.930 INFO:tasks.workunit.client.0.smithi001.stdout:2/795: creat d2/d12/f109 x:0 0 0 2024-09-15T22:26:51.930 INFO:tasks.workunit.client.0.smithi001.stdout:2/796: getdents d2/d12/d62/d64/d76/db4/dde 0 2024-09-15T22:26:51.931 INFO:tasks.workunit.client.0.smithi001.stdout:2/797: symlink d2/d14/d1a/d1b/de8/l10a 0 2024-09-15T22:26:51.931 INFO:tasks.workunit.client.0.smithi001.stdout:2/798: chown d2/d14/d1a/d1b/f78 1928903 1 2024-09-15T22:26:51.946 INFO:tasks.workunit.client.0.smithi001.stdout:2/799: dread d2/d14/d1a/d1b/d82/dc9/f6b [0,4194304] 0 2024-09-15T22:26:51.980 INFO:tasks.workunit.client.0.smithi001.stdout:6/831: dwrite d0/d6/fd [0,4194304] 0 2024-09-15T22:26:51.980 INFO:tasks.workunit.client.0.smithi001.stdout:6/832: chown d0/d6/l15 1434725 1 2024-09-15T22:26:51.981 INFO:tasks.workunit.client.0.smithi001.stdout:4/956: dwrite d0/d5d/d7c/dba/d20/d29/d124/d74/f99 [0,4194304] 0 2024-09-15T22:26:51.981 INFO:tasks.workunit.client.0.smithi001.stdout:4/957: fsync d0/d5d/d44/d65/d6a/f6e 0 2024-09-15T22:26:51.981 INFO:tasks.workunit.client.0.smithi001.stdout:6/833: creat d0/df/d24/d2e/f11e x:0 0 0 2024-09-15T22:26:51.982 INFO:tasks.workunit.client.0.smithi001.stdout:6/834: write d0/d6/f3e [5173025,125822] 0 2024-09-15T22:26:51.982 INFO:tasks.workunit.client.0.smithi001.stdout:4/958: creat d0/d5d/d7c/dba/d20/d29/d124/d74/f162 x:0 0 0 2024-09-15T22:26:51.983 INFO:tasks.workunit.client.0.smithi001.stdout:4/959: truncate d0/d5d/d7c/dba/d20/d29/d34/f39 1373788 0 2024-09-15T22:26:51.984 INFO:tasks.workunit.client.0.smithi001.stdout:7/780: dwrite d0/d8e/f7f [0,4194304] 0 2024-09-15T22:26:51.984 INFO:tasks.workunit.client.0.smithi001.stdout:0/668: dwrite d0/d84/fb0 [0,4194304] 0 2024-09-15T22:26:51.985 INFO:tasks.workunit.client.0.smithi001.stdout:0/669: creat d0/dd/d93/fcc x:0 0 0 2024-09-15T22:26:51.986 INFO:tasks.workunit.client.0.smithi001.stdout:4/960: rename d0/d5d/d7c/dba/d20/df6/f11c to d0/d5d/d7c/dba/d20/d29/d124/d59/d67/d7b/f163 0 2024-09-15T22:26:51.986 INFO:tasks.workunit.client.0.smithi001.stdout:0/670: creat d0/d6/d77/d78/fcd x:0 0 0 2024-09-15T22:26:51.988 INFO:tasks.workunit.client.0.smithi001.stdout:4/961: rmdir d0/d5d/d44/d65/d6a/d113 39 2024-09-15T22:26:51.988 INFO:tasks.workunit.client.0.smithi001.stdout:7/781: rename d0/d7/d21/d6b/f29 to d0/d7/d21/d6b/d107/f10f 0 2024-09-15T22:26:51.989 INFO:tasks.workunit.client.0.smithi001.stdout:4/962: symlink d0/d5d/d7c/dba/d20/df6/l164 0 2024-09-15T22:26:51.992 INFO:tasks.workunit.client.0.smithi001.stdout:2/800: dwrite d2/d14/f66 [0,4194304] 0 2024-09-15T22:26:51.992 INFO:tasks.workunit.client.0.smithi001.stdout:7/782: symlink d0/d7/d44/d3f/d49/l110 0 2024-09-15T22:26:51.994 INFO:tasks.workunit.client.0.smithi001.stdout:2/801: unlink d2/d14/d1a/d1b/de8/fe9 0 2024-09-15T22:26:51.998 INFO:tasks.workunit.client.0.smithi001.stdout:0/671: write d0/d9/f56 [49677,42913] 0 2024-09-15T22:26:51.998 INFO:tasks.workunit.client.0.smithi001.stdout:6/835: dread d0/d6/f100 [0,4194304] 0 2024-09-15T22:26:51.998 INFO:tasks.workunit.client.0.smithi001.stdout:6/836: write d0/df/fdb [144170,58857] 0 2024-09-15T22:26:51.999 INFO:tasks.workunit.client.0.smithi001.stdout:6/837: write d0/d6/d5d/d67/f54 [2688270,32773] 0 2024-09-15T22:26:51.999 INFO:tasks.workunit.client.0.smithi001.stdout:0/672: unlink d0/dd/d33/f90 0 2024-09-15T22:26:52.000 INFO:tasks.workunit.client.0.smithi001.stdout:6/838: symlink d0/df/d24/db1/l11f 0 2024-09-15T22:26:52.000 INFO:tasks.workunit.client.0.smithi001.stdout:0/673: symlink d0/d9/d1a/d36/lce 0 2024-09-15T22:26:52.001 INFO:tasks.workunit.client.0.smithi001.stdout:0/674: write d0/dd/f9d [704053,20639] 0 2024-09-15T22:26:52.002 INFO:tasks.workunit.client.0.smithi001.stdout:6/839: unlink d0/df/d24/l52 0 2024-09-15T22:26:52.006 INFO:tasks.workunit.client.0.smithi001.stdout:0/675: mkdir d0/dd/d1b/dcf 0 2024-09-15T22:26:52.006 INFO:tasks.workunit.client.0.smithi001.stdout:5/786: dwrite d3/d6/d25/f38 [0,4194304] 0 2024-09-15T22:26:52.008 INFO:tasks.workunit.client.0.smithi001.stdout:5/787: rmdir d3/d6/d57/d87/d8c 39 2024-09-15T22:26:52.008 INFO:tasks.workunit.client.0.smithi001.stdout:5/788: dread - d3/d6/d41/d4d/d5a/fc8 zero size 2024-09-15T22:26:52.008 INFO:tasks.workunit.client.0.smithi001.stdout:2/802: write d2/d12/f61 [770574,68408] 0 2024-09-15T22:26:52.008 INFO:tasks.workunit.client.0.smithi001.stdout:2/803: write d2/d14/d1a/d1b/d82/dc9/d6f/d70/fd8 [1886278,72282] 0 2024-09-15T22:26:52.009 INFO:tasks.workunit.client.0.smithi001.stdout:2/804: creat d2/d14/d1a/f10b x:0 0 0 2024-09-15T22:26:52.016 INFO:tasks.workunit.client.0.smithi001.stdout:2/805: dread d2/d12/d62/f68 [0,4194304] 0 2024-09-15T22:26:52.031 INFO:tasks.workunit.client.0.smithi001.stdout:5/789: dread d3/d1d/fc7 [0,4194304] 0 2024-09-15T22:26:52.031 INFO:tasks.workunit.client.0.smithi001.stdout:5/790: stat d3/d6/dd8 0 2024-09-15T22:26:52.032 INFO:tasks.workunit.client.0.smithi001.stdout:5/791: rmdir d3/d6/d41/d4d/dbe/d56/ddc/de9/df6/da4 39 2024-09-15T22:26:52.032 INFO:tasks.workunit.client.0.smithi001.stdout:5/792: chown d3/d27/d5c/l5f 147 1 2024-09-15T22:26:52.032 INFO:tasks.workunit.client.0.smithi001.stdout:7/783: dread d0/d7/d44/d3f/f75 [0,4194304] 0 2024-09-15T22:26:52.033 INFO:tasks.workunit.client.0.smithi001.stdout:5/793: mkdir d3/d6/d41/d88/da5/d107 0 2024-09-15T22:26:52.033 INFO:tasks.workunit.client.0.smithi001.stdout:5/794: chown d3/d6/d41/d4d/dbe/de6/le4 92 1 2024-09-15T22:26:52.033 INFO:tasks.workunit.client.0.smithi001.stdout:5/795: chown d3/d6/c2e 34 1 2024-09-15T22:26:52.036 INFO:tasks.workunit.client.0.smithi001.stdout:2/806: dread d2/d12/d62/d64/fa5 [0,4194304] 0 2024-09-15T22:26:52.042 INFO:tasks.workunit.client.0.smithi001.stdout:7/784: dread d0/d7/d2e/d60/d10d/fee [0,4194304] 0 2024-09-15T22:26:52.045 INFO:tasks.workunit.client.0.smithi001.stdout:7/785: write d0/d7/d44/d36/f99 [278820,81003] 0 2024-09-15T22:26:52.045 INFO:tasks.workunit.client.0.smithi001.stdout:7/786: write d0/d7/d44/d3f/fef [607819,100364] 0 2024-09-15T22:26:52.045 INFO:tasks.workunit.client.0.smithi001.stdout:4/963: dwrite d0/d5d/d7c/dba/d20/d29/d40/fa5 [0,4194304] 0 2024-09-15T22:26:52.045 INFO:tasks.workunit.client.0.smithi001.stdout:4/964: chown d0/d5d/d7c/dba/d20/d29/d124/ccd 337 1 2024-09-15T22:26:52.046 INFO:tasks.workunit.client.0.smithi001.stdout:4/965: fsync d0/fea 0 2024-09-15T22:26:52.047 INFO:tasks.workunit.client.0.smithi001.stdout:4/966: mkdir d0/d5d/d7c/dba/d20/d29/de0/d165 0 2024-09-15T22:26:52.048 INFO:tasks.workunit.client.0.smithi001.stdout:7/787: rename d0/d7/d2e/d60/d10d/dac/dda/fa3 to d0/d7/dc6/f111 0 2024-09-15T22:26:52.048 INFO:tasks.workunit.client.0.smithi001.stdout:4/967: mkdir d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d11b/d166 0 2024-09-15T22:26:52.048 INFO:tasks.workunit.client.0.smithi001.stdout:7/788: chown d0/d7/d44/d36/f99 2 1 2024-09-15T22:26:52.048 INFO:tasks.workunit.client.0.smithi001.stdout:7/789: fdatasync d0/d7/f24 0 2024-09-15T22:26:52.049 INFO:tasks.workunit.client.0.smithi001.stdout:7/790: mknod d0/db3/dd6/df5/c112 0 2024-09-15T22:26:52.049 INFO:tasks.workunit.client.0.smithi001.stdout:8/754: sync 2024-09-15T22:26:52.049 INFO:tasks.workunit.client.0.smithi001.stdout:3/836: sync 2024-09-15T22:26:52.050 INFO:tasks.workunit.client.0.smithi001.stdout:9/710: sync 2024-09-15T22:26:52.050 INFO:tasks.workunit.client.0.smithi001.stdout:3/837: chown da/d3b/d8b 161152756 1 2024-09-15T22:26:52.050 INFO:tasks.workunit.client.0.smithi001.stdout:9/711: readlink d5/de/l39 0 2024-09-15T22:26:52.050 INFO:tasks.workunit.client.0.smithi001.stdout:9/712: truncate d5/de/d1a/d1b/f70 1619058 0 2024-09-15T22:26:52.050 INFO:tasks.workunit.client.0.smithi001.stdout:9/713: fsync d5/de/d1a/d1b/d22/d2c/d21/d24/f4c 0 2024-09-15T22:26:52.050 INFO:tasks.workunit.client.0.smithi001.stdout:7/791: rmdir d0/db3/dd6 39 2024-09-15T22:26:52.050 INFO:tasks.workunit.client.0.smithi001.stdout:4/968: unlink d0/d5d/d7c/dba/d20/d29/d34/d84/d95/dd3/f14b 0 2024-09-15T22:26:52.051 INFO:tasks.workunit.client.0.smithi001.stdout:8/755: symlink d9/d19/lda 0 2024-09-15T22:26:52.051 INFO:tasks.workunit.client.0.smithi001.stdout:4/969: symlink d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d73/dc0/l167 0 2024-09-15T22:26:52.051 INFO:tasks.workunit.client.0.smithi001.stdout:4/970: chown d0/d5d/d7c/dba/d20/d29/d124/da4/de1/l15b 104 1 2024-09-15T22:26:52.051 INFO:tasks.workunit.client.0.smithi001.stdout:4/971: truncate d0/d5d/d7c/dd1/f110 506043 0 2024-09-15T22:26:52.051 INFO:tasks.workunit.client.0.smithi001.stdout:4/972: dread - d0/d5d/d7c/dd1/f123 zero size 2024-09-15T22:26:52.052 INFO:tasks.workunit.client.0.smithi001.stdout:1/791: sync 2024-09-15T22:26:52.052 INFO:tasks.workunit.client.0.smithi001.stdout:3/838: mkdir da/d3b/d1b/dcf/d124 0 2024-09-15T22:26:52.054 INFO:tasks.workunit.client.0.smithi001.stdout:9/714: mknod d5/de/d1a/d1b/d22/d2c/dab/cd7 0 2024-09-15T22:26:52.055 INFO:tasks.workunit.client.0.smithi001.stdout:4/973: link d0/d5d/d7c/dba/d20/f25 d0/d5d/d7c/dba/d20/d29/d34/f168 0 2024-09-15T22:26:52.056 INFO:tasks.workunit.client.0.smithi001.stdout:9/715: creat d5/de/fd8 x:0 0 0 2024-09-15T22:26:52.056 INFO:tasks.workunit.client.0.smithi001.stdout:4/974: mknod d0/d5d/d7c/dba/d20/d29/d34/d84/d136/c169 0 2024-09-15T22:26:52.056 INFO:tasks.workunit.client.0.smithi001.stdout:8/756: link d9/d19/d58/d8e/d9c/fae d9/d19/d29/d35/fdb 0 2024-09-15T22:26:52.057 INFO:tasks.workunit.client.0.smithi001.stdout:4/975: getdents d0/d5d/d7c/dba/d145 0 2024-09-15T22:26:52.057 INFO:tasks.workunit.client.0.smithi001.stdout:9/716: creat d5/de/d1a/fd9 x:0 0 0 2024-09-15T22:26:52.061 INFO:tasks.workunit.client.0.smithi001.stdout:8/757: link d9/fb d9/d19/d40/d5f/d61/fdc 0 2024-09-15T22:26:52.061 INFO:tasks.workunit.client.0.smithi001.stdout:8/758: chown d9/d19/d34/d41/la8 27914 1 2024-09-15T22:26:52.061 INFO:tasks.workunit.client.0.smithi001.stdout:8/759: chown d9/l7e 117 1 2024-09-15T22:26:52.062 INFO:tasks.workunit.client.0.smithi001.stdout:8/760: stat d9/d19/d29/d50/c83 0 2024-09-15T22:26:52.062 INFO:tasks.workunit.client.0.smithi001.stdout:8/761: chown d9/d19/f3f 23304713 1 2024-09-15T22:26:52.062 INFO:tasks.workunit.client.0.smithi001.stdout:8/762: chown d9/d19/d58/d8e/dc7 3577 1 2024-09-15T22:26:52.063 INFO:tasks.workunit.client.0.smithi001.stdout:5/796: dread d3/d6/d41/fb9 [0,4194304] 0 2024-09-15T22:26:52.063 INFO:tasks.workunit.client.0.smithi001.stdout:5/797: write d3/d6/d41/d4d/dbe/f7b [332285,25839] 0 2024-09-15T22:26:52.071 INFO:tasks.workunit.client.0.smithi001.stdout:8/763: symlink d9/d19/d40/d5f/d61/ldd 0 2024-09-15T22:26:52.083 INFO:tasks.workunit.client.0.smithi001.stdout:5/798: dread d3/d6/d41/d4d/d91/fbb [0,4194304] 0 2024-09-15T22:26:52.083 INFO:tasks.workunit.client.0.smithi001.stdout:4/976: write d0/d5d/d7c/dba/d20/d29/d40/f5a [2639942,37867] 0 2024-09-15T22:26:52.088 INFO:tasks.workunit.client.0.smithi001.stdout:9/717: dread d5/de/d1a/f88 [0,4194304] 0 2024-09-15T22:26:52.089 INFO:tasks.workunit.client.0.smithi001.stdout:9/718: unlink d5/cc3 0 2024-09-15T22:26:52.091 INFO:tasks.workunit.client.0.smithi001.stdout:7/792: dwrite d0/db3/fd8 [0,4194304] 0 2024-09-15T22:26:52.095 INFO:tasks.workunit.client.0.smithi001.stdout:7/793: link d0/d98/lde d0/d7/d44/d3f/l113 0 2024-09-15T22:26:52.096 INFO:tasks.workunit.client.0.smithi001.stdout:4/977: creat d0/d27/d94/d102/f16a x:0 0 0 2024-09-15T22:26:52.096 INFO:tasks.workunit.client.0.smithi001.stdout:4/978: readlink d0/d5d/d7c/dba/d20/d29/d124/ldb 0 2024-09-15T22:26:52.096 INFO:tasks.workunit.client.0.smithi001.stdout:0/676: dwrite d0/d51/f99 [0,4194304] 0 2024-09-15T22:26:52.097 INFO:tasks.workunit.client.0.smithi001.stdout:4/979: rename d0/d5d/d7c/dba/d20/d29/d34/db2/l77 to d0/d5d/d44/d65/d6a/l16b 0 2024-09-15T22:26:52.098 INFO:tasks.workunit.client.0.smithi001.stdout:4/980: symlink d0/d5d/d7c/de8/l16c 0 2024-09-15T22:26:52.099 INFO:tasks.workunit.client.0.smithi001.stdout:4/981: chown d0/d5d/d7c/dba/d20/d29/d124/l83 531 1 2024-09-15T22:26:52.099 INFO:tasks.workunit.client.0.smithi001.stdout:4/982: chown d0/d5d/lde 1999 1 2024-09-15T22:26:52.099 INFO:tasks.workunit.client.0.smithi001.stdout:4/983: write d0/d5d/d7c/dba/d20/d29/fa7 [122641,68367] 0 2024-09-15T22:26:52.099 INFO:tasks.workunit.client.0.smithi001.stdout:4/984: stat d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d73 0 2024-09-15T22:26:52.099 INFO:tasks.workunit.client.0.smithi001.stdout:4/985: dread - d0/d5d/d7c/dba/d20/f119 zero size 2024-09-15T22:26:52.101 INFO:tasks.workunit.client.0.smithi001.stdout:7/794: creat d0/d7/d7c/f114 x:0 0 0 2024-09-15T22:26:52.102 INFO:tasks.workunit.client.0.smithi001.stdout:0/677: getdents d0/d9/d1a/d70 0 2024-09-15T22:26:52.103 INFO:tasks.workunit.client.0.smithi001.stdout:7/795: getdents d0/d7/d2e 0 2024-09-15T22:26:52.103 INFO:tasks.workunit.client.0.smithi001.stdout:7/796: chown d0/d7/fa4 50343 1 2024-09-15T22:26:52.104 INFO:tasks.workunit.client.0.smithi001.stdout:7/797: symlink d0/d7/d44/d3f/l115 0 2024-09-15T22:26:52.107 INFO:tasks.workunit.client.0.smithi001.stdout:7/798: truncate d0/d7/d44/d3f/d49/fab 1047399 0 2024-09-15T22:26:52.108 INFO:tasks.workunit.client.0.smithi001.stdout:2/807: dwrite d2/d12/d62/d64/f2a [0,4194304] 0 2024-09-15T22:26:52.109 INFO:tasks.workunit.client.0.smithi001.stdout:8/764: dread d9/f59 [0,4194304] 0 2024-09-15T22:26:52.109 INFO:tasks.workunit.client.0.smithi001.stdout:8/765: chown d9/d19/d29/d50 238191899 1 2024-09-15T22:26:52.109 INFO:tasks.workunit.client.0.smithi001.stdout:8/766: chown d9/d19/d29/d35/l74 1029873 1 2024-09-15T22:26:52.114 INFO:tasks.workunit.client.0.smithi001.stdout:1/792: dwrite d3/d8d/d91/df5/d68/d8a/ff7 [0,4194304] 0 2024-09-15T22:26:52.115 INFO:tasks.workunit.client.0.smithi001.stdout:1/793: getdents d3/d12/d79/dce/d14/daa/ddd 0 2024-09-15T22:26:52.120 INFO:tasks.workunit.client.0.smithi001.stdout:1/794: creat d3/d12/d79/dce/d14/daa/ffd x:0 0 0 2024-09-15T22:26:52.120 INFO:tasks.workunit.client.0.smithi001.stdout:1/795: getdents d3/d12/d79/dd3 0 2024-09-15T22:26:52.126 INFO:tasks.workunit.client.0.smithi001.stdout:1/796: link d3/l59 d3/d8d/d91/df5/lfe 0 2024-09-15T22:26:52.126 INFO:tasks.workunit.client.0.smithi001.stdout:5/799: dwrite d3/d6/d41/d4d/dbe/d56/ddc/de9/df6/fc3 [0,4194304] 0 2024-09-15T22:26:52.158 INFO:tasks.workunit.client.0.smithi001.stdout:7/799: write d0/d7/d7c/fd1 [4068553,46742] 0 2024-09-15T22:26:52.161 INFO:tasks.workunit.client.0.smithi001.stdout:4/986: dwrite d0/d5d/d7c/dba/f43 [4194304,4194304] 0 2024-09-15T22:26:52.161 INFO:tasks.workunit.client.0.smithi001.stdout:4/987: stat d0/d27/d94/df9/l120 0 2024-09-15T22:26:52.161 INFO:tasks.workunit.client.0.smithi001.stdout:4/988: dread - d0/d5d/d7c/dba/d20/d29/d124/da4/f137 zero size 2024-09-15T22:26:52.161 INFO:tasks.workunit.client.0.smithi001.stdout:4/989: write d0/d5d/d7c/dba/d20/f11f [340564,10275] 0 2024-09-15T22:26:52.162 INFO:tasks.workunit.client.0.smithi001.stdout:4/990: read - d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d73/f128 zero size 2024-09-15T22:26:52.162 INFO:tasks.workunit.client.0.smithi001.stdout:3/839: dwrite da/d3d/d43/f11d [0,4194304] 0 2024-09-15T22:26:52.162 INFO:tasks.workunit.client.0.smithi001.stdout:2/808: dwrite d2/d12/d62/d64/f2a [4194304,4194304] 0 2024-09-15T22:26:52.162 INFO:tasks.workunit.client.0.smithi001.stdout:7/800: creat d0/db3/f116 x:0 0 0 2024-09-15T22:26:52.163 INFO:tasks.workunit.client.0.smithi001.stdout:7/801: creat d0/d7/d2e/d109/f117 x:0 0 0 2024-09-15T22:26:52.163 INFO:tasks.workunit.client.0.smithi001.stdout:4/991: symlink d0/d5d/d7c/dba/d20/d29/de0/d165/l16d 0 2024-09-15T22:26:52.164 INFO:tasks.workunit.client.0.smithi001.stdout:4/992: fsync d0/d5d/d7c/dba/d20/d29/d124/d59/fb0 0 2024-09-15T22:26:52.165 INFO:tasks.workunit.client.0.smithi001.stdout:4/993: mkdir d0/d5d/d7c/dba/d20/d29/d34/d84/d136/d16e 0 2024-09-15T22:26:52.168 INFO:tasks.workunit.client.0.smithi001.stdout:2/809: rename d2/d14/d1a/d1b/d82/d83 to d2/d12/d10c 0 2024-09-15T22:26:52.169 INFO:tasks.workunit.client.0.smithi001.stdout:4/994: creat d0/d5d/d7c/dba/f16f x:0 0 0 2024-09-15T22:26:52.170 INFO:tasks.workunit.client.0.smithi001.stdout:4/995: stat d0/d5d/d44/c14d 0 2024-09-15T22:26:52.171 INFO:tasks.workunit.client.0.smithi001.stdout:4/996: getdents d0/d5d/d7c/dba/d20/d29/d34/d84/d95/d11b 0 2024-09-15T22:26:52.171 INFO:tasks.workunit.client.0.smithi001.stdout:4/997: write d0/d5d/d7c/dba/d20/d29/d40/f5a [1378934,19972] 0 2024-09-15T22:26:52.172 INFO:tasks.workunit.client.0.smithi001.stdout:4/998: mknod d0/d27/d94/d151/c170 0 2024-09-15T22:26:52.172 INFO:tasks.workunit.client.0.smithi001.stdout:8/767: read d9/f6d [2464852,92709] 0 2024-09-15T22:26:52.172 INFO:tasks.workunit.client.0.smithi001.stdout:4/999: dread - d0/d27/d94/df1/f150 zero size 2024-09-15T22:26:52.173 INFO:tasks.workunit.client.0.smithi001.stdout:8/768: getdents d9/d19/d40/d5f 0 2024-09-15T22:26:52.173 INFO:tasks.workunit.client.0.smithi001.stdout:9/719: dwrite d5/d3e/fb0 [0,4194304] 0 2024-09-15T22:26:52.173 INFO:tasks.workunit.client.0.smithi001.stdout:9/720: chown d5/de/d1a/d1b/d22/d97/l98 52 1 2024-09-15T22:26:52.180 INFO:tasks.workunit.client.0.smithi001.stdout:6/840: sync 2024-09-15T22:26:52.184 INFO:tasks.workunit.client.0.smithi001.stdout:9/721: creat d5/de/d1a/d1b/d22/d2c/d21/d24/fda x:0 0 0 2024-09-15T22:26:52.186 INFO:tasks.workunit.client.0.smithi001.stdout:2/810: dread d2/d12/f1c [0,4194304] 0 2024-09-15T22:26:52.186 INFO:tasks.workunit.client.0.smithi001.stdout:2/811: readlink d2/d12/laa 0 2024-09-15T22:26:52.186 INFO:tasks.workunit.client.0.smithi001.stdout:7/802: dread d0/d7/d2e/f63 [0,4194304] 0 2024-09-15T22:26:52.189 INFO:tasks.workunit.client.0.smithi001.stdout:7/803: symlink d0/dd3/l118 0 2024-09-15T22:26:52.189 INFO:tasks.workunit.client.0.smithi001.stdout:7/804: fdatasync d0/d7/d7c/fd1 0 2024-09-15T22:26:52.190 INFO:tasks.workunit.client.0.smithi001.stdout:2/812: mkdir d2/d14/d1a/d1b/d82/d10d 0 2024-09-15T22:26:52.190 INFO:tasks.workunit.client.0.smithi001.stdout:8/769: dread d9/d19/d58/f4d [0,4194304] 0 2024-09-15T22:26:52.191 INFO:tasks.workunit.client.0.smithi001.stdout:2/813: creat d2/d12/d62/d64/d76/db4/f10e x:0 0 0 2024-09-15T22:26:52.193 INFO:tasks.workunit.client.0.smithi001.stdout:2/814: getdents d2/d12/d62/d4c 0 2024-09-15T22:26:52.195 INFO:tasks.workunit.client.0.smithi001.stdout:2/815: mkdir d2/d12/d10c/d10f 0 2024-09-15T22:26:52.206 INFO:tasks.workunit.client.0.smithi001.stdout:2/816: link d2/d14/d1a/d8a/f94 d2/d14/d1a/d1b/d82/d97/d74/f110 0 2024-09-15T22:26:52.207 INFO:tasks.workunit.client.0.smithi001.stdout:2/817: mknod d2/d14/d1a/d80/c111 0 2024-09-15T22:26:52.208 INFO:tasks.workunit.client.0.smithi001.stdout:1/797: dwrite d3/d12/d79/dce/d69/fe1 [0,4194304] 0 2024-09-15T22:26:52.208 INFO:tasks.workunit.client.0.smithi001.stdout:2/818: creat d2/d12/d10c/f112 x:0 0 0 2024-09-15T22:26:52.209 INFO:tasks.workunit.client.0.smithi001.stdout:1/798: mkdir d3/d12/d79/dce/d14/d23/da1/de9/dff 0 2024-09-15T22:26:52.209 INFO:tasks.workunit.client.0.smithi001.stdout:1/799: truncate d3/d8d/d91/fa9 812164 0 2024-09-15T22:26:52.210 INFO:tasks.workunit.client.0.smithi001.stdout:1/800: chown d3/d12/d79/dce/d53/dc7/ld6 281557 1 2024-09-15T22:26:52.210 INFO:tasks.workunit.client.0.smithi001.stdout:1/801: readlink d3/l94 0 2024-09-15T22:26:52.222 INFO:tasks.workunit.client.0.smithi001.stdout:2/819: dread d2/f43 [0,4194304] 0 2024-09-15T22:26:52.224 INFO:tasks.workunit.client.0.smithi001.stdout:2/820: getdents d2/d12/d62 0 2024-09-15T22:26:52.224 INFO:tasks.workunit.client.0.smithi001.stdout:2/821: truncate d2/d14/d1a/fd5 313602 0 2024-09-15T22:26:52.224 INFO:tasks.workunit.client.0.smithi001.stdout:2/822: creat d2/d12/f113 x:0 0 0 2024-09-15T22:26:52.231 INFO:tasks.workunit.client.0.smithi001.stdout:8/770: dwrite d9/d19/f3d [4194304,4194304] 0 2024-09-15T22:26:52.258 INFO:tasks.workunit.client.0.smithi001.stdout:7/805: dwrite d0/db3/dd6/fe5 [0,4194304] 0 2024-09-15T22:26:52.258 INFO:tasks.workunit.client.0.smithi001.stdout:7/806: fsync d0/d7/d44/d3f/d49/da5/fdc 0 2024-09-15T22:26:52.260 INFO:tasks.workunit.client.0.smithi001.stdout:7/807: mkdir d0/dd3/d119 0 2024-09-15T22:26:52.270 INFO:tasks.workunit.client.0.smithi001.stdout:7/808: dread d0/d7/fdf [0,4194304] 0 2024-09-15T22:26:52.272 INFO:tasks.workunit.client.0.smithi001.stdout:8/771: dwrite d9/d19/d40/d9e/fd6 [0,4194304] 0 2024-09-15T22:26:52.279 INFO:tasks.workunit.client.0.smithi001.stdout:6/841: dwrite d0/d6/d5d/dd8/f112 [0,4194304] 0 2024-09-15T22:26:52.281 INFO:tasks.workunit.client.0.smithi001.stdout:1/802: dwrite d3/d12/d79/dce/d3c/d64/fa6 [0,4194304] 0 2024-09-15T22:26:52.288 INFO:tasks.workunit.client.0.smithi001.stdout:8/772: dread d9/d19/d34/f47 [0,4194304] 0 2024-09-15T22:26:52.297 INFO:tasks.workunit.client.0.smithi001.stdout:8/773: symlink d9/lde 0 2024-09-15T22:26:52.297 INFO:tasks.workunit.client.0.smithi001.stdout:8/774: fsync d9/f11 0 2024-09-15T22:26:52.297 INFO:tasks.workunit.client.0.smithi001.stdout:8/775: readlink d9/d19/d34/da4/db7/ld4 0 2024-09-15T22:26:52.297 INFO:tasks.workunit.client.0.smithi001.stdout:8/776: write d9/d19/d58/fcc [557755,101975] 0 2024-09-15T22:26:52.299 INFO:tasks.workunit.client.0.smithi001.stdout:6/842: read d0/df/d24/d2e/fbe [3182237,31361] 0 2024-09-15T22:26:52.299 INFO:tasks.workunit.client.0.smithi001.stdout:8/777: rename d9/d19/d58/c4c to d9/d19/d58/d88/cdf 0 2024-09-15T22:26:52.299 INFO:tasks.workunit.client.0.smithi001.stdout:6/843: chown d0/d6/d5d/d8c/c113 75 1 2024-09-15T22:26:52.300 INFO:tasks.workunit.client.0.smithi001.stdout:7/809: dread d0/d7/d21/d6b/fe2 [0,4194304] 0 2024-09-15T22:26:52.304 INFO:tasks.workunit.client.0.smithi001.stdout:0/678: sync 2024-09-15T22:26:52.305 INFO:tasks.workunit.client.0.smithi001.stdout:5/800: sync 2024-09-15T22:26:52.306 INFO:tasks.workunit.client.0.smithi001.stdout:2/823: dread d2/d12/d62/d64/d76/db4/fce [0,4194304] 0 2024-09-15T22:26:52.306 INFO:tasks.workunit.client.0.smithi001.stdout:9/722: dwrite d5/de/d51/d53/f60 [4194304,4194304] 0 2024-09-15T22:26:52.306 INFO:tasks.workunit.client.0.smithi001.stdout:9/723: readlink d5/de/d1a/d1b/d22/d2c/l1f 0 2024-09-15T22:26:52.306 INFO:tasks.workunit.client.0.smithi001.stdout:9/724: write d5/de/d1a/d1b/d22/d2c/d21/d4d/f5d [3708182,28138] 0 2024-09-15T22:26:52.306 INFO:tasks.workunit.client.0.smithi001.stdout:5/801: mknod d3/d6/d41/d4d/dbe/de6/c108 0 2024-09-15T22:26:52.306 INFO:tasks.workunit.client.0.smithi001.stdout:5/802: readlink d3/d6/d41/l8e 0 2024-09-15T22:26:52.306 INFO:tasks.workunit.client.0.smithi001.stdout:0/679: getdents d0/d9/db/d5d/d6d 0 2024-09-15T22:26:52.307 INFO:tasks.workunit.client.0.smithi001.stdout:6/844: dread d0/d6/fb7 [0,4194304] 0 2024-09-15T22:26:52.307 INFO:tasks.workunit.client.0.smithi001.stdout:3/840: sync 2024-09-15T22:26:52.307 INFO:tasks.workunit.client.0.smithi001.stdout:3/841: fdatasync da/d3d/d43/d41/df1/d7f/fcd 0 2024-09-15T22:26:52.307 INFO:tasks.workunit.client.0.smithi001.stdout:3/842: read da/d16/fb7 [14458,69525] 0 2024-09-15T22:26:52.308 INFO:tasks.workunit.client.0.smithi001.stdout:5/803: rename d3/d27/d4e/d89/dae to d3/d27/d109 0 2024-09-15T22:26:52.308 INFO:tasks.workunit.client.0.smithi001.stdout:9/725: mknod d5/d3e/cdb 0 2024-09-15T22:26:52.308 INFO:tasks.workunit.client.0.smithi001.stdout:9/726: chown d5/de/d1a/d1b/d22 195 1 2024-09-15T22:26:52.308 INFO:tasks.workunit.client.0.smithi001.stdout:5/804: write d3/d1d/fa7 [737970,69302] 0 2024-09-15T22:26:52.309 INFO:tasks.workunit.client.0.smithi001.stdout:5/805: symlink d3/d6/d57/d87/d8c/l10a 0 2024-09-15T22:26:52.309 INFO:tasks.workunit.client.0.smithi001.stdout:5/806: chown d3/d27/d4e/f58 19726 1 2024-09-15T22:26:52.309 INFO:tasks.workunit.client.0.smithi001.stdout:3/843: unlink da/d3d/d43/d41/df1/d7f/f8c 0 2024-09-15T22:26:52.309 INFO:tasks.workunit.client.0.smithi001.stdout:3/844: write da/d3d/d43/d7c/d53/fd2 [170981,103960] 0 2024-09-15T22:26:52.309 INFO:tasks.workunit.client.0.smithi001.stdout:3/845: truncate da/d3b/d8b/dee/f22 616904 0 2024-09-15T22:26:52.310 INFO:tasks.workunit.client.0.smithi001.stdout:9/727: creat d5/de/d1a/d1b/d22/d2c/d21/d23/fdc x:0 0 0 2024-09-15T22:26:52.310 INFO:tasks.workunit.client.0.smithi001.stdout:9/728: fdatasync d5/de/d1a/d1b/d2a/f78 0 2024-09-15T22:26:52.311 INFO:tasks.workunit.client.0.smithi001.stdout:9/729: mkdir d5/de/d51/d53/dbe/ddd 0 2024-09-15T22:26:52.312 INFO:tasks.workunit.client.0.smithi001.stdout:9/730: chown d5/de/d51/d53/d9f/da1 377 1 2024-09-15T22:26:52.312 INFO:tasks.workunit.client.0.smithi001.stdout:9/731: truncate d5/de/d1a/d1b/d22/d2c/d21/d24/d86/f93 4943509 0 2024-09-15T22:26:52.316 INFO:tasks.workunit.client.0.smithi001.stdout:7/810: dread d0/d7/d44/f27 [0,4194304] 0 2024-09-15T22:26:52.317 INFO:tasks.workunit.client.0.smithi001.stdout:3/846: truncate da/d3d/d43/d7c/d53/fd2 947091 0 2024-09-15T22:26:52.317 INFO:tasks.workunit.client.0.smithi001.stdout:3/847: read - da/d3d/d43/d7c/d53/ff2 zero size 2024-09-15T22:26:52.317 INFO:tasks.workunit.client.0.smithi001.stdout:3/848: readlink da/d3d/d43/d7c/d53/d72/lde 0 2024-09-15T22:26:52.317 INFO:tasks.workunit.client.0.smithi001.stdout:7/811: creat d0/d8e/d3e/f11a x:0 0 0 2024-09-15T22:26:52.321 INFO:tasks.workunit.client.0.smithi001.stdout:7/812: unlink d0/d7/d2e/f63 0 2024-09-15T22:26:52.323 INFO:tasks.workunit.client.0.smithi001.stdout:7/813: rmdir d0/d7/dc6 39 2024-09-15T22:26:52.324 INFO:tasks.workunit.client.0.smithi001.stdout:7/814: rmdir d0/dd3/df9 39 2024-09-15T22:26:52.324 INFO:tasks.workunit.client.0.smithi001.stdout:7/815: truncate d0/d7/d44/d36/f84 1345088 0 2024-09-15T22:26:52.324 INFO:tasks.workunit.client.0.smithi001.stdout:7/816: stat d0/d7/d44/f8d 0 2024-09-15T22:26:52.325 INFO:tasks.workunit.client.0.smithi001.stdout:7/817: truncate d0/d7/d21/d6b/fba 2302576 0 2024-09-15T22:26:52.328 INFO:tasks.workunit.client.0.smithi001.stdout:7/818: creat d0/d7/d2e/d60/f11b x:0 0 0 2024-09-15T22:26:52.328 INFO:tasks.workunit.client.0.smithi001.stdout:7/819: truncate d0/d7/d21/d6b/d107/f10e 775493 0 2024-09-15T22:26:52.329 INFO:tasks.workunit.client.0.smithi001.stdout:9/732: write d5/de/d1a/f64 [3823047,66921] 0 2024-09-15T22:26:52.329 INFO:tasks.workunit.client.0.smithi001.stdout:9/733: readlink d5/de/d51/d53/l85 0 2024-09-15T22:26:52.329 INFO:tasks.workunit.client.0.smithi001.stdout:9/734: truncate d5/de/d15/d27/fc0 177878 0 2024-09-15T22:26:52.330 INFO:tasks.workunit.client.0.smithi001.stdout:9/735: fdatasync d5/de/d1a/d1b/d22/d2c/f6a 0 2024-09-15T22:26:52.342 INFO:tasks.workunit.client.0.smithi001.stdout:3/849: dread da/d3b/f32 [4194304,4194304] 0 2024-09-15T22:26:52.348 INFO:tasks.workunit.client.0.smithi001.stdout:3/850: rename da/f106 to da/d9e/f125 0 2024-09-15T22:26:52.350 INFO:tasks.workunit.client.0.smithi001.stdout:3/851: mkdir da/d3d/d43/d41/df1/d7f/d126 0 2024-09-15T22:26:52.352 INFO:tasks.workunit.client.0.smithi001.stdout:3/852: mknod da/d3b/d58/c127 0 2024-09-15T22:26:52.352 INFO:tasks.workunit.client.0.smithi001.stdout:3/853: fdatasync da/d3d/d43/d7c/d53/fd6 0 2024-09-15T22:26:52.362 INFO:tasks.workunit.client.0.smithi001.stdout:6/845: dwrite d0/df/d24/f34 [0,4194304] 0 2024-09-15T22:26:52.365 INFO:tasks.workunit.client.0.smithi001.stdout:6/846: rename d0/df/d24/d2e/d43/d30/dc2/de6 to d0/d6/d5d/d67/d53/da0/d120 0 2024-09-15T22:26:52.370 INFO:tasks.workunit.client.0.smithi001.stdout:3/854: dread da/d3d/d43/d7c/d53/fd2 [0,4194304] 0 2024-09-15T22:26:52.375 INFO:tasks.workunit.client.0.smithi001.stdout:9/736: dwrite d5/de/d1a/d1b/d22/d2c/f31 [0,4194304] 0 2024-09-15T22:26:52.375 INFO:tasks.workunit.client.0.smithi001.stdout:0/680: dwrite d0/d6/d77/d78/f8b [0,4194304] 0 2024-09-15T22:26:52.376 INFO:tasks.workunit.client.0.smithi001.stdout:5/807: dwrite d3/d6/d57/d87/d8c/da2/fed [0,4194304] 0 2024-09-15T22:26:52.378 INFO:tasks.workunit.client.0.smithi001.stdout:0/681: link d0/d84/lc9 d0/ld0 0 2024-09-15T22:26:52.379 INFO:tasks.workunit.client.0.smithi001.stdout:0/682: creat d0/d6/dae/fd1 x:0 0 0 2024-09-15T22:26:52.382 INFO:tasks.workunit.client.0.smithi001.stdout:9/737: dread d5/de/d1a/d1b/f70 [0,4194304] 0 2024-09-15T22:26:52.385 INFO:tasks.workunit.client.0.smithi001.stdout:3/855: dread da/f13 [0,4194304] 0 2024-09-15T22:26:52.389 INFO:tasks.workunit.client.0.smithi001.stdout:5/808: write d3/d49/fc1 [611311,85122] 0 2024-09-15T22:26:52.390 INFO:tasks.workunit.client.0.smithi001.stdout:6/847: dread d0/df/d24/d49/fc5 [0,4194304] 0 2024-09-15T22:26:52.395 INFO:tasks.workunit.client.0.smithi001.stdout:3/856: mkdir da/d3d/d43/d7c/d3f/db5/d128 0 2024-09-15T22:26:52.399 INFO:tasks.workunit.client.0.smithi001.stdout:9/738: write d5/de/f18 [7094317,26079] 0 2024-09-15T22:26:52.403 INFO:tasks.workunit.client.0.smithi001.stdout:7/820: dwrite d0/d7/d44/d36/f99 [0,4194304] 0 2024-09-15T22:26:52.404 INFO:tasks.workunit.client.0.smithi001.stdout:5/809: read d3/d6/d41/f4c [2025613,7657] 0 2024-09-15T22:26:52.406 INFO:tasks.workunit.client.0.smithi001.stdout:5/810: truncate d3/d6/d41/d4d/dbe/d56/f4a 1495130 0 2024-09-15T22:26:52.414 INFO:tasks.workunit.client.0.smithi001.stdout:5/811: dread d3/d6/fc4 [0,4194304] 0 2024-09-15T22:26:52.428 INFO:tasks.workunit.client.0.smithi001.stdout:5/812: write d3/d49/fa0 [3377090,120554] 0 2024-09-15T22:26:52.428 INFO:tasks.workunit.client.0.smithi001.stdout:5/813: fsync d3/d6/d41/d4d/dbe/f9e 0 2024-09-15T22:26:52.430 INFO:tasks.workunit.client.0.smithi001.stdout:5/814: creat d3/d6/f10b x:0 0 0 2024-09-15T22:26:52.432 INFO:tasks.workunit.client.0.smithi001.stdout:5/815: truncate d3/f33 1152140 0 2024-09-15T22:26:52.442 INFO:tasks.workunit.client.0.smithi001.stdout:0/683: dwrite d0/d6/d77/d78/fa6 [0,4194304] 0 2024-09-15T22:26:52.451 INFO:tasks.workunit.client.0.smithi001.stdout:9/739: dwrite d5/de/d1a/d1b/d22/d2c/d21/d24/fda [0,4194304] 0 2024-09-15T22:26:52.451 INFO:tasks.workunit.client.0.smithi001.stdout:5/816: dread d3/d6/d25/f2c [0,4194304] 0 2024-09-15T22:26:52.451 INFO:tasks.workunit.client.0.smithi001.stdout:5/817: write d3/d6/d41/d4d/dbe/f9e [5052310,114723] 0 2024-09-15T22:26:52.452 INFO:tasks.workunit.client.0.smithi001.stdout:5/818: mkdir d3/d6/dd8/d10c 0 2024-09-15T22:26:52.469 INFO:tasks.workunit.client.0.smithi001.stdout:3/857: symlink da/d3d/d43/d7c/d53/d72/l129 0 2024-09-15T22:26:52.473 INFO:tasks.workunit.client.0.smithi001.stdout:7/821: rename d0/d7/d21/d6b/c25 to d0/d7/d21/c11c 0 2024-09-15T22:26:52.477 INFO:tasks.workunit.client.0.smithi001.stdout:9/740: write d5/de/d1a/d1b/d22/d2c/d21/d23/fb2 [2706650,50507] 0 2024-09-15T22:26:52.478 INFO:tasks.workunit.client.0.smithi001.stdout:6/848: dwrite d0/df/d24/f6b [0,4194304] 0 2024-09-15T22:26:52.480 INFO:tasks.workunit.client.0.smithi001.stdout:0/684: mkdir d0/dd/d33/dd2 0 2024-09-15T22:26:52.484 INFO:tasks.workunit.client.0.smithi001.stdout:3/858: creat da/d9e/f12a x:0 0 0 2024-09-15T22:26:52.485 INFO:tasks.workunit.client.0.smithi001.stdout:7/822: creat d0/d7/d21/d6b/d93/f11d x:0 0 0 2024-09-15T22:26:52.490 INFO:tasks.workunit.client.0.smithi001.stdout:9/741: creat d5/de/d15/fde x:0 0 0 2024-09-15T22:26:52.491 INFO:tasks.workunit.client.0.smithi001.stdout:6/849: creat d0/d6/d5d/d67/d53/da0/f121 x:0 0 0 2024-09-15T22:26:52.492 INFO:tasks.workunit.client.0.smithi001.stdout:0/685: dread - d0/f50 zero size 2024-09-15T22:26:52.492 INFO:tasks.workunit.client.0.smithi001.stdout:0/686: rename d0 to d0/dd/d33/dd2/dd3 22 2024-09-15T22:26:52.493 INFO:tasks.workunit.client.0.smithi001.stdout:3/859: creat da/d90/d6f/dc7/f12b x:0 0 0 2024-09-15T22:26:52.495 INFO:tasks.workunit.client.0.smithi001.stdout:7/823: mknod d0/d7/d44/d3f/d49/da5/c11e 0 2024-09-15T22:26:52.495 INFO:tasks.workunit.client.0.smithi001.stdout:5/819: dwrite d3/d6/d41/d4d/f93 [0,4194304] 0 2024-09-15T22:26:52.495 INFO:tasks.workunit.client.0.smithi001.stdout:5/820: truncate d3/d6/d41/d4d/dbe/d56/ddc/de9/df6/da4/f105 77092 0 2024-09-15T22:26:52.495 INFO:tasks.workunit.client.0.smithi001.stdout:5/821: write d3/d6/d41/f82 [4194987,22892] 0 2024-09-15T22:26:52.496 INFO:tasks.workunit.client.0.smithi001.stdout:9/742: dread d5/de/d1a/d1b/d22/d2c/d21/d24/fbf [0,4194304] 0 2024-09-15T22:26:52.496 INFO:tasks.workunit.client.0.smithi001.stdout:0/687: symlink d0/d6/ld4 0 2024-09-15T22:26:52.496 INFO:tasks.workunit.client.0.smithi001.stdout:5/822: symlink d3/d27/d4e/d89/dfe/l10d 0 2024-09-15T22:26:52.497 INFO:tasks.workunit.client.0.smithi001.stdout:5/823: rename d3/d6/d41/d4d/dbe/d56/d8a to d3/d6/d41/d88/db0/d10e 0 2024-09-15T22:26:52.499 INFO:tasks.workunit.client.0.smithi001.stdout:5/824: rename d3/d6/d41/d4d/dbe/d56/ddc/de9/df6/lc6 to d3/d27/d7a/l10f 0 2024-09-15T22:26:52.499 INFO:tasks.workunit.client.0.smithi001.stdout:5/825: chown d3/d27/d7a/d80/fce 1762912 1 2024-09-15T22:26:52.499 INFO:tasks.workunit.client.0.smithi001.stdout:5/826: stat d3/d27/l48 0 2024-09-15T22:26:52.499 INFO:tasks.workunit.client.0.smithi001.stdout:5/827: fsync d3/d6/f10b 0 2024-09-15T22:26:52.500 INFO:tasks.workunit.client.0.smithi001.stdout:1/803: sync 2024-09-15T22:26:52.500 INFO:tasks.workunit.client.0.smithi001.stdout:7/824: mkdir d0/d7/d21/d6b/d11f 0 2024-09-15T22:26:52.501 INFO:tasks.workunit.client.0.smithi001.stdout:5/828: creat d3/d6/d41/d4d/dbe/de6/f110 x:0 0 0 2024-09-15T22:26:52.501 INFO:tasks.workunit.client.0.smithi001.stdout:8/778: sync 2024-09-15T22:26:52.501 INFO:tasks.workunit.client.0.smithi001.stdout:2/824: sync 2024-09-15T22:26:52.501 INFO:tasks.workunit.client.0.smithi001.stdout:9/743: creat d5/fdf x:0 0 0 2024-09-15T22:26:52.501 INFO:tasks.workunit.client.0.smithi001.stdout:8/779: chown d9/d19/d58/d8e/dc7 1385294 1 2024-09-15T22:26:52.502 INFO:tasks.workunit.client.0.smithi001.stdout:1/804: unlink d3/d8d/d91/df5/f61 0 2024-09-15T22:26:52.502 INFO:tasks.workunit.client.0.smithi001.stdout:9/744: truncate d5/de/d51/d53/f60 5998268 0 2024-09-15T22:26:52.503 INFO:tasks.workunit.client.0.smithi001.stdout:9/745: getdents d5/de/d51 0 2024-09-15T22:26:52.503 INFO:tasks.workunit.client.0.smithi001.stdout:9/746: fdatasync d5/de/d15/d27/d63/f79 0 2024-09-15T22:26:52.503 INFO:tasks.workunit.client.0.smithi001.stdout:9/747: write d5/de/d1a/d1b/d22/d2c/d21/d23/fb2 [4836931,75697] 0 2024-09-15T22:26:52.503 INFO:tasks.workunit.client.0.smithi001.stdout:1/805: link d3/d12/d79/dce/d14/d23/f9d d3/d12/d79/dce/d14/d1b/d98/f100 0 2024-09-15T22:26:52.504 INFO:tasks.workunit.client.0.smithi001.stdout:9/748: mknod d5/de/d1a/d1b/d22/d2c/ce0 0 2024-09-15T22:26:52.505 INFO:tasks.workunit.client.0.smithi001.stdout:0/688: dread d0/d9/db/d5d/d6d/fb4 [0,4194304] 0 2024-09-15T22:26:52.505 INFO:tasks.workunit.client.0.smithi001.stdout:1/806: stat d3/d12/d79/dce/ce3 0 2024-09-15T22:26:52.505 INFO:tasks.workunit.client.0.smithi001.stdout:1/807: chown d3/d12/d79/dce/ce3 12984 1 2024-09-15T22:26:52.505 INFO:tasks.workunit.client.0.smithi001.stdout:0/689: write d0/f16 [3732678,3084] 0 2024-09-15T22:26:52.509 INFO:tasks.workunit.client.0.smithi001.stdout:1/808: mknod d3/d12/d79/dce/d14/daa/ddd/df4/c101 0 2024-09-15T22:26:52.509 INFO:tasks.workunit.client.0.smithi001.stdout:6/850: dread d0/d6/f71 [0,4194304] 0 2024-09-15T22:26:52.510 INFO:tasks.workunit.client.0.smithi001.stdout:3/860: dread da/d3b/d8b/dbe/f116 [0,4194304] 0 2024-09-15T22:26:52.510 INFO:tasks.workunit.client.0.smithi001.stdout:3/861: stat da/d3d/d43/d41/f54 0 2024-09-15T22:26:52.510 INFO:tasks.workunit.client.0.smithi001.stdout:3/862: stat da/d3b/f3c 0 2024-09-15T22:26:52.511 INFO:tasks.workunit.client.0.smithi001.stdout:6/851: unlink d0/d6/d5d/d67/fcf 0 2024-09-15T22:26:52.511 INFO:tasks.workunit.client.0.smithi001.stdout:2/825: dread d2/d14/d1a/d8a/f94 [0,4194304] 0 2024-09-15T22:26:52.512 INFO:tasks.workunit.client.0.smithi001.stdout:3/863: rename da/d3b/d58/faf to da/d3b/d1b/f12c 0 2024-09-15T22:26:52.516 INFO:tasks.workunit.client.0.smithi001.stdout:2/826: link d2/d12/d62/d64/f60 d2/d14/f114 0 2024-09-15T22:26:52.516 INFO:tasks.workunit.client.0.smithi001.stdout:2/827: fdatasync d2/d14/d1a/d8a/fbc 0 2024-09-15T22:26:52.517 INFO:tasks.workunit.client.0.smithi001.stdout:2/828: creat d2/d12/dec/f115 x:0 0 0 2024-09-15T22:26:52.518 INFO:tasks.workunit.client.0.smithi001.stdout:9/749: write d5/de/d15/d27/d63/f7b [368696,37566] 0 2024-09-15T22:26:52.519 INFO:tasks.workunit.client.0.smithi001.stdout:1/809: dread d3/d12/d79/dce/d14/d23/f4f [0,4194304] 0 2024-09-15T22:26:52.519 INFO:tasks.workunit.client.0.smithi001.stdout:1/810: truncate d3/d8d/d91/df5/fb1 1014409 0 2024-09-15T22:26:52.520 INFO:tasks.workunit.client.0.smithi001.stdout:2/829: symlink d2/d14/d1a/d1b/d82/db0/df6/df8/l116 0 2024-09-15T22:26:52.520 INFO:tasks.workunit.client.0.smithi001.stdout:7/825: dread d0/d7/d44/d3f/ffc [0,4194304] 0 2024-09-15T22:26:52.520 INFO:tasks.workunit.client.0.smithi001.stdout:7/826: chown d0/d7/d21/f10c 5 1 2024-09-15T22:26:52.520 INFO:tasks.workunit.client.0.smithi001.stdout:7/827: getdents d0/d7/df3 0 2024-09-15T22:26:52.522 INFO:tasks.workunit.client.0.smithi001.stdout:2/830: creat d2/d14/d1a/d1b/d82/dc9/f117 x:0 0 0 2024-09-15T22:26:52.524 INFO:tasks.workunit.client.0.smithi001.stdout:6/852: creat d0/d6/d5d/dd8/f122 x:0 0 0 2024-09-15T22:26:52.524 INFO:tasks.workunit.client.0.smithi001.stdout:3/864: mknod da/db3/c12d 0 2024-09-15T22:26:52.525 INFO:tasks.workunit.client.0.smithi001.stdout:3/865: write da/d3d/d43/d41/f54 [3372771,57329] 0 2024-09-15T22:26:52.525 INFO:tasks.workunit.client.0.smithi001.stdout:3/866: dread - da/d3b/d58/fb4 zero size 2024-09-15T22:26:52.525 INFO:tasks.workunit.client.0.smithi001.stdout:9/750: symlink d5/de/d15/d27/d63/le1 0 2024-09-15T22:26:52.526 INFO:tasks.workunit.client.0.smithi001.stdout:0/690: dread d0/d6/d77/d78/f85 [0,4194304] 0 2024-09-15T22:26:52.526 INFO:tasks.workunit.client.0.smithi001.stdout:7/828: mkdir d0/db3/d120 0 2024-09-15T22:26:52.527 INFO:tasks.workunit.client.0.smithi001.stdout:6/853: mknod d0/d6/d5d/d67/c123 0 2024-09-15T22:26:52.529 INFO:tasks.workunit.client.0.smithi001.stdout:9/751: unlink d5/de/d1a/l3b 0 2024-09-15T22:26:52.531 INFO:tasks.workunit.client.0.smithi001.stdout:6/854: rename d0/df/d97/fdf to d0/d6/d5d/d101/f124 0 2024-09-15T22:26:52.533 INFO:tasks.workunit.client.0.smithi001.stdout:9/752: link d5/de/d1a/d1b/d22/d2c/d21/c5e d5/de/d51/ce2 0 2024-09-15T22:26:52.536 INFO:tasks.workunit.client.0.smithi001.stdout:6/855: rename d0/d6/d5d/d67/c123 to d0/d6/d5d/d67/df0/c125 0 2024-09-15T22:26:52.537 INFO:tasks.workunit.client.0.smithi001.stdout:9/753: write d5/de/d1a/d38/f72 [88684,72738] 0 2024-09-15T22:26:52.537 INFO:tasks.workunit.client.0.smithi001.stdout:2/831: write d2/d12/f59 [4056986,98639] 0 2024-09-15T22:26:52.540 INFO:tasks.workunit.client.0.smithi001.stdout:6/856: link d0/df/d24/d49/le9 d0/df/d24/d2e/d43/d30/l126 0 2024-09-15T22:26:52.541 INFO:tasks.workunit.client.0.smithi001.stdout:6/857: getdents d0/df/d24/d2e/d43/d30/dc2 0 2024-09-15T22:26:52.542 INFO:tasks.workunit.client.0.smithi001.stdout:6/858: write d0/df/d24/d49/dc7/def/f11b [222265,16409] 0 2024-09-15T22:26:52.542 INFO:tasks.workunit.client.0.smithi001.stdout:6/859: chown d0/df/d24/d2e/d43/d30/da7 4038 1 2024-09-15T22:26:52.544 INFO:tasks.workunit.client.0.smithi001.stdout:6/860: mknod d0/d6/d5d/d67/d53/c127 0 2024-09-15T22:26:52.544 INFO:tasks.workunit.client.0.smithi001.stdout:6/861: truncate d0/df/d24/d49/f81 108103 0 2024-09-15T22:26:52.545 INFO:tasks.workunit.client.0.smithi001.stdout:6/862: mknod d0/df/d24/d49/dc7/ddd/c128 0 2024-09-15T22:26:52.547 INFO:tasks.workunit.client.0.smithi001.stdout:6/863: symlink d0/df/d24/d2e/d43/l129 0 2024-09-15T22:26:52.547 INFO:tasks.workunit.client.0.smithi001.stdout:8/780: dwrite d9/fb [0,4194304] 0 2024-09-15T22:26:52.548 INFO:tasks.workunit.client.0.smithi001.stdout:6/864: creat d0/d6/d5d/d67/d53/f12a x:0 0 0 2024-09-15T22:26:52.552 INFO:tasks.workunit.client.0.smithi001.stdout:8/781: creat d9/d19/d40/d9e/dd0/fe0 x:0 0 0 2024-09-15T22:26:52.552 INFO:tasks.workunit.client.0.smithi001.stdout:8/782: chown d9/d19/d29/d35 5895 1 2024-09-15T22:26:52.552 INFO:tasks.workunit.client.0.smithi001.stdout:8/783: mknod d9/d19/d40/d9e/ce1 0 2024-09-15T22:26:52.552 INFO:tasks.workunit.client.0.smithi001.stdout:6/865: creat d0/d6/d5d/d67/d53/da0/dfc/f12b x:0 0 0 2024-09-15T22:26:52.554 INFO:tasks.workunit.client.0.smithi001.stdout:1/811: dread d3/d8d/d91/df5/d68/d8a/f97 [0,4194304] 0 2024-09-15T22:26:52.554 INFO:tasks.workunit.client.0.smithi001.stdout:1/812: write d3/d12/d79/dce/d14/d23/da1/dc6/ffb [942192,96066] 0 2024-09-15T22:26:52.560 INFO:tasks.workunit.client.0.smithi001.stdout:6/866: rmdir d0/df/d24/d49 39 2024-09-15T22:26:52.560 INFO:tasks.workunit.client.0.smithi001.stdout:2/832: read d2/d14/d1a/d80/fae [3341197,442] 0 2024-09-15T22:26:52.560 INFO:tasks.workunit.client.0.smithi001.stdout:2/833: fsync d2/d12/d62/d64/d76/db4/fce 0 2024-09-15T22:26:52.564 INFO:tasks.workunit.client.0.smithi001.stdout:2/834: mkdir d2/d14/d1a/d1b/d82/db0/df6/df8/d118 0 2024-09-15T22:26:52.564 INFO:tasks.workunit.client.0.smithi001.stdout:8/784: dread d9/d19/d29/d50/f73 [0,4194304] 0 2024-09-15T22:26:52.564 INFO:tasks.workunit.client.0.smithi001.stdout:8/785: chown d9/d19/d29/d33/c38 94087 1 2024-09-15T22:26:52.569 INFO:tasks.workunit.client.0.smithi001.stdout:1/813: dread d3/d12/d79/dce/d3c/d64/fa6 [0,4194304] 0 2024-09-15T22:26:52.571 INFO:tasks.workunit.client.0.smithi001.stdout:1/814: mknod d3/d8d/d91/c102 0 2024-09-15T22:26:52.572 INFO:tasks.workunit.client.0.smithi001.stdout:1/815: rename d3/l59 to d3/d12/d79/dce/d53/l103 0 2024-09-15T22:26:52.577 INFO:tasks.workunit.client.0.smithi001.stdout:5/829: dwrite d3/d6/d41/d4d/dbe/d56/f4b [0,4194304] 0 2024-09-15T22:26:52.579 INFO:tasks.workunit.client.0.smithi001.stdout:1/816: dread d3/d12/d79/dce/d14/d1b/f3b [0,4194304] 0 2024-09-15T22:26:52.579 INFO:tasks.workunit.client.0.smithi001.stdout:1/817: read d3/d12/d79/dce/d69/f92 [141391,79260] 0 2024-09-15T22:26:52.581 INFO:tasks.workunit.client.0.smithi001.stdout:6/867: dread d0/d6/d5d/f9d [0,4194304] 0 2024-09-15T22:26:52.583 INFO:tasks.workunit.client.0.smithi001.stdout:0/691: dread d0/d9/db/d5d/fa3 [0,4194304] 0 2024-09-15T22:26:52.583 INFO:tasks.workunit.client.0.smithi001.stdout:3/867: dwrite da/d3d/d43/ffe [0,4194304] 0 2024-09-15T22:26:52.586 INFO:tasks.workunit.client.0.smithi001.stdout:6/868: truncate d0/f22 160043 0 2024-09-15T22:26:52.586 INFO:tasks.workunit.client.0.smithi001.stdout:6/869: write d0/df/d24/d49/fc5 [1224229,58464] 0 2024-09-15T22:26:52.587 INFO:tasks.workunit.client.0.smithi001.stdout:2/835: dread d2/d14/d1a/d1b/d82/dc9/f4b [0,4194304] 0 2024-09-15T22:26:52.588 INFO:tasks.workunit.client.0.smithi001.stdout:6/870: link d0/df/d24/db1/l11f d0/d7e/l12c 0 2024-09-15T22:26:52.588 INFO:tasks.workunit.client.0.smithi001.stdout:6/871: write d0/d6/d5d/d67/f68 [417508,77168] 0 2024-09-15T22:26:52.590 INFO:tasks.workunit.client.0.smithi001.stdout:6/872: creat d0/d6/d5d/dd8/f12d x:0 0 0 2024-09-15T22:26:52.590 INFO:tasks.workunit.client.0.smithi001.stdout:1/818: write d3/f5e [640530,32016] 0 2024-09-15T22:26:52.592 INFO:tasks.workunit.client.0.smithi001.stdout:6/873: creat d0/d6/d5d/d67/d53/da0/d120/f12e x:0 0 0 2024-09-15T22:26:52.592 INFO:tasks.workunit.client.0.smithi001.stdout:6/874: fdatasync d0/d6/d5d/d67/f2b 0 2024-09-15T22:26:52.592 INFO:tasks.workunit.client.0.smithi001.stdout:1/819: mknod d3/d12/d79/dce/d14/d1b/d98/c104 0 2024-09-15T22:26:52.592 INFO:tasks.workunit.client.0.smithi001.stdout:6/875: chown d0/d6/d5d/d67/d53/da0/dfc/l109 68771987 1 2024-09-15T22:26:52.592 INFO:tasks.workunit.client.0.smithi001.stdout:1/820: write d3/d8d/d91/fa9 [1387474,108924] 0 2024-09-15T22:26:52.592 INFO:tasks.workunit.client.0.smithi001.stdout:1/821: getdents d3/d12/df3 0 2024-09-15T22:26:52.595 INFO:tasks.workunit.client.0.smithi001.stdout:1/822: read d3/d12/d79/dce/d14/d1b/fa8 [95607,65005] 0 2024-09-15T22:26:52.595 INFO:tasks.workunit.client.0.smithi001.stdout:1/823: write d3/d12/d79/dce/d3c/d64/f7e [4292963,81144] 0 2024-09-15T22:26:52.595 INFO:tasks.workunit.client.0.smithi001.stdout:1/824: write d3/d12/d79/dce/d3c/f5b [902535,130121] 0 2024-09-15T22:26:52.597 INFO:tasks.workunit.client.0.smithi001.stdout:1/825: rename d3/d12/d79/dce/d14/d1b/d98/f100 to d3/d12/d79/dce/d14/f105 0 2024-09-15T22:26:52.599 INFO:tasks.workunit.client.0.smithi001.stdout:1/826: creat d3/d12/d79/f106 x:0 0 0 2024-09-15T22:26:52.601 INFO:tasks.workunit.client.0.smithi001.stdout:1/827: mkdir d3/d12/d79/dce/d14/db9/d107 0 2024-09-15T22:26:52.601 INFO:tasks.workunit.client.0.smithi001.stdout:1/828: chown d3/d12/d79/dce/d14/d1b/f6c 6694936 1 2024-09-15T22:26:52.601 INFO:tasks.workunit.client.0.smithi001.stdout:1/829: read - d3/d12/dbd/fd9 zero size 2024-09-15T22:26:52.601 INFO:tasks.workunit.client.0.smithi001.stdout:1/830: fsync d3/d12/d79/dce/f34 0 2024-09-15T22:26:52.602 INFO:tasks.workunit.client.0.smithi001.stdout:1/831: truncate d3/d12/d79/dce/d53/fe5 568581 0 2024-09-15T22:26:52.603 INFO:tasks.workunit.client.0.smithi001.stdout:1/832: dread - d3/d8d/dae/ff8 zero size 2024-09-15T22:26:52.603 INFO:tasks.workunit.client.0.smithi001.stdout:1/833: dread - d3/d8d/dd4/fde zero size 2024-09-15T22:26:52.605 INFO:tasks.workunit.client.0.smithi001.stdout:1/834: creat d3/d12/d79/dce/d86/f108 x:0 0 0 2024-09-15T22:26:52.608 INFO:tasks.workunit.client.0.smithi001.stdout:9/754: dread d5/de/d1a/f56 [0,4194304] 0 2024-09-15T22:26:52.609 INFO:tasks.workunit.client.0.smithi001.stdout:9/755: write d5/de/d15/fce [25698,16732] 0 2024-09-15T22:26:52.609 INFO:tasks.workunit.client.0.smithi001.stdout:9/756: readlink d5/de/d1a/d1b/d22/lb1 0 2024-09-15T22:26:52.609 INFO:tasks.workunit.client.0.smithi001.stdout:9/757: readlink d5/de/d51/d53/l85 0 2024-09-15T22:26:52.609 INFO:tasks.workunit.client.0.smithi001.stdout:2/836: read d2/d14/d1a/d1b/d82/dc9/f75 [2254937,34560] 0 2024-09-15T22:26:52.609 INFO:tasks.workunit.client.0.smithi001.stdout:9/758: write d5/f44 [2204930,41127] 0 2024-09-15T22:26:52.609 INFO:tasks.workunit.client.0.smithi001.stdout:2/837: chown d2/d14/d1a/fc0 3686 1 2024-09-15T22:26:52.610 INFO:tasks.workunit.client.0.smithi001.stdout:2/838: creat d2/d12/d62/d64/d76/db4/f119 x:0 0 0 2024-09-15T22:26:52.610 INFO:tasks.workunit.client.0.smithi001.stdout:2/839: write d2/d14/d1a/f10b [867330,88032] 0 2024-09-15T22:26:52.611 INFO:tasks.workunit.client.0.smithi001.stdout:9/759: rmdir d5/de/d15/d27/d63 39 2024-09-15T22:26:52.611 INFO:tasks.workunit.client.0.smithi001.stdout:2/840: dread - d2/d14/d1a/d1b/d82/f107 zero size 2024-09-15T22:26:52.612 INFO:tasks.workunit.client.0.smithi001.stdout:5/830: read d3/d27/d7a/fa8 [3471872,105054] 0 2024-09-15T22:26:52.615 INFO:tasks.workunit.client.0.smithi001.stdout:7/829: dwrite d0/d7/d7c/ff1 [0,4194304] 0 2024-09-15T22:26:52.615 INFO:tasks.workunit.client.0.smithi001.stdout:7/830: fsync d0/d7/d2e/d60/df7/f108 0 2024-09-15T22:26:52.615 INFO:tasks.workunit.client.0.smithi001.stdout:5/831: rmdir d3/d6/d41/d4d/d5a/d84 39 2024-09-15T22:26:52.616 INFO:tasks.workunit.client.0.smithi001.stdout:5/832: write d3/d27/d109/fd3 [890433,44188] 0 2024-09-15T22:26:52.616 INFO:tasks.workunit.client.0.smithi001.stdout:5/833: write d3/d27/d109/fd3 [921377,70904] 0 2024-09-15T22:26:52.616 INFO:tasks.workunit.client.0.smithi001.stdout:5/834: stat d3/d27/f42 0 2024-09-15T22:26:52.617 INFO:tasks.workunit.client.0.smithi001.stdout:5/835: rmdir d3/d6/d41/d4d/dbe/d56/d52/db8 39 2024-09-15T22:26:52.618 INFO:tasks.workunit.client.0.smithi001.stdout:5/836: getdents d3/d27/d5c/dd6 0 2024-09-15T22:26:52.632 INFO:tasks.workunit.client.0.smithi001.stdout:9/760: dread d5/f59 [0,4194304] 0 2024-09-15T22:26:52.632 INFO:tasks.workunit.client.0.smithi001.stdout:9/761: write d5/de/d1a/d1b/d22/d2c/d21/f8e [1191622,84655] 0 2024-09-15T22:26:52.647 INFO:tasks.workunit.client.0.smithi001.stdout:9/762: dread d5/de/d1a/d1b/f89 [0,4194304] 0 2024-09-15T22:26:52.648 INFO:tasks.workunit.client.0.smithi001.stdout:9/763: link d5/de/d15/d27/d63/f7b d5/de/d15/d27/d63/fe3 0 2024-09-15T22:26:52.649 INFO:tasks.workunit.client.0.smithi001.stdout:9/764: chown d5/d3e/ld0 112993 1 2024-09-15T22:26:52.651 INFO:tasks.workunit.client.0.smithi001.stdout:9/765: creat d5/de/d1a/d1b/d22/fe4 x:0 0 0 2024-09-15T22:26:52.654 INFO:tasks.workunit.client.0.smithi001.stdout:6/876: dwrite d0/df/d24/fd4 [0,4194304] 0 2024-09-15T22:26:52.654 INFO:tasks.workunit.client.0.smithi001.stdout:6/877: dread - d0/df/d97/f107 zero size 2024-09-15T22:26:52.654 INFO:tasks.workunit.client.0.smithi001.stdout:6/878: chown d0/df/d24/d2e/fbe 3159 1 2024-09-15T22:26:52.657 INFO:tasks.workunit.client.0.smithi001.stdout:7/831: write d0/d7/d44/f1c [10093054,4159] 0 2024-09-15T22:26:52.657 INFO:tasks.workunit.client.0.smithi001.stdout:7/832: write d0/d7/d2e/d60/f11b [388306,121480] 0 2024-09-15T22:26:52.657 INFO:tasks.workunit.client.0.smithi001.stdout:7/833: stat d0/d7/d44/d3f/ffc 0 2024-09-15T22:26:52.657 INFO:tasks.workunit.client.0.smithi001.stdout:9/766: mkdir d5/de/d15/d27/d63/db6/de5 0 2024-09-15T22:26:52.658 INFO:tasks.workunit.client.0.smithi001.stdout:9/767: readlink d5/de/d1a/d1b/d22/d97/l98 0 2024-09-15T22:26:52.660 INFO:tasks.workunit.client.0.smithi001.stdout:8/786: dwrite d9/d19/d29/d50/d89/fc9 [0,4194304] 0 2024-09-15T22:26:52.660 INFO:tasks.workunit.client.0.smithi001.stdout:3/868: dwrite da/d3d/d43/d7c/d53/ff2 [0,4194304] 0 2024-09-15T22:26:52.660 INFO:tasks.workunit.client.0.smithi001.stdout:6/879: rename d0/d6/d5d/d67/f44 to d0/d6/d5d/d101/f12f 0 2024-09-15T22:26:52.660 INFO:tasks.workunit.client.0.smithi001.stdout:7/834: creat d0/db3/dd6/df5/df6/f121 x:0 0 0 2024-09-15T22:26:52.663 INFO:tasks.workunit.client.0.smithi001.stdout:9/768: creat d5/de/fe6 x:0 0 0 2024-09-15T22:26:52.664 INFO:tasks.workunit.client.0.smithi001.stdout:8/787: getdents d9/d19/d40/d5f/d61/d9f/db3 0 2024-09-15T22:26:52.664 INFO:tasks.workunit.client.0.smithi001.stdout:8/788: chown d9/d19/d40/d9e 29791 1 2024-09-15T22:26:52.664 INFO:tasks.workunit.client.0.smithi001.stdout:6/880: unlink d0/d6/d5d/d67/d53/da0/d120/f12e 0 2024-09-15T22:26:52.665 INFO:tasks.workunit.client.0.smithi001.stdout:6/881: chown d0/df/d24/d7b/db2/f11c 197 1 2024-09-15T22:26:52.665 INFO:tasks.workunit.client.0.smithi001.stdout:6/882: write d0/fb [2943551,73367] 0 2024-09-15T22:26:52.665 INFO:tasks.workunit.client.0.smithi001.stdout:6/883: stat d0/df/d97/f107 0 2024-09-15T22:26:52.665 INFO:tasks.workunit.client.0.smithi001.stdout:6/884: getdents d0/df/d10f 0 2024-09-15T22:26:52.665 INFO:tasks.workunit.client.0.smithi001.stdout:9/769: creat d5/de/d15/d27/dc6/fe7 x:0 0 0 2024-09-15T22:26:52.666 INFO:tasks.workunit.client.0.smithi001.stdout:8/789: creat d9/d19/d34/d41/fe2 x:0 0 0 2024-09-15T22:26:52.666 INFO:tasks.workunit.client.0.smithi001.stdout:3/869: dread da/d3d/d43/d7c/d53/fd2 [0,4194304] 0 2024-09-15T22:26:52.667 INFO:tasks.workunit.client.0.smithi001.stdout:9/770: rename d5/de/d1a/d1b/d22/d2c/d21/d23/c46 to d5/de/d1a/da8/daf/ce8 0 2024-09-15T22:26:52.669 INFO:tasks.workunit.client.0.smithi001.stdout:8/790: symlink d9/d19/d40/d5f/d61/d9f/le3 0 2024-09-15T22:26:52.669 INFO:tasks.workunit.client.0.smithi001.stdout:8/791: truncate d9/f31 2077311 0 2024-09-15T22:26:52.669 INFO:tasks.workunit.client.0.smithi001.stdout:9/771: mknod d5/de/d15/d27/dcb/ce9 0 2024-09-15T22:26:52.671 INFO:tasks.workunit.client.0.smithi001.stdout:9/772: symlink d5/de/d51/d53/d9f/da1/lea 0 2024-09-15T22:26:52.671 INFO:tasks.workunit.client.0.smithi001.stdout:9/773: truncate d5/de/d1a/f64 4822343 0 2024-09-15T22:26:52.671 INFO:tasks.workunit.client.0.smithi001.stdout:8/792: read d9/d19/d29/f2a [461718,93745] 0 2024-09-15T22:26:52.672 INFO:tasks.workunit.client.0.smithi001.stdout:9/774: symlink d5/de/d15/leb 0 2024-09-15T22:26:52.672 INFO:tasks.workunit.client.0.smithi001.stdout:9/775: write d5/de/d1a/f88 [4966214,9699] 0 2024-09-15T22:26:52.677 INFO:tasks.workunit.client.0.smithi001.stdout:1/835: dwrite d3/d12/d79/dce/f58 [0,4194304] 0 2024-09-15T22:26:52.677 INFO:tasks.workunit.client.0.smithi001.stdout:2/841: dwrite d2/d12/f1c [4194304,4194304] 0 2024-09-15T22:26:52.677 INFO:tasks.workunit.client.0.smithi001.stdout:2/842: mknod d2/d14/d1a/d80/c11a 0 2024-09-15T22:26:52.677 INFO:tasks.workunit.client.0.smithi001.stdout:9/776: creat d5/de/d51/d53/d9f/fec x:0 0 0 2024-09-15T22:26:52.677 INFO:tasks.workunit.client.0.smithi001.stdout:2/843: mkdir d2/d14/d1a/d11b 0 2024-09-15T22:26:52.677 INFO:tasks.workunit.client.0.smithi001.stdout:9/777: chown d5/de/d1a/d1b/d22/d2c/d21/l66 1125771 1 2024-09-15T22:26:52.677 INFO:tasks.workunit.client.0.smithi001.stdout:9/778: dread - d5/de/d1a/d1b/d22/fe4 zero size 2024-09-15T22:26:52.677 INFO:tasks.workunit.client.0.smithi001.stdout:9/779: stat d5/d90/fbb 0 2024-09-15T22:26:52.677 INFO:tasks.workunit.client.0.smithi001.stdout:0/692: dwrite d0/d9/f32 [0,4194304] 0 2024-09-15T22:26:52.683 INFO:tasks.workunit.client.0.smithi001.stdout:9/780: mkdir d5/de/d51/ded 0 2024-09-15T22:26:52.684 INFO:tasks.workunit.client.0.smithi001.stdout:0/693: creat d0/d9/db/d5d/fd5 x:0 0 0 2024-09-15T22:26:52.685 INFO:tasks.workunit.client.0.smithi001.stdout:9/781: mknod d5/de/d15/cee 0 2024-09-15T22:26:52.685 INFO:tasks.workunit.client.0.smithi001.stdout:9/782: write d5/de/d15/d27/d63/fe3 [2385139,31938] 0 2024-09-15T22:26:52.685 INFO:tasks.workunit.client.0.smithi001.stdout:0/694: chown d0/d9/f1c 27 1 2024-09-15T22:26:52.689 INFO:tasks.workunit.client.0.smithi001.stdout:9/783: creat d5/de/d51/d53/fef x:0 0 0 2024-09-15T22:26:52.690 INFO:tasks.workunit.client.0.smithi001.stdout:3/870: dread da/d16/ff [0,4194304] 0 2024-09-15T22:26:52.697 INFO:tasks.workunit.client.0.smithi001.stdout:3/871: mknod da/d16/c12e 0 2024-09-15T22:26:52.697 INFO:tasks.workunit.client.0.smithi001.stdout:1/836: dread d3/d12/d79/dce/d3c/d7d/f88 [0,4194304] 0 2024-09-15T22:26:52.698 INFO:tasks.workunit.client.0.smithi001.stdout:3/872: rmdir da/dae/d8e 39 2024-09-15T22:26:52.700 INFO:tasks.workunit.client.0.smithi001.stdout:1/837: mknod d3/d8d/d91/c109 0 2024-09-15T22:26:52.702 INFO:tasks.workunit.client.0.smithi001.stdout:3/873: rename da/d16/c107 to da/d3d/d43/d7c/d3f/db5/d128/c12f 0 2024-09-15T22:26:52.702 INFO:tasks.workunit.client.0.smithi001.stdout:1/838: write d3/d12/d79/dce/d3c/d64/fa6 [4775805,102138] 0 2024-09-15T22:26:52.702 INFO:tasks.workunit.client.0.smithi001.stdout:3/874: mknod da/d101/c130 0 2024-09-15T22:26:52.702 INFO:tasks.workunit.client.0.smithi001.stdout:3/875: fdatasync da/d90/d6f/f71 0 2024-09-15T22:26:52.702 INFO:tasks.workunit.client.0.smithi001.stdout:3/876: fdatasync da/d3b/d1b/f12c 0 2024-09-15T22:26:52.707 INFO:tasks.workunit.client.0.smithi001.stdout:1/839: symlink d3/d12/d79/l10a 0 2024-09-15T22:26:52.707 INFO:tasks.workunit.client.0.smithi001.stdout:3/877: creat da/d3d/d43/d41/df1/d7f/d126/f131 x:0 0 0 2024-09-15T22:26:52.715 INFO:tasks.workunit.client.0.smithi001.stdout:5/837: dread d3/d6/d41/d4d/dbe/f9e [0,4194304] 0 2024-09-15T22:26:52.716 INFO:tasks.workunit.client.0.smithi001.stdout:5/838: readlink d3/d6/d41/d4d/d91/laa 0 2024-09-15T22:26:52.716 INFO:tasks.workunit.client.0.smithi001.stdout:5/839: truncate d3/d6/d41/d4d/dbe/d56/ddc/ff2 169773 0 2024-09-15T22:26:52.716 INFO:tasks.workunit.client.0.smithi001.stdout:5/840: chown d3/d27/f3a 7744 1 2024-09-15T22:26:52.716 INFO:tasks.workunit.client.0.smithi001.stdout:5/841: write d3/d6/d41/d4d/dbe/d56/d52/d61/f71 [1780319,30300] 0 2024-09-15T22:26:52.716 INFO:tasks.workunit.client.0.smithi001.stdout:5/842: mknod d3/d6/d41/d4d/dbe/d56/d52/d61/dee/def/c111 0 2024-09-15T22:26:52.716 INFO:tasks.workunit.client.0.smithi001.stdout:5/843: chown d3/d1d/fea 506778 1 2024-09-15T22:26:52.717 INFO:tasks.workunit.client.0.smithi001.stdout:2/844: dread d2/d12/d62/d64/f2a [0,4194304] 0 2024-09-15T22:26:52.717 INFO:tasks.workunit.client.0.smithi001.stdout:2/845: fsync d2/d14/d1a/d1b/d82/d97/d74/f110 0 2024-09-15T22:26:52.718 INFO:tasks.workunit.client.0.smithi001.stdout:5/844: link d3/d49/f7e d3/d6/d41/d88/df0/f112 0 2024-09-15T22:26:52.721 INFO:tasks.workunit.client.0.smithi001.stdout:5/845: readlink d3/d27/d7a/l10f 0 2024-09-15T22:26:52.728 INFO:tasks.workunit.client.0.smithi001.stdout:1/840: dread d3/f39 [4194304,4194304] 0 2024-09-15T22:26:52.732 INFO:tasks.workunit.client.0.smithi001.stdout:8/793: dwrite d9/d19/d29/f2a [0,4194304] 0 2024-09-15T22:26:52.732 INFO:tasks.workunit.client.0.smithi001.stdout:5/846: read d3/d6/d41/d4d/dbe/f9e [726754,89862] 0 2024-09-15T22:26:52.732 INFO:tasks.workunit.client.0.smithi001.stdout:7/835: dwrite d0/d7/d44/d3f/fa6 [0,4194304] 0 2024-09-15T22:26:52.733 INFO:tasks.workunit.client.0.smithi001.stdout:5/847: creat d3/d49/f113 x:0 0 0 2024-09-15T22:26:52.733 INFO:tasks.workunit.client.0.smithi001.stdout:5/848: chown d3/d6/d41/d88/db0/d10e 9651225 1 2024-09-15T22:26:52.733 INFO:tasks.workunit.client.0.smithi001.stdout:5/849: stat d3/d6/d41/d88/df0 0 2024-09-15T22:26:52.734 INFO:tasks.workunit.client.0.smithi001.stdout:5/850: mknod d3/c114 0 2024-09-15T22:26:52.768 INFO:tasks.workunit.client.0.smithi001.stdout:8/794: dwrite d9/d19/d58/d8e/fac [0,4194304] 0 2024-09-15T22:26:52.784 INFO:tasks.workunit.client.0.smithi001.stdout:6/885: dwrite d0/df/d24/d49/dc7/fec [0,4194304] 0 2024-09-15T22:26:52.790 INFO:tasks.workunit.client.0.smithi001.stdout:7/836: dread d0/d7/d44/f1c [0,4194304] 0 2024-09-15T22:26:52.793 INFO:tasks.workunit.client.0.smithi001.stdout:7/837: mkdir d0/d7/d7c/d122 0 2024-09-15T22:26:52.793 INFO:tasks.workunit.client.0.smithi001.stdout:7/838: truncate d0/d7/dc6/f9d 938208 0 2024-09-15T22:26:52.797 INFO:tasks.workunit.client.0.smithi001.stdout:7/839: symlink d0/d98/l123 0 2024-09-15T22:26:52.797 INFO:tasks.workunit.client.0.smithi001.stdout:7/840: write d0/d7/d44/d3f/f75 [2315322,34082] 0 2024-09-15T22:26:52.800 INFO:tasks.workunit.client.0.smithi001.stdout:1/841: dread d3/d12/d79/dce/d3c/d64/fbb [0,4194304] 0 2024-09-15T22:26:52.800 INFO:tasks.workunit.client.0.smithi001.stdout:1/842: readlink d3/d8d/d91/df5/d68/d8a/lcf 0 2024-09-15T22:26:52.806 INFO:tasks.workunit.client.0.smithi001.stdout:1/843: link d3/fc9 d3/d12/d79/dce/d14/d23/da1/da2/f10b 0 2024-09-15T22:26:52.806 INFO:tasks.workunit.client.0.smithi001.stdout:1/844: chown d3/d12/d79/f106 10954049 1 2024-09-15T22:26:52.808 INFO:tasks.workunit.client.0.smithi001.stdout:9/784: dwrite d5/de/d1a/d1b/f70 [0,4194304] 0 2024-09-15T22:26:52.809 INFO:tasks.workunit.client.0.smithi001.stdout:3/878: dwrite da/d3d/d43/d7c/d3f/db5/df9/fdf [0,4194304] 0 2024-09-15T22:26:52.809 INFO:tasks.workunit.client.0.smithi001.stdout:3/879: dread - da/d3d/d43/d7c/d3f/db5/dce/ffa zero size 2024-09-15T22:26:52.812 INFO:tasks.workunit.client.0.smithi001.stdout:9/785: creat d5/d90/ff0 x:0 0 0 2024-09-15T22:26:52.812 INFO:tasks.workunit.client.0.smithi001.stdout:9/786: chown d5/de/d1a/d1b/d22/d2c/d21/f8e 415 1 2024-09-15T22:26:52.812 INFO:tasks.workunit.client.0.smithi001.stdout:9/787: stat d5/d3e/cb9 0 2024-09-15T22:26:52.812 INFO:tasks.workunit.client.0.smithi001.stdout:9/788: fsync d5/de/d1a/f8b 0 2024-09-15T22:26:52.812 INFO:tasks.workunit.client.0.smithi001.stdout:9/789: write d5/de/d1a/d1b/d22/f65 [879109,31827] 0 2024-09-15T22:26:52.813 INFO:tasks.workunit.client.0.smithi001.stdout:9/790: mkdir d5/de/da9/df1 0 2024-09-15T22:26:52.813 INFO:tasks.workunit.client.0.smithi001.stdout:9/791: chown d5/de/d1a/d1b/d22/d2c/d21/la6 1 1 2024-09-15T22:26:52.815 INFO:tasks.workunit.client.0.smithi001.stdout:9/792: mknod d5/de/d51/d53/d9f/cf2 0 2024-09-15T22:26:52.825 INFO:tasks.workunit.client.0.smithi001.stdout:3/880: read da/d3d/d43/d41/df1/ff0 [7818799,22497] 0 2024-09-15T22:26:52.827 INFO:tasks.workunit.client.0.smithi001.stdout:3/881: unlink da/d3d/d43/d7c/d3f/db5/fef 0 2024-09-15T22:26:52.828 INFO:tasks.workunit.client.0.smithi001.stdout:3/882: creat da/dae/f132 x:0 0 0 2024-09-15T22:26:52.831 INFO:tasks.workunit.client.0.smithi001.stdout:9/793: dread d5/de/d1a/d1b/f89 [0,4194304] 0 2024-09-15T22:26:52.831 INFO:tasks.workunit.client.0.smithi001.stdout:9/794: chown d5/de/d1a/d1b/d22/d2c/d21/d24/d86/f93 15379798 1 2024-09-15T22:26:52.833 INFO:tasks.workunit.client.0.smithi001.stdout:9/795: rename d5/de/d1a/d1b/d22/d2c/d21/d23/fac to d5/de/d1a/d1b/d22/ff3 0 2024-09-15T22:26:52.834 INFO:tasks.workunit.client.0.smithi001.stdout:9/796: creat d5/de/d15/d27/dc6/ff4 x:0 0 0 2024-09-15T22:26:52.835 INFO:tasks.workunit.client.0.smithi001.stdout:9/797: rename d5/de/d15/leb to d5/de/d51/ded/lf5 0 2024-09-15T22:26:52.836 INFO:tasks.workunit.client.0.smithi001.stdout:8/795: dwrite d9/f6d [0,4194304] 0 2024-09-15T22:26:52.841 INFO:tasks.workunit.client.0.smithi001.stdout:7/841: dread d0/d7/d2e/d60/d10d/fbb [0,4194304] 0 2024-09-15T22:26:52.841 INFO:tasks.workunit.client.0.smithi001.stdout:9/798: symlink d5/de/d1a/d1b/d2a/lf6 0 2024-09-15T22:26:52.845 INFO:tasks.workunit.client.0.smithi001.stdout:2/846: dwrite d2/d14/d1a/d1b/d82/dc9/fa3 [0,4194304] 0 2024-09-15T22:26:52.845 INFO:tasks.workunit.client.0.smithi001.stdout:2/847: fdatasync d2/d14/d1a/d1b/d82/dc9/d6f/d70/fd8 0 2024-09-15T22:26:52.845 INFO:tasks.workunit.client.0.smithi001.stdout:2/848: chown d2/d12/d62/d4c/cf7 16341 1 2024-09-15T22:26:52.848 INFO:tasks.workunit.client.0.smithi001.stdout:2/849: creat d2/d14/d1a/d1b/d82/dc9/f11c x:0 0 0 2024-09-15T22:26:52.858 INFO:tasks.workunit.client.0.smithi001.stdout:6/886: dwrite d0/d6/d5d/dd8/ff3 [0,4194304] 0 2024-09-15T22:26:52.858 INFO:tasks.workunit.client.0.smithi001.stdout:1/845: dwrite d3/d12/d79/dce/d3c/d64/fbb [0,4194304] 0 2024-09-15T22:26:52.861 INFO:tasks.workunit.client.0.smithi001.stdout:1/846: fsync d3/d12/d79/dce/d14/d23/da1/da2/f10b 0 2024-09-15T22:26:52.863 INFO:tasks.workunit.client.0.smithi001.stdout:1/847: read d3/d12/d79/dce/d3c/f5b [664730,10419] 0 2024-09-15T22:26:52.863 INFO:tasks.workunit.client.0.smithi001.stdout:1/848: chown d3/d8d/dae/ff8 91754 1 2024-09-15T22:26:52.869 INFO:tasks.workunit.client.0.smithi001.stdout:1/849: mknod d3/d12/d21/d82/c10c 0 2024-09-15T22:26:52.870 INFO:tasks.workunit.client.0.smithi001.stdout:2/850: dread d2/d14/f96 [0,4194304] 0 2024-09-15T22:26:52.871 INFO:tasks.workunit.client.0.smithi001.stdout:2/851: mkdir d2/d14/d1a/d1b/d82/db0/df6/d11d 0 2024-09-15T22:26:52.872 INFO:tasks.workunit.client.0.smithi001.stdout:2/852: symlink d2/d14/d1a/l11e 0 2024-09-15T22:26:52.873 INFO:tasks.workunit.client.0.smithi001.stdout:8/796: dwrite d9/d19/d58/d8e/d9c/fce [0,4194304] 0 2024-09-15T22:26:52.875 INFO:tasks.workunit.client.0.smithi001.stdout:0/695: sync 2024-09-15T22:26:52.876 INFO:tasks.workunit.client.0.smithi001.stdout:8/797: creat d9/d19/d40/d5f/fe4 x:0 0 0 2024-09-15T22:26:52.877 INFO:tasks.workunit.client.0.smithi001.stdout:8/798: symlink d9/le5 0 2024-09-15T22:26:52.878 INFO:tasks.workunit.client.0.smithi001.stdout:8/799: truncate d9/d19/d58/f4e 1257436 0 2024-09-15T22:26:52.879 INFO:tasks.workunit.client.0.smithi001.stdout:8/800: write d9/d19/d58/d8e/fc3 [1038157,91801] 0 2024-09-15T22:26:52.880 INFO:tasks.workunit.client.0.smithi001.stdout:8/801: unlink d9/d19/d58/d88/f9b 0 2024-09-15T22:26:52.881 INFO:tasks.workunit.client.0.smithi001.stdout:8/802: symlink d9/d19/d34/da4/le6 0 2024-09-15T22:26:52.882 INFO:tasks.workunit.client.0.smithi001.stdout:1/850: write d3/d12/d79/dce/d86/fbf [948352,21818] 0 2024-09-15T22:26:52.883 INFO:tasks.workunit.client.0.smithi001.stdout:1/851: rmdir d3/d8d/d91/df5/d68 39 2024-09-15T22:26:52.891 INFO:tasks.workunit.client.0.smithi001.stdout:1/852: truncate d3/d12/d79/dce/d86/fbf 1134174 0 2024-09-15T22:26:52.908 INFO:tasks.workunit.client.0.smithi001.stdout:6/887: dwrite d0/d6/d5d/d67/d53/f12a [0,4194304] 0 2024-09-15T22:26:52.910 INFO:tasks.workunit.client.0.smithi001.stdout:1/853: dread d3/f11 [0,4194304] 0 2024-09-15T22:26:52.911 INFO:tasks.workunit.client.0.smithi001.stdout:6/888: creat d0/d6/d5d/d67/d53/da0/deb/f130 x:0 0 0 2024-09-15T22:26:52.912 INFO:tasks.workunit.client.0.smithi001.stdout:1/854: truncate d3/d12/d79/dce/d3c/d7d/f88 3909184 0 2024-09-15T22:26:52.912 INFO:tasks.workunit.client.0.smithi001.stdout:6/889: fsync d0/df/d24/d2e/d43/f4a 0 2024-09-15T22:26:52.914 INFO:tasks.workunit.client.0.smithi001.stdout:1/855: link d3/d12/d79/dce/d14/la7 d3/d8d/l10d 0 2024-09-15T22:26:52.916 INFO:tasks.workunit.client.0.smithi001.stdout:1/856: mknod d3/d12/d21/d82/c10e 0 2024-09-15T22:26:52.918 INFO:tasks.workunit.client.0.smithi001.stdout:1/857: mkdir d3/d12/d79/dce/d14/daa/d10f 0 2024-09-15T22:26:52.918 INFO:tasks.workunit.client.0.smithi001.stdout:1/858: truncate d3/d12/d79/dce/d53/fcb 855246 0 2024-09-15T22:26:52.926 INFO:tasks.workunit.client.0.smithi001.stdout:6/890: dread d0/df/d24/f7f [0,4194304] 0 2024-09-15T22:26:52.928 INFO:tasks.workunit.client.0.smithi001.stdout:6/891: link d0/d6/d5d/d67/d53/f72 d0/d6/d5d/d67/dc4/f131 0 2024-09-15T22:26:52.929 INFO:tasks.workunit.client.0.smithi001.stdout:6/892: write d0/d6/f3e [4915222,20438] 0 2024-09-15T22:26:52.931 INFO:tasks.workunit.client.0.smithi001.stdout:0/696: dwrite d0/d9/f38 [4194304,4194304] 0 2024-09-15T22:26:52.934 INFO:tasks.workunit.client.0.smithi001.stdout:0/697: creat d0/d6/fd6 x:0 0 0 2024-09-15T22:26:52.935 INFO:tasks.workunit.client.0.smithi001.stdout:2/853: dwrite d2/f2b [0,4194304] 0 2024-09-15T22:26:52.937 INFO:tasks.workunit.client.0.smithi001.stdout:2/854: creat d2/d14/d1a/d8a/f11f x:0 0 0 2024-09-15T22:26:52.939 INFO:tasks.workunit.client.0.smithi001.stdout:2/855: rename d2/d12/d62/d4c/cf7 to d2/d12/d62/d64/d76/db4/c120 0 2024-09-15T22:26:52.940 INFO:tasks.workunit.client.0.smithi001.stdout:1/859: dread d3/d8d/d91/df5/de6/fea [0,4194304] 0 2024-09-15T22:26:52.940 INFO:tasks.workunit.client.0.smithi001.stdout:1/860: chown d3/fee 1 1 2024-09-15T22:26:52.940 INFO:tasks.workunit.client.0.smithi001.stdout:2/856: write d2/d14/d1a/d1b/d82/d97/d74/fe6 [4953686,82847] 0 2024-09-15T22:26:52.941 INFO:tasks.workunit.client.0.smithi001.stdout:6/893: write d0/d6/d5d/d101/f12f [2565356,31860] 0 2024-09-15T22:26:52.942 INFO:tasks.workunit.client.0.smithi001.stdout:2/857: unlink d2/d12/d62/d4c/d9d/f9e 0 2024-09-15T22:26:52.948 INFO:tasks.workunit.client.0.smithi001.stdout:1/861: rename d3/l94 to d3/d12/d90/l110 0 2024-09-15T22:26:52.950 INFO:tasks.workunit.client.0.smithi001.stdout:1/862: creat d3/d12/d79/dce/d14/d23/da1/da2/f111 x:0 0 0 2024-09-15T22:26:52.952 INFO:tasks.workunit.client.0.smithi001.stdout:1/863: stat d3/d12/d21/cc3 0 2024-09-15T22:26:52.954 INFO:tasks.workunit.client.0.smithi001.stdout:1/864: write d3/d12/d79/dce/d3c/f5b [1572028,15060] 0 2024-09-15T22:26:52.954 INFO:tasks.workunit.client.0.smithi001.stdout:8/803: dwrite d9/f11 [0,4194304] 0 2024-09-15T22:26:52.958 INFO:tasks.workunit.client.0.smithi001.stdout:8/804: creat d9/d19/d58/fe7 x:0 0 0 2024-09-15T22:26:52.959 INFO:tasks.workunit.client.0.smithi001.stdout:1/865: mkdir d3/d12/d79/dce/d14/d23/d112 0 2024-09-15T22:26:52.961 INFO:tasks.workunit.client.0.smithi001.stdout:8/805: rename d9/d19/d40/l48 to d9/d19/d58/d8e/d9c/le8 0 2024-09-15T22:26:52.961 INFO:tasks.workunit.client.0.smithi001.stdout:8/806: truncate d9/d19/d29/f45 488382 0 2024-09-15T22:26:52.983 INFO:tasks.workunit.client.0.smithi001.stdout:9/799: sync 2024-09-15T22:26:52.983 INFO:tasks.workunit.client.0.smithi001.stdout:7/842: sync 2024-09-15T22:26:52.983 INFO:tasks.workunit.client.0.smithi001.stdout:5/851: sync 2024-09-15T22:26:52.985 INFO:tasks.workunit.client.0.smithi001.stdout:9/800: mkdir d5/de/d1a/d38/df7 0 2024-09-15T22:26:52.985 INFO:tasks.workunit.client.0.smithi001.stdout:3/883: sync 2024-09-15T22:26:52.985 INFO:tasks.workunit.client.0.smithi001.stdout:3/884: stat da/dae/f8a 0 2024-09-15T22:26:52.990 INFO:tasks.workunit.client.0.smithi001.stdout:9/801: creat d5/de/d1a/d38/ff8 x:0 0 0 2024-09-15T22:26:52.990 INFO:tasks.workunit.client.0.smithi001.stdout:7/843: symlink d0/dd3/l124 0 2024-09-15T22:26:52.990 INFO:tasks.workunit.client.0.smithi001.stdout:3/885: mknod da/d3d/d43/d7c/d3f/db5/dce/c133 0 2024-09-15T22:26:52.992 INFO:tasks.workunit.client.0.smithi001.stdout:5/852: dread d3/d27/d4e/d89/f9b [0,4194304] 0 2024-09-15T22:26:52.992 INFO:tasks.workunit.client.0.smithi001.stdout:7/844: symlink d0/dd3/l125 0 2024-09-15T22:26:52.992 INFO:tasks.workunit.client.0.smithi001.stdout:5/853: chown d3/l15 50154120 1 2024-09-15T22:26:52.992 INFO:tasks.workunit.client.0.smithi001.stdout:5/854: fsync d3/d49/fc1 0 2024-09-15T22:26:52.992 INFO:tasks.workunit.client.0.smithi001.stdout:5/855: truncate d3/d6/d41/d4d/fcb 323956 0 2024-09-15T22:26:52.995 INFO:tasks.workunit.client.0.smithi001.stdout:0/698: dwrite d0/d51/fbb [0,4194304] 0 2024-09-15T22:26:52.995 INFO:tasks.workunit.client.0.smithi001.stdout:0/699: fdatasync d0/dd/d63/fca 0 2024-09-15T22:26:52.995 INFO:tasks.workunit.client.0.smithi001.stdout:0/700: write d0/f16 [1648646,82666] 0 2024-09-15T22:26:52.995 INFO:tasks.workunit.client.0.smithi001.stdout:7/845: mkdir d0/db3/dd6/d126 0 2024-09-15T22:26:52.998 INFO:tasks.workunit.client.0.smithi001.stdout:7/846: getdents d0/d7/d2e/d60/df7 0 2024-09-15T22:26:53.001 INFO:tasks.workunit.client.0.smithi001.stdout:0/701: unlink d0/d9/d1a/d36/c54 0 2024-09-15T22:26:53.003 INFO:tasks.workunit.client.0.smithi001.stdout:0/702: mknod d0/d9/db/d5d/cd7 0 2024-09-15T22:26:53.008 INFO:tasks.workunit.client.0.smithi001.stdout:6/894: dwrite d0/f5 [4194304,4194304] 0 2024-09-15T22:26:53.010 INFO:tasks.workunit.client.0.smithi001.stdout:5/856: write d3/d27/f90 [1673482,9668] 0 2024-09-15T22:26:53.010 INFO:tasks.workunit.client.0.smithi001.stdout:5/857: stat d3/d1d/c31 0 2024-09-15T22:26:53.010 INFO:tasks.workunit.client.0.smithi001.stdout:5/858: dread - d3/d27/d109/ff9 zero size 2024-09-15T22:26:53.011 INFO:tasks.workunit.client.0.smithi001.stdout:5/859: write d3/d6/d41/d4d/dbe/d56/d52/d61/f71 [692250,121014] 0 2024-09-15T22:26:53.011 INFO:tasks.workunit.client.0.smithi001.stdout:5/860: readlink d3/d6/d41/d4d/d5a/l5b 0 2024-09-15T22:26:53.012 INFO:tasks.workunit.client.0.smithi001.stdout:5/861: rmdir d3/d6/d57 39 2024-09-15T22:26:53.014 INFO:tasks.workunit.client.0.smithi001.stdout:5/862: rmdir d3/d27/d7a/d80 39 2024-09-15T22:26:53.014 INFO:tasks.workunit.client.0.smithi001.stdout:5/863: chown d3/d6/d57/d87/f106 107666 1 2024-09-15T22:26:53.015 INFO:tasks.workunit.client.0.smithi001.stdout:6/895: dread d0/df/d24/d2e/f86 [0,4194304] 0 2024-09-15T22:26:53.015 INFO:tasks.workunit.client.0.smithi001.stdout:6/896: fsync d0/f2 0 2024-09-15T22:26:53.015 INFO:tasks.workunit.client.0.smithi001.stdout:6/897: dread - d0/df/d24/d2e/d43/f73 zero size 2024-09-15T22:26:53.015 INFO:tasks.workunit.client.0.smithi001.stdout:5/864: rename d3/d6/d41/l8e to d3/d6/d41/d4d/l115 0 2024-09-15T22:26:53.017 INFO:tasks.workunit.client.0.smithi001.stdout:5/865: mkdir d3/d6/d41/d88/da5/d107/d116 0 2024-09-15T22:26:53.018 INFO:tasks.workunit.client.0.smithi001.stdout:1/866: dwrite d3/d12/d79/dce/d3c/d64/fbb [0,4194304] 0 2024-09-15T22:26:53.018 INFO:tasks.workunit.client.0.smithi001.stdout:5/866: creat d3/d6/f117 x:0 0 0 2024-09-15T22:26:53.018 INFO:tasks.workunit.client.0.smithi001.stdout:8/807: dwrite d9/d19/d58/d8e/fac [0,4194304] 0 2024-09-15T22:26:53.022 INFO:tasks.workunit.client.0.smithi001.stdout:1/867: mknod d3/d12/d79/dce/d53/dc7/c113 0 2024-09-15T22:26:53.024 INFO:tasks.workunit.client.0.smithi001.stdout:1/868: rename d3/d12/l20 to d3/d12/d21/d82/l114 0 2024-09-15T22:26:53.025 INFO:tasks.workunit.client.0.smithi001.stdout:2/858: dwrite d2/d14/d1a/d80/fae [0,4194304] 0 2024-09-15T22:26:53.025 INFO:tasks.workunit.client.0.smithi001.stdout:2/859: readlink d2/lbf 0 2024-09-15T22:26:53.029 INFO:tasks.workunit.client.0.smithi001.stdout:7/847: write d0/d7/d21/d6b/fed [824380,70817] 0 2024-09-15T22:26:53.030 INFO:tasks.workunit.client.0.smithi001.stdout:2/860: mkdir d2/d12/d62/d121 0 2024-09-15T22:26:53.031 INFO:tasks.workunit.client.0.smithi001.stdout:1/869: rename d3/d12/d79/dce/d14/d23/f9d to d3/d12/d79/dce/d14/d1b/d98/f115 0 2024-09-15T22:26:53.041 INFO:tasks.workunit.client.0.smithi001.stdout:1/870: rmdir d3/d12/d21 39 2024-09-15T22:26:53.042 INFO:tasks.workunit.client.0.smithi001.stdout:2/861: unlink d2/d14/d1a/d1b/d82/dc9/f3c 0 2024-09-15T22:26:53.042 INFO:tasks.workunit.client.0.smithi001.stdout:2/862: readlink d2/d12/d62/d64/d76/l81 0 2024-09-15T22:26:53.042 INFO:tasks.workunit.client.0.smithi001.stdout:5/867: dread d3/d27/d7a/fa8 [0,4194304] 0 2024-09-15T22:26:53.043 INFO:tasks.workunit.client.0.smithi001.stdout:1/871: symlink d3/d12/d79/dce/d3c/d4c/l116 0 2024-09-15T22:26:53.043 INFO:tasks.workunit.client.0.smithi001.stdout:1/872: write d3/d12/d79/dce/d14/d1b/f6c [892388,3964] 0 2024-09-15T22:26:53.044 INFO:tasks.workunit.client.0.smithi001.stdout:5/868: creat d3/d6/d41/d4d/dbe/de6/f118 x:0 0 0 2024-09-15T22:26:53.044 INFO:tasks.workunit.client.0.smithi001.stdout:2/863: unlink d2/d14/d1a/f69 0 2024-09-15T22:26:53.045 INFO:tasks.workunit.client.0.smithi001.stdout:1/873: rmdir d3/d12/d79/dce/d14/d23/da1/da2 39 2024-09-15T22:26:53.046 INFO:tasks.workunit.client.0.smithi001.stdout:5/869: symlink d3/d6/d41/d4d/l119 0 2024-09-15T22:26:53.047 INFO:tasks.workunit.client.0.smithi001.stdout:1/874: truncate d3/d12/d79/dce/f58 2158896 0 2024-09-15T22:26:53.048 INFO:tasks.workunit.client.0.smithi001.stdout:5/870: symlink d3/d6/d41/d4d/dbe/d56/d52/l11a 0 2024-09-15T22:26:53.052 INFO:tasks.workunit.client.0.smithi001.stdout:5/871: chown d3/d6/d41/d4d/d5a/d84/lff 5 1 2024-09-15T22:26:53.052 INFO:tasks.workunit.client.0.smithi001.stdout:9/802: dwrite d5/de/d1a/d1b/d22/d2c/f61 [0,4194304] 0 2024-09-15T22:26:53.053 INFO:tasks.workunit.client.0.smithi001.stdout:3/886: dwrite da/d3d/d43/d41/f5e [0,4194304] 0 2024-09-15T22:26:53.053 INFO:tasks.workunit.client.0.smithi001.stdout:1/875: mknod d3/d12/d79/dce/d53/dc7/ddb/c117 0 2024-09-15T22:26:53.053 INFO:tasks.workunit.client.0.smithi001.stdout:0/703: write d0/d6/d6a/f8d [2666659,38510] 0 2024-09-15T22:26:53.054 INFO:tasks.workunit.client.0.smithi001.stdout:3/887: symlink da/d90/d92/l134 0 2024-09-15T22:26:53.054 INFO:tasks.workunit.client.0.smithi001.stdout:3/888: fdatasync da/d90/d6f/dc7/fd0 0 2024-09-15T22:26:53.056 INFO:tasks.workunit.client.0.smithi001.stdout:3/889: creat da/d3b/d1b/dcf/f135 x:0 0 0 2024-09-15T22:26:53.056 INFO:tasks.workunit.client.0.smithi001.stdout:3/890: readlink da/d90/d6f/l82 0 2024-09-15T22:26:53.057 INFO:tasks.workunit.client.0.smithi001.stdout:3/891: truncate da/d16/ff 7985363 0 2024-09-15T22:26:53.062 INFO:tasks.workunit.client.0.smithi001.stdout:3/892: getdents da/d3d/d43/d41/df1/d7f/d126 0 2024-09-15T22:26:53.064 INFO:tasks.workunit.client.0.smithi001.stdout:3/893: link da/d3d/d43/d41/df1/ff0 da/d3d/d43/d7c/d3f/f136 0 2024-09-15T22:26:53.068 INFO:tasks.workunit.client.0.smithi001.stdout:3/894: rename da/d3d/d43/d41/df1/l81 to da/d3b/d1b/l137 0 2024-09-15T22:26:53.071 INFO:tasks.workunit.client.0.smithi001.stdout:9/803: write d5/de/d1a/f88 [1755221,50619] 0 2024-09-15T22:26:53.071 INFO:tasks.workunit.client.0.smithi001.stdout:9/804: readlink d5/de/d51/d53/d9f/da1/lea 0 2024-09-15T22:26:53.071 INFO:tasks.workunit.client.0.smithi001.stdout:9/805: chown d5/de/d1a/d1b/d22/d2c/d21/d23/d3d/fb5 183926 1 2024-09-15T22:26:53.076 INFO:tasks.workunit.client.0.smithi001.stdout:2/864: write d2/d14/d1a/d8a/fbc [942383,107191] 0 2024-09-15T22:26:53.076 INFO:tasks.workunit.client.0.smithi001.stdout:7/848: dwrite d0/d7/d2e/d60/f11b [0,4194304] 0 2024-09-15T22:26:53.077 INFO:tasks.workunit.client.0.smithi001.stdout:1/876: write d3/d8d/d91/df5/fb1 [690299,6187] 0 2024-09-15T22:26:53.077 INFO:tasks.workunit.client.0.smithi001.stdout:9/806: getdents d5/de/d15/d27/d63 0 2024-09-15T22:26:53.078 INFO:tasks.workunit.client.0.smithi001.stdout:2/865: creat d2/d14/d1a/d1b/d82/db0/df6/df8/f122 x:0 0 0 2024-09-15T22:26:53.079 INFO:tasks.workunit.client.0.smithi001.stdout:1/877: mkdir d3/d12/d79/dce/d3c/d4c/dcc/d118 0 2024-09-15T22:26:53.080 INFO:tasks.workunit.client.0.smithi001.stdout:9/807: mknod d5/de/d15/d27/d63/cf9 0 2024-09-15T22:26:53.080 INFO:tasks.workunit.client.0.smithi001.stdout:9/808: chown d5/de/d1a/d1b/d22/d2c/d21/d24 6855345 1 2024-09-15T22:26:53.081 INFO:tasks.workunit.client.0.smithi001.stdout:1/878: read d3/f3f [68180,117711] 0 2024-09-15T22:26:53.081 INFO:tasks.workunit.client.0.smithi001.stdout:1/879: write d3/d12/d79/dce/d14/d1b/f6c [1744447,84626] 0 2024-09-15T22:26:53.081 INFO:tasks.workunit.client.0.smithi001.stdout:2/866: symlink d2/d14/d1a/d1b/d82/db0/df6/df8/l123 0 2024-09-15T22:26:53.081 INFO:tasks.workunit.client.0.smithi001.stdout:9/809: mknod d5/de/d1a/d38/cfa 0 2024-09-15T22:26:53.082 INFO:tasks.workunit.client.0.smithi001.stdout:1/880: rmdir d3/d12/d79/dce/d14/db9 39 2024-09-15T22:26:53.082 INFO:tasks.workunit.client.0.smithi001.stdout:1/881: stat d3/d12/d79/dce/d14/d1b 0 2024-09-15T22:26:53.083 INFO:tasks.workunit.client.0.smithi001.stdout:2/867: truncate d2/d12/d62/f4e 17653 0 2024-09-15T22:26:53.083 INFO:tasks.workunit.client.0.smithi001.stdout:2/868: dread - d2/d12/dec/f115 zero size 2024-09-15T22:26:53.084 INFO:tasks.workunit.client.0.smithi001.stdout:9/810: link d5/de/d1a/d1b/d22/d2c/ce0 d5/de/d1a/d1b/d22/d2c/d21/d4d/dca/cfb 0 2024-09-15T22:26:53.085 INFO:tasks.workunit.client.0.smithi001.stdout:2/869: symlink d2/d12/dec/l124 0 2024-09-15T22:26:53.085 INFO:tasks.workunit.client.0.smithi001.stdout:2/870: read - d2/d14/d1a/d1b/d82/fda zero size 2024-09-15T22:26:53.086 INFO:tasks.workunit.client.0.smithi001.stdout:2/871: symlink d2/d14/d1a/d1b/d82/db0/df6/d11d/l125 0 2024-09-15T22:26:53.086 INFO:tasks.workunit.client.0.smithi001.stdout:2/872: readlink d2/d14/d1a/d1b/l4f 0 2024-09-15T22:26:53.087 INFO:tasks.workunit.client.0.smithi001.stdout:6/898: dwrite d0/fb [4194304,4194304] 0 2024-09-15T22:26:53.087 INFO:tasks.workunit.client.0.smithi001.stdout:6/899: write d0/d6/d5d/d67/d53/da0/d120/f115 [4824073,64889] 0 2024-09-15T22:26:53.087 INFO:tasks.workunit.client.0.smithi001.stdout:6/900: readlink d0/df/d24/d2e/d43/d30/dc2/l110 0 2024-09-15T22:26:53.087 INFO:tasks.workunit.client.0.smithi001.stdout:6/901: chown d0/d6/d5d/d8c/c113 11317 1 2024-09-15T22:26:53.088 INFO:tasks.workunit.client.0.smithi001.stdout:2/873: link d2/d12/d62/d64/fad d2/d12/d10c/d10f/f126 0 2024-09-15T22:26:53.088 INFO:tasks.workunit.client.0.smithi001.stdout:2/874: chown d2/d14/d1a/l87 114926623 1 2024-09-15T22:26:53.088 INFO:tasks.workunit.client.0.smithi001.stdout:2/875: symlink d2/d12/d62/d64/d76/db4/l127 0 2024-09-15T22:26:53.089 INFO:tasks.workunit.client.0.smithi001.stdout:8/808: dwrite d9/d19/d29/f3e [0,4194304] 0 2024-09-15T22:26:53.091 INFO:tasks.workunit.client.0.smithi001.stdout:3/895: dread da/d3d/d43/d7c/f55 [0,4194304] 0 2024-09-15T22:26:53.091 INFO:tasks.workunit.client.0.smithi001.stdout:7/849: rename d0/d7/d2e to d0/d8e/d3e/d127 0 2024-09-15T22:26:53.094 INFO:tasks.workunit.client.0.smithi001.stdout:7/850: mkdir d0/d7/dd5/d128 0 2024-09-15T22:26:53.095 INFO:tasks.workunit.client.0.smithi001.stdout:7/851: write d0/d7/d21/f55 [4670709,42114] 0 2024-09-15T22:26:53.095 INFO:tasks.workunit.client.0.smithi001.stdout:7/852: write d0/d8e/d3e/d127/d60/dbd/fcc [1006564,25796] 0 2024-09-15T22:26:53.096 INFO:tasks.workunit.client.0.smithi001.stdout:7/853: mkdir d0/dd3/d119/d129 0 2024-09-15T22:26:53.097 INFO:tasks.workunit.client.0.smithi001.stdout:2/876: rename d2/d14/d1a/d1b/d82/d10d to d2/d12/d62/d64/d76/d7f/d128 0 2024-09-15T22:26:53.097 INFO:tasks.workunit.client.0.smithi001.stdout:7/854: symlink d0/d7/d44/d3f/l12a 0 2024-09-15T22:26:53.097 INFO:tasks.workunit.client.0.smithi001.stdout:2/877: getdents d2/d14/d1a/d1b/d98 0 2024-09-15T22:26:53.098 INFO:tasks.workunit.client.0.smithi001.stdout:7/855: mkdir d0/dd3/d119/d12b 0 2024-09-15T22:26:53.103 INFO:tasks.workunit.client.0.smithi001.stdout:5/872: dwrite d3/d27/fa6 [0,4194304] 0 2024-09-15T22:26:53.104 INFO:tasks.workunit.client.0.smithi001.stdout:3/896: readlink da/l4d 0 2024-09-15T22:26:53.104 INFO:tasks.workunit.client.0.smithi001.stdout:5/873: link d3/d6/d41/d4d/d91/fbb d3/d6/d57/d87/d8c/f11b 0 2024-09-15T22:26:53.105 INFO:tasks.workunit.client.0.smithi001.stdout:3/897: link da/d3b/f66 da/d90/d92/f138 0 2024-09-15T22:26:53.106 INFO:tasks.workunit.client.0.smithi001.stdout:5/874: symlink d3/d6/d41/d4d/dbe/d56/l11c 0 2024-09-15T22:26:53.106 INFO:tasks.workunit.client.0.smithi001.stdout:3/898: write da/d3b/d8b/dee/f28 [2163179,85214] 0 2024-09-15T22:26:53.107 INFO:tasks.workunit.client.0.smithi001.stdout:5/875: creat d3/d6/d41/d4d/dc0/f11d x:0 0 0 2024-09-15T22:26:53.108 INFO:tasks.workunit.client.0.smithi001.stdout:3/899: symlink da/d90/d6f/d102/d11c/l139 0 2024-09-15T22:26:53.110 INFO:tasks.workunit.client.0.smithi001.stdout:3/900: creat da/d3d/d43/d7c/f13a x:0 0 0 2024-09-15T22:26:53.110 INFO:tasks.workunit.client.0.smithi001.stdout:3/901: write da/d16/f4b [4056971,37930] 0 2024-09-15T22:26:53.111 INFO:tasks.workunit.client.0.smithi001.stdout:3/902: mkdir da/d3b/d13b 0 2024-09-15T22:26:53.112 INFO:tasks.workunit.client.0.smithi001.stdout:3/903: unlink da/d9e/lb8 0 2024-09-15T22:26:53.112 INFO:tasks.workunit.client.0.smithi001.stdout:3/904: getdents da/d3d/d43/d41/df1/d7f/d126 0 2024-09-15T22:26:53.113 INFO:tasks.workunit.client.0.smithi001.stdout:3/905: creat da/d3b/d1b/f13c x:0 0 0 2024-09-15T22:26:53.118 INFO:tasks.workunit.client.0.smithi001.stdout:2/878: write d2/d12/f1c [3662114,5042] 0 2024-09-15T22:26:53.118 INFO:tasks.workunit.client.0.smithi001.stdout:2/879: write d2/d12/ff0 [5064753,90133] 0 2024-09-15T22:26:53.120 INFO:tasks.workunit.client.0.smithi001.stdout:2/880: mkdir d2/d14/d1a/d1b/d82/db0/df6/df8/d118/d129 0 2024-09-15T22:26:53.120 INFO:tasks.workunit.client.0.smithi001.stdout:5/876: dread d3/d27/d4e/d89/f9b [0,4194304] 0 2024-09-15T22:26:53.122 INFO:tasks.workunit.client.0.smithi001.stdout:5/877: unlink d3/d6/d41/d4d/dbe/d56/d52/d61/dee/def/cf1 0 2024-09-15T22:26:53.122 INFO:tasks.workunit.client.0.smithi001.stdout:6/902: dread d0/df/d24/d49/f6a [0,4194304] 0 2024-09-15T22:26:53.122 INFO:tasks.workunit.client.0.smithi001.stdout:6/903: readlink d0/df/d24/d49/dc7/ddd/le0 0 2024-09-15T22:26:53.124 INFO:tasks.workunit.client.0.smithi001.stdout:3/906: dread da/d3d/d43/d7c/d53/d73/ff3 [0,4194304] 0 2024-09-15T22:26:53.124 INFO:tasks.workunit.client.0.smithi001.stdout:3/907: write da/d3d/d43/d7c/d53/d72/f11f [868694,124778] 0 2024-09-15T22:26:53.125 INFO:tasks.workunit.client.0.smithi001.stdout:3/908: write da/d3b/d1b/dcf/f135 [526970,63590] 0 2024-09-15T22:26:53.125 INFO:tasks.workunit.client.0.smithi001.stdout:9/811: dwrite d5/de/d1a/d1b/d22/d2c/d21/d24/d86/f93 [0,4194304] 0 2024-09-15T22:26:53.125 INFO:tasks.workunit.client.0.smithi001.stdout:3/909: chown da/d3d/d43/d41/la1 0 1 2024-09-15T22:26:53.125 INFO:tasks.workunit.client.0.smithi001.stdout:5/878: link d3/d6/d57/d87/d8c/da2/fb6 d3/d6/d41/d88/da3/f11e 0 2024-09-15T22:26:53.125 INFO:tasks.workunit.client.0.smithi001.stdout:5/879: stat d3/d6/d41/d4d/dbe/d56/d52/d61/dee/ff5 0 2024-09-15T22:26:53.125 INFO:tasks.workunit.client.0.smithi001.stdout:6/904: unlink d0/d6/d5d/c99 0 2024-09-15T22:26:53.125 INFO:tasks.workunit.client.0.smithi001.stdout:9/812: creat d5/de/d1a/d1b/d22/d2c/d21/d24/ffc x:0 0 0 2024-09-15T22:26:53.125 INFO:tasks.workunit.client.0.smithi001.stdout:6/905: dread - d0/df/d24/d2e/d43/f73 zero size 2024-09-15T22:26:53.127 INFO:tasks.workunit.client.0.smithi001.stdout:9/813: mknod d5/de/d1a/d1b/d22/d2c/d21/d68/cfd 0 2024-09-15T22:26:53.129 INFO:tasks.workunit.client.0.smithi001.stdout:5/880: rename d3/d6/d57/d87/d8c/l94 to d3/d6/d41/d88/l11f 0 2024-09-15T22:26:53.129 INFO:tasks.workunit.client.0.smithi001.stdout:9/814: chown d5/de/d51/d53/dbe/ddd 52591157 1 2024-09-15T22:26:53.130 INFO:tasks.workunit.client.0.smithi001.stdout:5/881: mkdir d3/d6/d57/d120 0 2024-09-15T22:26:53.131 INFO:tasks.workunit.client.0.smithi001.stdout:6/906: truncate d0/df/d24/d2e/d43/fb6 52869 0 2024-09-15T22:26:53.131 INFO:tasks.workunit.client.0.smithi001.stdout:6/907: dread - d0/d6/d5d/da6/fc9 zero size 2024-09-15T22:26:53.131 INFO:tasks.workunit.client.0.smithi001.stdout:6/908: chown d0/d6/d5d/da6/lac 603 1 2024-09-15T22:26:53.131 INFO:tasks.workunit.client.0.smithi001.stdout:9/815: rename d5/de/d1a/d1b/d22/d2c/d21/d24/l3f to d5/de/d15/d27/lfe 0 2024-09-15T22:26:53.133 INFO:tasks.workunit.client.0.smithi001.stdout:6/909: stat d0/d7e/l12c 0 2024-09-15T22:26:53.134 INFO:tasks.workunit.client.0.smithi001.stdout:9/816: mkdir d5/de/d51/d53/d9f/da1/dff 0 2024-09-15T22:26:53.136 INFO:tasks.workunit.client.0.smithi001.stdout:6/910: link d0/df/d24/d49/dc7/ddd/c128 d0/d6/d5d/d67/df0/c132 0 2024-09-15T22:26:53.138 INFO:tasks.workunit.client.0.smithi001.stdout:6/911: chown d0/d6/d5d/d67/d53/f65 332 1 2024-09-15T22:26:53.138 INFO:tasks.workunit.client.0.smithi001.stdout:6/912: fsync d0/d7e/fa2 0 2024-09-15T22:26:53.141 INFO:tasks.workunit.client.0.smithi001.stdout:8/809: dread d9/d19/d29/d50/f52 [0,4194304] 0 2024-09-15T22:26:53.141 INFO:tasks.workunit.client.0.smithi001.stdout:8/810: fsync d9/d19/d58/fcc 0 2024-09-15T22:26:53.144 INFO:tasks.workunit.client.0.smithi001.stdout:8/811: link d9/d19/d58/f68 d9/d19/d58/d88/fe9 0 2024-09-15T22:26:53.148 INFO:tasks.workunit.client.0.smithi001.stdout:8/812: rmdir d9/d19/d29/d33/d63/dcb 39 2024-09-15T22:26:53.153 INFO:tasks.workunit.client.0.smithi001.stdout:1/882: dwrite d3/d12/d79/dce/d14/fa5 [0,4194304] 0 2024-09-15T22:26:53.153 INFO:tasks.workunit.client.0.smithi001.stdout:1/883: truncate d3/d12/fef 379829 0 2024-09-15T22:26:53.154 INFO:tasks.workunit.client.0.smithi001.stdout:1/884: mknod d3/d12/d79/dce/d3c/c119 0 2024-09-15T22:26:53.154 INFO:tasks.workunit.client.0.smithi001.stdout:1/885: write d3/fee [563651,114602] 0 2024-09-15T22:26:53.155 INFO:tasks.workunit.client.0.smithi001.stdout:1/886: mknod d3/d12/d79/dce/d3c/d7d/c11a 0 2024-09-15T22:26:53.155 INFO:tasks.workunit.client.0.smithi001.stdout:1/887: chown d3/d12/d79/dce/d53/fe5 1434213151 1 2024-09-15T22:26:53.162 INFO:tasks.workunit.client.0.smithi001.stdout:1/888: dread d3/d12/d79/dce/f38 [0,4194304] 0 2024-09-15T22:26:53.164 INFO:tasks.workunit.client.0.smithi001.stdout:1/889: getdents d3 0 2024-09-15T22:26:53.176 INFO:tasks.workunit.client.0.smithi001.stdout:7/856: read d0/d7/f24 [2010934,29870] 0 2024-09-15T22:26:53.176 INFO:tasks.workunit.client.0.smithi001.stdout:7/857: write d0/d7/d44/d36/f83 [843676,121345] 0 2024-09-15T22:26:53.176 INFO:tasks.workunit.client.0.smithi001.stdout:7/858: write d0/d7/d44/f1c [9718955,78195] 0 2024-09-15T22:26:53.177 INFO:tasks.workunit.client.0.smithi001.stdout:0/704: dwrite d0/d6/f30 [0,4194304] 0 2024-09-15T22:26:53.177 INFO:tasks.workunit.client.0.smithi001.stdout:0/705: read d0/d9/db/f6b [45905,19331] 0 2024-09-15T22:26:53.177 INFO:tasks.workunit.client.0.smithi001.stdout:0/706: chown d0/d9/d1a/d36/f45 6 1 2024-09-15T22:26:53.177 INFO:tasks.workunit.client.0.smithi001.stdout:0/707: mkdir d0/d9/d1a/dd8 0 2024-09-15T22:26:53.178 INFO:tasks.workunit.client.0.smithi001.stdout:5/882: dwrite d3/d6/d57/d87/d8c/da2/fed [0,4194304] 0 2024-09-15T22:26:53.178 INFO:tasks.workunit.client.0.smithi001.stdout:5/883: chown d3/d6/d41/d4d/dbe/d56/ddc/de9/df6/fc3 915481 1 2024-09-15T22:26:53.178 INFO:tasks.workunit.client.0.smithi001.stdout:5/884: read d3/d1d/f29 [3219471,941] 0 2024-09-15T22:26:53.178 INFO:tasks.workunit.client.0.smithi001.stdout:0/708: rename d0/d84/f9f to d0/dd/d1b/dcf/fd9 0 2024-09-15T22:26:53.180 INFO:tasks.workunit.client.0.smithi001.stdout:0/709: unlink d0/d6/fd6 0 2024-09-15T22:26:53.180 INFO:tasks.workunit.client.0.smithi001.stdout:0/710: getdents d0/d9/db/dc5 0 2024-09-15T22:26:53.183 INFO:tasks.workunit.client.0.smithi001.stdout:5/885: mknod d3/c121 0 2024-09-15T22:26:53.183 INFO:tasks.workunit.client.0.smithi001.stdout:1/890: dread d3/d12/d79/dce/f19 [8388608,4194304] 0 2024-09-15T22:26:53.186 INFO:tasks.workunit.client.0.smithi001.stdout:1/891: creat d3/d12/d79/dce/d14/d23/da1/de9/dff/f11b x:0 0 0 2024-09-15T22:26:53.189 INFO:tasks.workunit.client.0.smithi001.stdout:0/711: truncate d0/d6/d6a/f8d 1467999 0 2024-09-15T22:26:53.190 INFO:tasks.workunit.client.0.smithi001.stdout:7/859: dread d0/d7/d21/d6b/fd2 [0,4194304] 0 2024-09-15T22:26:53.190 INFO:tasks.workunit.client.0.smithi001.stdout:1/892: rename d3/d12/d79/dce/d14/daa/ddd/df4/lf9 to d3/d12/d79/dce/d14/d23/da1/de9/l11c 0 2024-09-15T22:26:53.191 INFO:tasks.workunit.client.0.smithi001.stdout:3/910: dwrite da/d3d/d43/d7c/d53/fd2 [0,4194304] 0 2024-09-15T22:26:53.192 INFO:tasks.workunit.client.0.smithi001.stdout:1/893: symlink d3/d12/d79/dce/d69/l11d 0 2024-09-15T22:26:53.192 INFO:tasks.workunit.client.0.smithi001.stdout:1/894: fsync d3/d8d/dd4/fd7 0 2024-09-15T22:26:53.192 INFO:tasks.workunit.client.0.smithi001.stdout:1/895: fdatasync d3/d12/d79/dce/d53/fe5 0 2024-09-15T22:26:53.192 INFO:tasks.workunit.client.0.smithi001.stdout:1/896: truncate d3/d12/d79/dce/d3c/d64/fa6 1393251 0 2024-09-15T22:26:53.192 INFO:tasks.workunit.client.0.smithi001.stdout:1/897: chown d3/l96 7 1 2024-09-15T22:26:53.192 INFO:tasks.workunit.client.0.smithi001.stdout:1/898: fdatasync d3/d8d/dd4/fd7 0 2024-09-15T22:26:53.193 INFO:tasks.workunit.client.0.smithi001.stdout:0/712: creat d0/d9/db/fda x:0 0 0 2024-09-15T22:26:53.193 INFO:tasks.workunit.client.0.smithi001.stdout:0/713: chown d0/d9/db/d5d/d79/fa5 7723 1 2024-09-15T22:26:53.193 INFO:tasks.workunit.client.0.smithi001.stdout:0/714: stat d0/d9/d1a/d70/faa 0 2024-09-15T22:26:53.195 INFO:tasks.workunit.client.0.smithi001.stdout:1/899: rename d3/d12/d79/dce/d3c/d64/f7e to d3/d12/d79/dce/d14/d23/da1/de9/f11e 0 2024-09-15T22:26:53.195 INFO:tasks.workunit.client.0.smithi001.stdout:3/911: creat da/d3d/d43/d41/df1/f13d x:0 0 0 2024-09-15T22:26:53.200 INFO:tasks.workunit.client.0.smithi001.stdout:5/886: getdents d3/d6/d41/d4d/dc0 0 2024-09-15T22:26:53.200 INFO:tasks.workunit.client.0.smithi001.stdout:3/912: unlink da/d3b/d58/c127 0 2024-09-15T22:26:53.203 INFO:tasks.workunit.client.0.smithi001.stdout:8/813: dwrite d9/d19/d58/d8e/fac [0,4194304] 0 2024-09-15T22:26:53.214 INFO:tasks.workunit.client.0.smithi001.stdout:3/913: rmdir da/d3d/d43/d7c/d53/d72 39 2024-09-15T22:26:53.214 INFO:tasks.workunit.client.0.smithi001.stdout:3/914: write da/d90/d6f/f120 [439654,105179] 0 2024-09-15T22:26:53.214 INFO:tasks.workunit.client.0.smithi001.stdout:3/915: truncate da/dae/f132 730086 0 2024-09-15T22:26:53.214 INFO:tasks.workunit.client.0.smithi001.stdout:0/715: rename d0/dd/d1b to d0/d9/d1a/ddb 0 2024-09-15T22:26:53.214 INFO:tasks.workunit.client.0.smithi001.stdout:0/716: chown d0/d6/dae/fbf 0 1 2024-09-15T22:26:53.215 INFO:tasks.workunit.client.0.smithi001.stdout:0/717: creat d0/d9/d1a/fdc x:0 0 0 2024-09-15T22:26:53.215 INFO:tasks.workunit.client.0.smithi001.stdout:0/718: readlink d0/d9/d1a/d36/l82 0 2024-09-15T22:26:53.216 INFO:tasks.workunit.client.0.smithi001.stdout:0/719: truncate d0/d9/db/fda 533500 0 2024-09-15T22:26:53.217 INFO:tasks.workunit.client.0.smithi001.stdout:0/720: creat d0/d84/fdd x:0 0 0 2024-09-15T22:26:53.217 INFO:tasks.workunit.client.0.smithi001.stdout:0/721: dread - d0/d9/d1a/d70/f87 zero size 2024-09-15T22:26:53.217 INFO:tasks.workunit.client.0.smithi001.stdout:0/722: write d0/d6/d77/d78/f9b [674172,96963] 0 2024-09-15T22:26:53.218 INFO:tasks.workunit.client.0.smithi001.stdout:0/723: mknod d0/d84/cde 0 2024-09-15T22:26:53.219 INFO:tasks.workunit.client.0.smithi001.stdout:0/724: mknod d0/dd/d63/cdf 0 2024-09-15T22:26:53.220 INFO:tasks.workunit.client.0.smithi001.stdout:0/725: rmdir d0/d6 39 2024-09-15T22:26:53.221 INFO:tasks.workunit.client.0.smithi001.stdout:0/726: chown d0/dd/cc6 2463 1 2024-09-15T22:26:53.222 INFO:tasks.workunit.client.0.smithi001.stdout:0/727: creat d0/d9/d1a/fe0 x:0 0 0 2024-09-15T22:26:53.223 INFO:tasks.workunit.client.0.smithi001.stdout:0/728: truncate d0/d9/d1a/d36/f3a 1181464 0 2024-09-15T22:26:53.224 INFO:tasks.workunit.client.0.smithi001.stdout:0/729: mkdir d0/d9/db/de1 0 2024-09-15T22:26:53.229 INFO:tasks.workunit.client.0.smithi001.stdout:0/730: stat d0/d84/lc9 0 2024-09-15T22:26:53.231 INFO:tasks.workunit.client.0.smithi001.stdout:0/731: mkdir d0/d6/d77/de2 0 2024-09-15T22:26:53.233 INFO:tasks.workunit.client.0.smithi001.stdout:0/732: rename d0/d6/f15 to d0/d9/db/d5d/d6d/fe3 0 2024-09-15T22:26:53.236 INFO:tasks.workunit.client.0.smithi001.stdout:3/916: write da/d3d/d43/d41/df1/d7f/fc5 [988169,63490] 0 2024-09-15T22:26:53.236 INFO:tasks.workunit.client.0.smithi001.stdout:3/917: dread - da/d90/d6f/fe6 zero size 2024-09-15T22:26:53.237 INFO:tasks.workunit.client.0.smithi001.stdout:3/918: creat da/d90/d6f/d102/f13e x:0 0 0 2024-09-15T22:26:53.237 INFO:tasks.workunit.client.0.smithi001.stdout:3/919: write da/d90/d6f/dc7/fd0 [948704,31259] 0 2024-09-15T22:26:53.237 INFO:tasks.workunit.client.0.smithi001.stdout:3/920: write da/d90/fbf [1013675,73206] 0 2024-09-15T22:26:53.237 INFO:tasks.workunit.client.0.smithi001.stdout:3/921: write da/d3b/d1b/f95 [1331927,96761] 0 2024-09-15T22:26:53.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:52 smithi012 ceph-mon[34883]: pgmap v416: 97 pgs: 97 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 192 MiB/s rd, 220 MiB/s wr, 861 op/s 2024-09-15T22:26:53.248 INFO:tasks.workunit.client.0.smithi001.stdout:0/733: dread d0/d9/db/d5d/fa3 [0,4194304] 0 2024-09-15T22:26:53.249 INFO:tasks.workunit.client.0.smithi001.stdout:0/734: creat d0/d9/db/fe4 x:0 0 0 2024-09-15T22:26:53.249 INFO:tasks.workunit.client.0.smithi001.stdout:0/735: truncate d0/f50 599409 0 2024-09-15T22:26:53.251 INFO:tasks.workunit.client.0.smithi001.stdout:0/736: rename d0/dd/d33/f73 to d0/d9/db/d5d/d79/dc3/fe5 0 2024-09-15T22:26:53.253 INFO:tasks.workunit.client.0.smithi001.stdout:0/737: rename d0/dd/d33/la4 to d0/d9/d1a/le6 0 2024-09-15T22:26:53.253 INFO:tasks.workunit.client.0.smithi001.stdout:0/738: fsync d0/d9/db/d5d/f76 0 2024-09-15T22:26:53.253 INFO:tasks.workunit.client.0.smithi001.stdout:0/739: dread - d0/d9/d1a/fdc zero size 2024-09-15T22:26:53.254 INFO:tasks.workunit.client.0.smithi001.stdout:0/740: mknod d0/d9/ce7 0 2024-09-15T22:26:53.259 INFO:tasks.workunit.client.0.smithi001.stdout:0/741: symlink d0/d9/d1a/ddb/le8 0 2024-09-15T22:26:53.265 INFO:tasks.workunit.client.0.smithi001.stdout:5/887: dwrite d3/d6/d57/f8f [0,4194304] 0 2024-09-15T22:26:53.268 INFO:tasks.workunit.client.0.smithi001.stdout:8/814: dwrite d9/d19/d58/f4e [0,4194304] 0 2024-09-15T22:26:53.276 INFO:tasks.workunit.client.0.smithi001.stdout:7/860: dwrite d0/d98/fca [0,4194304] 0 2024-09-15T22:26:53.276 INFO:tasks.workunit.client.0.smithi001.stdout:7/861: fdatasync d0/d7/fff 0 2024-09-15T22:26:53.278 INFO:tasks.workunit.client.0.smithi001.stdout:8/815: dread d9/d19/d58/d8e/fc3 [0,4194304] 0 2024-09-15T22:26:53.281 INFO:tasks.workunit.client.0.smithi001.stdout:1/900: dwrite d3/d12/d79/dce/d14/f1c [0,4194304] 0 2024-09-15T22:26:53.283 INFO:tasks.workunit.client.0.smithi001.stdout:5/888: dread d3/d6/d57/d87/d8c/f11b [0,4194304] 0 2024-09-15T22:26:53.283 INFO:tasks.workunit.client.0.smithi001.stdout:5/889: fsync d3/d6/d41/d4d/dc0/fd5 0 2024-09-15T22:26:53.286 INFO:tasks.workunit.client.0.smithi001.stdout:5/890: creat d3/d6/d41/d88/da3/f122 x:0 0 0 2024-09-15T22:26:53.290 INFO:tasks.workunit.client.0.smithi001.stdout:3/922: dwrite da/f31 [8388608,4194304] 0 2024-09-15T22:26:53.291 INFO:tasks.workunit.client.0.smithi001.stdout:3/923: mknod da/d3d/d43/d7c/d3f/db5/df9/c13f 0 2024-09-15T22:26:53.296 INFO:tasks.workunit.client.0.smithi001.stdout:6/913: sync 2024-09-15T22:26:53.296 INFO:tasks.workunit.client.0.smithi001.stdout:9/817: sync 2024-09-15T22:26:53.296 INFO:tasks.workunit.client.0.smithi001.stdout:6/914: readlink d0/df/d24/d49/l9b 0 2024-09-15T22:26:53.296 INFO:tasks.workunit.client.0.smithi001.stdout:6/915: readlink d0/df/d24/d2e/d43/d30/da7/l10e 0 2024-09-15T22:26:53.296 INFO:tasks.workunit.client.0.smithi001.stdout:9/818: write d5/de/fd8 [471709,17336] 0 2024-09-15T22:26:53.296 INFO:tasks.workunit.client.0.smithi001.stdout:9/819: stat d5/de/d1a/d1b/d22/f4a 0 2024-09-15T22:26:53.297 INFO:tasks.workunit.client.0.smithi001.stdout:9/820: chown d5/de/d1a/d1b/d22/d2c/f31 72184440 1 2024-09-15T22:26:53.297 INFO:tasks.workunit.client.0.smithi001.stdout:9/821: dread - d5/de/d15/d27/f50 zero size 2024-09-15T22:26:53.297 INFO:tasks.workunit.client.0.smithi001.stdout:9/822: readlink d5/de/d1a/l5f 0 2024-09-15T22:26:53.297 INFO:tasks.workunit.client.0.smithi001.stdout:2/881: sync 2024-09-15T22:26:53.298 INFO:tasks.workunit.client.0.smithi001.stdout:2/882: mkdir d2/d14/d1a/d1b/d82/db0/df6/df8/d12a 0 2024-09-15T22:26:53.298 INFO:tasks.workunit.client.0.smithi001.stdout:8/816: dread d9/d19/d58/d8e/fac [0,4194304] 0 2024-09-15T22:26:53.299 INFO:tasks.workunit.client.0.smithi001.stdout:2/883: chown d2/f9 10224 1 2024-09-15T22:26:53.299 INFO:tasks.workunit.client.0.smithi001.stdout:2/884: chown d2/d14/d1a/d1b/d82/dc9/f6b 3216 1 2024-09-15T22:26:53.299 INFO:tasks.workunit.client.0.smithi001.stdout:2/885: chown d2/d12/d62/d64/d76/db4 2346 1 2024-09-15T22:26:53.303 INFO:tasks.workunit.client.0.smithi001.stdout:6/916: mknod d0/df/d97/c133 0 2024-09-15T22:26:53.303 INFO:tasks.workunit.client.0.smithi001.stdout:2/886: rename d2/d12/d62/d4c/d71/c7c to d2/d14/d1a/d1b/d82/db0/df6/df8/d118/d129/c12b 0 2024-09-15T22:26:53.303 INFO:tasks.workunit.client.0.smithi001.stdout:2/887: readlink d2/d14/d1a/d1b/d82/db0/df6/d11d/l125 0 2024-09-15T22:26:53.303 INFO:tasks.workunit.client.0.smithi001.stdout:8/817: truncate d9/d19/d34/d41/fe2 396898 0 2024-09-15T22:26:53.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:52 smithi098 ceph-mon[35514]: pgmap v416: 97 pgs: 97 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 192 MiB/s rd, 220 MiB/s wr, 861 op/s 2024-09-15T22:26:53.310 INFO:tasks.workunit.client.0.smithi001.stdout:8/818: symlink d9/d19/d34/da4/db7/lea 0 2024-09-15T22:26:53.313 INFO:tasks.workunit.client.0.smithi001.stdout:8/819: creat d9/d19/d34/d41/feb x:0 0 0 2024-09-15T22:26:53.319 INFO:tasks.workunit.client.0.smithi001.stdout:0/742: dwrite d0/dd/d93/fc0 [0,4194304] 0 2024-09-15T22:26:53.319 INFO:tasks.workunit.client.0.smithi001.stdout:0/743: write d0/d9/db/d5d/fd5 [824924,49185] 0 2024-09-15T22:26:53.319 INFO:tasks.workunit.client.0.smithi001.stdout:9/823: dread d5/f44 [4194304,4194304] 0 2024-09-15T22:26:53.322 INFO:tasks.workunit.client.0.smithi001.stdout:9/824: truncate d5/de/d1a/d1b/d22/d2c/d21/d4d/f4e 2244341 0 2024-09-15T22:26:53.325 INFO:tasks.workunit.client.0.smithi001.stdout:9/825: symlink d5/de/d15/d27/l100 0 2024-09-15T22:26:53.325 INFO:tasks.workunit.client.0.smithi001.stdout:6/917: write d0/d6/d5d/da6/f102 [10273721,51689] 0 2024-09-15T22:26:53.328 INFO:tasks.workunit.client.0.smithi001.stdout:3/924: dwrite da/d3d/d43/d41/df1/f13d [0,4194304] 0 2024-09-15T22:26:53.329 INFO:tasks.workunit.client.0.smithi001.stdout:6/918: symlink d0/d7e/l134 0 2024-09-15T22:26:53.332 INFO:tasks.workunit.client.0.smithi001.stdout:3/925: rename da/dae/f132 to da/d3b/d1b/f140 0 2024-09-15T22:26:53.334 INFO:tasks.workunit.client.0.smithi001.stdout:8/820: read d9/d19/d29/d50/d70/f86 [358691,72396] 0 2024-09-15T22:26:53.336 INFO:tasks.workunit.client.0.smithi001.stdout:3/926: creat da/db3/f141 x:0 0 0 2024-09-15T22:26:53.338 INFO:tasks.workunit.client.0.smithi001.stdout:3/927: mknod da/db3/c142 0 2024-09-15T22:26:53.341 INFO:tasks.workunit.client.0.smithi001.stdout:1/901: dwrite d3/d12/d79/dce/f19 [0,4194304] 0 2024-09-15T22:26:53.347 INFO:tasks.workunit.client.0.smithi001.stdout:3/928: getdents da/d3d/d43/d41 0 2024-09-15T22:26:53.350 INFO:tasks.workunit.client.0.smithi001.stdout:1/902: dread d3/d12/d79/dce/d14/d1b/f3b [0,4194304] 0 2024-09-15T22:26:53.354 INFO:tasks.workunit.client.0.smithi001.stdout:1/903: symlink d3/d12/d79/dce/d3c/d4c/dcc/l11f 0 2024-09-15T22:26:53.354 INFO:tasks.workunit.client.0.smithi001.stdout:1/904: read d3/d8d/d91/df5/d68/fb5 [295093,36306] 0 2024-09-15T22:26:53.354 INFO:tasks.workunit.client.0.smithi001.stdout:7/862: dwrite d0/d7/d21/d6b/d107/f10e [0,4194304] 0 2024-09-15T22:26:53.359 INFO:tasks.workunit.client.0.smithi001.stdout:2/888: dwrite d2/d14/d1a/d1b/d82/dc9/f117 [0,4194304] 0 2024-09-15T22:26:53.359 INFO:tasks.workunit.client.0.smithi001.stdout:9/826: write d5/de/d15/d27/d63/f79 [3470357,19306] 0 2024-09-15T22:26:53.359 INFO:tasks.workunit.client.0.smithi001.stdout:9/827: chown d5/de/d1a/d1b/d22/d2c/d21/d68/f76 6 1 2024-09-15T22:26:53.374 INFO:tasks.workunit.client.0.smithi001.stdout:2/889: creat d2/d14/d1a/d1b/d82/db0/f12c x:0 0 0 2024-09-15T22:26:53.374 INFO:tasks.workunit.client.0.smithi001.stdout:9/828: link d5/de/d1a/fd6 d5/de/d1a/d1b/d22/d2c/d21/d4d/f101 0 2024-09-15T22:26:53.380 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:52 smithi001 ceph-mon[30843]: pgmap v416: 97 pgs: 97 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 192 MiB/s rd, 220 MiB/s wr, 861 op/s 2024-09-15T22:26:53.388 INFO:tasks.workunit.client.0.smithi001.stdout:8/821: dwrite d9/d19/d58/fe7 [0,4194304] 0 2024-09-15T22:26:53.395 INFO:tasks.workunit.client.0.smithi001.stdout:5/891: dwrite d3/d6/d57/d87/d8c/da2/fda [0,4194304] 0 2024-09-15T22:26:53.403 INFO:tasks.workunit.client.0.smithi001.stdout:5/892: dread d3/d6/d41/d4d/dbe/f9e [4194304,4194304] 0 2024-09-15T22:26:53.406 INFO:tasks.workunit.client.0.smithi001.stdout:5/893: unlink d3/d6/d57/d87/d8c/da2/fda 0 2024-09-15T22:26:53.406 INFO:tasks.workunit.client.0.smithi001.stdout:2/890: rename d2/d14/feb to d2/d14/d1a/d1b/d82/db0/df6/df8/d12a/f12d 0 2024-09-15T22:26:53.408 INFO:tasks.workunit.client.0.smithi001.stdout:5/894: creat d3/d6/d41/d4d/dbe/d56/ddc/de9/df6/d103/f123 x:0 0 0 2024-09-15T22:26:53.409 INFO:tasks.workunit.client.0.smithi001.stdout:3/929: dwrite da/d3b/f32 [0,4194304] 0 2024-09-15T22:26:53.409 INFO:tasks.workunit.client.0.smithi001.stdout:3/930: write da/d3d/d43/d7c/f13a [178193,2213] 0 2024-09-15T22:26:53.409 INFO:tasks.workunit.client.0.smithi001.stdout:2/891: link d2/d12/d62/f86 d2/d14/d1a/d1b/d82/db0/df6/df8/f12e 0 2024-09-15T22:26:53.410 INFO:tasks.workunit.client.0.smithi001.stdout:3/931: write da/d90/d6f/f71 [532810,120711] 0 2024-09-15T22:26:53.410 INFO:tasks.workunit.client.0.smithi001.stdout:3/932: chown da/d16/f30 19995015 1 2024-09-15T22:26:53.410 INFO:tasks.workunit.client.0.smithi001.stdout:3/933: readlink da/d3d/d43/l79 0 2024-09-15T22:26:53.411 INFO:tasks.workunit.client.0.smithi001.stdout:3/934: chown da/d3d/d43/d7c/d53/d72/l129 10 1 2024-09-15T22:26:53.411 INFO:tasks.workunit.client.0.smithi001.stdout:1/905: dwrite d3/d12/d79/f106 [0,4194304] 0 2024-09-15T22:26:53.411 INFO:tasks.workunit.client.0.smithi001.stdout:1/906: write d3/d12/d79/dce/f58 [2366782,52611] 0 2024-09-15T22:26:53.412 INFO:tasks.workunit.client.0.smithi001.stdout:3/935: creat da/f143 x:0 0 0 2024-09-15T22:26:53.413 INFO:tasks.workunit.client.0.smithi001.stdout:2/892: mknod d2/d12/d10c/d10f/c12f 0 2024-09-15T22:26:53.413 INFO:tasks.workunit.client.0.smithi001.stdout:3/936: fdatasync da/d16/fb7 0 2024-09-15T22:26:53.413 INFO:tasks.workunit.client.0.smithi001.stdout:2/893: chown d2/d14/d1a/d1b/d82/dc9/ffe 13 1 2024-09-15T22:26:53.413 INFO:tasks.workunit.client.0.smithi001.stdout:2/894: write d2/d14/d1a/d8a/f94 [1048006,63316] 0 2024-09-15T22:26:53.414 INFO:tasks.workunit.client.0.smithi001.stdout:2/895: creat d2/d12/dec/f130 x:0 0 0 2024-09-15T22:26:53.414 INFO:tasks.workunit.client.0.smithi001.stdout:2/896: getdents d2/d12/d62/d64/d76/d7f/d128 0 2024-09-15T22:26:53.415 INFO:tasks.workunit.client.0.smithi001.stdout:3/937: creat da/d3d/d43/d7c/d3f/db5/df9/dda/ddc/f144 x:0 0 0 2024-09-15T22:26:53.417 INFO:tasks.workunit.client.0.smithi001.stdout:2/897: mkdir d2/d14/d1a/d80/d131 0 2024-09-15T22:26:53.418 INFO:tasks.workunit.client.0.smithi001.stdout:2/898: write d2/d12/d10c/f112 [112112,43011] 0 2024-09-15T22:26:53.418 INFO:tasks.workunit.client.0.smithi001.stdout:2/899: chown d2/d14/d1a/d1b/d82/db0/df6/df8/l123 1976 1 2024-09-15T22:26:53.418 INFO:tasks.workunit.client.0.smithi001.stdout:2/900: chown d2/d14/d1a/d1b/d82/dc9/d6f/fb2 533571 1 2024-09-15T22:26:53.418 INFO:tasks.workunit.client.0.smithi001.stdout:3/938: unlink da/d3d/d43/d7c/d3f/db5/df9/dda/ddc/f10e 0 2024-09-15T22:26:53.419 INFO:tasks.workunit.client.0.smithi001.stdout:2/901: creat d2/d14/d1a/d1b/d82/db0/f132 x:0 0 0 2024-09-15T22:26:53.421 INFO:tasks.workunit.client.0.smithi001.stdout:2/902: link d2/d14/f96 d2/d12/d10c/d10f/f133 0 2024-09-15T22:26:53.421 INFO:tasks.workunit.client.0.smithi001.stdout:2/903: chown d2/f3 148 1 2024-09-15T22:26:53.421 INFO:tasks.workunit.client.0.smithi001.stdout:2/904: fdatasync d2/d12/d10c/fee 0 2024-09-15T22:26:53.421 INFO:tasks.workunit.client.0.smithi001.stdout:2/905: chown d2/d12/d62/d64/d76/db4/fce 409962 1 2024-09-15T22:26:53.423 INFO:tasks.workunit.client.0.smithi001.stdout:2/906: truncate d2/d12/d62/d64/d76/db4/fce 527103 0 2024-09-15T22:26:53.424 INFO:tasks.workunit.client.0.smithi001.stdout:9/829: dwrite d5/de/d1a/d1b/d22/fe4 [0,4194304] 0 2024-09-15T22:26:53.427 INFO:tasks.workunit.client.0.smithi001.stdout:2/907: link d2/d14/d1a/d1b/d82/dc9/ca4 d2/d14/d1a/d1b/d82/d97/d74/c134 0 2024-09-15T22:26:53.427 INFO:tasks.workunit.client.0.smithi001.stdout:9/830: mkdir d5/de/d102 0 2024-09-15T22:26:53.428 INFO:tasks.workunit.client.0.smithi001.stdout:2/908: creat d2/d14/de1/f135 x:0 0 0 2024-09-15T22:26:53.429 INFO:tasks.workunit.client.0.smithi001.stdout:9/831: rmdir d5/d90 39 2024-09-15T22:26:53.431 INFO:tasks.workunit.client.0.smithi001.stdout:9/832: creat d5/de/d1a/d1b/d22/d2c/d21/d24/d86/f103 x:0 0 0 2024-09-15T22:26:53.431 INFO:tasks.workunit.client.0.smithi001.stdout:9/833: write d5/de/d1a/d1b/d22/d2c/d21/d24/fda [4624519,81660] 0 2024-09-15T22:26:53.431 INFO:tasks.workunit.client.0.smithi001.stdout:9/834: stat d5/de/d1a/f88 0 2024-09-15T22:26:53.431 INFO:tasks.workunit.client.0.smithi001.stdout:9/835: dread - d5/de/fe6 zero size 2024-09-15T22:26:53.431 INFO:tasks.workunit.client.0.smithi001.stdout:9/836: fdatasync d5/d3e/f52 0 2024-09-15T22:26:53.431 INFO:tasks.workunit.client.0.smithi001.stdout:7/863: dwrite d0/d7/d44/f8d [0,4194304] 0 2024-09-15T22:26:53.433 INFO:tasks.workunit.client.0.smithi001.stdout:9/837: mkdir d5/de/da9/df1/d104 0 2024-09-15T22:26:53.434 INFO:tasks.workunit.client.0.smithi001.stdout:7/864: mkdir d0/d7/d44/d3f/d49/da5/d12c 0 2024-09-15T22:26:53.434 INFO:tasks.workunit.client.0.smithi001.stdout:7/865: read - d0/d8e/d3e/d127/d60/dbd/fe0 zero size 2024-09-15T22:26:53.436 INFO:tasks.workunit.client.0.smithi001.stdout:9/838: creat d5/de/da9/df1/f105 x:0 0 0 2024-09-15T22:26:53.436 INFO:tasks.workunit.client.0.smithi001.stdout:3/939: dread da/fe [0,4194304] 0 2024-09-15T22:26:53.438 INFO:tasks.workunit.client.0.smithi001.stdout:2/909: dread d2/d14/d1a/fd5 [0,4194304] 0 2024-09-15T22:26:53.438 INFO:tasks.workunit.client.0.smithi001.stdout:2/910: truncate d2/d12/d62/d64/d76/db4/fd1 583391 0 2024-09-15T22:26:53.438 INFO:tasks.workunit.client.0.smithi001.stdout:7/866: rename d0/d7/d21/c11c to d0/d8e/d3e/d127/c12d 0 2024-09-15T22:26:53.439 INFO:tasks.workunit.client.0.smithi001.stdout:2/911: truncate d2/d14/d1a/d1b/d82/dc9/f95 3455343 0 2024-09-15T22:26:53.440 INFO:tasks.workunit.client.0.smithi001.stdout:7/867: write d0/dd3/df9/ffe [225029,123934] 0 2024-09-15T22:26:53.441 INFO:tasks.workunit.client.0.smithi001.stdout:2/912: link d2/d14/d1a/d8a/fbc d2/d12/f136 0 2024-09-15T22:26:53.441 INFO:tasks.workunit.client.0.smithi001.stdout:9/839: rename d5/de/d1a/f8c to d5/de/d1a/d1b/d22/d2c/d21/d23/f106 0 2024-09-15T22:26:53.441 INFO:tasks.workunit.client.0.smithi001.stdout:9/840: getdents d5/de/d1a/d38/df7 0 2024-09-15T22:26:53.443 INFO:tasks.workunit.client.0.smithi001.stdout:0/744: sync 2024-09-15T22:26:53.443 INFO:tasks.workunit.client.0.smithi001.stdout:7/868: creat d0/d7/d44/d3f/d49/d4f/f12e x:0 0 0 2024-09-15T22:26:53.443 INFO:tasks.workunit.client.0.smithi001.stdout:7/869: stat d0/d7/dc6/f111 0 2024-09-15T22:26:53.443 INFO:tasks.workunit.client.0.smithi001.stdout:6/919: sync 2024-09-15T22:26:53.443 INFO:tasks.workunit.client.0.smithi001.stdout:6/920: chown d0/d6/cc 64958462 1 2024-09-15T22:26:53.444 INFO:tasks.workunit.client.0.smithi001.stdout:2/913: mknod d2/d14/d1a/d1b/d82/d97/d74/c137 0 2024-09-15T22:26:53.444 INFO:tasks.workunit.client.0.smithi001.stdout:2/914: write d2/d14/d1a/d1b/d82/db0/fbd [1244058,97471] 0 2024-09-15T22:26:53.445 INFO:tasks.workunit.client.0.smithi001.stdout:1/907: write d3/d12/d79/f106 [3285607,108623] 0 2024-09-15T22:26:53.447 INFO:tasks.workunit.client.0.smithi001.stdout:9/841: symlink d5/de/l107 0 2024-09-15T22:26:53.447 INFO:tasks.workunit.client.0.smithi001.stdout:2/915: truncate d2/f10 3632865 0 2024-09-15T22:26:53.447 INFO:tasks.workunit.client.0.smithi001.stdout:1/908: truncate d3/d12/d79/dce/d86/f87 138563 0 2024-09-15T22:26:53.448 INFO:tasks.workunit.client.0.smithi001.stdout:0/745: truncate d0/d9/db/d5d/d79/dc3/fe5 2776694 0 2024-09-15T22:26:53.448 INFO:tasks.workunit.client.0.smithi001.stdout:1/909: rmdir d3/d8d/dd4 39 2024-09-15T22:26:53.448 INFO:tasks.workunit.client.0.smithi001.stdout:1/910: read - d3/d12/d79/dce/d14/d23/da1/da2/f10b zero size 2024-09-15T22:26:53.449 INFO:tasks.workunit.client.0.smithi001.stdout:0/746: mkdir d0/d9/db/d5d/d79/dc3/de9 0 2024-09-15T22:26:53.450 INFO:tasks.workunit.client.0.smithi001.stdout:9/842: creat d5/de/d1a/d1b/d22/d2c/d21/d68/f108 x:0 0 0 2024-09-15T22:26:53.451 INFO:tasks.workunit.client.0.smithi001.stdout:6/921: rmdir d0/d6/d5d/d8c 39 2024-09-15T22:26:53.451 INFO:tasks.workunit.client.0.smithi001.stdout:6/922: readlink d0/d7e/lf9 0 2024-09-15T22:26:53.451 INFO:tasks.workunit.client.0.smithi001.stdout:0/747: fdatasync d0/f2 0 2024-09-15T22:26:53.451 INFO:tasks.workunit.client.0.smithi001.stdout:0/748: chown d0/dd/d63/db6 841775 1 2024-09-15T22:26:53.452 INFO:tasks.workunit.client.0.smithi001.stdout:9/843: unlink d5/de/d1a/d1b/d22/d2c/c8 0 2024-09-15T22:26:53.452 INFO:tasks.workunit.client.0.smithi001.stdout:0/749: symlink d0/dd/d33/lea 0 2024-09-15T22:26:53.455 INFO:tasks.workunit.client.0.smithi001.stdout:1/911: link c0 d3/d12/d79/dce/d14/d23/d112/c120 0 2024-09-15T22:26:53.456 INFO:tasks.workunit.client.0.smithi001.stdout:3/940: dread da/d3d/d43/d41/df1/d7f/fcd [0,4194304] 0 2024-09-15T22:26:53.456 INFO:tasks.workunit.client.0.smithi001.stdout:1/912: symlink d3/d12/d79/l121 0 2024-09-15T22:26:53.457 INFO:tasks.workunit.client.0.smithi001.stdout:3/941: creat da/d3b/d1b/dcf/f145 x:0 0 0 2024-09-15T22:26:53.457 INFO:tasks.workunit.client.0.smithi001.stdout:1/913: rmdir d3/d12/d79/dce/d3c/d4c/dcc/dd1 39 2024-09-15T22:26:53.459 INFO:tasks.workunit.client.0.smithi001.stdout:3/942: mknod da/d3d/d43/d41/dff/d105/c146 0 2024-09-15T22:26:53.459 INFO:tasks.workunit.client.0.smithi001.stdout:3/943: truncate da/d3d/d43/d7c/d3f/db5/df9/dda/ff8 376304 0 2024-09-15T22:26:53.459 INFO:tasks.workunit.client.0.smithi001.stdout:3/944: write da/d90/d6f/ffc [876425,97724] 0 2024-09-15T22:26:53.460 INFO:tasks.workunit.client.0.smithi001.stdout:3/945: chown da/d3d/d43/f11d 22367 1 2024-09-15T22:26:53.460 INFO:tasks.workunit.client.0.smithi001.stdout:3/946: readlink da/d3d/d43/l89 0 2024-09-15T22:26:53.460 INFO:tasks.workunit.client.0.smithi001.stdout:3/947: fdatasync da/d3d/d43/d7c/d3f/db5/fe7 0 2024-09-15T22:26:53.460 INFO:tasks.workunit.client.0.smithi001.stdout:3/948: truncate da/d90/d92/f138 1513456 0 2024-09-15T22:26:53.460 INFO:tasks.workunit.client.0.smithi001.stdout:3/949: rmdir da/d9e 39 2024-09-15T22:26:53.461 INFO:tasks.workunit.client.0.smithi001.stdout:3/950: mkdir da/d3d/d43/d41/dff/d105/d147 0 2024-09-15T22:26:53.471 INFO:tasks.workunit.client.0.smithi001.stdout:1/914: rmdir d3/d12/d79/dce/d14/db9/d107 0 2024-09-15T22:26:53.478 INFO:tasks.workunit.client.0.smithi001.stdout:0/750: dread d0/d9/d1a/d36/f45 [0,4194304] 0 2024-09-15T22:26:53.478 INFO:tasks.workunit.client.0.smithi001.stdout:0/751: fdatasync d0/d9/d1a/fe0 0 2024-09-15T22:26:53.478 INFO:tasks.workunit.client.0.smithi001.stdout:0/752: dread - d0/d9/db/fa7 zero size 2024-09-15T22:26:53.480 INFO:tasks.workunit.client.0.smithi001.stdout:0/753: mkdir d0/d9/d1a/ddb/dcf/deb 0 2024-09-15T22:26:53.481 INFO:tasks.workunit.client.0.smithi001.stdout:0/754: chown d0/d9/db/d5d/fa3 1032586 1 2024-09-15T22:26:53.481 INFO:tasks.workunit.client.0.smithi001.stdout:0/755: chown d0/d6/c59 212661 1 2024-09-15T22:26:53.481 INFO:tasks.workunit.client.0.smithi001.stdout:0/756: fsync d0/d9/db/d5d/d79/fa5 0 2024-09-15T22:26:53.482 INFO:tasks.workunit.client.0.smithi001.stdout:0/757: creat d0/d9/d1a/ddb/fec x:0 0 0 2024-09-15T22:26:53.483 INFO:tasks.workunit.client.0.smithi001.stdout:0/758: creat d0/d9/d1a/ddb/dcf/deb/fed x:0 0 0 2024-09-15T22:26:53.483 INFO:tasks.workunit.client.0.smithi001.stdout:0/759: chown d0/dd/d63/cdf 0 1 2024-09-15T22:26:53.492 INFO:tasks.workunit.client.0.smithi001.stdout:1/915: read d3/d12/d79/dce/d69/fe1 [1923292,16727] 0 2024-09-15T22:26:53.494 INFO:tasks.workunit.client.0.smithi001.stdout:2/916: dread d2/f3 [0,4194304] 0 2024-09-15T22:26:53.494 INFO:tasks.workunit.client.0.smithi001.stdout:2/917: fsync d2/d14/d1a/d1b/d82/d97/f51 0 2024-09-15T22:26:53.495 INFO:tasks.workunit.client.0.smithi001.stdout:1/916: unlink d3/d12/d79/dce/d14/d23/da1/de9/f11e 0 2024-09-15T22:26:53.504 INFO:tasks.workunit.client.0.smithi001.stdout:7/870: dwrite d0/d7/d7c/f114 [0,4194304] 0 2024-09-15T22:26:53.508 INFO:tasks.workunit.client.0.smithi001.stdout:7/871: getdents d0/d7/dc6 0 2024-09-15T22:26:53.510 INFO:tasks.workunit.client.0.smithi001.stdout:5/895: dwrite d3/d6/f59 [0,4194304] 0 2024-09-15T22:26:53.510 INFO:tasks.workunit.client.0.smithi001.stdout:5/896: stat d3/d6/d41/fe3 0 2024-09-15T22:26:53.511 INFO:tasks.workunit.client.0.smithi001.stdout:5/897: write d3/d6/dd8/ffd [831201,129218] 0 2024-09-15T22:26:53.512 INFO:tasks.workunit.client.0.smithi001.stdout:7/872: unlink d0/d7/d21/d6b/d107/f10f 0 2024-09-15T22:26:53.512 INFO:tasks.workunit.client.0.smithi001.stdout:7/873: write d0/d7/d21/d6b/f3b [1218791,76214] 0 2024-09-15T22:26:53.514 INFO:tasks.workunit.client.0.smithi001.stdout:7/874: mkdir d0/d7/d44/d3f/d49/d12f 0 2024-09-15T22:26:53.514 INFO:tasks.workunit.client.0.smithi001.stdout:7/875: read - d0/d8e/d3e/f11a zero size 2024-09-15T22:26:53.517 INFO:tasks.workunit.client.0.smithi001.stdout:7/876: creat d0/d7/dd5/d128/f130 x:0 0 0 2024-09-15T22:26:53.517 INFO:tasks.workunit.client.0.smithi001.stdout:5/898: dread d3/d6/d41/d4d/dbe/d56/ddc/ff2 [0,4194304] 0 2024-09-15T22:26:53.518 INFO:tasks.workunit.client.0.smithi001.stdout:5/899: mkdir d3/d6/d25/d124 0 2024-09-15T22:26:53.518 INFO:tasks.workunit.client.0.smithi001.stdout:5/900: fdatasync d3/d27/f2d 0 2024-09-15T22:26:53.519 INFO:tasks.workunit.client.0.smithi001.stdout:7/877: rename d0/d8e/d3e/f11a to d0/d8e/d3e/d127/d60/f131 0 2024-09-15T22:26:53.520 INFO:tasks.workunit.client.0.smithi001.stdout:3/951: dread da/d3d/d43/d41/df1/d7f/fc5 [0,4194304] 0 2024-09-15T22:26:53.520 INFO:tasks.workunit.client.0.smithi001.stdout:3/952: write da/d3d/d43/d7c/d3f/f136 [703781,95210] 0 2024-09-15T22:26:53.525 INFO:tasks.workunit.client.0.smithi001.stdout:9/844: dwrite d5/de/f18 [4194304,4194304] 0 2024-09-15T22:26:53.525 INFO:tasks.workunit.client.0.smithi001.stdout:6/923: dwrite d0/d6/fd [4194304,4194304] 0 2024-09-15T22:26:53.532 INFO:tasks.workunit.client.0.smithi001.stdout:1/917: write d3/d12/d79/dce/f58 [932125,57224] 0 2024-09-15T22:26:53.535 INFO:tasks.workunit.client.0.smithi001.stdout:7/878: unlink d0/d7/d21/d6b/d93/f11d 0 2024-09-15T22:26:53.538 INFO:tasks.workunit.client.0.smithi001.stdout:5/901: write d3/d6/d41/fb9 [2976378,86420] 0 2024-09-15T22:26:53.540 INFO:tasks.workunit.client.0.smithi001.stdout:6/924: mkdir d0/df/d24/d2e/d43/d30/d135 0 2024-09-15T22:26:53.540 INFO:tasks.workunit.client.0.smithi001.stdout:6/925: chown d0/df/c20 35577 1 2024-09-15T22:26:53.541 INFO:tasks.workunit.client.0.smithi001.stdout:6/926: fsync d0/d6/d5d/d67/d53/f8a 0 2024-09-15T22:26:53.546 INFO:tasks.workunit.client.0.smithi001.stdout:3/953: dread da/d3b/d8b/dee/fa2 [0,4194304] 0 2024-09-15T22:26:53.546 INFO:tasks.workunit.client.0.smithi001.stdout:3/954: creat da/d3d/d43/d41/dff/f148 x:0 0 0 2024-09-15T22:26:53.546 INFO:tasks.workunit.client.0.smithi001.stdout:3/955: chown da 5399 1 2024-09-15T22:26:53.546 INFO:tasks.workunit.client.0.smithi001.stdout:6/927: chown d0/d6/d5d/d67/d53/da0/deb/l11d 2242 1 2024-09-15T22:26:53.546 INFO:tasks.workunit.client.0.smithi001.stdout:3/956: getdents da/d3d/d43/d7c/d53/d72 0 2024-09-15T22:26:53.547 INFO:tasks.workunit.client.0.smithi001.stdout:0/760: dwrite d0/d6/d77/d78/fcd [0,4194304] 0 2024-09-15T22:26:53.551 INFO:tasks.workunit.client.0.smithi001.stdout:5/902: mkdir d3/d6/d41/d4d/dbe/d125 0 2024-09-15T22:26:53.551 INFO:tasks.workunit.client.0.smithi001.stdout:8/822: sync 2024-09-15T22:26:53.551 INFO:tasks.workunit.client.0.smithi001.stdout:5/903: rmdir d3/d6/d41/d4d/dbe/d56/d52/d61/dee 39 2024-09-15T22:26:53.553 INFO:tasks.workunit.client.0.smithi001.stdout:6/928: rename d0/df/d24/d2e/d43/f4a to d0/d6/d5d/d67/d53/da0/d120/f136 0 2024-09-15T22:26:53.554 INFO:tasks.workunit.client.0.smithi001.stdout:0/761: creat d0/d9/db/d5d/d79/dc3/de9/fee x:0 0 0 2024-09-15T22:26:53.554 INFO:tasks.workunit.client.0.smithi001.stdout:0/762: fsync d0/d6/d77/d78/f85 0 2024-09-15T22:26:53.555 INFO:tasks.workunit.client.0.smithi001.stdout:0/763: chown d0/d9/db/d5d 0 1 2024-09-15T22:26:53.559 INFO:tasks.workunit.client.0.smithi001.stdout:5/904: write d3/d1d/fa7 [444245,45697] 0 2024-09-15T22:26:53.559 INFO:tasks.workunit.client.0.smithi001.stdout:5/905: chown d3/d49/f7e 102886 1 2024-09-15T22:26:53.559 INFO:tasks.workunit.client.0.smithi001.stdout:7/879: dread d0/d7/d44/f5b [0,4194304] 0 2024-09-15T22:26:53.559 INFO:tasks.workunit.client.0.smithi001.stdout:7/880: stat d0/d8e/d3e/c69 0 2024-09-15T22:26:53.559 INFO:tasks.workunit.client.0.smithi001.stdout:8/823: mkdir d9/d19/d58/dec 0 2024-09-15T22:26:53.560 INFO:tasks.workunit.client.0.smithi001.stdout:0/764: mkdir d0/d6/d6a/def 0 2024-09-15T22:26:53.560 INFO:tasks.workunit.client.0.smithi001.stdout:6/929: rename d0/df/d24/d2e/d43/d30 to d0/d7e/d137 0 2024-09-15T22:26:53.561 INFO:tasks.workunit.client.0.smithi001.stdout:6/930: rmdir d0/d6/d5d 39 2024-09-15T22:26:53.566 INFO:tasks.workunit.client.0.smithi001.stdout:6/931: truncate d0/fb 3993246 0 2024-09-15T22:26:53.574 INFO:tasks.workunit.client.0.smithi001.stdout:2/918: dwrite d2/d14/d1a/d1b/d82/dc9/d6f/d70/fd8 [0,4194304] 0 2024-09-15T22:26:53.574 INFO:tasks.workunit.client.0.smithi001.stdout:2/919: stat d2/d12/d62/lc4 0 2024-09-15T22:26:53.576 INFO:tasks.workunit.client.0.smithi001.stdout:3/957: dread da/d3b/f32 [0,4194304] 0 2024-09-15T22:26:53.583 INFO:tasks.workunit.client.0.smithi001.stdout:0/765: dread d0/d6/d77/d78/f9b [0,4194304] 0 2024-09-15T22:26:53.584 INFO:tasks.workunit.client.0.smithi001.stdout:0/766: rmdir d0/d9/d1a/ddb/dcf/deb 39 2024-09-15T22:26:53.584 INFO:tasks.workunit.client.0.smithi001.stdout:0/767: write d0/d6/dae/fd1 [875219,70752] 0 2024-09-15T22:26:53.586 INFO:tasks.workunit.client.0.smithi001.stdout:1/918: dwrite d3/d12/d79/dce/d14/d1b/f6d [0,4194304] 0 2024-09-15T22:26:53.588 INFO:tasks.workunit.client.0.smithi001.stdout:1/919: rename d3/d12/d79/dce/d14/d1b/l67 to d3/d12/d79/dce/d3c/d4c/dcc/dd1/l122 0 2024-09-15T22:26:53.588 INFO:tasks.workunit.client.0.smithi001.stdout:1/920: readlink d3/d12/d79/dce/d14/d1b/l2a 0 2024-09-15T22:26:53.590 INFO:tasks.workunit.client.0.smithi001.stdout:1/921: rename d3/d12/d79/dce/d14/d1b/ldc to d3/d12/d79/dd3/l123 0 2024-09-15T22:26:53.590 INFO:tasks.workunit.client.0.smithi001.stdout:1/922: chown d3/d12/d79/dce/ce3 12 1 2024-09-15T22:26:53.596 INFO:tasks.workunit.client.0.smithi001.stdout:1/923: rename d3/d12/d79/dce/d3c/d64 to d3/d12/d79/dce/d14/d1b/d98/d124 0 2024-09-15T22:26:53.597 INFO:tasks.workunit.client.0.smithi001.stdout:1/924: mkdir d3/d12/d79/dce/d14/d23/da1/da2/d125 0 2024-09-15T22:26:53.601 INFO:tasks.workunit.client.0.smithi001.stdout:2/920: write d2/d12/f1c [7008218,19380] 0 2024-09-15T22:26:53.601 INFO:tasks.workunit.client.0.smithi001.stdout:9/845: dwrite d5/de/d1a/f8b [0,4194304] 0 2024-09-15T22:26:53.603 INFO:tasks.workunit.client.0.smithi001.stdout:2/921: rename d2/d14/d1a/d1b/d82/db0/df6/df8/d118/d129/c12b to d2/d14/d1a/d1b/d82/db0/df6/d11d/c138 0 2024-09-15T22:26:53.605 INFO:tasks.workunit.client.0.smithi001.stdout:1/925: dread d3/d12/d79/dce/d3c/d7d/fad [0,4194304] 0 2024-09-15T22:26:53.611 INFO:tasks.workunit.client.0.smithi001.stdout:0/768: dread d0/d9/d1a/d36/f41 [0,4194304] 0 2024-09-15T22:26:53.611 INFO:tasks.workunit.client.0.smithi001.stdout:0/769: getdents d0/d9/d1a/dd8 0 2024-09-15T22:26:53.612 INFO:tasks.workunit.client.0.smithi001.stdout:0/770: write d0/d9/fb2 [72220,93055] 0 2024-09-15T22:26:53.615 INFO:tasks.workunit.client.0.smithi001.stdout:0/771: creat d0/dd/d93/ff0 x:0 0 0 2024-09-15T22:26:53.616 INFO:tasks.workunit.client.0.smithi001.stdout:0/772: creat d0/d9/db/dc5/ff1 x:0 0 0 2024-09-15T22:26:53.617 INFO:tasks.workunit.client.0.smithi001.stdout:0/773: unlink d0/d6/l75 0 2024-09-15T22:26:53.622 INFO:tasks.workunit.client.0.smithi001.stdout:0/774: symlink d0/lf2 0 2024-09-15T22:26:53.640 INFO:tasks.workunit.client.0.smithi001.stdout:8/824: dwrite d9/d19/d29/d35/f8f [0,4194304] 0 2024-09-15T22:26:53.640 INFO:tasks.workunit.client.0.smithi001.stdout:8/825: chown d9/d19/d29/d33/d63/l8d 130339 1 2024-09-15T22:26:53.640 INFO:tasks.workunit.client.0.smithi001.stdout:0/775: write d0/d9/d1a/ddb/dcf/fd9 [3700391,42138] 0 2024-09-15T22:26:53.644 INFO:tasks.workunit.client.0.smithi001.stdout:8/826: rename d9/d19/d34/da4/db7/lbd to d9/d19/d40/d9e/led 0 2024-09-15T22:26:53.644 INFO:tasks.workunit.client.0.smithi001.stdout:8/827: fsync d9/d19/d58/d8e/d9c/fcd 0 2024-09-15T22:26:53.644 INFO:tasks.workunit.client.0.smithi001.stdout:8/828: dread - d9/d19/d40/d5f/fe4 zero size 2024-09-15T22:26:53.645 INFO:tasks.workunit.client.0.smithi001.stdout:8/829: readlink d9/d19/l51 0 2024-09-15T22:26:53.645 INFO:tasks.workunit.client.0.smithi001.stdout:7/881: dwrite d0/d7/d44/d3f/d49/fc7 [0,4194304] 0 2024-09-15T22:26:53.648 INFO:tasks.workunit.client.0.smithi001.stdout:0/776: creat d0/d6/d77/ff3 x:0 0 0 2024-09-15T22:26:53.648 INFO:tasks.workunit.client.0.smithi001.stdout:0/777: fsync d0/d6/d77/fb3 0 2024-09-15T22:26:53.648 INFO:tasks.workunit.client.0.smithi001.stdout:5/906: dwrite d3/d6/d41/d4d/f93 [4194304,4194304] 0 2024-09-15T22:26:53.648 INFO:tasks.workunit.client.0.smithi001.stdout:2/922: dread d2/d14/d1a/d1b/d82/dc9/f75 [0,4194304] 0 2024-09-15T22:26:53.651 INFO:tasks.workunit.client.0.smithi001.stdout:8/830: unlink d9/d19/d40/d5f/d61/d9f/le3 0 2024-09-15T22:26:53.653 INFO:tasks.workunit.client.0.smithi001.stdout:5/907: mkdir d3/d6/d41/d4d/dbe/d126 0 2024-09-15T22:26:53.654 INFO:tasks.workunit.client.0.smithi001.stdout:5/908: chown d3/d6/dd8 8325067 1 2024-09-15T22:26:53.654 INFO:tasks.workunit.client.0.smithi001.stdout:9/846: dwrite d5/de/d1a/d1b/d22/d2c/d21/f8e [0,4194304] 0 2024-09-15T22:26:53.654 INFO:tasks.workunit.client.0.smithi001.stdout:9/847: readlink d5/de/d15/d27/d63/le1 0 2024-09-15T22:26:53.667 INFO:tasks.workunit.client.0.smithi001.stdout:1/926: dwrite d3/f99 [0,4194304] 0 2024-09-15T22:26:53.669 INFO:tasks.workunit.client.0.smithi001.stdout:1/927: rename d3/d12/d79/d85 to d3/d12/d79/dce/d14/d1b/d126 0 2024-09-15T22:26:53.675 INFO:tasks.workunit.client.0.smithi001.stdout:5/909: write d3/d6/d57/d87/d8c/da2/fed [2040374,35985] 0 2024-09-15T22:26:53.675 INFO:tasks.workunit.client.0.smithi001.stdout:5/910: fsync d3/d6/d41/f4c 0 2024-09-15T22:26:53.677 INFO:tasks.workunit.client.0.smithi001.stdout:5/911: mknod d3/d6/d41/d4d/dbe/d56/d52/db8/c127 0 2024-09-15T22:26:53.678 INFO:tasks.workunit.client.0.smithi001.stdout:5/912: symlink d3/d49/l128 0 2024-09-15T22:26:53.679 INFO:tasks.workunit.client.0.smithi001.stdout:5/913: mknod d3/d1d/c129 0 2024-09-15T22:26:53.687 INFO:tasks.workunit.client.0.smithi001.stdout:5/914: creat d3/d6/d41/d4d/dbe/d56/d52/d61/dee/def/f12a x:0 0 0 2024-09-15T22:26:53.687 INFO:tasks.workunit.client.0.smithi001.stdout:5/915: write d3/d6/f7 [2761506,112162] 0 2024-09-15T22:26:53.687 INFO:tasks.workunit.client.0.smithi001.stdout:5/916: chown d3/d27/d7a 2589079 1 2024-09-15T22:26:53.687 INFO:tasks.workunit.client.0.smithi001.stdout:5/917: chown d3/d6/d41/l77 39820 1 2024-09-15T22:26:53.687 INFO:tasks.workunit.client.0.smithi001.stdout:5/918: fsync d3/d6/d41/d4d/d91/fbb 0 2024-09-15T22:26:53.687 INFO:tasks.workunit.client.0.smithi001.stdout:5/919: dread - d3/d6/d41/d88/da3/f122 zero size 2024-09-15T22:26:53.687 INFO:tasks.workunit.client.0.smithi001.stdout:5/920: dread - d3/d6/d41/d4d/dbe/de6/f110 zero size 2024-09-15T22:26:53.687 INFO:tasks.workunit.client.0.smithi001.stdout:6/932: dwrite d0/f22 [0,4194304] 0 2024-09-15T22:26:53.687 INFO:tasks.workunit.client.0.smithi001.stdout:7/882: dwrite d0/dd3/ff2 [0,4194304] 0 2024-09-15T22:26:53.687 INFO:tasks.workunit.client.0.smithi001.stdout:6/933: write d0/d6/f4b [1899909,20488] 0 2024-09-15T22:26:53.688 INFO:tasks.workunit.client.0.smithi001.stdout:1/928: dread d3/d12/d79/dce/d53/fa3 [0,4194304] 0 2024-09-15T22:26:53.688 INFO:tasks.workunit.client.0.smithi001.stdout:1/929: write d3/d12/d79/dce/f38 [378140,21162] 0 2024-09-15T22:26:53.688 INFO:tasks.workunit.client.0.smithi001.stdout:1/930: truncate d3/d12/d79/dce/d14/d23/da1/da2/f10b 987705 0 2024-09-15T22:26:53.688 INFO:tasks.workunit.client.0.smithi001.stdout:5/921: symlink d3/d6/d41/d4d/l12b 0 2024-09-15T22:26:53.690 INFO:tasks.workunit.client.0.smithi001.stdout:0/778: write d0/d9/db/d5d/f76 [2158202,121916] 0 2024-09-15T22:26:53.730 INFO:tasks.workunit.client.0.smithi001.stdout:1/931: write d3/d8d/dae/f70 [3798001,78079] 0 2024-09-15T22:26:53.730 INFO:tasks.workunit.client.0.smithi001.stdout:1/932: fdatasync d3/d12/fef 0 2024-09-15T22:26:53.731 INFO:tasks.workunit.client.0.smithi001.stdout:9/848: dwrite d5/de/d1a/d1b/d22/f4a [4194304,4194304] 0 2024-09-15T22:26:53.731 INFO:tasks.workunit.client.0.smithi001.stdout:5/922: dwrite d3/f33 [0,4194304] 0 2024-09-15T22:26:53.731 INFO:tasks.workunit.client.0.smithi001.stdout:5/923: chown d3/d6/d41/d4d/d5a/l9a 7785 1 2024-09-15T22:26:53.732 INFO:tasks.workunit.client.0.smithi001.stdout:5/924: stat d3/d27/fa6 0 2024-09-15T22:26:53.732 INFO:tasks.workunit.client.0.smithi001.stdout:1/933: creat d3/d12/d79/d89/f127 x:0 0 0 2024-09-15T22:26:53.733 INFO:tasks.workunit.client.0.smithi001.stdout:9/849: creat d5/de/d1a/d1b/d22/d2c/dab/f109 x:0 0 0 2024-09-15T22:26:53.733 INFO:tasks.workunit.client.0.smithi001.stdout:1/934: rename d3/l6e to d3/d12/d79/dce/d3c/d7d/l128 0 2024-09-15T22:26:53.734 INFO:tasks.workunit.client.0.smithi001.stdout:9/850: mkdir d5/de/d1a/da8/d10a 0 2024-09-15T22:26:53.735 INFO:tasks.workunit.client.0.smithi001.stdout:1/935: creat d3/d12/df3/f129 x:0 0 0 2024-09-15T22:26:53.735 INFO:tasks.workunit.client.0.smithi001.stdout:1/936: chown d3/d12/d79/l121 790116 1 2024-09-15T22:26:53.736 INFO:tasks.workunit.client.0.smithi001.stdout:1/937: rename d3/d12/d79/dce/d14/d23/l78 to d3/d12/dbd/l12a 0 2024-09-15T22:26:53.737 INFO:tasks.workunit.client.0.smithi001.stdout:1/938: fsync d3/d12/fb7 0 2024-09-15T22:26:53.740 INFO:tasks.workunit.client.0.smithi001.stdout:1/939: mkdir d3/d8d/dd4/d12b 0 2024-09-15T22:26:53.740 INFO:tasks.workunit.client.0.smithi001.stdout:2/923: dwrite d2/d14/d1a/d1b/f78 [0,4194304] 0 2024-09-15T22:26:53.740 INFO:tasks.workunit.client.0.smithi001.stdout:2/924: chown d2/d14/d1a/d1b/d82/dc9/ca4 33598 1 2024-09-15T22:26:53.740 INFO:tasks.workunit.client.0.smithi001.stdout:8/831: dwrite d9/d19/d34/fc4 [0,4194304] 0 2024-09-15T22:26:53.740 INFO:tasks.workunit.client.0.smithi001.stdout:2/925: write d2/d12/d62/d64/d76/db4/fd1 [1232131,109218] 0 2024-09-15T22:26:53.740 INFO:tasks.workunit.client.0.smithi001.stdout:2/926: fdatasync d2/d12/d62/d64/d76/db4/f119 0 2024-09-15T22:26:53.742 INFO:tasks.workunit.client.0.smithi001.stdout:2/927: creat d2/d14/d1a/d1b/de8/f139 x:0 0 0 2024-09-15T22:26:53.742 INFO:tasks.workunit.client.0.smithi001.stdout:2/928: dread - d2/d12/d62/d64/d76/db4/f10e zero size 2024-09-15T22:26:53.742 INFO:tasks.workunit.client.0.smithi001.stdout:2/929: fdatasync d2/d14/d1a/d1b/d82/d97/f23 0 2024-09-15T22:26:53.742 INFO:tasks.workunit.client.0.smithi001.stdout:8/832: rmdir d9/d19/d40/d5f/d61/d9f 39 2024-09-15T22:26:53.743 INFO:tasks.workunit.client.0.smithi001.stdout:7/883: dwrite d0/d7/d44/d36/fb5 [0,4194304] 0 2024-09-15T22:26:53.743 INFO:tasks.workunit.client.0.smithi001.stdout:7/884: fdatasync d0/d8e/d3e/d127/d60/f11b 0 2024-09-15T22:26:53.744 INFO:tasks.workunit.client.0.smithi001.stdout:8/833: mknod d9/d19/d40/d5f/cee 0 2024-09-15T22:26:53.747 INFO:tasks.workunit.client.0.smithi001.stdout:7/885: rename d0/d7/d21/d6b/d107 to d0/d7/d21/d6b/d93/d132 0 2024-09-15T22:26:53.747 INFO:tasks.workunit.client.0.smithi001.stdout:7/886: write d0/d8e/d3e/d127/f34 [311202,117418] 0 2024-09-15T22:26:53.747 INFO:tasks.workunit.client.0.smithi001.stdout:7/887: write d0/d7/d44/f28 [1250288,76790] 0 2024-09-15T22:26:53.747 INFO:tasks.workunit.client.0.smithi001.stdout:7/888: chown d0/d8e/d3e/d127/l8a 735114 1 2024-09-15T22:26:53.753 INFO:tasks.workunit.client.0.smithi001.stdout:3/958: sync 2024-09-15T22:26:53.754 INFO:tasks.workunit.client.0.smithi001.stdout:3/959: rename da/db3/c142 to da/d3d/d43/d41/dff/c149 0 2024-09-15T22:26:53.755 INFO:tasks.workunit.client.0.smithi001.stdout:3/960: mkdir da/d3d/d43/d7c/d3f/db5/df9/dda/d14a 0 2024-09-15T22:26:53.756 INFO:tasks.workunit.client.0.smithi001.stdout:3/961: dread - da/d3d/d43/d7c/f5f zero size 2024-09-15T22:26:53.756 INFO:tasks.workunit.client.0.smithi001.stdout:3/962: fsync da/d3b/d1b/f140 0 2024-09-15T22:26:53.757 INFO:tasks.workunit.client.0.smithi001.stdout:6/934: dwrite d0/d6/fde [0,4194304] 0 2024-09-15T22:26:53.757 INFO:tasks.workunit.client.0.smithi001.stdout:6/935: chown d0/df/d97/lc0 51480205 1 2024-09-15T22:26:53.764 INFO:tasks.workunit.client.0.smithi001.stdout:1/940: read d3/d12/d79/dce/f34 [155417,93952] 0 2024-09-15T22:26:53.766 INFO:tasks.workunit.client.0.smithi001.stdout:9/851: dread d5/f44 [0,4194304] 0 2024-09-15T22:26:53.767 INFO:tasks.workunit.client.0.smithi001.stdout:1/941: creat d3/d8d/f12c x:0 0 0 2024-09-15T22:26:53.768 INFO:tasks.workunit.client.0.smithi001.stdout:9/852: creat d5/de/d1a/da8/d10a/f10b x:0 0 0 2024-09-15T22:26:53.768 INFO:tasks.workunit.client.0.smithi001.stdout:9/853: truncate d5/de/d15/d27/dc6/ff4 283554 0 2024-09-15T22:26:53.769 INFO:tasks.workunit.client.0.smithi001.stdout:1/942: creat d3/d12/d79/dce/f12d x:0 0 0 2024-09-15T22:26:53.769 INFO:tasks.workunit.client.0.smithi001.stdout:9/854: rmdir d5/de/d51 39 2024-09-15T22:26:53.775 INFO:tasks.workunit.client.0.smithi001.stdout:1/943: mknod d3/d8d/d91/df5/d68/d8a/c12e 0 2024-09-15T22:26:53.775 INFO:tasks.workunit.client.0.smithi001.stdout:9/855: truncate d5/de/d1a/d1b/d22/d2c/d21/d23/fb2 1352273 0 2024-09-15T22:26:53.777 INFO:tasks.workunit.client.0.smithi001.stdout:9/856: mknod d5/de/d1a/d1b/d22/d2c/d21/d68/c10c 0 2024-09-15T22:26:53.777 INFO:tasks.workunit.client.0.smithi001.stdout:9/857: chown d5/de/d1a/d1b/d22/d2c/d21/d4d/l58 1187 1 2024-09-15T22:26:53.778 INFO:tasks.workunit.client.0.smithi001.stdout:9/858: mkdir d5/de/d1a/d1b/d22/d2c/d10d 0 2024-09-15T22:26:53.780 INFO:tasks.workunit.client.0.smithi001.stdout:9/859: link d5/de/d1a/d1b/d22/c35 d5/de/d15/c10e 0 2024-09-15T22:26:53.782 INFO:tasks.workunit.client.0.smithi001.stdout:9/860: creat d5/de/d15/d27/d63/f10f x:0 0 0 2024-09-15T22:26:53.790 INFO:tasks.workunit.client.0.smithi001.stdout:1/944: write d3/d8d/d91/df5/d68/d8a/ff7 [2857014,79912] 0 2024-09-15T22:26:53.806 INFO:tasks.workunit.client.0.smithi001.stdout:2/930: dwrite d2/d14/d1a/d1b/d82/d97/d74/fb5 [0,4194304] 0 2024-09-15T22:26:53.807 INFO:tasks.workunit.client.0.smithi001.stdout:5/925: dwrite d3/d6/d41/d88/da3/f122 [0,4194304] 0 2024-09-15T22:26:53.807 INFO:tasks.workunit.client.0.smithi001.stdout:5/926: write d3/d27/f3a [3102110,114723] 0 2024-09-15T22:26:53.807 INFO:tasks.workunit.client.0.smithi001.stdout:2/931: link d2/d14/d1a/d1b/d82/f107 d2/d14/d1a/d1b/d82/f13a 0 2024-09-15T22:26:53.808 INFO:tasks.workunit.client.0.smithi001.stdout:2/932: readlink d2/d12/d10c/lac 0 2024-09-15T22:26:53.808 INFO:tasks.workunit.client.0.smithi001.stdout:1/945: write d3/d12/d79/dce/d86/fbf [620486,54086] 0 2024-09-15T22:26:53.808 INFO:tasks.workunit.client.0.smithi001.stdout:2/933: rmdir d2/d14/d1a/d1b/d82/db0/df6/df8/d12a 39 2024-09-15T22:26:53.809 INFO:tasks.workunit.client.0.smithi001.stdout:2/934: truncate d2/d14/d1a/d1b/d82/f13a 881133 0 2024-09-15T22:26:53.810 INFO:tasks.workunit.client.0.smithi001.stdout:2/935: mkdir d2/d14/d13b 0 2024-09-15T22:26:53.811 INFO:tasks.workunit.client.0.smithi001.stdout:5/927: symlink d3/d6/d41/d4d/dc0/l12c 0 2024-09-15T22:26:53.812 INFO:tasks.workunit.client.0.smithi001.stdout:5/928: symlink d3/d6/d41/d4d/d5a/d84/l12d 0 2024-09-15T22:26:53.813 INFO:tasks.workunit.client.0.smithi001.stdout:5/929: write d3/d6/d41/d88/da3/f11e [626535,57271] 0 2024-09-15T22:26:53.814 INFO:tasks.workunit.client.0.smithi001.stdout:5/930: symlink d3/d6/l12e 0 2024-09-15T22:26:53.822 INFO:tasks.workunit.client.0.smithi001.stdout:9/861: write d5/de/d1a/d1b/d22/d2c/d21/d23/fd2 [2752044,52907] 0 2024-09-15T22:26:53.823 INFO:tasks.workunit.client.0.smithi001.stdout:1/946: write d3/d12/d79/dce/d14/f44 [1694874,42614] 0 2024-09-15T22:26:53.823 INFO:tasks.workunit.client.0.smithi001.stdout:1/947: dread - d3/d12/d79/dce/d14/fdf zero size 2024-09-15T22:26:53.826 INFO:tasks.workunit.client.0.smithi001.stdout:5/931: dread d3/d27/d4e/d89/f9b [0,4194304] 0 2024-09-15T22:26:53.828 INFO:tasks.workunit.client.0.smithi001.stdout:5/932: creat d3/d6/d41/d88/db0/d10e/f12f x:0 0 0 2024-09-15T22:26:53.828 INFO:tasks.workunit.client.0.smithi001.stdout:5/933: read d3/d6/d41/f5e [7116173,126829] 0 2024-09-15T22:26:53.828 INFO:tasks.workunit.client.0.smithi001.stdout:7/889: dread d0/dd3/ff2 [0,4194304] 0 2024-09-15T22:26:53.831 INFO:tasks.workunit.client.0.smithi001.stdout:8/834: dwrite d9/d19/d58/fcc [0,4194304] 0 2024-09-15T22:26:53.838 INFO:tasks.workunit.client.0.smithi001.stdout:8/835: truncate d9/d19/d58/f68 3959632 0 2024-09-15T22:26:53.839 INFO:tasks.workunit.client.0.smithi001.stdout:9/862: dread d5/de/d1a/f8b [0,4194304] 0 2024-09-15T22:26:53.840 INFO:tasks.workunit.client.0.smithi001.stdout:8/836: link d9/d19/fbe d9/d19/d34/fef 0 2024-09-15T22:26:53.840 INFO:tasks.workunit.client.0.smithi001.stdout:9/863: mkdir d5/de/d15/d27/d63/d110 0 2024-09-15T22:26:53.843 INFO:tasks.workunit.client.0.smithi001.stdout:8/837: creat d9/d19/d40/d5f/d61/ff0 x:0 0 0 2024-09-15T22:26:53.843 INFO:tasks.workunit.client.0.smithi001.stdout:8/838: fsync d9/d19/d29/f2a 0 2024-09-15T22:26:53.843 INFO:tasks.workunit.client.0.smithi001.stdout:9/864: rename d5/de/d1a/d1b/d22/d2c/d21/d4d/f101 to d5/de/d1a/d1b/d22/d97/f111 0 2024-09-15T22:26:53.856 INFO:tasks.workunit.client.0.smithi001.stdout:8/839: dread d9/d19/f3f [0,4194304] 0 2024-09-15T22:26:53.856 INFO:tasks.workunit.client.0.smithi001.stdout:8/840: fdatasync d9/d19/d29/d50/f52 0 2024-09-15T22:26:53.856 INFO:tasks.workunit.client.0.smithi001.stdout:8/841: write d9/d19/d34/f43 [4699472,104876] 0 2024-09-15T22:26:53.856 INFO:tasks.workunit.client.0.smithi001.stdout:8/842: chown d9/d19/d29/d50/d70/d76/cb5 85 1 2024-09-15T22:26:53.856 INFO:tasks.workunit.client.0.smithi001.stdout:8/843: chown d9/d19/d40 245783799 1 2024-09-15T22:26:53.863 INFO:tasks.workunit.client.0.smithi001.stdout:3/963: dwrite da/d3d/d43/d7c/d3f/f87 [0,4194304] 0 2024-09-15T22:26:53.866 INFO:tasks.workunit.client.0.smithi001.stdout:3/964: write da/d90/d6f/d102/f13e [512671,34833] 0 2024-09-15T22:26:53.867 INFO:tasks.workunit.client.0.smithi001.stdout:0/779: sync 2024-09-15T22:26:53.875 INFO:tasks.workunit.client.0.smithi001.stdout:0/780: mkdir d0/d9/db/d5d/df4 0 2024-09-15T22:26:53.884 INFO:tasks.workunit.client.0.smithi001.stdout:2/936: dwrite d2/d14/de1/f135 [0,4194304] 0 2024-09-15T22:26:53.884 INFO:tasks.workunit.client.0.smithi001.stdout:3/965: write da/dae/f8a [6045160,106903] 0 2024-09-15T22:26:53.885 INFO:tasks.workunit.client.0.smithi001.stdout:5/934: dwrite d3/d27/d4e/f58 [0,4194304] 0 2024-09-15T22:26:53.885 INFO:tasks.workunit.client.0.smithi001.stdout:3/966: getdents da/d90/d6f/dc7 0 2024-09-15T22:26:53.886 INFO:tasks.workunit.client.0.smithi001.stdout:2/937: mknod d2/d14/d1a/d1b/d82/db0/df6/df8/c13c 0 2024-09-15T22:26:53.888 INFO:tasks.workunit.client.0.smithi001.stdout:5/935: mknod d3/d6/d25/c130 0 2024-09-15T22:26:53.888 INFO:tasks.workunit.client.0.smithi001.stdout:3/967: symlink da/d3b/d58/l14b 0 2024-09-15T22:26:53.888 INFO:tasks.workunit.client.0.smithi001.stdout:5/936: fsync d3/d6/d57/d87/f106 0 2024-09-15T22:26:53.888 INFO:tasks.workunit.client.0.smithi001.stdout:1/948: dwrite d3/f3f [0,4194304] 0 2024-09-15T22:26:53.888 INFO:tasks.workunit.client.0.smithi001.stdout:1/949: chown d3/d12/d79/dce/d14/d23/da1/da2 165 1 2024-09-15T22:26:53.889 INFO:tasks.workunit.client.0.smithi001.stdout:3/968: mknod da/d90/d6f/c14c 0 2024-09-15T22:26:53.889 INFO:tasks.workunit.client.0.smithi001.stdout:3/969: getdents da/d3d/d43/d41/dff 0 2024-09-15T22:26:53.890 INFO:tasks.workunit.client.0.smithi001.stdout:1/950: creat d3/d12/d79/dce/d3c/d4c/f12f x:0 0 0 2024-09-15T22:26:53.890 INFO:tasks.workunit.client.0.smithi001.stdout:1/951: stat d3/d12/d79/dce/d3c/f5b 0 2024-09-15T22:26:53.892 INFO:tasks.workunit.client.0.smithi001.stdout:1/952: creat d3/d12/d79/dce/d3c/d4c/dcc/dd1/f130 x:0 0 0 2024-09-15T22:26:53.893 INFO:tasks.workunit.client.0.smithi001.stdout:1/953: fdatasync d3/d8d/dae/ff8 0 2024-09-15T22:26:53.893 INFO:tasks.workunit.client.0.smithi001.stdout:1/954: chown d3/d8d/d91/df5/c51 0 1 2024-09-15T22:26:53.894 INFO:tasks.workunit.client.0.smithi001.stdout:1/955: truncate d3/d12/d79/dce/d3c/d4c/f4e 2655559 0 2024-09-15T22:26:53.901 INFO:tasks.workunit.client.0.smithi001.stdout:2/938: dread d2/d14/d1a/d1b/f22 [0,4194304] 0 2024-09-15T22:26:53.901 INFO:tasks.workunit.client.0.smithi001.stdout:2/939: write d2/d14/d1a/d1b/d82/f107 [1778925,29933] 0 2024-09-15T22:26:53.906 INFO:tasks.workunit.client.0.smithi001.stdout:1/956: mkdir d3/d12/d79/dce/d14/daa/ddd/df4/d131 0 2024-09-15T22:26:53.920 INFO:tasks.workunit.client.0.smithi001.stdout:5/937: dread d3/d6/d41/f5e [0,4194304] 0 2024-09-15T22:26:53.921 INFO:tasks.workunit.client.0.smithi001.stdout:6/936: sync 2024-09-15T22:26:53.921 INFO:tasks.workunit.client.0.smithi001.stdout:6/937: write d0/df/d97/f107 [347234,93074] 0 2024-09-15T22:26:53.935 INFO:tasks.workunit.client.0.smithi001.stdout:5/938: dread d3/d6/d41/d4d/dbe/d56/d52/d61/dee/ff5 [0,4194304] 0 2024-09-15T22:26:53.935 INFO:tasks.workunit.client.0.smithi001.stdout:5/939: readlink d3/d27/l85 0 2024-09-15T22:26:53.937 INFO:tasks.workunit.client.0.smithi001.stdout:3/970: dwrite da/d3b/d8b/dee/f3e [0,4194304] 0 2024-09-15T22:26:53.939 INFO:tasks.workunit.client.0.smithi001.stdout:8/844: dwrite d9/d19/f77 [0,4194304] 0 2024-09-15T22:26:53.939 INFO:tasks.workunit.client.0.smithi001.stdout:3/971: rename da/dae/f83 to da/d3d/d43/d41/df1/f14d 0 2024-09-15T22:26:53.939 INFO:tasks.workunit.client.0.smithi001.stdout:3/972: fsync da/d3d/d43/d41/df1/d7f/fcd 0 2024-09-15T22:26:53.939 INFO:tasks.workunit.client.0.smithi001.stdout:3/973: chown da/d3d/d43/d7c/d53/d72/lde 13 1 2024-09-15T22:26:53.939 INFO:tasks.workunit.client.0.smithi001.stdout:3/974: write da/dae/d8e/fe2 [738036,64869] 0 2024-09-15T22:26:53.941 INFO:tasks.workunit.client.0.smithi001.stdout:8/845: rmdir d9/d19/d58/d8e/dc7 0 2024-09-15T22:26:53.942 INFO:tasks.workunit.client.0.smithi001.stdout:8/846: chown d9/f11 2950516 1 2024-09-15T22:26:53.944 INFO:tasks.workunit.client.0.smithi001.stdout:8/847: truncate d9/d19/d29/d50/fa2 2740028 0 2024-09-15T22:26:53.946 INFO:tasks.workunit.client.0.smithi001.stdout:8/848: symlink d9/lf1 0 2024-09-15T22:26:53.946 INFO:tasks.workunit.client.0.smithi001.stdout:8/849: stat d9/d19/d29/c5c 0 2024-09-15T22:26:53.987 INFO:tasks.workunit.client.0.smithi001.stdout:1/957: write d3/d12/d79/dce/d14/f1c [2372636,126276] 0 2024-09-15T22:26:53.988 INFO:tasks.workunit.client.0.smithi001.stdout:1/958: write d3/d12/d79/dce/d14/d1b/d98/d124/fa6 [1493226,41202] 0 2024-09-15T22:26:53.988 INFO:tasks.workunit.client.0.smithi001.stdout:1/959: fdatasync d3/d12/d79/dce/d14/fdf 0 2024-09-15T22:26:53.988 INFO:tasks.workunit.client.0.smithi001.stdout:0/781: dwrite d0/d9/db/f19 [4194304,4194304] 0 2024-09-15T22:26:53.989 INFO:tasks.workunit.client.0.smithi001.stdout:0/782: chown d0/d6/d77 22540 1 2024-09-15T22:26:53.989 INFO:tasks.workunit.client.0.smithi001.stdout:0/783: write d0/d9/d1a/ddb/dcf/fd9 [5060249,49784] 0 2024-09-15T22:26:53.991 INFO:tasks.workunit.client.0.smithi001.stdout:1/960: creat d3/d12/d79/f132 x:0 0 0 2024-09-15T22:26:53.992 INFO:tasks.workunit.client.0.smithi001.stdout:1/961: readlink d3/d12/d79/dce/d14/d23/da1/de9/l11c 0 2024-09-15T22:26:53.992 INFO:tasks.workunit.client.0.smithi001.stdout:1/962: stat d3/d12/d79/dce/d14/l65 0 2024-09-15T22:26:54.001 INFO:tasks.workunit.client.0.smithi001.stdout:1/963: dread d3/d8d/d91/df5/fb1 [0,4194304] 0 2024-09-15T22:26:54.001 INFO:tasks.workunit.client.0.smithi001.stdout:1/964: fsync d3/d12/d79/dce/d3c/d4c/f6b 0 2024-09-15T22:26:54.002 INFO:tasks.workunit.client.0.smithi001.stdout:1/965: truncate d3/d12/d79/dce/d14/f105 23362 0 2024-09-15T22:26:54.003 INFO:tasks.workunit.client.0.smithi001.stdout:1/966: rename d3/fee to d3/d12/df3/f133 0 2024-09-15T22:26:54.004 INFO:tasks.workunit.client.0.smithi001.stdout:1/967: write d3/d8d/dd4/fde [930363,115409] 0 2024-09-15T22:26:54.006 INFO:tasks.workunit.client.0.smithi001.stdout:8/850: dwrite d9/d19/f1e [0,4194304] 0 2024-09-15T22:26:54.006 INFO:tasks.workunit.client.0.smithi001.stdout:3/975: dwrite da/d3d/d43/d7c/d3f/db5/df9/fdf [4194304,4194304] 0 2024-09-15T22:26:54.006 INFO:tasks.workunit.client.0.smithi001.stdout:3/976: chown da/d16/ff 2428062 1 2024-09-15T22:26:54.006 INFO:tasks.workunit.client.0.smithi001.stdout:7/890: sync 2024-09-15T22:26:54.006 INFO:tasks.workunit.client.0.smithi001.stdout:7/891: chown d0/d7/d44/d3f/f75 3415 1 2024-09-15T22:26:54.007 INFO:tasks.workunit.client.0.smithi001.stdout:5/940: dwrite d3/d6/d41/fb9 [4194304,4194304] 0 2024-09-15T22:26:54.008 INFO:tasks.workunit.client.0.smithi001.stdout:8/851: getdents d9/d19/d29/d50/d70 0 2024-09-15T22:26:54.008 INFO:tasks.workunit.client.0.smithi001.stdout:5/941: getdents d3/d6/d41/d4d/dbe/d56/ddc/de9/df6 0 2024-09-15T22:26:54.011 INFO:tasks.workunit.client.0.smithi001.stdout:0/784: write d0/d6/d77/d78/fcd [2389987,123599] 0 2024-09-15T22:26:54.011 INFO:tasks.workunit.client.0.smithi001.stdout:0/785: fdatasync d0/dd/d63/fac 0 2024-09-15T22:26:54.011 INFO:tasks.workunit.client.0.smithi001.stdout:6/938: dwrite d0/df/d24/d49/f56 [0,4194304] 0 2024-09-15T22:26:54.012 INFO:tasks.workunit.client.0.smithi001.stdout:3/977: link da/d90/fbf da/d3d/f14e 0 2024-09-15T22:26:54.013 INFO:tasks.workunit.client.0.smithi001.stdout:1/968: dread d3/d8d/d91/df5/fb1 [0,4194304] 0 2024-09-15T22:26:54.013 INFO:tasks.workunit.client.0.smithi001.stdout:1/969: write d3/d8d/dd4/fde [1133440,71330] 0 2024-09-15T22:26:54.014 INFO:tasks.workunit.client.0.smithi001.stdout:7/892: creat d0/d7/d21/d6b/d93/d132/f133 x:0 0 0 2024-09-15T22:26:54.014 INFO:tasks.workunit.client.0.smithi001.stdout:7/893: write d0/d8e/d3e/d127/fec [1011913,19968] 0 2024-09-15T22:26:54.014 INFO:tasks.workunit.client.0.smithi001.stdout:7/894: chown d0/d8e/d3e/d127/d60/d10d/dac/dda 1504161 1 2024-09-15T22:26:54.014 INFO:tasks.workunit.client.0.smithi001.stdout:0/786: mknod d0/d6/d6a/cf5 0 2024-09-15T22:26:54.015 INFO:tasks.workunit.client.0.smithi001.stdout:0/787: fsync d0/dd/d63/f97 0 2024-09-15T22:26:54.015 INFO:tasks.workunit.client.0.smithi001.stdout:1/970: creat d3/d12/d79/dce/d14/d1b/d98/d124/f134 x:0 0 0 2024-09-15T22:26:54.015 INFO:tasks.workunit.client.0.smithi001.stdout:3/978: symlink da/d101/l14f 0 2024-09-15T22:26:54.016 INFO:tasks.workunit.client.0.smithi001.stdout:0/788: creat d0/dd/d63/db6/ff6 x:0 0 0 2024-09-15T22:26:54.017 INFO:tasks.workunit.client.0.smithi001.stdout:0/789: creat d0/dd/ff7 x:0 0 0 2024-09-15T22:26:54.017 INFO:tasks.workunit.client.0.smithi001.stdout:0/790: truncate d0/d51/f99 4687103 0 2024-09-15T22:26:54.021 INFO:tasks.workunit.client.0.smithi001.stdout:0/791: creat d0/d6/d6a/def/ff8 x:0 0 0 2024-09-15T22:26:54.036 INFO:tasks.workunit.client.0.smithi001.stdout:8/852: dread d9/fa [0,4194304] 0 2024-09-15T22:26:54.036 INFO:tasks.workunit.client.0.smithi001.stdout:9/865: sync 2024-09-15T22:26:54.036 INFO:tasks.workunit.client.0.smithi001.stdout:9/866: chown d5/de/d1a/d1b/d22/d2c/cb 10820 1 2024-09-15T22:26:54.038 INFO:tasks.workunit.client.0.smithi001.stdout:1/971: dread d3/d8d/dd4/fd7 [0,4194304] 0 2024-09-15T22:26:54.038 INFO:tasks.workunit.client.0.smithi001.stdout:1/972: write d3/d12/d79/dce/d14/d1b/d98/d124/fa6 [876169,78693] 0 2024-09-15T22:26:54.045 INFO:tasks.workunit.client.0.smithi001.stdout:3/979: dread da/d3d/d43/d41/f54 [0,4194304] 0 2024-09-15T22:26:54.046 INFO:tasks.workunit.client.0.smithi001.stdout:3/980: write da/d9e/fe8 [436947,22705] 0 2024-09-15T22:26:54.049 INFO:tasks.workunit.client.0.smithi001.stdout:6/939: dwrite d0/d7e/ff7 [0,4194304] 0 2024-09-15T22:26:54.049 INFO:tasks.workunit.client.0.smithi001.stdout:6/940: readlink d0/df/d24/d49/dc7/ddd/le0 0 2024-09-15T22:26:54.051 INFO:tasks.workunit.client.0.smithi001.stdout:6/941: chown d0/d6/d5d/d67/d53/fda 25106589 1 2024-09-15T22:26:54.052 INFO:tasks.workunit.client.0.smithi001.stdout:6/942: mknod d0/d6/d5d/d67/d53/da0/dfc/c138 0 2024-09-15T22:26:54.059 INFO:tasks.workunit.client.0.smithi001.stdout:9/867: dread d5/de/d15/d27/d63/f79 [0,4194304] 0 2024-09-15T22:26:54.060 INFO:tasks.workunit.client.0.smithi001.stdout:9/868: chown d5/de/d51/ce2 26018181 1 2024-09-15T22:26:54.061 INFO:tasks.workunit.client.0.smithi001.stdout:9/869: link d5/de/d1a/d1b/d22/d2c/d21/d24/d86/f103 d5/de/d1a/d1b/d22/d2c/d21/d4d/f112 0 2024-09-15T22:26:54.066 INFO:tasks.workunit.client.0.smithi001.stdout:6/943: read d0/df/d24/d49/f56 [3397026,98010] 0 2024-09-15T22:26:54.076 INFO:tasks.workunit.client.0.smithi001.stdout:9/870: dread d5/de/d1a/d1b/d22/fe4 [0,4194304] 0 2024-09-15T22:26:54.078 INFO:tasks.workunit.client.0.smithi001.stdout:9/871: rename d5/de/d51/d53/d9f/da1 to d5/de/d113 0 2024-09-15T22:26:54.079 INFO:tasks.workunit.client.0.smithi001.stdout:9/872: unlink d5/de/d15/d27/d63/f10f 0 2024-09-15T22:26:54.081 INFO:tasks.workunit.client.0.smithi001.stdout:9/873: creat d5/f114 x:0 0 0 2024-09-15T22:26:54.081 INFO:tasks.workunit.client.0.smithi001.stdout:9/874: readlink d5/de/d51/d53/l8f 0 2024-09-15T22:26:54.082 INFO:tasks.workunit.client.0.smithi001.stdout:9/875: link d5/de/d1a/l1e d5/de/d1a/d1b/l115 0 2024-09-15T22:26:54.082 INFO:tasks.workunit.client.0.smithi001.stdout:6/944: dread d0/d6/d5d/d67/f54 [0,4194304] 0 2024-09-15T22:26:54.089 INFO:tasks.workunit.client.0.smithi001.stdout:0/792: dread d0/dd/f47 [0,4194304] 0 2024-09-15T22:26:54.092 INFO:tasks.workunit.client.0.smithi001.stdout:0/793: mkdir d0/df9 0 2024-09-15T22:26:54.094 INFO:tasks.workunit.client.0.smithi001.stdout:0/794: creat d0/d9/db/d5d/ffa x:0 0 0 2024-09-15T22:26:54.094 INFO:tasks.workunit.client.0.smithi001.stdout:0/795: fsync d0/d6/d77/d78/fb7 0 2024-09-15T22:26:54.095 INFO:tasks.workunit.client.0.smithi001.stdout:0/796: mknod d0/d9/db/d5d/d6d/cfb 0 2024-09-15T22:26:54.097 INFO:tasks.workunit.client.0.smithi001.stdout:0/797: rename d0/d9/db/c69 to d0/d9/db/dc5/cfc 0 2024-09-15T22:26:54.097 INFO:tasks.workunit.client.0.smithi001.stdout:0/798: fsync d0/d6/d77/d78/fb7 0 2024-09-15T22:26:54.098 INFO:tasks.workunit.client.0.smithi001.stdout:0/799: creat d0/d9/d1a/d70/ffd x:0 0 0 2024-09-15T22:26:54.099 INFO:tasks.workunit.client.0.smithi001.stdout:0/800: chown d0/l52 22 1 2024-09-15T22:26:54.099 INFO:tasks.workunit.client.0.smithi001.stdout:0/801: dread - d0/d9/db/d5d/d6d/fcb zero size 2024-09-15T22:26:54.099 INFO:tasks.workunit.client.0.smithi001.stdout:0/802: fsync d0/d9/d1a/d70/f87 0 2024-09-15T22:26:54.109 INFO:tasks.workunit.client.0.smithi001.stdout:5/942: dwrite d3/d6/d41/d4d/dbe/d56/d52/d61/dee/def/f12a [0,4194304] 0 2024-09-15T22:26:54.116 INFO:tasks.workunit.client.0.smithi001.stdout:5/943: truncate d3/d27/d5c/dd6/fe2 573840 0 2024-09-15T22:26:54.116 INFO:tasks.workunit.client.0.smithi001.stdout:0/803: dread d0/dd/ff [0,4194304] 0 2024-09-15T22:26:54.117 INFO:tasks.workunit.client.0.smithi001.stdout:6/945: dread d0/df/fb3 [0,4194304] 0 2024-09-15T22:26:54.117 INFO:tasks.workunit.client.0.smithi001.stdout:6/946: truncate d0/d6/d5d/f91 4407786 0 2024-09-15T22:26:54.119 INFO:tasks.workunit.client.0.smithi001.stdout:6/947: creat d0/df/d97/f139 x:0 0 0 2024-09-15T22:26:54.119 INFO:tasks.workunit.client.0.smithi001.stdout:6/948: write d0/d7e/d137/da7/ff5 [9238801,116061] 0 2024-09-15T22:26:54.120 INFO:tasks.workunit.client.0.smithi001.stdout:6/949: mkdir d0/df/d24/d2e/d104/d13a 0 2024-09-15T22:26:54.129 INFO:tasks.workunit.client.0.smithi001.stdout:3/981: dread da/d3b/f32 [0,4194304] 0 2024-09-15T22:26:54.130 INFO:tasks.workunit.client.0.smithi001.stdout:7/895: dwrite d0/d7/d44/d3f/f75 [0,4194304] 0 2024-09-15T22:26:54.131 INFO:tasks.workunit.client.0.smithi001.stdout:7/896: chown d0/dd3/df9 185405131 1 2024-09-15T22:26:54.132 INFO:tasks.workunit.client.0.smithi001.stdout:7/897: creat d0/db3/f134 x:0 0 0 2024-09-15T22:26:54.138 INFO:tasks.workunit.client.0.smithi001.stdout:8/853: dwrite d9/d19/d58/d8e/d9c/fcd [0,4194304] 0 2024-09-15T22:26:54.138 INFO:tasks.workunit.client.0.smithi001.stdout:8/854: stat d9/d19/d29/d50/d70/fb2 0 2024-09-15T22:26:54.140 INFO:tasks.workunit.client.0.smithi001.stdout:6/950: read d0/df/d24/d2e/d43/f106 [215527,22385] 0 2024-09-15T22:26:54.144 INFO:tasks.workunit.client.0.smithi001.stdout:2/940: sync 2024-09-15T22:26:54.144 INFO:tasks.workunit.client.0.smithi001.stdout:2/941: stat d2/d12/cb1 0 2024-09-15T22:26:54.145 INFO:tasks.workunit.client.0.smithi001.stdout:2/942: getdents d2/d12/d62/d64/d76/db4/def 0 2024-09-15T22:26:54.149 INFO:tasks.workunit.client.0.smithi001.stdout:7/898: write d0/db3/fd8 [695597,126491] 0 2024-09-15T22:26:54.151 INFO:tasks.workunit.client.0.smithi001.stdout:7/899: link d0/d7/dc6/cc4 d0/d7/d44/c135 0 2024-09-15T22:26:54.151 INFO:tasks.workunit.client.0.smithi001.stdout:6/951: dread d0/f9 [0,4194304] 0 2024-09-15T22:26:54.151 INFO:tasks.workunit.client.0.smithi001.stdout:7/900: chown d0/d7/d21/l22 105 1 2024-09-15T22:26:54.151 INFO:tasks.workunit.client.0.smithi001.stdout:7/901: fdatasync d0/d8e/d3e/f51 0 2024-09-15T22:26:54.151 INFO:tasks.workunit.client.0.smithi001.stdout:7/902: symlink d0/d7/d21/d6b/d93/d132/l136 0 2024-09-15T22:26:54.153 INFO:tasks.workunit.client.0.smithi001.stdout:7/903: truncate d0/d7/d44/d3f/d49/fab 482377 0 2024-09-15T22:26:54.153 INFO:tasks.workunit.client.0.smithi001.stdout:7/904: truncate d0/d7/dd5/d128/f130 1046493 0 2024-09-15T22:26:54.153 INFO:tasks.workunit.client.0.smithi001.stdout:7/905: dread - d0/d8e/d3e/d127/d60/ffa zero size 2024-09-15T22:26:54.153 INFO:tasks.workunit.client.0.smithi001.stdout:7/906: symlink d0/d7/d7c/d122/l137 0 2024-09-15T22:26:54.154 INFO:tasks.workunit.client.0.smithi001.stdout:7/907: mkdir d0/d7/dc6/d105/d138 0 2024-09-15T22:26:54.164 INFO:tasks.workunit.client.0.smithi001.stdout:9/876: dwrite d5/de/d15/fce [0,4194304] 0 2024-09-15T22:26:54.168 INFO:tasks.workunit.client.0.smithi001.stdout:0/804: dread d0/dd/d63/f97 [0,4194304] 0 2024-09-15T22:26:54.170 INFO:tasks.workunit.client.0.smithi001.stdout:0/805: rmdir d0/d9/db/de1 0 2024-09-15T22:26:54.171 INFO:tasks.workunit.client.0.smithi001.stdout:0/806: dread - d0/d9/db/d5d/ffa zero size 2024-09-15T22:26:54.182 INFO:tasks.workunit.client.0.smithi001.stdout:3/982: dwrite da/d90/d92/fad [0,4194304] 0 2024-09-15T22:26:54.185 INFO:tasks.workunit.client.0.smithi001.stdout:3/983: rename da/d90/d92 to da/d3d/d43/d41/df1/d7f/d126/d150 0 2024-09-15T22:26:54.197 INFO:tasks.workunit.client.0.smithi001.stdout:5/944: dwrite d3/d6/d57/fe5 [4194304,4194304] 0 2024-09-15T22:26:54.201 INFO:tasks.workunit.client.0.smithi001.stdout:5/945: symlink d3/d6/d41/d88/df0/l131 0 2024-09-15T22:26:54.201 INFO:tasks.workunit.client.0.smithi001.stdout:5/946: symlink d3/d6/d41/d4d/d5a/d84/l132 0 2024-09-15T22:26:54.203 INFO:tasks.workunit.client.0.smithi001.stdout:5/947: creat d3/d27/d4e/d89/f133 x:0 0 0 2024-09-15T22:26:54.204 INFO:tasks.workunit.client.0.smithi001.stdout:2/943: dwrite d2/d12/d62/d64/d76/db4/f10e [0,4194304] 0 2024-09-15T22:26:54.207 INFO:tasks.workunit.client.0.smithi001.stdout:2/944: creat d2/d12/d62/f13d x:0 0 0 2024-09-15T22:26:54.213 INFO:tasks.workunit.client.0.smithi001.stdout:3/984: dread da/d90/fb1 [0,4194304] 0 2024-09-15T22:26:54.213 INFO:tasks.workunit.client.0.smithi001.stdout:8/855: dwrite d9/fa [0,4194304] 0 2024-09-15T22:26:54.214 INFO:tasks.workunit.client.0.smithi001.stdout:3/985: symlink da/d16/l151 0 2024-09-15T22:26:54.214 INFO:tasks.workunit.client.0.smithi001.stdout:3/986: chown da/d101 782544324 1 2024-09-15T22:26:54.214 INFO:tasks.workunit.client.0.smithi001.stdout:3/987: write da/d3d/d43/d41/df1/ff0 [4856773,128967] 0 2024-09-15T22:26:54.214 INFO:tasks.workunit.client.0.smithi001.stdout:3/988: fdatasync da/d101/f113 0 2024-09-15T22:26:54.214 INFO:tasks.workunit.client.0.smithi001.stdout:3/989: fsync da/f13 0 2024-09-15T22:26:54.215 INFO:tasks.workunit.client.0.smithi001.stdout:8/856: mkdir d9/d19/d29/df2 0 2024-09-15T22:26:54.215 INFO:tasks.workunit.client.0.smithi001.stdout:3/990: creat da/d9e/f152 x:0 0 0 2024-09-15T22:26:54.216 INFO:tasks.workunit.client.0.smithi001.stdout:3/991: truncate da/d16/f26 2161493 0 2024-09-15T22:26:54.216 INFO:tasks.workunit.client.0.smithi001.stdout:3/992: stat da/d3d/d43/d41/df1/d7f/d126/d150 0 2024-09-15T22:26:54.216 INFO:tasks.workunit.client.0.smithi001.stdout:3/993: truncate da/db3/ffd 623363 0 2024-09-15T22:26:54.216 INFO:tasks.workunit.client.0.smithi001.stdout:3/994: dread - da/d90/d6f/dc7/f12b zero size 2024-09-15T22:26:54.216 INFO:tasks.workunit.client.0.smithi001.stdout:3/995: readlink da/d16/lc4 0 2024-09-15T22:26:54.220 INFO:tasks.workunit.client.0.smithi001.stdout:8/857: symlink d9/d19/d40/d9e/dc2/lf3 0 2024-09-15T22:26:54.221 INFO:tasks.workunit.client.0.smithi001.stdout:8/858: dread - d9/d19/d34/d41/fbf zero size 2024-09-15T22:26:54.221 INFO:tasks.workunit.client.0.smithi001.stdout:8/859: chown d9/d19/d58/d8e/f9d 469 1 2024-09-15T22:26:54.221 INFO:tasks.workunit.client.0.smithi001.stdout:3/996: rename da/db3/ffd to da/d3d/d43/d41/f153 0 2024-09-15T22:26:54.221 INFO:tasks.workunit.client.0.smithi001.stdout:3/997: dread - da/d3b/d8b/dbe/f10c zero size 2024-09-15T22:26:54.221 INFO:tasks.workunit.client.0.smithi001.stdout:3/998: unlink da/d3d/d43/c42 0 2024-09-15T22:26:54.221 INFO:tasks.workunit.client.0.smithi001.stdout:3/999: chown da/d16/f26 143412087 1 2024-09-15T22:26:54.232 INFO:tasks.workunit.client.0.smithi001.stdout:2/945: dread d2/d14/fed [0,4194304] 0 2024-09-15T22:26:54.232 INFO:tasks.workunit.client.0.smithi001.stdout:9/877: dwrite d5/de/d51/d53/f60 [0,4194304] 0 2024-09-15T22:26:54.232 INFO:tasks.workunit.client.0.smithi001.stdout:7/908: dwrite d0/d7/d44/d3f/d49/d4f/f12e [0,4194304] 0 2024-09-15T22:26:54.232 INFO:tasks.workunit.client.0.smithi001.stdout:7/909: chown d0/d7/d44/d3f/lce 7 1 2024-09-15T22:26:54.235 INFO:tasks.workunit.client.0.smithi001.stdout:9/878: mknod d5/de/d1a/d1b/d22/d2c/d21/d68/c116 0 2024-09-15T22:26:54.235 INFO:tasks.workunit.client.0.smithi001.stdout:9/879: chown d5/de/d1a/f8b 1004479492 1 2024-09-15T22:26:54.237 INFO:tasks.workunit.client.0.smithi001.stdout:2/946: symlink d2/l13e 0 2024-09-15T22:26:54.237 INFO:tasks.workunit.client.0.smithi001.stdout:9/880: truncate d5/f44 4795840 0 2024-09-15T22:26:54.238 INFO:tasks.workunit.client.0.smithi001.stdout:2/947: rmdir d2/d14/d1a 39 2024-09-15T22:26:54.239 INFO:tasks.workunit.client.0.smithi001.stdout:2/948: creat d2/d14/d1a/d80/f13f x:0 0 0 2024-09-15T22:26:54.241 INFO:tasks.workunit.client.0.smithi001.stdout:2/949: creat d2/d14/f140 x:0 0 0 2024-09-15T22:26:54.241 INFO:tasks.workunit.client.0.smithi001.stdout:2/950: fsync d2/d14/d1a/fd5 0 2024-09-15T22:26:54.241 INFO:tasks.workunit.client.0.smithi001.stdout:2/951: fdatasync d2/d14/d1a/d1b/d82/db0/f12c 0 2024-09-15T22:26:54.241 INFO:tasks.workunit.client.0.smithi001.stdout:2/952: write d2/d14/d1a/d1b/d82/dc9/f11c [293511,66902] 0 2024-09-15T22:26:54.241 INFO:tasks.workunit.client.0.smithi001.stdout:2/953: chown d2/d14/d1a/d1b/d82/db0 338 1 2024-09-15T22:26:54.242 INFO:tasks.workunit.client.0.smithi001.stdout:2/954: unlink d2/d14/d1a/f10b 0 2024-09-15T22:26:54.242 INFO:tasks.workunit.client.0.smithi001.stdout:2/955: chown d2/d14/d1a/d1b/d82/d97/d74/l8d 1158 1 2024-09-15T22:26:54.243 INFO:tasks.workunit.client.0.smithi001.stdout:5/948: dwrite d3/d49/f95 [0,4194304] 0 2024-09-15T22:26:54.256 INFO:tasks.workunit.client.0.smithi001.stdout:9/881: write d5/de/d1a/d1b/d22/f91 [1918177,127663] 0 2024-09-15T22:26:54.256 INFO:tasks.workunit.client.0.smithi001.stdout:9/882: chown d5/de/d1a/d38/f72 234 1 2024-09-15T22:26:54.257 INFO:tasks.workunit.client.0.smithi001.stdout:9/883: stat d5/de/d15/c10e 0 2024-09-15T22:26:54.258 INFO:tasks.workunit.client.0.smithi001.stdout:9/884: mkdir d5/de/d117 0 2024-09-15T22:26:54.258 INFO:tasks.workunit.client.0.smithi001.stdout:9/885: truncate d5/de/d1a/d1b/d22/d2c/d21/d24/f69 696389 0 2024-09-15T22:26:54.266 INFO:tasks.workunit.client.0.smithi001.stdout:6/952: dwrite d0/df/d24/d2e/f6f [4194304,4194304] 0 2024-09-15T22:26:54.272 INFO:tasks.workunit.client.0.smithi001.stdout:6/953: unlink d0/df/d24/d49/f56 0 2024-09-15T22:26:54.272 INFO:tasks.workunit.client.0.smithi001.stdout:9/886: dread d5/de/d1a/d1b/d22/d2c/f6a [0,4194304] 0 2024-09-15T22:26:54.273 INFO:tasks.workunit.client.0.smithi001.stdout:9/887: chown d5/de/d15/d27/d63/f92 34263739 1 2024-09-15T22:26:54.273 INFO:tasks.workunit.client.0.smithi001.stdout:9/888: write d5/f59 [19844,29019] 0 2024-09-15T22:26:54.274 INFO:tasks.workunit.client.0.smithi001.stdout:6/954: creat d0/d6/f13b x:0 0 0 2024-09-15T22:26:54.274 INFO:tasks.workunit.client.0.smithi001.stdout:6/955: chown d0/d6/d5d/f75 902852 1 2024-09-15T22:26:54.276 INFO:tasks.workunit.client.0.smithi001.stdout:9/889: link d5/de/d1a/d1b/d2a/f78 d5/de/da9/df1/f118 0 2024-09-15T22:26:54.277 INFO:tasks.workunit.client.0.smithi001.stdout:6/956: mknod d0/df/d24/c13c 0 2024-09-15T22:26:54.279 INFO:tasks.workunit.client.0.smithi001.stdout:9/890: link d5/de/d1a/l5f d5/de/d1a/d1b/d22/d2c/d21/d24/l119 0 2024-09-15T22:26:54.280 INFO:tasks.workunit.client.0.smithi001.stdout:1/973: sync 2024-09-15T22:26:54.281 INFO:tasks.workunit.client.0.smithi001.stdout:9/891: mknod d5/de/d15/d27/dcb/c11a 0 2024-09-15T22:26:54.282 INFO:tasks.workunit.client.0.smithi001.stdout:9/892: creat d5/de/da9/df1/d104/f11b x:0 0 0 2024-09-15T22:26:54.283 INFO:tasks.workunit.client.0.smithi001.stdout:9/893: symlink d5/de/da9/l11c 0 2024-09-15T22:26:54.284 INFO:tasks.workunit.client.0.smithi001.stdout:8/860: dwrite d9/d19/d29/d33/d63/f64 [0,4194304] 0 2024-09-15T22:26:54.284 INFO:tasks.workunit.client.0.smithi001.stdout:9/894: read d5/de/d15/d27/fc0 [171346,126090] 0 2024-09-15T22:26:54.286 INFO:tasks.workunit.client.0.smithi001.stdout:8/861: mknod d9/d19/d58/d88/cf4 0 2024-09-15T22:26:54.286 INFO:tasks.workunit.client.0.smithi001.stdout:8/862: fsync d9/d19/d58/d8e/fb1 0 2024-09-15T22:26:54.295 INFO:tasks.workunit.client.0.smithi001.stdout:8/863: creat d9/d19/d29/df2/ff5 x:0 0 0 2024-09-15T22:26:54.295 INFO:tasks.workunit.client.0.smithi001.stdout:8/864: write d9/f18 [583306,97723] 0 2024-09-15T22:26:54.296 INFO:tasks.workunit.client.0.smithi001.stdout:0/807: sync 2024-09-15T22:26:54.298 INFO:tasks.workunit.client.0.smithi001.stdout:0/808: mknod d0/d9/d1a/ddb/dcf/deb/cfe 0 2024-09-15T22:26:54.298 INFO:tasks.workunit.client.0.smithi001.stdout:0/809: write d0/d9/fb2 [133774,16782] 0 2024-09-15T22:26:54.302 INFO:tasks.workunit.client.0.smithi001.stdout:5/949: dwrite d3/f33 [0,4194304] 0 2024-09-15T22:26:54.303 INFO:tasks.workunit.client.0.smithi001.stdout:2/956: dwrite d2/d12/f1c [4194304,4194304] 0 2024-09-15T22:26:54.304 INFO:tasks.workunit.client.0.smithi001.stdout:2/957: symlink d2/d14/d1a/d11b/l141 0 2024-09-15T22:26:54.305 INFO:tasks.workunit.client.0.smithi001.stdout:8/865: fsync d9/d19/d29/df2/ff5 0 2024-09-15T22:26:54.306 INFO:tasks.workunit.client.0.smithi001.stdout:2/958: unlink d2/d14/d1a/d1b/d98/cd7 0 2024-09-15T22:26:54.306 INFO:tasks.workunit.client.0.smithi001.stdout:2/959: readlink d2/d12/laa 0 2024-09-15T22:26:54.306 INFO:tasks.workunit.client.0.smithi001.stdout:2/960: chown d2/f3 152 1 2024-09-15T22:26:54.307 INFO:tasks.workunit.client.0.smithi001.stdout:8/866: unlink d9/d19/d29/d33/cd1 0 2024-09-15T22:26:54.307 INFO:tasks.workunit.client.0.smithi001.stdout:2/961: creat d2/d14/d1a/d106/f142 x:0 0 0 2024-09-15T22:26:54.309 INFO:tasks.workunit.client.0.smithi001.stdout:8/867: creat d9/d19/d34/da4/ff6 x:0 0 0 2024-09-15T22:26:54.309 INFO:tasks.workunit.client.0.smithi001.stdout:8/868: dread - d9/d19/d40/d5f/d61/ff0 zero size 2024-09-15T22:26:54.309 INFO:tasks.workunit.client.0.smithi001.stdout:8/869: chown d9/d19/d58/l71 2640463 1 2024-09-15T22:26:54.309 INFO:tasks.workunit.client.0.smithi001.stdout:8/870: mknod d9/d19/d29/d50/cf7 0 2024-09-15T22:26:54.310 INFO:tasks.workunit.client.0.smithi001.stdout:5/950: dread d3/d1d/fa7 [0,4194304] 0 2024-09-15T22:26:54.310 INFO:tasks.workunit.client.0.smithi001.stdout:8/871: rmdir d9/d19/d40/d9e/dd0 39 2024-09-15T22:26:54.311 INFO:tasks.workunit.client.0.smithi001.stdout:8/872: creat d9/d19/d29/d50/d70/d76/d7d/ff8 x:0 0 0 2024-09-15T22:26:54.313 INFO:tasks.workunit.client.0.smithi001.stdout:1/974: dwrite d3/d12/d79/dce/d69/fe1 [4194304,4194304] 0 2024-09-15T22:26:54.313 INFO:tasks.workunit.client.0.smithi001.stdout:1/975: fsync d3/d12/d79/dce/d86/f108 0 2024-09-15T22:26:54.313 INFO:tasks.workunit.client.0.smithi001.stdout:5/951: rename d3/d1d/l1f to d3/d27/d109/l134 0 2024-09-15T22:26:54.314 INFO:tasks.workunit.client.0.smithi001.stdout:8/873: unlink d9/d19/d58/d8e/fc3 0 2024-09-15T22:26:54.314 INFO:tasks.workunit.client.0.smithi001.stdout:8/874: write d9/d19/d34/fef [150974,90255] 0 2024-09-15T22:26:54.314 INFO:tasks.workunit.client.0.smithi001.stdout:1/976: truncate d3/fc0 6364028 0 2024-09-15T22:26:54.315 INFO:tasks.workunit.client.0.smithi001.stdout:5/952: symlink d3/d6/d41/d88/da5/l135 0 2024-09-15T22:26:54.315 INFO:tasks.workunit.client.0.smithi001.stdout:5/953: chown d3/d6/d57/d87/d8c/da2 396 1 2024-09-15T22:26:54.317 INFO:tasks.workunit.client.0.smithi001.stdout:8/875: link d9/d19/d29/d50/d70/d76/l81 d9/d19/d29/d50/d89/lf9 0 2024-09-15T22:26:54.366 INFO:tasks.workunit.client.0.smithi001.stdout:9/895: dwrite d5/de/da9/df1/f118 [0,4194304] 0 2024-09-15T22:26:54.367 INFO:tasks.workunit.client.0.smithi001.stdout:9/896: mkdir d5/de/d113/dff/d11d 0 2024-09-15T22:26:54.367 INFO:tasks.workunit.client.0.smithi001.stdout:9/897: write d5/de/d1a/d38/ff8 [446413,58747] 0 2024-09-15T22:26:54.369 INFO:tasks.workunit.client.0.smithi001.stdout:9/898: creat d5/de/d51/d53/d9f/f11e x:0 0 0 2024-09-15T22:26:54.383 INFO:tasks.workunit.client.0.smithi001.stdout:2/962: dwrite d2/d12/d62/d64/f60 [4194304,4194304] 0 2024-09-15T22:26:54.383 INFO:tasks.workunit.client.0.smithi001.stdout:2/963: stat d2/d14/d1a/d1b/de8/f139 0 2024-09-15T22:26:54.383 INFO:tasks.workunit.client.0.smithi001.stdout:2/964: read d2/d14/d1a/d1b/d82/d97/f23 [1182463,104442] 0 2024-09-15T22:26:54.383 INFO:tasks.workunit.client.0.smithi001.stdout:2/965: readlink d2/d12/d10c/lac 0 2024-09-15T22:26:54.384 INFO:tasks.workunit.client.0.smithi001.stdout:5/954: dwrite d3/d27/f90 [4194304,4194304] 0 2024-09-15T22:26:54.385 INFO:tasks.workunit.client.0.smithi001.stdout:5/955: mknod d3/d6/d41/d88/da5/c136 0 2024-09-15T22:26:54.385 INFO:tasks.workunit.client.0.smithi001.stdout:2/966: mkdir d2/d143 0 2024-09-15T22:26:54.385 INFO:tasks.workunit.client.0.smithi001.stdout:2/967: stat d2/d14/fed 0 2024-09-15T22:26:54.385 INFO:tasks.workunit.client.0.smithi001.stdout:5/956: mkdir d3/d49/d137 0 2024-09-15T22:26:54.386 INFO:tasks.workunit.client.0.smithi001.stdout:2/968: rename d2/d12/d62/d64/d76 to d2/d14/d1a/d1b/d144 0 2024-09-15T22:26:54.387 INFO:tasks.workunit.client.0.smithi001.stdout:5/957: link d3/d6/dd8/ffd d3/d27/d7a/f138 0 2024-09-15T22:26:54.416 INFO:tasks.workunit.client.0.smithi001.stdout:0/810: dwrite d0/d9/d1a/f58 [0,4194304] 0 2024-09-15T22:26:54.418 INFO:tasks.workunit.client.0.smithi001.stdout:0/811: creat d0/d9/db/dc5/fff x:0 0 0 2024-09-15T22:26:54.418 INFO:tasks.workunit.client.0.smithi001.stdout:0/812: fsync d0/d51/f7d 0 2024-09-15T22:26:54.422 INFO:tasks.workunit.client.0.smithi001.stdout:0/813: rename d0/d9/f39 to d0/dd/f100 0 2024-09-15T22:26:54.425 INFO:tasks.workunit.client.0.smithi001.stdout:5/958: write d3/d6/d41/d4d/dbe/d56/f55 [956707,67693] 0 2024-09-15T22:26:54.426 INFO:tasks.workunit.client.0.smithi001.stdout:7/910: sync 2024-09-15T22:26:54.427 INFO:tasks.workunit.client.0.smithi001.stdout:5/959: mkdir d3/d6/d41/d4d/d91/d139 0 2024-09-15T22:26:54.427 INFO:tasks.workunit.client.0.smithi001.stdout:5/960: chown d3/d6/dd8 25 1 2024-09-15T22:26:54.428 INFO:tasks.workunit.client.0.smithi001.stdout:5/961: link d3/c114 d3/d6/d41/d4d/dbe/d56/ddc/de9/df6/c13a 0 2024-09-15T22:26:54.431 INFO:tasks.workunit.client.0.smithi001.stdout:5/962: link d3/d6/d57/d87/d8c/da2/fb6 d3/d27/d4e/d89/f13b 0 2024-09-15T22:26:54.437 INFO:tasks.workunit.client.0.smithi001.stdout:9/899: dwrite d5/de/d1a/d1b/d22/d2c/d21/d23/d3d/fc4 [0,4194304] 0 2024-09-15T22:26:54.437 INFO:tasks.workunit.client.0.smithi001.stdout:8/876: dwrite d9/d19/d40/d5f/d61/ff0 [0,4194304] 0 2024-09-15T22:26:54.437 INFO:tasks.workunit.client.0.smithi001.stdout:8/877: dread - d9/d19/d29/d50/d70/d76/d7d/ff8 zero size 2024-09-15T22:26:54.437 INFO:tasks.workunit.client.0.smithi001.stdout:8/878: dread - d9/d19/d40/d9e/dd0/fe0 zero size 2024-09-15T22:26:54.438 INFO:tasks.workunit.client.0.smithi001.stdout:2/969: dwrite d2/d14/f66 [4194304,4194304] 0 2024-09-15T22:26:54.438 INFO:tasks.workunit.client.0.smithi001.stdout:2/970: dread - d2/d14/d1a/d1b/d82/dc9/d6f/fb2 zero size 2024-09-15T22:26:54.438 INFO:tasks.workunit.client.0.smithi001.stdout:2/971: chown d2/d12/d62 1471198587 1 2024-09-15T22:26:54.439 INFO:tasks.workunit.client.0.smithi001.stdout:9/900: unlink d5/d3e/fb0 0 2024-09-15T22:26:54.439 INFO:tasks.workunit.client.0.smithi001.stdout:9/901: chown d5/de/d113/lea 429 1 2024-09-15T22:26:54.440 INFO:tasks.workunit.client.0.smithi001.stdout:2/972: link d2/c5b d2/d14/d1a/d1b/d82/d97/d74/c145 0 2024-09-15T22:26:54.440 INFO:tasks.workunit.client.0.smithi001.stdout:8/879: truncate d9/d19/d29/d33/d63/f64 963383 0 2024-09-15T22:26:54.440 INFO:tasks.workunit.client.0.smithi001.stdout:2/973: write d2/d12/d62/d64/fad [1512783,113010] 0 2024-09-15T22:26:54.441 INFO:tasks.workunit.client.0.smithi001.stdout:2/974: creat d2/f146 x:0 0 0 2024-09-15T22:26:54.442 INFO:tasks.workunit.client.0.smithi001.stdout:9/902: creat d5/de/d1a/d1b/d22/d2c/d21/d24/f11f x:0 0 0 2024-09-15T22:26:54.443 INFO:tasks.workunit.client.0.smithi001.stdout:2/975: unlink d2/d14/d1a/d1b/d144/db4/lf3 0 2024-09-15T22:26:54.443 INFO:tasks.workunit.client.0.smithi001.stdout:2/976: fsync d2/d12/d62/d4c/fd0 0 2024-09-15T22:26:54.444 INFO:tasks.workunit.client.0.smithi001.stdout:8/880: creat d9/ffa x:0 0 0 2024-09-15T22:26:54.445 INFO:tasks.workunit.client.0.smithi001.stdout:2/977: rmdir d2/d14/d1a/d1b/d98 39 2024-09-15T22:26:54.459 INFO:tasks.workunit.client.0.smithi001.stdout:2/978: dread d2/f3 [0,4194304] 0 2024-09-15T22:26:54.459 INFO:tasks.workunit.client.0.smithi001.stdout:9/903: write d5/de/da9/df1/f118 [2197284,16537] 0 2024-09-15T22:26:54.464 INFO:tasks.workunit.client.0.smithi001.stdout:2/979: mknod d2/d14/d1a/d1b/d82/d97/d74/c147 0 2024-09-15T22:26:54.464 INFO:tasks.workunit.client.0.smithi001.stdout:1/977: sync 2024-09-15T22:26:54.464 INFO:tasks.workunit.client.0.smithi001.stdout:6/957: sync 2024-09-15T22:26:54.465 INFO:tasks.workunit.client.0.smithi001.stdout:8/881: dread d9/d19/d58/d8e/d9c/fae [0,4194304] 0 2024-09-15T22:26:54.465 INFO:tasks.workunit.client.0.smithi001.stdout:2/980: symlink d2/d14/d1a/d1b/d82/l148 0 2024-09-15T22:26:54.465 INFO:tasks.workunit.client.0.smithi001.stdout:6/958: creat d0/df/d24/d7b/db2/f13d x:0 0 0 2024-09-15T22:26:54.465 INFO:tasks.workunit.client.0.smithi001.stdout:1/978: mkdir d3/d8d/d91/df5/de6/d135 0 2024-09-15T22:26:54.466 INFO:tasks.workunit.client.0.smithi001.stdout:8/882: symlink d9/d19/d29/d50/d70/d76/lfb 0 2024-09-15T22:26:54.467 INFO:tasks.workunit.client.0.smithi001.stdout:6/959: symlink d0/df/d24/l13e 0 2024-09-15T22:26:54.467 INFO:tasks.workunit.client.0.smithi001.stdout:1/979: symlink d3/d12/d79/dce/d53/dc7/l136 0 2024-09-15T22:26:54.467 INFO:tasks.workunit.client.0.smithi001.stdout:1/980: truncate d3/fac 5132836 0 2024-09-15T22:26:54.468 INFO:tasks.workunit.client.0.smithi001.stdout:8/883: link d9/d19/d58/f68 d9/d19/d58/d8e/d9c/ffc 0 2024-09-15T22:26:54.468 INFO:tasks.workunit.client.0.smithi001.stdout:8/884: chown d9/c1c 211801 1 2024-09-15T22:26:54.468 INFO:tasks.workunit.client.0.smithi001.stdout:8/885: dread - d9/d19/d40/fa3 zero size 2024-09-15T22:26:54.468 INFO:tasks.workunit.client.0.smithi001.stdout:1/981: truncate d3/d12/d79/dce/f58 2132063 0 2024-09-15T22:26:54.469 INFO:tasks.workunit.client.0.smithi001.stdout:6/960: mknod d0/d6/d5d/d67/df0/c13f 0 2024-09-15T22:26:54.469 INFO:tasks.workunit.client.0.smithi001.stdout:5/963: dread d3/d6/d41/d4d/dbe/d56/d52/d61/f71 [0,4194304] 0 2024-09-15T22:26:54.471 INFO:tasks.workunit.client.0.smithi001.stdout:5/964: write d3/d6/d41/d4d/dc0/fd5 [4733667,64202] 0 2024-09-15T22:26:54.471 INFO:tasks.workunit.client.0.smithi001.stdout:8/886: truncate d9/f18 878714 0 2024-09-15T22:26:54.471 INFO:tasks.workunit.client.0.smithi001.stdout:6/961: link d0/df/d24/c96 d0/d6/d5d/dd8/c140 0 2024-09-15T22:26:54.471 INFO:tasks.workunit.client.0.smithi001.stdout:6/962: truncate d0/d6/d5d/f9e 2037514 0 2024-09-15T22:26:54.472 INFO:tasks.workunit.client.0.smithi001.stdout:6/963: creat d0/df/f141 x:0 0 0 2024-09-15T22:26:54.475 INFO:tasks.workunit.client.0.smithi001.stdout:1/982: dread d3/d12/d79/dce/d14/d1b/f3b [0,4194304] 0 2024-09-15T22:26:54.475 INFO:tasks.workunit.client.0.smithi001.stdout:1/983: dread - d3/d12/d79/dce/d14/d1b/d98/d124/f134 zero size 2024-09-15T22:26:54.475 INFO:tasks.workunit.client.0.smithi001.stdout:1/984: readlink d3/d12/d79/dce/d69/l11d 0 2024-09-15T22:26:54.477 INFO:tasks.workunit.client.0.smithi001.stdout:1/985: symlink d3/d12/d79/dce/d3c/d4c/dcc/l137 0 2024-09-15T22:26:54.479 INFO:tasks.workunit.client.0.smithi001.stdout:1/986: rename d3/f3f to d3/d12/d79/dce/d14/daa/f138 0 2024-09-15T22:26:54.480 INFO:tasks.workunit.client.0.smithi001.stdout:1/987: symlink d3/l139 0 2024-09-15T22:26:54.481 INFO:tasks.workunit.client.0.smithi001.stdout:2/981: dread d2/d14/d1a/d1b/f22 [0,4194304] 0 2024-09-15T22:26:54.482 INFO:tasks.workunit.client.0.smithi001.stdout:2/982: creat d2/d14/d1a/d1b/d144/f149 x:0 0 0 2024-09-15T22:26:54.483 INFO:tasks.workunit.client.0.smithi001.stdout:2/983: truncate d2/d12/f61 1506775 0 2024-09-15T22:26:54.485 INFO:tasks.workunit.client.0.smithi001.stdout:5/965: write d3/f33 [2468587,30517] 0 2024-09-15T22:26:54.486 INFO:tasks.workunit.client.0.smithi001.stdout:5/966: getdents d3/d6/d41/d4d/dbe/d56 0 2024-09-15T22:26:54.503 INFO:tasks.workunit.client.0.smithi001.stdout:2/984: dread d2/d14/d1a/fc0 [0,4194304] 0 2024-09-15T22:26:54.503 INFO:tasks.workunit.client.0.smithi001.stdout:2/985: stat d2/d14/de1/le2 0 2024-09-15T22:26:54.505 INFO:tasks.workunit.client.0.smithi001.stdout:2/986: rename d2/d14/d1a/d1b/d144/db4/c120 to d2/d14/d1a/d80/c14a 0 2024-09-15T22:26:54.505 INFO:tasks.workunit.client.0.smithi001.stdout:2/987: write d2/d14/d1a/d1b/d82/dc9/d6f/d70/fd8 [5013988,123715] 0 2024-09-15T22:26:54.506 INFO:tasks.workunit.client.0.smithi001.stdout:2/988: read - d2/d14/d1a/d1b/d82/dc9/ffe zero size 2024-09-15T22:26:54.506 INFO:tasks.workunit.client.0.smithi001.stdout:2/989: truncate d2/d12/d62/d4c/f101 955204 0 2024-09-15T22:26:54.507 INFO:tasks.workunit.client.0.smithi001.stdout:2/990: getdents d2/d12/d62/d4c/d9d 0 2024-09-15T22:26:54.507 INFO:tasks.workunit.client.0.smithi001.stdout:2/991: read d2/f10 [2620180,71691] 0 2024-09-15T22:26:54.517 INFO:tasks.workunit.client.0.smithi001.stdout:1/988: dwrite d3/d8d/dd4/fd7 [4194304,4194304] 0 2024-09-15T22:26:54.517 INFO:tasks.workunit.client.0.smithi001.stdout:1/989: fdatasync d3/d12/d79/dce/d14/daa/ff6 0 2024-09-15T22:26:54.518 INFO:tasks.workunit.client.0.smithi001.stdout:7/911: dwrite d0/d7/d21/d6b/d93/f104 [0,4194304] 0 2024-09-15T22:26:54.519 INFO:tasks.workunit.client.0.smithi001.stdout:7/912: stat d0/d7/fa4 0 2024-09-15T22:26:54.519 INFO:tasks.workunit.client.0.smithi001.stdout:1/990: creat d3/d12/df3/f13a x:0 0 0 2024-09-15T22:26:54.521 INFO:tasks.workunit.client.0.smithi001.stdout:1/991: unlink d3/d12/d79/dce/d14/d23/da1/da2/cbc 0 2024-09-15T22:26:54.523 INFO:tasks.workunit.client.0.smithi001.stdout:1/992: symlink d3/d12/d79/dce/d53/l13b 0 2024-09-15T22:26:54.524 INFO:tasks.workunit.client.0.smithi001.stdout:1/993: mknod d3/d8d/d91/df5/de6/d135/c13c 0 2024-09-15T22:26:54.525 INFO:tasks.workunit.client.0.smithi001.stdout:1/994: rename d3/d12/d79/dce/f34 to d3/d8d/d91/df5/de6/d135/f13d 0 2024-09-15T22:26:54.526 INFO:tasks.workunit.client.0.smithi001.stdout:1/995: mknod d3/d12/d79/dce/d3c/d4c/dcc/c13e 0 2024-09-15T22:26:54.527 INFO:tasks.workunit.client.0.smithi001.stdout:1/996: mknod d3/c13f 0 2024-09-15T22:26:54.536 INFO:tasks.workunit.client.0.smithi001.stdout:6/964: dwrite d0/d6/f100 [0,4194304] 0 2024-09-15T22:26:54.537 INFO:tasks.workunit.client.0.smithi001.stdout:1/997: getdents d3/d12/d79/dce/d53 0 2024-09-15T22:26:54.537 INFO:tasks.workunit.client.0.smithi001.stdout:6/965: creat d0/d6/d5d/d67/d53/da0/d120/f142 x:0 0 0 2024-09-15T22:26:54.538 INFO:tasks.workunit.client.0.smithi001.stdout:1/998: rmdir d3/d12/d79/dce/d14/d23/d112 39 2024-09-15T22:26:54.538 INFO:tasks.workunit.client.0.smithi001.stdout:1/999: read d3/d12/d21/f57 [2279405,71754] 0 2024-09-15T22:26:54.538 INFO:tasks.workunit.client.0.smithi001.stdout:6/966: mkdir d0/d6/d5d/d67/dc4/d143 0 2024-09-15T22:26:54.539 INFO:tasks.workunit.client.0.smithi001.stdout:6/967: chown d0/d6/c94 1741145 1 2024-09-15T22:26:54.540 INFO:tasks.workunit.client.0.smithi001.stdout:6/968: creat d0/df/d97/f144 x:0 0 0 2024-09-15T22:26:54.541 INFO:tasks.workunit.client.0.smithi001.stdout:6/969: creat d0/d6/d5d/d67/f145 x:0 0 0 2024-09-15T22:26:54.542 INFO:tasks.workunit.client.0.smithi001.stdout:5/967: dwrite d3/d6/f7 [4194304,4194304] 0 2024-09-15T22:26:54.543 INFO:tasks.workunit.client.0.smithi001.stdout:6/970: rename d0/d6/f71 to d0/df/d24/db1/f146 0 2024-09-15T22:26:54.543 INFO:tasks.workunit.client.0.smithi001.stdout:6/971: write d0/df/d24/d2e/f6f [2161300,102488] 0 2024-09-15T22:26:54.546 INFO:tasks.workunit.client.0.smithi001.stdout:6/972: rmdir d0/df/d10f 0 2024-09-15T22:26:54.550 INFO:tasks.workunit.client.0.smithi001.stdout:6/973: symlink d0/d7e/d137/dc2/l147 0 2024-09-15T22:26:54.552 INFO:tasks.workunit.client.0.smithi001.stdout:2/992: dwrite d2/fea [0,4194304] 0 2024-09-15T22:26:54.552 INFO:tasks.workunit.client.0.smithi001.stdout:6/974: mkdir d0/d6/d5d/d101/d148 0 2024-09-15T22:26:54.552 INFO:tasks.workunit.client.0.smithi001.stdout:2/993: chown d2/d12/f61 18131 1 2024-09-15T22:26:54.554 INFO:tasks.workunit.client.0.smithi001.stdout:6/975: truncate d0/df/fff 351224 0 2024-09-15T22:26:54.561 INFO:tasks.workunit.client.0.smithi001.stdout:7/913: dwrite d0/db3/fd8 [0,4194304] 0 2024-09-15T22:26:54.564 INFO:tasks.workunit.client.0.smithi001.stdout:7/914: rename d0/d7/d7c/d122 to d0/d7/dc6/d105/d138/d139 0 2024-09-15T22:26:54.564 INFO:tasks.workunit.client.0.smithi001.stdout:7/915: fsync d0/d7/d21/d6b/fed 0 2024-09-15T22:26:54.568 INFO:tasks.workunit.client.0.smithi001.stdout:0/814: sync 2024-09-15T22:26:54.568 INFO:tasks.workunit.client.0.smithi001.stdout:0/815: chown d0/d6/d77/d78 1735395 1 2024-09-15T22:26:54.598 INFO:tasks.workunit.client.0.smithi001.stdout:6/976: dwrite d0/d6/d5d/d101/f124 [0,4194304] 0 2024-09-15T22:26:54.598 INFO:tasks.workunit.client.0.smithi001.stdout:5/968: dwrite d3/d27/f42 [0,4194304] 0 2024-09-15T22:26:54.598 INFO:tasks.workunit.client.0.smithi001.stdout:6/977: write d0/d6/fb7 [1048717,28947] 0 2024-09-15T22:26:54.598 INFO:tasks.workunit.client.0.smithi001.stdout:6/978: truncate d0/df/d97/f144 1002891 0 2024-09-15T22:26:54.599 INFO:tasks.workunit.client.0.smithi001.stdout:6/979: chown d0/df/fdb 21 1 2024-09-15T22:26:54.599 INFO:tasks.workunit.client.0.smithi001.stdout:6/980: dread - d0/df/d24/fad zero size 2024-09-15T22:26:54.599 INFO:tasks.workunit.client.0.smithi001.stdout:6/981: chown d0/df/d24/d2e/d43/cc8 1624 1 2024-09-15T22:26:54.602 INFO:tasks.workunit.client.0.smithi001.stdout:5/969: dread d3/d6/d41/d4d/dbe/d56/f76 [0,4194304] 0 2024-09-15T22:26:54.604 INFO:tasks.workunit.client.0.smithi001.stdout:5/970: rename d3/d6/d41/d4d/dbe/d56/d52/d61/c6e to d3/d27/d5c/c13c 0 2024-09-15T22:26:54.605 INFO:tasks.workunit.client.0.smithi001.stdout:5/971: unlink d3/d27/d109/l134 0 2024-09-15T22:26:54.605 INFO:tasks.workunit.client.0.smithi001.stdout:5/972: fdatasync d3/d6/d25/ff8 0 2024-09-15T22:26:54.607 INFO:tasks.workunit.client.0.smithi001.stdout:5/973: link d3/d6/d25/c35 d3/d1d/c13d 0 2024-09-15T22:26:54.607 INFO:tasks.workunit.client.0.smithi001.stdout:5/974: write d3/d6/d41/d4d/dbe/d56/f55 [4097206,102780] 0 2024-09-15T22:26:54.627 INFO:tasks.workunit.client.0.smithi001.stdout:7/916: dwrite d0/d7/dd5/d128/f130 [0,4194304] 0 2024-09-15T22:26:54.629 INFO:tasks.workunit.client.0.smithi001.stdout:7/917: rmdir d0/d8e/d3e/d127/d60/d10d 39 2024-09-15T22:26:54.644 INFO:tasks.workunit.client.0.smithi001.stdout:7/918: dread d0/d8e/d3e/d127/d60/dbd/fdd [0,4194304] 0 2024-09-15T22:26:54.657 INFO:tasks.workunit.client.0.smithi001.stdout:7/919: dread d0/d8e/d3e/d127/d60/d10d/fee [0,4194304] 0 2024-09-15T22:26:54.657 INFO:tasks.workunit.client.0.smithi001.stdout:7/920: chown d0/d7/dc6 2 1 2024-09-15T22:26:54.657 INFO:tasks.workunit.client.0.smithi001.stdout:7/921: readlink d0/d8e/d3e/d127/d60/l103 0 2024-09-15T22:26:54.658 INFO:tasks.workunit.client.0.smithi001.stdout:7/922: creat d0/dd3/d119/d12b/f13a x:0 0 0 2024-09-15T22:26:54.661 INFO:tasks.workunit.client.0.smithi001.stdout:5/975: dwrite d3/d27/d109/ff9 [0,4194304] 0 2024-09-15T22:26:54.661 INFO:tasks.workunit.client.0.smithi001.stdout:7/923: write d0/d7/d44/d36/f84 [419711,39030] 0 2024-09-15T22:26:54.662 INFO:tasks.workunit.client.0.smithi001.stdout:7/924: fdatasync d0/d7/d44/f78 0 2024-09-15T22:26:54.663 INFO:tasks.workunit.client.0.smithi001.stdout:5/976: rmdir d3/d27/d4e 39 2024-09-15T22:26:54.663 INFO:tasks.workunit.client.0.smithi001.stdout:7/925: mknod d0/d7/d21/d6b/d93/c13b 0 2024-09-15T22:26:54.663 INFO:tasks.workunit.client.0.smithi001.stdout:7/926: fdatasync d0/d7/d7c/f114 0 2024-09-15T22:26:54.675 INFO:tasks.workunit.client.0.smithi001.stdout:5/977: dread d3/d6/d41/d4d/dbe/d56/f55 [0,4194304] 0 2024-09-15T22:26:54.675 INFO:tasks.workunit.client.0.smithi001.stdout:5/978: read - d3/d49/f113 zero size 2024-09-15T22:26:54.676 INFO:tasks.workunit.client.0.smithi001.stdout:5/979: mkdir d3/d6/d41/d88/da3/d13e 0 2024-09-15T22:26:54.677 INFO:tasks.workunit.client.0.smithi001.stdout:5/980: symlink d3/d6/d41/d4d/l13f 0 2024-09-15T22:26:54.681 INFO:tasks.workunit.client.0.smithi001.stdout:7/927: dread d0/d7/d44/f87 [0,4194304] 0 2024-09-15T22:26:54.682 INFO:tasks.workunit.client.0.smithi001.stdout:7/928: mknod d0/d7/d44/d36/c13c 0 2024-09-15T22:26:54.688 INFO:tasks.workunit.client.0.smithi001.stdout:2/994: sync 2024-09-15T22:26:54.688 INFO:tasks.workunit.client.0.smithi001.stdout:9/904: sync 2024-09-15T22:26:54.688 INFO:tasks.workunit.client.0.smithi001.stdout:8/887: sync 2024-09-15T22:26:54.688 INFO:tasks.workunit.client.0.smithi001.stdout:0/816: sync 2024-09-15T22:26:54.689 INFO:tasks.workunit.client.0.smithi001.stdout:6/982: sync 2024-09-15T22:26:54.689 INFO:tasks.workunit.client.0.smithi001.stdout:8/888: write f4 [631862,77066] 0 2024-09-15T22:26:54.689 INFO:tasks.workunit.client.0.smithi001.stdout:8/889: write d9/d19/d29/d50/d89/f92 [959777,21371] 0 2024-09-15T22:26:54.689 INFO:tasks.workunit.client.0.smithi001.stdout:0/817: symlink d0/d9/db/dc5/l101 0 2024-09-15T22:26:54.690 INFO:tasks.workunit.client.0.smithi001.stdout:6/983: mknod d0/df/d24/d2e/c149 0 2024-09-15T22:26:54.694 INFO:tasks.workunit.client.0.smithi001.stdout:2/995: rename d2/d14/d1a/d1b/d82/db0/df6/df8 to d2/d14/d1a/d80/d14b 0 2024-09-15T22:26:54.696 INFO:tasks.workunit.client.0.smithi001.stdout:0/818: rename d0/d6/d77/l98 to d0/dd/d33/dd2/l102 0 2024-09-15T22:26:54.698 INFO:tasks.workunit.client.0.smithi001.stdout:0/819: mknod d0/d51/c103 0 2024-09-15T22:26:54.698 INFO:tasks.workunit.client.0.smithi001.stdout:2/996: rename d2/d14/d1a/d1b/d82/d97/c8f to d2/d12/d10c/c14c 0 2024-09-15T22:26:54.698 INFO:tasks.workunit.client.0.smithi001.stdout:2/997: getdents d2/d14/d13b 0 2024-09-15T22:26:54.698 INFO:tasks.workunit.client.0.smithi001.stdout:2/998: stat d2/d12/c6d 0 2024-09-15T22:26:54.710 INFO:tasks.workunit.client.0.smithi001.stdout:7/929: dread d0/d7/d44/d36/f99 [0,4194304] 0 2024-09-15T22:26:54.739 INFO:tasks.workunit.client.0.smithi001.stdout:7/930: write d0/d7/d44/d3f/fa6 [1540201,40823] 0 2024-09-15T22:26:54.741 INFO:tasks.workunit.client.0.smithi001.stdout:6/984: write d0/d6/d5d/d67/d53/da0/d120/f136 [1653846,56334] 0 2024-09-15T22:26:54.741 INFO:tasks.workunit.client.0.smithi001.stdout:6/985: chown d0/d6/d5d/dd8/f112 0 1 2024-09-15T22:26:54.745 INFO:tasks.workunit.client.0.smithi001.stdout:8/890: dread d9/d19/d40/d5f/d61/ff0 [0,4194304] 0 2024-09-15T22:26:54.745 INFO:tasks.workunit.client.0.smithi001.stdout:8/891: write d9/d19/fbe [810014,16812] 0 2024-09-15T22:26:54.745 INFO:tasks.workunit.client.0.smithi001.stdout:8/892: readlink d9/l5d 0 2024-09-15T22:26:54.745 INFO:tasks.workunit.client.0.smithi001.stdout:9/905: dwrite d5/de/d1a/d1b/d22/d2c/d21/d23/d3d/fb5 [0,4194304] 0 2024-09-15T22:26:54.745 INFO:tasks.workunit.client.0.smithi001.stdout:7/931: truncate d0/f7a 2045215 0 2024-09-15T22:26:54.747 INFO:tasks.workunit.client.0.smithi001.stdout:6/986: creat d0/d7e/f14a x:0 0 0 2024-09-15T22:26:54.748 INFO:tasks.workunit.client.0.smithi001.stdout:0/820: dwrite d0/d9/d1a/d36/f41 [4194304,4194304] 0 2024-09-15T22:26:54.750 INFO:tasks.workunit.client.0.smithi001.stdout:9/906: mkdir d5/de/d51/d53/dbe/ddd/d120 0 2024-09-15T22:26:54.750 INFO:tasks.workunit.client.0.smithi001.stdout:7/932: mkdir d0/db3/dd6/d126/d13d 0 2024-09-15T22:26:54.753 INFO:tasks.workunit.client.0.smithi001.stdout:9/907: read d5/de/d1a/d1b/d22/d2c/f75 [1514038,119945] 0 2024-09-15T22:26:54.753 INFO:tasks.workunit.client.0.smithi001.stdout:8/893: symlink d9/d19/d58/lfd 0 2024-09-15T22:26:54.756 INFO:tasks.workunit.client.0.smithi001.stdout:9/908: creat d5/de/d1a/d1b/d22/d2c/dab/f121 x:0 0 0 2024-09-15T22:26:54.757 INFO:tasks.workunit.client.0.smithi001.stdout:7/933: creat d0/d7/d44/d3f/d49/d4f/f13e x:0 0 0 2024-09-15T22:26:54.757 INFO:tasks.workunit.client.0.smithi001.stdout:7/934: chown d0/d7/d21/ce8 50 1 2024-09-15T22:26:54.759 INFO:tasks.workunit.client.0.smithi001.stdout:9/909: symlink d5/de/d1a/d1b/d22/d2c/d21/d4d/l122 0 2024-09-15T22:26:54.761 INFO:tasks.workunit.client.0.smithi001.stdout:5/981: dwrite d3/d6/d41/d4d/dbe/f9e [4194304,4194304] 0 2024-09-15T22:26:54.761 INFO:tasks.workunit.client.0.smithi001.stdout:7/935: unlink d0/d98/fca 0 2024-09-15T22:26:54.762 INFO:tasks.workunit.client.0.smithi001.stdout:0/821: dread d0/d9/d1a/f64 [0,4194304] 0 2024-09-15T22:26:54.763 INFO:tasks.workunit.client.0.smithi001.stdout:0/822: dread - d0/d9/d1a/d70/ffd zero size 2024-09-15T22:26:54.763 INFO:tasks.workunit.client.0.smithi001.stdout:0/823: readlink d0/d84/l88 0 2024-09-15T22:26:54.764 INFO:tasks.workunit.client.0.smithi001.stdout:7/936: symlink d0/d7/d21/d6b/l13f 0 2024-09-15T22:26:54.768 INFO:tasks.workunit.client.0.smithi001.stdout:7/937: creat d0/d8e/d3e/d127/d60/dbd/f140 x:0 0 0 2024-09-15T22:26:54.770 INFO:tasks.workunit.client.0.smithi001.stdout:7/938: link d0/d7/d44/f28 d0/d8e/d3e/d127/d109/f141 0 2024-09-15T22:26:54.772 INFO:tasks.workunit.client.0.smithi001.stdout:7/939: creat d0/dd3/df9/f142 x:0 0 0 2024-09-15T22:26:54.794 INFO:tasks.workunit.client.0.smithi001.stdout:6/987: fdatasync d0/d6/d5d/d67/d53/da0/d120/f136 0 2024-09-15T22:26:54.794 INFO:tasks.workunit.client.0.smithi001.stdout:2/999: dwrite d2/d12/dec/f130 [0,4194304] 0 2024-09-15T22:26:54.794 INFO:tasks.workunit.client.0.smithi001.stdout:6/988: chown d0/d6/d5d/d67/dc4/d143 0 1 2024-09-15T22:26:54.795 INFO:tasks.workunit.client.0.smithi001.stdout:6/989: write d0/df/d97/f107 [1125535,7365] 0 2024-09-15T22:26:54.818 INFO:tasks.workunit.client.0.smithi001.stdout:8/894: dwrite d9/d19/d29/f45 [0,4194304] 0 2024-09-15T22:26:54.818 INFO:tasks.workunit.client.0.smithi001.stdout:5/982: dread d3/d27/f2d [0,4194304] 0 2024-09-15T22:26:54.820 INFO:tasks.workunit.client.0.smithi001.stdout:8/895: mknod d9/cfe 0 2024-09-15T22:26:54.825 INFO:tasks.workunit.client.0.smithi001.stdout:5/983: symlink d3/d6/dd8/l140 0 2024-09-15T22:26:54.827 INFO:tasks.workunit.client.0.smithi001.stdout:6/990: dread d0/d6/d5d/f9d [0,4194304] 0 2024-09-15T22:26:54.829 INFO:tasks.workunit.client.0.smithi001.stdout:6/991: creat d0/d6/d5d/d67/df0/f14b x:0 0 0 2024-09-15T22:26:54.829 INFO:tasks.workunit.client.0.smithi001.stdout:6/992: chown d0/d6/d5d/dd8/fee 375 1 2024-09-15T22:26:54.830 INFO:tasks.workunit.client.0.smithi001.stdout:6/993: readlink d0/l4c 0 2024-09-15T22:26:54.831 INFO:tasks.workunit.client.0.smithi001.stdout:6/994: symlink d0/d6/d5d/d67/dc4/d143/l14c 0 2024-09-15T22:26:54.837 INFO:tasks.workunit.client.0.smithi001.stdout:0/824: dwrite d0/d9/d1a/fc1 [0,4194304] 0 2024-09-15T22:26:54.837 INFO:tasks.workunit.client.0.smithi001.stdout:7/940: dwrite d0/d7/d21/d6b/d93/d132/f133 [0,4194304] 0 2024-09-15T22:26:54.840 INFO:tasks.workunit.client.0.smithi001.stdout:9/910: dwrite d5/d90/ff0 [0,4194304] 0 2024-09-15T22:26:54.840 INFO:tasks.workunit.client.0.smithi001.stdout:0/825: unlink d0/d9/d1a/d70/lbc 0 2024-09-15T22:26:54.840 INFO:tasks.workunit.client.0.smithi001.stdout:0/826: chown d0/d9/d1a/d70 1036 1 2024-09-15T22:26:54.840 INFO:tasks.workunit.client.0.smithi001.stdout:6/995: dread d0/d6/fb7 [0,4194304] 0 2024-09-15T22:26:54.842 INFO:tasks.workunit.client.0.smithi001.stdout:7/941: mkdir d0/d7/d21/d143 0 2024-09-15T22:26:54.845 INFO:tasks.workunit.client.0.smithi001.stdout:9/911: truncate d5/de/da9/df1/f118 3241543 0 2024-09-15T22:26:54.846 INFO:tasks.workunit.client.0.smithi001.stdout:0/827: mknod d0/d9/db/c104 0 2024-09-15T22:26:54.847 INFO:tasks.workunit.client.0.smithi001.stdout:6/996: link d0/d6/d5d/d67/d53/fda d0/d7e/f14d 0 2024-09-15T22:26:54.849 INFO:tasks.workunit.client.0.smithi001.stdout:9/912: rmdir d5/de/d1a/d1b/d22/d2c/d21/d4d/dca 39 2024-09-15T22:26:54.849 INFO:tasks.workunit.client.0.smithi001.stdout:9/913: write d5/f114 [459128,127864] 0 2024-09-15T22:26:54.850 INFO:tasks.workunit.client.0.smithi001.stdout:6/997: mknod d0/d7e/d137/da7/c14e 0 2024-09-15T22:26:54.850 INFO:tasks.workunit.client.0.smithi001.stdout:6/998: chown d0/df/d24/d7b/db2/lc1 775463736 1 2024-09-15T22:26:54.851 INFO:tasks.workunit.client.0.smithi001.stdout:6/999: mknod d0/d6/d5d/dd8/c14f 0 2024-09-15T22:26:54.859 INFO:tasks.workunit.client.0.smithi001.stdout:0/828: dread d0/d9/f38 [0,4194304] 0 2024-09-15T22:26:54.861 INFO:tasks.workunit.client.0.smithi001.stdout:0/829: rename d0/d9/d1a/ddb/dcf/deb/fed to d0/dd/d63/f105 0 2024-09-15T22:26:54.861 INFO:tasks.workunit.client.0.smithi001.stdout:0/830: read - d0/d9/db/d5d/ffa zero size 2024-09-15T22:26:54.861 INFO:tasks.workunit.client.0.smithi001.stdout:0/831: write d0/d9/d1a/d70/faa [728883,89005] 0 2024-09-15T22:26:54.862 INFO:tasks.workunit.client.0.smithi001.stdout:9/914: dread d5/de/d15/d27/d63/f7b [0,4194304] 0 2024-09-15T22:26:54.862 INFO:tasks.workunit.client.0.smithi001.stdout:9/915: write d5/de/d15/d27/f50 [532041,449] 0 2024-09-15T22:26:54.863 INFO:tasks.workunit.client.0.smithi001.stdout:9/916: mknod d5/de/d1a/d1b/d22/d2c/d21/d24/d86/c123 0 2024-09-15T22:26:54.865 INFO:tasks.workunit.client.0.smithi001.stdout:5/984: dwrite d3/d6/d41/fe3 [0,4194304] 0 2024-09-15T22:26:54.865 INFO:tasks.workunit.client.0.smithi001.stdout:5/985: truncate d3/d6/d25/f79 880117 0 2024-09-15T22:26:54.865 INFO:tasks.workunit.client.0.smithi001.stdout:9/917: truncate d5/de/d1a/d1b/d22/d2c/d21/d24/fda 4286949 0 2024-09-15T22:26:54.865 INFO:tasks.workunit.client.0.smithi001.stdout:9/918: dread - d5/de/d1a/d1b/fbc zero size 2024-09-15T22:26:54.866 INFO:tasks.workunit.client.0.smithi001.stdout:9/919: getdents d5/de/d1a/da8 0 2024-09-15T22:26:54.867 INFO:tasks.workunit.client.0.smithi001.stdout:5/986: creat d3/d6/d57/d87/d8c/da2/f141 x:0 0 0 2024-09-15T22:26:54.867 INFO:tasks.workunit.client.0.smithi001.stdout:5/987: stat d3/d27/d7a 0 2024-09-15T22:26:54.867 INFO:tasks.workunit.client.0.smithi001.stdout:5/988: write d3/d49/f113 [654133,90214] 0 2024-09-15T22:26:54.868 INFO:tasks.workunit.client.0.smithi001.stdout:5/989: readlink d3/d6/d41/d88/da5/l135 0 2024-09-15T22:26:54.868 INFO:tasks.workunit.client.0.smithi001.stdout:5/990: readlink d3/d6/d25/l92 0 2024-09-15T22:26:54.868 INFO:tasks.workunit.client.0.smithi001.stdout:5/991: chown d3/d6/d41/d88/df0/f112 10 1 2024-09-15T22:26:54.874 INFO:tasks.workunit.client.0.smithi001.stdout:0/832: dread d0/d9/f38 [4194304,4194304] 0 2024-09-15T22:26:54.876 INFO:tasks.workunit.client.0.smithi001.stdout:0/833: mknod d0/d9/db/d5d/d79/dc3/de9/c106 0 2024-09-15T22:26:54.880 INFO:tasks.workunit.client.0.smithi001.stdout:5/992: write d3/d6/d41/d4d/dbe/d56/f4b [3614305,101947] 0 2024-09-15T22:26:54.881 INFO:tasks.workunit.client.0.smithi001.stdout:9/920: dread d5/de/d1a/f88 [0,4194304] 0 2024-09-15T22:26:54.888 INFO:tasks.workunit.client.0.smithi001.stdout:0/834: read d0/d51/f7d [846884,19618] 0 2024-09-15T22:26:54.891 INFO:tasks.workunit.client.0.smithi001.stdout:0/835: mknod d0/c107 0 2024-09-15T22:26:54.898 INFO:tasks.workunit.client.0.smithi001.stdout:5/993: write d3/d6/d41/d88/df0/f112 [249686,112958] 0 2024-09-15T22:26:54.901 INFO:tasks.workunit.client.0.smithi001.stdout:5/994: rename d3/d6/f7 to d3/d6/d41/d4d/dbe/d56/ddc/f142 0 2024-09-15T22:26:54.903 INFO:tasks.workunit.client.0.smithi001.stdout:5/995: symlink d3/l143 0 2024-09-15T22:26:54.910 INFO:tasks.workunit.client.0.smithi001.stdout:7/942: dwrite d0/db3/f116 [0,4194304] 0 2024-09-15T22:26:54.911 INFO:tasks.workunit.client.0.smithi001.stdout:0/836: write d0/d9/db/d5d/d79/dc3/fe5 [1983031,966] 0 2024-09-15T22:26:54.913 INFO:tasks.workunit.client.0.smithi001.stdout:7/943: mknod d0/dd3/d119/d129/c144 0 2024-09-15T22:26:54.914 INFO:tasks.workunit.client.0.smithi001.stdout:0/837: unlink d0/d9/l3f 0 2024-09-15T22:26:54.916 INFO:tasks.workunit.client.0.smithi001.stdout:7/944: truncate d0/d7/d21/d6b/d93/d132/f10e 2700366 0 2024-09-15T22:26:54.917 INFO:tasks.workunit.client.0.smithi001.stdout:7/945: creat d0/d7/d7c/f145 x:0 0 0 2024-09-15T22:26:54.918 INFO:tasks.workunit.client.0.smithi001.stdout:5/996: dread d3/d27/f2d [0,4194304] 0 2024-09-15T22:26:54.920 INFO:tasks.workunit.client.0.smithi001.stdout:5/997: symlink d3/d6/d41/d4d/dbe/d56/d52/l144 0 2024-09-15T22:26:54.920 INFO:tasks.workunit.client.0.smithi001.stdout:5/998: write d3/d27/d109/fd3 [1945191,59439] 0 2024-09-15T22:26:54.921 INFO:tasks.workunit.client.0.smithi001.stdout:5/999: rename d3/d27/d5c/c13c to d3/d27/d7a/c145 0 2024-09-15T22:26:54.923 INFO:tasks.workunit.client.0.smithi001.stdout:9/921: dwrite d5/de/d1a/d1b/f70 [4194304,4194304] 0 2024-09-15T22:26:54.924 INFO:tasks.workunit.client.0.smithi001.stdout:0/838: write d0/d9/f38 [3097162,58828] 0 2024-09-15T22:26:54.924 INFO:tasks.workunit.client.0.smithi001.stdout:0/839: chown d0/d9/db/d5d/d6d/cfb 3 1 2024-09-15T22:26:54.926 INFO:tasks.workunit.client.0.smithi001.stdout:9/922: creat d5/de/d102/f124 x:0 0 0 2024-09-15T22:26:54.926 INFO:tasks.workunit.client.0.smithi001.stdout:0/840: creat d0/d9/db/d5d/d79/f108 x:0 0 0 2024-09-15T22:26:54.927 INFO:tasks.workunit.client.0.smithi001.stdout:0/841: mknod d0/dd/c109 0 2024-09-15T22:26:54.931 INFO:tasks.workunit.client.0.smithi001.stdout:9/923: rename d5/de/d51/d53 to d5/de/d1a/d1b/d22/d2c/d21/d24/d125 0 2024-09-15T22:26:54.931 INFO:tasks.workunit.client.0.smithi001.stdout:7/946: dread d0/d8e/d3e/d127/d60/dbd/fdd [0,4194304] 0 2024-09-15T22:26:54.932 INFO:tasks.workunit.client.0.smithi001.stdout:7/947: rename d0/db3/fd8 to d0/d98/f146 0 2024-09-15T22:26:54.945 INFO:tasks.workunit.client.0.smithi001.stdout:0/842: dread d0/d9/d1a/d36/f41 [4194304,4194304] 0 2024-09-15T22:26:54.947 INFO:tasks.workunit.client.0.smithi001.stdout:0/843: rename d0/d84/cb5 to d0/d6/d6a/c10a 0 2024-09-15T22:26:54.947 INFO:tasks.workunit.client.0.smithi001.stdout:0/844: fdatasync d0/d9/d1a/fc1 0 2024-09-15T22:26:54.947 INFO:tasks.workunit.client.0.smithi001.stdout:0/845: fdatasync d0/d84/fb0 0 2024-09-15T22:26:54.948 INFO:tasks.workunit.client.0.smithi001.stdout:0/846: link d0/c107 d0/d9/d1a/ddb/dcf/deb/c10b 0 2024-09-15T22:26:54.949 INFO:tasks.workunit.client.0.smithi001.stdout:0/847: mkdir d0/dd/d33/dd2/d10c 0 2024-09-15T22:26:54.951 INFO:tasks.workunit.client.0.smithi001.stdout:0/848: truncate d0/d9/db/f6b 4365930 0 2024-09-15T22:26:54.951 INFO:tasks.workunit.client.0.smithi001.stdout:7/948: dread d0/d7/d44/f74 [0,4194304] 0 2024-09-15T22:26:54.963 INFO:tasks.workunit.client.0.smithi001.stdout:0/849: link d0/d9/db/f10 d0/d9/db/d5d/df4/f10d 0 2024-09-15T22:26:54.963 INFO:tasks.workunit.client.0.smithi001.stdout:7/949: dread d0/dd3/df9/ffe [0,4194304] 0 2024-09-15T22:26:54.981 INFO:tasks.workunit.client.0.smithi001.stdout:0/850: dread d0/d9/db/d5d/d6d/fe3 [0,4194304] 0 2024-09-15T22:26:54.992 INFO:tasks.workunit.client.0.smithi001.stdout:9/924: dwrite d5/de/d1a/d1b/d22/d2c/d21/d4d/f112 [0,4194304] 0 2024-09-15T22:26:54.995 INFO:tasks.workunit.client.0.smithi001.stdout:9/925: unlink d5/f44 0 2024-09-15T22:26:54.995 INFO:tasks.workunit.client.0.smithi001.stdout:9/926: creat d5/de/d15/d27/d63/f126 x:0 0 0 2024-09-15T22:26:55.007 INFO:tasks.workunit.client.0.smithi001.stdout:7/950: dwrite d0/d7/d44/d3f/d49/da5/faa [0,4194304] 0 2024-09-15T22:26:55.060 INFO:tasks.workunit.client.0.smithi001.stdout:9/927: dwrite d5/de/da9/df1/f105 [0,4194304] 0 2024-09-15T22:26:55.060 INFO:tasks.workunit.client.0.smithi001.stdout:0/851: dwrite d0/d6/dae/fd1 [0,4194304] 0 2024-09-15T22:26:55.060 INFO:tasks.workunit.client.0.smithi001.stdout:7/951: dwrite d0/d7/d44/d3f/d49/da5/ffb [0,4194304] 0 2024-09-15T22:26:55.064 INFO:tasks.workunit.client.0.smithi001.stdout:0/852: link d0/d9/db/dc5/l101 d0/d9/db/dc5/l10e 0 2024-09-15T22:26:55.064 INFO:tasks.workunit.client.0.smithi001.stdout:9/928: symlink d5/de/d1a/da8/d10a/l127 0 2024-09-15T22:26:55.069 INFO:tasks.workunit.client.0.smithi001.stdout:0/853: rename d0/d9/db/d5d/d6d/c7c to d0/d6/c10f 0 2024-09-15T22:26:55.083 INFO:tasks.workunit.client.0.smithi001.stdout:7/952: write d0/f7a [2018694,35227] 0 2024-09-15T22:26:55.084 INFO:tasks.workunit.client.0.smithi001.stdout:0/854: dread d0/d9/db/f10 [0,4194304] 0 2024-09-15T22:26:55.085 INFO:tasks.workunit.client.0.smithi001.stdout:0/855: rename d0/d9/f8e to d0/d9/db/d5d/d79/f110 0 2024-09-15T22:26:55.095 INFO:tasks.workunit.client.0.smithi001.stdout:0/856: dread d0/d9/db/d5d/d79/dc3/fe5 [0,4194304] 0 2024-09-15T22:26:55.096 INFO:tasks.workunit.client.0.smithi001.stdout:0/857: creat d0/d9/db/d5d/df4/f111 x:0 0 0 2024-09-15T22:26:55.097 INFO:tasks.workunit.client.0.smithi001.stdout:0/858: link d0/d9/db/d5d/d79/fa0 d0/d51/f112 0 2024-09-15T22:26:55.111 INFO:tasks.workunit.client.0.smithi001.stdout:0/859: dread d0/d9/d1a/fc1 [0,4194304] 0 2024-09-15T22:26:55.113 INFO:tasks.workunit.client.0.smithi001.stdout:0/860: creat d0/d9/f113 x:0 0 0 2024-09-15T22:26:55.113 INFO:tasks.workunit.client.0.smithi001.stdout:0/861: fsync d0/d6/d77/ff3 0 2024-09-15T22:26:55.113 INFO:tasks.workunit.client.0.smithi001.stdout:0/862: read - d0/d6/d77/d78/fb7 zero size 2024-09-15T22:26:55.113 INFO:tasks.workunit.client.0.smithi001.stdout:0/863: readlink d0/d6/lc2 0 2024-09-15T22:26:55.113 INFO:tasks.workunit.client.0.smithi001.stdout:0/864: chown d0/d6/ca2 6 1 2024-09-15T22:26:55.113 INFO:tasks.workunit.client.0.smithi001.stdout:0/865: link d0/dd/c5c d0/dd/d63/c114 0 2024-09-15T22:26:55.114 INFO:tasks.workunit.client.0.smithi001.stdout:0/866: chown d0/d9/d1a/ddb/c2b 267448 1 2024-09-15T22:26:55.116 INFO:tasks.workunit.client.0.smithi001.stdout:0/867: rename d0/d9/db/f10 to d0/dd/d93/f115 0 2024-09-15T22:26:55.116 INFO:tasks.workunit.client.0.smithi001.stdout:0/868: fsync d0/d6/d77/d78/f85 0 2024-09-15T22:26:55.116 INFO:tasks.workunit.client.0.smithi001.stdout:0/869: fsync d0/f2 0 2024-09-15T22:26:55.116 INFO:tasks.workunit.client.0.smithi001.stdout:0/870: chown d0/dd/d63/c91 5234459 1 2024-09-15T22:26:55.116 INFO:tasks.workunit.client.0.smithi001.stdout:0/871: mkdir d0/dd/d116 0 2024-09-15T22:26:55.118 INFO:tasks.workunit.client.0.smithi001.stdout:0/872: rmdir d0/d6/d77 39 2024-09-15T22:26:55.118 INFO:tasks.workunit.client.0.smithi001.stdout:0/873: read d0/dd/f100 [44346,17007] 0 2024-09-15T22:26:55.118 INFO:tasks.workunit.client.0.smithi001.stdout:0/874: getdents d0/d9/d1a 0 2024-09-15T22:26:55.119 INFO:tasks.workunit.client.0.smithi001.stdout:0/875: truncate d0/d9/db/d5d/d79/fa0 266189 0 2024-09-15T22:26:55.119 INFO:tasks.workunit.client.0.smithi001.stdout:0/876: creat d0/d9/d1a/f117 x:0 0 0 2024-09-15T22:26:55.131 INFO:tasks.workunit.client.0.smithi001.stdout:0/877: write d0/d9/f1c [1815395,101971] 0 2024-09-15T22:26:55.139 INFO:tasks.workunit.client.0.smithi001.stdout:7/953: dwrite d0/db3/f134 [0,4194304] 0 2024-09-15T22:26:55.152 INFO:tasks.workunit.client.0.smithi001.stdout:7/954: read d0/d7/d7c/ff1 [851940,119811] 0 2024-09-15T22:26:55.152 INFO:tasks.workunit.client.0.smithi001.stdout:7/955: readlink d0/d7/l1f 0 2024-09-15T22:26:55.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:54 smithi012 ceph-mon[34883]: pgmap v417: 97 pgs: 97 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 170 MiB/s rd, 190 MiB/s wr, 294 op/s 2024-09-15T22:26:55.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:54 smithi098 ceph-mon[35514]: pgmap v417: 97 pgs: 97 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 170 MiB/s rd, 190 MiB/s wr, 294 op/s 2024-09-15T22:26:55.375 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:54 smithi001 ceph-mon[30843]: pgmap v417: 97 pgs: 97 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 170 MiB/s rd, 190 MiB/s wr, 294 op/s 2024-09-15T22:26:57.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:56 smithi012 ceph-mon[34883]: pgmap v418: 97 pgs: 97 active+clean; 1.9 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 239 MiB/s rd, 276 MiB/s wr, 642 op/s 2024-09-15T22:26:57.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:56 smithi098 ceph-mon[35514]: pgmap v418: 97 pgs: 97 active+clean; 1.9 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 239 MiB/s rd, 276 MiB/s wr, 642 op/s 2024-09-15T22:26:57.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:56 smithi001 ceph-mon[30843]: pgmap v418: 97 pgs: 97 active+clean; 1.9 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 239 MiB/s rd, 276 MiB/s wr, 642 op/s 2024-09-15T22:26:58.374 INFO:tasks.workunit.client.0.smithi001.stdout:8/896: sync 2024-09-15T22:26:58.375 INFO:tasks.workunit.client.0.smithi001.stdout:9/929: sync 2024-09-15T22:26:58.375 INFO:tasks.workunit.client.0.smithi001.stdout:7/956: sync 2024-09-15T22:26:58.375 INFO:tasks.workunit.client.0.smithi001.stdout:0/878: sync 2024-09-15T22:26:58.379 INFO:tasks.workunit.client.0.smithi001.stdout:7/957: mkdir d0/d7/d21/d143/d147 0 2024-09-15T22:26:58.379 INFO:tasks.workunit.client.0.smithi001.stdout:7/958: chown d0/d7/d44/d3f/d49/d4f/f12e 416772819 1 2024-09-15T22:26:58.380 INFO:tasks.workunit.client.0.smithi001.stdout:0/879: rmdir d0/d9/db/d5d/df4 39 2024-09-15T22:26:58.385 INFO:tasks.workunit.client.0.smithi001.stdout:9/930: creat d5/de/d1a/d1b/d22/d2c/d21/d23/d3d/f128 x:0 0 0 2024-09-15T22:26:58.395 INFO:tasks.workunit.client.0.smithi001.stdout:0/880: rmdir d0/d84 39 2024-09-15T22:26:58.404 INFO:tasks.workunit.client.0.smithi001.stdout:0/881: mkdir d0/d6/d6a/def/d118 0 2024-09-15T22:26:58.404 INFO:tasks.workunit.client.0.smithi001.stdout:0/882: chown d0/d9/db/c5a 0 1 2024-09-15T22:26:58.410 INFO:tasks.workunit.client.0.smithi001.stdout:0/883: rename d0/d9/d1a/d70/f87 to d0/d9/d1a/ddb/dcf/deb/f119 0 2024-09-15T22:26:58.410 INFO:tasks.workunit.client.0.smithi001.stdout:0/884: creat d0/d6/d6a/def/d118/f11a x:0 0 0 2024-09-15T22:26:58.412 INFO:tasks.workunit.client.0.smithi001.stdout:7/959: dread d0/d7/d44/d36/fb5 [0,4194304] 0 2024-09-15T22:26:58.414 INFO:tasks.workunit.client.0.smithi001.stdout:7/960: creat d0/d8e/d3e/d127/d60/d10d/dac/dda/f148 x:0 0 0 2024-09-15T22:26:58.414 INFO:tasks.workunit.client.0.smithi001.stdout:7/961: stat d0/d7/d21/d6b/fe2 0 2024-09-15T22:26:58.415 INFO:tasks.workunit.client.0.smithi001.stdout:7/962: mkdir d0/d8e/d3e/d127/d60/df7/d149 0 2024-09-15T22:26:58.416 INFO:tasks.workunit.client.0.smithi001.stdout:7/963: getdents d0/d7/dd5 0 2024-09-15T22:26:58.416 INFO:tasks.workunit.client.0.smithi001.stdout:7/964: write d0/d7/fdf [603246,62687] 0 2024-09-15T22:26:58.417 INFO:tasks.workunit.client.0.smithi001.stdout:7/965: getdents d0/d7/d44/d3f/d49 0 2024-09-15T22:26:58.417 INFO:tasks.workunit.client.0.smithi001.stdout:7/966: getdents d0/d7/d44/d3f/d49/d12f 0 2024-09-15T22:26:58.418 INFO:tasks.workunit.client.0.smithi001.stdout:7/967: mknod d0/db3/dd6/d126/c14a 0 2024-09-15T22:26:58.419 INFO:tasks.workunit.client.0.smithi001.stdout:8/897: dwrite d9/d19/d40/d5f/fe4 [0,4194304] 0 2024-09-15T22:26:58.419 INFO:tasks.workunit.client.0.smithi001.stdout:8/898: fsync d9/d19/d58/d8e/d9c/ffc 0 2024-09-15T22:26:58.420 INFO:tasks.workunit.client.0.smithi001.stdout:7/968: rmdir d0/d8e/d3e/d127/d60 39 2024-09-15T22:26:58.423 INFO:tasks.workunit.client.0.smithi001.stdout:7/969: read d0/d7/d21/f9b [125640,66427] 0 2024-09-15T22:26:58.423 INFO:tasks.workunit.client.0.smithi001.stdout:7/970: dread - d0/d8e/d3e/d127/d60/dbd/fe0 zero size 2024-09-15T22:26:58.427 INFO:tasks.workunit.client.0.smithi001.stdout:7/971: unlink d0/d7/d7c/ld9 0 2024-09-15T22:26:58.476 INFO:tasks.workunit.client.0.smithi001.stdout:9/931: dwrite d5/d90/fbb [0,4194304] 0 2024-09-15T22:26:58.476 INFO:tasks.workunit.client.0.smithi001.stdout:9/932: fdatasync d5/de/d1a/d1b/d22/f82 0 2024-09-15T22:26:58.478 INFO:tasks.workunit.client.0.smithi001.stdout:9/933: mknod d5/de/d1a/d1b/d22/d2c/d10d/c129 0 2024-09-15T22:26:58.478 INFO:tasks.workunit.client.0.smithi001.stdout:9/934: chown d5/de/d1a/d38/l47 322003959 1 2024-09-15T22:26:58.482 INFO:tasks.workunit.client.0.smithi001.stdout:7/972: dwrite d0/d8e/d3e/d127/fec [0,4194304] 0 2024-09-15T22:26:58.482 INFO:tasks.workunit.client.0.smithi001.stdout:7/973: chown d0/d8e/d3e/d127 1996314579 1 2024-09-15T22:26:58.484 INFO:tasks.workunit.client.0.smithi001.stdout:7/974: mkdir d0/d7/d21/d6b/d93/d14b 0 2024-09-15T22:26:58.484 INFO:tasks.workunit.client.0.smithi001.stdout:7/975: readlink d0/dd3/l125 0 2024-09-15T22:26:58.550 INFO:tasks.workunit.client.0.smithi001.stdout:9/935: dwrite d5/de/d15/d27/d63/f92 [0,4194304] 0 2024-09-15T22:26:58.550 INFO:tasks.workunit.client.0.smithi001.stdout:7/976: dwrite d0/d7/d44/d3f/f75 [4194304,4194304] 0 2024-09-15T22:26:58.552 INFO:tasks.workunit.client.0.smithi001.stdout:7/977: unlink d0/d7/d44/d3f/d49/l110 0 2024-09-15T22:26:58.553 INFO:tasks.workunit.client.0.smithi001.stdout:9/936: creat d5/de/d1a/d1b/f12a x:0 0 0 2024-09-15T22:26:58.555 INFO:tasks.workunit.client.0.smithi001.stdout:0/885: sync 2024-09-15T22:26:58.555 INFO:tasks.workunit.client.0.smithi001.stdout:8/899: sync 2024-09-15T22:26:58.555 INFO:tasks.workunit.client.0.smithi001.stdout:9/937: rename d5/de/d1a/d1b/d22/d97/ca0 to d5/de/d1a/d1b/d22/d2c/d21/d24/d125/dbe/ddd/d120/c12b 0 2024-09-15T22:26:58.564 INFO:tasks.workunit.client.0.smithi001.stdout:9/938: mkdir d5/de/d117/d12c 0 2024-09-15T22:26:58.565 INFO:tasks.workunit.client.0.smithi001.stdout:7/978: dread d0/d7/d44/d36/f99 [0,4194304] 0 2024-09-15T22:26:58.565 INFO:tasks.workunit.client.0.smithi001.stdout:7/979: chown d0/d7/d21/l22 0 1 2024-09-15T22:26:58.565 INFO:tasks.workunit.client.0.smithi001.stdout:9/939: symlink d5/de/d1a/d1b/d22/l12d 0 2024-09-15T22:26:58.567 INFO:tasks.workunit.client.0.smithi001.stdout:7/980: rename d0/dd3/l124 to d0/d7/d44/d3f/d49/da5/d12c/l14c 0 2024-09-15T22:26:58.567 INFO:tasks.workunit.client.0.smithi001.stdout:7/981: fsync d0/dd3/df9/f142 0 2024-09-15T22:26:58.567 INFO:tasks.workunit.client.0.smithi001.stdout:9/940: symlink d5/de/d1a/d1b/d22/d2c/d21/d24/l12e 0 2024-09-15T22:26:58.568 INFO:tasks.workunit.client.0.smithi001.stdout:9/941: creat d5/de/d1a/d1b/d22/d97/f12f x:0 0 0 2024-09-15T22:26:58.568 INFO:tasks.workunit.client.0.smithi001.stdout:9/942: dread - d5/de/d1a/d1b/d22/d97/f12f zero size 2024-09-15T22:26:58.571 INFO:tasks.workunit.client.0.smithi001.stdout:9/943: write d5/de/d1a/d1b/d22/d2c/d21/d68/f76 [616194,107993] 0 2024-09-15T22:26:58.572 INFO:tasks.workunit.client.0.smithi001.stdout:9/944: rmdir d5/de/d1a/d1b/d22/d2c/d21/d24/d125/dbe 39 2024-09-15T22:26:58.573 INFO:tasks.workunit.client.0.smithi001.stdout:9/945: rename d5/de/d1a/d1b/d22/d2c/d10d/c129 to d5/de/d1a/d1b/d22/d2c/d21/d4d/c130 0 2024-09-15T22:26:58.574 INFO:tasks.workunit.client.0.smithi001.stdout:9/946: rmdir d5/de/d102 39 2024-09-15T22:26:58.575 INFO:tasks.workunit.client.0.smithi001.stdout:8/900: write d9/f59 [1931845,49156] 0 2024-09-15T22:26:58.575 INFO:tasks.workunit.client.0.smithi001.stdout:8/901: truncate d9/d19/d58/fcc 4735778 0 2024-09-15T22:26:58.575 INFO:tasks.workunit.client.0.smithi001.stdout:9/947: mknod d5/de/d15/d27/dc6/c131 0 2024-09-15T22:26:58.575 INFO:tasks.workunit.client.0.smithi001.stdout:9/948: fdatasync d5/de/d1a/d1b/d22/fcd 0 2024-09-15T22:26:58.576 INFO:tasks.workunit.client.0.smithi001.stdout:8/902: mkdir d9/d19/d29/d50/d70/d76/d7d/dff 0 2024-09-15T22:26:58.577 INFO:tasks.workunit.client.0.smithi001.stdout:8/903: symlink d9/d19/d29/df2/l100 0 2024-09-15T22:26:58.578 INFO:tasks.workunit.client.0.smithi001.stdout:8/904: rename d9/d19/l8a to d9/d19/d40/d5f/d61/l101 0 2024-09-15T22:26:58.587 INFO:tasks.workunit.client.0.smithi001.stdout:7/982: dread d0/d7/f24 [0,4194304] 0 2024-09-15T22:26:58.588 INFO:tasks.workunit.client.0.smithi001.stdout:9/949: dread d5/de/d1a/d1b/d22/d2c/d21/d24/f69 [0,4194304] 0 2024-09-15T22:26:58.588 INFO:tasks.workunit.client.0.smithi001.stdout:9/950: chown d5/de/d1a/d1b/d22/d2c/d21/d24/d86/f93 137394311 1 2024-09-15T22:26:58.589 INFO:tasks.workunit.client.0.smithi001.stdout:9/951: write d5/de/d1a/d1b/f3a [3528033,34808] 0 2024-09-15T22:26:58.595 INFO:tasks.workunit.client.0.smithi001.stdout:7/983: getdents d0/d8e/d3e/d127/d60/d10d/dac/dda 0 2024-09-15T22:26:58.603 INFO:tasks.workunit.client.0.smithi001.stdout:0/886: dwrite d0/d9/db/d5d/df4/f111 [0,4194304] 0 2024-09-15T22:26:58.607 INFO:tasks.workunit.client.0.smithi001.stdout:0/887: mkdir d0/d9/d1a/d36/d11b 0 2024-09-15T22:26:58.611 INFO:tasks.workunit.client.0.smithi001.stdout:7/984: dread d0/d7/d44/f28 [0,4194304] 0 2024-09-15T22:26:58.612 INFO:tasks.workunit.client.0.smithi001.stdout:7/985: getdents d0/db3/dd6/d126/d13d 0 2024-09-15T22:26:58.614 INFO:tasks.workunit.client.0.smithi001.stdout:7/986: creat d0/d7/d44/d3f/d49/da5/d12c/f14d x:0 0 0 2024-09-15T22:26:58.618 INFO:tasks.workunit.client.0.smithi001.stdout:9/952: dwrite d5/de/d1a/d1b/d22/d2c/d21/d24/d125/d9f/fec [0,4194304] 0 2024-09-15T22:26:58.622 INFO:tasks.workunit.client.0.smithi001.stdout:8/905: dwrite d9/d19/d58/f95 [0,4194304] 0 2024-09-15T22:26:58.622 INFO:tasks.workunit.client.0.smithi001.stdout:9/953: creat d5/de/da9/f132 x:0 0 0 2024-09-15T22:26:58.622 INFO:tasks.workunit.client.0.smithi001.stdout:8/906: fsync d9/d19/d40/d9e/dd0/fe0 0 2024-09-15T22:26:58.622 INFO:tasks.workunit.client.0.smithi001.stdout:9/954: fsync d5/de/d1a/d1b/d22/d2c/dab/f109 0 2024-09-15T22:26:58.624 INFO:tasks.workunit.client.0.smithi001.stdout:8/907: symlink d9/d19/d34/da4/l102 0 2024-09-15T22:26:58.625 INFO:tasks.workunit.client.0.smithi001.stdout:7/987: read d0/d8e/d3e/d127/d60/d10d/fbb [294007,81303] 0 2024-09-15T22:26:58.627 INFO:tasks.workunit.client.0.smithi001.stdout:7/988: creat d0/d7/d21/d143/f14e x:0 0 0 2024-09-15T22:26:58.628 INFO:tasks.workunit.client.0.smithi001.stdout:7/989: mknod d0/dd3/d119/d12b/c14f 0 2024-09-15T22:26:58.630 INFO:tasks.workunit.client.0.smithi001.stdout:7/990: mkdir d0/db3/dd6/d126/d13d/d150 0 2024-09-15T22:26:58.631 INFO:tasks.workunit.client.0.smithi001.stdout:7/991: rename d0/d7/fff to d0/d7/d7c/f151 0 2024-09-15T22:26:58.631 INFO:tasks.workunit.client.0.smithi001.stdout:7/992: chown d0/d7/d44/d3f/d49/fc7 432891 1 2024-09-15T22:26:58.631 INFO:tasks.workunit.client.0.smithi001.stdout:7/993: chown d0/d7/d21/d6b/f3b 250698785 1 2024-09-15T22:26:58.638 INFO:tasks.workunit.client.0.smithi001.stdout:9/955: dread d5/de/d1a/f56 [0,4194304] 0 2024-09-15T22:26:58.638 INFO:tasks.workunit.client.0.smithi001.stdout:9/956: stat d5/de/d51/c5c 0 2024-09-15T22:26:58.642 INFO:tasks.workunit.client.0.smithi001.stdout:9/957: link d5/de/d1a/d1b/d22/d2c/f61 d5/de/da9/f133 0 2024-09-15T22:26:58.643 INFO:tasks.workunit.client.0.smithi001.stdout:9/958: mkdir d5/de/d15/d27/d63/d110/d134 0 2024-09-15T22:26:58.644 INFO:tasks.workunit.client.0.smithi001.stdout:9/959: creat d5/de/d1a/d1b/d22/d2c/d21/d4d/f135 x:0 0 0 2024-09-15T22:26:58.645 INFO:tasks.workunit.client.0.smithi001.stdout:9/960: chown d5/de/d1a/d38/c6c 588 1 2024-09-15T22:26:58.645 INFO:tasks.workunit.client.0.smithi001.stdout:9/961: write d5/de/d15/d27/f50 [864886,43359] 0 2024-09-15T22:26:58.645 INFO:tasks.workunit.client.0.smithi001.stdout:9/962: readlink d5/de/d1a/l1e 0 2024-09-15T22:26:58.646 INFO:tasks.workunit.client.0.smithi001.stdout:9/963: creat d5/de/d1a/d1b/d22/d2c/dab/f136 x:0 0 0 2024-09-15T22:26:58.647 INFO:tasks.workunit.client.0.smithi001.stdout:9/964: mkdir d5/d8d/d137 0 2024-09-15T22:26:58.647 INFO:tasks.workunit.client.0.smithi001.stdout:9/965: chown d5/de/d1a/d1b/d22/d2c/d21/d24/d125/d9f/cf2 3292819 1 2024-09-15T22:26:58.648 INFO:tasks.workunit.client.0.smithi001.stdout:9/966: creat d5/de/d15/d27/d63/db6/f138 x:0 0 0 2024-09-15T22:26:58.648 INFO:tasks.workunit.client.0.smithi001.stdout:8/908: dread d9/d19/d40/d5f/fe4 [0,4194304] 0 2024-09-15T22:26:58.648 INFO:tasks.workunit.client.0.smithi001.stdout:8/909: write d9/f31 [722820,71415] 0 2024-09-15T22:26:58.649 INFO:tasks.workunit.client.0.smithi001.stdout:9/967: mkdir d5/de/d15/d27/dcb/d139 0 2024-09-15T22:26:58.650 INFO:tasks.workunit.client.0.smithi001.stdout:9/968: getdents d5/de/d51 0 2024-09-15T22:26:58.651 INFO:tasks.workunit.client.0.smithi001.stdout:9/969: mknod d5/de/d1a/d1b/d22/d2c/d21/d4d/c13a 0 2024-09-15T22:26:58.660 INFO:tasks.workunit.client.0.smithi001.stdout:0/888: dwrite d0/d9/d1a/f58 [0,4194304] 0 2024-09-15T22:26:58.661 INFO:tasks.workunit.client.0.smithi001.stdout:7/994: dwrite d0/d7/d21/d6b/fd2 [0,4194304] 0 2024-09-15T22:26:58.661 INFO:tasks.workunit.client.0.smithi001.stdout:7/995: chown d0/d7/fa4 0 1 2024-09-15T22:26:58.663 INFO:tasks.workunit.client.0.smithi001.stdout:8/910: truncate d9/d19/d58/f95 1240399 0 2024-09-15T22:26:58.664 INFO:tasks.workunit.client.0.smithi001.stdout:8/911: truncate d9/d19/d34/d41/fe2 753360 0 2024-09-15T22:26:58.664 INFO:tasks.workunit.client.0.smithi001.stdout:8/912: fsync d9/d19/d29/f45 0 2024-09-15T22:26:58.666 INFO:tasks.workunit.client.0.smithi001.stdout:0/889: creat d0/d9/db/dc5/f11c x:0 0 0 2024-09-15T22:26:58.666 INFO:tasks.workunit.client.0.smithi001.stdout:0/890: write d0/d9/d1a/ddb/dcf/fd9 [1457390,63423] 0 2024-09-15T22:26:58.667 INFO:tasks.workunit.client.0.smithi001.stdout:8/913: unlink d9/d19/d29/d50/d70/d76/d7d/lc5 0 2024-09-15T22:26:58.667 INFO:tasks.workunit.client.0.smithi001.stdout:9/970: dread d5/de/f18 [4194304,4194304] 0 2024-09-15T22:26:58.667 INFO:tasks.workunit.client.0.smithi001.stdout:9/971: readlink d5/de/d1a/d1b/d22/d2c/d21/d68/la4 0 2024-09-15T22:26:58.668 INFO:tasks.workunit.client.0.smithi001.stdout:0/891: creat d0/d9/db/d5d/df4/f11d x:0 0 0 2024-09-15T22:26:58.669 INFO:tasks.workunit.client.0.smithi001.stdout:8/914: creat d9/f103 x:0 0 0 2024-09-15T22:26:58.670 INFO:tasks.workunit.client.0.smithi001.stdout:9/972: unlink d5/de/f18 0 2024-09-15T22:26:58.671 INFO:tasks.workunit.client.0.smithi001.stdout:0/892: mknod d0/d84/c11e 0 2024-09-15T22:26:58.671 INFO:tasks.workunit.client.0.smithi001.stdout:0/893: read - d0/dd/d63/db6/ff6 zero size 2024-09-15T22:26:58.672 INFO:tasks.workunit.client.0.smithi001.stdout:9/973: truncate d5/de/d1a/d1b/d22/d2c/d21/d24/fda 2511042 0 2024-09-15T22:26:58.672 INFO:tasks.workunit.client.0.smithi001.stdout:9/974: truncate d5/de/d1a/f8b 2504666 0 2024-09-15T22:26:58.686 INFO:tasks.workunit.client.0.smithi001.stdout:0/894: dread d0/d9/db/d5d/df4/f10d [0,4194304] 0 2024-09-15T22:26:58.692 INFO:tasks.workunit.client.0.smithi001.stdout:0/895: mkdir d0/d9/d1a/d36/d11f 0 2024-09-15T22:26:58.695 INFO:tasks.workunit.client.0.smithi001.stdout:0/896: link d0/d9/d1a/fdc d0/d6/dae/f120 0 2024-09-15T22:26:58.695 INFO:tasks.workunit.client.0.smithi001.stdout:0/897: truncate d0/dd/d63/f105 920400 0 2024-09-15T22:26:58.696 INFO:tasks.workunit.client.0.smithi001.stdout:0/898: mkdir d0/d9/d1a/ddb/dcf/d121 0 2024-09-15T22:26:58.696 INFO:tasks.workunit.client.0.smithi001.stdout:0/899: write d0/d9/db/f25 [1750401,90648] 0 2024-09-15T22:26:58.697 INFO:tasks.workunit.client.0.smithi001.stdout:0/900: stat d0/d9/d1a/fc1 0 2024-09-15T22:26:58.698 INFO:tasks.workunit.client.0.smithi001.stdout:0/901: rename d0/d6/cbe to d0/d9/d1a/d36/d11f/c122 0 2024-09-15T22:26:58.700 INFO:tasks.workunit.client.0.smithi001.stdout:0/902: mknod d0/d6/dae/c123 0 2024-09-15T22:26:58.702 INFO:tasks.workunit.client.0.smithi001.stdout:7/996: dwrite d0/d7/d44/d3f/d49/da5/faa [4194304,4194304] 0 2024-09-15T22:26:58.710 INFO:tasks.workunit.client.0.smithi001.stdout:8/915: dwrite d9/d19/d58/f4d [0,4194304] 0 2024-09-15T22:26:58.712 INFO:tasks.workunit.client.0.smithi001.stdout:0/903: dread d0/d51/f7d [0,4194304] 0 2024-09-15T22:26:58.712 INFO:tasks.workunit.client.0.smithi001.stdout:0/904: fsync d0/d9/d1a/d36/f3a 0 2024-09-15T22:26:58.731 INFO:tasks.workunit.client.0.smithi001.stdout:0/905: write d0/d6/d77/fb3 [1624368,99743] 0 2024-09-15T22:26:58.739 INFO:tasks.workunit.client.0.smithi001.stdout:8/916: rename d9/d19/d29/d33/d63 to d9/d19/d34/d41/d104 0 2024-09-15T22:26:58.740 INFO:tasks.workunit.client.0.smithi001.stdout:8/917: readlink d9/l6f 0 2024-09-15T22:26:58.741 INFO:tasks.workunit.client.0.smithi001.stdout:8/918: truncate d9/d19/d58/f54 582721 0 2024-09-15T22:26:58.745 INFO:tasks.workunit.client.0.smithi001.stdout:9/975: dwrite d5/de/d1a/d1b/d22/d2c/f61 [0,4194304] 0 2024-09-15T22:26:58.752 INFO:tasks.workunit.client.0.smithi001.stdout:9/976: symlink d5/de/d1a/d1b/d22/d2c/d21/d68/l13b 0 2024-09-15T22:26:58.755 INFO:tasks.workunit.client.0.smithi001.stdout:8/919: rmdir d9/d19/d34/d41/d99 0 2024-09-15T22:26:58.761 INFO:tasks.workunit.client.0.smithi001.stdout:7/997: dwrite d0/d7/d7c/f145 [0,4194304] 0 2024-09-15T22:26:58.761 INFO:tasks.workunit.client.0.smithi001.stdout:7/998: write d0/dd3/d119/d12b/f13a [802142,29667] 0 2024-09-15T22:26:58.761 INFO:tasks.workunit.client.0.smithi001.stdout:7/999: readlink d0/d98/lde 0 2024-09-15T22:26:58.806 INFO:tasks.workunit.client.0.smithi001.stdout:0/906: rmdir d0/d9/d1a/ddb 39 2024-09-15T22:26:58.828 INFO:tasks.workunit.client.0.smithi001.stdout:9/977: dwrite d5/de/da9/f133 [4194304,4194304] 0 2024-09-15T22:26:58.828 INFO:tasks.workunit.client.0.smithi001.stdout:9/978: write d5/de/da9/df1/d104/f11b [533979,54166] 0 2024-09-15T22:26:58.843 INFO:tasks.workunit.client.0.smithi001.stdout:8/920: dwrite d9/f31 [0,4194304] 0 2024-09-15T22:26:58.850 INFO:tasks.workunit.client.0.smithi001.stdout:0/907: dwrite d0/d9/d1a/fa8 [0,4194304] 0 2024-09-15T22:26:58.850 INFO:tasks.workunit.client.0.smithi001.stdout:0/908: write d0/d9/d1a/fdc [59783,106322] 0 2024-09-15T22:26:58.865 INFO:tasks.workunit.client.0.smithi001.stdout:9/979: unlink d5/de/d1a/c57 0 2024-09-15T22:26:58.866 INFO:tasks.workunit.client.0.smithi001.stdout:8/921: getdents d9/d19/d29 0 2024-09-15T22:26:58.868 INFO:tasks.workunit.client.0.smithi001.stdout:9/980: stat d5/de/d1a/d1b/d22/f82 0 2024-09-15T22:26:58.868 INFO:tasks.workunit.client.0.smithi001.stdout:9/981: write d5/de/d1a/d1b/f3a [3532427,43143] 0 2024-09-15T22:26:58.869 INFO:tasks.workunit.client.0.smithi001.stdout:8/922: mkdir d9/d19/d34/d41/d105 0 2024-09-15T22:26:58.872 INFO:tasks.workunit.client.0.smithi001.stdout:9/982: mknod d5/de/da9/df1/c13c 0 2024-09-15T22:26:58.872 INFO:tasks.workunit.client.0.smithi001.stdout:9/983: truncate d5/f114 1327009 0 2024-09-15T22:26:58.874 INFO:tasks.workunit.client.0.smithi001.stdout:9/984: creat d5/de/d1a/d1b/d22/d2c/d21/d23/d3d/f13d x:0 0 0 2024-09-15T22:26:58.875 INFO:tasks.workunit.client.0.smithi001.stdout:9/985: creat d5/de/d15/d27/d63/d110/d134/f13e x:0 0 0 2024-09-15T22:26:58.877 INFO:tasks.workunit.client.0.smithi001.stdout:9/986: rename d5/de/d1a/d1b/d22/d2c/d21/d23/d3d/fb5 to d5/de/d1a/d1b/d22/d2c/d21/d24/d125/f13f 0 2024-09-15T22:26:58.882 INFO:tasks.workunit.client.0.smithi001.stdout:8/923: read d9/f31 [1163403,117810] 0 2024-09-15T22:26:58.883 INFO:tasks.workunit.client.0.smithi001.stdout:8/924: getdents d9/d19/d40/d5f/d61/d9f/db3 0 2024-09-15T22:26:58.884 INFO:tasks.workunit.client.0.smithi001.stdout:8/925: creat d9/d19/d29/d50/f106 x:0 0 0 2024-09-15T22:26:58.884 INFO:tasks.workunit.client.0.smithi001.stdout:8/926: write d9/d19/d58/d8e/d9c/fce [4733983,55911] 0 2024-09-15T22:26:58.889 INFO:tasks.workunit.client.0.smithi001.stdout:0/909: dwrite d0/dd/d93/fcc [0,4194304] 0 2024-09-15T22:26:58.895 INFO:tasks.workunit.client.0.smithi001.stdout:9/987: dread d5/de/d1a/d1b/d22/d2c/d21/d24/d125/f60 [0,4194304] 0 2024-09-15T22:26:58.908 INFO:tasks.workunit.client.0.smithi001.stdout:0/910: dread d0/d6/d77/d78/f8b [0,4194304] 0 2024-09-15T22:26:58.964 INFO:tasks.workunit.client.0.smithi001.stdout:0/911: rmdir d0/d9/d1a/d36 39 2024-09-15T22:26:59.000 INFO:tasks.workunit.client.0.smithi001.stdout:0/912: dwrite d0/d6/d77/ff3 [0,4194304] 0 2024-09-15T22:26:59.004 INFO:tasks.workunit.client.0.smithi001.stdout:0/913: symlink d0/dd/d63/l124 0 2024-09-15T22:26:59.004 INFO:tasks.workunit.client.0.smithi001.stdout:0/914: fsync d0/d9/d1a/d36/f41 0 2024-09-15T22:26:59.004 INFO:tasks.workunit.client.0.smithi001.stdout:0/915: read - d0/d9/db/d5d/d79/f110 zero size 2024-09-15T22:26:59.004 INFO:tasks.workunit.client.0.smithi001.stdout:0/916: write d0/d9/f113 [142839,59505] 0 2024-09-15T22:26:59.004 INFO:tasks.workunit.client.0.smithi001.stdout:0/917: write d0/d9/db/f25 [2011363,31099] 0 2024-09-15T22:26:59.004 INFO:tasks.workunit.client.0.smithi001.stdout:0/918: fdatasync d0/d6/d6a/def/ff8 0 2024-09-15T22:26:59.006 INFO:tasks.workunit.client.0.smithi001.stdout:0/919: rmdir d0/d9/d1a/d36/d11b 0 2024-09-15T22:26:59.008 INFO:tasks.workunit.client.0.smithi001.stdout:0/920: read d0/d6/d77/d78/f9b [104026,26591] 0 2024-09-15T22:26:59.014 INFO:tasks.workunit.client.0.smithi001.stdout:0/921: dread d0/f2 [0,4194304] 0 2024-09-15T22:26:59.070 INFO:tasks.workunit.client.0.smithi001.stdout:0/922: dwrite d0/d9/d1a/fdc [0,4194304] 0 2024-09-15T22:26:59.070 INFO:tasks.workunit.client.0.smithi001.stdout:0/923: chown d0/d6/c59 68652952 1 2024-09-15T22:26:59.070 INFO:tasks.workunit.client.0.smithi001.stdout:0/924: chown d0/d6/d77/d78/c94 30539214 1 2024-09-15T22:26:59.222 INFO:tasks.workunit.client.0.smithi001.stdout:0/925: symlink d0/l125 0 2024-09-15T22:26:59.222 INFO:tasks.workunit.client.0.smithi001.stdout:0/926: dread - d0/d9/db/d5d/d6d/fcb zero size 2024-09-15T22:26:59.222 INFO:tasks.workunit.client.0.smithi001.stdout:0/927: chown d0/d9/d1a/d36/c8f 5629978 1 2024-09-15T22:26:59.223 INFO:tasks.workunit.client.0.smithi001.stdout:0/928: getdents d0/dd/d93 0 2024-09-15T22:26:59.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:26:58 smithi012 ceph-mon[34883]: pgmap v419: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 170 MiB/s rd, 196 MiB/s wr, 545 op/s 2024-09-15T22:26:59.279 INFO:tasks.workunit.client.0.smithi001.stdout:0/929: dwrite d0/d9/d1a/d36/f41 [0,4194304] 0 2024-09-15T22:26:59.280 INFO:tasks.workunit.client.0.smithi001.stdout:0/930: creat d0/d9/db/dc5/f126 x:0 0 0 2024-09-15T22:26:59.281 INFO:tasks.workunit.client.0.smithi001.stdout:0/931: mknod d0/d6/d77/c127 0 2024-09-15T22:26:59.281 INFO:tasks.workunit.client.0.smithi001.stdout:0/932: fdatasync d0/d9/d1a/d70/faa 0 2024-09-15T22:26:59.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:26:58 smithi098 ceph-mon[35514]: pgmap v419: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 170 MiB/s rd, 196 MiB/s wr, 545 op/s 2024-09-15T22:26:59.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:26:58 smithi001 ceph-mon[30843]: pgmap v419: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 170 MiB/s rd, 196 MiB/s wr, 545 op/s 2024-09-15T22:27:01.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:00 smithi012 ceph-mon[34883]: pgmap v420: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 173 MiB/s rd, 195 MiB/s wr, 544 op/s 2024-09-15T22:27:01.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:00 smithi098 ceph-mon[35514]: pgmap v420: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 173 MiB/s rd, 195 MiB/s wr, 544 op/s 2024-09-15T22:27:01.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:00 smithi001 ceph-mon[30843]: pgmap v420: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 173 MiB/s rd, 195 MiB/s wr, 544 op/s 2024-09-15T22:27:03.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:02 smithi012 ceph-mon[34883]: pgmap v421: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 142 MiB/s rd, 162 MiB/s wr, 521 op/s 2024-09-15T22:27:03.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:02 smithi098 ceph-mon[35514]: pgmap v421: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 142 MiB/s rd, 162 MiB/s wr, 521 op/s 2024-09-15T22:27:03.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:02 smithi001 ceph-mon[30843]: pgmap v421: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 142 MiB/s rd, 162 MiB/s wr, 521 op/s 2024-09-15T22:27:03.383 INFO:tasks.workunit.client.0.smithi001.stdout:0/933: sync 2024-09-15T22:27:03.383 INFO:tasks.workunit.client.0.smithi001.stdout:9/988: sync 2024-09-15T22:27:03.383 INFO:tasks.workunit.client.0.smithi001.stdout:8/927: sync 2024-09-15T22:27:03.383 INFO:tasks.workunit.client.0.smithi001.stdout:8/928: fdatasync d9/d19/d29/d33/fa0 0 2024-09-15T22:27:03.388 INFO:tasks.workunit.client.0.smithi001.stdout:0/934: rename d0/df9 to d0/d9/db/d5d/d79/dc3/de9/d128 0 2024-09-15T22:27:03.388 INFO:tasks.workunit.client.0.smithi001.stdout:9/989: unlink d5/de/d1a/d1b/d22/d2c/d21/d24/d125/dbe/ddd/d120/c12b 0 2024-09-15T22:27:03.390 INFO:tasks.workunit.client.0.smithi001.stdout:8/929: link d9/c24 d9/d19/d34/d41/d105/c107 0 2024-09-15T22:27:03.390 INFO:tasks.workunit.client.0.smithi001.stdout:9/990: creat d5/de/d113/dff/f140 x:0 0 0 2024-09-15T22:27:03.391 INFO:tasks.workunit.client.0.smithi001.stdout:8/930: symlink d9/d19/d34/da4/db7/l108 0 2024-09-15T22:27:03.408 INFO:tasks.workunit.client.0.smithi001.stdout:9/991: write d5/de/d1a/d1b/d22/fe4 [1673358,115750] 0 2024-09-15T22:27:03.408 INFO:tasks.workunit.client.0.smithi001.stdout:9/992: fdatasync d5/f114 0 2024-09-15T22:27:03.415 INFO:tasks.workunit.client.0.smithi001.stdout:8/931: read d9/d19/d34/d41/f4b [1776888,95525] 0 2024-09-15T22:27:03.416 INFO:tasks.workunit.client.0.smithi001.stdout:8/932: truncate d9/d19/d58/f4d 1139050 0 2024-09-15T22:27:03.431 INFO:tasks.workunit.client.0.smithi001.stdout:8/933: dread d9/d19/d58/f4d [0,4194304] 0 2024-09-15T22:27:03.431 INFO:tasks.workunit.client.0.smithi001.stdout:8/934: chown d9/d19/d29/d33/c85 366 1 2024-09-15T22:27:03.431 INFO:tasks.workunit.client.0.smithi001.stdout:8/935: chown d9/d19/d29/d33/c85 287557263 1 2024-09-15T22:27:03.431 INFO:tasks.workunit.client.0.smithi001.stdout:8/936: readlink d9/d19/l51 0 2024-09-15T22:27:03.438 INFO:tasks.workunit.client.0.smithi001.stdout:8/937: dread d9/d19/d34/f43 [4194304,4194304] 0 2024-09-15T22:27:03.475 INFO:tasks.workunit.client.0.smithi001.stdout:8/938: write d9/d19/d58/d8e/d9c/fcd [756632,61010] 0 2024-09-15T22:27:03.475 INFO:tasks.workunit.client.0.smithi001.stdout:8/939: readlink d9/d19/d29/d50/d70/d76/d7d/la6 0 2024-09-15T22:27:03.482 INFO:tasks.workunit.client.0.smithi001.stdout:0/935: dwrite d0/d9/db/d5d/ffa [0,4194304] 0 2024-09-15T22:27:03.484 INFO:tasks.workunit.client.0.smithi001.stdout:8/940: dread d9/d19/d29/d50/d89/f92 [0,4194304] 0 2024-09-15T22:27:03.484 INFO:tasks.workunit.client.0.smithi001.stdout:0/936: mknod d0/d9/d1a/ddb/dcf/deb/c129 0 2024-09-15T22:27:03.486 INFO:tasks.workunit.client.0.smithi001.stdout:8/941: symlink d9/d19/d40/d5f/d61/d9f/l109 0 2024-09-15T22:27:03.487 INFO:tasks.workunit.client.0.smithi001.stdout:0/937: mknod d0/d6/d6a/def/c12a 0 2024-09-15T22:27:03.488 INFO:tasks.workunit.client.0.smithi001.stdout:0/938: symlink d0/d6/l12b 0 2024-09-15T22:27:03.489 INFO:tasks.workunit.client.0.smithi001.stdout:0/939: creat d0/dd/d116/f12c x:0 0 0 2024-09-15T22:27:03.489 INFO:tasks.workunit.client.0.smithi001.stdout:0/940: write d0/d9/db/f19 [1908248,56942] 0 2024-09-15T22:27:03.489 INFO:tasks.workunit.client.0.smithi001.stdout:0/941: write d0/d9/db/dc5/fff [734316,123728] 0 2024-09-15T22:27:03.489 INFO:tasks.workunit.client.0.smithi001.stdout:0/942: dread - d0/d9/db/dc5/f11c zero size 2024-09-15T22:27:03.490 INFO:tasks.workunit.client.0.smithi001.stdout:0/943: symlink d0/d6/d77/l12d 0 2024-09-15T22:27:03.490 INFO:tasks.workunit.client.0.smithi001.stdout:0/944: fsync d0/d9/db/fa7 0 2024-09-15T22:27:03.491 INFO:tasks.workunit.client.0.smithi001.stdout:0/945: rmdir d0/d9/db/d5d/df4 39 2024-09-15T22:27:03.492 INFO:tasks.workunit.client.0.smithi001.stdout:0/946: creat d0/d9/db/f12e x:0 0 0 2024-09-15T22:27:03.493 INFO:tasks.workunit.client.0.smithi001.stdout:0/947: chown d0/d9/f56 3 1 2024-09-15T22:27:03.493 INFO:tasks.workunit.client.0.smithi001.stdout:0/948: write d0/d9/d1a/fe0 [616974,95693] 0 2024-09-15T22:27:03.496 INFO:tasks.workunit.client.0.smithi001.stdout:0/949: mkdir d0/d9/d1a/ddb/d12f 0 2024-09-15T22:27:03.498 INFO:tasks.workunit.client.0.smithi001.stdout:0/950: rmdir d0 39 2024-09-15T22:27:03.499 INFO:tasks.workunit.client.0.smithi001.stdout:0/951: symlink d0/d9/d1a/l130 0 2024-09-15T22:27:03.500 INFO:tasks.workunit.client.0.smithi001.stdout:0/952: write d0/dd/d116/f12c [897108,45552] 0 2024-09-15T22:27:03.513 INFO:tasks.workunit.client.0.smithi001.stdout:0/953: write d0/dd/d93/fcc [2915375,113828] 0 2024-09-15T22:27:03.513 INFO:tasks.workunit.client.0.smithi001.stdout:0/954: write d0/dd/d63/db6/ff6 [405117,25734] 0 2024-09-15T22:27:03.513 INFO:tasks.workunit.client.0.smithi001.stdout:0/955: dread - d0/d6/fbd zero size 2024-09-15T22:27:03.513 INFO:tasks.workunit.client.0.smithi001.stdout:0/956: write d0/d9/db/d5d/d6d/fb4 [1707140,129539] 0 2024-09-15T22:27:03.514 INFO:tasks.workunit.client.0.smithi001.stdout:0/957: creat d0/d9/d1a/f131 x:0 0 0 2024-09-15T22:27:03.516 INFO:tasks.workunit.client.0.smithi001.stdout:0/958: creat d0/dd/d33/dd2/d10c/f132 x:0 0 0 2024-09-15T22:27:03.517 INFO:tasks.workunit.client.0.smithi001.stdout:0/959: truncate d0/d9/d1a/d36/f41 1358715 0 2024-09-15T22:27:03.532 INFO:tasks.workunit.client.0.smithi001.stdout:9/993: sync 2024-09-15T22:27:03.535 INFO:tasks.workunit.client.0.smithi001.stdout:0/960: dread d0/d9/db/d5d/ffa [0,4194304] 0 2024-09-15T22:27:03.536 INFO:tasks.workunit.client.0.smithi001.stdout:0/961: mkdir d0/dd/d63/db6/d133 0 2024-09-15T22:27:03.537 INFO:tasks.workunit.client.0.smithi001.stdout:9/994: rename d5/de/l107 to d5/de/d1a/d1b/d22/d97/l141 0 2024-09-15T22:27:03.537 INFO:tasks.workunit.client.0.smithi001.stdout:0/962: mkdir d0/d6/d77/d134 0 2024-09-15T22:27:03.537 INFO:tasks.workunit.client.0.smithi001.stdout:9/995: fdatasync d5/de/d1a/da8/daf/fc7 0 2024-09-15T22:27:03.538 INFO:tasks.workunit.client.0.smithi001.stdout:9/996: creat d5/de/d15/d27/d63/db6/de5/f142 x:0 0 0 2024-09-15T22:27:03.540 INFO:tasks.workunit.client.0.smithi001.stdout:9/997: mkdir d5/de/d117/d12c/d143 0 2024-09-15T22:27:03.540 INFO:tasks.workunit.client.0.smithi001.stdout:9/998: chown d5/de/d1a/d1b/d22/c26 2299 1 2024-09-15T22:27:03.576 INFO:tasks.workunit.client.0.smithi001.stdout:9/999: dwrite d5/de/d15/d27/dcb/fd1 [0,4194304] 0 2024-09-15T22:27:04.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.447+0000 7f3899200640 1 -- 172.21.15.1:0/2259495590 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3894105760 msgr2=0x7f389410bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:04.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.447+0000 7f3899200640 1 --2- 172.21.15.1:0/2259495590 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3894105760 0x7f389410bff0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f388c009ca0 tx=0x7f388c02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.447+0000 7f3899200640 1 -- 172.21.15.1:0/2259495590 shutdown_connections 2024-09-15T22:27:04.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.447+0000 7f3899200640 1 --2- 172.21.15.1:0/2259495590 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3894105760 0x7f389410bff0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.447+0000 7f3899200640 1 --2- 172.21.15.1:0/2259495590 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3894104da0 0x7f3894105220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.447+0000 7f3899200640 1 --2- 172.21.15.1:0/2259495590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3894103bb0 0x7f3894103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.447+0000 7f3899200640 1 -- 172.21.15.1:0/2259495590 >> 172.21.15.1:0/2259495590 conn(0x7f38940ff310 msgr2=0x7f3894101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.447+0000 7f3899200640 1 -- 172.21.15.1:0/2259495590 shutdown_connections 2024-09-15T22:27:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.447+0000 7f3899200640 1 -- 172.21.15.1:0/2259495590 wait complete. 2024-09-15T22:27:04.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.448+0000 7f3899200640 1 Processor -- start 2024-09-15T22:27:04.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.448+0000 7f3899200640 1 -- start start 2024-09-15T22:27:04.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.448+0000 7f3899200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3894103bb0 0x7f3894199e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:04.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.448+0000 7f3899200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3894104da0 0x7f389419a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:04.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.448+0000 7f3899200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3894105760 0x7f38941a1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:04.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.448+0000 7f3899200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f389410f880 con 0x7f3894104da0 2024-09-15T22:27:04.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.448+0000 7f3899200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f389410f700 con 0x7f3894105760 2024-09-15T22:27:04.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.448+0000 7f3899200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f389410fa00 con 0x7f3894103bb0 2024-09-15T22:27:04.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.449+0000 7f3893400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3894103bb0 0x7f3894199e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.449+0000 7f3893e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3894105760 0x7f38941a1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.449+0000 7f3892a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3894104da0 0x7f389419a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.449+0000 7f3893400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3894103bb0 0x7f3894199e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:59746/0 (socket says 172.21.15.1:59746) 2024-09-15T22:27:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.449+0000 7f3893400640 1 -- 172.21.15.1:0/1603257099 learned_addr learned my addr 172.21.15.1:0/1603257099 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:27:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.449+0000 7f3893e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3894105760 0x7f38941a1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:39440/0 (socket says 172.21.15.1:39440) 2024-09-15T22:27:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.449+0000 7f3892a00640 1 -- 172.21.15.1:0/1603257099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3894103bb0 msgr2=0x7f3894199e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.449+0000 7f3892a00640 1 --2- 172.21.15.1:0/1603257099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3894103bb0 0x7f3894199e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.449+0000 7f3892a00640 1 -- 172.21.15.1:0/1603257099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3894105760 msgr2=0x7f38941a1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.449+0000 7f3892a00640 1 --2- 172.21.15.1:0/1603257099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3894105760 0x7f38941a1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.449+0000 7f3892a00640 1 -- 172.21.15.1:0/1603257099 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38941a1a70 con 0x7f3894104da0 2024-09-15T22:27:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.449+0000 7f3893400640 1 --2- 172.21.15.1:0/1603257099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3894103bb0 0x7f3894199e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:27:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.449+0000 7f3892a00640 1 --2- 172.21.15.1:0/1603257099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3894104da0 0x7f389419a390 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f388000e9f0 tx=0x7f388000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.449+0000 7f388be00640 1 -- 172.21.15.1:0/1603257099 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388000ccc0 con 0x7f3894104da0 2024-09-15T22:27:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.450+0000 7f388be00640 1 -- 172.21.15.1:0/1603257099 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3880005020 con 0x7f3894104da0 2024-09-15T22:27:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.450+0000 7f3899200640 1 -- 172.21.15.1:0/1603257099 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38941a1d60 con 0x7f3894104da0 2024-09-15T22:27:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.450+0000 7f388be00640 1 -- 172.21.15.1:0/1603257099 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38800049e0 con 0x7f3894104da0 2024-09-15T22:27:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.450+0000 7f3899200640 1 -- 172.21.15.1:0/1603257099 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38941a2200 con 0x7f3894104da0 2024-09-15T22:27:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.453+0000 7f389d66d740 1 Processor -- start 2024-09-15T22:27:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.453+0000 7f389d66d740 1 -- start start 2024-09-15T22:27:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.453+0000 7f389d66d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649b2aed260 0x5649b2aed660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.453+0000 7f389d66d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649b2aedba0 0x5649b2af2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.453+0000 7f389d66d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649b2af2c30 0x5649b2af50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.453+0000 7f389d66d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5649b2a52100 con 0x5649b2aedba0 2024-09-15T22:27:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.453+0000 7f389d66d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5649b29fa1b0 con 0x5649b2aed260 2024-09-15T22:27:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.453+0000 7f389d66d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5649b2a4e0c0 con 0x5649b2af2c30 2024-09-15T22:27:04.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.453+0000 7f3893400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649b2aedba0 0x5649b2af2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:04.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.453+0000 7f3893400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649b2aedba0 0x5649b2af2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44372/0 (socket says 172.21.15.1:44372) 2024-09-15T22:27:04.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.453+0000 7f3893400640 1 -- 172.21.15.1:0/2058736575 learned_addr learned my addr 172.21.15.1:0/2058736575 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:27:04.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.453+0000 7f3893e00640 1 --2- 172.21.15.1:0/2058736575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649b2aed260 0x5649b2aed660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:04.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.453+0000 7f388be00640 1 -- 172.21.15.1:0/1603257099 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f3880005560 con 0x7f3894104da0 2024-09-15T22:27:04.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.454+0000 7f3893e00640 1 -- 172.21.15.1:0/2058736575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649b2af2c30 msgr2=0x5649b2af50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:04.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.454+0000 7f3893e00640 1 --2- 172.21.15.1:0/2058736575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649b2af2c30 0x5649b2af50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.454+0000 7f3893e00640 1 -- 172.21.15.1:0/2058736575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649b2aedba0 msgr2=0x5649b2af2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:04.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.454+0000 7f3893e00640 1 --2- 172.21.15.1:0/2058736575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649b2aedba0 0x5649b2af2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.454+0000 7f3893e00640 1 -- 172.21.15.1:0/2058736575 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649b2765210 con 0x5649b2aed260 2024-09-15T22:27:04.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.454+0000 7f3893400640 1 --2- 172.21.15.1:0/2058736575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649b2aedba0 0x5649b2af2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:27:04.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.454+0000 7f3893e00640 1 --2- 172.21.15.1:0/2058736575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649b2aed260 0x5649b2aed660 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f388c02ade0 tx=0x7f388c0093c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8891487fd21a8afb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:04.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.454+0000 7f3888c00640 1 -- 172.21.15.1:0/2058736575 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c031650 con 0x5649b2aed260 2024-09-15T22:27:04.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.454+0000 7f3888c00640 1 -- 172.21.15.1:0/2058736575 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f388c036030 con 0x5649b2aed260 2024-09-15T22:27:04.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.454+0000 7f3888c00640 1 -- 172.21.15.1:0/2058736575 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c004680 con 0x5649b2aed260 2024-09-15T22:27:04.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.455+0000 7f388be00640 1 --2- 172.21.15.1:0/1603257099 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f38780a3230 0x7f38780a56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:04.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.455+0000 7f388be00640 1 -- 172.21.15.1:0/1603257099 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f38800cf950 con 0x7f3894104da0 2024-09-15T22:27:04.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.455+0000 7f3893400640 1 --2- 172.21.15.1:0/1603257099 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f38780a3230 0x7f38780a56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:04.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.455+0000 7f389d66d740 1 -- 172.21.15.1:0/2058736575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649b2aed260 msgr2=0x5649b2aed660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:04.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.455+0000 7f389d66d740 1 --2- 172.21.15.1:0/2058736575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649b2aed260 0x5649b2aed660 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f388c02ade0 tx=0x7f388c0093c0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.455+0000 7f389d66d740 1 -- 172.21.15.1:0/2058736575 shutdown_connections 2024-09-15T22:27:04.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.455+0000 7f389d66d740 1 --2- 172.21.15.1:0/2058736575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649b2af2c30 0x5649b2af50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.455+0000 7f389d66d740 1 --2- 172.21.15.1:0/2058736575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649b2aedba0 0x5649b2af2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.455+0000 7f389d66d740 1 --2- 172.21.15.1:0/2058736575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649b2aed260 0x5649b2aed660 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.455+0000 7f389d66d740 1 -- 172.21.15.1:0/2058736575 >> 172.21.15.1:0/2058736575 conn(0x5649b2ae88d0 msgr2=0x5649b2ae8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:04.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.455+0000 7f389d66d740 1 -- 172.21.15.1:0/2058736575 shutdown_connections 2024-09-15T22:27:04.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.455+0000 7f389d66d740 1 -- 172.21.15.1:0/2058736575 wait complete. 2024-09-15T22:27:04.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.456+0000 7f3893400640 1 --2- 172.21.15.1:0/1603257099 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f38780a3230 0x7f38780a56f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x5649b2ae9750 tx=0x7f3884005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:04.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.456+0000 7f389d66d740 1 -- start start 2024-09-15T22:27:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.456+0000 7f389d66d740 1 Processor -- start 2024-09-15T22:27:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.457+0000 7f389d66d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649b2aed260 0x5649b2af7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.457+0000 7f389d66d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649b2aedba0 0x5649b2af77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.457+0000 7f389d66d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649b2af2c30 0x5649b2afe7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.457+0000 7f389d66d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5649b2af5a20 con 0x5649b2af2c30 2024-09-15T22:27:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.457+0000 7f389d66d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5649b29db090 con 0x5649b2aed260 2024-09-15T22:27:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.457+0000 7f389d66d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5649b2af5ba0 con 0x5649b2aedba0 2024-09-15T22:27:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.457+0000 7f389d66d740 10 client.0 _ll_register_callbacks cb 0x5649b2a2ff30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:27:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.457+0000 7f3893400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649b2aed260 0x5649b2af7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.457+0000 7f3893e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649b2af2c30 0x5649b2afe7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.457+0000 7f3893400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649b2aed260 0x5649b2af7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:39454/0 (socket says 172.21.15.1:39454) 2024-09-15T22:27:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.457+0000 7f3893400640 1 -- 172.21.15.1:0/3867098836 learned_addr learned my addr 172.21.15.1:0/3867098836 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:27:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.457+0000 7f3892a00640 1 --2- 172.21.15.1:0/3867098836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649b2aedba0 0x5649b2af77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.457+0000 7f3893400640 1 -- 172.21.15.1:0/3867098836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649b2aedba0 msgr2=0x5649b2af77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.457+0000 7f3893400640 1 --2- 172.21.15.1:0/3867098836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649b2aedba0 0x5649b2af77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.457+0000 7f3893400640 1 -- 172.21.15.1:0/3867098836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649b2af2c30 msgr2=0x5649b2afe7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.457+0000 7f3893400640 1 --2- 172.21.15.1:0/3867098836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649b2af2c30 0x5649b2afe7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.457+0000 7f3893400640 1 -- 172.21.15.1:0/3867098836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649b2831620 con 0x5649b2aed260 2024-09-15T22:27:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.457+0000 7f3893e00640 1 --2- 172.21.15.1:0/3867098836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649b2af2c30 0x5649b2afe7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:27:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.458+0000 7f3893400640 1 --2- 172.21.15.1:0/3867098836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649b2aed260 0x5649b2af7260 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3884012fd0 tx=0x7f3884004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db26713a0510da0c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.458+0000 7f387d600640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-15T22:27:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.458+0000 7f387d600640 1 -- 172.21.15.1:0/3867098836 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38840119c0 con 0x5649b2aed260 2024-09-15T22:27:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.458+0000 7f389d66d740 1 -- 172.21.15.1:0/3867098836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f388c036030 con 0x5649b2aed260 2024-09-15T22:27:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.458+0000 7f387d600640 1 -- 172.21.15.1:0/3867098836 <== mon.2 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f3884011b60 con 0x5649b2aed260 2024-09-15T22:27:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.458+0000 7f387d600640 1 -- 172.21.15.1:0/3867098836 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3884011d60 con 0x5649b2aed260 2024-09-15T22:27:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.458+0000 7f389d66d740 10 client.25193 fetch_fsmap learned FSMap version 27 2024-09-15T22:27:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.458+0000 7f389d66d740 1 -- 172.21.15.1:0/3867098836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5649b2b016f0 con 0x5649b2aed260 2024-09-15T22:27:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.459+0000 7f387d600640 1 -- 172.21.15.1:0/3867098836 <== mon.2 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f388c036030 con 0x5649b2aed260 2024-09-15T22:27:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.459+0000 7f387d600640 1 -- 172.21.15.1:0/3867098836 <== mon.2 v2:172.21.15.12:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f3884030020 con 0x5649b2aed260 2024-09-15T22:27:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.459+0000 7f389d66d740 10 client.25193 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:27:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.459+0000 7f389d66d740 10 client.25193 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T22:27:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.459+0000 7f389d66d740 20 client.25193 populate_metadata read hostname 'smithi001' 2024-09-15T22:27:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.459+0000 7f389d66d740 1 --2- 172.21.15.1:0/3867098836 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x5649b2b02e20 0x5649b2b052a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.459+0000 7f389d66d740 4 client.25193 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:27:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.459+0000 7f389d66d740 1 -- 172.21.15.1:0/3867098836 --> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5649b2a5f830 con 0x5649b2b02e20 2024-09-15T22:27:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.459+0000 7f3892a00640 1 --2- 172.21.15.1:0/3867098836 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x5649b2b02e20 0x5649b2b052a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.460+0000 7f3892a00640 1 --2- 172.21.15.1:0/3867098836 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x5649b2b02e20 0x5649b2b052a0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3176a89804c9143 server_cookie=58fc290941e51b1f in_seq=0 out_seq=0 2024-09-15T22:27:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.460+0000 7f387d600640 10 client.25193 ms_handle_connect on v2:172.21.15.98:6838/2831161859 2024-09-15T22:27:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.461+0000 7f387d600640 1 -- 172.21.15.1:0/3867098836 <== mds.0 v2:172.21.15.98:6838/2831161859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5649b2a5f830 con 0x5649b2b02e20 2024-09-15T22:27:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.461+0000 7f387d600640 10 client.25193 handle_command_reply: tid=0 2024-09-15T22:27:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.461+0000 7f389d66d740 1 client.25193 shutdown 2024-09-15T22:27:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.461+0000 7f389d66d740 1 -- 172.21.15.1:0/3867098836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649b2aed260 msgr2=0x5649b2af7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.461+0000 7f389d66d740 1 --2- 172.21.15.1:0/3867098836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649b2aed260 0x5649b2af7260 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3884012fd0 tx=0x7f3884004730 comp rx=0 tx=0).stop 2024-09-15T22:27:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.461+0000 7f389d66d740 1 -- 172.21.15.1:0/3867098836 shutdown_connections 2024-09-15T22:27:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.461+0000 7f389d66d740 1 --2- 172.21.15.1:0/3867098836 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x5649b2b02e20 0x5649b2b052a0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.461+0000 7f389d66d740 1 --2- 172.21.15.1:0/3867098836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649b2af2c30 0x5649b2afe7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.461+0000 7f389d66d740 1 --2- 172.21.15.1:0/3867098836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649b2aedba0 0x5649b2af77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.461+0000 7f389d66d740 1 --2- 172.21.15.1:0/3867098836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649b2aed260 0x5649b2af7260 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.461+0000 7f387d600640 0 client.25193 ms_handle_reset on v2:172.21.15.98:6838/2831161859 2024-09-15T22:27:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.461+0000 7f389d66d740 1 -- 172.21.15.1:0/3867098836 >> 172.21.15.1:0/3867098836 conn(0x5649b2ae88d0 msgr2=0x5649b2aea0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.461+0000 7f389d66d740 1 -- 172.21.15.1:0/3867098836 shutdown_connections 2024-09-15T22:27:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.461+0000 7f389d66d740 1 -- 172.21.15.1:0/3867098836 wait complete. 2024-09-15T22:27:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.461+0000 7f389d66d740 20 client.25193 trim_cache size 0 max 16384 2024-09-15T22:27:04.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.476+0000 7f389d66d740 1 Processor -- start 2024-09-15T22:27:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.476+0000 7f389d66d740 1 -- start start 2024-09-15T22:27:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.477+0000 7f389d66d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649b2aed260 0x5649b2af7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.477+0000 7f389d66d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649b2aedba0 0x5649b2afe700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.477+0000 7f389d66d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649b2af2c30 0x5649b2ae7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.477+0000 7f389d66d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f38941ad9f0 con 0x5649b2af2c30 2024-09-15T22:27:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.477+0000 7f389d66d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f38941ab2c0 con 0x5649b2aedba0 2024-09-15T22:27:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.477+0000 7f389d66d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f38941a9110 con 0x5649b2aed260 2024-09-15T22:27:04.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.477+0000 7f3893e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649b2af2c30 0x5649b2ae7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:04.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.477+0000 7f3893e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649b2af2c30 0x5649b2ae7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44400/0 (socket says 172.21.15.1:44400) 2024-09-15T22:27:04.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.477+0000 7f3893e00640 1 -- 172.21.15.1:0/1436670845 learned_addr learned my addr 172.21.15.1:0/1436670845 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:27:04.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.477+0000 7f3892a00640 1 --2- 172.21.15.1:0/1436670845 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649b2aedba0 0x5649b2afe700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:04.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.477+0000 7f3893400640 1 --2- 172.21.15.1:0/1436670845 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649b2aed260 0x5649b2af7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:04.483 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.477+0000 7f3893e00640 1 -- 172.21.15.1:0/1436670845 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649b2aed260 msgr2=0x5649b2af7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:04.483 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.477+0000 7f3893e00640 1 --2- 172.21.15.1:0/1436670845 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649b2aed260 0x5649b2af7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.483 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.477+0000 7f3893e00640 1 -- 172.21.15.1:0/1436670845 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649b2aedba0 msgr2=0x5649b2afe700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:04.483 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.477+0000 7f3893e00640 1 --2- 172.21.15.1:0/1436670845 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649b2aedba0 0x5649b2afe700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.483 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.477+0000 7f3893e00640 1 -- 172.21.15.1:0/1436670845 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649b2aee080 con 0x5649b2af2c30 2024-09-15T22:27:04.483 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.477+0000 7f3892a00640 1 --2- 172.21.15.1:0/1436670845 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649b2aedba0 0x5649b2afe700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:27:04.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.478+0000 7f3893e00640 1 --2- 172.21.15.1:0/1436670845 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649b2af2c30 0x5649b2ae7900 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f388c02ade0 tx=0x7f388c005bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d741a3b6cfd6e28 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:04.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.478+0000 7f387fe00640 1 -- 172.21.15.1:0/1436670845 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c04a040 con 0x5649b2af2c30 2024-09-15T22:27:04.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.478+0000 7f387fe00640 1 -- 172.21.15.1:0/1436670845 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f388c036040 con 0x5649b2af2c30 2024-09-15T22:27:04.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.478+0000 7f387fe00640 1 -- 172.21.15.1:0/1436670845 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c003970 con 0x5649b2af2c30 2024-09-15T22:27:04.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.479+0000 7f389d66d740 1 -- 172.21.15.1:0/1436670845 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649b2af2c30 msgr2=0x5649b2ae7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:04.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.479+0000 7f389d66d740 1 --2- 172.21.15.1:0/1436670845 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649b2af2c30 0x5649b2ae7900 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f388c02ade0 tx=0x7f388c005bf0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.479+0000 7f389d66d740 1 -- 172.21.15.1:0/1436670845 shutdown_connections 2024-09-15T22:27:04.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.479+0000 7f389d66d740 1 --2- 172.21.15.1:0/1436670845 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649b2af2c30 0x5649b2ae7900 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.479+0000 7f389d66d740 1 --2- 172.21.15.1:0/1436670845 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649b2aedba0 0x5649b2afe700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.479+0000 7f389d66d740 1 --2- 172.21.15.1:0/1436670845 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649b2aed260 0x5649b2af7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.479+0000 7f389d66d740 1 -- 172.21.15.1:0/1436670845 >> 172.21.15.1:0/1436670845 conn(0x5649b2ae88d0 msgr2=0x5649b2ae71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:04.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.479+0000 7f389d66d740 1 -- 172.21.15.1:0/1436670845 shutdown_connections 2024-09-15T22:27:04.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.479+0000 7f389d66d740 1 -- 172.21.15.1:0/1436670845 wait complete. 2024-09-15T22:27:04.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.479+0000 7f389d66d740 1 -- start start 2024-09-15T22:27:04.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.479+0000 7f389d66d740 1 Processor -- start 2024-09-15T22:27:04.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.480+0000 7f389d66d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649b2aed260 0x5649b2afbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:04.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.480+0000 7f389d66d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649b2aedba0 0x5649b2afc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:04.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.480+0000 7f389d66d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649b2af2c30 0x5649b2afd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:04.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.480+0000 7f389d66d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f38941a9780 con 0x5649b2aed260 2024-09-15T22:27:04.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.480+0000 7f389d66d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f38941aabf0 con 0x5649b2aedba0 2024-09-15T22:27:04.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.480+0000 7f389d66d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f38941a9e50 con 0x5649b2af2c30 2024-09-15T22:27:04.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.480+0000 7f389d66d740 10 client.0 _ll_register_callbacks cb 0x7f3884012e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:27:04.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.480+0000 7f3893400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649b2aed260 0x5649b2afbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:04.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.480+0000 7f3893400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649b2aed260 0x5649b2afbfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44408/0 (socket says 172.21.15.1:44408) 2024-09-15T22:27:04.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.480+0000 7f3893400640 1 -- 172.21.15.1:0/1984248580 learned_addr learned my addr 172.21.15.1:0/1984248580 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:27:04.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.480+0000 7f3892a00640 1 --2- 172.21.15.1:0/1984248580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649b2aedba0 0x5649b2afc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:04.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.480+0000 7f3893e00640 1 --2- 172.21.15.1:0/1984248580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649b2af2c30 0x5649b2afd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:04.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.480+0000 7f3893400640 1 -- 172.21.15.1:0/1984248580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649b2af2c30 msgr2=0x5649b2afd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.480+0000 7f3893400640 1 --2- 172.21.15.1:0/1984248580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649b2af2c30 0x5649b2afd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.480+0000 7f3893400640 1 -- 172.21.15.1:0/1984248580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649b2aedba0 msgr2=0x5649b2afc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.480+0000 7f3893400640 1 --2- 172.21.15.1:0/1984248580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649b2aedba0 0x5649b2afc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.480+0000 7f3893400640 1 -- 172.21.15.1:0/1984248580 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649b2afdb20 con 0x5649b2aed260 2024-09-15T22:27:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.480+0000 7f3892a00640 1 --2- 172.21.15.1:0/1984248580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649b2aedba0 0x5649b2afc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:27:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.481+0000 7f3893400640 1 --2- 172.21.15.1:0/1984248580 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649b2aed260 0x5649b2afbfc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f38840058c0 tx=0x7f3884012440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cfa8be95606b670 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.481+0000 7f387d600640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-15T22:27:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.481+0000 7f387d600640 1 -- 172.21.15.1:0/1984248580 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3884005bf0 con 0x5649b2aed260 2024-09-15T22:27:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.481+0000 7f389d66d740 1 -- 172.21.15.1:0/1984248580 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f388c036040 con 0x5649b2aed260 2024-09-15T22:27:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.481+0000 7f387d600640 1 -- 172.21.15.1:0/1984248580 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f38840049b0 con 0x5649b2aed260 2024-09-15T22:27:04.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.481+0000 7f387d600640 1 -- 172.21.15.1:0/1984248580 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3884004bb0 con 0x5649b2aed260 2024-09-15T22:27:04.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.481+0000 7f389d66d740 10 client.15201 fetch_fsmap learned FSMap version 27 2024-09-15T22:27:04.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.481+0000 7f389d66d740 1 -- 172.21.15.1:0/1984248580 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5649b2b6dd30 con 0x5649b2aed260 2024-09-15T22:27:04.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.481+0000 7f387d600640 1 -- 172.21.15.1:0/1984248580 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f388c036040 con 0x5649b2aed260 2024-09-15T22:27:04.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.482+0000 7f387d600640 1 -- 172.21.15.1:0/1984248580 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f3884030070 con 0x5649b2aed260 2024-09-15T22:27:04.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.482+0000 7f389d66d740 10 client.15201 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:27:04.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.482+0000 7f389d66d740 10 client.15201 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T22:27:04.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.482+0000 7f389d66d740 20 client.15201 populate_metadata read hostname 'smithi001' 2024-09-15T22:27:04.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.482+0000 7f389d66d740 1 --2- 172.21.15.1:0/1984248580 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x5649b2b6e710 0x5649b2b70b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:04.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.482+0000 7f389d66d740 4 client.15201 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:27:04.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.482+0000 7f389d66d740 1 -- 172.21.15.1:0/1984248580 --> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5649b2ae3c80 con 0x5649b2b6e710 2024-09-15T22:27:04.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.482+0000 7f3892a00640 1 --2- 172.21.15.1:0/1984248580 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x5649b2b6e710 0x5649b2b70b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:04.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.483+0000 7f3892a00640 1 --2- 172.21.15.1:0/1984248580 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x5649b2b6e710 0x5649b2b70b30 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e98058522c75750 server_cookie=9f031c7c8e7c603 in_seq=0 out_seq=0 2024-09-15T22:27:04.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.483+0000 7f387d600640 10 client.15201 ms_handle_connect on v2:172.21.15.98:6838/2831161859 2024-09-15T22:27:04.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.600+0000 7f387d600640 1 -- 172.21.15.1:0/1984248580 <== mds.0 v2:172.21.15.98:6838/2831161859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5649b2ae3c80 con 0x5649b2b6e710 2024-09-15T22:27:04.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.600+0000 7f387d600640 10 client.15201 handle_command_reply: tid=0 2024-09-15T22:27:04.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.600+0000 7f389d66d740 1 client.15201 shutdown 2024-09-15T22:27:04.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.600+0000 7f389d66d740 1 -- 172.21.15.1:0/1984248580 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649b2aed260 msgr2=0x5649b2afbfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:04.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.600+0000 7f389d66d740 1 --2- 172.21.15.1:0/1984248580 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649b2aed260 0x5649b2afbfc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f38840058c0 tx=0x7f3884012440 comp rx=0 tx=0).stop 2024-09-15T22:27:04.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.600+0000 7f389d66d740 1 -- 172.21.15.1:0/1984248580 shutdown_connections 2024-09-15T22:27:04.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.600+0000 7f389d66d740 1 --2- 172.21.15.1:0/1984248580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649b2af2c30 0x5649b2afd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.600+0000 7f389d66d740 1 --2- 172.21.15.1:0/1984248580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649b2aedba0 0x5649b2afc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.600+0000 7f389d66d740 1 --2- 172.21.15.1:0/1984248580 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x5649b2b6e710 0x5649b2b70b30 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.600+0000 7f389d66d740 1 --2- 172.21.15.1:0/1984248580 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5649b2aed260 0x5649b2afbfc0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.600+0000 7f389d66d740 1 -- 172.21.15.1:0/1984248580 >> 172.21.15.1:0/1984248580 conn(0x5649b2ae88d0 msgr2=0x5649b2ae7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:04.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.600+0000 7f387d600640 0 client.15201 ms_handle_reset on v2:172.21.15.98:6838/2831161859 2024-09-15T22:27:04.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.600+0000 7f389d66d740 1 -- 172.21.15.1:0/1984248580 shutdown_connections 2024-09-15T22:27:04.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.600+0000 7f389d66d740 1 -- 172.21.15.1:0/1984248580 wait complete. 2024-09-15T22:27:04.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.600+0000 7f389d66d740 20 client.15201 trim_cache size 0 max 16384 2024-09-15T22:27:04.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-15T22:27:04.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-15T22:27:04.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-15T22:27:04.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-15T22:27:04.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.601+0000 7f3899200640 1 -- 172.21.15.1:0/1603257099 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f38780a3230 msgr2=0x7f38780a56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:04.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.601+0000 7f3899200640 1 --2- 172.21.15.1:0/1603257099 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f38780a3230 0x7f38780a56f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x5649b2ae9750 tx=0x7f3884005f90 comp rx=0 tx=0).stop 2024-09-15T22:27:04.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.601+0000 7f3899200640 1 -- 172.21.15.1:0/1603257099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3894104da0 msgr2=0x7f389419a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:04.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.601+0000 7f3899200640 1 --2- 172.21.15.1:0/1603257099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3894104da0 0x7f389419a390 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f388000e9f0 tx=0x7f388000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.601+0000 7f3899200640 1 -- 172.21.15.1:0/1603257099 shutdown_connections 2024-09-15T22:27:04.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.601+0000 7f3899200640 1 --2- 172.21.15.1:0/1603257099 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f38780a3230 0x7f38780a56f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.601+0000 7f3899200640 1 --2- 172.21.15.1:0/1603257099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3894105760 0x7f38941a1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.601+0000 7f3899200640 1 --2- 172.21.15.1:0/1603257099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3894104da0 0x7f389419a390 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.601+0000 7f3899200640 1 --2- 172.21.15.1:0/1603257099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3894103bb0 0x7f3894199e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.601+0000 7f3899200640 1 -- 172.21.15.1:0/1603257099 >> 172.21.15.1:0/1603257099 conn(0x7f38940ff310 msgr2=0x7f38941080a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:04.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.601+0000 7f3899200640 1 -- 172.21.15.1:0/1603257099 shutdown_connections 2024-09-15T22:27:04.605 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:04.601+0000 7f3899200640 1 -- 172.21.15.1:0/1603257099 wait complete. 2024-09-15T22:27:05.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:04 smithi012 ceph-mon[34883]: pgmap v422: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 90 MiB/s rd, 105 MiB/s wr, 412 op/s 2024-09-15T22:27:05.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:04 smithi098 ceph-mon[35514]: pgmap v422: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 90 MiB/s rd, 105 MiB/s wr, 412 op/s 2024-09-15T22:27:05.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:04 smithi001 ceph-mon[30843]: pgmap v422: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 90 MiB/s rd, 105 MiB/s wr, 412 op/s 2024-09-15T22:27:07.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:06 smithi012 ceph-mon[34883]: pgmap v423: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 92 MiB/s rd, 106 MiB/s wr, 467 op/s 2024-09-15T22:27:07.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:06 smithi098 ceph-mon[35514]: pgmap v423: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 92 MiB/s rd, 106 MiB/s wr, 467 op/s 2024-09-15T22:27:07.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:06 smithi001 ceph-mon[30843]: pgmap v423: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 92 MiB/s rd, 106 MiB/s wr, 467 op/s 2024-09-15T22:27:08.374 INFO:tasks.workunit.client.0.smithi001.stdout:8/942: sync 2024-09-15T22:27:08.374 INFO:tasks.workunit.client.0.smithi001.stdout:0/963: sync 2024-09-15T22:27:08.374 INFO:tasks.workunit.client.0.smithi001.stdout:0/964: chown d0/dd/d63/db6 842 1 2024-09-15T22:27:08.375 INFO:tasks.workunit.client.0.smithi001.stdout:8/943: dread - d9/d19/d40/d5f/fbc zero size 2024-09-15T22:27:08.375 INFO:tasks.workunit.client.0.smithi001.stdout:8/944: fsync d9/d19/d29/f2a 0 2024-09-15T22:27:08.398 INFO:tasks.workunit.client.0.smithi001.stdout:8/945: write d9/d19/d29/f45 [3240278,27352] 0 2024-09-15T22:27:08.400 INFO:tasks.workunit.client.0.smithi001.stdout:8/946: symlink d9/l10a 0 2024-09-15T22:27:08.400 INFO:tasks.workunit.client.0.smithi001.stdout:0/965: dread d0/dd/d93/fc0 [0,4194304] 0 2024-09-15T22:27:08.400 INFO:tasks.workunit.client.0.smithi001.stdout:0/966: dread - d0/d6/d6a/def/ff8 zero size 2024-09-15T22:27:08.401 INFO:tasks.workunit.client.0.smithi001.stdout:8/947: symlink d9/d19/d29/d50/d70/l10b 0 2024-09-15T22:27:08.402 INFO:tasks.workunit.client.0.smithi001.stdout:8/948: symlink d9/d19/d40/d9e/dd0/l10c 0 2024-09-15T22:27:08.402 INFO:tasks.workunit.client.0.smithi001.stdout:8/949: fdatasync d9/d19/d34/d41/f6e 0 2024-09-15T22:27:08.420 INFO:tasks.workunit.client.0.smithi001.stdout:8/950: mkdir d9/d19/d29/d50/d10d 0 2024-09-15T22:27:08.428 INFO:tasks.workunit.client.0.smithi001.stdout:8/951: write d9/d19/d34/d41/fe2 [669511,91656] 0 2024-09-15T22:27:08.431 INFO:tasks.workunit.client.0.smithi001.stdout:8/952: link d9/d19/d29/d50/d70/fb2 d9/d19/d34/d41/d104/dcb/f10e 0 2024-09-15T22:27:08.431 INFO:tasks.workunit.client.0.smithi001.stdout:8/953: getdents d9/d19/d58/d88 0 2024-09-15T22:27:08.433 INFO:tasks.workunit.client.0.smithi001.stdout:8/954: truncate d9/d19/d58/d8e/d9c/fce 819641 0 2024-09-15T22:27:08.433 INFO:tasks.workunit.client.0.smithi001.stdout:8/955: write d9/d19/d29/d50/f73 [1262746,61477] 0 2024-09-15T22:27:08.434 INFO:tasks.workunit.client.0.smithi001.stdout:8/956: creat d9/d19/d34/da4/f10f x:0 0 0 2024-09-15T22:27:08.439 INFO:tasks.workunit.client.0.smithi001.stdout:0/967: dwrite d0/d84/fdd [0,4194304] 0 2024-09-15T22:27:08.441 INFO:tasks.workunit.client.0.smithi001.stdout:0/968: mknod d0/d9/d1a/ddb/d12f/c135 0 2024-09-15T22:27:08.452 INFO:tasks.workunit.client.0.smithi001.stdout:0/969: dread d0/d51/f7d [0,4194304] 0 2024-09-15T22:27:08.452 INFO:tasks.workunit.client.0.smithi001.stdout:0/970: fdatasync d0/dd/ff7 0 2024-09-15T22:27:08.452 INFO:tasks.workunit.client.0.smithi001.stdout:0/971: truncate d0/d6/f2a 3355966 0 2024-09-15T22:27:08.452 INFO:tasks.workunit.client.0.smithi001.stdout:0/972: dread - d0/d6/fbd zero size 2024-09-15T22:27:08.507 INFO:tasks.workunit.client.0.smithi001.stdout:0/973: dwrite d0/dd/d63/db6/ff6 [0,4194304] 0 2024-09-15T22:27:08.513 INFO:tasks.workunit.client.0.smithi001.stdout:8/957: dwrite d9/d19/f77 [0,4194304] 0 2024-09-15T22:27:08.514 INFO:tasks.workunit.client.0.smithi001.stdout:8/958: mkdir d9/d19/d40/d5f/d61/d9f/db3/d110 0 2024-09-15T22:27:08.535 INFO:tasks.workunit.client.0.smithi001.stdout:8/959: write d9/d19/d58/f4e [3675184,114620] 0 2024-09-15T22:27:08.535 INFO:tasks.workunit.client.0.smithi001.stdout:8/960: stat d9/d19/d58/d88/fe9 0 2024-09-15T22:27:08.535 INFO:tasks.workunit.client.0.smithi001.stdout:8/961: fdatasync d9/d19/d40/d5f/fbc 0 2024-09-15T22:27:08.558 INFO:tasks.workunit.client.0.smithi001.stdout:0/974: dwrite d0/dd/d33/f5b [4194304,4194304] 0 2024-09-15T22:27:08.558 INFO:tasks.workunit.client.0.smithi001.stdout:0/975: chown d0/d9/d1a/ddb/dcf/fd9 115 1 2024-09-15T22:27:08.558 INFO:tasks.workunit.client.0.smithi001.stdout:0/976: truncate d0/d6/f30 5197321 0 2024-09-15T22:27:08.559 INFO:tasks.workunit.client.0.smithi001.stdout:0/977: symlink d0/d6/dae/l136 0 2024-09-15T22:27:08.566 INFO:tasks.workunit.client.0.smithi001.stdout:0/978: dread d0/d6/d77/d78/f9b [0,4194304] 0 2024-09-15T22:27:08.566 INFO:tasks.workunit.client.0.smithi001.stdout:0/979: truncate d0/d9/db/d5d/df4/f11d 550777 0 2024-09-15T22:27:08.577 INFO:tasks.workunit.client.0.smithi001.stdout:0/980: dread d0/d9/f1c [0,4194304] 0 2024-09-15T22:27:08.580 INFO:tasks.workunit.client.0.smithi001.stdout:0/981: rename d0/c107 to d0/d9/c137 0 2024-09-15T22:27:08.580 INFO:tasks.workunit.client.0.smithi001.stdout:0/982: write d0/d9/db/fda [901596,97875] 0 2024-09-15T22:27:08.582 INFO:tasks.workunit.client.0.smithi001.stdout:0/983: getdents d0/d9/db 0 2024-09-15T22:27:08.584 INFO:tasks.workunit.client.0.smithi001.stdout:0/984: link d0/d9/db/d5d/d79/fa0 d0/d6/d6a/f138 0 2024-09-15T22:27:08.585 INFO:tasks.workunit.client.0.smithi001.stdout:0/985: symlink d0/d9/db/dc5/l139 0 2024-09-15T22:27:08.588 INFO:tasks.workunit.client.0.smithi001.stdout:0/986: truncate d0/d9/db/d5d/d79/dc3/fe5 818373 0 2024-09-15T22:27:08.588 INFO:tasks.workunit.client.0.smithi001.stdout:0/987: chown d0/d9/d1a/d36/lce 449 1 2024-09-15T22:27:08.590 INFO:tasks.workunit.client.0.smithi001.stdout:0/988: creat d0/d6/d6a/def/d118/f13a x:0 0 0 2024-09-15T22:27:08.591 INFO:tasks.workunit.client.0.smithi001.stdout:0/989: unlink d0/dd/d63/c114 0 2024-09-15T22:27:08.592 INFO:tasks.workunit.client.0.smithi001.stdout:0/990: fsync d0/d6/d77/ff3 0 2024-09-15T22:27:08.592 INFO:tasks.workunit.client.0.smithi001.stdout:0/991: chown d0/cc 101007103 1 2024-09-15T22:27:08.594 INFO:tasks.workunit.client.0.smithi001.stdout:0/992: getdents d0/d6 0 2024-09-15T22:27:08.602 INFO:tasks.workunit.client.0.smithi001.stdout:0/993: write d0/dd/d63/f97 [167405,69935] 0 2024-09-15T22:27:08.602 INFO:tasks.workunit.client.0.smithi001.stdout:0/994: readlink d0/d9/d1a/d36/l57 0 2024-09-15T22:27:08.604 INFO:tasks.workunit.client.0.smithi001.stdout:0/995: rename d0/d6/d6a/cf5 to d0/d9/db/dc5/c13b 0 2024-09-15T22:27:08.606 INFO:tasks.workunit.client.0.smithi001.stdout:0/996: mkdir d0/d6/d6a/def/d118/d13c 0 2024-09-15T22:27:08.606 INFO:tasks.workunit.client.0.smithi001.stdout:0/997: readlink d0/dd/d33/dd2/l102 0 2024-09-15T22:27:08.607 INFO:tasks.workunit.client.0.smithi001.stdout:0/998: rmdir d0/dd/d93 39 2024-09-15T22:27:08.607 INFO:tasks.workunit.client.0.smithi001.stdout:0/999: fsync d0/dd/d116/f12c 0 2024-09-15T22:27:08.716 INFO:tasks.workunit.client.0.smithi001.stdout:8/962: sync 2024-09-15T22:27:08.770 INFO:tasks.workunit.client.0.smithi001.stdout:8/963: dwrite d9/d19/d40/f57 [0,4194304] 0 2024-09-15T22:27:08.772 INFO:tasks.workunit.client.0.smithi001.stdout:8/964: creat d9/d19/d29/f111 x:0 0 0 2024-09-15T22:27:08.772 INFO:tasks.workunit.client.0.smithi001.stdout:8/965: dread - d9/d19/d29/f111 zero size 2024-09-15T22:27:08.773 INFO:tasks.workunit.client.0.smithi001.stdout:8/966: truncate d9/f6d 1419415 0 2024-09-15T22:27:08.774 INFO:tasks.workunit.client.0.smithi001.stdout:8/967: chown d9/d19/d29/d50/cf7 93204 1 2024-09-15T22:27:08.774 INFO:tasks.workunit.client.0.smithi001.stdout:8/968: readlink d9/d19/d34/da4/db7/l108 0 2024-09-15T22:27:08.774 INFO:tasks.workunit.client.0.smithi001.stdout:8/969: chown d9/d19/d29/d50/d89/f92 985 1 2024-09-15T22:27:08.774 INFO:tasks.workunit.client.0.smithi001.stdout:8/970: creat d9/d19/d40/d5f/d61/f112 x:0 0 0 2024-09-15T22:27:08.776 INFO:tasks.workunit.client.0.smithi001.stdout:8/971: unlink d9/d19/d40/d9e/fd6 0 2024-09-15T22:27:08.843 INFO:tasks.workunit.client.0.smithi001.stdout:8/972: dwrite d9/d19/d34/da4/f10f [0,4194304] 0 2024-09-15T22:27:08.844 INFO:tasks.workunit.client.0.smithi001.stdout:8/973: creat d9/d19/d58/d8e/d9c/f113 x:0 0 0 2024-09-15T22:27:08.844 INFO:tasks.workunit.client.0.smithi001.stdout:8/974: chown d9/d19/d40/d9e/dc2 52 1 2024-09-15T22:27:08.845 INFO:tasks.workunit.client.0.smithi001.stdout:8/975: creat d9/d19/d34/d41/f114 x:0 0 0 2024-09-15T22:27:08.858 INFO:tasks.workunit.client.0.smithi001.stdout:8/976: dread d9/d19/d58/d8e/d9c/faf [0,4194304] 0 2024-09-15T22:27:08.859 INFO:tasks.workunit.client.0.smithi001.stdout:8/977: write d9/d19/d40/d5f/f87 [416773,49945] 0 2024-09-15T22:27:08.859 INFO:tasks.workunit.client.0.smithi001.stdout:8/978: creat d9/d19/d40/d5f/d61/d9f/f115 x:0 0 0 2024-09-15T22:27:08.908 INFO:tasks.workunit.client.0.smithi001.stdout:8/979: sync 2024-09-15T22:27:08.908 INFO:tasks.workunit.client.0.smithi001.stdout:8/980: write d9/d19/d34/d41/d104/f64 [1362396,38877] 0 2024-09-15T22:27:08.908 INFO:tasks.workunit.client.0.smithi001.stdout:8/981: chown d9/d19/c79 442209817 1 2024-09-15T22:27:08.945 INFO:tasks.workunit.client.0.smithi001.stdout:8/982: dwrite d9/d19/d40/d5f/f87 [0,4194304] 0 2024-09-15T22:27:08.957 INFO:tasks.workunit.client.0.smithi001.stdout:8/983: dread d9/d19/d58/d8e/fac [0,4194304] 0 2024-09-15T22:27:09.029 INFO:tasks.workunit.client.0.smithi001.stdout:8/984: dwrite d9/d19/f32 [0,4194304] 0 2024-09-15T22:27:09.030 INFO:tasks.workunit.client.0.smithi001.stdout:8/985: rmdir d9/d19/d34 39 2024-09-15T22:27:09.031 INFO:tasks.workunit.client.0.smithi001.stdout:8/986: stat d9/d19/d34/d41/d105 0 2024-09-15T22:27:09.032 INFO:tasks.workunit.client.0.smithi001.stdout:8/987: getdents d9/d19/d34 0 2024-09-15T22:27:09.032 INFO:tasks.workunit.client.0.smithi001.stdout:8/988: readlink d9/d19/d29/d50/d70/d76/l81 0 2024-09-15T22:27:09.032 INFO:tasks.workunit.client.0.smithi001.stdout:8/989: stat d9/d19/d29/d50/d70/d76 0 2024-09-15T22:27:09.095 INFO:tasks.workunit.client.0.smithi001.stdout:8/990: dwrite d9/d19/d34/f43 [0,4194304] 0 2024-09-15T22:27:09.096 INFO:tasks.workunit.client.0.smithi001.stdout:8/991: fdatasync d9/d19/d40/d9e/dd0/fe0 0 2024-09-15T22:27:09.097 INFO:tasks.workunit.client.0.smithi001.stdout:8/992: symlink d9/d19/d40/d9e/dc2/l116 0 2024-09-15T22:27:09.108 INFO:tasks.workunit.client.0.smithi001.stdout:8/993: write d9/d19/f1e [4142550,3672] 0 2024-09-15T22:27:09.109 INFO:tasks.workunit.client.0.smithi001.stdout:8/994: mkdir d9/d19/d40/d9e/dc2/d117 0 2024-09-15T22:27:09.110 INFO:tasks.workunit.client.0.smithi001.stdout:8/995: creat d9/d19/d58/d88/f118 x:0 0 0 2024-09-15T22:27:09.116 INFO:tasks.workunit.client.0.smithi001.stdout:8/996: dread d9/d19/fbe [0,4194304] 0 2024-09-15T22:27:09.116 INFO:tasks.workunit.client.0.smithi001.stdout:8/997: chown d9/d19/d58/d8e/d9c/f113 4 1 2024-09-15T22:27:09.117 INFO:tasks.workunit.client.0.smithi001.stdout:8/998: creat d9/d19/d29/f119 x:0 0 0 2024-09-15T22:27:09.117 INFO:tasks.workunit.client.0.smithi001.stdout:8/999: dread - d9/d19/d40/d5f/d61/d9f/f115 zero size 2024-09-15T22:27:09.123 INFO:tasks.workunit.client.0.smithi001.stderr:+ rm -rf -- ./tmp.oyij8MkDJS 2024-09-15T22:27:09.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:08 smithi012 ceph-mon[34883]: pgmap v424: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 21 MiB/s wr, 136 op/s 2024-09-15T22:27:09.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:08 smithi098 ceph-mon[35514]: pgmap v424: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 21 MiB/s wr, 136 op/s 2024-09-15T22:27:09.375 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:08 smithi001 ceph-mon[30843]: pgmap v424: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 21 MiB/s wr, 136 op/s 2024-09-15T22:27:11.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:10 smithi001 ceph-mon[30843]: pgmap v425: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 16 MiB/s wr, 145 op/s 2024-09-15T22:27:11.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:10 smithi012 ceph-mon[34883]: pgmap v425: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 16 MiB/s wr, 145 op/s 2024-09-15T22:27:11.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:10 smithi098 ceph-mon[35514]: pgmap v425: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 16 MiB/s wr, 145 op/s 2024-09-15T22:27:13.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:12 smithi012 ceph-mon[34883]: pgmap v426: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 8.3 MiB/s wr, 152 op/s 2024-09-15T22:27:13.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:12 smithi098 ceph-mon[35514]: pgmap v426: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 8.3 MiB/s wr, 152 op/s 2024-09-15T22:27:13.375 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:12 smithi001 ceph-mon[30843]: pgmap v426: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 8.3 MiB/s wr, 152 op/s 2024-09-15T22:27:14.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:13 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:27:14.375 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:13 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:27:14.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:13 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:27:15.277 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:14 smithi001 ceph-mon[30843]: pgmap v427: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 4.0 MiB/s wr, 130 op/s 2024-09-15T22:27:15.277 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:14 smithi001 ceph-mon[30843]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-15T22:27:15.277 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:14 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:27:15.277 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:15 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:27:15.277 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:15 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:27:15.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:15 smithi098 ceph-mon[35514]: pgmap v427: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 4.0 MiB/s wr, 130 op/s 2024-09-15T22:27:15.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:15 smithi098 ceph-mon[35514]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-15T22:27:15.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:15 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:27:15.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:15 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:27:15.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:15 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:27:15.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:14 smithi012 ceph-mon[34883]: pgmap v427: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 4.0 MiB/s wr, 130 op/s 2024-09-15T22:27:15.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:14 smithi012 ceph-mon[34883]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-15T22:27:15.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:14 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:27:15.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:14 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:27:15.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:14 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:27:17.266 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:17 smithi001 ceph-mon[30843]: pgmap v428: 97 pgs: 97 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 4.4 MiB/s wr, 222 op/s 2024-09-15T22:27:17.311 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:17 smithi098 ceph-mon[35514]: pgmap v428: 97 pgs: 97 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 4.4 MiB/s wr, 222 op/s 2024-09-15T22:27:17.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:17 smithi012 ceph-mon[34883]: pgmap v428: 97 pgs: 97 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 4.4 MiB/s wr, 222 op/s 2024-09-15T22:27:17.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.720+0000 7fc05ee00640 1 -- 172.21.15.1:0/1714977071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc058103560 msgr2=0x7fc058109df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:17.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.720+0000 7fc05ee00640 1 --2- 172.21.15.1:0/1714977071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc058103560 0x7fc058109df0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc050009ca0 tx=0x7fc05002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:27:17.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.720+0000 7fc05ee00640 1 -- 172.21.15.1:0/1714977071 shutdown_connections 2024-09-15T22:27:17.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.720+0000 7fc05ee00640 1 --2- 172.21.15.1:0/1714977071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc058103560 0x7fc058109df0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:17.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.720+0000 7fc05ee00640 1 --2- 172.21.15.1:0/1714977071 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc058102ba0 0x7fc058103020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:17.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.720+0000 7fc05ee00640 1 --2- 172.21.15.1:0/1714977071 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0581019b0 0x7fc058101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:17.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.720+0000 7fc05ee00640 1 -- 172.21.15.1:0/1714977071 >> 172.21.15.1:0/1714977071 conn(0x7fc0580fd130 msgr2=0x7fc0580ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:17.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.720+0000 7fc05ee00640 1 -- 172.21.15.1:0/1714977071 shutdown_connections 2024-09-15T22:27:17.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.720+0000 7fc05ee00640 1 -- 172.21.15.1:0/1714977071 wait complete. 2024-09-15T22:27:17.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.721+0000 7fc05ee00640 1 Processor -- start 2024-09-15T22:27:17.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.721+0000 7fc05ee00640 1 -- start start 2024-09-15T22:27:17.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.721+0000 7fc05ee00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0581019b0 0x7fc058075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:17.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.721+0000 7fc05ee00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc058102ba0 0x7fc0580745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:17.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.721+0000 7fc05ee00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc058103560 0x7fc058074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:17.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.721+0000 7fc05ee00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc05810d680 con 0x7fc058103560 2024-09-15T22:27:17.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.721+0000 7fc05ee00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc05810d500 con 0x7fc058102ba0 2024-09-15T22:27:17.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.721+0000 7fc05ee00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc05810d800 con 0x7fc0581019b0 2024-09-15T22:27:17.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.721+0000 7fc05da00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0581019b0 0x7fc058075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.721+0000 7fc05d000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc058102ba0 0x7fc0580745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.721+0000 7fc05e400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc058103560 0x7fc058074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.721+0000 7fc05d000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc058102ba0 0x7fc0580745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:45998/0 (socket says 172.21.15.1:45998) 2024-09-15T22:27:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.721+0000 7fc05da00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0581019b0 0x7fc058075fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:32982/0 (socket says 172.21.15.1:32982) 2024-09-15T22:27:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.721+0000 7fc05d000640 1 -- 172.21.15.1:0/1672543451 learned_addr learned my addr 172.21.15.1:0/1672543451 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:27:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.722+0000 7fc05da00640 1 -- 172.21.15.1:0/1672543451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc058102ba0 msgr2=0x7fc0580745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.722+0000 7fc05da00640 1 --2- 172.21.15.1:0/1672543451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc058102ba0 0x7fc0580745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.722+0000 7fc05da00640 1 -- 172.21.15.1:0/1672543451 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc058103560 msgr2=0x7fc058074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.722+0000 7fc05da00640 1 --2- 172.21.15.1:0/1672543451 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc058103560 0x7fc058074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.722+0000 7fc05da00640 1 -- 172.21.15.1:0/1672543451 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0580753b0 con 0x7fc0581019b0 2024-09-15T22:27:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.722+0000 7fc05d000640 1 --2- 172.21.15.1:0/1672543451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc058102ba0 0x7fc0580745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:27:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.722+0000 7fc05da00640 1 --2- 172.21.15.1:0/1672543451 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0581019b0 0x7fc058075fa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc04c00e9c0 tx=0x7fc04c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.722+0000 7fc056000640 1 -- 172.21.15.1:0/1672543451 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04c00ccc0 con 0x7fc0581019b0 2024-09-15T22:27:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.722+0000 7fc056000640 1 -- 172.21.15.1:0/1672543451 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc04c0035f0 con 0x7fc0581019b0 2024-09-15T22:27:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.723+0000 7fc05ee00640 1 -- 172.21.15.1:0/1672543451 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0581a1d70 con 0x7fc0581019b0 2024-09-15T22:27:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.723+0000 7fc056000640 1 -- 172.21.15.1:0/1672543451 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04c00ce60 con 0x7fc0581019b0 2024-09-15T22:27:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.723+0000 7fc05ee00640 1 -- 172.21.15.1:0/1672543451 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0581a2220 con 0x7fc0581019b0 2024-09-15T22:27:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.726+0000 7fc0631c3740 1 Processor -- start 2024-09-15T22:27:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.726+0000 7fc0631c3740 1 -- start start 2024-09-15T22:27:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.726+0000 7fc056000640 1 -- 172.21.15.1:0/1672543451 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fc04c0037a0 con 0x7fc0581019b0 2024-09-15T22:27:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.726+0000 7fc0631c3740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d25f45260 0x561d25f45660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.726+0000 7fc0631c3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d25f45ba0 0x561d25f4a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.726+0000 7fc0631c3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d25f4ac30 0x561d25f4d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.726+0000 7fc0631c3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561d25eaa100 con 0x561d25f45ba0 2024-09-15T22:27:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.726+0000 7fc0631c3740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561d25e521b0 con 0x561d25f45260 2024-09-15T22:27:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.726+0000 7fc0631c3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561d25ea60c0 con 0x561d25f4ac30 2024-09-15T22:27:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.726+0000 7fc05e400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d25f45260 0x561d25f45660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.726+0000 7fc05e400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d25f45260 0x561d25f45660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:46000/0 (socket says 172.21.15.1:46000) 2024-09-15T22:27:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.726+0000 7fc05e400640 1 -- 172.21.15.1:0/2940633013 learned_addr learned my addr 172.21.15.1:0/2940633013 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:27:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.726+0000 7fc05da00640 1 --2- 172.21.15.1:0/2940633013 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d25f45ba0 0x561d25f4a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.726+0000 7fc05d000640 1 --2- 172.21.15.1:0/2940633013 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d25f4ac30 0x561d25f4d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.727+0000 7fc05e400640 1 -- 172.21.15.1:0/2940633013 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d25f4ac30 msgr2=0x561d25f4d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.727+0000 7fc05e400640 1 --2- 172.21.15.1:0/2940633013 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d25f4ac30 0x561d25f4d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.727+0000 7fc05e400640 1 -- 172.21.15.1:0/2940633013 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d25f45ba0 msgr2=0x561d25f4a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.727+0000 7fc05e400640 1 --2- 172.21.15.1:0/2940633013 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d25f45ba0 0x561d25f4a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.727+0000 7fc05e400640 1 -- 172.21.15.1:0/2940633013 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d25bbd210 con 0x561d25f45260 2024-09-15T22:27:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.727+0000 7fc05e400640 1 --2- 172.21.15.1:0/2940633013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d25f45260 0x561d25f45660 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc050009ca0 tx=0x7fc0500093c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ab5ae3bf0af5ad server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.727+0000 7fc04aa00640 1 -- 172.21.15.1:0/2940633013 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc050031650 con 0x561d25f45260 2024-09-15T22:27:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.727+0000 7fc04aa00640 1 -- 172.21.15.1:0/2940633013 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc050036030 con 0x561d25f45260 2024-09-15T22:27:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.727+0000 7fc04aa00640 1 -- 172.21.15.1:0/2940633013 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc050004720 con 0x561d25f45260 2024-09-15T22:27:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.727+0000 7fc056000640 1 --2- 172.21.15.1:0/1672543451 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc0400a32b0 0x7fc0400a5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.728+0000 7fc056000640 1 -- 172.21.15.1:0/1672543451 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7fc04c0cfd20 con 0x7fc0581019b0 2024-09-15T22:27:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.728+0000 7fc05da00640 1 --2- 172.21.15.1:0/1672543451 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc0400a32b0 0x7fc0400a5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.728+0000 7fc0631c3740 1 -- 172.21.15.1:0/2940633013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d25f45260 msgr2=0x561d25f45660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.728+0000 7fc0631c3740 1 --2- 172.21.15.1:0/2940633013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d25f45260 0x561d25f45660 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc050009ca0 tx=0x7fc0500093c0 comp rx=0 tx=0).stop 2024-09-15T22:27:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.728+0000 7fc0631c3740 1 -- 172.21.15.1:0/2940633013 shutdown_connections 2024-09-15T22:27:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.728+0000 7fc0631c3740 1 --2- 172.21.15.1:0/2940633013 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d25f4ac30 0x561d25f4d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.728+0000 7fc0631c3740 1 --2- 172.21.15.1:0/2940633013 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d25f45ba0 0x561d25f4a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.728+0000 7fc0631c3740 1 --2- 172.21.15.1:0/2940633013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d25f45260 0x561d25f45660 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.728+0000 7fc0631c3740 1 -- 172.21.15.1:0/2940633013 >> 172.21.15.1:0/2940633013 conn(0x561d25f408d0 msgr2=0x561d25f40cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.728+0000 7fc0631c3740 1 -- 172.21.15.1:0/2940633013 shutdown_connections 2024-09-15T22:27:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.728+0000 7fc0631c3740 1 -- 172.21.15.1:0/2940633013 wait complete. 2024-09-15T22:27:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.728+0000 7fc05da00640 1 --2- 172.21.15.1:0/1672543451 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc0400a32b0 0x7fc0400a5770 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc04c098c50 tx=0x7fc04c003e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.729+0000 7fc0631c3740 1 -- start start 2024-09-15T22:27:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.729+0000 7fc0631c3740 1 Processor -- start 2024-09-15T22:27:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.729+0000 7fc0631c3740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d25f45260 0x561d25f4f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.729+0000 7fc0631c3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d25f45ba0 0x561d25f4f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.729+0000 7fc0631c3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d25f4ac30 0x561d25f567b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.729+0000 7fc0631c3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561d25f4da20 con 0x561d25f45ba0 2024-09-15T22:27:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.729+0000 7fc0631c3740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561d25e33090 con 0x561d25f45260 2024-09-15T22:27:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.729+0000 7fc0631c3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561d25f4dba0 con 0x561d25f4ac30 2024-09-15T22:27:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.729+0000 7fc0631c3740 10 client.0 _ll_register_callbacks cb 0x561d25e87f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:27:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.730+0000 7fc05e400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d25f45260 0x561d25f4f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.730+0000 7fc05e400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d25f45260 0x561d25f4f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:46002/0 (socket says 172.21.15.1:46002) 2024-09-15T22:27:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.730+0000 7fc05e400640 1 -- 172.21.15.1:0/4006363460 learned_addr learned my addr 172.21.15.1:0/4006363460 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:27:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.730+0000 7fc05d000640 1 --2- 172.21.15.1:0/4006363460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d25f45ba0 0x561d25f4f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.730+0000 7fc05e400640 1 --2- 172.21.15.1:0/4006363460 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d25f4ac30 0x561d25f567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.730+0000 7fc05e400640 1 -- 172.21.15.1:0/4006363460 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d25f4ac30 msgr2=0x561d25f567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.730+0000 7fc05e400640 1 --2- 172.21.15.1:0/4006363460 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d25f4ac30 0x561d25f567b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.730+0000 7fc05e400640 1 -- 172.21.15.1:0/4006363460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d25f45ba0 msgr2=0x561d25f4f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.730+0000 7fc05e400640 1 --2- 172.21.15.1:0/4006363460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d25f45ba0 0x561d25f4f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.730+0000 7fc05e400640 1 -- 172.21.15.1:0/4006363460 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d25c89620 con 0x561d25f45260 2024-09-15T22:27:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.730+0000 7fc05e400640 1 --2- 172.21.15.1:0/4006363460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d25f45260 0x561d25f4f230 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc050009bf0 tx=0x7fc050004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c72bf63d11cd3ec server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.730+0000 7fc03f400640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-15T22:27:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.731+0000 7fc03f400640 1 -- 172.21.15.1:0/4006363460 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc050059060 con 0x561d25f45260 2024-09-15T22:27:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.731+0000 7fc03f400640 1 -- 172.21.15.1:0/4006363460 <== mon.2 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7fc050003b70 con 0x561d25f45260 2024-09-15T22:27:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.731+0000 7fc0631c3740 1 -- 172.21.15.1:0/4006363460 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc050036030 con 0x561d25f45260 2024-09-15T22:27:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.731+0000 7fc03f400640 1 -- 172.21.15.1:0/4006363460 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc050004b40 con 0x561d25f45260 2024-09-15T22:27:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.731+0000 7fc0631c3740 10 client.25211 fetch_fsmap learned FSMap version 28 2024-09-15T22:27:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.731+0000 7fc0631c3740 1 -- 172.21.15.1:0/4006363460 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561d25f4da20 con 0x561d25f45260 2024-09-15T22:27:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.731+0000 7fc03f400640 1 -- 172.21.15.1:0/4006363460 <== mon.2 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc050036030 con 0x561d25f45260 2024-09-15T22:27:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.731+0000 7fc03f400640 1 -- 172.21.15.1:0/4006363460 <== mon.2 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7fc050043070 con 0x561d25f45260 2024-09-15T22:27:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.732+0000 7fc0631c3740 10 client.25211 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:27:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.732+0000 7fc0631c3740 10 client.25211 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T22:27:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.732+0000 7fc0631c3740 20 client.25211 populate_metadata read hostname 'smithi001' 2024-09-15T22:27:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.732+0000 7fc0631c3740 1 --2- 172.21.15.1:0/4006363460 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x561d25f5a960 0x561d25f5cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.732+0000 7fc0631c3740 4 client.25211 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:27:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.732+0000 7fc0631c3740 1 -- 172.21.15.1:0/4006363460 --> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d25eb7830 con 0x561d25f5a960 2024-09-15T22:27:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.732+0000 7fc05d000640 1 --2- 172.21.15.1:0/4006363460 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x561d25f5a960 0x561d25f5cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.732+0000 7fc05d000640 1 --2- 172.21.15.1:0/4006363460 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x561d25f5a960 0x561d25f5cd80 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c97f06483ef207fc server_cookie=ab86faaba74cf535 in_seq=0 out_seq=0 2024-09-15T22:27:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.732+0000 7fc03f400640 10 client.25211 ms_handle_connect on v2:172.21.15.98:6838/2831161859 2024-09-15T22:27:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.733+0000 7fc03f400640 1 -- 172.21.15.1:0/4006363460 <== mds.0 v2:172.21.15.98:6838/2831161859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561d25eb7830 con 0x561d25f5a960 2024-09-15T22:27:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.733+0000 7fc03f400640 10 client.25211 handle_command_reply: tid=0 2024-09-15T22:27:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.733+0000 7fc0631c3740 1 client.25211 shutdown 2024-09-15T22:27:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.733+0000 7fc0631c3740 1 -- 172.21.15.1:0/4006363460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d25f45260 msgr2=0x561d25f4f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.733+0000 7fc0631c3740 1 --2- 172.21.15.1:0/4006363460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d25f45260 0x561d25f4f230 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc050009bf0 tx=0x7fc050004040 comp rx=0 tx=0).stop 2024-09-15T22:27:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.733+0000 7fc0631c3740 1 -- 172.21.15.1:0/4006363460 shutdown_connections 2024-09-15T22:27:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.733+0000 7fc0631c3740 1 --2- 172.21.15.1:0/4006363460 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d25f4ac30 0x561d25f567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.733+0000 7fc0631c3740 1 --2- 172.21.15.1:0/4006363460 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x561d25f5a960 0x561d25f5cd80 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.733+0000 7fc0631c3740 1 --2- 172.21.15.1:0/4006363460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d25f45ba0 0x561d25f4f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.733+0000 7fc0631c3740 1 --2- 172.21.15.1:0/4006363460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d25f45260 0x561d25f4f230 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.733+0000 7fc03f400640 0 client.25211 ms_handle_reset on v2:172.21.15.98:6838/2831161859 2024-09-15T22:27:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.733+0000 7fc0631c3740 1 -- 172.21.15.1:0/4006363460 >> 172.21.15.1:0/4006363460 conn(0x561d25f408d0 msgr2=0x561d25f420e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.733+0000 7fc0631c3740 1 -- 172.21.15.1:0/4006363460 shutdown_connections 2024-09-15T22:27:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.733+0000 7fc0631c3740 1 -- 172.21.15.1:0/4006363460 wait complete. 2024-09-15T22:27:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.734+0000 7fc0631c3740 20 client.25211 trim_cache size 0 max 16384 2024-09-15T22:27:17.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.748+0000 7fc0631c3740 1 Processor -- start 2024-09-15T22:27:17.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.749+0000 7fc0631c3740 1 -- start start 2024-09-15T22:27:17.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.749+0000 7fc0631c3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d25f45260 0x561d25f4f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:17.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.749+0000 7fc0631c3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d25f45ba0 0x561d25f56770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:17.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.749+0000 7fc0631c3740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d25f4ac30 0x561d25f3f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:17.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.749+0000 7fc0631c3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc0581ada80 con 0x561d25f45ba0 2024-09-15T22:27:17.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.749+0000 7fc0631c3740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc0581ab2c0 con 0x561d25f4ac30 2024-09-15T22:27:17.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.749+0000 7fc0631c3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc0581a9110 con 0x561d25f45260 2024-09-15T22:27:17.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.749+0000 7fc05e400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d25f45260 0x561d25f4f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:17.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.749+0000 7fc05d000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d25f45ba0 0x561d25f56770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:17.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.749+0000 7fc05e400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d25f45260 0x561d25f4f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:33020/0 (socket says 172.21.15.1:33020) 2024-09-15T22:27:17.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.749+0000 7fc05e400640 1 -- 172.21.15.1:0/1577264162 learned_addr learned my addr 172.21.15.1:0/1577264162 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:27:17.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.749+0000 7fc05e400640 1 --2- 172.21.15.1:0/1577264162 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d25f4ac30 0x561d25f3f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:17.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.749+0000 7fc05e400640 1 -- 172.21.15.1:0/1577264162 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d25f4ac30 msgr2=0x561d25f3f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:17.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.749+0000 7fc05e400640 1 --2- 172.21.15.1:0/1577264162 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d25f4ac30 0x561d25f3f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:17.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.749+0000 7fc05e400640 1 -- 172.21.15.1:0/1577264162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d25f45ba0 msgr2=0x561d25f56770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:17.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.749+0000 7fc05e400640 1 --2- 172.21.15.1:0/1577264162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d25f45ba0 0x561d25f56770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:17.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.749+0000 7fc05e400640 1 -- 172.21.15.1:0/1577264162 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d25f406f0 con 0x561d25f45260 2024-09-15T22:27:17.755 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.750+0000 7fc05e400640 1 --2- 172.21.15.1:0/1577264162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d25f45260 0x561d25f4f6f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc050004fd0 tx=0x7fc05002a8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bdba0ae70b722c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:17.755 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.750+0000 7fc04a000640 1 -- 172.21.15.1:0/1577264162 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc050059040 con 0x561d25f45260 2024-09-15T22:27:17.755 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.750+0000 7fc04a000640 1 -- 172.21.15.1:0/1577264162 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc050036070 con 0x561d25f45260 2024-09-15T22:27:17.755 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.750+0000 7fc04a000640 1 -- 172.21.15.1:0/1577264162 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc050004850 con 0x561d25f45260 2024-09-15T22:27:17.755 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.750+0000 7fc0631c3740 1 -- 172.21.15.1:0/1577264162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d25f45260 msgr2=0x561d25f4f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:17.755 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.750+0000 7fc0631c3740 1 --2- 172.21.15.1:0/1577264162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d25f45260 0x561d25f4f6f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc050004fd0 tx=0x7fc05002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:27:17.755 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.751+0000 7fc0631c3740 1 -- 172.21.15.1:0/1577264162 shutdown_connections 2024-09-15T22:27:17.755 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.751+0000 7fc0631c3740 1 --2- 172.21.15.1:0/1577264162 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d25f4ac30 0x561d25f3f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:17.755 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.751+0000 7fc0631c3740 1 --2- 172.21.15.1:0/1577264162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d25f45ba0 0x561d25f56770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:17.755 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.751+0000 7fc0631c3740 1 --2- 172.21.15.1:0/1577264162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d25f45260 0x561d25f4f6f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:17.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.751+0000 7fc0631c3740 1 -- 172.21.15.1:0/1577264162 >> 172.21.15.1:0/1577264162 conn(0x561d25f408d0 msgr2=0x561d25f4efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:17.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.751+0000 7fc0631c3740 1 -- 172.21.15.1:0/1577264162 shutdown_connections 2024-09-15T22:27:17.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.751+0000 7fc0631c3740 1 -- 172.21.15.1:0/1577264162 wait complete. 2024-09-15T22:27:17.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.751+0000 7fc0631c3740 1 -- start start 2024-09-15T22:27:17.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.751+0000 7fc0631c3740 1 Processor -- start 2024-09-15T22:27:17.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.752+0000 7fc0631c3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d25f45260 0x561d25f53e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:17.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.752+0000 7fc0631c3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d25f45ba0 0x561d25f543a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:17.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.752+0000 7fc0631c3740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d25f4ac30 0x561d25f553b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:17.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.752+0000 7fc0631c3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc0581a9780 con 0x561d25f45260 2024-09-15T22:27:17.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.752+0000 7fc0631c3740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc0581aabf0 con 0x561d25f4ac30 2024-09-15T22:27:17.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.752+0000 7fc0631c3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc0581a9e50 con 0x561d25f45ba0 2024-09-15T22:27:17.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.752+0000 7fc0631c3740 10 client.0 _ll_register_callbacks cb 0x7fc044009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:27:17.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.752+0000 7fc05d000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d25f45ba0 0x561d25f543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.752+0000 7fc05d000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d25f45ba0 0x561d25f543a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:33036/0 (socket says 172.21.15.1:33036) 2024-09-15T22:27:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.752+0000 7fc05d000640 1 -- 172.21.15.1:0/3872940463 learned_addr learned my addr 172.21.15.1:0/3872940463 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:27:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.752+0000 7fc05d000640 1 -- 172.21.15.1:0/3872940463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d25f4ac30 msgr2=0x561d25f553b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:27:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.752+0000 7fc05d000640 1 --2- 172.21.15.1:0/3872940463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d25f4ac30 0x561d25f553b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.752+0000 7fc05e400640 1 --2- 172.21.15.1:0/3872940463 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d25f45260 0x561d25f53e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.752+0000 7fc05d000640 1 -- 172.21.15.1:0/3872940463 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d25f45260 msgr2=0x561d25f53e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.752+0000 7fc05d000640 1 --2- 172.21.15.1:0/3872940463 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d25f45260 0x561d25f53e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.752+0000 7fc05d000640 1 -- 172.21.15.1:0/3872940463 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d25f559c0 con 0x561d25f45ba0 2024-09-15T22:27:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.752+0000 7fc05e400640 1 --2- 172.21.15.1:0/3872940463 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d25f45260 0x561d25f53e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:27:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.753+0000 7fc05d000640 1 --2- 172.21.15.1:0/3872940463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d25f45ba0 0x561d25f543a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x561d25f41750 tx=0x7fc044012650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e40da8266901c90b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.753+0000 7fc03f400640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-15T22:27:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.753+0000 7fc03f400640 1 -- 172.21.15.1:0/3872940463 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04401fc40 con 0x561d25f45ba0 2024-09-15T22:27:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.753+0000 7fc03f400640 1 -- 172.21.15.1:0/3872940463 <== mon.1 v2:172.21.15.98:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7fc04401fde0 con 0x561d25f45ba0 2024-09-15T22:27:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.753+0000 7fc0631c3740 1 -- 172.21.15.1:0/3872940463 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc050036070 con 0x561d25f45ba0 2024-09-15T22:27:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.754+0000 7fc03f400640 1 -- 172.21.15.1:0/3872940463 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc044005020 con 0x561d25f45ba0 2024-09-15T22:27:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.754+0000 7fc0631c3740 10 client.25243 fetch_fsmap learned FSMap version 28 2024-09-15T22:27:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.754+0000 7fc0631c3740 1 -- 172.21.15.1:0/3872940463 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561d25fc56d0 con 0x561d25f45ba0 2024-09-15T22:27:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.754+0000 7fc03f400640 1 -- 172.21.15.1:0/3872940463 <== mon.1 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc050036070 con 0x561d25f45ba0 2024-09-15T22:27:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.754+0000 7fc03f400640 1 -- 172.21.15.1:0/3872940463 <== mon.1 v2:172.21.15.98:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7fc044029460 con 0x561d25f45ba0 2024-09-15T22:27:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.754+0000 7fc0631c3740 10 client.25243 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:27:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.754+0000 7fc0631c3740 10 client.25243 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T22:27:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.754+0000 7fc0631c3740 20 client.25243 populate_metadata read hostname 'smithi001' 2024-09-15T22:27:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.754+0000 7fc0631c3740 1 --2- 172.21.15.1:0/3872940463 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x561d25fc6040 0x561d25fc84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.754+0000 7fc0631c3740 4 client.25243 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:27:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.754+0000 7fc0631c3740 1 -- 172.21.15.1:0/3872940463 --> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561d25f4a9b0 con 0x561d25fc6040 2024-09-15T22:27:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.755+0000 7fc05e400640 1 --2- 172.21.15.1:0/3872940463 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x561d25fc6040 0x561d25fc84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.755+0000 7fc05e400640 1 --2- 172.21.15.1:0/3872940463 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x561d25fc6040 0x561d25fc84a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80b5d427c021d97c server_cookie=dae8475ba3ac25a1 in_seq=0 out_seq=0 2024-09-15T22:27:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.755+0000 7fc03f400640 10 client.25243 ms_handle_connect on v2:172.21.15.98:6838/2831161859 2024-09-15T22:27:17.788 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.786+0000 7fc03f400640 1 -- 172.21.15.1:0/3872940463 <== mds.0 v2:172.21.15.98:6838/2831161859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561d25f4a9b0 con 0x561d25fc6040 2024-09-15T22:27:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.786+0000 7fc03f400640 10 client.25243 handle_command_reply: tid=0 2024-09-15T22:27:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.786+0000 7fc0631c3740 1 client.25243 shutdown 2024-09-15T22:27:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.786+0000 7fc0631c3740 1 -- 172.21.15.1:0/3872940463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d25f45ba0 msgr2=0x561d25f543a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.786+0000 7fc0631c3740 1 --2- 172.21.15.1:0/3872940463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d25f45ba0 0x561d25f543a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x561d25f41750 tx=0x7fc044012650 comp rx=0 tx=0).stop 2024-09-15T22:27:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.786+0000 7fc0631c3740 1 -- 172.21.15.1:0/3872940463 shutdown_connections 2024-09-15T22:27:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.786+0000 7fc0631c3740 1 --2- 172.21.15.1:0/3872940463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d25f4ac30 0x561d25f553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.786+0000 7fc0631c3740 1 --2- 172.21.15.1:0/3872940463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d25f45ba0 0x561d25f543a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.786+0000 7fc0631c3740 1 --2- 172.21.15.1:0/3872940463 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x561d25fc6040 0x561d25fc84a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.786+0000 7fc0631c3740 1 --2- 172.21.15.1:0/3872940463 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561d25f45260 0x561d25f53e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.786+0000 7fc03f400640 0 client.25243 ms_handle_reset on v2:172.21.15.98:6838/2831161859 2024-09-15T22:27:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.786+0000 7fc0631c3740 1 -- 172.21.15.1:0/3872940463 >> 172.21.15.1:0/3872940463 conn(0x561d25f408d0 msgr2=0x561d25f41780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.786+0000 7fc0631c3740 1 -- 172.21.15.1:0/3872940463 shutdown_connections 2024-09-15T22:27:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.786+0000 7fc0631c3740 1 -- 172.21.15.1:0/3872940463 wait complete. 2024-09-15T22:27:17.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.787+0000 7fc0631c3740 20 client.25243 trim_cache size 0 max 16384 2024-09-15T22:27:17.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-15T22:27:17.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-15T22:27:17.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-15T22:27:17.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-15T22:27:17.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.787+0000 7fc05ee00640 1 -- 172.21.15.1:0/1672543451 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc0400a32b0 msgr2=0x7fc0400a5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:17.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.787+0000 7fc05ee00640 1 --2- 172.21.15.1:0/1672543451 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc0400a32b0 0x7fc0400a5770 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc04c098c50 tx=0x7fc04c003e10 comp rx=0 tx=0).stop 2024-09-15T22:27:17.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.787+0000 7fc05ee00640 1 -- 172.21.15.1:0/1672543451 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0581019b0 msgr2=0x7fc058075fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:17.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.787+0000 7fc05ee00640 1 --2- 172.21.15.1:0/1672543451 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0581019b0 0x7fc058075fa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc04c00e9c0 tx=0x7fc04c00ee80 comp rx=0 tx=0).stop 2024-09-15T22:27:17.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.787+0000 7fc05ee00640 1 -- 172.21.15.1:0/1672543451 shutdown_connections 2024-09-15T22:27:17.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.787+0000 7fc05ee00640 1 --2- 172.21.15.1:0/1672543451 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc0400a32b0 0x7fc0400a5770 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:17.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.787+0000 7fc05ee00640 1 --2- 172.21.15.1:0/1672543451 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc058103560 0x7fc058074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:17.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.787+0000 7fc05ee00640 1 --2- 172.21.15.1:0/1672543451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc058102ba0 0x7fc0580745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:17.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.787+0000 7fc05ee00640 1 --2- 172.21.15.1:0/1672543451 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0581019b0 0x7fc058075fa0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:17.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.787+0000 7fc05ee00640 1 -- 172.21.15.1:0/1672543451 >> 172.21.15.1:0/1672543451 conn(0x7fc0580fd130 msgr2=0x7fc058105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:17.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.787+0000 7fc05ee00640 1 -- 172.21.15.1:0/1672543451 shutdown_connections 2024-09-15T22:27:17.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:17.788+0000 7fc05ee00640 1 -- 172.21.15.1:0/1672543451 wait complete. 2024-09-15T22:27:19.290 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:19 smithi001 ceph-mon[30843]: pgmap v429: 97 pgs: 97 active+clean; 962 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 184 op/s 2024-09-15T22:27:19.296 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:19 smithi012 ceph-mon[34883]: pgmap v429: 97 pgs: 97 active+clean; 962 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 184 op/s 2024-09-15T22:27:19.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:19 smithi098 ceph-mon[35514]: pgmap v429: 97 pgs: 97 active+clean; 962 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 184 op/s 2024-09-15T22:27:19.578 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-15T22:27:19.578 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-15T22:27:21.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:21 smithi098 ceph-mon[35514]: pgmap v430: 97 pgs: 97 active+clean; 570 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.8 MiB/s wr, 210 op/s 2024-09-15T22:27:21.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:21 smithi001 ceph-mon[30843]: pgmap v430: 97 pgs: 97 active+clean; 570 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.8 MiB/s wr, 210 op/s 2024-09-15T22:27:21.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:21 smithi012 ceph-mon[34883]: pgmap v430: 97 pgs: 97 active+clean; 570 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.8 MiB/s wr, 210 op/s 2024-09-15T22:27:23.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:23 smithi098 ceph-mon[35514]: pgmap v431: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 252 op/s 2024-09-15T22:27:23.375 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:23 smithi001 ceph-mon[30843]: pgmap v431: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 252 op/s 2024-09-15T22:27:23.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:23 smithi012 ceph-mon[34883]: pgmap v431: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 252 op/s 2024-09-15T22:27:25.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:25 smithi098 ceph-mon[35514]: pgmap v432: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1016 KiB/s wr, 232 op/s 2024-09-15T22:27:25.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:25 smithi001 ceph-mon[30843]: pgmap v432: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1016 KiB/s wr, 232 op/s 2024-09-15T22:27:25.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:25 smithi012 ceph-mon[34883]: pgmap v432: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1016 KiB/s wr, 232 op/s 2024-09-15T22:27:27.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:27 smithi098 ceph-mon[35514]: pgmap v433: 97 pgs: 97 active+clean; 89 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 348 op/s 2024-09-15T22:27:27.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:27 smithi001 ceph-mon[30843]: pgmap v433: 97 pgs: 97 active+clean; 89 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 348 op/s 2024-09-15T22:27:27.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:27 smithi012 ceph-mon[34883]: pgmap v433: 97 pgs: 97 active+clean; 89 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 348 op/s 2024-09-15T22:27:29.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:29 smithi098 ceph-mon[35514]: pgmap v434: 97 pgs: 97 active+clean; 92 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 276 op/s 2024-09-15T22:27:29.375 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:29 smithi001 ceph-mon[30843]: pgmap v434: 97 pgs: 97 active+clean; 92 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 276 op/s 2024-09-15T22:27:29.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:29 smithi012 ceph-mon[34883]: pgmap v434: 97 pgs: 97 active+clean; 92 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 276 op/s 2024-09-15T22:27:30.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.904+0000 7f48b4200640 1 -- 172.21.15.1:0/1218880540 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48ac105910 msgr2=0x7f48ac10c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:30.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.904+0000 7f48b4200640 1 --2- 172.21.15.1:0/1218880540 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48ac105910 0x7f48ac10c1a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f48a4009ca0 tx=0x7f48a402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.905+0000 7f48b4200640 1 -- 172.21.15.1:0/1218880540 shutdown_connections 2024-09-15T22:27:30.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.905+0000 7f48b4200640 1 --2- 172.21.15.1:0/1218880540 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48ac105910 0x7f48ac10c1a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.905+0000 7f48b4200640 1 --2- 172.21.15.1:0/1218880540 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48ac104f50 0x7f48ac1053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.905+0000 7f48b4200640 1 --2- 172.21.15.1:0/1218880540 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48ac103d60 0x7f48ac104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.905+0000 7f48b4200640 1 -- 172.21.15.1:0/1218880540 >> 172.21.15.1:0/1218880540 conn(0x7f48ac0ff4e0 msgr2=0x7f48ac101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:30.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.905+0000 7f48b4200640 1 -- 172.21.15.1:0/1218880540 shutdown_connections 2024-09-15T22:27:30.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.905+0000 7f48b4200640 1 -- 172.21.15.1:0/1218880540 wait complete. 2024-09-15T22:27:30.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.905+0000 7f48b4200640 1 Processor -- start 2024-09-15T22:27:30.910 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.906+0000 7f48b4200640 1 -- start start 2024-09-15T22:27:30.910 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.906+0000 7f48b4200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48ac103d60 0x7f48ac19a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:30.910 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.906+0000 7f48b4200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48ac104f50 0x7f48ac19a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:30.910 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.906+0000 7f48b4200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48ac105910 0x7f48ac1a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:30.910 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.906+0000 7f48b4200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac10fa30 con 0x7f48ac103d60 2024-09-15T22:27:30.910 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.906+0000 7f48b4200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac10f8b0 con 0x7f48ac105910 2024-09-15T22:27:30.910 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.906+0000 7f48b4200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac10fbb0 con 0x7f48ac104f50 2024-09-15T22:27:30.910 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.906+0000 7f48b0e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48ac104f50 0x7f48ac19a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:30.910 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.906+0000 7f48b0e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48ac104f50 0x7f48ac19a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:35710/0 (socket says 172.21.15.1:35710) 2024-09-15T22:27:30.910 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.906+0000 7f48b0e00640 1 -- 172.21.15.1:0/1358810493 learned_addr learned my addr 172.21.15.1:0/1358810493 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:27:30.910 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.906+0000 7f48b2200640 1 --2- 172.21.15.1:0/1358810493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48ac105910 0x7f48ac1a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:30.911 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.906+0000 7f48b1800640 1 --2- 172.21.15.1:0/1358810493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48ac103d60 0x7f48ac19a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:30.911 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.907+0000 7f48b0e00640 1 -- 172.21.15.1:0/1358810493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48ac105910 msgr2=0x7f48ac1a15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:30.912 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.907+0000 7f48b0e00640 1 --2- 172.21.15.1:0/1358810493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48ac105910 0x7f48ac1a15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.912 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.907+0000 7f48b0e00640 1 -- 172.21.15.1:0/1358810493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48ac103d60 msgr2=0x7f48ac19a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:30.912 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.907+0000 7f48b0e00640 1 --2- 172.21.15.1:0/1358810493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48ac103d60 0x7f48ac19a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.912 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.907+0000 7f48b0e00640 1 -- 172.21.15.1:0/1358810493 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48ac1a1c50 con 0x7f48ac104f50 2024-09-15T22:27:30.912 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.907+0000 7f48b0e00640 1 --2- 172.21.15.1:0/1358810493 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48ac104f50 0x7f48ac19a570 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f489800e9f0 tx=0x7f489800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:30.912 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.907+0000 7f48aa000640 1 -- 172.21.15.1:0/1358810493 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f489800cd80 con 0x7f48ac104f50 2024-09-15T22:27:30.912 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.907+0000 7f48aa000640 1 -- 172.21.15.1:0/1358810493 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4898005500 con 0x7f48ac104f50 2024-09-15T22:27:30.912 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.907+0000 7f48b4200640 1 -- 172.21.15.1:0/1358810493 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48ac1a1f40 con 0x7f48ac104f50 2024-09-15T22:27:30.912 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.907+0000 7f48aa000640 1 -- 172.21.15.1:0/1358810493 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4898010690 con 0x7f48ac104f50 2024-09-15T22:27:30.912 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.907+0000 7f48b4200640 1 -- 172.21.15.1:0/1358810493 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48ac1a2400 con 0x7f48ac104f50 2024-09-15T22:27:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.910+0000 7f48b7087740 1 Processor -- start 2024-09-15T22:27:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.910+0000 7f48b7087740 1 -- start start 2024-09-15T22:27:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.911+0000 7f48b7087740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597babc4090 0x5597babc4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.911+0000 7f48b7087740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597babc49d0 0x5597babc9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.911+0000 7f48b7087740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5597babc9a60 0x5597babcbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.911+0000 7f48b7087740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5597bab29100 con 0x5597babc4090 2024-09-15T22:27:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.911+0000 7f48b7087740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5597baad11b0 con 0x5597babc49d0 2024-09-15T22:27:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.911+0000 7f48b7087740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5597bab250c0 con 0x5597babc9a60 2024-09-15T22:27:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.911+0000 7f48aa000640 1 -- 172.21.15.1:0/1358810493 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f48980046c0 con 0x7f48ac104f50 2024-09-15T22:27:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.911+0000 7f48b1800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597babc49d0 0x5597babc9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.911+0000 7f48b1800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597babc49d0 0x5597babc9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:40692/0 (socket says 172.21.15.1:40692) 2024-09-15T22:27:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.911+0000 7f48b1800640 1 -- 172.21.15.1:0/2912227468 learned_addr learned my addr 172.21.15.1:0/2912227468 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:27:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.911+0000 7f48b2200640 1 --2- 172.21.15.1:0/2912227468 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597babc4090 0x5597babc4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.911+0000 7f48b0e00640 1 --2- 172.21.15.1:0/2912227468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5597babc9a60 0x5597babcbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.911+0000 7f48b1800640 1 -- 172.21.15.1:0/2912227468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5597babc9a60 msgr2=0x5597babcbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.911+0000 7f48b1800640 1 --2- 172.21.15.1:0/2912227468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5597babc9a60 0x5597babcbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.911+0000 7f48b1800640 1 -- 172.21.15.1:0/2912227468 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597babc4090 msgr2=0x5597babc4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.911+0000 7f48b1800640 1 --2- 172.21.15.1:0/2912227468 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597babc4090 0x5597babc4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.911+0000 7f48b1800640 1 -- 172.21.15.1:0/2912227468 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597ba83c210 con 0x5597babc49d0 2024-09-15T22:27:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.911+0000 7f48b2200640 1 --2- 172.21.15.1:0/2912227468 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597babc4090 0x5597babc4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:27:30.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.912+0000 7f48b1800640 1 --2- 172.21.15.1:0/2912227468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597babc49d0 0x5597babc9490 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f48a0009ca0 tx=0x7f48a0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74c776c4d370e3fa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:30.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.912+0000 7f489ea00640 1 -- 172.21.15.1:0/2912227468 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a0004220 con 0x5597babc49d0 2024-09-15T22:27:30.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.912+0000 7f489ea00640 1 -- 172.21.15.1:0/2912227468 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48a00043c0 con 0x5597babc49d0 2024-09-15T22:27:30.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.912+0000 7f489ea00640 1 -- 172.21.15.1:0/2912227468 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a00198d0 con 0x5597babc49d0 2024-09-15T22:27:30.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.912+0000 7f48aa000640 1 --2- 172.21.15.1:0/1358810493 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f48940a32c0 0x7f48940a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:30.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.912+0000 7f48b7087740 1 -- 172.21.15.1:0/2912227468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597babc49d0 msgr2=0x5597babc9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:30.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.912+0000 7f48b7087740 1 --2- 172.21.15.1:0/2912227468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597babc49d0 0x5597babc9490 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f48a0009ca0 tx=0x7f48a0011810 comp rx=0 tx=0).stop 2024-09-15T22:27:30.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.913+0000 7f48aa000640 1 -- 172.21.15.1:0/1358810493 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f48980cfd20 con 0x7f48ac104f50 2024-09-15T22:27:30.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.913+0000 7f48b7087740 1 -- 172.21.15.1:0/2912227468 shutdown_connections 2024-09-15T22:27:30.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.913+0000 7f48b7087740 1 --2- 172.21.15.1:0/2912227468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5597babc9a60 0x5597babcbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.913+0000 7f48b7087740 1 --2- 172.21.15.1:0/2912227468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597babc49d0 0x5597babc9490 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.913+0000 7f48b7087740 1 --2- 172.21.15.1:0/2912227468 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597babc4090 0x5597babc4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.913+0000 7f48b7087740 1 -- 172.21.15.1:0/2912227468 >> 172.21.15.1:0/2912227468 conn(0x5597babbf700 msgr2=0x5597babbfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:30.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.913+0000 7f48b2200640 1 --2- 172.21.15.1:0/1358810493 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f48940a32c0 0x7f48940a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:30.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.913+0000 7f48b7087740 1 -- 172.21.15.1:0/2912227468 shutdown_connections 2024-09-15T22:27:30.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.913+0000 7f48b7087740 1 -- 172.21.15.1:0/2912227468 wait complete. 2024-09-15T22:27:30.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.913+0000 7f48b7087740 1 -- start start 2024-09-15T22:27:30.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.913+0000 7f48b2200640 1 --2- 172.21.15.1:0/1358810493 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f48940a32c0 0x7f48940a5780 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f48a4005e30 tx=0x7f48a4031bb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:30.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.913+0000 7f48b7087740 1 Processor -- start 2024-09-15T22:27:30.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.914+0000 7f48b7087740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5597babc4090 0x5597babce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:30.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.914+0000 7f48b7087740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597babc49d0 0x5597babce720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:30.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.914+0000 7f48b7087740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597babc9a60 0x5597babd5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:30.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.914+0000 7f48b7087740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5597babcca30 con 0x5597babc9a60 2024-09-15T22:27:30.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.914+0000 7f48b7087740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5597baab2090 con 0x5597babc49d0 2024-09-15T22:27:30.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.914+0000 7f48b7087740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5597babccbb0 con 0x5597babc4090 2024-09-15T22:27:30.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.914+0000 7f48b7087740 10 client.0 _ll_register_callbacks cb 0x5597bab06f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:27:30.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.914+0000 7f48b1800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5597babc4090 0x5597babce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:30.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.914+0000 7f48b1800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5597babc4090 0x5597babce1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:35718/0 (socket says 172.21.15.1:35718) 2024-09-15T22:27:30.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.914+0000 7f48b1800640 1 -- 172.21.15.1:0/4191259469 learned_addr learned my addr 172.21.15.1:0/4191259469 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:27:30.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.914+0000 7f48b0e00640 1 --2- 172.21.15.1:0/4191259469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597babc49d0 0x5597babce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:30.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.914+0000 7f48b2200640 1 --2- 172.21.15.1:0/4191259469 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597babc9a60 0x5597babd5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:30.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.915+0000 7f48b1800640 1 -- 172.21.15.1:0/4191259469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597babc49d0 msgr2=0x5597babce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:30.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.915+0000 7f48b1800640 1 --2- 172.21.15.1:0/4191259469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597babc49d0 0x5597babce720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.915+0000 7f48b1800640 1 -- 172.21.15.1:0/4191259469 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597babc9a60 msgr2=0x5597babd5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:30.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.915+0000 7f48b1800640 1 --2- 172.21.15.1:0/4191259469 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597babc9a60 0x5597babd5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.915+0000 7f48b1800640 1 -- 172.21.15.1:0/4191259469 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597ba908620 con 0x5597babc4090 2024-09-15T22:27:30.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.915+0000 7f48b0e00640 1 --2- 172.21.15.1:0/4191259469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597babc49d0 0x5597babce720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:27:30.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.915+0000 7f48b1800640 1 --2- 172.21.15.1:0/4191259469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5597babc4090 0x5597babce1e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f48a0011d10 tx=0x7f48a00035f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b3991c7343f52e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:30.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.915+0000 7f4893400640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-15T22:27:30.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.915+0000 7f4893400640 1 -- 172.21.15.1:0/4191259469 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a0028070 con 0x5597babc4090 2024-09-15T22:27:30.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.915+0000 7f48b7087740 1 -- 172.21.15.1:0/4191259469 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48a00043c0 con 0x5597babc4090 2024-09-15T22:27:30.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.915+0000 7f4893400640 1 -- 172.21.15.1:0/4191259469 <== mon.1 v2:172.21.15.98:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f48a00039f0 con 0x5597babc4090 2024-09-15T22:27:30.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.916+0000 7f4893400640 1 -- 172.21.15.1:0/4191259469 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f48a0034050 con 0x5597babc4090 2024-09-15T22:27:30.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.916+0000 7f48b7087740 10 client.25255 fetch_fsmap learned FSMap version 28 2024-09-15T22:27:30.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.916+0000 7f48b7087740 1 -- 172.21.15.1:0/4191259469 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5597babd85a0 con 0x5597babc4090 2024-09-15T22:27:30.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.916+0000 7f4893400640 1 -- 172.21.15.1:0/4191259469 <== mon.1 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48a00043c0 con 0x5597babc4090 2024-09-15T22:27:30.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.916+0000 7f4893400640 1 -- 172.21.15.1:0/4191259469 <== mon.1 v2:172.21.15.98:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f48a00195d0 con 0x5597babc4090 2024-09-15T22:27:30.925 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.917+0000 7f48b7087740 10 client.25255 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:27:30.925 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.917+0000 7f48b7087740 10 client.25255 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T22:27:30.925 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.917+0000 7f48b7087740 20 client.25255 populate_metadata read hostname 'smithi001' 2024-09-15T22:27:30.925 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.917+0000 7f48b7087740 1 --2- 172.21.15.1:0/4191259469 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x5597babd9b50 0x5597babdbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:30.925 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.917+0000 7f48b7087740 4 client.25255 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:27:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.917+0000 7f48b7087740 1 -- 172.21.15.1:0/4191259469 --> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597bab36830 con 0x5597babd9b50 2024-09-15T22:27:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.917+0000 7f48b0e00640 1 --2- 172.21.15.1:0/4191259469 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x5597babd9b50 0x5597babdbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.917+0000 7f48b0e00640 1 --2- 172.21.15.1:0/4191259469 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x5597babd9b50 0x5597babdbfd0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4868f588a43860a server_cookie=2a9902731c7c3d3c in_seq=0 out_seq=0 2024-09-15T22:27:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.917+0000 7f4893400640 10 client.25255 ms_handle_connect on v2:172.21.15.98:6838/2831161859 2024-09-15T22:27:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.918+0000 7f4893400640 1 -- 172.21.15.1:0/4191259469 <== mds.0 v2:172.21.15.98:6838/2831161859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5597bab36830 con 0x5597babd9b50 2024-09-15T22:27:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.918+0000 7f4893400640 10 client.25255 handle_command_reply: tid=0 2024-09-15T22:27:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.918+0000 7f48b7087740 1 client.25255 shutdown 2024-09-15T22:27:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.918+0000 7f48b7087740 1 -- 172.21.15.1:0/4191259469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5597babc4090 msgr2=0x5597babce1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.918+0000 7f48b7087740 1 --2- 172.21.15.1:0/4191259469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5597babc4090 0x5597babce1e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f48a0011d10 tx=0x7f48a00035f0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.918+0000 7f48b7087740 1 -- 172.21.15.1:0/4191259469 shutdown_connections 2024-09-15T22:27:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.918+0000 7f48b7087740 1 --2- 172.21.15.1:0/4191259469 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x5597babd9b50 0x5597babdbfd0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.918+0000 7f48b7087740 1 --2- 172.21.15.1:0/4191259469 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597babc9a60 0x5597babd5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.918+0000 7f4893400640 0 client.25255 ms_handle_reset on v2:172.21.15.98:6838/2831161859 2024-09-15T22:27:30.927 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.918+0000 7f48b7087740 1 --2- 172.21.15.1:0/4191259469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597babc49d0 0x5597babce720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.927 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.918+0000 7f48b7087740 1 --2- 172.21.15.1:0/4191259469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5597babc4090 0x5597babce1e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.927 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.918+0000 7f48b7087740 1 -- 172.21.15.1:0/4191259469 >> 172.21.15.1:0/4191259469 conn(0x5597babbf700 msgr2=0x5597babc0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:30.927 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.919+0000 7f48b7087740 1 -- 172.21.15.1:0/4191259469 shutdown_connections 2024-09-15T22:27:30.927 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.919+0000 7f48b7087740 1 -- 172.21.15.1:0/4191259469 wait complete. 2024-09-15T22:27:30.927 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.919+0000 7f48b7087740 20 client.25255 trim_cache size 0 max 16384 2024-09-15T22:27:30.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.934+0000 7f48b7087740 1 Processor -- start 2024-09-15T22:27:30.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.935+0000 7f48b7087740 1 -- start start 2024-09-15T22:27:30.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.935+0000 7f48b7087740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597babc4090 0x5597babc0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:30.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.935+0000 7f48b7087740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5597babc49d0 0x5597babd5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:30.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.935+0000 7f48b7087740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597babc9a60 0x5597babc1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:30.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.935+0000 7f48b7087740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac1adcd0 con 0x5597babc4090 2024-09-15T22:27:30.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.935+0000 7f48b7087740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac1ab510 con 0x5597babc9a60 2024-09-15T22:27:30.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.935+0000 7f48b7087740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac1a9360 con 0x5597babc49d0 2024-09-15T22:27:30.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.935+0000 7f48b0e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5597babc49d0 0x5597babd5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:30.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.935+0000 7f48b2200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597babc9a60 0x5597babc1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:30.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.935+0000 7f48b0e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5597babc49d0 0x5597babd5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:35722/0 (socket says 172.21.15.1:35722) 2024-09-15T22:27:30.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.935+0000 7f48b0e00640 1 -- 172.21.15.1:0/831170077 learned_addr learned my addr 172.21.15.1:0/831170077 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:27:30.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.935+0000 7f48b1800640 1 --2- 172.21.15.1:0/831170077 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597babc4090 0x5597babc0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:30.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.935+0000 7f48b0e00640 1 -- 172.21.15.1:0/831170077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597babc9a60 msgr2=0x5597babc1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:30.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.935+0000 7f48b0e00640 1 --2- 172.21.15.1:0/831170077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597babc9a60 0x5597babc1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.935+0000 7f48b0e00640 1 -- 172.21.15.1:0/831170077 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597babc4090 msgr2=0x5597babc0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:30.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.935+0000 7f48b0e00640 1 --2- 172.21.15.1:0/831170077 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597babc4090 0x5597babc0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.935+0000 7f48b0e00640 1 -- 172.21.15.1:0/831170077 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597babcc910 con 0x5597babc49d0 2024-09-15T22:27:30.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.936+0000 7f48b0e00640 1 --2- 172.21.15.1:0/831170077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5597babc49d0 0x5597babd5720 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4898098c00 tx=0x7f48980bc040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38f4950d1ef9bc20 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:30.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.936+0000 7f489e000640 1 -- 172.21.15.1:0/831170077 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f489809c280 con 0x5597babc49d0 2024-09-15T22:27:30.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.936+0000 7f489e000640 1 -- 172.21.15.1:0/831170077 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48980a0630 con 0x5597babc49d0 2024-09-15T22:27:30.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.936+0000 7f489e000640 1 -- 172.21.15.1:0/831170077 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48980a0170 con 0x5597babc49d0 2024-09-15T22:27:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.937+0000 7f48b7087740 1 -- 172.21.15.1:0/831170077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5597babc49d0 msgr2=0x5597babd5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.937+0000 7f48b7087740 1 --2- 172.21.15.1:0/831170077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5597babc49d0 0x5597babd5720 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4898098c00 tx=0x7f48980bc040 comp rx=0 tx=0).stop 2024-09-15T22:27:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.937+0000 7f48b7087740 1 -- 172.21.15.1:0/831170077 shutdown_connections 2024-09-15T22:27:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.937+0000 7f48b7087740 1 --2- 172.21.15.1:0/831170077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597babc9a60 0x5597babc1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.937+0000 7f48b7087740 1 --2- 172.21.15.1:0/831170077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5597babc49d0 0x5597babd5720 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.937+0000 7f48b7087740 1 --2- 172.21.15.1:0/831170077 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597babc4090 0x5597babc0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.937+0000 7f48b7087740 1 -- 172.21.15.1:0/831170077 >> 172.21.15.1:0/831170077 conn(0x5597babbf700 msgr2=0x5597babcd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.937+0000 7f48b7087740 1 -- 172.21.15.1:0/831170077 shutdown_connections 2024-09-15T22:27:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.937+0000 7f48b7087740 1 -- 172.21.15.1:0/831170077 wait complete. 2024-09-15T22:27:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.937+0000 7f48b7087740 1 -- start start 2024-09-15T22:27:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.937+0000 7f48b7087740 1 Processor -- start 2024-09-15T22:27:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.938+0000 7f48b7087740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597babc4090 0x5597babd25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.938+0000 7f48b7087740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597babc49d0 0x5597babd2af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.938+0000 7f48b7087740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5597babc9a60 0x5597bac42860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.938+0000 7f48b7087740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac1a99d0 con 0x5597babc4090 2024-09-15T22:27:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.938+0000 7f48b7087740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac1aae40 con 0x5597babc49d0 2024-09-15T22:27:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.938+0000 7f48b7087740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac1aa0a0 con 0x5597babc9a60 2024-09-15T22:27:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.938+0000 7f48b7087740 10 client.0 _ll_register_callbacks cb 0x7f48a0009af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:27:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.938+0000 7f48b0e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597babc49d0 0x5597babd2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.938+0000 7f48b1800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597babc4090 0x5597babd25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.938+0000 7f48b0e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597babc49d0 0x5597babd2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:40730/0 (socket says 172.21.15.1:40730) 2024-09-15T22:27:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.938+0000 7f48b0e00640 1 -- 172.21.15.1:0/1114108152 learned_addr learned my addr 172.21.15.1:0/1114108152 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:27:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.938+0000 7f48b2200640 1 --2- 172.21.15.1:0/1114108152 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5597babc9a60 0x5597bac42860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.938+0000 7f48b0e00640 1 -- 172.21.15.1:0/1114108152 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5597babc9a60 msgr2=0x5597bac42860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.938+0000 7f48b0e00640 1 --2- 172.21.15.1:0/1114108152 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5597babc9a60 0x5597bac42860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.938+0000 7f48b0e00640 1 -- 172.21.15.1:0/1114108152 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597babc4090 msgr2=0x5597babd25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.938+0000 7f48b0e00640 1 --2- 172.21.15.1:0/1114108152 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597babc4090 0x5597babd25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.938+0000 7f48b0e00640 1 -- 172.21.15.1:0/1114108152 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597bac42da0 con 0x5597babc49d0 2024-09-15T22:27:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.939+0000 7f48b0e00640 1 --2- 172.21.15.1:0/1114108152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597babc49d0 0x5597babd2af0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f489800c6a0 tx=0x7f4898005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26d259bedcbb17af server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.939+0000 7f4893400640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-15T22:27:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.939+0000 7f4893400640 1 -- 172.21.15.1:0/1114108152 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f489809c280 con 0x5597babc49d0 2024-09-15T22:27:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.939+0000 7f4893400640 1 -- 172.21.15.1:0/1114108152 <== mon.2 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f489809a320 con 0x5597babc49d0 2024-09-15T22:27:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.939+0000 7f48b7087740 1 -- 172.21.15.1:0/1114108152 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48980a0630 con 0x5597babc49d0 2024-09-15T22:27:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.939+0000 7f4893400640 1 -- 172.21.15.1:0/1114108152 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f489809a580 con 0x5597babc49d0 2024-09-15T22:27:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.939+0000 7f48b7087740 10 client.25232 fetch_fsmap learned FSMap version 28 2024-09-15T22:27:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.939+0000 7f48b7087740 1 -- 172.21.15.1:0/1114108152 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5597bac44050 con 0x5597babc49d0 2024-09-15T22:27:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.939+0000 7f4893400640 1 -- 172.21.15.1:0/1114108152 <== mon.2 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48980a0630 con 0x5597babc49d0 2024-09-15T22:27:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.939+0000 7f4893400640 1 -- 172.21.15.1:0/1114108152 <== mon.2 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f48980bc0b0 con 0x5597babc49d0 2024-09-15T22:27:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.939+0000 7f48b7087740 10 client.25232 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:27:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.939+0000 7f48b7087740 10 client.25232 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T22:27:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.939+0000 7f48b7087740 20 client.25232 populate_metadata read hostname 'smithi001' 2024-09-15T22:27:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.939+0000 7f48b7087740 1 --2- 172.21.15.1:0/1114108152 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x5597babd9b50 0x5597bac46a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.939+0000 7f48b7087740 4 client.25232 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:27:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.939+0000 7f48b7087740 1 -- 172.21.15.1:0/1114108152 --> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5597bab30b80 con 0x5597babd9b50 2024-09-15T22:27:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.940+0000 7f48b1800640 1 --2- 172.21.15.1:0/1114108152 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x5597babd9b50 0x5597bac46a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.940+0000 7f48b1800640 1 --2- 172.21.15.1:0/1114108152 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x5597babd9b50 0x5597bac46a40 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1700f30e22ee52 server_cookie=4a74e66fd7b73f59 in_seq=0 out_seq=0 2024-09-15T22:27:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.940+0000 7f4893400640 10 client.25232 ms_handle_connect on v2:172.21.15.98:6838/2831161859 2024-09-15T22:27:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.953+0000 7f4893400640 1 -- 172.21.15.1:0/1114108152 <== mds.0 v2:172.21.15.98:6838/2831161859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5597bab30b80 con 0x5597babd9b50 2024-09-15T22:27:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.953+0000 7f4893400640 10 client.25232 handle_command_reply: tid=0 2024-09-15T22:27:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.953+0000 7f48b7087740 1 client.25232 shutdown 2024-09-15T22:27:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.954+0000 7f48b7087740 1 -- 172.21.15.1:0/1114108152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597babc49d0 msgr2=0x5597babd2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.954+0000 7f48b7087740 1 --2- 172.21.15.1:0/1114108152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597babc49d0 0x5597babd2af0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f489800c6a0 tx=0x7f4898005740 comp rx=0 tx=0).stop 2024-09-15T22:27:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.954+0000 7f48b7087740 1 -- 172.21.15.1:0/1114108152 shutdown_connections 2024-09-15T22:27:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.954+0000 7f48b7087740 1 --2- 172.21.15.1:0/1114108152 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5597babc9a60 0x5597bac42860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.954+0000 7f48b7087740 1 --2- 172.21.15.1:0/1114108152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597babc49d0 0x5597babd2af0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.954+0000 7f48b7087740 1 --2- 172.21.15.1:0/1114108152 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x5597babd9b50 0x5597bac46a40 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.954+0000 7f48b7087740 1 --2- 172.21.15.1:0/1114108152 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5597babc4090 0x5597babd25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.954+0000 7f48b7087740 1 -- 172.21.15.1:0/1114108152 >> 172.21.15.1:0/1114108152 conn(0x5597babbf700 msgr2=0x5597babce000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.954+0000 7f4893400640 0 client.25232 ms_handle_reset on v2:172.21.15.98:6838/2831161859 2024-09-15T22:27:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.954+0000 7f48b7087740 1 -- 172.21.15.1:0/1114108152 shutdown_connections 2024-09-15T22:27:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.954+0000 7f48b7087740 1 -- 172.21.15.1:0/1114108152 wait complete. 2024-09-15T22:27:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.954+0000 7f48b7087740 20 client.25232 trim_cache size 0 max 16384 2024-09-15T22:27:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-15T22:27:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-15T22:27:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-15T22:27:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-15T22:27:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.955+0000 7f48b4200640 1 -- 172.21.15.1:0/1358810493 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f48940a32c0 msgr2=0x7f48940a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.955+0000 7f48b4200640 1 --2- 172.21.15.1:0/1358810493 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f48940a32c0 0x7f48940a5780 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f48a4005e30 tx=0x7f48a4031bb0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.955+0000 7f48b4200640 1 -- 172.21.15.1:0/1358810493 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48ac104f50 msgr2=0x7f48ac19a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.955+0000 7f48b4200640 1 --2- 172.21.15.1:0/1358810493 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48ac104f50 0x7f48ac19a570 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f489800e9f0 tx=0x7f489800edf0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.955+0000 7f48b4200640 1 -- 172.21.15.1:0/1358810493 shutdown_connections 2024-09-15T22:27:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.955+0000 7f48b4200640 1 --2- 172.21.15.1:0/1358810493 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f48940a32c0 0x7f48940a5780 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.955+0000 7f48b4200640 1 --2- 172.21.15.1:0/1358810493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48ac105910 0x7f48ac1a15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.955+0000 7f48b4200640 1 --2- 172.21.15.1:0/1358810493 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48ac104f50 0x7f48ac19a570 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.955+0000 7f48b4200640 1 --2- 172.21.15.1:0/1358810493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48ac103d60 0x7f48ac19a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:30.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.955+0000 7f48b4200640 1 -- 172.21.15.1:0/1358810493 >> 172.21.15.1:0/1358810493 conn(0x7f48ac0ff4e0 msgr2=0x7f48ac108250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:30.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.955+0000 7f48b4200640 1 -- 172.21.15.1:0/1358810493 shutdown_connections 2024-09-15T22:27:30.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:30.955+0000 7f48b4200640 1 -- 172.21.15.1:0/1358810493 wait complete. 2024-09-15T22:27:31.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:31 smithi098 ceph-mon[35514]: pgmap v435: 97 pgs: 97 active+clean; 97 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 332 op/s 2024-09-15T22:27:31.375 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:31 smithi001 ceph-mon[30843]: pgmap v435: 97 pgs: 97 active+clean; 97 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 332 op/s 2024-09-15T22:27:31.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:31 smithi012 ceph-mon[34883]: pgmap v435: 97 pgs: 97 active+clean; 97 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 332 op/s 2024-09-15T22:27:33.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:33 smithi098 ceph-mon[35514]: pgmap v436: 97 pgs: 97 active+clean; 96 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 378 op/s 2024-09-15T22:27:33.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:33 smithi001 ceph-mon[30843]: pgmap v436: 97 pgs: 97 active+clean; 96 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 378 op/s 2024-09-15T22:27:33.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:33 smithi012 ceph-mon[34883]: pgmap v436: 97 pgs: 97 active+clean; 96 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 378 op/s 2024-09-15T22:27:35.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:35 smithi098 ceph-mon[35514]: pgmap v437: 97 pgs: 97 active+clean; 96 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 297 op/s 2024-09-15T22:27:35.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:35 smithi001 ceph-mon[30843]: pgmap v437: 97 pgs: 97 active+clean; 96 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 297 op/s 2024-09-15T22:27:35.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:35 smithi012 ceph-mon[34883]: pgmap v437: 97 pgs: 97 active+clean; 96 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 297 op/s 2024-09-15T22:27:37.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:37 smithi098 ceph-mon[35514]: pgmap v438: 97 pgs: 97 active+clean; 86 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 444 op/s 2024-09-15T22:27:37.375 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:37 smithi001 ceph-mon[30843]: pgmap v438: 97 pgs: 97 active+clean; 86 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 444 op/s 2024-09-15T22:27:37.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:37 smithi012 ceph-mon[34883]: pgmap v438: 97 pgs: 97 active+clean; 86 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 444 op/s 2024-09-15T22:27:39.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:39 smithi098 ceph-mon[35514]: pgmap v439: 97 pgs: 97 active+clean; 92 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 349 op/s 2024-09-15T22:27:39.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:39 smithi001 ceph-mon[30843]: pgmap v439: 97 pgs: 97 active+clean; 92 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 349 op/s 2024-09-15T22:27:39.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:39 smithi012 ceph-mon[34883]: pgmap v439: 97 pgs: 97 active+clean; 92 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 349 op/s 2024-09-15T22:27:41.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:41 smithi098 ceph-mon[35514]: pgmap v440: 97 pgs: 97 active+clean; 88 MiB data, 892 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 403 op/s 2024-09-15T22:27:41.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:41 smithi001 ceph-mon[30843]: pgmap v440: 97 pgs: 97 active+clean; 88 MiB data, 892 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 403 op/s 2024-09-15T22:27:41.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:41 smithi012 ceph-mon[34883]: pgmap v440: 97 pgs: 97 active+clean; 88 MiB data, 892 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 403 op/s 2024-09-15T22:27:43.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:43 smithi098 ceph-mon[35514]: pgmap v441: 97 pgs: 97 active+clean; 92 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 423 op/s 2024-09-15T22:27:43.375 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:43 smithi001 ceph-mon[30843]: pgmap v441: 97 pgs: 97 active+clean; 92 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 423 op/s 2024-09-15T22:27:43.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:43 smithi012 ceph-mon[34883]: pgmap v441: 97 pgs: 97 active+clean; 92 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 423 op/s 2024-09-15T22:27:44.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.081+0000 7f78abe00640 1 -- 172.21.15.1:0/1684386385 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78ac076230 msgr2=0x7f78ac074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:44.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.081+0000 7f78abe00640 1 --2- 172.21.15.1:0/1684386385 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78ac076230 0x7f78ac074680 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f78a4009ca0 tx=0x7f78a402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.081+0000 7f78abe00640 1 -- 172.21.15.1:0/1684386385 shutdown_connections 2024-09-15T22:27:44.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.081+0000 7f78abe00640 1 --2- 172.21.15.1:0/1684386385 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78ac10df80 0x7f78ac110370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.081+0000 7f78abe00640 1 --2- 172.21.15.1:0/1684386385 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78ac074c50 0x7f78ac0750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.081+0000 7f78abe00640 1 --2- 172.21.15.1:0/1684386385 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78ac076230 0x7f78ac074680 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.081+0000 7f78abe00640 1 -- 172.21.15.1:0/1684386385 >> 172.21.15.1:0/1684386385 conn(0x7f78ac0fd130 msgr2=0x7f78ac0ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:44.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.082+0000 7f78abe00640 1 -- 172.21.15.1:0/1684386385 shutdown_connections 2024-09-15T22:27:44.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.082+0000 7f78abe00640 1 -- 172.21.15.1:0/1684386385 wait complete. 2024-09-15T22:27:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.083+0000 7f78abe00640 1 Processor -- start 2024-09-15T22:27:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.083+0000 7f78abe00640 1 -- start start 2024-09-15T22:27:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.083+0000 7f78abe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78ac074c50 0x7f78ac19e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.083+0000 7f78abe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78ac10df80 0x7f78ac19e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.083+0000 7f78abe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78ac1a3a30 0x7f78ac1a5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.083+0000 7f78abe00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f78ac113c50 con 0x7f78ac1a3a30 2024-09-15T22:27:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.083+0000 7f78abe00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f78ac113ad0 con 0x7f78ac074c50 2024-09-15T22:27:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.083+0000 7f78abe00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f78ac113dd0 con 0x7f78ac10df80 2024-09-15T22:27:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.083+0000 7f78aaa00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78ac074c50 0x7f78ac19e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.083+0000 7f78aa000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78ac10df80 0x7f78ac19e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.083+0000 7f78aaa00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78ac074c50 0x7f78ac19e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:55412/0 (socket says 172.21.15.1:55412) 2024-09-15T22:27:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.083+0000 7f78aaa00640 1 -- 172.21.15.1:0/2874201533 learned_addr learned my addr 172.21.15.1:0/2874201533 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:27:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.084+0000 7f78ab400640 1 --2- 172.21.15.1:0/2874201533 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78ac1a3a30 0x7f78ac1a5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:44.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.084+0000 7f78aa000640 1 -- 172.21.15.1:0/2874201533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78ac074c50 msgr2=0x7f78ac19e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:44.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.084+0000 7f78aa000640 1 --2- 172.21.15.1:0/2874201533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78ac074c50 0x7f78ac19e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.084+0000 7f78aa000640 1 -- 172.21.15.1:0/2874201533 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78ac1a3a30 msgr2=0x7f78ac1a5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:44.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.084+0000 7f78aa000640 1 --2- 172.21.15.1:0/2874201533 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78ac1a3a30 0x7f78ac1a5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.084+0000 7f78aa000640 1 -- 172.21.15.1:0/2874201533 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78ac1a6490 con 0x7f78ac10df80 2024-09-15T22:27:44.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.084+0000 7f78aaa00640 1 --2- 172.21.15.1:0/2874201533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78ac074c50 0x7f78ac19e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:27:44.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.084+0000 7f78aa000640 1 --2- 172.21.15.1:0/2874201533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78ac10df80 0x7f78ac19e9d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f789800e9f0 tx=0x7f789800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.084+0000 7f78b0a00640 1 -- 172.21.15.1:0/2874201533 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789800cd80 con 0x7f78ac10df80 2024-09-15T22:27:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.084+0000 7f78abe00640 1 -- 172.21.15.1:0/2874201533 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78ac1a6780 con 0x7f78ac10df80 2024-09-15T22:27:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.084+0000 7f78b0a00640 1 -- 172.21.15.1:0/2874201533 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78980035f0 con 0x7f78ac10df80 2024-09-15T22:27:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.084+0000 7f78b0a00640 1 -- 172.21.15.1:0/2874201533 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7898010670 con 0x7f78ac10df80 2024-09-15T22:27:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.085+0000 7f78abe00640 1 -- 172.21.15.1:0/2874201533 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78ac1a6d20 con 0x7f78ac10df80 2024-09-15T22:27:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.088+0000 7f78b4e4c740 1 Processor -- start 2024-09-15T22:27:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.088+0000 7f78b0a00640 1 -- 172.21.15.1:0/2874201533 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f78980037a0 con 0x7f78ac10df80 2024-09-15T22:27:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.088+0000 7f78b4e4c740 1 -- start start 2024-09-15T22:27:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.088+0000 7f78b4e4c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda2785260 0x55dda2785660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.088+0000 7f78b4e4c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda2785ba0 0x55dda278a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.088+0000 7f78b4e4c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dda278ac30 0x55dda278d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.088+0000 7f78b4e4c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55dda26ea100 con 0x55dda2785260 2024-09-15T22:27:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.088+0000 7f78b4e4c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55dda26921b0 con 0x55dda2785ba0 2024-09-15T22:27:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.088+0000 7f78b4e4c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55dda26e60c0 con 0x55dda278ac30 2024-09-15T22:27:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.088+0000 7f78aaa00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda2785ba0 0x55dda278a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.088+0000 7f78aaa00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda2785ba0 0x55dda278a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:55426/0 (socket says 172.21.15.1:55426) 2024-09-15T22:27:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.088+0000 7f78aaa00640 1 -- 172.21.15.1:0/1390290780 learned_addr learned my addr 172.21.15.1:0/1390290780 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:27:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.089+0000 7f78ab400640 1 --2- 172.21.15.1:0/1390290780 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda2785260 0x55dda2785660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.089+0000 7f78aa000640 1 --2- 172.21.15.1:0/1390290780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dda278ac30 0x55dda278d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.089+0000 7f78aaa00640 1 -- 172.21.15.1:0/1390290780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dda278ac30 msgr2=0x55dda278d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.089+0000 7f78aaa00640 1 --2- 172.21.15.1:0/1390290780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dda278ac30 0x55dda278d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.089+0000 7f78aaa00640 1 -- 172.21.15.1:0/1390290780 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda2785260 msgr2=0x55dda2785660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.089+0000 7f78aaa00640 1 --2- 172.21.15.1:0/1390290780 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda2785260 0x55dda2785660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.089+0000 7f78aaa00640 1 -- 172.21.15.1:0/1390290780 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dda23fd210 con 0x55dda2785ba0 2024-09-15T22:27:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.090+0000 7f78aaa00640 1 --2- 172.21.15.1:0/1390290780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda2785ba0 0x55dda278a660 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f78a402aeb0 tx=0x7f78a4009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2245c5c49c5f5ec1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.090+0000 7f7897e00640 1 -- 172.21.15.1:0/1390290780 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a4031650 con 0x55dda2785ba0 2024-09-15T22:27:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.090+0000 7f7897e00640 1 -- 172.21.15.1:0/1390290780 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78a4036040 con 0x55dda2785ba0 2024-09-15T22:27:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.090+0000 7f7897e00640 1 -- 172.21.15.1:0/1390290780 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a4004040 con 0x55dda2785ba0 2024-09-15T22:27:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.091+0000 7f78b0a00640 1 --2- 172.21.15.1:0/2874201533 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f78900a3230 0x7f78900a56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:44.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.091+0000 7f78b4e4c740 1 -- 172.21.15.1:0/1390290780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda2785ba0 msgr2=0x55dda278a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:44.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.091+0000 7f78b4e4c740 1 --2- 172.21.15.1:0/1390290780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda2785ba0 0x55dda278a660 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f78a402aeb0 tx=0x7f78a4009a20 comp rx=0 tx=0).stop 2024-09-15T22:27:44.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.092+0000 7f78b0a00640 1 -- 172.21.15.1:0/2874201533 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f78980cfcb0 con 0x7f78ac10df80 2024-09-15T22:27:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.093+0000 7f78ab400640 1 --2- 172.21.15.1:0/2874201533 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f78900a3230 0x7f78900a56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.094+0000 7f78b4e4c740 1 -- 172.21.15.1:0/1390290780 shutdown_connections 2024-09-15T22:27:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.094+0000 7f78b4e4c740 1 --2- 172.21.15.1:0/1390290780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dda278ac30 0x55dda278d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.094+0000 7f78b4e4c740 1 --2- 172.21.15.1:0/1390290780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda2785ba0 0x55dda278a660 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.094+0000 7f78b4e4c740 1 --2- 172.21.15.1:0/1390290780 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda2785260 0x55dda2785660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.094+0000 7f78b4e4c740 1 -- 172.21.15.1:0/1390290780 >> 172.21.15.1:0/1390290780 conn(0x55dda27808d0 msgr2=0x55dda2780cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.094+0000 7f78b4e4c740 1 -- 172.21.15.1:0/1390290780 shutdown_connections 2024-09-15T22:27:44.097 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.094+0000 7f78b4e4c740 1 -- 172.21.15.1:0/1390290780 wait complete. 2024-09-15T22:27:44.097 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.094+0000 7f78b4e4c740 1 -- start start 2024-09-15T22:27:44.097 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.095+0000 7f78b4e4c740 1 Processor -- start 2024-09-15T22:27:44.097 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.095+0000 7f78ab400640 1 --2- 172.21.15.1:0/2874201533 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f78900a3230 0x7f78900a56f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f789c00b650 tx=0x7f789c00b2e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:44.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.096+0000 7f78b4e4c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda2785260 0x55dda278f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:44.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.096+0000 7f78b4e4c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dda2785ba0 0x55dda278f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:44.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.096+0000 7f78b4e4c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda278ac30 0x55dda2796790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:44.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.096+0000 7f78b4e4c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55dda278da20 con 0x55dda278ac30 2024-09-15T22:27:44.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.096+0000 7f78b4e4c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55dda2673090 con 0x55dda2785260 2024-09-15T22:27:44.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.096+0000 7f78b4e4c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55dda278dba0 con 0x55dda2785ba0 2024-09-15T22:27:44.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.096+0000 7f78b4e4c740 10 client.0 _ll_register_callbacks cb 0x55dda26c7f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:27:44.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.096+0000 7f78aaa00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda2785260 0x55dda278f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:44.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.096+0000 7f78aaa00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda2785260 0x55dda278f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:55440/0 (socket says 172.21.15.1:55440) 2024-09-15T22:27:44.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.096+0000 7f78aaa00640 1 -- 172.21.15.1:0/2696108636 learned_addr learned my addr 172.21.15.1:0/2696108636 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:27:44.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.096+0000 7f78aa000640 1 --2- 172.21.15.1:0/2696108636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dda2785ba0 0x55dda278f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:44.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.096+0000 7f78ab400640 1 --2- 172.21.15.1:0/2696108636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda278ac30 0x55dda2796790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:44.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.097+0000 7f78aaa00640 1 -- 172.21.15.1:0/2696108636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dda2785ba0 msgr2=0x55dda278f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:44.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.097+0000 7f78aaa00640 1 --2- 172.21.15.1:0/2696108636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dda2785ba0 0x55dda278f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.097+0000 7f78aaa00640 1 -- 172.21.15.1:0/2696108636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda278ac30 msgr2=0x55dda2796790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:44.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.097+0000 7f78aaa00640 1 --2- 172.21.15.1:0/2696108636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda278ac30 0x55dda2796790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.097+0000 7f78aaa00640 1 -- 172.21.15.1:0/2696108636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dda24c9620 con 0x55dda2785260 2024-09-15T22:27:44.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.097+0000 7f78aaa00640 1 --2- 172.21.15.1:0/2696108636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda2785260 0x55dda278f210 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f78a4000f80 tx=0x7f78a4030cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f50eca6167da3230 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:44.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.097+0000 7f7894c00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-15T22:27:44.101 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.098+0000 7f7894c00640 1 -- 172.21.15.1:0/2696108636 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a4030ea0 con 0x55dda2785260 2024-09-15T22:27:44.101 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.098+0000 7f7894c00640 1 -- 172.21.15.1:0/2696108636 <== mon.2 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f78a4046650 con 0x55dda2785260 2024-09-15T22:27:44.101 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.098+0000 7f78b4e4c740 1 -- 172.21.15.1:0/2696108636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78a4036040 con 0x55dda2785260 2024-09-15T22:27:44.101 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.100+0000 7f7894c00640 1 -- 172.21.15.1:0/2696108636 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f78a4046890 con 0x55dda2785260 2024-09-15T22:27:44.102 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.100+0000 7f78b4e4c740 10 client.25244 fetch_fsmap learned FSMap version 29 2024-09-15T22:27:44.102 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.100+0000 7f78b4e4c740 1 -- 172.21.15.1:0/2696108636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55dda278da20 con 0x55dda2785260 2024-09-15T22:27:44.102 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.101+0000 7f7894c00640 1 -- 172.21.15.1:0/2696108636 <== mon.2 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78a4036040 con 0x55dda2785260 2024-09-15T22:27:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.101+0000 7f7894c00640 1 -- 172.21.15.1:0/2696108636 <== mon.2 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f78a4044070 con 0x55dda2785260 2024-09-15T22:27:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.101+0000 7f78b4e4c740 10 client.25244 fetch_fsmap finished waiting for FSMap version 29 2024-09-15T22:27:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.101+0000 7f78b4e4c740 10 client.25244 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T22:27:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.101+0000 7f78b4e4c740 20 client.25244 populate_metadata read hostname 'smithi001' 2024-09-15T22:27:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.101+0000 7f78b4e4c740 1 --2- 172.21.15.1:0/2696108636 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55dda279a980 0x55dda279cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.101+0000 7f78b4e4c740 4 client.25244 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:27:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.101+0000 7f78b4e4c740 1 -- 172.21.15.1:0/2696108636 --> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dda26f7830 con 0x55dda279a980 2024-09-15T22:27:44.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.102+0000 7f78aa000640 1 --2- 172.21.15.1:0/2696108636 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55dda279a980 0x55dda279cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:44.106 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.104+0000 7f78aa000640 1 --2- 172.21.15.1:0/2696108636 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55dda279a980 0x55dda279cdb0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cd6944fa3ed34f4 server_cookie=9bac731fbec5127a in_seq=0 out_seq=0 2024-09-15T22:27:44.106 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.104+0000 7f7894c00640 10 client.25244 ms_handle_connect on v2:172.21.15.98:6838/2831161859 2024-09-15T22:27:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.105+0000 7f7894c00640 1 -- 172.21.15.1:0/2696108636 <== mds.0 v2:172.21.15.98:6838/2831161859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dda26f7830 con 0x55dda279a980 2024-09-15T22:27:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.105+0000 7f7894c00640 10 client.25244 handle_command_reply: tid=0 2024-09-15T22:27:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.106+0000 7f78b4e4c740 1 client.25244 shutdown 2024-09-15T22:27:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.106+0000 7f78b4e4c740 1 -- 172.21.15.1:0/2696108636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda2785260 msgr2=0x55dda278f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.106+0000 7f78b4e4c740 1 --2- 172.21.15.1:0/2696108636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda2785260 0x55dda278f210 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f78a4000f80 tx=0x7f78a4030cb0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.106+0000 7f78b4e4c740 1 -- 172.21.15.1:0/2696108636 shutdown_connections 2024-09-15T22:27:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.106+0000 7f78b4e4c740 1 --2- 172.21.15.1:0/2696108636 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55dda279a980 0x55dda279cdb0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.106+0000 7f78b4e4c740 1 --2- 172.21.15.1:0/2696108636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda278ac30 0x55dda2796790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.106+0000 7f78b4e4c740 1 --2- 172.21.15.1:0/2696108636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dda2785ba0 0x55dda278f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.106+0000 7f78b4e4c740 1 --2- 172.21.15.1:0/2696108636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda2785260 0x55dda278f210 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.106+0000 7f78b4e4c740 1 -- 172.21.15.1:0/2696108636 >> 172.21.15.1:0/2696108636 conn(0x55dda27808d0 msgr2=0x55dda27820e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.106+0000 7f7894c00640 0 client.25244 ms_handle_reset on v2:172.21.15.98:6838/2831161859 2024-09-15T22:27:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.107+0000 7f78b4e4c740 1 -- 172.21.15.1:0/2696108636 shutdown_connections 2024-09-15T22:27:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.107+0000 7f78b4e4c740 1 -- 172.21.15.1:0/2696108636 wait complete. 2024-09-15T22:27:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.107+0000 7f78b4e4c740 20 client.25244 trim_cache size 0 max 16384 2024-09-15T22:27:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.138+0000 7f78b4e4c740 1 Processor -- start 2024-09-15T22:27:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.138+0000 7f78b4e4c740 1 -- start start 2024-09-15T22:27:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.138+0000 7f78b4e4c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda2785260 0x55dda278efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.138+0000 7f78b4e4c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dda2785ba0 0x55dda2796750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.138+0000 7f78b4e4c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda278ac30 0x55dda278f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.138+0000 7f78b4e4c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f78ac1b24f0 con 0x55dda278ac30 2024-09-15T22:27:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.138+0000 7f78b4e4c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f78ac1afd00 con 0x55dda2785260 2024-09-15T22:27:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.138+0000 7f78b4e4c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f78ac1adb50 con 0x55dda2785ba0 2024-09-15T22:27:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.139+0000 7f78aa000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dda2785ba0 0x55dda2796750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.139+0000 7f78aa000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dda2785ba0 0x55dda2796750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:34568/0 (socket says 172.21.15.1:34568) 2024-09-15T22:27:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.139+0000 7f78aa000640 1 -- 172.21.15.1:0/1095920378 learned_addr learned my addr 172.21.15.1:0/1095920378 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:27:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.139+0000 7f78aaa00640 1 --2- 172.21.15.1:0/1095920378 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda2785260 0x55dda278efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.139+0000 7f78ab400640 1 --2- 172.21.15.1:0/1095920378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda278ac30 0x55dda278f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.139+0000 7f78aa000640 1 -- 172.21.15.1:0/1095920378 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda2785260 msgr2=0x55dda278efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.139+0000 7f78aa000640 1 --2- 172.21.15.1:0/1095920378 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda2785260 0x55dda278efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.139+0000 7f78aa000640 1 -- 172.21.15.1:0/1095920378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda278ac30 msgr2=0x55dda278f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.139+0000 7f78aa000640 1 --2- 172.21.15.1:0/1095920378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda278ac30 0x55dda278f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.139+0000 7f78aa000640 1 -- 172.21.15.1:0/1095920378 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dda278a050 con 0x55dda2785ba0 2024-09-15T22:27:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.139+0000 7f78ab400640 1 --2- 172.21.15.1:0/1095920378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda278ac30 0x55dda278f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:27:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.139+0000 7f78aa000640 1 --2- 172.21.15.1:0/1095920378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dda2785ba0 0x55dda2796750 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7898098670 tx=0x7f7898005bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88319d3b41cefb4c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:44.146 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.140+0000 7f7897400640 1 -- 172.21.15.1:0/1095920378 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78980a4e80 con 0x55dda2785ba0 2024-09-15T22:27:44.146 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.140+0000 7f7897400640 1 -- 172.21.15.1:0/1095920378 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78980bae50 con 0x55dda2785ba0 2024-09-15T22:27:44.146 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.140+0000 7f7897400640 1 -- 172.21.15.1:0/1095920378 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7898003c50 con 0x55dda2785ba0 2024-09-15T22:27:44.146 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.140+0000 7f78b4e4c740 1 -- 172.21.15.1:0/1095920378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dda2785ba0 msgr2=0x55dda2796750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:44.146 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.140+0000 7f78b4e4c740 1 --2- 172.21.15.1:0/1095920378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dda2785ba0 0x55dda2796750 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7898098670 tx=0x7f7898005bb0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.146 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.141+0000 7f78b4e4c740 1 -- 172.21.15.1:0/1095920378 shutdown_connections 2024-09-15T22:27:44.146 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.141+0000 7f78b4e4c740 1 --2- 172.21.15.1:0/1095920378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda278ac30 0x55dda278f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.146 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.141+0000 7f78b4e4c740 1 --2- 172.21.15.1:0/1095920378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dda2785ba0 0x55dda2796750 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.146 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.141+0000 7f78b4e4c740 1 --2- 172.21.15.1:0/1095920378 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda2785260 0x55dda278efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.146 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.141+0000 7f78b4e4c740 1 -- 172.21.15.1:0/1095920378 >> 172.21.15.1:0/1095920378 conn(0x55dda27808d0 msgr2=0x55dda278a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.141+0000 7f78b4e4c740 1 -- 172.21.15.1:0/1095920378 shutdown_connections 2024-09-15T22:27:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.141+0000 7f78b4e4c740 1 -- 172.21.15.1:0/1095920378 wait complete. 2024-09-15T22:27:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.141+0000 7f78b4e4c740 1 -- start start 2024-09-15T22:27:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.141+0000 7f78b4e4c740 1 Processor -- start 2024-09-15T22:27:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.142+0000 7f78b4e4c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dda2785260 0x55dda2793530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.142+0000 7f78b4e4c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda2785ba0 0x55dda2793a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.142+0000 7f78b4e4c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda278ac30 0x55dda2803680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.142+0000 7f78b4e4c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f78ac1ae1c0 con 0x55dda278ac30 2024-09-15T22:27:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.142+0000 7f78b4e4c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f78ac1af630 con 0x55dda2785ba0 2024-09-15T22:27:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.142+0000 7f78b4e4c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f78ac1ae890 con 0x55dda2785260 2024-09-15T22:27:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.142+0000 7f78b4e4c740 10 client.0 _ll_register_callbacks cb 0x7f78a40305c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:27:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.142+0000 7f78aa000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda2785ba0 0x55dda2793a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.142+0000 7f78aaa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dda2785260 0x55dda2793530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.142+0000 7f78aa000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda2785ba0 0x55dda2793a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:55452/0 (socket says 172.21.15.1:55452) 2024-09-15T22:27:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.142+0000 7f78ab400640 1 --2- 172.21.15.1:0/3356919131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda278ac30 0x55dda2803680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.142+0000 7f78aa000640 1 -- 172.21.15.1:0/3356919131 learned_addr learned my addr 172.21.15.1:0/3356919131 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:27:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.142+0000 7f78aaa00640 1 -- 172.21.15.1:0/3356919131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda2785ba0 msgr2=0x55dda2793a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.142+0000 7f78aaa00640 1 --2- 172.21.15.1:0/3356919131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda2785ba0 0x55dda2793a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.142+0000 7f78aaa00640 1 -- 172.21.15.1:0/3356919131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda278ac30 msgr2=0x55dda2803680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.142+0000 7f78aaa00640 1 --2- 172.21.15.1:0/3356919131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda278ac30 0x55dda2803680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.142+0000 7f78aaa00640 1 -- 172.21.15.1:0/3356919131 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dda2803bc0 con 0x55dda2785260 2024-09-15T22:27:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.142+0000 7f78aaa00640 1 --2- 172.21.15.1:0/3356919131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dda2785260 0x55dda2793530 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f78a402aeb0 tx=0x7f78a40095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82ca414f4de49f89 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.142+0000 7f7894c00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-15T22:27:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.143+0000 7f7894c00640 1 -- 172.21.15.1:0/3356919131 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a4061030 con 0x55dda2785260 2024-09-15T22:27:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.143+0000 7f78b4e4c740 1 -- 172.21.15.1:0/3356919131 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78980bae50 con 0x55dda2785260 2024-09-15T22:27:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.143+0000 7f7894c00640 1 -- 172.21.15.1:0/3356919131 <== mon.1 v2:172.21.15.98:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f78a404b050 con 0x55dda2785260 2024-09-15T22:27:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.143+0000 7f7894c00640 1 -- 172.21.15.1:0/3356919131 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f78a4030d20 con 0x55dda2785260 2024-09-15T22:27:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.143+0000 7f78b4e4c740 10 client.25279 fetch_fsmap learned FSMap version 29 2024-09-15T22:27:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.143+0000 7f78b4e4c740 1 -- 172.21.15.1:0/3356919131 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55dda2804d10 con 0x55dda2785260 2024-09-15T22:27:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.143+0000 7f7894c00640 1 -- 172.21.15.1:0/3356919131 <== mon.1 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78980bae50 con 0x55dda2785260 2024-09-15T22:27:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.143+0000 7f7894c00640 1 -- 172.21.15.1:0/3356919131 <== mon.1 v2:172.21.15.98:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f78a4044040 con 0x55dda2785260 2024-09-15T22:27:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.143+0000 7f78b4e4c740 10 client.25279 fetch_fsmap finished waiting for FSMap version 29 2024-09-15T22:27:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.143+0000 7f78b4e4c740 10 client.25279 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T22:27:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.143+0000 7f78b4e4c740 20 client.25279 populate_metadata read hostname 'smithi001' 2024-09-15T22:27:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.143+0000 7f78b4e4c740 1 --2- 172.21.15.1:0/3356919131 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55dda28056f0 0x55dda2807b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.144+0000 7f78b4e4c740 4 client.25279 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:27:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.144+0000 7f78b4e4c740 1 -- 172.21.15.1:0/3356919131 --> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dda26f1b80 con 0x55dda28056f0 2024-09-15T22:27:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.144+0000 7f78aa000640 1 --2- 172.21.15.1:0/3356919131 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55dda28056f0 0x55dda2807b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:44.150 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.144+0000 7f78aa000640 1 --2- 172.21.15.1:0/3356919131 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55dda28056f0 0x55dda2807b10 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89f33752559f4cbf server_cookie=e68aac301a36147d in_seq=0 out_seq=0 2024-09-15T22:27:44.150 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.144+0000 7f7894c00640 10 client.25279 ms_handle_connect on v2:172.21.15.98:6838/2831161859 2024-09-15T22:27:44.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.155+0000 7f7894c00640 1 -- 172.21.15.1:0/3356919131 <== mds.0 v2:172.21.15.98:6838/2831161859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dda26f1b80 con 0x55dda28056f0 2024-09-15T22:27:44.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.155+0000 7f7894c00640 10 client.25279 handle_command_reply: tid=0 2024-09-15T22:27:44.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.155+0000 7f78b4e4c740 1 client.25279 shutdown 2024-09-15T22:27:44.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.155+0000 7f78b4e4c740 1 -- 172.21.15.1:0/3356919131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dda2785260 msgr2=0x55dda2793530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:44.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.155+0000 7f78b4e4c740 1 --2- 172.21.15.1:0/3356919131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dda2785260 0x55dda2793530 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f78a402aeb0 tx=0x7f78a40095c0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.155+0000 7f78b4e4c740 1 -- 172.21.15.1:0/3356919131 shutdown_connections 2024-09-15T22:27:44.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.155+0000 7f78b4e4c740 1 --2- 172.21.15.1:0/3356919131 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55dda28056f0 0x55dda2807b10 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.155+0000 7f78b4e4c740 1 --2- 172.21.15.1:0/3356919131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda278ac30 0x55dda2803680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.155+0000 7f78b4e4c740 1 --2- 172.21.15.1:0/3356919131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda2785ba0 0x55dda2793a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.155+0000 7f7894c00640 0 client.25279 ms_handle_reset on v2:172.21.15.98:6838/2831161859 2024-09-15T22:27:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.155+0000 7f78b4e4c740 1 --2- 172.21.15.1:0/3356919131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dda2785260 0x55dda2793530 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.155+0000 7f78b4e4c740 1 -- 172.21.15.1:0/3356919131 >> 172.21.15.1:0/3356919131 conn(0x55dda27808d0 msgr2=0x55dda278ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.155+0000 7f78b4e4c740 1 -- 172.21.15.1:0/3356919131 shutdown_connections 2024-09-15T22:27:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.155+0000 7f78b4e4c740 1 -- 172.21.15.1:0/3356919131 wait complete. 2024-09-15T22:27:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.155+0000 7f78b4e4c740 20 client.25279 trim_cache size 0 max 16384 2024-09-15T22:27:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-15T22:27:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-15T22:27:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-15T22:27:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-15T22:27:44.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.156+0000 7f78abe00640 1 -- 172.21.15.1:0/2874201533 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f78900a3230 msgr2=0x7f78900a56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:44.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.156+0000 7f78abe00640 1 --2- 172.21.15.1:0/2874201533 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f78900a3230 0x7f78900a56f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f789c00b650 tx=0x7f789c00b2e0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.156+0000 7f78abe00640 1 -- 172.21.15.1:0/2874201533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78ac10df80 msgr2=0x7f78ac19e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:44.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.156+0000 7f78abe00640 1 --2- 172.21.15.1:0/2874201533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78ac10df80 0x7f78ac19e9d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f789800e9f0 tx=0x7f789800eeb0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.156+0000 7f78abe00640 1 -- 172.21.15.1:0/2874201533 shutdown_connections 2024-09-15T22:27:44.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.156+0000 7f78abe00640 1 --2- 172.21.15.1:0/2874201533 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f78900a3230 0x7f78900a56f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.160 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.156+0000 7f78abe00640 1 --2- 172.21.15.1:0/2874201533 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78ac1a3a30 0x7f78ac1a5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.160 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.156+0000 7f78abe00640 1 --2- 172.21.15.1:0/2874201533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78ac10df80 0x7f78ac19e9d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.160 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.156+0000 7f78abe00640 1 --2- 172.21.15.1:0/2874201533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78ac074c50 0x7f78ac19e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:44.160 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.156+0000 7f78abe00640 1 -- 172.21.15.1:0/2874201533 >> 172.21.15.1:0/2874201533 conn(0x7f78ac0fd130 msgr2=0x7f78ac0ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:44.160 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.156+0000 7f78abe00640 1 -- 172.21.15.1:0/2874201533 shutdown_connections 2024-09-15T22:27:44.160 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:44.156+0000 7f78abe00640 1 -- 172.21.15.1:0/2874201533 wait complete. 2024-09-15T22:27:45.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:45 smithi098 ceph-mon[35514]: pgmap v442: 97 pgs: 97 active+clean; 92 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 334 op/s 2024-09-15T22:27:45.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:45 smithi098 ceph-mon[35514]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-15T22:27:45.375 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:45 smithi001 ceph-mon[30843]: pgmap v442: 97 pgs: 97 active+clean; 92 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 334 op/s 2024-09-15T22:27:45.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:45 smithi001 ceph-mon[30843]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-15T22:27:45.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:45 smithi012 ceph-mon[34883]: pgmap v442: 97 pgs: 97 active+clean; 92 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 334 op/s 2024-09-15T22:27:45.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:45 smithi012 ceph-mon[34883]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-15T22:27:47.310 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:47 smithi098 ceph-mon[35514]: pgmap v443: 97 pgs: 97 active+clean; 93 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 470 op/s 2024-09-15T22:27:47.375 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:47 smithi001 ceph-mon[30843]: pgmap v443: 97 pgs: 97 active+clean; 93 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 470 op/s 2024-09-15T22:27:47.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:47 smithi012 ceph-mon[34883]: pgmap v443: 97 pgs: 97 active+clean; 93 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 470 op/s 2024-09-15T22:27:49.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:49 smithi001 ceph-mon[30843]: pgmap v444: 97 pgs: 97 active+clean; 93 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 342 op/s 2024-09-15T22:27:49.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:49 smithi012 ceph-mon[34883]: pgmap v444: 97 pgs: 97 active+clean; 93 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 342 op/s 2024-09-15T22:27:49.560 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:49 smithi098 ceph-mon[35514]: pgmap v444: 97 pgs: 97 active+clean; 93 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 342 op/s 2024-09-15T22:27:51.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:51 smithi001 ceph-mon[30843]: pgmap v445: 97 pgs: 97 active+clean; 92 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 391 op/s 2024-09-15T22:27:51.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:51 smithi012 ceph-mon[34883]: pgmap v445: 97 pgs: 97 active+clean; 92 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 391 op/s 2024-09-15T22:27:51.560 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:51 smithi098 ceph-mon[35514]: pgmap v445: 97 pgs: 97 active+clean; 92 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 391 op/s 2024-09-15T22:27:53.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:53 smithi001 ceph-mon[30843]: pgmap v446: 97 pgs: 97 active+clean; 97 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 417 op/s 2024-09-15T22:27:53.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:53 smithi012 ceph-mon[34883]: pgmap v446: 97 pgs: 97 active+clean; 97 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 417 op/s 2024-09-15T22:27:53.560 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:53 smithi098 ceph-mon[35514]: pgmap v446: 97 pgs: 97 active+clean; 97 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 417 op/s 2024-09-15T22:27:55.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:55 smithi001 ceph-mon[30843]: pgmap v447: 97 pgs: 97 active+clean; 97 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 325 op/s 2024-09-15T22:27:55.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:55 smithi012 ceph-mon[34883]: pgmap v447: 97 pgs: 97 active+clean; 97 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 325 op/s 2024-09-15T22:27:55.560 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:55 smithi098 ceph-mon[35514]: pgmap v447: 97 pgs: 97 active+clean; 97 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 325 op/s 2024-09-15T22:27:57.021 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-15T22:27:57.021 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-15T22:27:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.276+0000 7fc1c9200640 1 -- 172.21.15.1:0/1119853815 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1c4103d50 msgr2=0x7fc1c4104150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.276+0000 7fc1c9200640 1 --2- 172.21.15.1:0/1119853815 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1c4103d50 0x7fc1c4104150 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4009860 tx=0x7fc1b402a360 comp rx=0 tx=0).stop 2024-09-15T22:27:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.276+0000 7fc1c9200640 1 -- 172.21.15.1:0/1119853815 shutdown_connections 2024-09-15T22:27:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.276+0000 7fc1c9200640 1 --2- 172.21.15.1:0/1119853815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1c4105900 0x7fc1c410c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.276+0000 7fc1c9200640 1 --2- 172.21.15.1:0/1119853815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1c4104f40 0x7fc1c41053c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.276+0000 7fc1c9200640 1 --2- 172.21.15.1:0/1119853815 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1c4103d50 0x7fc1c4104150 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.276+0000 7fc1c9200640 1 -- 172.21.15.1:0/1119853815 >> 172.21.15.1:0/1119853815 conn(0x7fc1c40ff4b0 msgr2=0x7fc1c41018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.276+0000 7fc1c9200640 1 -- 172.21.15.1:0/1119853815 shutdown_connections 2024-09-15T22:27:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.277+0000 7fc1c9200640 1 -- 172.21.15.1:0/1119853815 wait complete. 2024-09-15T22:27:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.278+0000 7fc1c9200640 1 Processor -- start 2024-09-15T22:27:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.278+0000 7fc1c9200640 1 -- start start 2024-09-15T22:27:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.278+0000 7fc1c9200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1c4103d50 0x7fc1c419a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.278+0000 7fc1c9200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1c4104f40 0x7fc1c419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.278+0000 7fc1c9200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1c4105900 0x7fc1c41a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.278+0000 7fc1c9200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c410fa00 con 0x7fc1c4104f40 2024-09-15T22:27:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.278+0000 7fc1c9200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c410f880 con 0x7fc1c4105900 2024-09-15T22:27:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.278+0000 7fc1c9200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c410fb80 con 0x7fc1c4103d50 2024-09-15T22:27:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.278+0000 7fc1c1e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1c4103d50 0x7fc1c419a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.278+0000 7fc1c1e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1c4103d50 0x7fc1c419a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:52604/0 (socket says 172.21.15.1:52604) 2024-09-15T22:27:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.278+0000 7fc1c1e00640 1 -- 172.21.15.1:0/297123510 learned_addr learned my addr 172.21.15.1:0/297123510 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:27:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.279+0000 7fc1c1400640 1 --2- 172.21.15.1:0/297123510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1c4104f40 0x7fc1c419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.279+0000 7fc1c2800640 1 --2- 172.21.15.1:0/297123510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1c4105900 0x7fc1c41a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.279+0000 7fc1c1e00640 1 -- 172.21.15.1:0/297123510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1c4105900 msgr2=0x7fc1c41a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.279+0000 7fc1c1e00640 1 --2- 172.21.15.1:0/297123510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1c4105900 0x7fc1c41a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.279+0000 7fc1c1e00640 1 -- 172.21.15.1:0/297123510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1c4104f40 msgr2=0x7fc1c419a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.279+0000 7fc1c1e00640 1 --2- 172.21.15.1:0/297123510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1c4104f40 0x7fc1c419a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.279+0000 7fc1c1e00640 1 -- 172.21.15.1:0/297123510 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c41a1cb0 con 0x7fc1c4103d50 2024-09-15T22:27:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.279+0000 7fc1c1400640 1 --2- 172.21.15.1:0/297123510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1c4104f40 0x7fc1c419a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:27:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.279+0000 7fc1c1e00640 1 --2- 172.21.15.1:0/297123510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1c4103d50 0x7fc1c419a090 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc1b40304e0 tx=0x7fc1b4030ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.279+0000 7fc1baa00640 1 -- 172.21.15.1:0/297123510 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b4037040 con 0x7fc1c4103d50 2024-09-15T22:27:57.283 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:57 smithi001 ceph-mon[30843]: pgmap v448: 97 pgs: 97 active+clean; 95 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 460 op/s 2024-09-15T22:27:57.284 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.280+0000 7fc1baa00640 1 -- 172.21.15.1:0/297123510 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1b4004050 con 0x7fc1c4103d50 2024-09-15T22:27:57.284 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.280+0000 7fc1baa00640 1 -- 172.21.15.1:0/297123510 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b40046c0 con 0x7fc1c4103d50 2024-09-15T22:27:57.284 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.280+0000 7fc1c9200640 1 -- 172.21.15.1:0/297123510 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1c41a1f40 con 0x7fc1c4103d50 2024-09-15T22:27:57.284 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.280+0000 7fc1c9200640 1 -- 172.21.15.1:0/297123510 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1c41a2350 con 0x7fc1c4103d50 2024-09-15T22:27:57.286 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.284+0000 7fc1baa00640 1 -- 172.21.15.1:0/297123510 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fc1b40306b0 con 0x7fc1c4103d50 2024-09-15T22:27:57.289 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.286+0000 7fc1cc06b740 1 Processor -- start 2024-09-15T22:27:57.289 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.286+0000 7fc1baa00640 1 --2- 172.21.15.1:0/297123510 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc1a80a3300 0x7fc1a80a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:57.289 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.286+0000 7fc1cc06b740 1 -- start start 2024-09-15T22:27:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.286+0000 7fc1baa00640 1 -- 172.21.15.1:0/297123510 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7fc1b40ef2c0 con 0x7fc1c4103d50 2024-09-15T22:27:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.286+0000 7fc1cc06b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb3d5a3090 0x55cb3d5a3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.286+0000 7fc1cc06b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb3d5a39d0 0x55cb3d5a8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.286+0000 7fc1cc06b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cb3d5a8a60 0x55cb3d5aaf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.286+0000 7fc1cc06b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55cb3d508100 con 0x55cb3d5a8a60 2024-09-15T22:27:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.286+0000 7fc1cc06b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55cb3d4b01b0 con 0x55cb3d5a39d0 2024-09-15T22:27:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.286+0000 7fc1cc06b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55cb3d5040c0 con 0x55cb3d5a3090 2024-09-15T22:27:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.287+0000 7fc1c1e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb3d5a3090 0x55cb3d5a3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.287+0000 7fc1c1e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb3d5a3090 0x55cb3d5a3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:52620/0 (socket says 172.21.15.1:52620) 2024-09-15T22:27:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.287+0000 7fc1c1e00640 1 -- 172.21.15.1:0/2953466252 learned_addr learned my addr 172.21.15.1:0/2953466252 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:27:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.287+0000 7fc1c2800640 1 --2- 172.21.15.1:0/297123510 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc1a80a3300 0x7fc1a80a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.287+0000 7fc1c1e00640 1 -- 172.21.15.1:0/2953466252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb3d5a39d0 msgr2=0x55cb3d5a8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.287+0000 7fc1c1e00640 1 --2- 172.21.15.1:0/2953466252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb3d5a39d0 0x55cb3d5a8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.287+0000 7fc1c1e00640 1 -- 172.21.15.1:0/2953466252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cb3d5a8a60 msgr2=0x55cb3d5aaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.287+0000 7fc1c1e00640 1 --2- 172.21.15.1:0/2953466252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cb3d5a8a60 0x55cb3d5aaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:57.292 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.287+0000 7fc1c1e00640 1 -- 172.21.15.1:0/2953466252 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb3d21b210 con 0x55cb3d5a3090 2024-09-15T22:27:57.292 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.287+0000 7fc1c1e00640 1 --2- 172.21.15.1:0/2953466252 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb3d5a3090 0x55cb3d5a3490 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc1b40c3f60 tx=0x7fc1b40044e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d8de503e737cd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.288+0000 7fc1af400640 1 -- 172.21.15.1:0/2953466252 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b40bb210 con 0x55cb3d5a3090 2024-09-15T22:27:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.288+0000 7fc1af400640 1 -- 172.21.15.1:0/2953466252 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1b40bbfb0 con 0x55cb3d5a3090 2024-09-15T22:27:57.296 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.288+0000 7fc1af400640 1 -- 172.21.15.1:0/2953466252 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b40c20e0 con 0x55cb3d5a3090 2024-09-15T22:27:57.296 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.289+0000 7fc1cc06b740 1 -- 172.21.15.1:0/2953466252 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb3d5a3090 msgr2=0x55cb3d5a3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:57.296 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.289+0000 7fc1cc06b740 1 --2- 172.21.15.1:0/2953466252 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb3d5a3090 0x55cb3d5a3490 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc1b40c3f60 tx=0x7fc1b40044e0 comp rx=0 tx=0).stop 2024-09-15T22:27:57.296 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.289+0000 7fc1c2800640 1 --2- 172.21.15.1:0/297123510 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc1a80a3300 0x7fc1a80a57c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc005fd0 tx=0x7fc1bc010040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:57.296 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.289+0000 7fc1cc06b740 1 -- 172.21.15.1:0/2953466252 shutdown_connections 2024-09-15T22:27:57.296 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.289+0000 7fc1cc06b740 1 --2- 172.21.15.1:0/2953466252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cb3d5a8a60 0x55cb3d5aaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:57.297 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.289+0000 7fc1cc06b740 1 --2- 172.21.15.1:0/2953466252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb3d5a39d0 0x55cb3d5a8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:57.297 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.289+0000 7fc1cc06b740 1 --2- 172.21.15.1:0/2953466252 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb3d5a3090 0x55cb3d5a3490 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:57.297 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.289+0000 7fc1cc06b740 1 -- 172.21.15.1:0/2953466252 >> 172.21.15.1:0/2953466252 conn(0x55cb3d59e700 msgr2=0x55cb3d59eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:57.297 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.289+0000 7fc1cc06b740 1 -- 172.21.15.1:0/2953466252 shutdown_connections 2024-09-15T22:27:57.297 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.290+0000 7fc1cc06b740 1 -- 172.21.15.1:0/2953466252 wait complete. 2024-09-15T22:27:57.297 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.290+0000 7fc1cc06b740 1 -- start start 2024-09-15T22:27:57.297 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.290+0000 7fc1cc06b740 1 Processor -- start 2024-09-15T22:27:57.297 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.291+0000 7fc1cc06b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb3d5a3090 0x55cb3d5acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:57.298 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.291+0000 7fc1cc06b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb3d5a39d0 0x55cb3d5ad500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:57.298 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.291+0000 7fc1cc06b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cb3d5a8a60 0x55cb3d5b4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:57.298 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.291+0000 7fc1cc06b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55cb3d5ab7f0 con 0x55cb3d5a8a60 2024-09-15T22:27:57.298 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.291+0000 7fc1cc06b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55cb3d491090 con 0x55cb3d5a39d0 2024-09-15T22:27:57.298 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.291+0000 7fc1cc06b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55cb3d5ab970 con 0x55cb3d5a3090 2024-09-15T22:27:57.298 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.291+0000 7fc1cc06b740 10 client.0 _ll_register_callbacks cb 0x55cb3d4e5f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:27:57.298 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.291+0000 7fc1c1400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb3d5a39d0 0x55cb3d5ad500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:57.298 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.291+0000 7fc1c1400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb3d5a39d0 0x55cb3d5ad500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:57122/0 (socket says 172.21.15.1:57122) 2024-09-15T22:27:57.299 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.291+0000 7fc1c1400640 1 -- 172.21.15.1:0/3581575879 learned_addr learned my addr 172.21.15.1:0/3581575879 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:27:57.299 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.291+0000 7fc1c1e00640 1 --2- 172.21.15.1:0/3581575879 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb3d5a3090 0x55cb3d5acfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:57.299 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.291+0000 7fc1c2800640 1 --2- 172.21.15.1:0/3581575879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cb3d5a8a60 0x55cb3d5b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:57.299 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.292+0000 7fc1c1400640 1 -- 172.21.15.1:0/3581575879 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb3d5a3090 msgr2=0x55cb3d5acfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:57.299 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.292+0000 7fc1c1400640 1 --2- 172.21.15.1:0/3581575879 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb3d5a3090 0x55cb3d5acfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:57.299 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.292+0000 7fc1c1400640 1 -- 172.21.15.1:0/3581575879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cb3d5a8a60 msgr2=0x55cb3d5b4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:57.299 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.292+0000 7fc1c1400640 1 --2- 172.21.15.1:0/3581575879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cb3d5a8a60 0x55cb3d5b4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:57.299 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.292+0000 7fc1c1400640 1 -- 172.21.15.1:0/3581575879 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb3d2e7620 con 0x55cb3d5a39d0 2024-09-15T22:27:57.300 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.292+0000 7fc1c1400640 1 --2- 172.21.15.1:0/3581575879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb3d5a39d0 0x55cb3d5ad500 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc1b000be00 tx=0x7fc1b000f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3615aaf8b8fc09a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:57.300 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.293+0000 7fc1a3e00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-15T22:27:57.300 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.293+0000 7fc1a3e00640 1 -- 172.21.15.1:0/3581575879 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b0015070 con 0x55cb3d5a39d0 2024-09-15T22:27:57.303 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.293+0000 7fc1a3e00640 1 -- 172.21.15.1:0/3581575879 <== mon.2 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7fc1b0011650 con 0x55cb3d5a39d0 2024-09-15T22:27:57.303 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.293+0000 7fc1cc06b740 1 -- 172.21.15.1:0/3581575879 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1b40bbfb0 con 0x55cb3d5a39d0 2024-09-15T22:27:57.303 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.294+0000 7fc1a3e00640 1 -- 172.21.15.1:0/3581575879 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc1b0015070 con 0x55cb3d5a39d0 2024-09-15T22:27:57.303 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.295+0000 7fc1cc06b740 10 client.25259 fetch_fsmap learned FSMap version 29 2024-09-15T22:27:57.303 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.295+0000 7fc1cc06b740 1 -- 172.21.15.1:0/3581575879 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cb3d5b7400 con 0x55cb3d5a39d0 2024-09-15T22:27:57.303 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.296+0000 7fc1a3e00640 1 -- 172.21.15.1:0/3581575879 <== mon.2 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1b40bbfb0 con 0x55cb3d5a39d0 2024-09-15T22:27:57.303 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.296+0000 7fc1a3e00640 1 -- 172.21.15.1:0/3581575879 <== mon.2 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc1b001aa40 con 0x55cb3d5a39d0 2024-09-15T22:27:57.303 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.297+0000 7fc1cc06b740 10 client.25259 fetch_fsmap finished waiting for FSMap version 29 2024-09-15T22:27:57.303 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.297+0000 7fc1cc06b740 10 client.25259 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T22:27:57.303 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.297+0000 7fc1cc06b740 20 client.25259 populate_metadata read hostname 'smithi001' 2024-09-15T22:27:57.303 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.297+0000 7fc1cc06b740 1 --2- 172.21.15.1:0/3581575879 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55cb3d5b8b20 0x55cb3d5baf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:57.304 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.297+0000 7fc1cc06b740 4 client.25259 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:27:57.304 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.297+0000 7fc1cc06b740 1 -- 172.21.15.1:0/3581575879 --> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb3d515830 con 0x55cb3d5b8b20 2024-09-15T22:27:57.304 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.297+0000 7fc1c1e00640 1 --2- 172.21.15.1:0/3581575879 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55cb3d5b8b20 0x55cb3d5baf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:57.304 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.298+0000 7fc1c1e00640 1 --2- 172.21.15.1:0/3581575879 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55cb3d5b8b20 0x55cb3d5baf10 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdabf199d0587443 server_cookie=afb13e10fc016552 in_seq=0 out_seq=0 2024-09-15T22:27:57.304 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.298+0000 7fc1a3e00640 10 client.25259 ms_handle_connect on v2:172.21.15.98:6838/2831161859 2024-09-15T22:27:57.304 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.298+0000 7fc1a3e00640 1 -- 172.21.15.1:0/3581575879 <== mds.0 v2:172.21.15.98:6838/2831161859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cb3d515830 con 0x55cb3d5b8b20 2024-09-15T22:27:57.304 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.298+0000 7fc1a3e00640 10 client.25259 handle_command_reply: tid=0 2024-09-15T22:27:57.304 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.298+0000 7fc1cc06b740 1 client.25259 shutdown 2024-09-15T22:27:57.304 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.299+0000 7fc1cc06b740 1 -- 172.21.15.1:0/3581575879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb3d5a39d0 msgr2=0x55cb3d5ad500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:57.304 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.299+0000 7fc1cc06b740 1 --2- 172.21.15.1:0/3581575879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb3d5a39d0 0x55cb3d5ad500 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc1b000be00 tx=0x7fc1b000f730 comp rx=0 tx=0).stop 2024-09-15T22:27:57.304 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.299+0000 7fc1cc06b740 1 -- 172.21.15.1:0/3581575879 shutdown_connections 2024-09-15T22:27:57.304 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.299+0000 7fc1cc06b740 1 --2- 172.21.15.1:0/3581575879 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55cb3d5b8b20 0x55cb3d5baf10 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:57.304 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.299+0000 7fc1cc06b740 1 --2- 172.21.15.1:0/3581575879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cb3d5a8a60 0x55cb3d5b4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:57.305 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.299+0000 7fc1a3e00640 0 client.25259 ms_handle_reset on v2:172.21.15.98:6838/2831161859 2024-09-15T22:27:57.305 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.299+0000 7fc1cc06b740 1 --2- 172.21.15.1:0/3581575879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb3d5a39d0 0x55cb3d5ad500 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:57.305 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.299+0000 7fc1cc06b740 1 --2- 172.21.15.1:0/3581575879 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb3d5a3090 0x55cb3d5acfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:57.305 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.299+0000 7fc1cc06b740 1 -- 172.21.15.1:0/3581575879 >> 172.21.15.1:0/3581575879 conn(0x55cb3d59e700 msgr2=0x55cb3d59ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:57.305 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.299+0000 7fc1cc06b740 1 -- 172.21.15.1:0/3581575879 shutdown_connections 2024-09-15T22:27:57.305 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.300+0000 7fc1cc06b740 1 -- 172.21.15.1:0/3581575879 wait complete. 2024-09-15T22:27:57.305 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.300+0000 7fc1cc06b740 20 client.25259 trim_cache size 0 max 16384 2024-09-15T22:27:57.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.339+0000 7fc1cc06b740 1 Processor -- start 2024-09-15T22:27:57.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.340+0000 7fc1cc06b740 1 -- start start 2024-09-15T22:27:57.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.341+0000 7fc1cc06b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb3d5a3090 0x55cb3d59d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:57.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.341+0000 7fc1cc06b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cb3d5a39d0 0x55cb3d5b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:57.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.341+0000 7fc1cc06b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb3d5a8a60 0x55cb3d5bf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:57.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.341+0000 7fc1c2800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb3d5a8a60 0x55cb3d5bf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:57.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.341+0000 7fc1c1e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb3d5a3090 0x55cb3d59d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:57.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.341+0000 7fc1c2800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb3d5a8a60 0x55cb3d5bf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:52626/0 (socket says 172.21.15.1:52626) 2024-09-15T22:27:57.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.341+0000 7fc1c1e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb3d5a3090 0x55cb3d59d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:57130/0 (socket says 172.21.15.1:57130) 2024-09-15T22:27:57.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.341+0000 7fc1c2800640 1 -- 172.21.15.1:0/1948886521 learned_addr learned my addr 172.21.15.1:0/1948886521 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:27:57.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.341+0000 7fc1c1400640 1 --2- 172.21.15.1:0/1948886521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cb3d5a39d0 0x55cb3d5b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:57.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.341+0000 7fc1cc06b740 1 -- 172.21.15.1:0/1948886521 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c41ade80 con 0x55cb3d5a39d0 2024-09-15T22:27:57.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.341+0000 7fc1cc06b740 1 -- 172.21.15.1:0/1948886521 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c41ab690 con 0x55cb3d5a3090 2024-09-15T22:27:57.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.341+0000 7fc1cc06b740 1 -- 172.21.15.1:0/1948886521 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c41a94e0 con 0x55cb3d5a8a60 2024-09-15T22:27:57.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.342+0000 7fc1c1e00640 1 -- 172.21.15.1:0/1948886521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb3d5a8a60 msgr2=0x55cb3d5bf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:57.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.342+0000 7fc1c1e00640 1 --2- 172.21.15.1:0/1948886521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb3d5a8a60 0x55cb3d5bf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:57.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.342+0000 7fc1c1e00640 1 -- 172.21.15.1:0/1948886521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cb3d5a39d0 msgr2=0x55cb3d5b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:57.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.342+0000 7fc1c1e00640 1 --2- 172.21.15.1:0/1948886521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cb3d5a39d0 0x55cb3d5b4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:57.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.342+0000 7fc1c1e00640 1 -- 172.21.15.1:0/1948886521 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb3d5a3eb0 con 0x55cb3d5a3090 2024-09-15T22:27:57.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.342+0000 7fc1c1400640 1 --2- 172.21.15.1:0/1948886521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cb3d5a39d0 0x55cb3d5b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:27:57.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.343+0000 7fc1c1e00640 1 --2- 172.21.15.1:0/1948886521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb3d5a3090 0x55cb3d59d770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4005d00 tx=0x7fc1b40a6040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b331338279977038 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:57.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.343+0000 7fc1aea00640 1 -- 172.21.15.1:0/1948886521 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b40bb210 con 0x55cb3d5a3090 2024-09-15T22:27:57.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.343+0000 7fc1aea00640 1 -- 172.21.15.1:0/1948886521 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1b40bbfb0 con 0x55cb3d5a3090 2024-09-15T22:27:57.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.343+0000 7fc1aea00640 1 -- 172.21.15.1:0/1948886521 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b4004200 con 0x55cb3d5a3090 2024-09-15T22:27:57.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.344+0000 7fc1cc06b740 1 -- 172.21.15.1:0/1948886521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb3d5a3090 msgr2=0x55cb3d59d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.344+0000 7fc1cc06b740 1 --2- 172.21.15.1:0/1948886521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb3d5a3090 0x55cb3d59d770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4005d00 tx=0x7fc1b40a6040 comp rx=0 tx=0).stop 2024-09-15T22:27:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.344+0000 7fc1cc06b740 1 -- 172.21.15.1:0/1948886521 shutdown_connections 2024-09-15T22:27:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.344+0000 7fc1cc06b740 1 --2- 172.21.15.1:0/1948886521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb3d5a8a60 0x55cb3d5bf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.344+0000 7fc1cc06b740 1 --2- 172.21.15.1:0/1948886521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cb3d5a39d0 0x55cb3d5b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.344+0000 7fc1cc06b740 1 --2- 172.21.15.1:0/1948886521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb3d5a3090 0x55cb3d59d770 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.344+0000 7fc1cc06b740 1 -- 172.21.15.1:0/1948886521 >> 172.21.15.1:0/1948886521 conn(0x55cb3d59e700 msgr2=0x55cb3d59d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.344+0000 7fc1cc06b740 1 -- 172.21.15.1:0/1948886521 shutdown_connections 2024-09-15T22:27:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.345+0000 7fc1cc06b740 1 -- 172.21.15.1:0/1948886521 wait complete. 2024-09-15T22:27:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.345+0000 7fc1cc06b740 1 -- start start 2024-09-15T22:27:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.346+0000 7fc1cc06b740 1 Processor -- start 2024-09-15T22:27:57.349 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.346+0000 7fc1cc06b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cb3d5a3090 0x55cb3d5b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.347+0000 7fc1cc06b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb3d5a39d0 0x55cb3d5b25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.347+0000 7fc1cc06b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb3d5a8a60 0x55cb3d5b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.347+0000 7fc1cc06b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c41a9b50 con 0x55cb3d5a3090 2024-09-15T22:27:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.347+0000 7fc1cc06b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c41aafc0 con 0x55cb3d5a8a60 2024-09-15T22:27:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.347+0000 7fc1cc06b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c41aa220 con 0x55cb3d5a39d0 2024-09-15T22:27:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.347+0000 7fc1c1e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cb3d5a3090 0x55cb3d5b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.347+0000 7fc1cc06b740 10 client.0 _ll_register_callbacks cb 0x7fc1b000b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:27:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.347+0000 7fc1c2800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb3d5a8a60 0x55cb3d5b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.347+0000 7fc1c1400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb3d5a39d0 0x55cb3d5b25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.347+0000 7fc1c2800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb3d5a8a60 0x55cb3d5b35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:57144/0 (socket says 172.21.15.1:57144) 2024-09-15T22:27:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.347+0000 7fc1c2800640 1 -- 172.21.15.1:0/617793588 learned_addr learned my addr 172.21.15.1:0/617793588 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:27:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.347+0000 7fc1c2800640 1 -- 172.21.15.1:0/617793588 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb3d5a39d0 msgr2=0x55cb3d5b25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.347+0000 7fc1c2800640 1 --2- 172.21.15.1:0/617793588 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb3d5a39d0 0x55cb3d5b25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.347+0000 7fc1c2800640 1 -- 172.21.15.1:0/617793588 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cb3d5a3090 msgr2=0x55cb3d5b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:27:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.347+0000 7fc1c2800640 1 --2- 172.21.15.1:0/617793588 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cb3d5a3090 0x55cb3d5b20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.347+0000 7fc1c2800640 1 -- 172.21.15.1:0/617793588 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb3d5b3c00 con 0x55cb3d5a8a60 2024-09-15T22:27:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.348+0000 7fc1c1e00640 1 --2- 172.21.15.1:0/617793588 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cb3d5a3090 0x55cb3d5b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:27:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.348+0000 7fc1c2800640 1 --2- 172.21.15.1:0/617793588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb3d5a8a60 0x55cb3d5b35f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc00de50 tx=0x7fc1bc0095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42a8751bf8a07911 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.348+0000 7fc1a3e00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-15T22:27:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.348+0000 7fc1a3e00640 1 -- 172.21.15.1:0/617793588 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc003b80 con 0x55cb3d5a8a60 2024-09-15T22:27:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.348+0000 7fc1cc06b740 1 -- 172.21.15.1:0/617793588 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1b40bbfb0 con 0x55cb3d5a8a60 2024-09-15T22:27:57.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.348+0000 7fc1a3e00640 1 -- 172.21.15.1:0/617793588 <== mon.2 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7fc1bc003d20 con 0x55cb3d5a8a60 2024-09-15T22:27:57.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.349+0000 7fc1a3e00640 1 -- 172.21.15.1:0/617793588 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc1bc004050 con 0x55cb3d5a8a60 2024-09-15T22:27:57.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.349+0000 7fc1cc06b740 10 client.25265 fetch_fsmap learned FSMap version 29 2024-09-15T22:27:57.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.349+0000 7fc1cc06b740 1 -- 172.21.15.1:0/617793588 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cb3d62c5f0 con 0x55cb3d5a8a60 2024-09-15T22:27:57.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.349+0000 7fc1a3e00640 1 -- 172.21.15.1:0/617793588 <== mon.2 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1b40bbfb0 con 0x55cb3d5a8a60 2024-09-15T22:27:57.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.349+0000 7fc1a3e00640 1 -- 172.21.15.1:0/617793588 <== mon.2 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc1bc018070 con 0x55cb3d5a8a60 2024-09-15T22:27:57.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.349+0000 7fc1cc06b740 10 client.25265 fetch_fsmap finished waiting for FSMap version 29 2024-09-15T22:27:57.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.349+0000 7fc1cc06b740 10 client.25265 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T22:27:57.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.349+0000 7fc1cc06b740 20 client.25265 populate_metadata read hostname 'smithi001' 2024-09-15T22:27:57.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.349+0000 7fc1cc06b740 1 --2- 172.21.15.1:0/617793588 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55cb3d5b8b20 0x55cb3d62f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:57.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.350+0000 7fc1cc06b740 4 client.25265 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:27:57.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.350+0000 7fc1cc06b740 1 -- 172.21.15.1:0/617793588 --> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cb3d50fb80 con 0x55cb3d5b8b20 2024-09-15T22:27:57.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.351+0000 7fc1c1e00640 1 --2- 172.21.15.1:0/617793588 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55cb3d5b8b20 0x55cb3d62f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:57.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.352+0000 7fc1c1e00640 1 --2- 172.21.15.1:0/617793588 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55cb3d5b8b20 0x55cb3d62f020 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffde93f25c0fb431 server_cookie=88b7c7000ff6ddc8 in_seq=0 out_seq=0 2024-09-15T22:27:57.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.352+0000 7fc1a3e00640 10 client.25265 ms_handle_connect on v2:172.21.15.98:6838/2831161859 2024-09-15T22:27:57.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.377+0000 7fc1a3e00640 1 -- 172.21.15.1:0/617793588 <== mds.0 v2:172.21.15.98:6838/2831161859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cb3d50fb80 con 0x55cb3d5b8b20 2024-09-15T22:27:57.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.377+0000 7fc1a3e00640 10 client.25265 handle_command_reply: tid=0 2024-09-15T22:27:57.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.377+0000 7fc1cc06b740 1 client.25265 shutdown 2024-09-15T22:27:57.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.379+0000 7fc1cc06b740 1 -- 172.21.15.1:0/617793588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb3d5a8a60 msgr2=0x55cb3d5b35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.379+0000 7fc1cc06b740 1 --2- 172.21.15.1:0/617793588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb3d5a8a60 0x55cb3d5b35f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc00de50 tx=0x7fc1bc0095c0 comp rx=0 tx=0).stop 2024-09-15T22:27:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.379+0000 7fc1cc06b740 1 -- 172.21.15.1:0/617793588 shutdown_connections 2024-09-15T22:27:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.379+0000 7fc1cc06b740 1 --2- 172.21.15.1:0/617793588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb3d5a8a60 0x55cb3d5b35f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.379+0000 7fc1cc06b740 1 --2- 172.21.15.1:0/617793588 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb3d5a39d0 0x55cb3d5b25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.379+0000 7fc1cc06b740 1 --2- 172.21.15.1:0/617793588 >> [v2:172.21.15.98:6838/2831161859,v1:172.21.15.98:6839/2831161859] conn(0x55cb3d5b8b20 0x55cb3d62f020 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.379+0000 7fc1a3e00640 0 client.25265 ms_handle_reset on v2:172.21.15.98:6838/2831161859 2024-09-15T22:27:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.379+0000 7fc1cc06b740 1 --2- 172.21.15.1:0/617793588 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cb3d5a3090 0x55cb3d5b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.379+0000 7fc1cc06b740 1 -- 172.21.15.1:0/617793588 >> 172.21.15.1:0/617793588 conn(0x55cb3d59e700 msgr2=0x55cb3d59d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.381+0000 7fc1cc06b740 1 -- 172.21.15.1:0/617793588 shutdown_connections 2024-09-15T22:27:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.381+0000 7fc1cc06b740 1 -- 172.21.15.1:0/617793588 wait complete. 2024-09-15T22:27:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.382+0000 7fc1cc06b740 20 client.25265 trim_cache size 0 max 16384 2024-09-15T22:27:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-15T22:27:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-15T22:27:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-15T22:27:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-15T22:27:57.388 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.386+0000 7fc1c9200640 1 -- 172.21.15.1:0/297123510 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc1a80a3300 msgr2=0x7fc1a80a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:57.388 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.386+0000 7fc1c9200640 1 --2- 172.21.15.1:0/297123510 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc1a80a3300 0x7fc1a80a57c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc005fd0 tx=0x7fc1bc010040 comp rx=0 tx=0).stop 2024-09-15T22:27:57.388 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.386+0000 7fc1c9200640 1 -- 172.21.15.1:0/297123510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1c4103d50 msgr2=0x7fc1c419a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:57.388 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.386+0000 7fc1c9200640 1 --2- 172.21.15.1:0/297123510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1c4103d50 0x7fc1c419a090 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc1b40304e0 tx=0x7fc1b4030ee0 comp rx=0 tx=0).stop 2024-09-15T22:27:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.386+0000 7fc1c9200640 1 -- 172.21.15.1:0/297123510 shutdown_connections 2024-09-15T22:27:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.386+0000 7fc1c9200640 1 --2- 172.21.15.1:0/297123510 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fc1a80a3300 0x7fc1a80a57c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.386+0000 7fc1c9200640 1 --2- 172.21.15.1:0/297123510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1c4105900 0x7fc1c41a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.386+0000 7fc1c9200640 1 --2- 172.21.15.1:0/297123510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1c4104f40 0x7fc1c419a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.386+0000 7fc1c9200640 1 --2- 172.21.15.1:0/297123510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1c4103d50 0x7fc1c419a090 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.386+0000 7fc1c9200640 1 -- 172.21.15.1:0/297123510 >> 172.21.15.1:0/297123510 conn(0x7fc1c40ff4b0 msgr2=0x7fc1c4108300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.387+0000 7fc1c9200640 1 -- 172.21.15.1:0/297123510 shutdown_connections 2024-09-15T22:27:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-15T22:27:57.387+0000 7fc1c9200640 1 -- 172.21.15.1:0/297123510 wait complete. 2024-09-15T22:27:57.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:57 smithi012 ceph-mon[34883]: pgmap v448: 97 pgs: 97 active+clean; 95 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 460 op/s 2024-09-15T22:27:57.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:57 smithi098 ceph-mon[35514]: pgmap v448: 97 pgs: 97 active+clean; 95 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 460 op/s 2024-09-15T22:27:58.226 DEBUG:teuthology.parallel:result is None 2024-09-15T22:27:58.226 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-15T22:27:58.306 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-15T22:27:58.306 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-15T22:27:58.385 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi001.front.sepia.ceph.com 2024-09-15T22:27:58.398 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-15T22:27:58.413 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:27:58.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.596+0000 7f493be00640 1 -- 172.21.15.1:0/738619763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f493c1035d0 msgr2=0x7f493c109e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:58.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.596+0000 7f493be00640 1 --2- 172.21.15.1:0/738619763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f493c1035d0 0x7f493c109e60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4934009be0 tx=0x7f493402a6d0 comp rx=0 tx=0).stop 2024-09-15T22:27:58.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.596+0000 7f493be00640 1 -- 172.21.15.1:0/738619763 shutdown_connections 2024-09-15T22:27:58.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.596+0000 7f493be00640 1 --2- 172.21.15.1:0/738619763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f493c1035d0 0x7f493c109e60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:58.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.596+0000 7f493be00640 1 --2- 172.21.15.1:0/738619763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f493c102c10 0x7f493c103090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:58.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.596+0000 7f493be00640 1 --2- 172.21.15.1:0/738619763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f493c101a20 0x7f493c101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:58.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.596+0000 7f493be00640 1 -- 172.21.15.1:0/738619763 >> 172.21.15.1:0/738619763 conn(0x7f493c0fd180 msgr2=0x7f493c0ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:58.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.596+0000 7f493be00640 1 -- 172.21.15.1:0/738619763 shutdown_connections 2024-09-15T22:27:58.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.596+0000 7f493be00640 1 -- 172.21.15.1:0/738619763 wait complete. 2024-09-15T22:27:58.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.597+0000 7f493be00640 1 Processor -- start 2024-09-15T22:27:58.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.597+0000 7f493be00640 1 -- start start 2024-09-15T22:27:58.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.597+0000 7f493be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f493c101a20 0x7f493c199ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:58.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.597+0000 7f493be00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f493c102c10 0x7f493c19a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:58.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.597+0000 7f493be00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f493c1035d0 0x7f493c1a1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:58.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.597+0000 7f493be00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f493c10d680 con 0x7f493c1035d0 2024-09-15T22:27:58.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.598+0000 7f493be00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f493c10d500 con 0x7f493c102c10 2024-09-15T22:27:58.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.598+0000 7f493be00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f493c10d800 con 0x7f493c101a20 2024-09-15T22:27:58.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.598+0000 7f4933e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f493c102c10 0x7f493c19a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:58.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.598+0000 7f4933e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f493c102c10 0x7f493c19a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.1:57158/0 (socket says 172.21.15.1:57158) 2024-09-15T22:27:58.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.598+0000 7f4933e00640 1 -- 172.21.15.1:0/3199800973 learned_addr learned my addr 172.21.15.1:0/3199800973 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:27:58.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.598+0000 7f493b400640 1 --2- 172.21.15.1:0/3199800973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f493c1035d0 0x7f493c1a1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:58.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.598+0000 7f493aa00640 1 --2- 172.21.15.1:0/3199800973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f493c101a20 0x7f493c199ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:58.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.598+0000 7f4933e00640 1 -- 172.21.15.1:0/3199800973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f493c101a20 msgr2=0x7f493c199ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:58.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.598+0000 7f4933e00640 1 --2- 172.21.15.1:0/3199800973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f493c101a20 0x7f493c199ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:58.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.598+0000 7f4933e00640 1 -- 172.21.15.1:0/3199800973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f493c1035d0 msgr2=0x7f493c1a1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:58.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.598+0000 7f4933e00640 1 --2- 172.21.15.1:0/3199800973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f493c1035d0 0x7f493c1a1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:58.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.598+0000 7f4933e00640 1 -- 172.21.15.1:0/3199800973 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f493c1a1ae0 con 0x7f493c102c10 2024-09-15T22:27:58.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.598+0000 7f493aa00640 1 --2- 172.21.15.1:0/3199800973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f493c101a20 0x7f493c199ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:27:58.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.598+0000 7f493b400640 1 --2- 172.21.15.1:0/3199800973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f493c1035d0 0x7f493c1a1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:27:58.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.599+0000 7f4933e00640 1 --2- 172.21.15.1:0/3199800973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f493c102c10 0x7f493c19a400 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f492400e9f0 tx=0x7f492400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:58.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.599+0000 7f4940a00640 1 -- 172.21.15.1:0/3199800973 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492400ccc0 con 0x7f493c102c10 2024-09-15T22:27:58.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.599+0000 7f493be00640 1 -- 172.21.15.1:0/3199800973 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f493c1a1dd0 con 0x7f493c102c10 2024-09-15T22:27:58.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.599+0000 7f4940a00640 1 -- 172.21.15.1:0/3199800973 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4924010910 con 0x7f493c102c10 2024-09-15T22:27:58.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.599+0000 7f4940a00640 1 -- 172.21.15.1:0/3199800973 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49240188a0 con 0x7f493c102c10 2024-09-15T22:27:58.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.599+0000 7f493be00640 1 -- 172.21.15.1:0/3199800973 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f493c1a2290 con 0x7f493c102c10 2024-09-15T22:27:58.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.600+0000 7f493be00640 1 -- 172.21.15.1:0/3199800973 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f493c1a24c0 con 0x7f493c102c10 2024-09-15T22:27:58.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.602+0000 7f4940a00640 1 -- 172.21.15.1:0/3199800973 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f4924010ac0 con 0x7f493c102c10 2024-09-15T22:27:58.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.603+0000 7f4940a00640 1 --2- 172.21.15.1:0/3199800973 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f49200a3240 0x7f49200a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:58.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.604+0000 7f4940a00640 1 -- 172.21.15.1:0/3199800973 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f49240d02d0 con 0x7f493c102c10 2024-09-15T22:27:58.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.604+0000 7f493aa00640 1 --2- 172.21.15.1:0/3199800973 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f49200a3240 0x7f49200a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:58.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.604+0000 7f493aa00640 1 --2- 172.21.15.1:0/3199800973 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f49200a3240 0x7f49200a5700 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f493c102a70 tx=0x7f492c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:58.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.606+0000 7f4940a00640 1 -- 172.21.15.1:0/3199800973 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f492409cf30 con 0x7f493c102c10 2024-09-15T22:27:58.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.795+0000 7f493be00640 1 -- 172.21.15.1:0/3199800973 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f493c1a2850 con 0x7f493c102c10 2024-09-15T22:27:58.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.798+0000 7f4940a00640 1 -- 172.21.15.1:0/3199800973 <== mon.2 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+22787 (secure 0 0 0) 0x7f492409c830 con 0x7f493c102c10 2024-09-15T22:27:58.799 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:27:58.800 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":86,"fsid":"c1228c44-73af-11ef-bceb-c7b262605968","created":"2024-09-15T22:14:39.004556+0000","modified":"2024-09-15T22:24:33.423260+0000","last_up_change":"2024-09-15T22:21:53.270221+0000","last_in_change":"2024-09-15T22:21:30.911945+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:17:56.059390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:22:47.262081+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:22:49.746577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28228d47-bbb7-4103-a4fb-3e126769f8bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6803","nonce":3588868833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6805","nonce":3588868833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6809","nonce":3588868833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6807","nonce":3588868833}]},"public_addr":"172.21.15.1:6803/3588868833","cluster_addr":"172.21.15.1:6805/3588868833","heartbeat_back_addr":"172.21.15.1:6809/3588868833","heartbeat_front_addr":"172.21.15.1:6807/3588868833","state":["exists","up"]},{"osd":1,"uuid":"d90dd2c1-2047-4491-8730-30793a354aa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6801","nonce":3951165354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6803","nonce":3951165354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6807","nonce":3951165354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6805","nonce":3951165354}]},"public_addr":"172.21.15.12:6801/3951165354","cluster_addr":"172.21.15.12:6803/3951165354","heartbeat_back_addr":"172.21.15.12:6807/3951165354","heartbeat_front_addr":"172.21.15.12:6805/3951165354","state":["exists","up"]},{"osd":2,"uuid":"22e38f44-88d3-4461-a57e-6dc4857ec48f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6801","nonce":1633982971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6803","nonce":1633982971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6807","nonce":1633982971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6805","nonce":1633982971}]},"public_addr":"172.21.15.98:6801/1633982971","cluster_addr":"172.21.15.98:6803/1633982971","heartbeat_back_addr":"172.21.15.98:6807/1633982971","heartbeat_front_addr":"172.21.15.98:6805/1633982971","state":["exists","up"]},{"osd":3,"uuid":"dd9d6e97-af81-442a-ac0d-543e440a8d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6811","nonce":3706738461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6813","nonce":3706738461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6817","nonce":3706738461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6815","nonce":3706738461}]},"public_addr":"172.21.15.1:6811/3706738461","cluster_addr":"172.21.15.1:6813/3706738461","heartbeat_back_addr":"172.21.15.1:6817/3706738461","heartbeat_front_addr":"172.21.15.1:6815/3706738461","state":["exists","up"]},{"osd":4,"uuid":"50116baa-dd99-4dbb-a7a1-2268f04052f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6809","nonce":4057902964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6811","nonce":4057902964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6815","nonce":4057902964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6813","nonce":4057902964}]},"public_addr":"172.21.15.12:6809/4057902964","cluster_addr":"172.21.15.12:6811/4057902964","heartbeat_back_addr":"172.21.15.12:6815/4057902964","heartbeat_front_addr":"172.21.15.12:6813/4057902964","state":["exists","up"]},{"osd":5,"uuid":"56ab0694-2f21-46c4-a086-44f72c271c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6809","nonce":4043567619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6811","nonce":4043567619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6815","nonce":4043567619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6813","nonce":4043567619}]},"public_addr":"172.21.15.98:6809/4043567619","cluster_addr":"172.21.15.98:6811/4043567619","heartbeat_back_addr":"172.21.15.98:6815/4043567619","heartbeat_front_addr":"172.21.15.98:6813/4043567619","state":["exists","up"]},{"osd":6,"uuid":"5ca0d114-4894-428e-bcd3-2ebd24d10a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6819","nonce":2236861161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6821","nonce":2236861161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6825","nonce":2236861161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6823","nonce":2236861161}]},"public_addr":"172.21.15.1:6819/2236861161","cluster_addr":"172.21.15.1:6821/2236861161","heartbeat_back_addr":"172.21.15.1:6825/2236861161","heartbeat_front_addr":"172.21.15.1:6823/2236861161","state":["exists","up"]},{"osd":7,"uuid":"db99cc6e-1717-4958-bf11-65aca94476b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6817","nonce":133202448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6819","nonce":133202448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6823","nonce":133202448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6821","nonce":133202448}]},"public_addr":"172.21.15.12:6817/133202448","cluster_addr":"172.21.15.12:6819/133202448","heartbeat_back_addr":"172.21.15.12:6823/133202448","heartbeat_front_addr":"172.21.15.12:6821/133202448","state":["exists","up"]},{"osd":8,"uuid":"4d3b6574-49f7-47f6-b36b-4da14ca290f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6817","nonce":3701478409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6819","nonce":3701478409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6823","nonce":3701478409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6821","nonce":3701478409}]},"public_addr":"172.21.15.98:6817/3701478409","cluster_addr":"172.21.15.98:6819/3701478409","heartbeat_back_addr":"172.21.15.98:6823/3701478409","heartbeat_front_addr":"172.21.15.98:6821/3701478409","state":["exists","up"]},{"osd":9,"uuid":"7dd2fe25-1b75-48e5-86c7-c7a3ab85053f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6827","nonce":2580755002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6829","nonce":2580755002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6833","nonce":2580755002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6831","nonce":2580755002}]},"public_addr":"172.21.15.1:6827/2580755002","cluster_addr":"172.21.15.1:6829/2580755002","heartbeat_back_addr":"172.21.15.1:6833/2580755002","heartbeat_front_addr":"172.21.15.1:6831/2580755002","state":["exists","up"]},{"osd":10,"uuid":"fcad11dc-0a1b-44a2-ac32-74100e317255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6825","nonce":3989063573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6827","nonce":3989063573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6831","nonce":3989063573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6829","nonce":3989063573}]},"public_addr":"172.21.15.12:6825/3989063573","cluster_addr":"172.21.15.12:6827/3989063573","heartbeat_back_addr":"172.21.15.12:6831/3989063573","heartbeat_front_addr":"172.21.15.12:6829/3989063573","state":["exists","up"]},{"osd":11,"uuid":"f4e717bb-586d-4fe2-9e6b-f574be4db36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6825","nonce":839956167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6827","nonce":839956167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6831","nonce":839956167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6829","nonce":839956167}]},"public_addr":"172.21.15.98:6825/839956167","cluster_addr":"172.21.15.98:6827/839956167","heartbeat_back_addr":"172.21.15.98:6831/839956167","heartbeat_front_addr":"172.21.15.98:6829/839956167","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:17:01.990618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:17:28.259003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:17:52.825080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:18:22.724038+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:18:48.383663+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:19:13.246563+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:19:42.318469+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:20:08.809160+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:20:32.628925+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:21:02.280217+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:21:27.897758+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:21:52.055015+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":1,"to":2}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6800/3145051160":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/3101438101":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/4159811089":"2024-09-16T22:15:31.433375+0000","172.21.15.1:6801/3145051160":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/2785155592":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/714180295":"2024-09-16T22:15:03.937536+0000","172.21.15.1:6801/215291238":"2024-09-16T22:15:03.937536+0000","172.21.15.1:6800/215291238":"2024-09-16T22:15:03.937536+0000","172.21.15.1:0/1842817732":"2024-09-16T22:15:03.937536+0000","172.21.15.1:0/3888009741":"2024-09-16T22:15:03.937536+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:27:58.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.799+0000 7f493be00640 1 -- 172.21.15.1:0/3199800973 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f49200a3240 msgr2=0x7f49200a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:58.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.799+0000 7f493be00640 1 --2- 172.21.15.1:0/3199800973 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f49200a3240 0x7f49200a5700 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f493c102a70 tx=0x7f492c009260 comp rx=0 tx=0).stop 2024-09-15T22:27:58.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.799+0000 7f493be00640 1 -- 172.21.15.1:0/3199800973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f493c102c10 msgr2=0x7f493c19a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:58.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.799+0000 7f493be00640 1 --2- 172.21.15.1:0/3199800973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f493c102c10 0x7f493c19a400 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f492400e9f0 tx=0x7f492400edf0 comp rx=0 tx=0).stop 2024-09-15T22:27:58.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.799+0000 7f493be00640 1 -- 172.21.15.1:0/3199800973 shutdown_connections 2024-09-15T22:27:58.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.799+0000 7f493be00640 1 --2- 172.21.15.1:0/3199800973 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f49200a3240 0x7f49200a5700 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:58.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.799+0000 7f493be00640 1 --2- 172.21.15.1:0/3199800973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f493c1035d0 0x7f493c1a1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:58.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.799+0000 7f493be00640 1 --2- 172.21.15.1:0/3199800973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f493c102c10 0x7f493c19a400 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:58.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.799+0000 7f493be00640 1 --2- 172.21.15.1:0/3199800973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f493c101a20 0x7f493c199ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:58.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.799+0000 7f493be00640 1 -- 172.21.15.1:0/3199800973 >> 172.21.15.1:0/3199800973 conn(0x7f493c0fd180 msgr2=0x7f493c074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:58.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.799+0000 7f493be00640 1 -- 172.21.15.1:0/3199800973 shutdown_connections 2024-09-15T22:27:58.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.799+0000 7f493be00640 1 -- 172.21.15.1:0/3199800973 wait complete. 2024-09-15T22:27:58.818 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T22:17:56.059390+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-15T22:22:47.262081+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-15T22:22:49.746577+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T22:27:58.819 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T22:27:58.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.979+0000 7f3650400640 1 -- 172.21.15.1:0/2120117658 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3648076bb0 msgr2=0x7f3648076fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:58.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.979+0000 7f3650400640 1 --2- 172.21.15.1:0/2120117658 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3648076bb0 0x7f3648076fb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f363c009900 tx=0x7f363c02a410 comp rx=0 tx=0).stop 2024-09-15T22:27:58.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.980+0000 7f3650400640 1 -- 172.21.15.1:0/2120117658 shutdown_connections 2024-09-15T22:27:58.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.980+0000 7f3650400640 1 --2- 172.21.15.1:0/2120117658 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3648078790 0x7f3648079030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:58.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.980+0000 7f3650400640 1 --2- 172.21.15.1:0/2120117658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3648077df0 0x7f3648078250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:58.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.980+0000 7f3650400640 1 --2- 172.21.15.1:0/2120117658 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3648076bb0 0x7f3648076fb0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:58.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.980+0000 7f3650400640 1 -- 172.21.15.1:0/2120117658 >> 172.21.15.1:0/2120117658 conn(0x7f36480ff4b0 msgr2=0x7f36481018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:58.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.980+0000 7f3650400640 1 -- 172.21.15.1:0/2120117658 shutdown_connections 2024-09-15T22:27:58.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.980+0000 7f3650400640 1 -- 172.21.15.1:0/2120117658 wait complete. 2024-09-15T22:27:58.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.980+0000 7f3650400640 1 Processor -- start 2024-09-15T22:27:58.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.981+0000 7f3650400640 1 -- start start 2024-09-15T22:27:58.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.981+0000 7f3650400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3648076bb0 0x7f364819e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:58.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.981+0000 7f3650400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3648077df0 0x7f364819ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:58.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.981+0000 7f3650400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3648078790 0x7f36481a5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:58.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.981+0000 7f3650400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3648113e20 con 0x7f3648076bb0 2024-09-15T22:27:58.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.981+0000 7f3650400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3648113ca0 con 0x7f3648078790 2024-09-15T22:27:58.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.981+0000 7f3650400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3648113fa0 con 0x7f3648077df0 2024-09-15T22:27:58.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.981+0000 7f364da00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3648076bb0 0x7f364819e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:58.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.981+0000 7f364e400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3648078790 0x7f36481a5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:58.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.981+0000 7f364da00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3648076bb0 0x7f364819e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36454/0 (socket says 172.21.15.1:36454) 2024-09-15T22:27:58.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.981+0000 7f364da00640 1 -- 172.21.15.1:0/1236700860 learned_addr learned my addr 172.21.15.1:0/1236700860 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:27:58.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.981+0000 7f364d000640 1 --2- 172.21.15.1:0/1236700860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3648077df0 0x7f364819ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:58.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.982+0000 7f364e400640 1 -- 172.21.15.1:0/1236700860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3648077df0 msgr2=0x7f364819ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:58.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.982+0000 7f364e400640 1 --2- 172.21.15.1:0/1236700860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3648077df0 0x7f364819ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:58.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.982+0000 7f364e400640 1 -- 172.21.15.1:0/1236700860 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3648076bb0 msgr2=0x7f364819e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:58.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.982+0000 7f364e400640 1 --2- 172.21.15.1:0/1236700860 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3648076bb0 0x7f364819e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:58.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.982+0000 7f364e400640 1 -- 172.21.15.1:0/1236700860 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36481a60e0 con 0x7f3648078790 2024-09-15T22:27:58.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.982+0000 7f364e400640 1 --2- 172.21.15.1:0/1236700860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3648078790 0x7f36481a5a70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3640009fd0 tx=0x7f364000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:58.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.982+0000 7f3646000640 1 -- 172.21.15.1:0/1236700860 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364000ce20 con 0x7f3648078790 2024-09-15T22:27:58.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.982+0000 7f3646000640 1 -- 172.21.15.1:0/1236700860 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3640005020 con 0x7f3648078790 2024-09-15T22:27:58.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.982+0000 7f3650400640 1 -- 172.21.15.1:0/1236700860 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36481a63d0 con 0x7f3648078790 2024-09-15T22:27:58.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.982+0000 7f3646000640 1 -- 172.21.15.1:0/1236700860 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3640010720 con 0x7f3648078790 2024-09-15T22:27:58.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.982+0000 7f3650400640 1 -- 172.21.15.1:0/1236700860 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36481a6920 con 0x7f3648078790 2024-09-15T22:27:58.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.983+0000 7f3650400640 1 -- 172.21.15.1:0/1236700860 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36481106c0 con 0x7f3648078790 2024-09-15T22:27:58.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.985+0000 7f3646000640 1 -- 172.21.15.1:0/1236700860 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f3640005540 con 0x7f3648078790 2024-09-15T22:27:58.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.987+0000 7f3646000640 1 --2- 172.21.15.1:0/1236700860 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f36300a3250 0x7f36300a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:58.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.987+0000 7f3646000640 1 -- 172.21.15.1:0/1236700860 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f36400d00a0 con 0x7f3648078790 2024-09-15T22:27:58.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.987+0000 7f364da00640 1 --2- 172.21.15.1:0/1236700860 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f36300a3250 0x7f36300a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:58.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.988+0000 7f364da00640 1 --2- 172.21.15.1:0/1236700860 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f36300a3250 0x7f36300a5710 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f363c031440 tx=0x7f363c0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:58.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:58.989+0000 7f3646000640 1 -- 172.21.15.1:0/1236700860 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f364009cd90 con 0x7f3648078790 2024-09-15T22:27:59.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.177+0000 7f3650400640 1 -- 172.21.15.1:0/1236700860 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3648062df0 con 0x7f3648078790 2024-09-15T22:27:59.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.178+0000 7f3646000640 1 -- 172.21.15.1:0/1236700860 <== mon.2 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) ==== 93+0+10 (secure 0 0 0) 0x7f364009c690 con 0x7f3648078790 2024-09-15T22:27:59.180 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2024-09-15T22:27:59.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.180+0000 7f3650400640 1 -- 172.21.15.1:0/1236700860 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f36300a3250 msgr2=0x7f36300a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:59.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.180+0000 7f3650400640 1 --2- 172.21.15.1:0/1236700860 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f36300a3250 0x7f36300a5710 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f363c031440 tx=0x7f363c0315b0 comp rx=0 tx=0).stop 2024-09-15T22:27:59.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.180+0000 7f3650400640 1 -- 172.21.15.1:0/1236700860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3648078790 msgr2=0x7f36481a5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:59.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.180+0000 7f3650400640 1 --2- 172.21.15.1:0/1236700860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3648078790 0x7f36481a5a70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3640009fd0 tx=0x7f364000ef10 comp rx=0 tx=0).stop 2024-09-15T22:27:59.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.180+0000 7f3650400640 1 -- 172.21.15.1:0/1236700860 shutdown_connections 2024-09-15T22:27:59.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.180+0000 7f3650400640 1 --2- 172.21.15.1:0/1236700860 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f36300a3250 0x7f36300a5710 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:59.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.180+0000 7f3650400640 1 --2- 172.21.15.1:0/1236700860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3648078790 0x7f36481a5a70 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:59.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.180+0000 7f3650400640 1 --2- 172.21.15.1:0/1236700860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3648077df0 0x7f364819ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:59.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.180+0000 7f3650400640 1 --2- 172.21.15.1:0/1236700860 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3648076bb0 0x7f364819e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:59.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.180+0000 7f3650400640 1 -- 172.21.15.1:0/1236700860 >> 172.21.15.1:0/1236700860 conn(0x7f36480ff4b0 msgr2=0x7f3648100f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:59.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.180+0000 7f3650400640 1 -- 172.21.15.1:0/1236700860 shutdown_connections 2024-09-15T22:27:59.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.180+0000 7f3650400640 1 -- 172.21.15.1:0/1236700860 wait complete. 2024-09-15T22:27:59.198 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-15T22:27:59.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.358+0000 7f74dce00640 1 -- 172.21.15.1:0/2994458783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74d8103d50 msgr2=0x7f74d8104150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:59.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.358+0000 7f74dce00640 1 --2- 172.21.15.1:0/2994458783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74d8103d50 0x7f74d8104150 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f74c8009900 tx=0x7f74c802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:27:59.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.358+0000 7f74dce00640 1 -- 172.21.15.1:0/2994458783 shutdown_connections 2024-09-15T22:27:59.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.358+0000 7f74dce00640 1 --2- 172.21.15.1:0/2994458783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74d8105900 0x7f74d810c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:59.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.358+0000 7f74dce00640 1 --2- 172.21.15.1:0/2994458783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74d8104f40 0x7f74d81053c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:59.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.358+0000 7f74dce00640 1 --2- 172.21.15.1:0/2994458783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74d8103d50 0x7f74d8104150 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:59.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.358+0000 7f74dce00640 1 -- 172.21.15.1:0/2994458783 >> 172.21.15.1:0/2994458783 conn(0x7f74d80ff4b0 msgr2=0x7f74d81018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:59.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.358+0000 7f74dce00640 1 -- 172.21.15.1:0/2994458783 shutdown_connections 2024-09-15T22:27:59.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.358+0000 7f74dce00640 1 -- 172.21.15.1:0/2994458783 wait complete. 2024-09-15T22:27:59.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.359+0000 7f74dce00640 1 Processor -- start 2024-09-15T22:27:59.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.359+0000 7f74dce00640 1 -- start start 2024-09-15T22:27:59.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.360+0000 7f74dce00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74d8103d50 0x7f74d819a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:59.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.360+0000 7f74dce00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74d8104f40 0x7f74d819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:59.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.360+0000 7f74dce00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74d8105900 0x7f74d81a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:59.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.360+0000 7f74dce00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f74d810f9d0 con 0x7f74d8104f40 2024-09-15T22:27:59.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.360+0000 7f74dce00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f74d810f850 con 0x7f74d8103d50 2024-09-15T22:27:59.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.360+0000 7f74dce00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f74d810fb50 con 0x7f74d8105900 2024-09-15T22:27:59.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.360+0000 7f74d5400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74d8104f40 0x7f74d819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:59.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.360+0000 7f74d5400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74d8104f40 0x7f74d819a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36470/0 (socket says 172.21.15.1:36470) 2024-09-15T22:27:59.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.360+0000 7f74d5400640 1 -- 172.21.15.1:0/2709364421 learned_addr learned my addr 172.21.15.1:0/2709364421 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:27:59.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.360+0000 7f74d5e00640 1 --2- 172.21.15.1:0/2709364421 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74d8103d50 0x7f74d819a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:59.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.360+0000 7f74d6800640 1 --2- 172.21.15.1:0/2709364421 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74d8105900 0x7f74d81a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:59.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.360+0000 7f74d5400640 1 -- 172.21.15.1:0/2709364421 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74d8105900 msgr2=0x7f74d81a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:59.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.360+0000 7f74d5400640 1 --2- 172.21.15.1:0/2709364421 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74d8105900 0x7f74d81a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:59.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.360+0000 7f74d5400640 1 -- 172.21.15.1:0/2709364421 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74d8103d50 msgr2=0x7f74d819a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:59.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.360+0000 7f74d5400640 1 --2- 172.21.15.1:0/2709364421 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74d8103d50 0x7f74d819a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:59.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.360+0000 7f74d5400640 1 -- 172.21.15.1:0/2709364421 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d81a1cd0 con 0x7f74d8104f40 2024-09-15T22:27:59.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.361+0000 7f74d5400640 1 --2- 172.21.15.1:0/2709364421 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74d8104f40 0x7f74d819a5f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f74c400e9f0 tx=0x7f74c400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:59.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.361+0000 7f74cea00640 1 -- 172.21.15.1:0/2709364421 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c400cd80 con 0x7f74d8104f40 2024-09-15T22:27:59.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.361+0000 7f74cea00640 1 -- 172.21.15.1:0/2709364421 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74c4005500 con 0x7f74d8104f40 2024-09-15T22:27:59.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.361+0000 7f74dce00640 1 -- 172.21.15.1:0/2709364421 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74d81a1fc0 con 0x7f74d8104f40 2024-09-15T22:27:59.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.361+0000 7f74cea00640 1 -- 172.21.15.1:0/2709364421 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c4010690 con 0x7f74d8104f40 2024-09-15T22:27:59.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.361+0000 7f74dce00640 1 -- 172.21.15.1:0/2709364421 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74d81a2430 con 0x7f74d8104f40 2024-09-15T22:27:59.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.362+0000 7f74dce00640 1 -- 172.21.15.1:0/2709364421 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74d810b140 con 0x7f74d8104f40 2024-09-15T22:27:59.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.364+0000 7f74cea00640 1 -- 172.21.15.1:0/2709364421 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f74c40046c0 con 0x7f74d8104f40 2024-09-15T22:27:59.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.365+0000 7f74cea00640 1 --2- 172.21.15.1:0/2709364421 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f74bc0a3250 0x7f74bc0a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:59.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.366+0000 7f74cea00640 1 -- 172.21.15.1:0/2709364421 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f74c40cfe50 con 0x7f74d8104f40 2024-09-15T22:27:59.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.366+0000 7f74d5e00640 1 --2- 172.21.15.1:0/2709364421 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f74bc0a3250 0x7f74bc0a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:59.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.366+0000 7f74d5e00640 1 --2- 172.21.15.1:0/2709364421 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f74bc0a3250 0x7f74bc0a5710 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f74c8005ab0 tx=0x7f74c8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:59.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.369+0000 7f74cea00640 1 -- 172.21.15.1:0/2709364421 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f74c409cab0 con 0x7f74d8104f40 2024-09-15T22:27:59.375 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:59 smithi001 ceph-mon[30843]: pgmap v449: 97 pgs: 97 active+clean; 95 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 342 op/s 2024-09-15T22:27:59.375 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:27:59 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/3199800973' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:27:59.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:59 smithi012 ceph-mon[34883]: pgmap v449: 97 pgs: 97 active+clean; 95 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 342 op/s 2024-09-15T22:27:59.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:27:59 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/3199800973' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:27:59.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.557+0000 7f74dce00640 1 -- 172.21.15.1:0/2709364421 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f74d8062e90 con 0x7f74d8104f40 2024-09-15T22:27:59.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.557+0000 7f74cea00640 1 -- 172.21.15.1:0/2709364421 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) ==== 104+0+11 (secure 0 0 0) 0x7f74c409c3b0 con 0x7f74d8104f40 2024-09-15T22:27:59.560 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 32 2024-09-15T22:27:59.560 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:59 smithi098 ceph-mon[35514]: pgmap v449: 97 pgs: 97 active+clean; 95 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 342 op/s 2024-09-15T22:27:59.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:27:59 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/3199800973' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:27:59.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.559+0000 7f74dce00640 1 -- 172.21.15.1:0/2709364421 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f74bc0a3250 msgr2=0x7f74bc0a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:59.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.559+0000 7f74dce00640 1 --2- 172.21.15.1:0/2709364421 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f74bc0a3250 0x7f74bc0a5710 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f74c8005ab0 tx=0x7f74c8000bc0 comp rx=0 tx=0).stop 2024-09-15T22:27:59.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.559+0000 7f74dce00640 1 -- 172.21.15.1:0/2709364421 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74d8104f40 msgr2=0x7f74d819a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:59.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.559+0000 7f74dce00640 1 --2- 172.21.15.1:0/2709364421 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74d8104f40 0x7f74d819a5f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f74c400e9f0 tx=0x7f74c400edf0 comp rx=0 tx=0).stop 2024-09-15T22:27:59.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.559+0000 7f74dce00640 1 -- 172.21.15.1:0/2709364421 shutdown_connections 2024-09-15T22:27:59.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.559+0000 7f74dce00640 1 --2- 172.21.15.1:0/2709364421 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f74bc0a3250 0x7f74bc0a5710 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:59.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.559+0000 7f74dce00640 1 --2- 172.21.15.1:0/2709364421 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74d8105900 0x7f74d81a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:59.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.559+0000 7f74dce00640 1 --2- 172.21.15.1:0/2709364421 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74d8104f40 0x7f74d819a5f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:59.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.559+0000 7f74dce00640 1 --2- 172.21.15.1:0/2709364421 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74d8103d50 0x7f74d819a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:59.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.559+0000 7f74dce00640 1 -- 172.21.15.1:0/2709364421 >> 172.21.15.1:0/2709364421 conn(0x7f74d80ff4b0 msgr2=0x7f74d8108310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:59.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.559+0000 7f74dce00640 1 -- 172.21.15.1:0/2709364421 shutdown_connections 2024-09-15T22:27:59.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.560+0000 7f74dce00640 1 -- 172.21.15.1:0/2709364421 wait complete. 2024-09-15T22:27:59.577 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-15T22:27:59.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.738+0000 7f4ba2400640 1 -- 172.21.15.1:0/3768481032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b9c105700 msgr2=0x7f4b9c10bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:59.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.738+0000 7f4ba2400640 1 --2- 172.21.15.1:0/3768481032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b9c105700 0x7f4b9c10bf90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4b94009ca0 tx=0x7f4b9402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:27:59.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.738+0000 7f4ba2400640 1 -- 172.21.15.1:0/3768481032 shutdown_connections 2024-09-15T22:27:59.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.738+0000 7f4ba2400640 1 --2- 172.21.15.1:0/3768481032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b9c105700 0x7f4b9c10bf90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:59.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.738+0000 7f4ba2400640 1 --2- 172.21.15.1:0/3768481032 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b9c104d40 0x7f4b9c1051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:59.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.738+0000 7f4ba2400640 1 --2- 172.21.15.1:0/3768481032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b9c103b50 0x7f4b9c103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:59.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.738+0000 7f4ba2400640 1 -- 172.21.15.1:0/3768481032 >> 172.21.15.1:0/3768481032 conn(0x7f4b9c0ff2b0 msgr2=0x7f4b9c1016f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:59.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.738+0000 7f4ba2400640 1 -- 172.21.15.1:0/3768481032 shutdown_connections 2024-09-15T22:27:59.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.738+0000 7f4ba2400640 1 -- 172.21.15.1:0/3768481032 wait complete. 2024-09-15T22:27:59.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.739+0000 7f4ba2400640 1 Processor -- start 2024-09-15T22:27:59.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.739+0000 7f4ba2400640 1 -- start start 2024-09-15T22:27:59.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.739+0000 7f4ba2400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b9c103b50 0x7f4b9c199e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:59.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.739+0000 7f4ba2400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b9c104d40 0x7f4b9c19a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:59.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.739+0000 7f4ba2400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b9c105700 0x7f4b9c1a1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:59.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.739+0000 7f4ba2400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9c10f800 con 0x7f4b9c105700 2024-09-15T22:27:59.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.739+0000 7f4ba2400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9c10f680 con 0x7f4b9c103b50 2024-09-15T22:27:59.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.739+0000 7f4ba2400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9c10f980 con 0x7f4b9c104d40 2024-09-15T22:27:59.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.740+0000 7f4ba1a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b9c105700 0x7f4b9c1a1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:59.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.740+0000 7f4ba1000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b9c103b50 0x7f4b9c199e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:59.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.740+0000 7f4ba1a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b9c105700 0x7f4b9c1a1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36484/0 (socket says 172.21.15.1:36484) 2024-09-15T22:27:59.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.740+0000 7f4ba1a00640 1 -- 172.21.15.1:0/1844732859 learned_addr learned my addr 172.21.15.1:0/1844732859 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:27:59.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.740+0000 7f4b9be00640 1 --2- 172.21.15.1:0/1844732859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b9c104d40 0x7f4b9c19a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:59.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.740+0000 7f4ba1a00640 1 -- 172.21.15.1:0/1844732859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b9c104d40 msgr2=0x7f4b9c19a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:59.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.740+0000 7f4ba1a00640 1 --2- 172.21.15.1:0/1844732859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b9c104d40 0x7f4b9c19a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:59.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.740+0000 7f4ba1a00640 1 -- 172.21.15.1:0/1844732859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b9c103b50 msgr2=0x7f4b9c199e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:59.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.740+0000 7f4ba1a00640 1 --2- 172.21.15.1:0/1844732859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b9c103b50 0x7f4b9c199e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:59.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.740+0000 7f4ba1a00640 1 -- 172.21.15.1:0/1844732859 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b9c1a1a80 con 0x7f4b9c105700 2024-09-15T22:27:59.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.741+0000 7f4ba1a00640 1 --2- 172.21.15.1:0/1844732859 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b9c105700 0x7f4b9c1a1410 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4b9402f540 tx=0x7f4b94031750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:59.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.741+0000 7f4b99600640 1 -- 172.21.15.1:0/1844732859 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b94003b70 con 0x7f4b9c105700 2024-09-15T22:27:59.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.741+0000 7f4b99600640 1 -- 172.21.15.1:0/1844732859 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b94003d10 con 0x7f4b9c105700 2024-09-15T22:27:59.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.741+0000 7f4b99600640 1 -- 172.21.15.1:0/1844732859 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9402fb50 con 0x7f4b9c105700 2024-09-15T22:27:59.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.741+0000 7f4ba2400640 1 -- 172.21.15.1:0/1844732859 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b9c1a1d10 con 0x7f4b9c105700 2024-09-15T22:27:59.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.741+0000 7f4ba2400640 1 -- 172.21.15.1:0/1844732859 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b9c1a21b0 con 0x7f4b9c105700 2024-09-15T22:27:59.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.742+0000 7f4ba2400640 1 -- 172.21.15.1:0/1844732859 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b9c10af40 con 0x7f4b9c105700 2024-09-15T22:27:59.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.744+0000 7f4b99600640 1 -- 172.21.15.1:0/1844732859 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f4b9402fcf0 con 0x7f4b9c105700 2024-09-15T22:27:59.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.745+0000 7f4b99600640 1 --2- 172.21.15.1:0/1844732859 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f4b840a32d0 0x7f4b840a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:59.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.745+0000 7f4b99600640 1 -- 172.21.15.1:0/1844732859 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f4b940f0cf0 con 0x7f4b9c105700 2024-09-15T22:27:59.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.746+0000 7f4ba1000640 1 --2- 172.21.15.1:0/1844732859 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f4b840a32d0 0x7f4b840a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:59.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.746+0000 7f4ba1000640 1 --2- 172.21.15.1:0/1844732859 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f4b840a32d0 0x7f4b840a5790 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c104ba0 tx=0x7f4b90005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:59.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.749+0000 7f4b99600640 1 -- 172.21.15.1:0/1844732859 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4b940bd950 con 0x7f4b9c105700 2024-09-15T22:27:59.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.934+0000 7f4ba2400640 1 -- 172.21.15.1:0/1844732859 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4b9c062ef0 con 0x7f4b9c105700 2024-09-15T22:27:59.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.934+0000 7f4b99600640 1 -- 172.21.15.1:0/1844732859 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) ==== 100+0+11 (secure 0 0 0) 0x7f4b940bd250 con 0x7f4b9c105700 2024-09-15T22:27:59.936 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2024-09-15T22:27:59.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.937+0000 7f4ba2400640 1 -- 172.21.15.1:0/1844732859 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f4b840a32d0 msgr2=0x7f4b840a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:59.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.937+0000 7f4ba2400640 1 --2- 172.21.15.1:0/1844732859 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f4b840a32d0 0x7f4b840a5790 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c104ba0 tx=0x7f4b90005f90 comp rx=0 tx=0).stop 2024-09-15T22:27:59.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.937+0000 7f4ba2400640 1 -- 172.21.15.1:0/1844732859 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b9c105700 msgr2=0x7f4b9c1a1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:59.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.937+0000 7f4ba2400640 1 --2- 172.21.15.1:0/1844732859 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b9c105700 0x7f4b9c1a1410 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4b9402f540 tx=0x7f4b94031750 comp rx=0 tx=0).stop 2024-09-15T22:27:59.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.937+0000 7f4ba2400640 1 -- 172.21.15.1:0/1844732859 shutdown_connections 2024-09-15T22:27:59.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.937+0000 7f4ba2400640 1 --2- 172.21.15.1:0/1844732859 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f4b840a32d0 0x7f4b840a5790 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:59.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.937+0000 7f4ba2400640 1 --2- 172.21.15.1:0/1844732859 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b9c105700 0x7f4b9c1a1410 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:59.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.937+0000 7f4ba2400640 1 --2- 172.21.15.1:0/1844732859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b9c104d40 0x7f4b9c19a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:59.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.937+0000 7f4ba2400640 1 --2- 172.21.15.1:0/1844732859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b9c103b50 0x7f4b9c199e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:59.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.937+0000 7f4ba2400640 1 -- 172.21.15.1:0/1844732859 >> 172.21.15.1:0/1844732859 conn(0x7f4b9c0ff2b0 msgr2=0x7f4b9c108110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:59.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.938+0000 7f4ba2400640 1 -- 172.21.15.1:0/1844732859 shutdown_connections 2024-09-15T22:27:59.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:27:59.938+0000 7f4ba2400640 1 -- 172.21.15.1:0/1844732859 wait complete. 2024-09-15T22:27:59.956 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-15T22:28:00.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.117+0000 7f2e33600640 1 -- 172.21.15.1:0/1084277892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e2c104f30 msgr2=0x7f2e2c1053b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:00.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.117+0000 7f2e33600640 1 --2- 172.21.15.1:0/1084277892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e2c104f30 0x7f2e2c1053b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2e18009900 tx=0x7f2e1802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:28:00.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.117+0000 7f2e33600640 1 -- 172.21.15.1:0/1084277892 shutdown_connections 2024-09-15T22:28:00.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.117+0000 7f2e33600640 1 --2- 172.21.15.1:0/1084277892 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e2c1058f0 0x7f2e2c10c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:00.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.117+0000 7f2e33600640 1 --2- 172.21.15.1:0/1084277892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e2c104f30 0x7f2e2c1053b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:00.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.117+0000 7f2e33600640 1 --2- 172.21.15.1:0/1084277892 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e2c103d40 0x7f2e2c104140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:00.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.117+0000 7f2e33600640 1 -- 172.21.15.1:0/1084277892 >> 172.21.15.1:0/1084277892 conn(0x7f2e2c0ff4e0 msgr2=0x7f2e2c101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:28:00.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.117+0000 7f2e33600640 1 -- 172.21.15.1:0/1084277892 shutdown_connections 2024-09-15T22:28:00.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.117+0000 7f2e33600640 1 -- 172.21.15.1:0/1084277892 wait complete. 2024-09-15T22:28:00.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.118+0000 7f2e33600640 1 Processor -- start 2024-09-15T22:28:00.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.118+0000 7f2e33600640 1 -- start start 2024-09-15T22:28:00.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.118+0000 7f2e33600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e2c103d40 0x7f2e2c19a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:00.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.118+0000 7f2e33600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e2c104f30 0x7f2e2c19a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:00.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.118+0000 7f2e33600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e2c1058f0 0x7f2e2c1a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:00.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.118+0000 7f2e33600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c10f9c0 con 0x7f2e2c103d40 2024-09-15T22:28:00.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.118+0000 7f2e33600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c10f840 con 0x7f2e2c1058f0 2024-09-15T22:28:00.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.118+0000 7f2e33600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c10fb40 con 0x7f2e2c104f30 2024-09-15T22:28:00.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.119+0000 7f2e30c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e2c103d40 0x7f2e2c19a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:00.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.119+0000 7f2e30c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e2c103d40 0x7f2e2c19a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36494/0 (socket says 172.21.15.1:36494) 2024-09-15T22:28:00.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.119+0000 7f2e30c00640 1 -- 172.21.15.1:0/285966533 learned_addr learned my addr 172.21.15.1:0/285966533 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:28:00.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.119+0000 7f2e2be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e2c104f30 0x7f2e2c19a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:00.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.119+0000 7f2e31600640 1 --2- 172.21.15.1:0/285966533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e2c1058f0 0x7f2e2c1a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:00.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.119+0000 7f2e30c00640 1 -- 172.21.15.1:0/285966533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e2c104f30 msgr2=0x7f2e2c19a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:00.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.119+0000 7f2e30c00640 1 --2- 172.21.15.1:0/285966533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e2c104f30 0x7f2e2c19a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:00.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.119+0000 7f2e30c00640 1 -- 172.21.15.1:0/285966533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e2c1058f0 msgr2=0x7f2e2c1a1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:00.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.119+0000 7f2e30c00640 1 --2- 172.21.15.1:0/285966533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e2c1058f0 0x7f2e2c1a1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:00.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.119+0000 7f2e30c00640 1 -- 172.21.15.1:0/285966533 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e2c1a1c90 con 0x7f2e2c103d40 2024-09-15T22:28:00.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.120+0000 7f2e30c00640 1 --2- 172.21.15.1:0/285966533 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e2c103d40 0x7f2e2c19a070 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2e2000d950 tx=0x7f2e2000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:28:00.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.120+0000 7f2e29600640 1 -- 172.21.15.1:0/285966533 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e20017070 con 0x7f2e2c103d40 2024-09-15T22:28:00.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.120+0000 7f2e29600640 1 -- 172.21.15.1:0/285966533 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e20009c30 con 0x7f2e2c103d40 2024-09-15T22:28:00.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.120+0000 7f2e33600640 1 -- 172.21.15.1:0/285966533 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e2c1a1f80 con 0x7f2e2c103d40 2024-09-15T22:28:00.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.120+0000 7f2e29600640 1 -- 172.21.15.1:0/285966533 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2000f600 con 0x7f2e2c103d40 2024-09-15T22:28:00.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.120+0000 7f2e33600640 1 -- 172.21.15.1:0/285966533 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e2c1a2390 con 0x7f2e2c103d40 2024-09-15T22:28:00.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.121+0000 7f2e33600640 1 -- 172.21.15.1:0/285966533 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e2c10b130 con 0x7f2e2c103d40 2024-09-15T22:28:00.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.123+0000 7f2e29600640 1 -- 172.21.15.1:0/285966533 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f2e2001a070 con 0x7f2e2c103d40 2024-09-15T22:28:00.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.124+0000 7f2e29600640 1 --2- 172.21.15.1:0/285966533 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2e140a3250 0x7f2e140a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:00.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.125+0000 7f2e29600640 1 -- 172.21.15.1:0/285966533 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f2e200cf330 con 0x7f2e2c103d40 2024-09-15T22:28:00.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.125+0000 7f2e2be00640 1 --2- 172.21.15.1:0/285966533 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2e140a3250 0x7f2e140a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:00.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.125+0000 7f2e2be00640 1 --2- 172.21.15.1:0/285966533 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2e140a3250 0x7f2e140a5710 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2e180314e0 tx=0x7f2e18000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:28:00.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.126+0000 7f2e29600640 1 -- 172.21.15.1:0/285966533 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2e20009de0 con 0x7f2e2c103d40 2024-09-15T22:28:00.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.363+0000 7f2e33600640 1 -- 172.21.15.1:0/285966533 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f2e2c02da30 con 0x7f2e2c103d40 2024-09-15T22:28:00.375 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:00 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/1236700860' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T22:28:00.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:00 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/2709364421' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-15T22:28:00.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:00 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/1844732859' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-15T22:28:00.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.374+0000 7f2e29600640 1 -- 172.21.15.1:0/285966533 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+742331 (secure 0 0 0) 0x7f2e2009b940 con 0x7f2e2c103d40 2024-09-15T22:28:00.388 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:28:00.388 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-15T22:28:00.388 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 18, 2024-09-15T22:28:00.388 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.388 INFO:teuthology.orchestra.run.smithi001.stdout: "active_gid": 14150, 2024-09-15T22:28:00.388 INFO:teuthology.orchestra.run.smithi001.stdout: "active_name": "x", 2024-09-15T22:28:00.388 INFO:teuthology.orchestra.run.smithi001.stdout: "active_addrs": { 2024-09-15T22:28:00.388 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-15T22:28:00.389 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.389 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-15T22:28:00.389 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:6800", 2024-09-15T22:28:00.389 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 3816767836 2024-09-15T22:28:00.389 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.389 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.389 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-15T22:28:00.389 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:6801", 2024-09-15T22:28:00.389 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 3816767836 2024-09-15T22:28:00.389 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.389 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-15T22:28:00.389 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.389 INFO:teuthology.orchestra.run.smithi001.stdout: "active_addr": "172.21.15.1:6801/3816767836", 2024-09-15T22:28:00.390 INFO:teuthology.orchestra.run.smithi001.stdout: "active_change": "2024-09-15T22:15:31.433526+0000", 2024-09-15T22:28:00.390 INFO:teuthology.orchestra.run.smithi001.stdout: "active_mgr_features": 4540701547738038271, 2024-09-15T22:28:00.390 INFO:teuthology.orchestra.run.smithi001.stdout: "available": true, 2024-09-15T22:28:00.390 INFO:teuthology.orchestra.run.smithi001.stdout: "standbys": [ 2024-09-15T22:28:00.390 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.390 INFO:teuthology.orchestra.run.smithi001.stdout: "gid": 24109, 2024-09-15T22:28:00.390 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "z", 2024-09-15T22:28:00.390 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_features": 4540701547738038271, 2024-09-15T22:28:00.390 INFO:teuthology.orchestra.run.smithi001.stdout: "available_modules": [ 2024-09-15T22:28:00.390 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.390 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "alerts", 2024-09-15T22:28:00.390 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.390 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.391 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.391 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-15T22:28:00.391 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-15T22:28:00.391 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:00.391 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.391 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.391 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-15T22:28:00.391 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.391 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.391 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.391 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How frequently to reexamine health status", 2024-09-15T22:28:00.391 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.391 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.392 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.392 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.392 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.392 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.392 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.392 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.392 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.392 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.392 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.392 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.392 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.392 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.392 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.393 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.393 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.393 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.393 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.393 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.393 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.393 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.393 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.393 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.393 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.393 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.393 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.394 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.394 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.394 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.394 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.394 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.394 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.394 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.394 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.394 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.394 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.394 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.394 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.394 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.394 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.395 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.395 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.395 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.395 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.395 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.395 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.395 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.395 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.395 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.395 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.395 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.395 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.395 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.396 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.396 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.396 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.396 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.396 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.396 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.396 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.396 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.396 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.396 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.396 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.396 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.396 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.397 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.397 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.397 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.397 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.397 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.397 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.397 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.397 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_destination": { 2024-09-15T22:28:00.397 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_destination", 2024-09-15T22:28:00.397 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.397 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.397 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.397 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.398 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.398 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.398 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.398 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email address to send alerts to", 2024-09-15T22:28:00.398 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.398 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.398 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.398 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.398 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_from_name": { 2024-09-15T22:28:00.398 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_from_name", 2024-09-15T22:28:00.398 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.398 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.398 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.398 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "Ceph", 2024-09-15T22:28:00.399 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.399 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.399 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.399 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email From: name", 2024-09-15T22:28:00.399 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.399 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.399 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.399 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.399 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_host": { 2024-09-15T22:28:00.399 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_host", 2024-09-15T22:28:00.399 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.399 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.399 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.399 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.400 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.400 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.400 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.400 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP server", 2024-09-15T22:28:00.400 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.400 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.400 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.400 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.400 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_password": { 2024-09-15T22:28:00.400 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_password", 2024-09-15T22:28:00.400 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.400 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.400 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.400 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.401 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.401 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.401 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.401 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Password to authenticate with", 2024-09-15T22:28:00.401 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.401 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.401 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.401 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.401 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_port": { 2024-09-15T22:28:00.401 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_port", 2024-09-15T22:28:00.401 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.401 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.401 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.402 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "465", 2024-09-15T22:28:00.402 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.402 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.402 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.402 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP port", 2024-09-15T22:28:00.402 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.402 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.402 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.402 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.402 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_sender": { 2024-09-15T22:28:00.402 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_sender", 2024-09-15T22:28:00.402 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.402 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.402 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.402 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.403 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.403 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.403 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.403 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP envelope sender", 2024-09-15T22:28:00.404 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.405 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.405 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.405 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.405 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_ssl": { 2024-09-15T22:28:00.405 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_ssl", 2024-09-15T22:28:00.405 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.405 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.405 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.405 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.405 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.405 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.406 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.406 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-15T22:28:00.406 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.406 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.406 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.406 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.406 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_user": { 2024-09-15T22:28:00.406 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_user", 2024-09-15T22:28:00.406 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.406 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.406 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.406 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.406 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.406 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.407 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.407 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "User to authenticate as", 2024-09-15T22:28:00.407 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.407 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.407 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.407 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.407 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.407 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.407 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.407 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "balancer", 2024-09-15T22:28:00.407 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.407 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.407 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.408 INFO:teuthology.orchestra.run.smithi001.stdout: "active": { 2024-09-15T22:28:00.408 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "active", 2024-09-15T22:28:00.408 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.408 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.408 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.408 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.408 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.408 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.408 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.408 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically balance PGs across cluster", 2024-09-15T22:28:00.408 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.408 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.408 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.409 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.409 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_time": { 2024-09-15T22:28:00.409 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_time", 2024-09-15T22:28:00.409 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.409 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.409 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.409 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0000", 2024-09-15T22:28:00.409 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.409 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.409 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.409 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "beginning time of day to automatically balance", 2024-09-15T22:28:00.409 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T22:28:00.409 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.410 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.410 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.410 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_weekday": { 2024-09-15T22:28:00.410 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_weekday", 2024-09-15T22:28:00.410 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-15T22:28:00.410 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.410 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.410 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-15T22:28:00.410 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-15T22:28:00.410 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-15T22:28:00.410 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.410 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-15T22:28:00.410 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T22:28:00.411 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.411 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.411 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.411 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_max_iterations": { 2024-09-15T22:28:00.411 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_max_iterations", 2024-09-15T22:28:00.411 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-15T22:28:00.411 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.411 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.411 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "25", 2024-09-15T22:28:00.411 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-15T22:28:00.411 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "250", 2024-09-15T22:28:00.411 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.411 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-15T22:28:00.412 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.412 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.412 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.412 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.412 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_metrics": { 2024-09-15T22:28:00.412 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_metrics", 2024-09-15T22:28:00.412 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.412 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.412 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.412 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "pgs,objects,bytes", 2024-09-15T22:28:00.412 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.412 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.412 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.413 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-15T22:28:00.413 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-15T22:28:00.413 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.413 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.413 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.413 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_step": { 2024-09-15T22:28:00.413 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_step", 2024-09-15T22:28:00.413 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-15T22:28:00.413 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.413 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.413 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.5", 2024-09-15T22:28:00.413 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0.001", 2024-09-15T22:28:00.413 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "0.999", 2024-09-15T22:28:00.414 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.414 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "aggressiveness of optimization", 2024-09-15T22:28:00.414 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-15T22:28:00.414 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.414 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.414 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.414 INFO:teuthology.orchestra.run.smithi001.stdout: "end_time": { 2024-09-15T22:28:00.414 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_time", 2024-09-15T22:28:00.414 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.414 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.414 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.414 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2359", 2024-09-15T22:28:00.414 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.414 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.415 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.415 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ending time of day to automatically balance", 2024-09-15T22:28:00.415 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T22:28:00.415 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.415 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.415 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.415 INFO:teuthology.orchestra.run.smithi001.stdout: "end_weekday": { 2024-09-15T22:28:00.415 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_weekday", 2024-09-15T22:28:00.415 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-15T22:28:00.415 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.415 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.415 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-15T22:28:00.415 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-15T22:28:00.416 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-15T22:28:00.416 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.416 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-15T22:28:00.416 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T22:28:00.416 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.416 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.417 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.417 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.417 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.417 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.417 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.417 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.418 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.418 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.418 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.418 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.418 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.418 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.418 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.419 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.419 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.419 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.419 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.419 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.419 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.420 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.420 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.420 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.420 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.420 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.420 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.420 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.421 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.421 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.421 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.421 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.421 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.421 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.422 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.422 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.422 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.422 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.422 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.422 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.423 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.423 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.423 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.423 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.423 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.423 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.423 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.424 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.424 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.424 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.424 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.424 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.424 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.424 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.424 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.425 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.425 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.425 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.425 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.425 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.425 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.425 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.425 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.425 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.426 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.426 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.426 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.426 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.426 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.426 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.426 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.426 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.427 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.427 INFO:teuthology.orchestra.run.smithi001.stdout: "min_score": { 2024-09-15T22:28:00.427 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_score", 2024-09-15T22:28:00.427 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-15T22:28:00.427 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.427 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.427 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-15T22:28:00.427 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.427 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.428 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.428 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-15T22:28:00.428 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.428 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.428 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.428 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.428 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-15T22:28:00.428 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-15T22:28:00.428 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.428 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.428 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.428 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "upmap", 2024-09-15T22:28:00.428 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.429 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.429 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.429 INFO:teuthology.orchestra.run.smithi001.stdout: "crush-compat", 2024-09-15T22:28:00.429 INFO:teuthology.orchestra.run.smithi001.stdout: "none", 2024-09-15T22:28:00.429 INFO:teuthology.orchestra.run.smithi001.stdout: "read", 2024-09-15T22:28:00.429 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap", 2024-09-15T22:28:00.429 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap-read" 2024-09-15T22:28:00.429 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.429 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Balancer mode", 2024-09-15T22:28:00.429 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.429 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.429 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.430 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.430 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_ids": { 2024-09-15T22:28:00.430 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_ids", 2024-09-15T22:28:00.430 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.430 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.430 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.430 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.430 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.430 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.430 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.430 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-15T22:28:00.430 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.430 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.431 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.431 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.431 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-15T22:28:00.431 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-15T22:28:00.431 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:00.431 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.431 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.431 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-15T22:28:00.431 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.431 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.431 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.431 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-15T22:28:00.432 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.432 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.432 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.432 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.432 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_deviation": { 2024-09-15T22:28:00.432 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_deviation", 2024-09-15T22:28:00.432 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.432 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.432 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.432 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-15T22:28:00.432 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-15T22:28:00.432 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.433 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.433 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-15T22:28:00.433 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-15T22:28:00.433 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.433 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.433 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.433 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_optimizations": { 2024-09-15T22:28:00.433 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_optimizations", 2024-09-15T22:28:00.433 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-15T22:28:00.433 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.433 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.433 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-15T22:28:00.433 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.433 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.434 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.434 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-15T22:28:00.434 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.434 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.434 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.434 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.434 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.434 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.434 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.434 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm", 2024-09-15T22:28:00.434 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.434 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.434 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.435 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_down_multiplier": { 2024-09-15T22:28:00.435 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_down_multiplier", 2024-09-15T22:28:00.435 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-15T22:28:00.435 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.435 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.435 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-15T22:28:00.435 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.435 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.435 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.435 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-15T22:28:00.436 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.436 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.436 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.436 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.436 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_refresh_rate": { 2024-09-15T22:28:00.436 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_refresh_rate", 2024-09-15T22:28:00.436 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:00.436 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.436 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.436 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "20", 2024-09-15T22:28:00.437 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.437 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.437 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.437 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-15T22:28:00.437 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.437 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.437 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.437 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.437 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_starting_port": { 2024-09-15T22:28:00.437 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_starting_port", 2024-09-15T22:28:00.437 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.437 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.437 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.438 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4721", 2024-09-15T22:28:00.438 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.438 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.438 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.438 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-15T22:28:00.438 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.438 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.438 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.438 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.438 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_ptrace": { 2024-09-15T22:28:00.438 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_ptrace", 2024-09-15T22:28:00.439 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.439 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.439 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.439 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.439 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.439 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.439 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.439 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-15T22:28:00.439 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-15T22:28:00.439 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.439 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.439 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.439 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_interval": { 2024-09-15T22:28:00.440 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_interval", 2024-09-15T22:28:00.440 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:00.440 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.440 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.440 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-15T22:28:00.440 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.440 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.440 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.440 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-15T22:28:00.440 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.440 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.440 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.441 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.441 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_memory_target_ratio": { 2024-09-15T22:28:00.441 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_memory_target_ratio", 2024-09-15T22:28:00.441 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-15T22:28:00.441 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.441 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.441 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.7", 2024-09-15T22:28:00.441 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.441 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.441 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.441 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-15T22:28:00.441 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.441 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.442 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.442 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.442 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm_log_destination": { 2024-09-15T22:28:00.442 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm_log_destination", 2024-09-15T22:28:00.442 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.442 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.442 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.442 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.442 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.442 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.442 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.442 INFO:teuthology.orchestra.run.smithi001.stdout: "file", 2024-09-15T22:28:00.442 INFO:teuthology.orchestra.run.smithi001.stdout: "file,syslog", 2024-09-15T22:28:00.443 INFO:teuthology.orchestra.run.smithi001.stdout: "syslog" 2024-09-15T22:28:00.443 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.443 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-15T22:28:00.443 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.443 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.443 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.443 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.443 INFO:teuthology.orchestra.run.smithi001.stdout: "cgroups_split": { 2024-09-15T22:28:00.443 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cgroups_split", 2024-09-15T22:28:00.443 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.443 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.443 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.443 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.444 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.444 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.444 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.444 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-15T22:28:00.444 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.444 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.444 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.444 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.444 INFO:teuthology.orchestra.run.smithi001.stdout: "config_checks_enabled": { 2024-09-15T22:28:00.444 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_checks_enabled", 2024-09-15T22:28:00.444 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.444 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.445 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.445 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.445 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.445 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.445 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.445 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-15T22:28:00.445 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.445 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.445 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.445 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.445 INFO:teuthology.orchestra.run.smithi001.stdout: "config_dashboard": { 2024-09-15T22:28:00.445 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_dashboard", 2024-09-15T22:28:00.445 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.446 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.446 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.446 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.446 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.446 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.446 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.446 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-15T22:28:00.446 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.446 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.446 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.446 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.446 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_alertmanager": { 2024-09-15T22:28:00.446 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_alertmanager", 2024-09-15T22:28:00.447 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.447 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.447 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.447 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-15T22:28:00.447 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.447 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.447 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.447 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-15T22:28:00.447 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.447 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.447 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.447 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.447 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_base": { 2024-09-15T22:28:00.448 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_base", 2024-09-15T22:28:00.448 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.448 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.448 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.448 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-15T22:28:00.448 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.449 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.449 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.449 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Container image name, without the tag", 2024-09-15T22:28:00.449 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.449 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.449 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.450 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.450 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_elasticsearch": { 2024-09-15T22:28:00.450 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_elasticsearch", 2024-09-15T22:28:00.450 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.450 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.450 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.451 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-15T22:28:00.451 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.451 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.451 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.451 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "elasticsearch container image", 2024-09-15T22:28:00.451 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.451 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.452 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.452 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.452 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_grafana": { 2024-09-15T22:28:00.452 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_grafana", 2024-09-15T22:28:00.452 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.452 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.452 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.452 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-15T22:28:00.453 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.453 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.453 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.453 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-15T22:28:00.453 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.453 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.453 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.454 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.454 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_haproxy": { 2024-09-15T22:28:00.454 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_haproxy", 2024-09-15T22:28:00.454 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.454 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.454 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.455 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-15T22:28:00.455 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.455 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.455 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.455 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "HAproxy container image", 2024-09-15T22:28:00.456 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.456 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.456 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.456 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.456 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_agent": { 2024-09-15T22:28:00.456 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_agent", 2024-09-15T22:28:00.457 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.457 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.457 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.457 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-15T22:28:00.457 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.457 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.457 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.457 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger agent container image", 2024-09-15T22:28:00.457 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.457 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.458 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.458 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.458 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_collector": { 2024-09-15T22:28:00.458 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_collector", 2024-09-15T22:28:00.458 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.458 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.458 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.458 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-15T22:28:00.458 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.458 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.458 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.458 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger collector container image", 2024-09-15T22:28:00.458 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.459 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.459 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.459 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.459 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_query": { 2024-09-15T22:28:00.459 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_query", 2024-09-15T22:28:00.459 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.459 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.459 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.459 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-15T22:28:00.459 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.460 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.460 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.460 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger query container image", 2024-09-15T22:28:00.460 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.460 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.460 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.460 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.460 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_keepalived": { 2024-09-15T22:28:00.460 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_keepalived", 2024-09-15T22:28:00.460 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.460 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.461 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.461 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-15T22:28:00.461 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.461 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.461 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.461 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Keepalived container image", 2024-09-15T22:28:00.461 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.461 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.461 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.461 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.461 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_loki": { 2024-09-15T22:28:00.462 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_loki", 2024-09-15T22:28:00.462 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.462 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.462 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.462 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-15T22:28:00.462 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.462 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.462 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.462 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Loki container image", 2024-09-15T22:28:00.462 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.462 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.462 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.462 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.463 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_node_exporter": { 2024-09-15T22:28:00.463 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_node_exporter", 2024-09-15T22:28:00.463 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.463 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.463 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.463 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-15T22:28:00.463 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.463 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.463 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.463 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-15T22:28:00.463 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.463 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.463 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.464 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.464 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_nvmeof": { 2024-09-15T22:28:00.464 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_nvmeof", 2024-09-15T22:28:00.464 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.464 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.464 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.464 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-15T22:28:00.464 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.464 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.464 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.464 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Nvme-of container image", 2024-09-15T22:28:00.464 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.464 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.465 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.465 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.465 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_prometheus": { 2024-09-15T22:28:00.465 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_prometheus", 2024-09-15T22:28:00.465 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.465 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.465 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.465 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-15T22:28:00.465 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.465 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.465 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.465 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-15T22:28:00.465 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.466 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.466 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.466 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.466 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_promtail": { 2024-09-15T22:28:00.466 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_promtail", 2024-09-15T22:28:00.466 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.466 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.466 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.466 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-15T22:28:00.466 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.466 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.466 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.466 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Promtail container image", 2024-09-15T22:28:00.467 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.467 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.467 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.467 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.467 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_samba": { 2024-09-15T22:28:00.467 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_samba", 2024-09-15T22:28:00.467 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.467 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.467 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.467 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-15T22:28:00.468 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.468 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.468 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.468 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Samba/SMB container image", 2024-09-15T22:28:00.468 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.468 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.468 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.468 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.468 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_snmp_gateway": { 2024-09-15T22:28:00.468 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_snmp_gateway", 2024-09-15T22:28:00.468 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.469 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.469 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.469 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-15T22:28:00.469 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.469 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.469 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.469 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SNMP Gateway container image", 2024-09-15T22:28:00.469 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.469 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.469 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.469 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.469 INFO:teuthology.orchestra.run.smithi001.stdout: "container_init": { 2024-09-15T22:28:00.469 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_init", 2024-09-15T22:28:00.470 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.470 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.470 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.470 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.470 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.470 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.470 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.470 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Run podman/docker with `--init`", 2024-09-15T22:28:00.470 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.470 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.470 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.470 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.471 INFO:teuthology.orchestra.run.smithi001.stdout: "daemon_cache_timeout": { 2024-09-15T22:28:00.471 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "daemon_cache_timeout", 2024-09-15T22:28:00.471 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:00.471 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.471 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.471 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-15T22:28:00.471 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.471 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.471 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.471 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-15T22:28:00.471 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.471 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.471 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.471 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.472 INFO:teuthology.orchestra.run.smithi001.stdout: "default_cephadm_command_timeout": { 2024-09-15T22:28:00.472 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_cephadm_command_timeout", 2024-09-15T22:28:00.472 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.472 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.472 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.472 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "900", 2024-09-15T22:28:00.472 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.472 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.472 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.472 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-15T22:28:00.472 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.472 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.472 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.473 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.473 INFO:teuthology.orchestra.run.smithi001.stdout: "default_registry": { 2024-09-15T22:28:00.473 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_registry", 2024-09-15T22:28:00.473 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.473 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.473 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.473 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io", 2024-09-15T22:28:00.473 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.473 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.473 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.473 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-15T22:28:00.473 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.473 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.473 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.474 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.474 INFO:teuthology.orchestra.run.smithi001.stdout: "device_cache_timeout": { 2024-09-15T22:28:00.474 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_cache_timeout", 2024-09-15T22:28:00.474 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:00.474 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.474 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.474 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1800", 2024-09-15T22:28:00.474 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.474 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.474 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.474 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache device inventory", 2024-09-15T22:28:00.474 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.474 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: "device_enhanced_scan": { 2024-09-15T22:28:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_enhanced_scan", 2024-09-15T22:28:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-15T22:28:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: "facts_cache_timeout": { 2024-09-15T22:28:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "facts_cache_timeout", 2024-09-15T22:28:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-15T22:28:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache host facts data", 2024-09-15T22:28:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.477 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.477 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.477 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.477 INFO:teuthology.orchestra.run.smithi001.stdout: "grafana_dashboards_path": { 2024-09-15T22:28:00.477 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "grafana_dashboards_path", 2024-09-15T22:28:00.477 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.477 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.477 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.477 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-15T22:28:00.477 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.477 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.477 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.478 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-15T22:28:00.478 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.478 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.478 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.478 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.478 INFO:teuthology.orchestra.run.smithi001.stdout: "host_check_interval": { 2024-09-15T22:28:00.478 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "host_check_interval", 2024-09-15T22:28:00.478 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:00.478 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.478 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.478 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-15T22:28:00.478 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.478 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.479 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.479 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to perform a host check", 2024-09-15T22:28:00.479 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.479 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.479 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.479 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.479 INFO:teuthology.orchestra.run.smithi001.stdout: "hw_monitoring": { 2024-09-15T22:28:00.479 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hw_monitoring", 2024-09-15T22:28:00.479 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.479 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.479 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.479 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.479 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.479 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.480 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.480 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-15T22:28:00.480 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.480 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.480 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.480 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.480 INFO:teuthology.orchestra.run.smithi001.stdout: "inventory_list_all": { 2024-09-15T22:28:00.480 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "inventory_list_all", 2024-09-15T22:28:00.480 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.480 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.480 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.480 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.481 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.481 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.481 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.481 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-15T22:28:00.481 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.481 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.481 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.481 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.481 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.481 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.481 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.481 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.481 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.482 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.482 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.482 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.482 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.482 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.482 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.482 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.482 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.482 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.482 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.483 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.483 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.483 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.483 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.483 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.483 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.483 INFO:teuthology.orchestra.run.smithi001.stdout: "log_refresh_metadata": { 2024-09-15T22:28:00.483 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_refresh_metadata", 2024-09-15T22:28:00.483 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.483 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.483 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.483 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.483 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-15T22:28:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-15T22:28:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.486 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.486 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.486 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.486 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.486 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.486 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.486 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.486 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.486 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.486 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.486 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.486 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.487 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.487 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.487 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.487 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.487 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.487 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.487 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.487 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.487 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.487 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.487 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.487 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.487 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.488 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.488 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.488 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.488 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.488 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.488 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.488 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.488 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.488 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-15T22:28:00.488 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-15T22:28:00.488 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.488 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.488 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.489 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.489 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.489 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.489 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.489 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-15T22:28:00.489 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.489 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.489 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.489 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.489 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-15T22:28:00.489 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-15T22:28:00.489 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.489 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.490 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.490 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "*", 2024-09-15T22:28:00.490 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.490 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.490 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.490 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-15T22:28:00.490 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.490 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.490 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.490 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.491 INFO:teuthology.orchestra.run.smithi001.stdout: "max_count_per_host": { 2024-09-15T22:28:00.491 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_count_per_host", 2024-09-15T22:28:00.491 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.491 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.491 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.491 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-15T22:28:00.491 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.491 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.491 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.491 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of daemons per service per host", 2024-09-15T22:28:00.491 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.491 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.491 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.492 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.492 INFO:teuthology.orchestra.run.smithi001.stdout: "max_osd_draining_count": { 2024-09-15T22:28:00.492 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_osd_draining_count", 2024-09-15T22:28:00.492 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.492 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.492 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.492 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-15T22:28:00.492 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.492 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.492 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.492 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-15T22:28:00.492 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.492 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.493 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.493 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.493 INFO:teuthology.orchestra.run.smithi001.stdout: "migration_current": { 2024-09-15T22:28:00.493 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "migration_current", 2024-09-15T22:28:00.493 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.493 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.493 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.493 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.493 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.493 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.493 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.493 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "internal - do not modify", 2024-09-15T22:28:00.493 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.494 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.494 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.494 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.494 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-15T22:28:00.494 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-15T22:28:00.494 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.494 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.494 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.494 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "root", 2024-09-15T22:28:00.494 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.494 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.494 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.494 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm-package", 2024-09-15T22:28:00.494 INFO:teuthology.orchestra.run.smithi001.stdout: "root" 2024-09-15T22:28:00.495 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.495 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "mode for remote execution of cephadm", 2024-09-15T22:28:00.495 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.495 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.495 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.495 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.495 INFO:teuthology.orchestra.run.smithi001.stdout: "oob_default_addr": { 2024-09-15T22:28:00.495 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "oob_default_addr", 2024-09-15T22:28:00.495 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.495 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.495 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.495 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "169.254.1.1", 2024-09-15T22:28:00.495 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.495 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.495 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.496 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-15T22:28:00.496 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.496 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.496 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.496 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.496 INFO:teuthology.orchestra.run.smithi001.stdout: "prometheus_alerts_path": { 2024-09-15T22:28:00.496 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus_alerts_path", 2024-09-15T22:28:00.496 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.496 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.496 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.496 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-15T22:28:00.496 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.496 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.497 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.497 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-15T22:28:00.497 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.497 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.497 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.497 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.497 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_insecure": { 2024-09-15T22:28:00.497 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_insecure", 2024-09-15T22:28:00.497 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.497 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.497 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.497 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.498 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.498 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.498 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.498 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-15T22:28:00.498 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.498 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.498 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.498 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.498 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_password": { 2024-09-15T22:28:00.498 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_password", 2024-09-15T22:28:00.498 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.498 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.499 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.499 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.499 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.499 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.499 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.499 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-15T22:28:00.499 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.499 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.499 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.499 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.499 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_url": { 2024-09-15T22:28:00.499 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_url", 2024-09-15T22:28:00.499 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.500 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.500 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.500 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.500 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.500 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.500 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.500 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-15T22:28:00.500 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.500 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.500 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.500 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.500 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_username": { 2024-09-15T22:28:00.500 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_username", 2024-09-15T22:28:00.501 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.501 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.501 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.501 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.501 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.501 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.501 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.501 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-15T22:28:00.501 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.501 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.501 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.501 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.501 INFO:teuthology.orchestra.run.smithi001.stdout: "secure_monitoring_stack": { 2024-09-15T22:28:00.501 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secure_monitoring_stack", 2024-09-15T22:28:00.502 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.502 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.502 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.502 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.502 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.502 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.502 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.502 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-15T22:28:00.502 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.502 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.502 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.502 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.502 INFO:teuthology.orchestra.run.smithi001.stdout: "service_discovery_port": { 2024-09-15T22:28:00.503 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "service_discovery_port", 2024-09-15T22:28:00.503 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.503 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.503 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.503 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8765", 2024-09-15T22:28:00.503 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.503 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.503 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.503 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "cephadm service discovery port", 2024-09-15T22:28:00.503 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.503 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.503 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.503 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.503 INFO:teuthology.orchestra.run.smithi001.stdout: "ssh_config_file": { 2024-09-15T22:28:00.504 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssh_config_file", 2024-09-15T22:28:00.504 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.504 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.504 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.504 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.504 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.504 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.504 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.504 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-15T22:28:00.504 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.504 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.504 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.505 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.505 INFO:teuthology.orchestra.run.smithi001.stdout: "use_agent": { 2024-09-15T22:28:00.505 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_agent", 2024-09-15T22:28:00.505 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.505 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.505 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.505 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.505 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.505 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.505 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.505 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-15T22:28:00.505 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.505 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.505 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.506 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.506 INFO:teuthology.orchestra.run.smithi001.stdout: "use_repo_digest": { 2024-09-15T22:28:00.506 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_repo_digest", 2024-09-15T22:28:00.506 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.506 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.506 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.506 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.506 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.506 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.506 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.506 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-15T22:28:00.506 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.506 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.506 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.507 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.507 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_failed_host_check": { 2024-09-15T22:28:00.507 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_failed_host_check", 2024-09-15T22:28:00.507 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.507 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.507 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.507 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.507 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.507 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.507 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.507 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if the host check fails", 2024-09-15T22:28:00.507 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.507 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.508 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.508 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.508 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_daemons": { 2024-09-15T22:28:00.508 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_daemons", 2024-09-15T22:28:00.508 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.508 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.508 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.508 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.508 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.508 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.508 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.508 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-15T22:28:00.508 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.509 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.509 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.509 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.509 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_hosts": { 2024-09-15T22:28:00.509 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_hosts", 2024-09-15T22:28:00.509 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.509 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.509 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.509 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.509 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.509 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.509 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.509 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-15T22:28:00.509 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.510 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.510 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.510 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.510 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.510 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.510 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.510 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crash", 2024-09-15T22:28:00.510 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.510 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.510 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.510 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.510 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.510 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.511 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.511 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.511 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.511 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.511 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.511 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.511 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.511 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.511 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.511 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.511 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.511 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.511 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.512 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.512 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.512 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.512 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.512 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.512 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.512 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.512 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.512 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.512 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.512 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.512 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.512 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.513 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.513 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.513 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.513 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.513 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.513 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.513 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.513 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.513 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.513 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.513 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.513 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.513 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.514 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.514 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.514 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.514 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.514 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.514 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.514 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.514 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.514 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.514 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.514 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.514 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.514 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.514 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.515 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.515 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.515 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.515 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.515 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.515 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.515 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.515 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.515 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.515 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.515 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.515 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.515 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.515 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.516 INFO:teuthology.orchestra.run.smithi001.stdout: "retain_interval": { 2024-09-15T22:28:00.516 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retain_interval", 2024-09-15T22:28:00.516 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:00.516 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.516 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.516 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "31536000", 2024-09-15T22:28:00.516 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.516 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.516 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.516 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-15T22:28:00.516 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.516 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.516 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.517 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.517 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_recent_interval": { 2024-09-15T22:28:00.517 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_recent_interval", 2024-09-15T22:28:00.517 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:00.517 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.517 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.517 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1209600", 2024-09-15T22:28:00.517 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.517 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.517 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.517 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-15T22:28:00.517 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.517 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.517 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.518 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.518 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.518 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.518 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.518 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dashboard", 2024-09-15T22:28:00.518 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.518 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.518 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.518 INFO:teuthology.orchestra.run.smithi001.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-15T22:28:00.518 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-15T22:28:00.518 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.518 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.518 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.518 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-15T22:28:00.519 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.519 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.519 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.519 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.519 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.519 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.519 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.519 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.519 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_HOST": { 2024-09-15T22:28:00.519 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-15T22:28:00.519 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.519 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.519 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.519 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.520 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.520 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.520 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.520 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.520 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.520 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.520 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.520 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.520 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-15T22:28:00.520 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-15T22:28:00.520 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.520 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.520 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.520 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.521 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.521 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.521 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.521 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.521 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.521 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.521 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.521 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.521 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_ENABLED": { 2024-09-15T22:28:00.521 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_ENABLED", 2024-09-15T22:28:00.521 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.521 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.521 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.521 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.522 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.522 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.522 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.522 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.522 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.522 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.522 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.522 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.522 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-15T22:28:00.522 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-15T22:28:00.522 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.522 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.522 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.522 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.523 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.523 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.523 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.523 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.523 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.523 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.523 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.523 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.523 INFO:teuthology.orchestra.run.smithi001.stdout: "ENABLE_BROWSABLE_API": { 2024-09-15T22:28:00.523 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-15T22:28:00.523 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.523 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.523 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.523 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.524 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.524 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.524 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.524 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.524 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.524 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.524 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.524 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.524 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-15T22:28:00.524 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-15T22:28:00.524 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.524 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.525 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.525 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.525 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.525 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.525 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.525 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.525 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.525 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.525 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.525 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.525 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-15T22:28:00.525 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-15T22:28:00.525 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.526 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.526 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.526 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.526 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.526 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.526 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.526 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.526 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.526 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.526 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.526 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.526 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-15T22:28:00.526 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-15T22:28:00.526 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.527 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.527 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.527 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.527 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.527 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.527 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.527 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.527 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.527 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.527 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.527 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.527 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-15T22:28:00.527 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-15T22:28:00.528 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.528 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.528 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.528 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.528 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.528 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.528 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.528 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.528 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.528 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.528 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.528 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.528 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-15T22:28:00.529 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-15T22:28:00.529 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.529 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.529 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.529 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.529 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.529 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.529 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.529 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.529 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.529 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.529 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.529 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.529 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-15T22:28:00.530 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-15T22:28:00.530 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.530 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.530 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.530 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.530 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.530 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.530 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.530 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.530 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.530 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.530 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.530 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.531 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-15T22:28:00.531 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-15T22:28:00.531 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.531 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.531 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.531 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.531 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.531 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.531 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.531 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.531 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.531 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.531 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.532 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.532 INFO:teuthology.orchestra.run.smithi001.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-15T22:28:00.532 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-15T22:28:00.532 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.532 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.532 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.532 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.532 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.532 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.532 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.532 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.532 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.533 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.533 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.533 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.533 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_PASSWORD": { 2024-09-15T22:28:00.533 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-15T22:28:00.533 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.533 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.533 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.533 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-15T22:28:00.533 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.533 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.533 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.534 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.534 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.534 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.534 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.534 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.534 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-15T22:28:00.534 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-15T22:28:00.534 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.534 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.534 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.534 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.534 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.534 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.535 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.535 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.535 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.535 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.535 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.535 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.535 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_URL": { 2024-09-15T22:28:00.535 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_URL", 2024-09-15T22:28:00.535 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.535 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.535 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.535 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.535 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.535 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.536 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.536 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.536 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.536 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.536 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.536 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.536 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_USERNAME": { 2024-09-15T22:28:00.536 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-15T22:28:00.536 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.536 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.536 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.536 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-15T22:28:00.536 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.537 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.537 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.537 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.537 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.537 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.537 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.537 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.537 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-15T22:28:00.537 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-15T22:28:00.537 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.537 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.537 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.537 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.537 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.538 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.538 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.538 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.538 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.538 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.538 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.538 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.538 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-15T22:28:00.538 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-15T22:28:00.538 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.538 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.538 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.538 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.539 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.539 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.539 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.539 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.539 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.539 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.539 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.539 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.539 INFO:teuthology.orchestra.run.smithi001.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-15T22:28:00.539 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-15T22:28:00.539 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.539 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.539 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.540 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.540 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.540 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.540 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.540 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.540 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.540 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.540 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.540 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.540 INFO:teuthology.orchestra.run.smithi001.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-15T22:28:00.540 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-15T22:28:00.540 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.540 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.541 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.541 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.541 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.541 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.541 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.541 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.541 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.541 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.541 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.541 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.541 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_HOST": { 2024-09-15T22:28:00.541 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-15T22:28:00.541 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.542 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.542 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.542 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.542 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.542 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.542 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.542 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.542 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.542 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.542 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.542 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.542 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-15T22:28:00.542 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-15T22:28:00.542 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.543 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.543 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.543 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.543 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.543 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.543 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.543 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.543 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.543 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.543 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.543 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.543 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-15T22:28:00.543 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-15T22:28:00.544 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.544 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.544 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.544 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.544 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.544 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.544 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.544 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.544 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.544 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.544 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.544 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.544 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-15T22:28:00.545 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-15T22:28:00.545 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.545 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.545 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.545 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.545 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.545 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.545 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.545 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.545 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.545 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.545 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.545 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.546 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-15T22:28:00.546 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-15T22:28:00.546 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.546 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.546 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.546 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.546 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.546 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.546 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.546 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.546 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.546 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.546 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.547 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.547 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-15T22:28:00.547 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-15T22:28:00.547 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.547 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.547 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.547 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.547 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.547 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.547 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.547 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.547 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.547 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.548 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.548 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.548 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-15T22:28:00.548 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-15T22:28:00.548 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.548 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.548 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.548 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.548 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.548 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.548 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.548 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.548 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.549 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.549 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.549 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.549 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-15T22:28:00.549 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-15T22:28:00.549 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.549 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.549 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.549 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.549 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.549 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.549 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.549 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.550 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.550 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.550 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.550 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.550 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-15T22:28:00.550 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-15T22:28:00.550 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.550 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.550 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.550 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.550 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.550 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.550 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.550 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.551 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.551 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.551 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.551 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.551 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_ENABLED": { 2024-09-15T22:28:00.551 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-15T22:28:00.551 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.551 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.551 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.551 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.551 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.551 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.551 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.551 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.552 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.552 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.552 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.552 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.552 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-15T22:28:00.552 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-15T22:28:00.552 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.552 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.552 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.552 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-15T22:28:00.552 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.553 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.553 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.553 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.553 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.553 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.553 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.553 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.553 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-15T22:28:00.553 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-15T22:28:00.553 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.553 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.553 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.553 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-15T22:28:00.554 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.554 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.554 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.554 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.554 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.554 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.554 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.554 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.554 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-15T22:28:00.554 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-15T22:28:00.554 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.554 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.554 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.554 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8", 2024-09-15T22:28:00.555 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.555 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.555 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.555 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.555 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.555 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.555 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.555 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.555 INFO:teuthology.orchestra.run.smithi001.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-15T22:28:00.555 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-15T22:28:00.555 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.555 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.555 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.556 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "45", 2024-09-15T22:28:00.556 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.556 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.556 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.556 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.556 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.556 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.556 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.556 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.556 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ACCESS_KEY": { 2024-09-15T22:28:00.556 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-15T22:28:00.556 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.556 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.557 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.557 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.557 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.557 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.557 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.557 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.557 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.557 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.557 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.557 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.557 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-15T22:28:00.557 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-15T22:28:00.557 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.557 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.558 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.558 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-15T22:28:00.558 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.558 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.558 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.558 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.558 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.558 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.558 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.558 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.558 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SECRET_KEY": { 2024-09-15T22:28:00.558 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-15T22:28:00.558 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.558 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.559 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.559 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.559 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.559 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.559 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.559 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.559 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.559 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.559 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.559 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.559 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SSL_VERIFY": { 2024-09-15T22:28:00.559 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-15T22:28:00.559 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.559 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.560 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.560 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.560 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.560 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.560 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.560 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.560 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.560 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.560 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.560 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.560 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-15T22:28:00.560 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-15T22:28:00.560 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.561 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.561 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.561 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-15T22:28:00.561 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.561 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.561 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.561 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.561 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.561 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.561 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.561 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.561 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-15T22:28:00.561 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-15T22:28:00.561 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.562 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.562 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.562 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-15T22:28:00.562 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.562 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.562 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.562 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.562 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.562 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.562 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.562 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.562 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-15T22:28:00.562 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-15T22:28:00.562 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.562 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.563 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.563 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-15T22:28:00.563 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.563 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.563 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.563 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.563 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.563 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.563 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.563 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.563 INFO:teuthology.orchestra.run.smithi001.stdout: "cross_origin_url": { 2024-09-15T22:28:00.563 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cross_origin_url", 2024-09-15T22:28:00.563 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.564 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.564 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.564 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.564 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.564 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.564 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.564 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.564 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.564 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.564 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.564 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.564 INFO:teuthology.orchestra.run.smithi001.stdout: "crt_file": { 2024-09-15T22:28:00.564 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crt_file", 2024-09-15T22:28:00.564 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.564 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.565 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.565 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.565 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.565 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.565 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.565 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.565 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.565 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.565 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.565 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.565 INFO:teuthology.orchestra.run.smithi001.stdout: "debug": { 2024-09-15T22:28:00.565 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "debug", 2024-09-15T22:28:00.566 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.566 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.566 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.566 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.566 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.566 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.566 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.566 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable/disable debug options", 2024-09-15T22:28:00.566 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.566 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.566 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.566 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.566 INFO:teuthology.orchestra.run.smithi001.stdout: "jwt_token_ttl": { 2024-09-15T22:28:00.566 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "jwt_token_ttl", 2024-09-15T22:28:00.567 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.567 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.567 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.567 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "28800", 2024-09-15T22:28:00.567 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.567 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.567 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.567 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.567 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.567 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.567 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.567 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.567 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-15T22:28:00.567 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-15T22:28:00.568 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.568 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.568 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.568 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.568 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.568 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.568 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.568 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.568 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.568 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.568 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.568 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.568 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.569 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.569 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.569 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.569 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.569 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.569 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.569 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.569 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.569 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.569 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.569 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.569 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.569 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.569 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.570 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.570 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.570 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.570 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.570 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.570 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.570 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.570 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.570 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.570 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.570 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.570 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.570 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.571 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.571 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.571 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.571 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.571 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.571 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.571 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.571 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.571 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.571 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.571 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.571 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.571 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.571 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.572 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.572 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.572 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.572 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.572 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.572 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.572 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.572 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.572 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.572 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.572 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.572 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.572 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.573 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.573 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.573 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.573 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.573 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.573 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.573 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.573 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.573 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.573 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.573 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.573 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.573 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.574 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.574 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.574 INFO:teuthology.orchestra.run.smithi001.stdout: "motd": { 2024-09-15T22:28:00.574 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "motd", 2024-09-15T22:28:00.574 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.574 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.574 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.574 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.574 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.574 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.574 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.574 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "The message of the day", 2024-09-15T22:28:00.574 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.574 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.575 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.575 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.575 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect_resolve_ip_addr": { 2024-09-15T22:28:00.575 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "redirect_resolve_ip_addr", 2024-09-15T22:28:00.575 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.575 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.575 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.575 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.575 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.575 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.575 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.575 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.575 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.575 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.576 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.576 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.576 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-15T22:28:00.576 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-15T22:28:00.576 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.576 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.576 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.576 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-15T22:28:00.576 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.576 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.576 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.576 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.576 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.577 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.577 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.577 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.577 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-15T22:28:00.577 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-15T22:28:00.577 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.577 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.577 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.577 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8080", 2024-09-15T22:28:00.577 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.577 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.577 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.577 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.577 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.577 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.578 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.578 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.578 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-15T22:28:00.578 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-15T22:28:00.578 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.578 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.578 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.578 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.578 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.578 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.578 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.578 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.578 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.578 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.579 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.579 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.579 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl_server_port": { 2024-09-15T22:28:00.579 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl_server_port", 2024-09-15T22:28:00.579 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.579 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.579 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.579 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8443", 2024-09-15T22:28:00.579 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.579 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.579 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.579 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.579 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.579 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.580 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.580 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.580 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-15T22:28:00.580 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-15T22:28:00.580 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.580 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.580 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.580 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "redirect", 2024-09-15T22:28:00.580 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.580 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.580 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.580 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.580 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect" 2024-09-15T22:28:00.581 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.581 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.581 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.581 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.581 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.581 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.581 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-15T22:28:00.581 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-15T22:28:00.581 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.581 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.581 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.581 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-15T22:28:00.581 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-15T22:28:00.581 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-15T22:28:00.582 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.582 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.582 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.582 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.582 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.582 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.582 INFO:teuthology.orchestra.run.smithi001.stdout: "url_prefix": { 2024-09-15T22:28:00.582 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url_prefix", 2024-09-15T22:28:00.582 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.582 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.582 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.582 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.582 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.583 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.583 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.583 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.583 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.583 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.583 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.583 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.583 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.583 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.583 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.583 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "devicehealth", 2024-09-15T22:28:00.583 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.583 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.584 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.584 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_monitoring": { 2024-09-15T22:28:00.584 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_monitoring", 2024-09-15T22:28:00.584 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.584 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.584 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.584 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.584 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.584 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.584 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.584 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "monitor device health metrics", 2024-09-15T22:28:00.584 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.585 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.585 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.585 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.585 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.585 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.585 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.585 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.585 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.585 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.585 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.585 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.585 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.585 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.585 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.586 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.586 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.586 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.586 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.586 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.586 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.586 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.586 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.586 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.586 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.586 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.586 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.586 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.586 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.587 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.587 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.587 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.587 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.587 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.587 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.587 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.587 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.587 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.587 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.587 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.587 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.587 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.588 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.588 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.588 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.588 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.588 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.588 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.588 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.588 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.588 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.588 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.588 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.588 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.588 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.588 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.589 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.589 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.589 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.589 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.589 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.589 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.589 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.589 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.589 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.589 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.589 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.589 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.589 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.589 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.590 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.590 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.590 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.590 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.590 INFO:teuthology.orchestra.run.smithi001.stdout: "mark_out_threshold": { 2024-09-15T22:28:00.590 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mark_out_threshold", 2024-09-15T22:28:00.590 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:00.590 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.590 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.590 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2419200", 2024-09-15T22:28:00.590 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.590 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.590 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.590 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-15T22:28:00.591 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.591 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.591 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.591 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.591 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": { 2024-09-15T22:28:00.591 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_name", 2024-09-15T22:28:00.591 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.591 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.591 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.591 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "device_health_metrics", 2024-09-15T22:28:00.591 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.591 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.591 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.591 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-15T22:28:00.592 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.592 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.592 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.592 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.592 INFO:teuthology.orchestra.run.smithi001.stdout: "retention_period": { 2024-09-15T22:28:00.592 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retention_period", 2024-09-15T22:28:00.592 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:00.592 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.592 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.592 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15552000", 2024-09-15T22:28:00.592 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.592 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.592 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.593 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain device health metrics", 2024-09-15T22:28:00.593 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.593 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.593 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.593 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.593 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_frequency": { 2024-09-15T22:28:00.593 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_frequency", 2024-09-15T22:28:00.593 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:00.593 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.593 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.593 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-15T22:28:00.593 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.593 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.594 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.594 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-15T22:28:00.594 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.594 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.594 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.594 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.594 INFO:teuthology.orchestra.run.smithi001.stdout: "self_heal": { 2024-09-15T22:28:00.594 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "self_heal", 2024-09-15T22:28:00.594 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.594 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.594 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.594 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.594 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.595 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.595 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.595 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-15T22:28:00.595 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.595 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.595 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.595 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.595 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-15T22:28:00.595 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-15T22:28:00.595 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:00.595 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.595 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.595 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-15T22:28:00.595 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.596 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.596 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.596 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and check device health", 2024-09-15T22:28:00.596 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.596 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.596 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.596 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.596 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_threshold": { 2024-09-15T22:28:00.596 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_threshold", 2024-09-15T22:28:00.596 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:00.596 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.597 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.597 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7257600", 2024-09-15T22:28:00.597 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.597 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.597 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.597 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-15T22:28:00.597 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.597 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.597 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.597 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.597 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.597 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.598 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.598 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "diskprediction_local", 2024-09-15T22:28:00.598 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.598 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.598 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.598 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.598 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.598 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.598 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.598 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.598 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.598 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.598 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.599 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.599 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.599 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.599 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.599 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.599 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.599 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.599 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.599 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.599 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.600 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.600 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.600 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.600 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.600 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.600 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.600 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.600 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.600 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.600 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.600 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.600 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.600 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.600 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.601 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.601 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.601 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.601 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.601 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.601 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.601 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.601 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.601 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.601 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.601 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.601 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.601 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.602 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.602 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.602 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.602 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.602 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.602 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.602 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.602 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.602 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.602 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.602 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.602 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.602 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.602 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.603 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.603 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.603 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.603 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.603 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.603 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.603 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.603 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.603 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.603 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.603 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.603 INFO:teuthology.orchestra.run.smithi001.stdout: "predict_interval": { 2024-09-15T22:28:00.603 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predict_interval", 2024-09-15T22:28:00.603 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.604 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.604 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.604 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-15T22:28:00.604 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.604 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.604 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.604 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.604 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.604 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.604 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.604 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.604 INFO:teuthology.orchestra.run.smithi001.stdout: "predictor_model": { 2024-09-15T22:28:00.604 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predictor_model", 2024-09-15T22:28:00.604 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.605 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.605 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.605 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "prophetstor", 2024-09-15T22:28:00.605 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.605 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.605 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.605 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.605 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.605 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.605 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.605 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.605 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-15T22:28:00.605 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-15T22:28:00.605 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.606 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.606 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.606 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-15T22:28:00.606 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.606 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.606 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.606 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.606 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.606 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.606 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.606 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.606 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.606 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.606 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.607 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "influx", 2024-09-15T22:28:00.607 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": false, 2024-09-15T22:28:00.607 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "influxdb python module not found", 2024-09-15T22:28:00.607 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.607 INFO:teuthology.orchestra.run.smithi001.stdout: "batch_size": { 2024-09-15T22:28:00.607 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "batch_size", 2024-09-15T22:28:00.607 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.607 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.607 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.607 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5000", 2024-09-15T22:28:00.607 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.607 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.607 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.607 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-15T22:28:00.608 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.608 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.608 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.608 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.608 INFO:teuthology.orchestra.run.smithi001.stdout: "database": { 2024-09-15T22:28:00.608 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "database", 2024-09-15T22:28:00.608 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.608 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.608 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.608 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "ceph", 2024-09-15T22:28:00.608 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.608 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.609 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.609 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-15T22:28:00.609 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.609 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.609 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.609 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.609 INFO:teuthology.orchestra.run.smithi001.stdout: "hostname": { 2024-09-15T22:28:00.609 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hostname", 2024-09-15T22:28:00.609 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.609 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.609 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.609 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.609 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.609 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.610 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.610 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server hostname", 2024-09-15T22:28:00.610 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.610 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.610 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.610 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.610 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-15T22:28:00.610 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-15T22:28:00.610 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:00.610 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.610 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.610 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "30", 2024-09-15T22:28:00.610 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "5", 2024-09-15T22:28:00.610 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.611 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.611 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-15T22:28:00.611 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.611 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.611 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.611 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.611 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.611 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.611 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.612 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.612 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.612 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.612 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.612 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.612 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.612 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.612 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.612 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.612 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.612 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.612 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.612 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.613 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.613 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.613 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.613 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.613 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.613 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.613 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.613 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.613 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.613 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.613 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.613 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.613 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.613 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.614 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.614 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.614 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.614 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.614 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.614 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.614 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.614 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.614 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.614 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.614 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.614 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.614 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.615 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.615 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.615 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.615 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.615 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.615 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.615 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.615 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.615 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.615 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.615 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.615 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.615 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.616 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.616 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.616 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.616 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.616 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.616 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.616 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.616 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.616 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.616 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.616 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.616 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.616 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.617 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.617 INFO:teuthology.orchestra.run.smithi001.stdout: "password": { 2024-09-15T22:28:00.617 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "password", 2024-09-15T22:28:00.617 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.617 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.617 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.617 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.617 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.617 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.617 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.617 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "password of InfluxDB server user", 2024-09-15T22:28:00.617 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.617 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.618 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.618 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.618 INFO:teuthology.orchestra.run.smithi001.stdout: "port": { 2024-09-15T22:28:00.618 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "port", 2024-09-15T22:28:00.618 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.618 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.618 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.618 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8086", 2024-09-15T22:28:00.618 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.618 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.618 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.618 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server port", 2024-09-15T22:28:00.618 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.618 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.619 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.619 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.619 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-15T22:28:00.619 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-15T22:28:00.619 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.619 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.619 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.619 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "false", 2024-09-15T22:28:00.619 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.619 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.619 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.619 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T22:28:00.619 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.620 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.620 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.620 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.620 INFO:teuthology.orchestra.run.smithi001.stdout: "threads": { 2024-09-15T22:28:00.620 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threads", 2024-09-15T22:28:00.620 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.620 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.620 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.620 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-15T22:28:00.620 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-15T22:28:00.620 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "32", 2024-09-15T22:28:00.620 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.620 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-15T22:28:00.620 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.621 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.621 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.621 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.621 INFO:teuthology.orchestra.run.smithi001.stdout: "username": { 2024-09-15T22:28:00.621 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "username", 2024-09-15T22:28:00.621 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.621 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.621 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.621 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.621 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.621 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.621 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.621 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "username of InfluxDB server user", 2024-09-15T22:28:00.622 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.622 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.622 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.622 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.622 INFO:teuthology.orchestra.run.smithi001.stdout: "verify_ssl": { 2024-09-15T22:28:00.622 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "verify_ssl", 2024-09-15T22:28:00.622 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.622 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.622 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.622 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "true", 2024-09-15T22:28:00.622 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.622 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.622 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.623 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T22:28:00.623 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.623 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.623 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.623 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.623 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.623 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.623 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.623 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "insights", 2024-09-15T22:28:00.623 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.623 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.623 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.623 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.624 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.624 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.624 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.624 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.624 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.624 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.624 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.624 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.624 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.624 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.624 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.624 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.624 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.624 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.625 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.625 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.625 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.625 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.625 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.625 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.625 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.625 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.625 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.625 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.625 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.625 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.625 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.626 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.626 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.626 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.626 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.626 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.626 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.626 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.626 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.626 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.626 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.626 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.626 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.626 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.627 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.627 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.627 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.627 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.627 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.627 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.627 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.627 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.627 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.627 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.627 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.627 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.627 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.627 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.628 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.628 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.628 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.628 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.628 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.628 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.628 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.628 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.628 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.628 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.628 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.628 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.628 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.629 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.629 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.629 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.629 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.629 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.629 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "iostat", 2024-09-15T22:28:00.629 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.629 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.629 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.629 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.629 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.629 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.629 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.629 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.630 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.630 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.630 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.630 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.630 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.630 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.630 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.630 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.630 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.630 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.630 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.630 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.630 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.630 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.631 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.631 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.631 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.631 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.631 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.631 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.631 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.631 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.631 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.631 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.631 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.631 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.631 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.631 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.632 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.632 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.632 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.632 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.632 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.632 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.632 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.632 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.632 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.632 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.632 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.632 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.632 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.632 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.633 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.633 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.633 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.633 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.633 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.633 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.633 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.633 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.633 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.633 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.633 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.633 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.633 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.633 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.634 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.634 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.634 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.634 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.634 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.634 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.634 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.634 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.634 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.634 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.634 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.634 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.634 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "k8sevents", 2024-09-15T22:28:00.634 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.635 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.635 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.635 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_event_retention_days": { 2024-09-15T22:28:00.635 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ceph_event_retention_days", 2024-09-15T22:28:00.635 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.635 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.635 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.635 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7", 2024-09-15T22:28:00.635 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.635 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.635 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.635 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-15T22:28:00.635 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.635 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.636 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.636 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.636 INFO:teuthology.orchestra.run.smithi001.stdout: "config_check_secs": { 2024-09-15T22:28:00.636 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_check_secs", 2024-09-15T22:28:00.636 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.636 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.636 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.636 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-15T22:28:00.636 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "10", 2024-09-15T22:28:00.636 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.636 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.636 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-15T22:28:00.636 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.637 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.637 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.637 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.637 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.637 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.637 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.637 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.637 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.637 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.637 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.637 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.637 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.637 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.637 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.638 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.638 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.638 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.638 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.638 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.638 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.638 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.638 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.638 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.638 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.638 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.638 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.638 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.638 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.639 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.639 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.639 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.639 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.639 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.639 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.639 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.639 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.639 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.639 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.639 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.639 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.639 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.639 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.640 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.640 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.640 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.640 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.640 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.640 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.640 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.640 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.640 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.640 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.640 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.640 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.640 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.640 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.641 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.641 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.641 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.641 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.641 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.641 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.641 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.641 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.641 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.641 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.641 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.641 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.641 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.641 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.642 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.642 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.642 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.642 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.642 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.642 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.642 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "localpool", 2024-09-15T22:28:00.642 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.642 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.642 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.642 INFO:teuthology.orchestra.run.smithi001.stdout: "failure_domain": { 2024-09-15T22:28:00.642 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "failure_domain", 2024-09-15T22:28:00.642 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.642 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.643 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.643 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "host", 2024-09-15T22:28:00.643 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.643 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.643 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.643 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "failure domain for any created local pool", 2024-09-15T22:28:00.643 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-15T22:28:00.643 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.643 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.643 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.643 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.643 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.643 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.643 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.644 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.644 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.644 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.644 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.644 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.644 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.644 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.644 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.644 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.644 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.644 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.644 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.644 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.644 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.645 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.645 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.645 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.645 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.645 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.645 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.645 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.645 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.645 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.645 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.645 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.645 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.645 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.645 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.646 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.646 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.646 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.646 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.646 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.646 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.646 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.646 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.646 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.646 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.646 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.646 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.646 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.646 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.647 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.647 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.647 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.647 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.647 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.647 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.647 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.647 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.647 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.647 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.647 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.647 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.647 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.648 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.648 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.648 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.648 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.648 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.648 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.648 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.648 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.648 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.648 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.648 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.648 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": { 2024-09-15T22:28:00.648 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_size", 2024-09-15T22:28:00.648 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.649 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.649 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.649 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.649 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.649 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.649 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.649 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default min_size for any created local pool", 2024-09-15T22:28:00.649 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-15T22:28:00.649 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.649 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.649 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.649 INFO:teuthology.orchestra.run.smithi001.stdout: "num_rep": { 2024-09-15T22:28:00.649 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "num_rep", 2024-09-15T22:28:00.649 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.649 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.650 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.650 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3", 2024-09-15T22:28:00.650 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.650 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.650 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.650 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default replica count for any created local pool", 2024-09-15T22:28:00.650 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.650 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.650 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.650 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.650 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": { 2024-09-15T22:28:00.650 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_num", 2024-09-15T22:28:00.651 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.651 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.651 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.651 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "128", 2024-09-15T22:28:00.651 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.651 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.651 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.651 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default pg_num for any created local pool", 2024-09-15T22:28:00.651 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.651 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.651 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.651 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.651 INFO:teuthology.orchestra.run.smithi001.stdout: "prefix": { 2024-09-15T22:28:00.651 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prefix", 2024-09-15T22:28:00.652 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.652 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.652 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.652 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.652 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.652 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.652 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.652 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name prefix for any created local pool", 2024-09-15T22:28:00.652 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.652 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.652 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.652 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.652 INFO:teuthology.orchestra.run.smithi001.stdout: "subtree": { 2024-09-15T22:28:00.653 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "subtree", 2024-09-15T22:28:00.653 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.653 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.653 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.653 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "rack", 2024-09-15T22:28:00.653 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.653 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.653 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.653 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-15T22:28:00.653 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-15T22:28:00.653 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.653 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.653 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.654 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.654 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.654 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.654 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mds_autoscaler", 2024-09-15T22:28:00.654 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.654 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.654 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.654 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.654 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.654 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.654 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.654 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.654 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.654 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.655 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.655 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.655 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.655 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.655 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.655 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.655 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.655 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.655 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.655 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.655 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.655 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.655 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.655 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.656 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.656 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.656 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.656 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.656 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.656 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.656 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.656 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.656 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.656 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.656 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.656 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.656 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.657 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.657 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.657 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.657 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.657 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.657 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.657 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.657 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.657 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.657 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.657 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.657 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.657 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.658 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.658 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.658 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.658 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.658 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.658 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.658 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.658 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.658 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.658 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.658 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.658 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.658 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.658 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.659 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.659 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.659 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.659 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.659 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.659 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.659 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.659 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.659 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.659 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.659 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.659 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.659 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirroring", 2024-09-15T22:28:00.659 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.660 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.660 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.660 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.660 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.660 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.660 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.660 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.660 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.660 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.660 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.660 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.660 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.660 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.660 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.661 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.661 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.661 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.661 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.661 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.661 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.661 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.661 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.661 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.661 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.661 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.661 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.661 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.661 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.662 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.662 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.662 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.662 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.662 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.662 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.662 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.662 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.662 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.662 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.662 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.662 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.662 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.663 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.663 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.663 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.663 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.663 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.663 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.663 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.663 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.663 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.663 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.663 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.663 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.663 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.663 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.664 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.664 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.664 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.664 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.664 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.664 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.664 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.664 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.664 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.664 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.664 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.664 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.664 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.665 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.665 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.665 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.665 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.665 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.665 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.665 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.665 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "nfs", 2024-09-15T22:28:00.665 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.665 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.665 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.665 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.665 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.665 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.666 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.666 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.666 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.666 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.666 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.666 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.666 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.666 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.666 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.666 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.666 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.666 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.666 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.666 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.667 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.667 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.667 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.667 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.667 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.667 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.667 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.667 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.667 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.667 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.667 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.667 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.667 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.668 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.668 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.668 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.668 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.668 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.668 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.668 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.668 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.668 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.668 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.668 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.668 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.668 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.668 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.669 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.669 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.669 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.669 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.669 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.669 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.669 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.669 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.669 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.669 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.669 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.669 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.669 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.669 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.670 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.670 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.670 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.670 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.670 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.670 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.670 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.670 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.670 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.670 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.670 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.670 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.670 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.670 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.671 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.671 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-15T22:28:00.671 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.671 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.671 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.671 INFO:teuthology.orchestra.run.smithi001.stdout: "fail_fs": { 2024-09-15T22:28:00.671 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "fail_fs", 2024-09-15T22:28:00.671 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.671 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.671 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.671 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.671 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.671 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.671 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.672 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-15T22:28:00.672 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.672 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.672 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.672 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.672 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.672 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.672 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.672 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.672 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.672 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.672 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.672 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.673 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.673 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.673 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.673 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.673 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.673 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.673 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.673 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.673 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.673 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.673 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.673 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.673 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.673 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.674 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.674 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.674 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.674 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.674 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.674 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.674 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.674 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.674 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.674 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.674 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.674 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.674 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.674 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.675 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.675 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.675 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.675 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.675 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.675 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.675 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.675 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.675 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.675 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.675 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.675 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.675 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.675 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.676 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.676 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.676 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.676 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.676 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.676 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.676 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.676 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.676 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.676 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.676 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.676 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.676 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.676 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.677 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.677 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.677 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.677 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.677 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.677 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.677 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator": { 2024-09-15T22:28:00.677 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-15T22:28:00.677 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.677 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.677 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.677 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.677 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.677 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.678 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.678 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm", 2024-09-15T22:28:00.678 INFO:teuthology.orchestra.run.smithi001.stdout: "rook", 2024-09-15T22:28:00.678 INFO:teuthology.orchestra.run.smithi001.stdout: "test_orchestrator" 2024-09-15T22:28:00.678 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.678 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Orchestrator backend", 2024-09-15T22:28:00.678 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.678 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.678 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.678 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.678 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.678 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.679 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.679 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_perf_query", 2024-09-15T22:28:00.679 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.679 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.679 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.679 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.679 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.679 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.679 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.679 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.679 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.679 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.679 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.679 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.680 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.680 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.680 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.680 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.680 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.680 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.680 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.680 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.680 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.680 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.680 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.680 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.680 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.681 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.681 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.681 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.681 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.681 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.681 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.681 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.681 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.681 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.681 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.681 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.681 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.681 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.682 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.682 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.682 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.682 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.682 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.682 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.682 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.682 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.682 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.682 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.682 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.682 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.682 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.683 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.683 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.683 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.683 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.683 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.683 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.683 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.683 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.683 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.683 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.683 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.683 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.683 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.684 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.684 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.684 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.684 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.684 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.684 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.684 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.684 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.684 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.684 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.684 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.684 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.684 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_support", 2024-09-15T22:28:00.685 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.685 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.685 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.685 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.685 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.685 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.685 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.685 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.685 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.685 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.685 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.685 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.685 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.686 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.686 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.686 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.686 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.686 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.686 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.686 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.686 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.686 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.686 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.686 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.686 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.686 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.686 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.687 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.687 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.687 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.687 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.687 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.687 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.687 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.687 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.687 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.687 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.687 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.687 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.687 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.687 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.688 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.688 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.688 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.688 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.688 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.688 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.688 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.688 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.688 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.688 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.688 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.688 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.688 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.689 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.689 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.689 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.689 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.689 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.689 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.689 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.689 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.689 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.689 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.689 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.689 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.689 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.689 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.690 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.690 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.690 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.690 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.690 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.690 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.690 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.690 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.690 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_autoscaler", 2024-09-15T22:28:00.690 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.690 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.690 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.690 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.690 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.691 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.691 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.691 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.691 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.691 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.691 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.691 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.691 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.691 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.691 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.691 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.691 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.691 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.691 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.692 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.692 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.692 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.692 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.692 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.692 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.692 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.692 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.692 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.692 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.692 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.692 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.692 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.693 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.693 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.693 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.693 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.693 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.693 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.693 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.693 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.693 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.693 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.693 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.693 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.693 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.694 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.694 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.694 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.694 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.694 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.694 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.694 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.694 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.694 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.694 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.694 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.694 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.694 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.694 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.695 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.695 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.695 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.695 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.695 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.695 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.695 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.695 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.695 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.695 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.695 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.695 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.695 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.695 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.696 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-15T22:28:00.696 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-15T22:28:00.696 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:00.696 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.696 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.696 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-15T22:28:00.696 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.696 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.696 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.696 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.696 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.696 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.696 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.697 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.697 INFO:teuthology.orchestra.run.smithi001.stdout: "threshold": { 2024-09-15T22:28:00.697 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threshold", 2024-09-15T22:28:00.697 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-15T22:28:00.697 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.697 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.697 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-15T22:28:00.697 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1.0", 2024-09-15T22:28:00.697 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.697 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.697 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "scaling threshold", 2024-09-15T22:28:00.697 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-15T22:28:00.697 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.697 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.698 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.698 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.698 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.698 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.698 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "progress", 2024-09-15T22:28:00.698 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.698 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.698 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.698 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_pg_recovery_event": { 2024-09-15T22:28:00.698 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_pg_recovery_event", 2024-09-15T22:28:00.698 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.698 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.698 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.699 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.699 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.699 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.699 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.699 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-15T22:28:00.699 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.699 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.699 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.699 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.699 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-15T22:28:00.699 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-15T22:28:00.699 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.699 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.699 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.700 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.700 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.700 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.700 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.700 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.700 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.700 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.700 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.700 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.700 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.700 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.700 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.700 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.701 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.701 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.701 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.701 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.701 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.701 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.701 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.701 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.701 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.701 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.701 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.701 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.701 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.702 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.702 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.702 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.702 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.702 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.702 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.702 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.702 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.702 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.702 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.702 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.702 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.702 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.702 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.703 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.703 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.703 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.703 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.703 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.703 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.703 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.703 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.703 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.703 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.703 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.703 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.703 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.703 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.704 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.704 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.704 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.704 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.704 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.704 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.704 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.704 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.704 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.704 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.704 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.704 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.704 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.705 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.705 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.705 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.705 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.705 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.705 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.705 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.705 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.705 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.705 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.705 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.705 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.705 INFO:teuthology.orchestra.run.smithi001.stdout: "max_completed_events": { 2024-09-15T22:28:00.705 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_completed_events", 2024-09-15T22:28:00.706 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.706 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.706 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.706 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "50", 2024-09-15T22:28:00.706 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.706 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.706 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.706 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "number of past completed events to remember", 2024-09-15T22:28:00.706 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.706 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.706 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.706 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.706 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-15T22:28:00.706 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-15T22:28:00.706 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:00.707 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.707 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.708 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-15T22:28:00.708 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.708 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.708 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.708 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long the module is going to sleep", 2024-09-15T22:28:00.708 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.708 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.709 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.709 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.709 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.709 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.709 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.709 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus", 2024-09-15T22:28:00.709 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.709 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.709 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.709 INFO:teuthology.orchestra.run.smithi001.stdout: "cache": { 2024-09-15T22:28:00.709 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cache", 2024-09-15T22:28:00.709 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.709 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.709 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.710 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.710 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.710 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.710 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.710 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.710 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.710 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.710 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.710 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.710 INFO:teuthology.orchestra.run.smithi001.stdout: "exclude_perf_counters": { 2024-09-15T22:28:00.711 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "exclude_perf_counters", 2024-09-15T22:28:00.711 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.711 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.711 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.711 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.711 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.711 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.711 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.711 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-15T22:28:00.711 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-15T22:28:00.711 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.711 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.711 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.712 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.712 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.712 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.712 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.712 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.712 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.712 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.712 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.712 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.712 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.712 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.712 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.712 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.713 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.713 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.713 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.713 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.713 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.713 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.713 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.713 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.713 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.713 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.713 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.713 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.713 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.714 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.714 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.714 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.714 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.714 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.714 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.714 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.714 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.714 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.714 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.714 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.714 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.714 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.714 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.715 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.715 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.715 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.715 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.715 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.715 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.715 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.715 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.715 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.715 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.715 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.715 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.715 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.715 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.716 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.716 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.716 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.716 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.716 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.716 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.716 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.716 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.716 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.716 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.716 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.716 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.716 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.716 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.717 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.717 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.717 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools": { 2024-09-15T22:28:00.717 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools", 2024-09-15T22:28:00.717 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.717 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.717 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.717 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.717 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.717 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.717 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.717 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.717 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.717 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.718 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.718 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.718 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-15T22:28:00.718 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-15T22:28:00.718 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.718 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.718 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.718 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "300", 2024-09-15T22:28:00.718 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.718 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.718 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.718 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.718 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.718 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.719 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.719 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.719 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_interval": { 2024-09-15T22:28:00.719 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_interval", 2024-09-15T22:28:00.719 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-15T22:28:00.719 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.719 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.719 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15.0", 2024-09-15T22:28:00.719 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.719 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.719 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.719 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.719 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.719 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.720 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.720 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.720 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-15T22:28:00.720 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-15T22:28:00.720 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.720 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.720 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.720 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-15T22:28:00.720 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.720 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.720 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.720 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-15T22:28:00.720 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.721 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.721 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.721 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.721 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-15T22:28:00.721 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-15T22:28:00.721 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.721 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.721 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.721 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "9283", 2024-09-15T22:28:00.721 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.721 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.721 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.721 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-15T22:28:00.721 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.721 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.722 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.722 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.722 INFO:teuthology.orchestra.run.smithi001.stdout: "stale_cache_strategy": { 2024-09-15T22:28:00.722 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stale_cache_strategy", 2024-09-15T22:28:00.722 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.722 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.722 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.722 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "log", 2024-09-15T22:28:00.722 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.722 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.722 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.722 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.722 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.723 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.723 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.723 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.723 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-15T22:28:00.723 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-15T22:28:00.723 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.723 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.723 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.723 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "default", 2024-09-15T22:28:00.723 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.723 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.723 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.723 INFO:teuthology.orchestra.run.smithi001.stdout: "default", 2024-09-15T22:28:00.723 INFO:teuthology.orchestra.run.smithi001.stdout: "error" 2024-09-15T22:28:00.724 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.724 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.724 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.724 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.724 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.724 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.724 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-15T22:28:00.724 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-15T22:28:00.724 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.724 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.724 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.724 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-15T22:28:00.724 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-15T22:28:00.725 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-15T22:28:00.725 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.725 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.725 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.725 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.725 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.725 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.725 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.725 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.725 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.725 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_support", 2024-09-15T22:28:00.725 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.726 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.726 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.726 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.726 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.726 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.726 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.726 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.726 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.726 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.726 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.726 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.726 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.726 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.726 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.727 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.727 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.727 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.727 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.727 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.727 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.727 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.727 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.727 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.727 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.727 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.727 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.727 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.728 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.728 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.728 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.728 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.728 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.728 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.728 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.728 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.728 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.728 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.728 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.728 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.728 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.728 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.729 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.729 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.729 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.729 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.729 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.729 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.729 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.729 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.729 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.729 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.729 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.729 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.729 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.730 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.730 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.730 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.730 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.730 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.730 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.730 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.730 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.730 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.730 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.730 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.730 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.731 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.731 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.731 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.731 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.731 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.731 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.731 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_snap_create": { 2024-09-15T22:28:00.731 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_snap_create", 2024-09-15T22:28:00.731 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.731 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.731 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.731 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-15T22:28:00.731 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.731 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.731 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.732 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.732 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.732 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.732 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.732 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.732 INFO:teuthology.orchestra.run.smithi001.stdout: "mirror_snapshot_schedule": { 2024-09-15T22:28:00.732 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirror_snapshot_schedule", 2024-09-15T22:28:00.732 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.732 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.732 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.732 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.732 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.732 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.732 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.733 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.733 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.733 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.733 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.733 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.733 INFO:teuthology.orchestra.run.smithi001.stdout: "trash_purge_schedule": { 2024-09-15T22:28:00.733 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "trash_purge_schedule", 2024-09-15T22:28:00.733 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.733 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.733 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.733 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.733 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.733 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.733 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.734 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.734 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.734 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.734 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.734 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.734 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.734 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.734 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.734 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "restful", 2024-09-15T22:28:00.734 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.734 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.734 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.734 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_auth": { 2024-09-15T22:28:00.735 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_auth", 2024-09-15T22:28:00.735 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.735 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.735 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.735 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.735 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.735 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.735 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.735 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.735 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.735 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.735 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.735 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.735 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-15T22:28:00.735 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-15T22:28:00.736 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.736 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.736 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.736 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.736 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.736 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.736 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.736 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.736 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.736 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.737 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.737 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.737 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.737 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.737 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.737 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.737 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.737 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.737 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.737 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.737 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.737 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.738 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.738 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.738 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.738 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.738 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.738 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.738 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.738 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.738 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.738 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.738 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.738 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.738 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.738 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.738 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.738 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.739 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.739 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.739 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.739 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.739 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.739 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.739 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.739 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.739 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.739 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.739 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.739 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.739 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.739 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.739 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.740 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.740 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.740 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.740 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.740 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.740 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.740 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.740 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.740 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.740 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.740 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.740 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.740 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.740 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.741 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.741 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.741 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.741 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.741 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.741 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.741 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.741 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.741 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.741 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.741 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.741 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.741 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.741 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.742 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.742 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-15T22:28:00.742 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-15T22:28:00.742 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.742 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.742 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.742 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.742 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.742 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.742 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.742 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.742 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.742 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.743 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.743 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.743 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-15T22:28:00.743 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-15T22:28:00.743 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.743 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.743 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.743 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.743 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.743 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.743 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.743 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.743 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.744 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.744 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.744 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.744 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.744 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.744 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.744 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rgw", 2024-09-15T22:28:00.744 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.744 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.744 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.744 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.744 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.745 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.745 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.745 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.745 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.745 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.745 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.745 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.745 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.745 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.745 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.745 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.745 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.745 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.745 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.746 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.746 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.746 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.746 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.746 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.746 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.746 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.746 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.746 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.746 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.746 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.746 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.746 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.746 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.747 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.747 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.747 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.747 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.747 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.747 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.747 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.747 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.747 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.747 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.747 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.747 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.747 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.747 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.748 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.748 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.748 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.748 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.748 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.748 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.748 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.748 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.748 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.748 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.748 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.748 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.748 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.749 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.749 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.749 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.749 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.749 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.749 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.749 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.749 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.749 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.749 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.749 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.749 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.749 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.749 INFO:teuthology.orchestra.run.smithi001.stdout: "secondary_zone_period_retry_limit": { 2024-09-15T22:28:00.750 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-15T22:28:00.750 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.750 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.750 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.750 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-15T22:28:00.750 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.750 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.750 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.750 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-15T22:28:00.750 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.750 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.750 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.750 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.750 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.751 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.751 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.751 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rook", 2024-09-15T22:28:00.751 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.751 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.751 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.751 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.751 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.751 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.751 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.751 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.751 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.751 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.752 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.752 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.752 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.752 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.752 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.752 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.752 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.752 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.752 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.752 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.752 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.752 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.753 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.753 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.753 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.753 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.753 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.753 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.753 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.753 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.753 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.753 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.753 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.753 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.753 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.754 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.754 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.754 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.754 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.754 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.754 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.754 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.754 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.754 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.754 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.754 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.754 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.754 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.754 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.755 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.755 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.755 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.755 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.755 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.755 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.755 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.755 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.755 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.755 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.755 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.755 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.755 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.755 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.756 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.756 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.756 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.756 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.756 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.756 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.756 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.756 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.756 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.756 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.756 INFO:teuthology.orchestra.run.smithi001.stdout: "storage_class": { 2024-09-15T22:28:00.756 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "storage_class", 2024-09-15T22:28:00.756 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.756 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.757 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.757 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "local", 2024-09-15T22:28:00.757 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.757 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.757 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.757 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-15T22:28:00.757 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.757 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.757 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.757 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.757 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.757 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.757 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.758 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "selftest", 2024-09-15T22:28:00.758 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.758 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.758 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.758 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.758 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.758 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.758 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.758 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.758 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.758 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.758 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.758 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.759 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.759 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.759 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.759 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.759 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.759 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.759 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.759 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.759 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.759 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.759 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.759 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.759 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.760 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.760 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.760 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.760 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.760 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.760 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.760 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.760 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.760 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.760 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.760 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.760 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.760 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.760 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.761 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.761 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.761 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.761 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.761 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.761 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.761 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.761 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.761 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.761 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.761 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.761 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.761 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.761 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.762 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.762 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.762 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.762 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.762 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.762 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.762 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.762 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.762 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.762 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.762 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.762 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.762 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.762 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.763 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.763 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.763 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.763 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.763 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.763 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.763 INFO:teuthology.orchestra.run.smithi001.stdout: "roption1": { 2024-09-15T22:28:00.763 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption1", 2024-09-15T22:28:00.763 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.763 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.763 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.763 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.763 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.763 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.764 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.764 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.764 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.764 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.764 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.764 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.764 INFO:teuthology.orchestra.run.smithi001.stdout: "roption2": { 2024-09-15T22:28:00.764 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption2", 2024-09-15T22:28:00.764 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.764 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.764 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.764 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "xyz", 2024-09-15T22:28:00.764 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.765 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.765 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.765 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.765 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.765 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.765 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.765 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.765 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption1": { 2024-09-15T22:28:00.765 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption1", 2024-09-15T22:28:00.765 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.765 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.765 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.765 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.765 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.766 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.766 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.766 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.766 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.766 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.766 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.766 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.766 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption2": { 2024-09-15T22:28:00.766 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption2", 2024-09-15T22:28:00.766 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.766 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.766 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.766 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.766 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.767 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.767 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.767 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.767 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.767 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.767 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.767 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.767 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption3": { 2024-09-15T22:28:00.767 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption3", 2024-09-15T22:28:00.767 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-15T22:28:00.767 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.767 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.767 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.768 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.768 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.768 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.768 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.768 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.768 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.768 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.768 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.768 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption4": { 2024-09-15T22:28:00.768 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption4", 2024-09-15T22:28:00.768 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.768 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.768 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.768 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.769 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.769 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.769 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.769 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.769 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.769 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.769 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.769 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.769 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption5": { 2024-09-15T22:28:00.769 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption5", 2024-09-15T22:28:00.769 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.769 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.769 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.769 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.770 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.770 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.770 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.770 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.770 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.770 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.770 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.770 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.770 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption6": { 2024-09-15T22:28:00.770 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption6", 2024-09-15T22:28:00.770 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.770 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.770 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.770 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.771 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.771 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.771 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.771 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.771 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.771 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.771 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.771 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.771 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption7": { 2024-09-15T22:28:00.771 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption7", 2024-09-15T22:28:00.771 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.771 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.771 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.771 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.772 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-15T22:28:00.772 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "42", 2024-09-15T22:28:00.772 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.772 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.772 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.772 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.772 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.772 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.772 INFO:teuthology.orchestra.run.smithi001.stdout: "testkey": { 2024-09-15T22:28:00.772 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testkey", 2024-09-15T22:28:00.772 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.772 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.772 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.772 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.773 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.773 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.773 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.773 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.773 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.773 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.773 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.773 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.773 INFO:teuthology.orchestra.run.smithi001.stdout: "testlkey": { 2024-09-15T22:28:00.773 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testlkey", 2024-09-15T22:28:00.773 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.773 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.773 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.773 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.774 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.774 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.774 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.774 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.774 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.774 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.774 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.774 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.774 INFO:teuthology.orchestra.run.smithi001.stdout: "testnewline": { 2024-09-15T22:28:00.774 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testnewline", 2024-09-15T22:28:00.774 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.774 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.774 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.774 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.775 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.775 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.775 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.775 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.775 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.775 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.775 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.775 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.775 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.775 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.775 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.775 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snap_schedule", 2024-09-15T22:28:00.775 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.775 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.776 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.776 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_m_granularity": { 2024-09-15T22:28:00.776 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_m_granularity", 2024-09-15T22:28:00.776 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.776 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.776 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.776 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.776 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.776 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.776 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.776 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow minute scheduled snapshots", 2024-09-15T22:28:00.776 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.776 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.776 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.777 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.777 INFO:teuthology.orchestra.run.smithi001.stdout: "dump_on_update": { 2024-09-15T22:28:00.777 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dump_on_update", 2024-09-15T22:28:00.777 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.777 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.777 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.777 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.777 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.777 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.777 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.777 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "dump database to debug log on update", 2024-09-15T22:28:00.777 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.777 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.777 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.778 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.778 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.778 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.778 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.778 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.778 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.778 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.778 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.778 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.778 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.778 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.778 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.778 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.778 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.779 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.779 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.779 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.779 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.779 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.779 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.779 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.779 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.779 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.779 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.779 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.779 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.779 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.780 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.780 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.780 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.780 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.780 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.780 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.780 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.780 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.780 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.780 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.780 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.780 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.781 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.781 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.781 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.781 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.781 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.781 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.781 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.781 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.781 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.781 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.781 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.781 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.781 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.782 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.782 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.782 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.782 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.782 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.782 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.782 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.782 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.782 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.782 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.782 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.782 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.782 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.783 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.783 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.783 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.783 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.783 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.783 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.783 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.783 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.783 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.783 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stats", 2024-09-15T22:28:00.783 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.783 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.783 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.784 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.784 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.784 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.784 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.784 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.784 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.784 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.784 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.784 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.784 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.784 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.784 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.784 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.785 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.785 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.785 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.785 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.785 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.785 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.785 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.785 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.785 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.785 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.785 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.785 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.785 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.785 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.786 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.786 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.786 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.786 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.786 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.786 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.786 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.786 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.786 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.786 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.786 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.786 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.786 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.786 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.787 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.787 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.787 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.787 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.787 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.787 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.787 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.787 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.787 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.787 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.787 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.787 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.787 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.788 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.788 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.788 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.788 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.788 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.788 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.788 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.788 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.788 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.788 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.788 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.788 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.788 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.789 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.789 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.789 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.789 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.789 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.789 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.789 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "status", 2024-09-15T22:28:00.789 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.789 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.789 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.789 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.789 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.789 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.790 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.790 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.790 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.790 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.790 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.790 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.790 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.790 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.790 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.790 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.790 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.790 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.790 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.790 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.791 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.791 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.791 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.791 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.791 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.791 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.791 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.791 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.791 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.791 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.791 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.791 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.791 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.791 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.792 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.792 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.792 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.792 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.792 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.792 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.792 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.792 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.792 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.792 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.792 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.792 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.792 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.792 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.793 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.793 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.793 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.793 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.793 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.793 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.793 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.793 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.793 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.793 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.793 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.793 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.793 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.794 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.794 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.794 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.794 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.794 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.794 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.794 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.794 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.794 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.794 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.794 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.794 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.795 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.795 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.795 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.795 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telegraf", 2024-09-15T22:28:00.795 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.795 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.795 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.795 INFO:teuthology.orchestra.run.smithi001.stdout: "address": { 2024-09-15T22:28:00.795 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "address", 2024-09-15T22:28:00.795 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.795 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.795 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.795 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-15T22:28:00.796 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.796 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.796 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.796 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.796 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.796 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.796 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.796 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.796 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-15T22:28:00.796 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-15T22:28:00.796 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:00.796 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.796 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.797 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15", 2024-09-15T22:28:00.797 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.797 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.797 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.797 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.797 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.797 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.797 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.797 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.797 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.797 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.797 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.797 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.798 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.798 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.798 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.798 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.798 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.798 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.798 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.798 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.798 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.798 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.798 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.798 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.798 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.798 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.799 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.799 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.799 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.799 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.799 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.799 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.799 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.799 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.799 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.799 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.799 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.799 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.799 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.800 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.800 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.800 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.800 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.800 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.800 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.800 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.800 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.800 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.800 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.800 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.800 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.800 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.801 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.801 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.801 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.801 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.801 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.801 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.801 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.801 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.801 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.801 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.801 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.801 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.801 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.801 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.802 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.802 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.802 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.802 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.802 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.802 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.802 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.802 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.802 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.802 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.802 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.802 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.802 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.803 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.803 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.803 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telemetry", 2024-09-15T22:28:00.803 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.803 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.803 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.803 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_basic": { 2024-09-15T22:28:00.803 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_basic", 2024-09-15T22:28:00.803 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.803 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.803 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.803 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.803 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.803 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.804 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.804 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-15T22:28:00.804 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.804 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.804 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.804 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.804 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_crash": { 2024-09-15T22:28:00.804 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_crash", 2024-09-15T22:28:00.804 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.804 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.804 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.804 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.804 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.805 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.805 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.805 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-15T22:28:00.805 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.805 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.805 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.805 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.805 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_device": { 2024-09-15T22:28:00.805 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_device", 2024-09-15T22:28:00.805 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.805 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.805 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.805 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.805 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.806 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.806 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.806 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-15T22:28:00.806 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.806 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.806 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.806 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.806 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_ident": { 2024-09-15T22:28:00.806 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_ident", 2024-09-15T22:28:00.806 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.806 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.806 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.806 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.806 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.807 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.807 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.807 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-15T22:28:00.807 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.807 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.807 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.807 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.807 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_perf": { 2024-09-15T22:28:00.807 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_perf", 2024-09-15T22:28:00.807 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.807 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.807 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.807 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.808 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.808 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.808 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.808 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-15T22:28:00.808 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.808 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.808 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.808 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.808 INFO:teuthology.orchestra.run.smithi001.stdout: "contact": { 2024-09-15T22:28:00.808 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "contact", 2024-09-15T22:28:00.808 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.808 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.808 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.809 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.809 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.809 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.809 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.809 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.809 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.809 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.809 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.809 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.809 INFO:teuthology.orchestra.run.smithi001.stdout: "description": { 2024-09-15T22:28:00.809 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "description", 2024-09-15T22:28:00.809 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.809 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.809 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.810 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.810 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.810 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.810 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.810 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.810 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.810 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.810 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.810 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.810 INFO:teuthology.orchestra.run.smithi001.stdout: "device_url": { 2024-09-15T22:28:00.810 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_url", 2024-09-15T22:28:00.810 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.810 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.811 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.811 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-15T22:28:00.811 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.811 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.811 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.811 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.811 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.811 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.811 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.811 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.811 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-15T22:28:00.811 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-15T22:28:00.811 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.812 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.812 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.812 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.812 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.812 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.812 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.812 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.812 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.812 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.812 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.812 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.812 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-15T22:28:00.812 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-15T22:28:00.813 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.813 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.813 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.813 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "24", 2024-09-15T22:28:00.813 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "8", 2024-09-15T22:28:00.813 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.813 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.813 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.813 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.813 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.813 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.813 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.813 INFO:teuthology.orchestra.run.smithi001.stdout: "last_opt_revision": { 2024-09-15T22:28:00.813 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "last_opt_revision", 2024-09-15T22:28:00.814 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.814 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.814 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.814 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1", 2024-09-15T22:28:00.814 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.814 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.814 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.814 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.814 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.814 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.814 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.814 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.814 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard": { 2024-09-15T22:28:00.814 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard", 2024-09-15T22:28:00.815 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.815 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.815 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.815 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.815 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.815 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.815 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.815 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.815 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.815 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.815 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.815 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.815 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard_description": { 2024-09-15T22:28:00.816 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard_description", 2024-09-15T22:28:00.816 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.816 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.816 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.816 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.816 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.816 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.816 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.816 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.816 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.816 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.816 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.816 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.817 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.817 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.817 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.817 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.817 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.817 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.817 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.817 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.817 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.817 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.817 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.817 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.817 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.818 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.818 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.818 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.818 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.818 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.818 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.818 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.818 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.818 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.818 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.818 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.818 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.818 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.819 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.819 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.819 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.819 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.819 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.819 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.819 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.819 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.819 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.819 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.819 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.819 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.819 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.819 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.819 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.819 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.820 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.820 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.820 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.820 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.820 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.820 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.820 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.820 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.820 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.820 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.820 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.820 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.820 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.820 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.821 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.821 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.821 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.821 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.821 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.821 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.821 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.821 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.821 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.821 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.821 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.821 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.821 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.821 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.821 INFO:teuthology.orchestra.run.smithi001.stdout: "organization": { 2024-09-15T22:28:00.822 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "organization", 2024-09-15T22:28:00.822 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.822 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.822 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.822 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.822 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.822 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.822 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.822 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.822 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.822 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.822 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.822 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.823 INFO:teuthology.orchestra.run.smithi001.stdout: "proxy": { 2024-09-15T22:28:00.823 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "proxy", 2024-09-15T22:28:00.823 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.823 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.823 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.823 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.823 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.823 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.823 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.823 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.823 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.823 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.823 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.823 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.824 INFO:teuthology.orchestra.run.smithi001.stdout: "url": { 2024-09-15T22:28:00.824 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url", 2024-09-15T22:28:00.824 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.824 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.824 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.824 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-15T22:28:00.824 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.824 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.824 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.824 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.824 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.824 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.824 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.824 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.824 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.825 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.825 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.825 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "test_orchestrator", 2024-09-15T22:28:00.825 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.825 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.825 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.825 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.825 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.825 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.825 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.825 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.825 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.825 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.825 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.826 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.826 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.826 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.826 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.826 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.826 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.826 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.826 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.826 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.826 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.826 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.826 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.826 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.826 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.826 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.826 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.827 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.827 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.827 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.827 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.827 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.827 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.827 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.827 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.827 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.827 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.827 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.827 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.827 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.827 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.827 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.827 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.828 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.828 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.828 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.828 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.828 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.828 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.828 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.828 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.828 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.828 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.828 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.828 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.828 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.828 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.828 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.829 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.829 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.829 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.829 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.829 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.829 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.829 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.829 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.829 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.829 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.829 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.829 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.830 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.830 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.830 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.830 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.830 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.830 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.830 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "volumes", 2024-09-15T22:28:00.830 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.830 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.830 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.830 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.830 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.830 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.830 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.830 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.831 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.831 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.831 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.831 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.831 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.831 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.831 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.831 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.831 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.831 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.831 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.831 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.831 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.831 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.831 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.832 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.832 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.832 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.832 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.832 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.832 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.832 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.832 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.832 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.832 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.832 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.832 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.832 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.832 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.832 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.833 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.833 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.833 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.833 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.833 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.833 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.833 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.833 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.833 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.833 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.833 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.833 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.833 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.833 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.834 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.834 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.834 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.834 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.834 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.834 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.834 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.834 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.834 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.834 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.834 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.834 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.834 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.834 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.835 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.835 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.835 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.835 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.835 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.835 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.835 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.835 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_clones": { 2024-09-15T22:28:00.835 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_clones", 2024-09-15T22:28:00.835 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.835 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.835 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.835 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4", 2024-09-15T22:28:00.835 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.835 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.836 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.836 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-15T22:28:00.836 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.836 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.836 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.836 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.836 INFO:teuthology.orchestra.run.smithi001.stdout: "periodic_async_work": { 2024-09-15T22:28:00.836 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "periodic_async_work", 2024-09-15T22:28:00.836 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.836 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.836 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.837 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.837 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.837 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.837 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.837 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Periodically check for async work", 2024-09-15T22:28:00.837 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.837 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.837 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.837 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.837 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_delay": { 2024-09-15T22:28:00.837 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_delay", 2024-09-15T22:28:00.837 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.837 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.837 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.837 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-15T22:28:00.838 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.838 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.838 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.838 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-15T22:28:00.838 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.838 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.838 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.838 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.838 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_no_wait": { 2024-09-15T22:28:00.838 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_no_wait", 2024-09-15T22:28:00.838 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.838 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.838 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.838 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.838 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.839 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.839 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.839 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-15T22:28:00.839 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.839 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.839 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.839 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.839 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.839 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.839 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.839 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix", 2024-09-15T22:28:00.839 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.839 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.840 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.840 INFO:teuthology.orchestra.run.smithi001.stdout: "discovery_interval": { 2024-09-15T22:28:00.840 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "discovery_interval", 2024-09-15T22:28:00.840 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-15T22:28:00.840 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.840 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.840 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "100", 2024-09-15T22:28:00.840 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.840 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.840 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.840 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.840 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.840 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.841 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.841 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.841 INFO:teuthology.orchestra.run.smithi001.stdout: "identifier": { 2024-09-15T22:28:00.841 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "identifier", 2024-09-15T22:28:00.841 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.841 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.841 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.841 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.841 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.841 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.841 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.841 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.841 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.842 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.842 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.842 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.842 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-15T22:28:00.842 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-15T22:28:00.842 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:00.842 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.842 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.842 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-15T22:28:00.842 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.842 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.842 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.842 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.843 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.843 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.843 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.843 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.843 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.843 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.843 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.843 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.843 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.843 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.843 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.843 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.843 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.843 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.844 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.844 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.844 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.844 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.844 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.844 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.844 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.844 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.844 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.844 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.844 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.844 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.844 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.845 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.845 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.845 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.845 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.845 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.845 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.845 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.845 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.845 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.845 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.845 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.845 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.845 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.845 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.846 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.846 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.846 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.846 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.846 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.846 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.846 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.846 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.846 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.846 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.846 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.846 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.846 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.846 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.847 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.847 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.847 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.847 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.847 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.847 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.847 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.847 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.847 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.847 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.847 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.847 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.847 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.848 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.848 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.848 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.848 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.848 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.848 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.848 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_host": { 2024-09-15T22:28:00.848 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_host", 2024-09-15T22:28:00.848 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.848 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.848 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.848 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.848 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.848 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.849 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.849 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.849 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.849 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.849 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.849 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.849 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_port": { 2024-09-15T22:28:00.849 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_port", 2024-09-15T22:28:00.849 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.849 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.849 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.849 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10051", 2024-09-15T22:28:00.849 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.849 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.850 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.850 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.850 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.850 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.850 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.850 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.850 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_sender": { 2024-09-15T22:28:00.850 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_sender", 2024-09-15T22:28:00.850 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.850 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.850 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.850 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-15T22:28:00.850 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.851 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.851 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.851 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.851 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.851 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.851 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.851 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.851 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.851 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.851 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-15T22:28:00.851 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.851 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.851 INFO:teuthology.orchestra.run.smithi001.stdout: "gid": 24116, 2024-09-15T22:28:00.851 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "y", 2024-09-15T22:28:00.852 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_features": 4540701547738038271, 2024-09-15T22:28:00.852 INFO:teuthology.orchestra.run.smithi001.stdout: "available_modules": [ 2024-09-15T22:28:00.852 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.852 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "alerts", 2024-09-15T22:28:00.852 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.852 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.852 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.852 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-15T22:28:00.852 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-15T22:28:00.852 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:00.852 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.852 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.852 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-15T22:28:00.853 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.853 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.853 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.853 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How frequently to reexamine health status", 2024-09-15T22:28:00.853 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.853 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.853 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.853 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.853 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.853 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.853 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.853 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.853 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.853 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.854 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.854 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.854 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.854 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.854 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.854 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.854 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.854 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.854 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.854 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.854 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.854 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.854 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.855 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.855 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.855 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.855 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.855 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.855 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.855 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.855 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.855 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.855 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.855 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.855 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.855 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.855 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.856 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.856 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.856 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.856 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.856 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.856 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.856 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.856 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.856 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.856 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.856 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.856 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.856 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.857 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.857 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.857 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.857 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.857 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.857 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.857 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.857 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.857 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.857 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.857 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.857 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.857 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.858 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.858 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.858 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.858 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.858 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.858 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.858 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.858 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.858 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.858 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.858 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.858 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_destination": { 2024-09-15T22:28:00.858 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_destination", 2024-09-15T22:28:00.858 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.859 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.859 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.859 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.859 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.859 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.859 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.859 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email address to send alerts to", 2024-09-15T22:28:00.859 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.859 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.859 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.859 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.859 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_from_name": { 2024-09-15T22:28:00.859 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_from_name", 2024-09-15T22:28:00.859 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.860 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.860 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.860 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "Ceph", 2024-09-15T22:28:00.860 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.860 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.860 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.860 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email From: name", 2024-09-15T22:28:00.860 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.860 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.860 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.860 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.860 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_host": { 2024-09-15T22:28:00.860 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_host", 2024-09-15T22:28:00.860 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.860 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.861 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.861 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.861 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.861 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.861 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.861 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP server", 2024-09-15T22:28:00.861 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.861 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.861 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.861 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.861 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_password": { 2024-09-15T22:28:00.861 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_password", 2024-09-15T22:28:00.861 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.861 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.861 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.862 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.862 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.862 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.862 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.862 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Password to authenticate with", 2024-09-15T22:28:00.862 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.862 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.862 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.862 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.862 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_port": { 2024-09-15T22:28:00.862 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_port", 2024-09-15T22:28:00.862 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.862 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.862 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.862 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "465", 2024-09-15T22:28:00.862 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.863 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.863 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.863 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP port", 2024-09-15T22:28:00.863 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.863 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.863 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.863 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.863 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_sender": { 2024-09-15T22:28:00.863 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_sender", 2024-09-15T22:28:00.863 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.863 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.863 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.863 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.863 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.864 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.864 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.864 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP envelope sender", 2024-09-15T22:28:00.864 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.864 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.864 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.864 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.864 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_ssl": { 2024-09-15T22:28:00.864 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_ssl", 2024-09-15T22:28:00.864 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.864 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.864 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.864 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.865 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.865 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.865 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.865 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-15T22:28:00.865 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.865 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.865 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.865 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.865 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_user": { 2024-09-15T22:28:00.865 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_user", 2024-09-15T22:28:00.865 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.865 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.865 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.865 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.866 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.866 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.866 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.866 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "User to authenticate as", 2024-09-15T22:28:00.866 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.866 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.866 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.866 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.866 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.866 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.866 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.866 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "balancer", 2024-09-15T22:28:00.866 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.866 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.867 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.867 INFO:teuthology.orchestra.run.smithi001.stdout: "active": { 2024-09-15T22:28:00.867 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "active", 2024-09-15T22:28:00.867 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.867 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.867 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.867 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.867 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.867 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.867 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.867 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically balance PGs across cluster", 2024-09-15T22:28:00.867 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.867 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.867 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.868 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.868 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_time": { 2024-09-15T22:28:00.868 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_time", 2024-09-15T22:28:00.868 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.868 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.868 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.868 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0000", 2024-09-15T22:28:00.868 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.868 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.868 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.868 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "beginning time of day to automatically balance", 2024-09-15T22:28:00.868 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T22:28:00.869 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.869 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.869 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.869 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_weekday": { 2024-09-15T22:28:00.869 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_weekday", 2024-09-15T22:28:00.869 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-15T22:28:00.869 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.869 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.869 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-15T22:28:00.869 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-15T22:28:00.869 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-15T22:28:00.869 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.869 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-15T22:28:00.869 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T22:28:00.869 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.870 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.870 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.870 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_max_iterations": { 2024-09-15T22:28:00.870 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_max_iterations", 2024-09-15T22:28:00.870 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-15T22:28:00.870 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.870 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.870 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "25", 2024-09-15T22:28:00.870 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-15T22:28:00.870 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "250", 2024-09-15T22:28:00.870 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.870 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-15T22:28:00.870 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.870 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.871 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.871 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.871 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_metrics": { 2024-09-15T22:28:00.871 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_metrics", 2024-09-15T22:28:00.871 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.871 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.871 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.871 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "pgs,objects,bytes", 2024-09-15T22:28:00.871 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.871 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.871 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.871 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-15T22:28:00.871 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-15T22:28:00.871 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.871 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.871 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.872 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_step": { 2024-09-15T22:28:00.872 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_step", 2024-09-15T22:28:00.872 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-15T22:28:00.872 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.872 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.872 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.5", 2024-09-15T22:28:00.872 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0.001", 2024-09-15T22:28:00.872 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "0.999", 2024-09-15T22:28:00.872 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.872 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "aggressiveness of optimization", 2024-09-15T22:28:00.872 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-15T22:28:00.872 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.872 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.872 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.872 INFO:teuthology.orchestra.run.smithi001.stdout: "end_time": { 2024-09-15T22:28:00.873 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_time", 2024-09-15T22:28:00.873 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.873 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.873 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.873 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2359", 2024-09-15T22:28:00.873 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.873 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.873 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.873 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ending time of day to automatically balance", 2024-09-15T22:28:00.873 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T22:28:00.873 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.873 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.873 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.873 INFO:teuthology.orchestra.run.smithi001.stdout: "end_weekday": { 2024-09-15T22:28:00.874 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_weekday", 2024-09-15T22:28:00.874 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-15T22:28:00.874 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.874 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.874 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-15T22:28:00.874 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-15T22:28:00.874 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-15T22:28:00.874 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.874 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-15T22:28:00.874 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T22:28:00.874 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.874 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.874 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.874 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.875 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.875 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.875 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.875 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.875 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.875 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.875 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.875 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.875 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.875 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.875 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.875 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.875 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.875 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.875 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.875 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.876 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.876 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.876 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.876 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.876 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.876 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.876 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.876 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.876 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.876 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.876 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.876 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.876 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.877 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.877 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.877 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.877 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.877 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.877 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.877 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.877 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.877 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.877 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.877 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.877 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.877 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.877 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.877 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.878 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.878 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.878 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.878 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.878 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.878 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.878 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.878 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.878 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.878 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.878 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.878 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.878 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.878 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.879 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.879 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.879 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.879 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.879 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.879 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.879 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.879 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.879 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.879 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.879 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.879 INFO:teuthology.orchestra.run.smithi001.stdout: "min_score": { 2024-09-15T22:28:00.879 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_score", 2024-09-15T22:28:00.880 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-15T22:28:00.880 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.880 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.880 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-15T22:28:00.880 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.880 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.880 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.880 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-15T22:28:00.880 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.880 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.880 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.880 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.881 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-15T22:28:00.881 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-15T22:28:00.881 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.881 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.881 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.881 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "upmap", 2024-09-15T22:28:00.881 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.881 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.881 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.881 INFO:teuthology.orchestra.run.smithi001.stdout: "crush-compat", 2024-09-15T22:28:00.881 INFO:teuthology.orchestra.run.smithi001.stdout: "none", 2024-09-15T22:28:00.881 INFO:teuthology.orchestra.run.smithi001.stdout: "read", 2024-09-15T22:28:00.881 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap", 2024-09-15T22:28:00.881 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap-read" 2024-09-15T22:28:00.882 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.882 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Balancer mode", 2024-09-15T22:28:00.882 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.882 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.882 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.882 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.882 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_ids": { 2024-09-15T22:28:00.882 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_ids", 2024-09-15T22:28:00.882 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.882 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.882 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.882 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.882 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.883 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.883 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.883 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-15T22:28:00.883 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.883 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.883 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.883 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.883 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-15T22:28:00.883 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-15T22:28:00.883 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:00.883 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.883 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.884 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-15T22:28:00.884 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.884 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.884 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.884 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-15T22:28:00.884 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.884 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.884 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.884 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.884 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_deviation": { 2024-09-15T22:28:00.884 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_deviation", 2024-09-15T22:28:00.884 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.885 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.885 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.885 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-15T22:28:00.885 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-15T22:28:00.885 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.885 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.885 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-15T22:28:00.885 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-15T22:28:00.885 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.885 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.885 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.885 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_optimizations": { 2024-09-15T22:28:00.885 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_optimizations", 2024-09-15T22:28:00.886 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-15T22:28:00.886 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.886 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.886 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-15T22:28:00.886 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.886 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.886 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.886 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-15T22:28:00.886 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.886 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.886 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.886 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.886 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.886 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.886 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.887 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm", 2024-09-15T22:28:00.887 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.887 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.887 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.887 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_down_multiplier": { 2024-09-15T22:28:00.887 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_down_multiplier", 2024-09-15T22:28:00.887 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-15T22:28:00.887 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.887 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.887 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-15T22:28:00.887 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.887 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.887 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.888 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-15T22:28:00.888 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.888 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.888 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.888 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.888 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_refresh_rate": { 2024-09-15T22:28:00.888 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_refresh_rate", 2024-09-15T22:28:00.888 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:00.888 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.888 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.888 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "20", 2024-09-15T22:28:00.888 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.888 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.889 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.889 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-15T22:28:00.889 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.889 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.889 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.889 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.889 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_starting_port": { 2024-09-15T22:28:00.889 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_starting_port", 2024-09-15T22:28:00.889 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.889 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.889 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.889 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4721", 2024-09-15T22:28:00.889 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.889 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.890 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.890 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-15T22:28:00.890 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.890 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.890 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.890 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.890 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_ptrace": { 2024-09-15T22:28:00.890 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_ptrace", 2024-09-15T22:28:00.890 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.890 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.890 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.890 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.890 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.891 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.891 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.891 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-15T22:28:00.891 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-15T22:28:00.891 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.891 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.891 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.891 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_interval": { 2024-09-15T22:28:00.891 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_interval", 2024-09-15T22:28:00.891 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:00.891 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.891 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.891 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-15T22:28:00.892 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.892 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.892 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.892 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-15T22:28:00.892 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.892 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.892 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.892 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.892 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_memory_target_ratio": { 2024-09-15T22:28:00.892 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_memory_target_ratio", 2024-09-15T22:28:00.892 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-15T22:28:00.892 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.892 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.892 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.7", 2024-09-15T22:28:00.893 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.893 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.893 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.893 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-15T22:28:00.893 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.893 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.893 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.893 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.893 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm_log_destination": { 2024-09-15T22:28:00.893 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm_log_destination", 2024-09-15T22:28:00.893 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.893 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.893 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.894 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.894 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.894 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.894 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.894 INFO:teuthology.orchestra.run.smithi001.stdout: "file", 2024-09-15T22:28:00.894 INFO:teuthology.orchestra.run.smithi001.stdout: "file,syslog", 2024-09-15T22:28:00.894 INFO:teuthology.orchestra.run.smithi001.stdout: "syslog" 2024-09-15T22:28:00.894 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.894 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-15T22:28:00.894 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.894 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.894 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.894 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.895 INFO:teuthology.orchestra.run.smithi001.stdout: "cgroups_split": { 2024-09-15T22:28:00.895 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cgroups_split", 2024-09-15T22:28:00.895 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.895 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.895 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.895 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.895 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.895 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.895 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.895 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-15T22:28:00.895 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.895 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.895 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.896 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.896 INFO:teuthology.orchestra.run.smithi001.stdout: "config_checks_enabled": { 2024-09-15T22:28:00.896 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_checks_enabled", 2024-09-15T22:28:00.896 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.896 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.896 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.896 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.896 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.896 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.896 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.896 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-15T22:28:00.896 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.896 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.896 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.897 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.897 INFO:teuthology.orchestra.run.smithi001.stdout: "config_dashboard": { 2024-09-15T22:28:00.897 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_dashboard", 2024-09-15T22:28:00.897 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.897 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.897 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.897 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.897 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.897 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.897 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.897 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-15T22:28:00.897 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.897 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.898 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.898 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.898 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_alertmanager": { 2024-09-15T22:28:00.898 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_alertmanager", 2024-09-15T22:28:00.898 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.898 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.898 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.898 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-15T22:28:00.898 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.898 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.898 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.898 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-15T22:28:00.898 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.898 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.899 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.899 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.899 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_base": { 2024-09-15T22:28:00.899 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_base", 2024-09-15T22:28:00.899 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.899 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.899 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.899 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-15T22:28:00.899 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.899 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.899 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.899 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Container image name, without the tag", 2024-09-15T22:28:00.899 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.899 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.900 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.900 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.900 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_elasticsearch": { 2024-09-15T22:28:00.900 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_elasticsearch", 2024-09-15T22:28:00.900 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.900 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.900 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.900 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-15T22:28:00.900 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.900 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.900 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.900 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "elasticsearch container image", 2024-09-15T22:28:00.900 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.901 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.901 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.901 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.901 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_grafana": { 2024-09-15T22:28:00.901 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_grafana", 2024-09-15T22:28:00.901 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.901 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.901 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.901 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-15T22:28:00.901 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.901 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.901 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.901 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-15T22:28:00.902 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.902 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.902 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.902 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.902 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_haproxy": { 2024-09-15T22:28:00.902 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_haproxy", 2024-09-15T22:28:00.902 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.902 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.902 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.902 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-15T22:28:00.902 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.902 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.902 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.903 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "HAproxy container image", 2024-09-15T22:28:00.903 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.903 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.903 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.903 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.903 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_agent": { 2024-09-15T22:28:00.903 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_agent", 2024-09-15T22:28:00.903 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.903 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.903 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.903 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-15T22:28:00.903 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.904 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.904 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.904 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger agent container image", 2024-09-15T22:28:00.904 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.904 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.904 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.904 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.904 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_collector": { 2024-09-15T22:28:00.904 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_collector", 2024-09-15T22:28:00.904 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.904 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.904 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.905 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-15T22:28:00.905 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.905 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.905 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.905 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger collector container image", 2024-09-15T22:28:00.905 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.905 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.905 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.905 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.905 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_query": { 2024-09-15T22:28:00.905 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_query", 2024-09-15T22:28:00.905 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.905 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.905 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.906 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-15T22:28:00.906 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.906 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.906 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.906 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger query container image", 2024-09-15T22:28:00.906 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.906 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.906 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.906 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.906 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_keepalived": { 2024-09-15T22:28:00.906 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_keepalived", 2024-09-15T22:28:00.906 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.906 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.907 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.907 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-15T22:28:00.907 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.907 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.907 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.907 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Keepalived container image", 2024-09-15T22:28:00.907 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.907 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.907 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.907 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.907 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_loki": { 2024-09-15T22:28:00.907 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_loki", 2024-09-15T22:28:00.907 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.907 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.908 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.908 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-15T22:28:00.908 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.908 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.908 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.908 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Loki container image", 2024-09-15T22:28:00.908 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.908 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.908 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.908 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.908 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_node_exporter": { 2024-09-15T22:28:00.908 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_node_exporter", 2024-09-15T22:28:00.908 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.908 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.909 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.909 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-15T22:28:00.909 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.909 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.909 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.909 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-15T22:28:00.909 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.909 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.909 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.909 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.909 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_nvmeof": { 2024-09-15T22:28:00.909 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_nvmeof", 2024-09-15T22:28:00.909 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.910 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.910 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.910 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-15T22:28:00.910 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.910 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.910 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.910 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Nvme-of container image", 2024-09-15T22:28:00.910 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.910 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.910 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.910 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.910 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_prometheus": { 2024-09-15T22:28:00.910 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_prometheus", 2024-09-15T22:28:00.911 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.911 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.911 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.911 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-15T22:28:00.911 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.911 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.911 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.911 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-15T22:28:00.911 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.911 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.911 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.911 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.911 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_promtail": { 2024-09-15T22:28:00.911 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_promtail", 2024-09-15T22:28:00.912 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.912 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.912 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.912 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-15T22:28:00.912 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.912 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.912 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.912 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Promtail container image", 2024-09-15T22:28:00.912 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.912 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.912 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.912 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.912 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_samba": { 2024-09-15T22:28:00.913 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_samba", 2024-09-15T22:28:00.913 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.913 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.913 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.913 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-15T22:28:00.913 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.913 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.913 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.913 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Samba/SMB container image", 2024-09-15T22:28:00.913 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.913 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.913 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.913 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.913 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_snmp_gateway": { 2024-09-15T22:28:00.914 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_snmp_gateway", 2024-09-15T22:28:00.914 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.914 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.914 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.914 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-15T22:28:00.914 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.914 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.914 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.914 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SNMP Gateway container image", 2024-09-15T22:28:00.914 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.914 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.914 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.914 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.915 INFO:teuthology.orchestra.run.smithi001.stdout: "container_init": { 2024-09-15T22:28:00.915 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_init", 2024-09-15T22:28:00.915 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.915 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.915 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.915 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.915 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.915 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.915 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.915 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Run podman/docker with `--init`", 2024-09-15T22:28:00.915 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.915 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.915 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.916 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.916 INFO:teuthology.orchestra.run.smithi001.stdout: "daemon_cache_timeout": { 2024-09-15T22:28:00.916 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "daemon_cache_timeout", 2024-09-15T22:28:00.916 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:00.916 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.916 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.916 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-15T22:28:00.916 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.916 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.916 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.916 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-15T22:28:00.916 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.917 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.917 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.917 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.917 INFO:teuthology.orchestra.run.smithi001.stdout: "default_cephadm_command_timeout": { 2024-09-15T22:28:00.917 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_cephadm_command_timeout", 2024-09-15T22:28:00.917 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.917 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.917 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.917 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "900", 2024-09-15T22:28:00.917 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.917 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.917 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.917 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-15T22:28:00.917 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.918 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.918 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.918 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.918 INFO:teuthology.orchestra.run.smithi001.stdout: "default_registry": { 2024-09-15T22:28:00.918 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_registry", 2024-09-15T22:28:00.918 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.918 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.918 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.918 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io", 2024-09-15T22:28:00.918 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.918 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.918 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.918 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-15T22:28:00.918 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.919 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.919 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.919 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.919 INFO:teuthology.orchestra.run.smithi001.stdout: "device_cache_timeout": { 2024-09-15T22:28:00.919 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_cache_timeout", 2024-09-15T22:28:00.919 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:00.919 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.919 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.919 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1800", 2024-09-15T22:28:00.919 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.919 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.919 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.919 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache device inventory", 2024-09-15T22:28:00.919 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.919 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.920 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.920 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.920 INFO:teuthology.orchestra.run.smithi001.stdout: "device_enhanced_scan": { 2024-09-15T22:28:00.920 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_enhanced_scan", 2024-09-15T22:28:00.920 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.920 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.920 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.920 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.920 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.920 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.920 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.920 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-15T22:28:00.921 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.921 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.921 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.921 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.921 INFO:teuthology.orchestra.run.smithi001.stdout: "facts_cache_timeout": { 2024-09-15T22:28:00.921 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "facts_cache_timeout", 2024-09-15T22:28:00.921 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:00.921 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.921 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.921 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-15T22:28:00.921 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.921 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.921 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.922 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache host facts data", 2024-09-15T22:28:00.922 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.922 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.922 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.922 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.922 INFO:teuthology.orchestra.run.smithi001.stdout: "grafana_dashboards_path": { 2024-09-15T22:28:00.922 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "grafana_dashboards_path", 2024-09-15T22:28:00.922 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.922 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.922 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.922 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-15T22:28:00.922 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.922 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.923 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.923 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-15T22:28:00.923 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.923 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.923 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.923 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.923 INFO:teuthology.orchestra.run.smithi001.stdout: "host_check_interval": { 2024-09-15T22:28:00.923 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "host_check_interval", 2024-09-15T22:28:00.923 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:00.923 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.923 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.923 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-15T22:28:00.923 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.923 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.924 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.924 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to perform a host check", 2024-09-15T22:28:00.924 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.924 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.924 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.924 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.924 INFO:teuthology.orchestra.run.smithi001.stdout: "hw_monitoring": { 2024-09-15T22:28:00.924 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hw_monitoring", 2024-09-15T22:28:00.924 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.924 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.924 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.924 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.924 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.925 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.925 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.925 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-15T22:28:00.925 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.925 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.925 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.925 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.925 INFO:teuthology.orchestra.run.smithi001.stdout: "inventory_list_all": { 2024-09-15T22:28:00.925 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "inventory_list_all", 2024-09-15T22:28:00.925 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.925 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.925 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.925 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.925 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.926 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.926 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.926 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-15T22:28:00.926 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.926 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.926 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.926 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.926 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.926 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.926 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.926 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.926 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.926 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.926 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.926 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.927 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.927 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.927 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.927 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.927 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.927 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.927 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.927 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.927 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.927 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.927 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.927 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.927 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.927 INFO:teuthology.orchestra.run.smithi001.stdout: "log_refresh_metadata": { 2024-09-15T22:28:00.927 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_refresh_metadata", 2024-09-15T22:28:00.927 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.928 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.928 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.928 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.928 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.928 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.928 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.928 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-15T22:28:00.928 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.928 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.928 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.928 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.928 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.928 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.928 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.929 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.929 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.929 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.929 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.929 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.929 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.929 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-15T22:28:00.929 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.929 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.929 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.929 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.929 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.929 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.929 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.930 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.930 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.930 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.930 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.930 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.930 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.930 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.930 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.930 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.930 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.930 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.930 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.930 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.930 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.930 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.931 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.931 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.931 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.931 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.931 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.931 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.931 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.931 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.931 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.931 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.931 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.931 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.931 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.931 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.931 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.931 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.932 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.932 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-15T22:28:00.932 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-15T22:28:00.932 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.932 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.932 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.932 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.932 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.932 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.932 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.932 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-15T22:28:00.932 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.932 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.933 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.933 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.933 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-15T22:28:00.933 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-15T22:28:00.933 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.933 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.933 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.933 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "*", 2024-09-15T22:28:00.933 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.933 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.933 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.933 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-15T22:28:00.933 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.934 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.934 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.934 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.934 INFO:teuthology.orchestra.run.smithi001.stdout: "max_count_per_host": { 2024-09-15T22:28:00.934 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_count_per_host", 2024-09-15T22:28:00.934 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.934 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.934 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.934 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-15T22:28:00.934 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.934 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.934 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.935 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of daemons per service per host", 2024-09-15T22:28:00.935 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.935 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.935 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.935 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.935 INFO:teuthology.orchestra.run.smithi001.stdout: "max_osd_draining_count": { 2024-09-15T22:28:00.935 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_osd_draining_count", 2024-09-15T22:28:00.935 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.935 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.935 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.935 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-15T22:28:00.935 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.935 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.935 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.936 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-15T22:28:00.936 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.936 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.936 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.936 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.936 INFO:teuthology.orchestra.run.smithi001.stdout: "migration_current": { 2024-09-15T22:28:00.936 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "migration_current", 2024-09-15T22:28:00.936 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.936 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.936 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.936 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.936 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.936 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.937 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.937 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "internal - do not modify", 2024-09-15T22:28:00.937 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.937 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.937 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.937 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.937 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-15T22:28:00.937 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-15T22:28:00.937 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.937 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.937 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.937 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "root", 2024-09-15T22:28:00.937 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.937 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.938 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.938 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm-package", 2024-09-15T22:28:00.938 INFO:teuthology.orchestra.run.smithi001.stdout: "root" 2024-09-15T22:28:00.938 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.938 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "mode for remote execution of cephadm", 2024-09-15T22:28:00.938 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.938 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.938 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.938 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.938 INFO:teuthology.orchestra.run.smithi001.stdout: "oob_default_addr": { 2024-09-15T22:28:00.938 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "oob_default_addr", 2024-09-15T22:28:00.938 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.938 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.939 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.939 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "169.254.1.1", 2024-09-15T22:28:00.939 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.939 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.939 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.939 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-15T22:28:00.939 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.939 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.939 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.939 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.939 INFO:teuthology.orchestra.run.smithi001.stdout: "prometheus_alerts_path": { 2024-09-15T22:28:00.939 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus_alerts_path", 2024-09-15T22:28:00.939 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.940 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.940 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.940 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-15T22:28:00.940 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.940 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.940 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.940 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-15T22:28:00.940 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.940 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.940 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.940 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.940 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_insecure": { 2024-09-15T22:28:00.940 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_insecure", 2024-09-15T22:28:00.941 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.941 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.941 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.941 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.941 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.941 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.941 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.941 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-15T22:28:00.941 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.941 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.941 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.941 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.941 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_password": { 2024-09-15T22:28:00.942 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_password", 2024-09-15T22:28:00.942 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.942 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.942 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.942 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.942 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.942 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.942 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.942 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-15T22:28:00.942 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.942 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.942 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.942 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.942 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_url": { 2024-09-15T22:28:00.943 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_url", 2024-09-15T22:28:00.943 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.943 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.943 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.943 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.943 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.943 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.943 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.943 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-15T22:28:00.943 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.943 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.943 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.943 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.944 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_username": { 2024-09-15T22:28:00.944 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_username", 2024-09-15T22:28:00.944 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.944 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.944 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.944 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.944 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.944 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.944 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.944 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-15T22:28:00.944 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.944 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.944 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.944 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.945 INFO:teuthology.orchestra.run.smithi001.stdout: "secure_monitoring_stack": { 2024-09-15T22:28:00.945 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secure_monitoring_stack", 2024-09-15T22:28:00.945 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.945 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.945 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.945 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.945 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.945 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.945 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.945 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-15T22:28:00.945 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.945 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.945 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.945 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.946 INFO:teuthology.orchestra.run.smithi001.stdout: "service_discovery_port": { 2024-09-15T22:28:00.946 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "service_discovery_port", 2024-09-15T22:28:00.946 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.946 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.946 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.946 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8765", 2024-09-15T22:28:00.946 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.946 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.946 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.946 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "cephadm service discovery port", 2024-09-15T22:28:00.946 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.946 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.946 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.946 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.947 INFO:teuthology.orchestra.run.smithi001.stdout: "ssh_config_file": { 2024-09-15T22:28:00.947 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssh_config_file", 2024-09-15T22:28:00.947 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.947 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.947 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.947 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.947 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.947 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.947 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.947 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-15T22:28:00.947 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.947 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.947 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.947 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.948 INFO:teuthology.orchestra.run.smithi001.stdout: "use_agent": { 2024-09-15T22:28:00.948 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_agent", 2024-09-15T22:28:00.948 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.948 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.948 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.948 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.948 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.948 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.948 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.948 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-15T22:28:00.948 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.948 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.948 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.949 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.949 INFO:teuthology.orchestra.run.smithi001.stdout: "use_repo_digest": { 2024-09-15T22:28:00.949 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_repo_digest", 2024-09-15T22:28:00.949 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.949 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.949 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.949 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.949 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.949 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.949 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.949 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-15T22:28:00.949 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.949 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.949 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.949 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.950 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_failed_host_check": { 2024-09-15T22:28:00.950 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_failed_host_check", 2024-09-15T22:28:00.950 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.950 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.950 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.950 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.950 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.950 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.950 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.950 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if the host check fails", 2024-09-15T22:28:00.950 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.950 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.950 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.951 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.951 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_daemons": { 2024-09-15T22:28:00.951 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_daemons", 2024-09-15T22:28:00.951 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.951 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.951 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.951 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.951 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.951 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.951 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.951 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-15T22:28:00.951 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.951 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.951 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.952 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.952 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_hosts": { 2024-09-15T22:28:00.952 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_hosts", 2024-09-15T22:28:00.952 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.952 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.952 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.952 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.952 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.952 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.952 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.952 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-15T22:28:00.952 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.952 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.952 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.953 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.953 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.953 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.953 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.953 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crash", 2024-09-15T22:28:00.953 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.953 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.953 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.953 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:00.953 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:00.953 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.953 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.953 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.954 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.954 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.954 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.954 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.954 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.954 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.954 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.954 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.954 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.954 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.954 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.954 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.954 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.954 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.955 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.955 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.955 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:00.955 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:00.955 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.955 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.955 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.955 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.955 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.955 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.955 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.955 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.955 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.955 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.956 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.956 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.956 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:00.956 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:00.956 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.956 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.956 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.956 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:00.956 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.956 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.956 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:00.956 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:00.956 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:00.957 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:00.957 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:00.957 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:00.957 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:00.957 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:00.957 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.957 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.957 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.957 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.957 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.957 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:00.957 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:00.957 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.957 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.958 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.958 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.958 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.958 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.958 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.958 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.958 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.958 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.958 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.958 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.958 INFO:teuthology.orchestra.run.smithi001.stdout: "retain_interval": { 2024-09-15T22:28:00.958 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retain_interval", 2024-09-15T22:28:00.958 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:00.958 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.959 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.959 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "31536000", 2024-09-15T22:28:00.959 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.959 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.959 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.959 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-15T22:28:00.959 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.959 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.959 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.959 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.959 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_recent_interval": { 2024-09-15T22:28:00.959 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_recent_interval", 2024-09-15T22:28:00.959 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:00.959 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.960 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:00.960 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1209600", 2024-09-15T22:28:00.960 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.960 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.960 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.960 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-15T22:28:00.960 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.960 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.960 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.960 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.960 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:00.960 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.960 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:00.960 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dashboard", 2024-09-15T22:28:00.961 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:00.961 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:00.961 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:00.961 INFO:teuthology.orchestra.run.smithi001.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-15T22:28:00.961 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-15T22:28:00.961 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.961 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.961 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.961 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-15T22:28:00.961 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.961 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.961 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.961 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.961 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.962 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.962 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.962 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.962 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_HOST": { 2024-09-15T22:28:00.962 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-15T22:28:00.962 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.962 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.962 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.962 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.962 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.962 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.962 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.962 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.962 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.963 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.963 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.963 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.963 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-15T22:28:00.963 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-15T22:28:00.963 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.963 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.963 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.963 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.963 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.963 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.963 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.963 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.964 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.964 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.964 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.964 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.964 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_ENABLED": { 2024-09-15T22:28:00.964 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_ENABLED", 2024-09-15T22:28:00.964 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.964 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.964 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.964 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.964 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.964 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.964 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.965 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.965 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.965 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.965 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.965 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.965 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-15T22:28:00.965 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-15T22:28:00.965 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.965 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.965 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.965 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.965 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.965 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.965 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.965 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.966 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.966 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.966 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.966 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.966 INFO:teuthology.orchestra.run.smithi001.stdout: "ENABLE_BROWSABLE_API": { 2024-09-15T22:28:00.966 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-15T22:28:00.966 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.966 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.966 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.966 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.966 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.966 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.966 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.967 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.967 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.967 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.967 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.967 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.967 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-15T22:28:00.967 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-15T22:28:00.967 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.967 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.967 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.967 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.967 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.967 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.967 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.968 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.968 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.968 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.968 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.968 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.968 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-15T22:28:00.968 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-15T22:28:00.968 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.968 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.968 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.968 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.968 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.968 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.969 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.969 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.969 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.969 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.969 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.969 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.969 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-15T22:28:00.969 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-15T22:28:00.969 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.969 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.969 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.969 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.969 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.969 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.970 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.970 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.970 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.970 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.970 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.970 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.970 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-15T22:28:00.970 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-15T22:28:00.970 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.970 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.970 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.970 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.970 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.970 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.971 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.971 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.971 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.971 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.971 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.971 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.971 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-15T22:28:00.971 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-15T22:28:00.971 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.971 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.971 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.971 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.971 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.971 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.972 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.972 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.972 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.972 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.972 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.972 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.972 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-15T22:28:00.972 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-15T22:28:00.972 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.972 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.972 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.972 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.973 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.973 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.973 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.973 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.973 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.973 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.973 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.973 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.973 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-15T22:28:00.973 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-15T22:28:00.973 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.973 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.973 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.973 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.974 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.974 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.974 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.974 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.974 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.974 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.974 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.974 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.974 INFO:teuthology.orchestra.run.smithi001.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-15T22:28:00.974 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-15T22:28:00.974 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.974 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.974 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.974 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.975 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.975 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.975 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.975 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.975 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.975 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.975 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.975 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.975 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_PASSWORD": { 2024-09-15T22:28:00.975 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-15T22:28:00.975 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.975 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.975 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.975 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-15T22:28:00.976 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.976 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.976 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.976 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.976 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.976 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.976 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.976 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.976 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-15T22:28:00.976 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-15T22:28:00.976 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.976 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.976 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.976 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.977 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.977 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.977 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.977 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.977 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.977 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.977 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.977 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.977 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_URL": { 2024-09-15T22:28:00.977 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_URL", 2024-09-15T22:28:00.977 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.977 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.977 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.977 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.978 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.978 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.978 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.978 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.978 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.978 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.978 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.978 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.978 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_USERNAME": { 2024-09-15T22:28:00.978 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-15T22:28:00.978 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.978 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.978 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.979 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-15T22:28:00.979 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.979 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.979 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.979 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.979 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.979 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.979 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.979 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.979 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-15T22:28:00.979 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-15T22:28:00.979 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.979 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.979 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.980 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.980 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.980 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.980 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.980 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.980 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.980 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.980 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.980 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.980 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-15T22:28:00.980 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-15T22:28:00.980 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.981 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.981 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.981 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.981 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.981 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.981 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.981 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.981 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.981 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.981 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.981 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.981 INFO:teuthology.orchestra.run.smithi001.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-15T22:28:00.981 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-15T22:28:00.982 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.982 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.982 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.982 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.982 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.982 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.982 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.982 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.982 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.982 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.982 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.982 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.982 INFO:teuthology.orchestra.run.smithi001.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-15T22:28:00.983 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-15T22:28:00.983 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.983 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.983 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.983 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.983 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.983 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.983 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.983 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.983 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.983 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.983 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.983 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.983 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_HOST": { 2024-09-15T22:28:00.984 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-15T22:28:00.984 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.984 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.984 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.984 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.984 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.984 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.984 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.984 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.984 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.984 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.984 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.984 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.985 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-15T22:28:00.985 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-15T22:28:00.985 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.985 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.985 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.985 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.985 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.985 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.985 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.985 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.985 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.985 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.985 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.985 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.986 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-15T22:28:00.986 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-15T22:28:00.986 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.986 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.986 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.986 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.986 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.986 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.986 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.986 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.986 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.986 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.986 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.987 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.987 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-15T22:28:00.987 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-15T22:28:00.987 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.987 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.987 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.987 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.987 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.987 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.987 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.987 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.987 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.988 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.988 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.988 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.988 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-15T22:28:00.988 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-15T22:28:00.988 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.988 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.988 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.988 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.988 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.988 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.988 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.988 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.989 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.989 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.989 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.989 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.989 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-15T22:28:00.989 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-15T22:28:00.989 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.989 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.989 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.989 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.989 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.989 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.989 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.989 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.990 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.990 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.990 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.990 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.990 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-15T22:28:00.990 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-15T22:28:00.990 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.990 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.990 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.990 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.990 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.990 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.990 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.991 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.991 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.991 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.991 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.991 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.991 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-15T22:28:00.991 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-15T22:28:00.991 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.991 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.991 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.991 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.991 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.991 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.991 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.992 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.992 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.992 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.992 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.992 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.992 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-15T22:28:00.992 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-15T22:28:00.992 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.992 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.992 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.992 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:00.992 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.992 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.992 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.993 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.993 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.993 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.993 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.993 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.993 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_ENABLED": { 2024-09-15T22:28:00.993 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-15T22:28:00.993 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:00.993 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.993 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.993 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:00.993 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.993 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.993 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.994 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.994 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.994 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.994 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.994 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.994 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-15T22:28:00.994 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-15T22:28:00.994 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.994 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.994 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.994 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-15T22:28:00.994 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.995 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.995 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.995 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.995 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.995 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.995 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.995 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.995 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-15T22:28:00.995 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-15T22:28:00.995 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.995 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.995 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.995 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-15T22:28:00.996 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.996 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.996 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.996 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.996 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.996 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.996 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.996 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.996 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-15T22:28:00.996 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-15T22:28:00.996 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.996 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.996 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.996 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8", 2024-09-15T22:28:00.997 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.997 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.997 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.997 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.997 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.997 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.997 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.997 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.997 INFO:teuthology.orchestra.run.smithi001.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-15T22:28:00.997 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-15T22:28:00.997 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:00.997 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.997 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.997 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "45", 2024-09-15T22:28:00.998 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.998 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.998 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.998 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.998 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.998 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.998 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.998 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.998 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ACCESS_KEY": { 2024-09-15T22:28:00.998 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-15T22:28:00.998 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.998 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.998 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:00.999 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:00.999 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:00.999 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:00.999 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:00.999 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:00.999 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:00.999 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:00.999 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:00.999 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:00.999 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-15T22:28:00.999 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-15T22:28:00.999 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:00.999 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:00.999 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.000 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-15T22:28:01.000 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.000 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.000 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.000 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.000 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.000 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.000 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.000 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.000 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SECRET_KEY": { 2024-09-15T22:28:01.000 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-15T22:28:01.000 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.000 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.001 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.001 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.001 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.001 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.001 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.001 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.001 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.001 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.001 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.001 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.001 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SSL_VERIFY": { 2024-09-15T22:28:01.001 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-15T22:28:01.001 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.001 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.002 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.002 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.002 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.002 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.002 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.002 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.002 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.002 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.002 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.002 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.002 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-15T22:28:01.002 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-15T22:28:01.002 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.003 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.003 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.003 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-15T22:28:01.003 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.003 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.003 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.003 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.003 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.003 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.003 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.003 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.003 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-15T22:28:01.003 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-15T22:28:01.003 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.003 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.004 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.004 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-15T22:28:01.004 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.004 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.004 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.004 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.004 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.004 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.004 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.004 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.004 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-15T22:28:01.004 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-15T22:28:01.004 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.005 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.005 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.005 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-15T22:28:01.005 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.005 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.005 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.005 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.005 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.005 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.005 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.005 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.005 INFO:teuthology.orchestra.run.smithi001.stdout: "cross_origin_url": { 2024-09-15T22:28:01.005 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cross_origin_url", 2024-09-15T22:28:01.005 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.006 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.006 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.006 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.006 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.006 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.006 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.006 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.006 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.006 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.006 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.006 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.006 INFO:teuthology.orchestra.run.smithi001.stdout: "crt_file": { 2024-09-15T22:28:01.006 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crt_file", 2024-09-15T22:28:01.006 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.007 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.007 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.007 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.007 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.007 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.007 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.007 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.007 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.007 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.007 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.007 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.007 INFO:teuthology.orchestra.run.smithi001.stdout: "debug": { 2024-09-15T22:28:01.007 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "debug", 2024-09-15T22:28:01.007 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.008 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.008 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.008 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.008 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.008 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.008 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.008 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable/disable debug options", 2024-09-15T22:28:01.008 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.008 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.008 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.008 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.008 INFO:teuthology.orchestra.run.smithi001.stdout: "jwt_token_ttl": { 2024-09-15T22:28:01.008 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "jwt_token_ttl", 2024-09-15T22:28:01.009 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.009 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.009 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.009 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "28800", 2024-09-15T22:28:01.009 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.009 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.009 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.009 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.009 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.009 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.009 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.009 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.009 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-15T22:28:01.009 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-15T22:28:01.010 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.010 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.010 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.010 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.010 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.010 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.010 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.010 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.010 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.010 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.010 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.010 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.010 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.010 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.011 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.011 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.011 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.011 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.011 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.011 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.011 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.011 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.011 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.011 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.011 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.011 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.011 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.011 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.011 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.012 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.012 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.012 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.012 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.012 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.012 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.012 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.012 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.012 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.012 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.012 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.012 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.012 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.013 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.013 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.013 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.013 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.013 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.013 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.013 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.013 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.013 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.013 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.013 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.013 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.013 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.013 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.014 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.014 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.014 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.014 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.014 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.014 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.014 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.014 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.014 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.014 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.014 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.014 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.014 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.014 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.015 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.015 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.015 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.015 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.015 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.015 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.015 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.015 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.015 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.015 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.015 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.015 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.015 INFO:teuthology.orchestra.run.smithi001.stdout: "motd": { 2024-09-15T22:28:01.015 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "motd", 2024-09-15T22:28:01.016 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.016 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.016 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.016 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.016 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.016 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.016 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.016 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "The message of the day", 2024-09-15T22:28:01.016 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.016 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.016 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.016 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.016 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect_resolve_ip_addr": { 2024-09-15T22:28:01.016 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "redirect_resolve_ip_addr", 2024-09-15T22:28:01.017 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.017 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.017 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.017 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.017 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.017 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.017 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.017 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.017 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.017 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.017 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.017 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.017 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-15T22:28:01.017 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-15T22:28:01.018 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.018 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.018 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.018 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-15T22:28:01.018 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.018 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.018 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.018 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.018 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.018 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.018 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.018 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.018 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-15T22:28:01.018 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-15T22:28:01.019 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.019 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.019 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.019 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8080", 2024-09-15T22:28:01.019 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.019 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.019 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.019 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.019 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.019 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.019 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.019 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.019 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-15T22:28:01.019 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-15T22:28:01.019 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.020 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.020 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.020 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.020 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.020 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.020 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.020 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.020 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.020 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.020 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.020 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.020 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl_server_port": { 2024-09-15T22:28:01.020 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl_server_port", 2024-09-15T22:28:01.020 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.021 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.021 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.021 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8443", 2024-09-15T22:28:01.021 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.021 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.021 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.021 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.021 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.021 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.021 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.021 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.021 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-15T22:28:01.021 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-15T22:28:01.021 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.022 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.022 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.022 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "redirect", 2024-09-15T22:28:01.022 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.022 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.022 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.022 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.022 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect" 2024-09-15T22:28:01.022 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.022 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.022 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.022 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.022 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.022 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.023 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-15T22:28:01.023 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-15T22:28:01.023 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.023 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.023 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.023 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-15T22:28:01.023 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-15T22:28:01.023 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-15T22:28:01.023 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.023 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.023 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.023 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.023 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.024 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.024 INFO:teuthology.orchestra.run.smithi001.stdout: "url_prefix": { 2024-09-15T22:28:01.024 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url_prefix", 2024-09-15T22:28:01.024 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.024 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.024 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.024 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.024 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.024 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.024 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.024 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.024 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.024 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.025 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.025 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.025 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.025 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.025 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.025 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "devicehealth", 2024-09-15T22:28:01.025 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.025 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.025 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.025 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_monitoring": { 2024-09-15T22:28:01.025 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_monitoring", 2024-09-15T22:28:01.025 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.025 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.025 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.026 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.026 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.026 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.026 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.026 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "monitor device health metrics", 2024-09-15T22:28:01.026 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.026 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.026 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.026 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.026 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.026 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.026 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.026 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.027 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.027 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.027 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.027 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.027 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.027 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.027 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.027 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.027 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.027 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.027 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.027 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.027 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.027 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.028 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.028 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.028 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.028 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.028 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.028 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.028 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.028 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.028 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.028 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.028 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.028 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.028 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.029 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.029 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.029 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.029 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.029 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.029 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.029 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.029 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.029 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.029 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.029 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.029 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.029 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.029 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.030 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.030 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.030 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.030 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.030 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.030 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.030 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.030 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.030 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.030 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.030 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.030 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.030 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.030 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.031 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.031 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.031 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.031 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.031 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.031 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.031 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.031 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.031 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.031 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.031 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.031 INFO:teuthology.orchestra.run.smithi001.stdout: "mark_out_threshold": { 2024-09-15T22:28:01.031 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mark_out_threshold", 2024-09-15T22:28:01.031 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:01.032 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.032 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.032 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2419200", 2024-09-15T22:28:01.032 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.032 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.032 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.032 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-15T22:28:01.032 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.032 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.032 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.032 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.032 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": { 2024-09-15T22:28:01.032 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_name", 2024-09-15T22:28:01.033 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.033 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.033 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.033 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "device_health_metrics", 2024-09-15T22:28:01.033 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.033 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.033 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.033 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-15T22:28:01.033 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.033 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.033 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.033 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.033 INFO:teuthology.orchestra.run.smithi001.stdout: "retention_period": { 2024-09-15T22:28:01.034 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retention_period", 2024-09-15T22:28:01.034 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:01.034 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.034 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.034 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15552000", 2024-09-15T22:28:01.034 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.034 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.034 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.034 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain device health metrics", 2024-09-15T22:28:01.034 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.034 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.034 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.034 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.034 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_frequency": { 2024-09-15T22:28:01.034 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_frequency", 2024-09-15T22:28:01.035 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:01.035 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.035 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.035 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-15T22:28:01.035 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.035 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.035 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.035 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-15T22:28:01.035 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.035 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.035 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.035 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.035 INFO:teuthology.orchestra.run.smithi001.stdout: "self_heal": { 2024-09-15T22:28:01.036 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "self_heal", 2024-09-15T22:28:01.036 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.036 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.036 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.036 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.036 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.036 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.036 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.036 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-15T22:28:01.036 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.036 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.036 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.037 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.037 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-15T22:28:01.037 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-15T22:28:01.037 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:01.037 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.037 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.037 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-15T22:28:01.037 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.037 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.037 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.037 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and check device health", 2024-09-15T22:28:01.037 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.037 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.038 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.038 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.038 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_threshold": { 2024-09-15T22:28:01.038 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_threshold", 2024-09-15T22:28:01.038 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:01.038 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.038 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.038 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7257600", 2024-09-15T22:28:01.038 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.038 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.038 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.038 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-15T22:28:01.038 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.039 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.039 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.039 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.039 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.039 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.039 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.039 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "diskprediction_local", 2024-09-15T22:28:01.039 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.039 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.039 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.039 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.039 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.039 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.039 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.039 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.040 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.040 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.040 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.040 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.040 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.040 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.040 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.040 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.040 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.040 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.040 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.040 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.040 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.041 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.041 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.041 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.041 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.041 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.041 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.041 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.041 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.041 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.041 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.041 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.041 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.042 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.042 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.042 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.042 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.042 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.042 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.042 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.042 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.042 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.042 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.042 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.042 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.042 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.043 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.043 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.043 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.043 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.043 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.043 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.043 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.043 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.043 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.043 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.043 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.043 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.043 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.044 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.044 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.044 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.044 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.044 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.044 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.044 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.044 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.044 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.044 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.044 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.044 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.044 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.045 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.045 INFO:teuthology.orchestra.run.smithi001.stdout: "predict_interval": { 2024-09-15T22:28:01.045 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predict_interval", 2024-09-15T22:28:01.045 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.045 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.045 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.045 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-15T22:28:01.045 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.045 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.045 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.045 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.045 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.045 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.045 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.046 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.046 INFO:teuthology.orchestra.run.smithi001.stdout: "predictor_model": { 2024-09-15T22:28:01.046 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predictor_model", 2024-09-15T22:28:01.046 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.046 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.046 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.046 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "prophetstor", 2024-09-15T22:28:01.046 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.046 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.046 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.046 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.046 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.046 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.046 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.046 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.047 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-15T22:28:01.047 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-15T22:28:01.047 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.047 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.047 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.047 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-15T22:28:01.047 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.047 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.047 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.047 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.047 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.047 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.048 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.048 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.048 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.048 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.048 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.048 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "influx", 2024-09-15T22:28:01.048 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": false, 2024-09-15T22:28:01.048 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "influxdb python module not found", 2024-09-15T22:28:01.048 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.048 INFO:teuthology.orchestra.run.smithi001.stdout: "batch_size": { 2024-09-15T22:28:01.048 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "batch_size", 2024-09-15T22:28:01.048 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.048 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.049 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.049 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5000", 2024-09-15T22:28:01.049 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.049 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.049 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.049 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-15T22:28:01.049 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.049 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.049 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.049 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.049 INFO:teuthology.orchestra.run.smithi001.stdout: "database": { 2024-09-15T22:28:01.049 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "database", 2024-09-15T22:28:01.049 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.050 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.050 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.050 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "ceph", 2024-09-15T22:28:01.050 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.050 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.050 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.050 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-15T22:28:01.050 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.050 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.050 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.050 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.050 INFO:teuthology.orchestra.run.smithi001.stdout: "hostname": { 2024-09-15T22:28:01.050 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hostname", 2024-09-15T22:28:01.051 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.051 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.051 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.051 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.051 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.051 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.051 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.051 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server hostname", 2024-09-15T22:28:01.051 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.051 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.051 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.051 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.051 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-15T22:28:01.051 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-15T22:28:01.052 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:01.052 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.052 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.052 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "30", 2024-09-15T22:28:01.052 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "5", 2024-09-15T22:28:01.052 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.052 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.052 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-15T22:28:01.052 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.052 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.052 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.052 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.052 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.052 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.053 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.053 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.053 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.053 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.053 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.053 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.053 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.053 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.053 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.053 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.053 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.053 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.053 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.054 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.054 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.054 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.054 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.054 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.054 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.054 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.054 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.054 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.054 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.054 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.054 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.054 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.054 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.055 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.055 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.055 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.055 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.055 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.055 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.055 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.055 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.055 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.055 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.055 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.055 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.055 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.055 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.056 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.056 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.056 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.056 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.056 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.056 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.056 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.056 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.056 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.056 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.056 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.056 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.056 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.056 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.057 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.057 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.057 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.057 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.057 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.057 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.057 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.057 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.057 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.057 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.057 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.057 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.057 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.057 INFO:teuthology.orchestra.run.smithi001.stdout: "password": { 2024-09-15T22:28:01.058 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "password", 2024-09-15T22:28:01.058 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.058 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.058 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.058 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.058 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.058 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.058 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.058 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "password of InfluxDB server user", 2024-09-15T22:28:01.058 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.058 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.058 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.058 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.058 INFO:teuthology.orchestra.run.smithi001.stdout: "port": { 2024-09-15T22:28:01.058 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "port", 2024-09-15T22:28:01.059 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.059 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.059 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.059 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8086", 2024-09-15T22:28:01.059 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.059 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.059 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.059 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server port", 2024-09-15T22:28:01.059 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.059 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.059 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.059 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.059 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-15T22:28:01.059 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-15T22:28:01.059 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.060 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.060 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.060 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "false", 2024-09-15T22:28:01.060 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.060 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.060 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.060 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T22:28:01.060 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.060 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.060 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.060 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.060 INFO:teuthology.orchestra.run.smithi001.stdout: "threads": { 2024-09-15T22:28:01.060 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threads", 2024-09-15T22:28:01.060 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.061 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.061 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.061 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-15T22:28:01.061 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-15T22:28:01.061 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "32", 2024-09-15T22:28:01.061 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.061 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-15T22:28:01.061 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.061 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.061 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.061 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.061 INFO:teuthology.orchestra.run.smithi001.stdout: "username": { 2024-09-15T22:28:01.061 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "username", 2024-09-15T22:28:01.061 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.062 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.062 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.062 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.062 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.062 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.062 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.062 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "username of InfluxDB server user", 2024-09-15T22:28:01.062 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.062 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.062 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.062 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.062 INFO:teuthology.orchestra.run.smithi001.stdout: "verify_ssl": { 2024-09-15T22:28:01.062 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "verify_ssl", 2024-09-15T22:28:01.062 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.063 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.063 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.063 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "true", 2024-09-15T22:28:01.063 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.063 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.063 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.063 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T22:28:01.063 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.063 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.063 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.063 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.063 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.063 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.063 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.064 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "insights", 2024-09-15T22:28:01.064 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.064 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.064 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.064 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.064 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.064 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.064 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.064 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.064 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.064 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.064 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.064 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.065 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.065 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.065 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.065 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.065 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.065 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.065 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.065 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.065 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.065 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.065 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.065 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.065 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.065 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.065 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.066 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.066 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.066 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.066 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.066 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.066 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.066 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.066 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.066 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.066 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.066 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.066 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.066 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.067 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.067 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.067 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.067 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.067 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.067 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.067 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.067 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.067 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.067 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.067 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.067 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.067 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.067 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.068 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.068 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.068 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.068 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.068 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.068 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.068 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.068 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.068 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.068 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.068 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.068 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.069 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.069 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.069 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.069 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.069 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.069 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.069 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.069 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.069 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.069 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.069 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "iostat", 2024-09-15T22:28:01.069 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.069 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.070 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.070 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.070 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.070 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.070 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.070 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.070 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.070 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.070 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.070 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.070 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.070 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.070 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.071 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.071 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.071 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.071 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.071 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.071 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.071 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.071 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.071 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.071 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.071 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.071 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.071 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.071 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.072 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.072 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.072 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.072 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.072 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.072 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.072 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.072 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.072 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.072 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.072 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.073 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.073 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.073 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.073 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.073 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.073 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.073 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.073 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.073 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.073 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.073 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.073 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.073 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.073 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.074 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.074 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.074 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.074 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.074 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.074 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.074 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.074 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.074 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.074 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.074 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.074 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.074 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.074 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.075 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.075 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.075 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.075 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.075 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.075 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.075 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.075 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.075 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "k8sevents", 2024-09-15T22:28:01.075 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.075 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.075 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.075 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_event_retention_days": { 2024-09-15T22:28:01.075 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ceph_event_retention_days", 2024-09-15T22:28:01.075 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.076 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.076 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.076 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7", 2024-09-15T22:28:01.076 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.076 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.076 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.076 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-15T22:28:01.076 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.076 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.076 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.076 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.076 INFO:teuthology.orchestra.run.smithi001.stdout: "config_check_secs": { 2024-09-15T22:28:01.076 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_check_secs", 2024-09-15T22:28:01.076 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.077 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.077 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.077 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-15T22:28:01.077 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "10", 2024-09-15T22:28:01.077 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.077 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.077 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-15T22:28:01.077 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.077 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.077 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.077 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.077 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.077 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.078 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.078 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.078 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.078 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.078 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.078 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.078 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.078 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.078 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.078 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.078 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.078 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.078 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.078 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.078 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.079 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.079 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.079 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.079 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.079 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.079 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.079 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.079 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.079 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.079 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.079 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.079 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.079 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.080 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.080 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.080 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.080 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.080 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.080 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.080 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.080 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.080 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.080 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.080 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.080 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.080 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.080 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.081 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.081 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.081 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.081 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.081 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.081 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.081 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.081 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.081 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.081 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.081 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.081 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.081 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.082 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.082 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.082 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.082 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.082 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.082 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.082 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.082 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.082 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.082 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.082 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.082 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.083 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.083 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.083 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.083 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.083 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "localpool", 2024-09-15T22:28:01.083 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.083 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.083 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.083 INFO:teuthology.orchestra.run.smithi001.stdout: "failure_domain": { 2024-09-15T22:28:01.083 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "failure_domain", 2024-09-15T22:28:01.083 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.083 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.083 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.083 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "host", 2024-09-15T22:28:01.084 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.084 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.084 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.084 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "failure domain for any created local pool", 2024-09-15T22:28:01.084 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-15T22:28:01.084 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.084 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.084 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.084 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.084 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.084 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.084 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.084 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.085 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.085 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.085 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.085 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.085 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.085 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.085 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.085 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.085 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.085 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.085 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.085 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.085 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.086 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.086 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.086 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.086 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.086 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.086 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.086 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.086 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.086 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.086 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.086 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.086 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.086 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.086 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.087 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.087 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.087 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.087 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.087 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.087 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.087 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.087 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.087 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.087 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.087 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.087 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.087 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.087 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.087 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.088 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.088 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.088 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.088 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.088 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.088 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.088 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.088 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.088 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.088 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.088 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.088 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.088 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.089 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.089 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.089 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.089 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.089 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.089 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.089 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.089 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.089 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.089 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.089 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": { 2024-09-15T22:28:01.089 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_size", 2024-09-15T22:28:01.089 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.089 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.090 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.090 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.090 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.090 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.090 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.090 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default min_size for any created local pool", 2024-09-15T22:28:01.090 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-15T22:28:01.090 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.090 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.090 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.090 INFO:teuthology.orchestra.run.smithi001.stdout: "num_rep": { 2024-09-15T22:28:01.090 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "num_rep", 2024-09-15T22:28:01.090 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.091 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.091 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.091 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3", 2024-09-15T22:28:01.091 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.091 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.091 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.091 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default replica count for any created local pool", 2024-09-15T22:28:01.091 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.091 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.091 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.091 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.092 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": { 2024-09-15T22:28:01.092 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_num", 2024-09-15T22:28:01.092 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.092 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.092 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.092 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "128", 2024-09-15T22:28:01.092 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.092 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.092 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.092 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default pg_num for any created local pool", 2024-09-15T22:28:01.092 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.092 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.092 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.093 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.093 INFO:teuthology.orchestra.run.smithi001.stdout: "prefix": { 2024-09-15T22:28:01.093 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prefix", 2024-09-15T22:28:01.093 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.093 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.093 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.093 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.093 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.093 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.093 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.093 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name prefix for any created local pool", 2024-09-15T22:28:01.093 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.093 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.094 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.094 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.094 INFO:teuthology.orchestra.run.smithi001.stdout: "subtree": { 2024-09-15T22:28:01.094 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "subtree", 2024-09-15T22:28:01.094 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.094 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.094 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.094 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "rack", 2024-09-15T22:28:01.094 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.094 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.094 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.094 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-15T22:28:01.094 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-15T22:28:01.095 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.095 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.095 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.095 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.095 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.095 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.095 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mds_autoscaler", 2024-09-15T22:28:01.095 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.095 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.095 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.095 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.095 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.095 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.095 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.096 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.096 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.096 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.096 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.096 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.096 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.096 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.096 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.096 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.096 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.096 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.096 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.096 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.097 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.097 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.097 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.097 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.097 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.097 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.097 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.097 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.097 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.097 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.097 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.097 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.097 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.097 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.098 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.098 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.098 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.098 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.098 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.098 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.098 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.098 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.098 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.098 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.098 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.098 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.098 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.099 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.099 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.099 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.099 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.099 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.099 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.099 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.099 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.099 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.099 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.099 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.099 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.100 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.100 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.100 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.100 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.100 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.100 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.100 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.100 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.100 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.100 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.100 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.100 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.100 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.101 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.101 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.101 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.101 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.101 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirroring", 2024-09-15T22:28:01.101 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.101 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.101 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.101 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.101 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.101 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.101 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.101 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.102 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.102 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.102 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.102 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.102 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.102 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.102 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.102 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.102 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.102 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.102 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.102 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.102 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.102 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.102 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.103 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.103 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.103 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.103 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.103 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.103 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.103 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.103 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.103 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.103 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.103 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.103 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.103 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.103 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.104 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.104 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.104 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.104 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.104 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.104 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.104 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.104 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.104 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.104 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.104 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.104 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.104 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.105 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.105 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.105 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.105 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.105 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.105 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.105 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.105 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.105 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.105 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.105 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.105 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.105 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.106 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.106 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.106 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.106 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.106 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.106 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.106 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.106 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.106 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.106 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.106 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.106 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.106 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.107 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "nfs", 2024-09-15T22:28:01.107 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.107 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.107 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.107 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.107 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.107 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.107 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.107 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.107 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.107 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.107 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.107 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.107 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.108 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.108 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.108 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.108 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.108 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.108 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.108 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.108 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.108 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.108 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.108 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.108 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.109 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.109 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.109 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.109 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.109 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.109 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.109 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.109 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.109 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.109 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.109 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.109 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.109 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.109 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.110 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.110 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.110 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.110 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.110 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.110 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.110 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.110 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.110 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.110 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.110 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.110 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.110 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.110 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.111 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.111 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.111 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.111 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.111 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.111 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.111 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.111 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.111 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.111 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.111 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.111 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.111 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.111 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.111 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.112 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.112 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.112 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.112 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.112 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.112 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.112 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.112 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.112 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-15T22:28:01.112 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.112 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.112 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.112 INFO:teuthology.orchestra.run.smithi001.stdout: "fail_fs": { 2024-09-15T22:28:01.113 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "fail_fs", 2024-09-15T22:28:01.113 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.113 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.113 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.113 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.113 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.113 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.113 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.113 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-15T22:28:01.113 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.113 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.113 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.113 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.113 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.114 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.114 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.114 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.114 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.114 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.114 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.114 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.114 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.114 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.114 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.114 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.114 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.114 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.114 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.114 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.115 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.115 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.115 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.115 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.115 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.115 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.115 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.115 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.115 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.115 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.115 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.115 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.115 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.115 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.115 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.116 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.116 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.116 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.116 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.116 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.116 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.116 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.116 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.116 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.116 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.116 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.116 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.116 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.116 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.116 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.117 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.117 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.117 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.117 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.117 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.117 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.117 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.117 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.117 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.117 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.117 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.117 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.117 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.117 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.118 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.118 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.118 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.118 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.118 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.118 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.118 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.118 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.118 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.118 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.118 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator": { 2024-09-15T22:28:01.118 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-15T22:28:01.118 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.118 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.119 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.119 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.119 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.119 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.119 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.119 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm", 2024-09-15T22:28:01.119 INFO:teuthology.orchestra.run.smithi001.stdout: "rook", 2024-09-15T22:28:01.119 INFO:teuthology.orchestra.run.smithi001.stdout: "test_orchestrator" 2024-09-15T22:28:01.119 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.119 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Orchestrator backend", 2024-09-15T22:28:01.119 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.119 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.119 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.119 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.119 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.119 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.120 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.120 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_perf_query", 2024-09-15T22:28:01.120 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.120 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.120 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.120 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.120 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.120 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.120 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.120 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.120 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.120 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.120 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.120 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.121 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.121 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.121 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.121 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.121 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.121 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.121 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.121 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.121 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.121 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.121 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.121 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.121 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.122 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.122 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.122 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.122 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.122 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.122 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.122 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.122 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.122 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.122 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.122 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.122 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.122 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.122 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.123 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.123 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.123 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.123 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.123 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.123 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.123 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.123 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.123 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.123 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.123 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.123 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.123 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.123 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.124 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.124 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.124 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.124 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.124 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.124 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.124 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.124 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.124 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.124 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.124 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.124 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.124 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.125 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.125 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.125 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.125 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.125 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.125 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.125 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.125 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.125 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.125 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.125 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_support", 2024-09-15T22:28:01.125 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.125 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.125 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.126 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.126 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.126 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.126 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.126 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.126 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.126 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.126 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.126 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.126 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.126 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.126 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.126 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.126 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.126 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.127 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.127 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.127 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.127 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.127 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.127 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.127 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.127 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.127 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.127 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.127 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.127 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.127 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.128 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.128 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.128 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.128 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.128 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.128 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.128 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.128 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.128 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.128 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.128 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.128 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.128 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.128 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.129 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.129 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.129 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.129 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.129 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.129 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.129 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.129 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.129 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.129 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.129 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.129 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.129 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.129 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.129 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.130 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.130 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.130 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.130 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.130 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.130 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.130 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.130 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.130 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.130 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.130 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.130 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.130 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.130 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.130 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.130 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.131 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_autoscaler", 2024-09-15T22:28:01.131 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.131 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.131 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.131 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.131 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.131 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.131 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.131 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.131 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.131 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.131 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.131 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.131 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.131 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.132 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.132 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.132 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.132 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.132 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.132 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.132 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.132 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.132 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.132 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.132 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.132 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.132 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.132 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.132 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.133 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.133 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.133 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.133 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.133 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.133 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.133 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.133 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.133 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.133 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.133 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.133 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.133 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.134 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.134 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.134 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.134 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.134 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.134 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.134 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.134 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.134 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.134 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.134 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.134 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.134 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.135 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.135 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.135 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.135 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.135 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.135 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.135 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.135 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.135 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.135 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.135 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.135 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.135 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.136 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.136 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.136 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.136 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.136 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.136 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-15T22:28:01.136 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-15T22:28:01.136 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:01.136 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.136 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.136 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-15T22:28:01.136 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.136 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.136 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.137 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.137 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.137 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.137 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.137 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.137 INFO:teuthology.orchestra.run.smithi001.stdout: "threshold": { 2024-09-15T22:28:01.137 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threshold", 2024-09-15T22:28:01.137 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-15T22:28:01.137 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.137 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.137 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-15T22:28:01.137 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1.0", 2024-09-15T22:28:01.138 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.138 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.138 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "scaling threshold", 2024-09-15T22:28:01.138 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-15T22:28:01.138 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.138 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.138 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.138 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.138 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.138 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.138 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "progress", 2024-09-15T22:28:01.138 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.138 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.139 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.139 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_pg_recovery_event": { 2024-09-15T22:28:01.139 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_pg_recovery_event", 2024-09-15T22:28:01.139 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.139 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.139 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.139 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.139 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.139 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.139 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.139 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-15T22:28:01.139 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.139 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.140 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.140 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.140 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-15T22:28:01.140 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-15T22:28:01.140 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.140 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.140 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.140 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.140 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.140 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.140 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.140 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.140 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.140 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.141 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.141 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.141 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.141 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.141 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.141 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.141 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.141 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.141 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.141 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.141 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.141 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.141 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.142 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.142 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.142 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.142 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.142 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.142 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.142 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.142 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.142 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.142 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.142 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.142 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.142 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.142 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.143 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.143 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.143 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.143 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.143 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.143 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.143 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.143 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.143 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.143 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.143 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.143 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.143 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.144 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.144 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.144 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.144 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.144 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.144 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.144 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.144 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.144 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.144 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.144 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.144 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.144 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.145 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.145 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.145 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.145 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.145 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.145 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.145 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.145 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.145 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.145 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.145 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.145 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.145 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.145 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.146 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.146 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.146 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.146 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.146 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.146 INFO:teuthology.orchestra.run.smithi001.stdout: "max_completed_events": { 2024-09-15T22:28:01.146 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_completed_events", 2024-09-15T22:28:01.146 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.146 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.146 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.146 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "50", 2024-09-15T22:28:01.146 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.146 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.146 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.146 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "number of past completed events to remember", 2024-09-15T22:28:01.147 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.147 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.147 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.147 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.147 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-15T22:28:01.147 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-15T22:28:01.147 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:01.147 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.147 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.147 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-15T22:28:01.147 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.147 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.147 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.147 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long the module is going to sleep", 2024-09-15T22:28:01.147 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.147 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.148 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.148 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.148 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.148 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.148 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.148 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus", 2024-09-15T22:28:01.148 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.148 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.148 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.148 INFO:teuthology.orchestra.run.smithi001.stdout: "cache": { 2024-09-15T22:28:01.148 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cache", 2024-09-15T22:28:01.148 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.148 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.149 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.149 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.149 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.149 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.149 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.149 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.149 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.149 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.149 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.149 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.149 INFO:teuthology.orchestra.run.smithi001.stdout: "exclude_perf_counters": { 2024-09-15T22:28:01.149 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "exclude_perf_counters", 2024-09-15T22:28:01.149 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.149 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.149 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.150 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.150 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.150 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.150 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.150 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-15T22:28:01.150 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-15T22:28:01.150 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.150 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.150 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.150 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.150 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.150 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.150 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.150 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.150 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.150 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.151 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.151 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.151 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.151 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.151 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.151 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.151 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.151 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.151 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.151 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.151 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.151 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.151 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.151 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.152 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.152 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.152 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.152 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.152 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.152 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.152 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.152 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.152 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.152 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.152 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.152 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.152 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.153 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.153 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.153 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.153 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.153 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.153 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.153 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.153 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.153 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.153 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.153 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.153 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.153 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.153 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.153 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.154 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.154 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.154 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.154 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.154 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.154 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.154 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.154 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.154 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.154 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.154 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.154 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.154 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.154 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.155 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.155 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.155 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.155 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.155 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.155 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.155 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.155 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools": { 2024-09-15T22:28:01.155 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools", 2024-09-15T22:28:01.155 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.155 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.155 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.155 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.155 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.156 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.156 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.156 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.156 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.156 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.156 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.156 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.156 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-15T22:28:01.156 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-15T22:28:01.156 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.156 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.156 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.156 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "300", 2024-09-15T22:28:01.156 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.157 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.157 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.157 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.157 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.157 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.157 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.157 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.157 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_interval": { 2024-09-15T22:28:01.157 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_interval", 2024-09-15T22:28:01.157 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-15T22:28:01.157 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.157 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.157 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15.0", 2024-09-15T22:28:01.157 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.157 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.158 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.158 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.158 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.158 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.158 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.158 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.158 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-15T22:28:01.158 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-15T22:28:01.158 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.158 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.158 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.158 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-15T22:28:01.158 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.158 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.159 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.159 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-15T22:28:01.159 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.159 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.159 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.159 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.159 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-15T22:28:01.159 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-15T22:28:01.159 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.159 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.159 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.159 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "9283", 2024-09-15T22:28:01.159 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.159 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.160 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.160 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-15T22:28:01.160 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.160 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.160 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.160 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.160 INFO:teuthology.orchestra.run.smithi001.stdout: "stale_cache_strategy": { 2024-09-15T22:28:01.160 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stale_cache_strategy", 2024-09-15T22:28:01.160 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.160 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.160 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.161 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "log", 2024-09-15T22:28:01.161 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.161 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.161 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.161 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.161 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.161 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.161 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.161 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.161 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-15T22:28:01.161 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-15T22:28:01.161 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.161 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.162 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.162 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "default", 2024-09-15T22:28:01.162 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.162 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.162 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.162 INFO:teuthology.orchestra.run.smithi001.stdout: "default", 2024-09-15T22:28:01.162 INFO:teuthology.orchestra.run.smithi001.stdout: "error" 2024-09-15T22:28:01.162 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.162 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.162 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.162 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.162 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.162 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.162 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-15T22:28:01.163 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-15T22:28:01.163 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.163 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.163 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.163 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-15T22:28:01.163 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-15T22:28:01.163 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-15T22:28:01.163 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.163 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.163 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.163 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.163 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.163 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.164 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.164 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.164 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.164 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_support", 2024-09-15T22:28:01.164 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.164 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.164 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.164 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.164 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.164 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.164 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.164 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.164 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.164 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.165 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.165 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.165 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.165 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.165 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.165 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.165 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.165 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.165 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.165 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.165 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.165 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.165 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.165 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.166 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.166 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.166 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.166 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.166 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.166 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.166 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.166 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.166 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.166 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.166 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.166 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.166 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.167 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.167 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.167 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.167 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.167 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.167 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.167 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.167 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.167 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.167 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.167 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.167 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.167 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.168 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.168 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.168 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.168 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.168 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.168 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.168 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.168 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.168 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.168 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.168 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.168 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.169 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.169 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.169 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.169 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.169 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.169 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.169 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.169 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.169 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.169 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.169 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.169 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_snap_create": { 2024-09-15T22:28:01.169 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_snap_create", 2024-09-15T22:28:01.170 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.170 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.170 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.170 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-15T22:28:01.170 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.170 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.170 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.170 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.170 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.170 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.170 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.170 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.170 INFO:teuthology.orchestra.run.smithi001.stdout: "mirror_snapshot_schedule": { 2024-09-15T22:28:01.170 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirror_snapshot_schedule", 2024-09-15T22:28:01.171 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.171 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.171 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.171 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.171 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.171 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.171 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.171 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.171 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.171 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.171 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.171 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.171 INFO:teuthology.orchestra.run.smithi001.stdout: "trash_purge_schedule": { 2024-09-15T22:28:01.171 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "trash_purge_schedule", 2024-09-15T22:28:01.172 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.172 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.172 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.172 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.172 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.172 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.172 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.172 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.172 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.172 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.172 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.172 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.172 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.172 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.173 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.173 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "restful", 2024-09-15T22:28:01.173 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.173 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.173 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.173 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_auth": { 2024-09-15T22:28:01.173 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_auth", 2024-09-15T22:28:01.173 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.173 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.173 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.173 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.173 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.173 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.173 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.174 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.174 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.174 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.174 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.174 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.174 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-15T22:28:01.174 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-15T22:28:01.174 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.174 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.174 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.174 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.174 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.174 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.175 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.175 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.175 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.175 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.175 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.175 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.175 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.175 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.175 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.175 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.175 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.175 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.175 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.176 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.176 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.176 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.176 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.176 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.176 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.176 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.176 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.176 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.176 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.176 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.176 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.176 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.177 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.177 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.177 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.177 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.177 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.177 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.177 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.177 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.177 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.177 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.177 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.177 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.177 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.177 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.178 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.178 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.178 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.178 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.178 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.178 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.178 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.178 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.178 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.178 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.178 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.178 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.178 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.178 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.179 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.179 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.179 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.179 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.179 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.179 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.179 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.179 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.179 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.179 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.179 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.179 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.179 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.179 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.180 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.180 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.180 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.180 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.180 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.180 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.180 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.180 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.180 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-15T22:28:01.180 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-15T22:28:01.180 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.180 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.180 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.181 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.181 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.181 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.181 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.181 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.181 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.181 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.181 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.181 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.181 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-15T22:28:01.181 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-15T22:28:01.181 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.181 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.182 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.182 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.182 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.182 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.182 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.182 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.182 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.182 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.182 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.182 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.182 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.182 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.182 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.183 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rgw", 2024-09-15T22:28:01.183 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.183 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.183 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.183 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.183 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.183 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.183 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.183 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.183 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.183 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.183 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.183 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.183 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.184 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.184 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.184 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.184 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.184 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.184 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.184 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.184 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.184 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.184 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.184 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.184 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.185 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.185 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.185 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.185 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.185 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.185 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.185 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.185 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.185 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.185 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.185 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.185 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.185 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.185 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.185 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.186 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.186 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.186 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.186 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.186 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.186 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.186 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.186 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.186 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.186 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.186 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.186 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.186 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.187 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.187 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.187 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.187 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.187 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.187 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.187 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.187 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.187 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.187 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.187 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.187 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.187 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.188 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.188 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.188 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.188 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.188 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.188 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.188 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.188 INFO:teuthology.orchestra.run.smithi001.stdout: "secondary_zone_period_retry_limit": { 2024-09-15T22:28:01.188 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-15T22:28:01.188 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.188 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.188 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.188 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-15T22:28:01.188 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.188 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.189 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.189 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-15T22:28:01.189 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.189 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.189 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.189 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.189 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.189 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.189 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.189 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rook", 2024-09-15T22:28:01.189 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.189 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.189 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.190 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.190 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.190 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.190 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.190 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.190 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.190 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.190 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.190 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.190 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.190 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.190 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.190 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.190 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.191 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.191 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.191 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.191 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.191 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.191 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.191 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.191 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.191 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.191 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.191 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.191 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.191 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.192 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.192 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.192 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.192 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.192 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.192 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.192 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.192 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.192 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.192 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.192 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.192 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.192 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.192 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.192 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.193 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.193 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.193 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.193 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.193 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.193 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.193 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.193 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.193 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.193 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.193 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.193 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.193 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.193 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.194 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.194 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.194 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.194 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.194 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.194 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.194 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.194 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.194 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.194 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.194 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.194 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.194 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.194 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.194 INFO:teuthology.orchestra.run.smithi001.stdout: "storage_class": { 2024-09-15T22:28:01.195 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "storage_class", 2024-09-15T22:28:01.195 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.195 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.195 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.195 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "local", 2024-09-15T22:28:01.195 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.195 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.195 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.195 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-15T22:28:01.195 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.195 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.195 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.195 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.195 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.195 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.195 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.196 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "selftest", 2024-09-15T22:28:01.196 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.196 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.196 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.196 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.196 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.196 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.196 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.196 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.196 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.196 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.196 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.196 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.197 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.197 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.197 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.197 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.197 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.197 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.197 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.197 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.197 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.197 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.197 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.197 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.197 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.198 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.198 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.198 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.198 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.198 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.198 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.198 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.198 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.198 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.198 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.198 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.198 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.198 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.199 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.199 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.199 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.199 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.199 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.199 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.199 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.199 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.199 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.199 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.199 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.199 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.199 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.200 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.200 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.200 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.200 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.200 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.200 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.200 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.200 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.200 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.200 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.200 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.200 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.200 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.200 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.201 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.201 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.201 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.201 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.201 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.201 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.201 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.201 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.201 INFO:teuthology.orchestra.run.smithi001.stdout: "roption1": { 2024-09-15T22:28:01.201 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption1", 2024-09-15T22:28:01.201 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.201 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.201 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.201 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.202 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.202 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.202 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.202 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.202 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.202 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.202 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.202 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.202 INFO:teuthology.orchestra.run.smithi001.stdout: "roption2": { 2024-09-15T22:28:01.202 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption2", 2024-09-15T22:28:01.202 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.202 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.202 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.202 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "xyz", 2024-09-15T22:28:01.203 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.203 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.203 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.203 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.203 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.203 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.203 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.203 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.203 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption1": { 2024-09-15T22:28:01.203 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption1", 2024-09-15T22:28:01.203 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.203 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.203 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.204 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.204 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.204 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.204 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.204 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.204 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.204 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.204 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.204 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.204 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption2": { 2024-09-15T22:28:01.204 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption2", 2024-09-15T22:28:01.204 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.204 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.204 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.205 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.205 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.205 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.205 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.205 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.205 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.205 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.205 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.205 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.205 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption3": { 2024-09-15T22:28:01.205 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption3", 2024-09-15T22:28:01.205 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-15T22:28:01.205 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.205 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.206 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.206 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.206 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.206 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.206 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.206 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.206 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.206 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.206 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.206 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption4": { 2024-09-15T22:28:01.206 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption4", 2024-09-15T22:28:01.206 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.206 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.206 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.207 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.207 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.207 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.207 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.207 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.207 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.207 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.207 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.207 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.207 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption5": { 2024-09-15T22:28:01.207 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption5", 2024-09-15T22:28:01.207 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.207 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.208 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.208 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.208 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.208 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.208 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.208 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.208 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.208 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.208 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.208 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.208 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption6": { 2024-09-15T22:28:01.208 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption6", 2024-09-15T22:28:01.208 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.209 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.209 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.209 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.209 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.209 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.209 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.209 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.209 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.209 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.209 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.209 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.209 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption7": { 2024-09-15T22:28:01.209 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption7", 2024-09-15T22:28:01.209 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.210 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.210 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.210 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.210 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-15T22:28:01.210 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "42", 2024-09-15T22:28:01.210 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.210 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.210 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.210 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.210 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.210 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.210 INFO:teuthology.orchestra.run.smithi001.stdout: "testkey": { 2024-09-15T22:28:01.210 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testkey", 2024-09-15T22:28:01.211 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.211 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.211 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.211 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.211 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.211 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.211 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.211 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.211 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.211 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.211 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.211 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.211 INFO:teuthology.orchestra.run.smithi001.stdout: "testlkey": { 2024-09-15T22:28:01.211 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testlkey", 2024-09-15T22:28:01.211 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.212 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.212 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.212 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.212 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.212 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.212 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.212 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.212 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.212 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.212 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.212 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.212 INFO:teuthology.orchestra.run.smithi001.stdout: "testnewline": { 2024-09-15T22:28:01.212 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testnewline", 2024-09-15T22:28:01.213 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.213 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.213 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.213 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.213 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.213 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.213 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.213 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.213 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.213 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.213 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.213 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.213 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.213 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.214 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.214 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snap_schedule", 2024-09-15T22:28:01.214 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.214 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.214 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.214 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_m_granularity": { 2024-09-15T22:28:01.214 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_m_granularity", 2024-09-15T22:28:01.214 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.214 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.214 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.214 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.214 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.214 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.214 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.215 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow minute scheduled snapshots", 2024-09-15T22:28:01.215 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.215 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.215 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.215 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.215 INFO:teuthology.orchestra.run.smithi001.stdout: "dump_on_update": { 2024-09-15T22:28:01.215 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dump_on_update", 2024-09-15T22:28:01.215 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.215 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.215 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.215 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.215 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.216 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.216 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.216 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "dump database to debug log on update", 2024-09-15T22:28:01.216 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.216 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.216 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.216 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.216 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.216 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.216 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.216 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.216 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.216 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.216 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.217 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.217 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.217 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.217 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.217 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.217 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.217 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.217 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.217 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.217 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.217 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.217 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.217 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.217 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.218 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.218 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.218 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.218 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.218 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.218 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.218 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.218 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.218 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.218 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.218 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.218 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.218 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.218 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.219 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.219 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.219 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.219 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.219 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.219 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.219 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.219 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.219 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.219 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.219 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.219 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.219 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.220 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.220 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.220 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.220 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.220 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.220 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.220 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.220 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.220 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.220 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.220 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.220 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.220 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.220 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.221 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.221 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.221 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.221 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.221 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.221 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.221 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.221 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.221 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.221 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.221 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.221 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stats", 2024-09-15T22:28:01.221 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.221 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.222 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.222 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.222 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.222 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.222 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.222 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.222 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.222 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.222 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.222 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.222 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.222 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.222 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.223 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.223 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.223 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.223 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.223 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.223 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.223 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.223 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.223 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.223 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.223 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.223 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.223 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.223 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.224 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.224 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.224 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.224 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.224 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.224 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.224 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.224 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.224 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.224 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.224 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.224 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.224 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.225 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.225 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.225 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.225 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.225 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.225 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.225 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.225 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.225 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.225 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.225 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.225 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.225 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.226 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.226 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.226 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.226 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.226 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.226 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.226 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.226 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.226 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.226 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.226 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.226 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.226 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.226 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.227 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.227 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.227 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.227 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.227 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.227 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.227 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.227 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "status", 2024-09-15T22:28:01.227 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.227 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.227 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.227 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.227 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.227 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.227 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.228 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.228 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.228 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.228 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.228 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.228 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.228 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.228 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.228 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.228 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.228 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.228 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.228 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.228 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.228 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.229 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.229 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.229 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.229 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.229 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.229 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.229 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.229 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.229 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.229 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.229 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.229 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.229 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.229 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.229 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.230 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.230 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.230 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.230 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.230 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.230 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.230 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.230 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.230 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.230 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.230 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.230 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.230 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.230 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.230 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.231 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.231 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.231 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.231 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.231 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.231 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.231 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.231 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.231 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.231 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.231 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.231 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.231 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.231 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.232 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.232 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.232 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.232 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.232 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.232 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.232 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.232 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.232 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.232 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.232 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telegraf", 2024-09-15T22:28:01.232 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.232 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.233 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.233 INFO:teuthology.orchestra.run.smithi001.stdout: "address": { 2024-09-15T22:28:01.233 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "address", 2024-09-15T22:28:01.233 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.233 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.233 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.233 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-15T22:28:01.233 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.233 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.233 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.233 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.233 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.233 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.234 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.234 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.234 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-15T22:28:01.234 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-15T22:28:01.234 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:01.234 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.234 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.234 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15", 2024-09-15T22:28:01.234 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.234 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.234 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.234 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.234 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.234 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.235 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.235 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.235 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.235 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.235 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.235 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.235 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.235 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.235 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.235 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.235 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.235 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.235 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.235 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.236 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.236 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.236 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.236 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.236 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.236 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.236 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.236 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.236 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.236 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.236 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.236 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.236 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.237 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.237 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.237 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.237 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.237 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.237 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.237 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.237 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.237 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.237 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.237 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.237 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.237 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.237 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.238 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.238 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.238 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.238 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.238 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.238 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.238 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.238 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.238 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.238 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.238 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.238 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.238 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.239 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.239 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.239 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.239 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.239 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.239 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.239 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.239 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.239 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.239 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.239 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.239 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.239 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.239 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.239 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.240 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.240 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.240 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.240 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.240 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.240 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.240 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telemetry", 2024-09-15T22:28:01.240 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.240 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.240 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.240 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_basic": { 2024-09-15T22:28:01.240 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_basic", 2024-09-15T22:28:01.241 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.241 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.241 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.241 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.241 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.241 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.241 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.241 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-15T22:28:01.241 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.241 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.241 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.241 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.241 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_crash": { 2024-09-15T22:28:01.241 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_crash", 2024-09-15T22:28:01.241 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.242 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.242 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.242 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.242 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.242 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.242 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.242 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-15T22:28:01.242 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.242 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.242 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.242 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.242 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_device": { 2024-09-15T22:28:01.242 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_device", 2024-09-15T22:28:01.242 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.243 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.243 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.243 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.243 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.243 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.243 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.243 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-15T22:28:01.243 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.243 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.243 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.243 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.243 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_ident": { 2024-09-15T22:28:01.243 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_ident", 2024-09-15T22:28:01.243 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.243 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.244 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.244 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.244 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.244 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.244 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.244 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-15T22:28:01.244 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.244 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.244 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.244 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.244 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_perf": { 2024-09-15T22:28:01.244 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_perf", 2024-09-15T22:28:01.244 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.245 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.245 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.245 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.245 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.245 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.245 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.245 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-15T22:28:01.245 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.245 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.245 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.245 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.245 INFO:teuthology.orchestra.run.smithi001.stdout: "contact": { 2024-09-15T22:28:01.245 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "contact", 2024-09-15T22:28:01.246 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.246 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.246 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.246 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.246 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.246 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.246 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.246 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.246 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.246 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.246 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.246 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.246 INFO:teuthology.orchestra.run.smithi001.stdout: "description": { 2024-09-15T22:28:01.246 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "description", 2024-09-15T22:28:01.246 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.247 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.247 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.247 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.247 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.247 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.247 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.247 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.247 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.247 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.247 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.247 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.247 INFO:teuthology.orchestra.run.smithi001.stdout: "device_url": { 2024-09-15T22:28:01.247 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_url", 2024-09-15T22:28:01.247 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.247 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.247 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.248 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-15T22:28:01.248 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.248 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.248 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.248 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.248 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.248 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.248 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.248 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.248 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-15T22:28:01.248 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-15T22:28:01.248 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.248 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.249 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.249 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.249 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.249 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.249 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.249 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.249 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.249 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.249 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.249 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.249 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-15T22:28:01.249 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-15T22:28:01.249 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.250 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.250 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.250 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "24", 2024-09-15T22:28:01.250 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "8", 2024-09-15T22:28:01.250 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.250 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.250 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.250 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.250 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.250 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.250 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.250 INFO:teuthology.orchestra.run.smithi001.stdout: "last_opt_revision": { 2024-09-15T22:28:01.250 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "last_opt_revision", 2024-09-15T22:28:01.251 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.251 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.251 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.251 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1", 2024-09-15T22:28:01.251 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.251 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.251 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.251 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.251 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.251 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.251 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.251 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.251 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard": { 2024-09-15T22:28:01.251 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard", 2024-09-15T22:28:01.252 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.252 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.252 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.252 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.252 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.252 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.252 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.252 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.252 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.252 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.252 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.252 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.252 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard_description": { 2024-09-15T22:28:01.252 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard_description", 2024-09-15T22:28:01.253 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.253 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.253 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.253 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.253 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.253 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.253 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.253 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.253 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.253 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.253 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.253 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.253 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.254 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.254 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.254 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.254 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.254 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.254 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.254 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.254 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.254 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.254 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.254 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.254 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.254 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.254 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.255 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.255 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.255 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.255 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.255 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.255 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.255 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.255 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.255 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.255 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.255 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.255 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.255 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.256 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.256 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.256 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.256 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.256 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.256 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.256 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.256 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.256 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.256 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.256 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.256 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.256 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.257 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.257 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.257 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.257 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.257 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.257 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.257 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.257 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.257 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.257 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.257 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.257 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.257 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.257 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.258 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.258 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.258 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.258 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.258 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.258 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.258 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.258 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.258 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.258 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.258 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.258 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.258 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.258 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.259 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.259 INFO:teuthology.orchestra.run.smithi001.stdout: "organization": { 2024-09-15T22:28:01.259 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "organization", 2024-09-15T22:28:01.259 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.259 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.259 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.259 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.259 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.259 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.259 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.259 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.259 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.259 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.260 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.260 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.260 INFO:teuthology.orchestra.run.smithi001.stdout: "proxy": { 2024-09-15T22:28:01.260 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "proxy", 2024-09-15T22:28:01.260 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.260 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.260 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.260 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.260 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.260 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.260 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.260 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.260 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.260 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.261 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.261 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.261 INFO:teuthology.orchestra.run.smithi001.stdout: "url": { 2024-09-15T22:28:01.261 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url", 2024-09-15T22:28:01.261 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.261 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.261 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.261 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-15T22:28:01.261 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.261 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.261 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.261 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.261 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.261 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.262 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.262 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.262 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.262 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.262 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.262 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "test_orchestrator", 2024-09-15T22:28:01.262 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.262 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.262 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.262 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.262 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.262 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.262 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.262 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.263 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.263 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.263 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.263 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.263 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.263 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.263 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.263 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.263 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.263 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.263 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.263 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.264 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.264 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.264 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.264 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.264 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.264 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.264 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.264 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.264 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.264 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.264 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.264 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.264 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.265 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.265 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.265 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.265 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.265 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.265 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.265 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.265 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.265 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.265 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.265 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.265 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.266 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.266 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.266 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.266 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.266 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.266 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.266 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.266 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.266 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.266 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.266 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.266 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.266 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.266 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.267 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.267 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.267 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.267 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.267 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.267 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.267 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.267 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.267 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.267 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.267 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.267 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.267 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.267 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.267 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.268 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.268 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.268 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "volumes", 2024-09-15T22:28:01.268 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.268 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.268 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.268 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.268 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.268 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.268 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.268 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.268 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.268 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.268 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.268 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.269 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.269 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.269 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.269 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.269 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.269 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.269 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.269 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.269 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.269 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.269 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.269 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.269 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.269 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.270 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.270 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.270 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.270 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.270 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.270 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.270 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.270 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.270 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.270 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.270 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.270 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.270 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.270 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.270 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.271 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.271 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.271 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.271 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.271 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.271 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.271 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.271 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.271 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.271 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.271 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.271 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.271 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.271 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.272 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.272 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.272 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.272 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.272 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.272 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.272 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.272 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.272 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.272 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.272 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.272 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.272 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.272 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.273 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.273 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.273 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.273 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.273 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_clones": { 2024-09-15T22:28:01.273 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_clones", 2024-09-15T22:28:01.273 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.273 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.273 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.273 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4", 2024-09-15T22:28:01.273 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.273 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.273 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.273 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-15T22:28:01.274 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.274 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.274 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.274 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.274 INFO:teuthology.orchestra.run.smithi001.stdout: "periodic_async_work": { 2024-09-15T22:28:01.274 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "periodic_async_work", 2024-09-15T22:28:01.274 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.274 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.274 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.274 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.274 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.274 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.274 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.275 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Periodically check for async work", 2024-09-15T22:28:01.275 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.275 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.275 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.275 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.275 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_delay": { 2024-09-15T22:28:01.275 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_delay", 2024-09-15T22:28:01.275 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.275 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.275 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.275 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-15T22:28:01.275 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.275 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.275 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.276 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-15T22:28:01.276 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.276 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.276 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.276 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.276 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_no_wait": { 2024-09-15T22:28:01.276 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_no_wait", 2024-09-15T22:28:01.276 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.276 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.276 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.276 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.277 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.277 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.277 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.277 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-15T22:28:01.277 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.277 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.277 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.277 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.277 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.277 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.277 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.277 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix", 2024-09-15T22:28:01.277 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.277 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.277 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.278 INFO:teuthology.orchestra.run.smithi001.stdout: "discovery_interval": { 2024-09-15T22:28:01.278 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "discovery_interval", 2024-09-15T22:28:01.278 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-15T22:28:01.278 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.278 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.278 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "100", 2024-09-15T22:28:01.278 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.278 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.278 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.278 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.278 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.278 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.278 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.278 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.279 INFO:teuthology.orchestra.run.smithi001.stdout: "identifier": { 2024-09-15T22:28:01.279 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "identifier", 2024-09-15T22:28:01.279 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.279 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.279 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.279 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.279 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.279 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.279 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.279 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.279 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.279 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.279 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.280 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.280 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-15T22:28:01.280 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-15T22:28:01.280 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:01.280 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.280 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.280 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-15T22:28:01.280 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.280 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.280 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.280 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.280 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.280 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.280 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.281 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.281 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.281 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.281 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.281 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.281 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.281 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.281 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.281 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.281 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.281 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.281 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.281 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.282 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.282 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.282 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.282 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.282 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.282 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.282 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.282 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.282 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.282 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.282 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.282 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.282 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.283 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.283 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.283 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.283 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.283 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.283 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.283 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.283 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.283 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.283 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.283 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.283 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.283 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.283 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.283 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.284 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.284 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.284 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.284 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.284 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.284 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.284 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.284 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.284 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.284 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.284 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.284 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.284 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.285 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.285 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.285 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.285 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.285 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.285 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.285 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.285 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.285 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.285 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.285 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.285 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.285 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.285 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.286 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.286 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.286 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.286 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_host": { 2024-09-15T22:28:01.286 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_host", 2024-09-15T22:28:01.286 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.286 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.286 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.286 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.286 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.286 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.286 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.286 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.286 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.287 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.287 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.287 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.287 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_port": { 2024-09-15T22:28:01.287 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_port", 2024-09-15T22:28:01.287 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.287 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.287 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.287 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10051", 2024-09-15T22:28:01.287 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.287 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.287 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.287 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.288 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.288 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.288 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.288 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.288 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_sender": { 2024-09-15T22:28:01.288 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_sender", 2024-09-15T22:28:01.288 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.288 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.288 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.288 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-15T22:28:01.288 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.288 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.288 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.289 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.289 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.289 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.289 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.289 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.289 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.289 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.289 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-15T22:28:01.289 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.289 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.289 INFO:teuthology.orchestra.run.smithi001.stdout: "modules": [ 2024-09-15T22:28:01.289 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm", 2024-09-15T22:28:01.289 INFO:teuthology.orchestra.run.smithi001.stdout: "dashboard", 2024-09-15T22:28:01.290 INFO:teuthology.orchestra.run.smithi001.stdout: "iostat", 2024-09-15T22:28:01.290 INFO:teuthology.orchestra.run.smithi001.stdout: "nfs", 2024-09-15T22:28:01.290 INFO:teuthology.orchestra.run.smithi001.stdout: "restful" 2024-09-15T22:28:01.290 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.290 INFO:teuthology.orchestra.run.smithi001.stdout: "available_modules": [ 2024-09-15T22:28:01.290 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.290 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "alerts", 2024-09-15T22:28:01.290 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.290 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.290 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.290 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-15T22:28:01.290 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-15T22:28:01.290 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:01.290 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.291 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.291 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-15T22:28:01.291 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.291 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.291 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.291 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How frequently to reexamine health status", 2024-09-15T22:28:01.291 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.291 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.291 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.291 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.291 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.291 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.291 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.292 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.292 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.292 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.292 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.292 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.292 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.292 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.292 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.292 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.292 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.292 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.292 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.292 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.292 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.293 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.293 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.293 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.293 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.293 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.293 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.293 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.293 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.293 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.293 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.293 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.293 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.293 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.293 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.294 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.294 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.294 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.294 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.294 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.294 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.294 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.294 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.294 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.294 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.294 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.294 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.294 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.295 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.295 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.295 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.295 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.295 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.295 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.295 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.295 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.295 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.295 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.295 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.295 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.295 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.296 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.296 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.296 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.296 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.296 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.296 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.296 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.296 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.296 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.296 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.296 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.296 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.296 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.296 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_destination": { 2024-09-15T22:28:01.297 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_destination", 2024-09-15T22:28:01.297 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.297 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.297 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.297 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.297 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.297 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.297 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.297 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email address to send alerts to", 2024-09-15T22:28:01.297 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.297 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.297 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.297 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.298 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_from_name": { 2024-09-15T22:28:01.298 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_from_name", 2024-09-15T22:28:01.298 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.298 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.298 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.298 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "Ceph", 2024-09-15T22:28:01.298 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.298 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.298 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.298 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email From: name", 2024-09-15T22:28:01.298 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.298 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.298 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.298 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.298 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_host": { 2024-09-15T22:28:01.299 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_host", 2024-09-15T22:28:01.299 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.299 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.299 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.299 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.299 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.299 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.299 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.299 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP server", 2024-09-15T22:28:01.299 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.299 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.299 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.299 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.299 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_password": { 2024-09-15T22:28:01.299 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_password", 2024-09-15T22:28:01.300 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.300 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.300 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.300 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.300 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.300 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.300 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.300 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Password to authenticate with", 2024-09-15T22:28:01.300 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.300 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.300 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.300 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.300 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_port": { 2024-09-15T22:28:01.301 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_port", 2024-09-15T22:28:01.301 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.301 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.301 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.301 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "465", 2024-09-15T22:28:01.301 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.301 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.301 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.301 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP port", 2024-09-15T22:28:01.301 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.301 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.301 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.301 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.302 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_sender": { 2024-09-15T22:28:01.302 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_sender", 2024-09-15T22:28:01.302 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.302 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.302 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.302 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.302 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.302 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.302 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.302 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP envelope sender", 2024-09-15T22:28:01.302 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.302 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.302 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.303 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.303 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_ssl": { 2024-09-15T22:28:01.303 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_ssl", 2024-09-15T22:28:01.303 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.303 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.303 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.303 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.303 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.303 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.303 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.303 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-15T22:28:01.303 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.303 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.303 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.303 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.304 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_user": { 2024-09-15T22:28:01.304 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_user", 2024-09-15T22:28:01.304 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.304 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.304 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.304 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.304 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.304 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.304 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.304 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "User to authenticate as", 2024-09-15T22:28:01.304 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.304 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.304 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.305 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.305 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.305 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.305 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.305 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "balancer", 2024-09-15T22:28:01.305 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.305 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.305 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.305 INFO:teuthology.orchestra.run.smithi001.stdout: "active": { 2024-09-15T22:28:01.305 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "active", 2024-09-15T22:28:01.305 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.305 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.305 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.306 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.306 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.306 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.306 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.306 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically balance PGs across cluster", 2024-09-15T22:28:01.306 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.306 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.306 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.306 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.306 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_time": { 2024-09-15T22:28:01.306 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_time", 2024-09-15T22:28:01.306 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.306 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.306 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.307 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0000", 2024-09-15T22:28:01.307 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.307 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.307 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.307 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "beginning time of day to automatically balance", 2024-09-15T22:28:01.307 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T22:28:01.307 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.307 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.307 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.307 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_weekday": { 2024-09-15T22:28:01.307 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_weekday", 2024-09-15T22:28:01.307 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-15T22:28:01.307 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.307 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.308 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-15T22:28:01.308 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-15T22:28:01.308 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-15T22:28:01.308 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.308 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-15T22:28:01.308 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T22:28:01.308 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.308 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.308 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.308 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_max_iterations": { 2024-09-15T22:28:01.308 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_max_iterations", 2024-09-15T22:28:01.308 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-15T22:28:01.308 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.309 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.309 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "25", 2024-09-15T22:28:01.309 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-15T22:28:01.309 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "250", 2024-09-15T22:28:01.309 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.309 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-15T22:28:01.309 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.309 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.309 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.309 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.309 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_metrics": { 2024-09-15T22:28:01.309 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_metrics", 2024-09-15T22:28:01.309 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.309 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.309 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.310 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "pgs,objects,bytes", 2024-09-15T22:28:01.310 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.310 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.310 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.310 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-15T22:28:01.310 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-15T22:28:01.310 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.310 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.310 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.310 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_step": { 2024-09-15T22:28:01.310 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_step", 2024-09-15T22:28:01.310 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-15T22:28:01.310 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.310 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.310 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.5", 2024-09-15T22:28:01.311 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0.001", 2024-09-15T22:28:01.311 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "0.999", 2024-09-15T22:28:01.311 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.311 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "aggressiveness of optimization", 2024-09-15T22:28:01.311 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-15T22:28:01.311 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.311 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.311 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.311 INFO:teuthology.orchestra.run.smithi001.stdout: "end_time": { 2024-09-15T22:28:01.311 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_time", 2024-09-15T22:28:01.311 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.311 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.311 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.311 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2359", 2024-09-15T22:28:01.311 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.311 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.312 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.312 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ending time of day to automatically balance", 2024-09-15T22:28:01.312 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T22:28:01.312 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.312 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.312 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.312 INFO:teuthology.orchestra.run.smithi001.stdout: "end_weekday": { 2024-09-15T22:28:01.312 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_weekday", 2024-09-15T22:28:01.312 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-15T22:28:01.312 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.312 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.312 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-15T22:28:01.312 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-15T22:28:01.312 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-15T22:28:01.312 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.313 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-15T22:28:01.313 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T22:28:01.313 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.313 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.313 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.313 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.313 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.313 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.313 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.313 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.313 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.313 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.313 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.314 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.314 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.314 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.314 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.314 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.314 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.314 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.314 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.314 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.314 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.314 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.314 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.314 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.314 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.315 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.315 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.315 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.315 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.315 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.315 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.315 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.315 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.315 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.315 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.315 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.315 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.315 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.315 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.316 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.316 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.316 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.316 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.316 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.316 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.316 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.316 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.316 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.316 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.316 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.316 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.316 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.316 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.316 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.316 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.317 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.317 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.317 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.317 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.317 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.317 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.317 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.317 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.317 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.317 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.317 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.317 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.317 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.317 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.317 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.318 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.318 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.318 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.318 INFO:teuthology.orchestra.run.smithi001.stdout: "min_score": { 2024-09-15T22:28:01.318 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_score", 2024-09-15T22:28:01.318 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-15T22:28:01.318 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.318 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.318 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-15T22:28:01.318 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.318 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.318 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.318 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-15T22:28:01.318 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.318 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.318 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.318 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.319 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-15T22:28:01.319 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-15T22:28:01.319 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.319 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.319 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.319 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "upmap", 2024-09-15T22:28:01.319 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.319 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.319 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.319 INFO:teuthology.orchestra.run.smithi001.stdout: "crush-compat", 2024-09-15T22:28:01.319 INFO:teuthology.orchestra.run.smithi001.stdout: "none", 2024-09-15T22:28:01.319 INFO:teuthology.orchestra.run.smithi001.stdout: "read", 2024-09-15T22:28:01.319 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap", 2024-09-15T22:28:01.319 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap-read" 2024-09-15T22:28:01.320 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.320 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Balancer mode", 2024-09-15T22:28:01.320 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.320 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.320 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.320 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.320 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_ids": { 2024-09-15T22:28:01.320 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_ids", 2024-09-15T22:28:01.320 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.320 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.320 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.320 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.320 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.320 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.321 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.321 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-15T22:28:01.321 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.321 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.321 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.321 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.321 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-15T22:28:01.321 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-15T22:28:01.321 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:01.321 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.321 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.321 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-15T22:28:01.324 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.324 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.324 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.324 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-15T22:28:01.324 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.324 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.324 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.324 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.324 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_deviation": { 2024-09-15T22:28:01.324 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_deviation", 2024-09-15T22:28:01.324 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.324 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.325 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.325 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-15T22:28:01.325 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-15T22:28:01.325 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.325 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.325 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-15T22:28:01.325 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-15T22:28:01.325 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.325 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.325 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.325 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_optimizations": { 2024-09-15T22:28:01.325 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_optimizations", 2024-09-15T22:28:01.325 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-15T22:28:01.325 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.325 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.326 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-15T22:28:01.326 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.326 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.326 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.326 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-15T22:28:01.326 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.326 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.326 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.326 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.326 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.326 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.326 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.326 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm", 2024-09-15T22:28:01.326 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.327 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.327 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.327 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_down_multiplier": { 2024-09-15T22:28:01.327 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_down_multiplier", 2024-09-15T22:28:01.327 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-15T22:28:01.327 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.327 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.327 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-15T22:28:01.327 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.327 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.327 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.327 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-15T22:28:01.327 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.328 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.328 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.328 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.328 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_refresh_rate": { 2024-09-15T22:28:01.328 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_refresh_rate", 2024-09-15T22:28:01.328 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:01.328 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.328 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.328 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "20", 2024-09-15T22:28:01.328 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.328 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.328 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.328 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-15T22:28:01.328 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.329 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.329 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.329 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.329 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_starting_port": { 2024-09-15T22:28:01.329 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_starting_port", 2024-09-15T22:28:01.329 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.329 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.329 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.329 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4721", 2024-09-15T22:28:01.329 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.329 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.329 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.329 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-15T22:28:01.330 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.330 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.330 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.330 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.330 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_ptrace": { 2024-09-15T22:28:01.330 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_ptrace", 2024-09-15T22:28:01.330 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.330 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.330 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.330 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.330 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.330 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.330 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.330 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-15T22:28:01.331 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-15T22:28:01.331 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.331 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.331 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.331 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_interval": { 2024-09-15T22:28:01.331 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_interval", 2024-09-15T22:28:01.331 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:01.331 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.331 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.331 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-15T22:28:01.331 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.331 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.331 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.331 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-15T22:28:01.331 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.332 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.332 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.332 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.332 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_memory_target_ratio": { 2024-09-15T22:28:01.332 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_memory_target_ratio", 2024-09-15T22:28:01.332 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-15T22:28:01.332 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.332 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.332 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.7", 2024-09-15T22:28:01.332 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.332 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.332 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.332 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-15T22:28:01.333 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.333 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.333 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.333 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.333 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm_log_destination": { 2024-09-15T22:28:01.333 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm_log_destination", 2024-09-15T22:28:01.333 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.333 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.333 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.333 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.333 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.333 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.333 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.334 INFO:teuthology.orchestra.run.smithi001.stdout: "file", 2024-09-15T22:28:01.334 INFO:teuthology.orchestra.run.smithi001.stdout: "file,syslog", 2024-09-15T22:28:01.334 INFO:teuthology.orchestra.run.smithi001.stdout: "syslog" 2024-09-15T22:28:01.334 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.334 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-15T22:28:01.334 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.334 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.334 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.334 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.334 INFO:teuthology.orchestra.run.smithi001.stdout: "cgroups_split": { 2024-09-15T22:28:01.334 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cgroups_split", 2024-09-15T22:28:01.334 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.334 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.334 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.335 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.335 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.335 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.335 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.335 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-15T22:28:01.335 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.335 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.335 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.335 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.335 INFO:teuthology.orchestra.run.smithi001.stdout: "config_checks_enabled": { 2024-09-15T22:28:01.335 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_checks_enabled", 2024-09-15T22:28:01.335 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.335 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.335 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.335 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.336 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.336 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.336 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.336 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-15T22:28:01.336 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.336 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.336 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.336 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.336 INFO:teuthology.orchestra.run.smithi001.stdout: "config_dashboard": { 2024-09-15T22:28:01.336 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_dashboard", 2024-09-15T22:28:01.336 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.336 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.336 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.337 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.337 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.337 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.337 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.337 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-15T22:28:01.337 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.337 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.337 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.337 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.337 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_alertmanager": { 2024-09-15T22:28:01.337 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_alertmanager", 2024-09-15T22:28:01.337 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.338 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.338 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.338 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-15T22:28:01.338 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.338 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.338 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.338 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-15T22:28:01.338 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.338 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.338 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.338 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.338 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_base": { 2024-09-15T22:28:01.338 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_base", 2024-09-15T22:28:01.339 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.339 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.339 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.339 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-15T22:28:01.339 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.339 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.339 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.339 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Container image name, without the tag", 2024-09-15T22:28:01.339 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.339 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.339 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.339 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.339 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_elasticsearch": { 2024-09-15T22:28:01.340 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_elasticsearch", 2024-09-15T22:28:01.340 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.340 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.340 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.340 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-15T22:28:01.340 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.340 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.340 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.340 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "elasticsearch container image", 2024-09-15T22:28:01.340 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.340 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.340 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.341 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.341 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_grafana": { 2024-09-15T22:28:01.341 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_grafana", 2024-09-15T22:28:01.341 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.341 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.341 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.341 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-15T22:28:01.341 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.341 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.341 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.341 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-15T22:28:01.341 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.341 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.342 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.342 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.342 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_haproxy": { 2024-09-15T22:28:01.342 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_haproxy", 2024-09-15T22:28:01.342 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.342 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.342 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.342 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-15T22:28:01.342 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.342 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.342 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.342 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "HAproxy container image", 2024-09-15T22:28:01.342 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.343 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.343 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.343 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.343 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_agent": { 2024-09-15T22:28:01.343 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_agent", 2024-09-15T22:28:01.343 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.343 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.343 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.343 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-15T22:28:01.343 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.343 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.343 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.343 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger agent container image", 2024-09-15T22:28:01.344 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.344 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.344 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.344 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.344 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_collector": { 2024-09-15T22:28:01.344 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_collector", 2024-09-15T22:28:01.344 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.344 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.344 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.344 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-15T22:28:01.344 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.344 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.345 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.345 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger collector container image", 2024-09-15T22:28:01.345 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.345 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.345 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.345 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.345 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_query": { 2024-09-15T22:28:01.345 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_query", 2024-09-15T22:28:01.345 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.345 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.345 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.345 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-15T22:28:01.345 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.346 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.346 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.346 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger query container image", 2024-09-15T22:28:01.346 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.346 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.346 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.346 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.346 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_keepalived": { 2024-09-15T22:28:01.346 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_keepalived", 2024-09-15T22:28:01.346 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.346 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.346 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.346 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-15T22:28:01.346 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.346 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.347 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.347 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Keepalived container image", 2024-09-15T22:28:01.347 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.347 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.347 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.347 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.347 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_loki": { 2024-09-15T22:28:01.347 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_loki", 2024-09-15T22:28:01.347 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.347 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.347 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.347 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-15T22:28:01.347 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.347 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.348 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.348 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Loki container image", 2024-09-15T22:28:01.348 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.348 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.348 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.348 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.348 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_node_exporter": { 2024-09-15T22:28:01.348 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_node_exporter", 2024-09-15T22:28:01.348 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.348 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.348 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.348 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-15T22:28:01.348 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.348 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.349 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.349 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-15T22:28:01.349 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.349 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.349 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.349 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.349 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_nvmeof": { 2024-09-15T22:28:01.349 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_nvmeof", 2024-09-15T22:28:01.349 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.349 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.349 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.349 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-15T22:28:01.349 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.349 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.350 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.350 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Nvme-of container image", 2024-09-15T22:28:01.350 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.350 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.350 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.350 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.350 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_prometheus": { 2024-09-15T22:28:01.350 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_prometheus", 2024-09-15T22:28:01.350 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.350 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.350 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.350 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-15T22:28:01.350 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.350 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.350 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.351 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-15T22:28:01.351 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.351 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.351 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.351 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.351 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_promtail": { 2024-09-15T22:28:01.351 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_promtail", 2024-09-15T22:28:01.351 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.351 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.351 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.351 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-15T22:28:01.351 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.351 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.351 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.352 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Promtail container image", 2024-09-15T22:28:01.352 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.352 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.352 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.352 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.352 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_samba": { 2024-09-15T22:28:01.352 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_samba", 2024-09-15T22:28:01.352 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.352 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.352 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.352 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-15T22:28:01.352 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.352 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.353 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.353 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Samba/SMB container image", 2024-09-15T22:28:01.353 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.353 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.353 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.353 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.353 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_snmp_gateway": { 2024-09-15T22:28:01.353 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_snmp_gateway", 2024-09-15T22:28:01.353 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.353 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.353 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.353 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-15T22:28:01.353 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.354 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.354 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.354 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SNMP Gateway container image", 2024-09-15T22:28:01.354 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.354 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.354 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.354 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.354 INFO:teuthology.orchestra.run.smithi001.stdout: "container_init": { 2024-09-15T22:28:01.354 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_init", 2024-09-15T22:28:01.354 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.354 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.354 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.354 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.355 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.355 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.355 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.355 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Run podman/docker with `--init`", 2024-09-15T22:28:01.355 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.355 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.355 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.355 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.355 INFO:teuthology.orchestra.run.smithi001.stdout: "daemon_cache_timeout": { 2024-09-15T22:28:01.355 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "daemon_cache_timeout", 2024-09-15T22:28:01.355 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:01.355 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.355 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.355 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-15T22:28:01.356 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.356 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.356 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.356 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-15T22:28:01.356 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.356 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.356 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.356 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.356 INFO:teuthology.orchestra.run.smithi001.stdout: "default_cephadm_command_timeout": { 2024-09-15T22:28:01.356 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_cephadm_command_timeout", 2024-09-15T22:28:01.356 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.356 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.357 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.357 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "900", 2024-09-15T22:28:01.357 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.357 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.357 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.357 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-15T22:28:01.357 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.357 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.357 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.357 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.357 INFO:teuthology.orchestra.run.smithi001.stdout: "default_registry": { 2024-09-15T22:28:01.357 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_registry", 2024-09-15T22:28:01.357 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.358 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.358 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.358 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io", 2024-09-15T22:28:01.358 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.358 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.358 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.358 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-15T22:28:01.358 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.358 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.358 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.358 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.358 INFO:teuthology.orchestra.run.smithi001.stdout: "device_cache_timeout": { 2024-09-15T22:28:01.358 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_cache_timeout", 2024-09-15T22:28:01.358 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:01.359 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.359 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.359 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1800", 2024-09-15T22:28:01.359 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.359 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.359 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.359 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache device inventory", 2024-09-15T22:28:01.359 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.359 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.359 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.359 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.359 INFO:teuthology.orchestra.run.smithi001.stdout: "device_enhanced_scan": { 2024-09-15T22:28:01.359 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_enhanced_scan", 2024-09-15T22:28:01.359 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.360 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.360 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.360 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.360 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.360 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.360 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.360 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-15T22:28:01.360 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.360 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.360 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.360 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.360 INFO:teuthology.orchestra.run.smithi001.stdout: "facts_cache_timeout": { 2024-09-15T22:28:01.360 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "facts_cache_timeout", 2024-09-15T22:28:01.360 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:01.360 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.361 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.361 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-15T22:28:01.361 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.361 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.361 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.361 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache host facts data", 2024-09-15T22:28:01.361 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.361 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.361 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.361 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.361 INFO:teuthology.orchestra.run.smithi001.stdout: "grafana_dashboards_path": { 2024-09-15T22:28:01.361 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "grafana_dashboards_path", 2024-09-15T22:28:01.361 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.361 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.362 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.362 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-15T22:28:01.362 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.362 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.362 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.362 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-15T22:28:01.362 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.362 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.362 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.362 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.362 INFO:teuthology.orchestra.run.smithi001.stdout: "host_check_interval": { 2024-09-15T22:28:01.362 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "host_check_interval", 2024-09-15T22:28:01.362 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:01.362 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.362 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.363 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-15T22:28:01.363 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.363 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.363 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.363 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to perform a host check", 2024-09-15T22:28:01.363 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.363 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.363 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.363 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.363 INFO:teuthology.orchestra.run.smithi001.stdout: "hw_monitoring": { 2024-09-15T22:28:01.363 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hw_monitoring", 2024-09-15T22:28:01.363 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.363 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.363 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.363 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.364 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.364 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.364 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.364 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-15T22:28:01.364 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.364 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.364 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.364 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.364 INFO:teuthology.orchestra.run.smithi001.stdout: "inventory_list_all": { 2024-09-15T22:28:01.364 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "inventory_list_all", 2024-09-15T22:28:01.364 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.364 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.364 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.364 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.365 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.365 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.365 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.365 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-15T22:28:01.365 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.365 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.365 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.365 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.365 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.365 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.365 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.365 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.365 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.365 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.365 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.366 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.366 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.366 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.366 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.366 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.366 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.366 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.366 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.366 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.366 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.366 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.366 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.366 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.366 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.366 INFO:teuthology.orchestra.run.smithi001.stdout: "log_refresh_metadata": { 2024-09-15T22:28:01.367 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_refresh_metadata", 2024-09-15T22:28:01.367 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.367 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.367 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.367 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.367 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.367 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.367 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.367 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-15T22:28:01.367 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.367 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.367 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.367 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.367 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.368 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.368 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.368 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.368 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.368 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.368 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.368 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.368 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.368 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-15T22:28:01.368 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.368 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.368 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.368 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.369 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.369 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.369 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.369 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.369 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.369 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.369 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.369 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.369 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.369 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.369 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.369 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.369 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.369 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.369 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.370 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.370 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.370 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.370 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.370 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.370 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.370 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.370 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.370 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.370 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.370 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.370 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.370 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.371 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.371 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.371 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.371 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.371 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.371 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.371 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.371 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-15T22:28:01.371 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-15T22:28:01.371 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.371 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.371 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.371 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.371 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.371 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.372 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.372 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-15T22:28:01.372 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.372 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.372 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.372 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.372 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-15T22:28:01.372 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-15T22:28:01.372 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.372 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.372 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.372 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "*", 2024-09-15T22:28:01.372 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.372 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.372 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.373 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-15T22:28:01.373 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.373 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.373 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.373 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.373 INFO:teuthology.orchestra.run.smithi001.stdout: "max_count_per_host": { 2024-09-15T22:28:01.373 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_count_per_host", 2024-09-15T22:28:01.373 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.373 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.373 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.373 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-15T22:28:01.373 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.373 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.373 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.374 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of daemons per service per host", 2024-09-15T22:28:01.374 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.374 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.374 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.374 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.374 INFO:teuthology.orchestra.run.smithi001.stdout: "max_osd_draining_count": { 2024-09-15T22:28:01.374 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_osd_draining_count", 2024-09-15T22:28:01.374 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.374 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.374 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.374 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-15T22:28:01.374 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.374 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.375 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.375 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-15T22:28:01.375 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.375 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.375 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.375 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.375 INFO:teuthology.orchestra.run.smithi001.stdout: "migration_current": { 2024-09-15T22:28:01.375 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "migration_current", 2024-09-15T22:28:01.375 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.375 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.375 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.375 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.375 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.376 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.376 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.376 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "internal - do not modify", 2024-09-15T22:28:01.376 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.376 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.376 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.376 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.376 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-15T22:28:01.376 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-15T22:28:01.376 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.376 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.376 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.376 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "root", 2024-09-15T22:28:01.376 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.377 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.377 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.377 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm-package", 2024-09-15T22:28:01.377 INFO:teuthology.orchestra.run.smithi001.stdout: "root" 2024-09-15T22:28:01.377 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.377 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "mode for remote execution of cephadm", 2024-09-15T22:28:01.377 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.377 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.377 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.377 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.377 INFO:teuthology.orchestra.run.smithi001.stdout: "oob_default_addr": { 2024-09-15T22:28:01.377 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "oob_default_addr", 2024-09-15T22:28:01.377 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.378 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.378 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.378 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "169.254.1.1", 2024-09-15T22:28:01.378 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.378 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.378 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.378 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-15T22:28:01.378 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.378 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.378 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.378 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.378 INFO:teuthology.orchestra.run.smithi001.stdout: "prometheus_alerts_path": { 2024-09-15T22:28:01.378 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus_alerts_path", 2024-09-15T22:28:01.378 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.379 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.379 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.379 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-15T22:28:01.379 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.379 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.379 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.379 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-15T22:28:01.379 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.379 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.379 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.379 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.379 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_insecure": { 2024-09-15T22:28:01.379 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_insecure", 2024-09-15T22:28:01.379 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.380 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.380 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.380 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.380 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.380 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.380 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.380 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-15T22:28:01.380 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.380 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.380 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.380 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.380 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_password": { 2024-09-15T22:28:01.380 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_password", 2024-09-15T22:28:01.380 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.381 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.381 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.381 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.381 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.381 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.381 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.381 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-15T22:28:01.381 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.381 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.381 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.381 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.381 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_url": { 2024-09-15T22:28:01.381 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_url", 2024-09-15T22:28:01.381 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.382 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.382 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.382 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.382 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.382 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.382 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.382 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-15T22:28:01.382 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.382 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.382 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.382 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.382 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_username": { 2024-09-15T22:28:01.382 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_username", 2024-09-15T22:28:01.383 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.383 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.383 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.383 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.383 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.383 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.383 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.383 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-15T22:28:01.383 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.383 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.383 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.383 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.383 INFO:teuthology.orchestra.run.smithi001.stdout: "secure_monitoring_stack": { 2024-09-15T22:28:01.383 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secure_monitoring_stack", 2024-09-15T22:28:01.384 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.384 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.384 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.384 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.384 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.384 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.384 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.384 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-15T22:28:01.384 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.384 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.384 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.384 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.384 INFO:teuthology.orchestra.run.smithi001.stdout: "service_discovery_port": { 2024-09-15T22:28:01.385 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "service_discovery_port", 2024-09-15T22:28:01.385 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.385 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.385 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.385 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8765", 2024-09-15T22:28:01.385 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.385 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.385 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.385 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "cephadm service discovery port", 2024-09-15T22:28:01.385 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.385 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.385 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.385 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.385 INFO:teuthology.orchestra.run.smithi001.stdout: "ssh_config_file": { 2024-09-15T22:28:01.386 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssh_config_file", 2024-09-15T22:28:01.386 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.386 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.386 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.386 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.386 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.386 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.386 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.386 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-15T22:28:01.386 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.386 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.386 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.386 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.386 INFO:teuthology.orchestra.run.smithi001.stdout: "use_agent": { 2024-09-15T22:28:01.387 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_agent", 2024-09-15T22:28:01.387 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.387 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.387 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.387 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.387 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.387 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.387 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.387 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-15T22:28:01.387 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.387 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.387 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.387 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.388 INFO:teuthology.orchestra.run.smithi001.stdout: "use_repo_digest": { 2024-09-15T22:28:01.388 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_repo_digest", 2024-09-15T22:28:01.388 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.388 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.388 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.388 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.388 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.388 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.388 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.388 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-15T22:28:01.388 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.388 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.388 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.388 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.389 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_failed_host_check": { 2024-09-15T22:28:01.389 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_failed_host_check", 2024-09-15T22:28:01.389 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.389 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.389 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.389 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.389 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.389 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.389 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.389 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if the host check fails", 2024-09-15T22:28:01.389 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.389 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.389 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.390 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.390 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_daemons": { 2024-09-15T22:28:01.390 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_daemons", 2024-09-15T22:28:01.390 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.390 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.390 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.390 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.390 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.390 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.390 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.390 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-15T22:28:01.390 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.390 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.390 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.391 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.391 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_hosts": { 2024-09-15T22:28:01.391 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_hosts", 2024-09-15T22:28:01.391 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.391 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.391 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.391 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.391 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.391 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.391 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.391 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-15T22:28:01.391 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.391 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.392 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.392 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.392 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.392 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.392 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.392 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crash", 2024-09-15T22:28:01.392 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.392 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.392 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.392 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.392 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.392 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.392 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.392 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.393 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.393 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.393 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.393 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.393 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.393 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.393 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.393 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.393 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.393 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.393 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.393 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.393 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.393 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.394 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.394 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.394 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.394 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.394 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.394 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.394 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.394 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.394 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.394 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.394 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.394 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.394 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.394 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.395 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.395 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.395 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.395 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.395 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.395 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.395 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.395 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.395 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.395 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.395 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.395 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.395 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.395 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.396 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.396 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.396 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.396 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.396 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.396 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.396 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.396 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.396 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.396 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.396 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.396 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.396 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.397 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.397 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.397 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.397 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.397 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.397 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.397 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.397 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.397 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.397 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.397 INFO:teuthology.orchestra.run.smithi001.stdout: "retain_interval": { 2024-09-15T22:28:01.397 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retain_interval", 2024-09-15T22:28:01.397 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:01.398 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.398 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.398 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "31536000", 2024-09-15T22:28:01.398 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.398 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.398 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.398 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-15T22:28:01.398 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.398 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.398 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.398 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.398 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_recent_interval": { 2024-09-15T22:28:01.399 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_recent_interval", 2024-09-15T22:28:01.399 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:01.399 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.399 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.399 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1209600", 2024-09-15T22:28:01.399 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.399 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.399 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.399 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-15T22:28:01.399 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.399 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.399 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.399 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.399 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.400 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.400 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.400 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dashboard", 2024-09-15T22:28:01.400 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.400 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.400 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.400 INFO:teuthology.orchestra.run.smithi001.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-15T22:28:01.400 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-15T22:28:01.400 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.400 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.400 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.400 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-15T22:28:01.401 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.401 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.401 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.401 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.401 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.401 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.401 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.401 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.401 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_HOST": { 2024-09-15T22:28:01.401 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-15T22:28:01.401 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.401 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.401 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.401 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.402 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.402 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.402 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.402 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.402 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.402 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.402 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.402 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.402 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-15T22:28:01.402 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-15T22:28:01.402 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.402 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.402 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.403 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.403 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.403 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.403 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.403 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.403 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.403 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.403 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.403 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.403 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_ENABLED": { 2024-09-15T22:28:01.403 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_ENABLED", 2024-09-15T22:28:01.403 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.403 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.403 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.404 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.404 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.404 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.404 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.404 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.404 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.404 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.404 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.404 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.404 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-15T22:28:01.404 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-15T22:28:01.404 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.404 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.405 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.405 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.405 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.405 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.405 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.405 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.405 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.405 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.405 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.405 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.405 INFO:teuthology.orchestra.run.smithi001.stdout: "ENABLE_BROWSABLE_API": { 2024-09-15T22:28:01.405 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-15T22:28:01.405 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.405 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.406 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.406 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.406 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.406 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.406 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.406 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.406 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.406 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.406 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.406 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.406 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-15T22:28:01.406 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-15T22:28:01.406 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.407 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.407 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.407 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.407 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.407 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.407 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.407 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.407 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.407 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.407 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.407 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.407 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-15T22:28:01.408 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-15T22:28:01.408 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.408 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.408 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.408 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.408 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.408 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.408 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.408 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.408 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.408 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.408 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.408 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.409 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-15T22:28:01.409 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-15T22:28:01.409 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.409 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.409 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.409 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.409 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.409 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.409 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.409 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.409 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.409 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.409 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.409 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.410 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-15T22:28:01.410 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-15T22:28:01.410 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.410 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.410 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.410 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.410 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.410 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.410 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.410 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.410 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.410 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.411 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.411 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.411 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-15T22:28:01.411 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-15T22:28:01.411 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.411 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.411 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.411 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.411 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.411 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.411 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.411 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.411 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.412 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.412 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.412 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.412 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-15T22:28:01.412 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-15T22:28:01.412 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.412 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.412 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.412 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.412 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.412 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.412 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.412 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.412 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.413 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.413 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.413 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.413 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-15T22:28:01.413 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-15T22:28:01.413 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.413 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.413 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.413 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.413 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.413 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.413 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.413 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.413 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.414 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.414 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.414 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.414 INFO:teuthology.orchestra.run.smithi001.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-15T22:28:01.414 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-15T22:28:01.414 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.414 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.414 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.414 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.414 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.414 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.414 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.414 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.415 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.415 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.415 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.415 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.415 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_PASSWORD": { 2024-09-15T22:28:01.415 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-15T22:28:01.415 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.415 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.415 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.415 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-15T22:28:01.415 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.415 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.416 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.416 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.416 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.416 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.416 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.416 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.416 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-15T22:28:01.416 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-15T22:28:01.416 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.416 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.416 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.416 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.416 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.416 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.417 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.417 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.417 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.417 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.417 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.417 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.417 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_URL": { 2024-09-15T22:28:01.417 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_URL", 2024-09-15T22:28:01.417 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.417 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.417 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.417 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.417 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.417 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.418 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.418 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.418 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.418 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.418 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.418 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.418 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_USERNAME": { 2024-09-15T22:28:01.418 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-15T22:28:01.418 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.418 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.418 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.418 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-15T22:28:01.418 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.418 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.419 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.419 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.419 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.419 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.419 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.419 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.419 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-15T22:28:01.419 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-15T22:28:01.419 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.419 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.419 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.419 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.419 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.419 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.420 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.420 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.420 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.420 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.420 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.420 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.420 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-15T22:28:01.420 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-15T22:28:01.420 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.420 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.420 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.420 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.420 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.420 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.421 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.421 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.421 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.421 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.421 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.421 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.421 INFO:teuthology.orchestra.run.smithi001.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-15T22:28:01.421 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-15T22:28:01.421 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.421 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.421 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.421 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.421 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.421 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.422 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.422 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.422 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.422 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.422 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.422 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.422 INFO:teuthology.orchestra.run.smithi001.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-15T22:28:01.422 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-15T22:28:01.422 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.422 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.422 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.422 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.422 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.422 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.422 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.422 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.423 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.423 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.423 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.423 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.423 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_HOST": { 2024-09-15T22:28:01.423 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-15T22:28:01.423 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.423 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.423 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.423 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.423 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.423 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.423 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.423 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.424 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.424 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.424 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.424 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.424 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-15T22:28:01.424 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-15T22:28:01.424 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.424 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.424 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.424 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.424 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.424 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.424 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.425 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.425 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.425 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.425 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.425 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.425 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-15T22:28:01.425 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-15T22:28:01.425 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.425 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.425 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.425 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.425 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.425 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.425 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.426 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.426 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.426 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.426 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.426 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.426 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-15T22:28:01.426 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-15T22:28:01.426 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.426 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.426 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.426 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.426 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.426 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.426 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.426 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.426 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.427 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.427 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.427 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.427 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-15T22:28:01.427 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-15T22:28:01.427 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.427 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.427 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.427 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.427 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.427 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.427 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.427 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.427 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.428 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.428 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.428 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.428 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-15T22:28:01.428 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-15T22:28:01.428 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.428 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.428 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.428 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.428 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.428 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.428 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.428 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.428 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.428 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.429 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.429 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.429 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-15T22:28:01.429 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-15T22:28:01.429 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.429 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.429 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.429 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.429 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.429 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.429 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.429 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.429 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.429 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.429 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.430 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.430 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-15T22:28:01.430 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-15T22:28:01.430 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.430 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.430 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.430 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.430 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.430 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.430 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.430 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.430 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.430 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.430 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.431 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.431 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-15T22:28:01.431 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-15T22:28:01.431 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.431 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.431 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.431 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.431 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.431 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.431 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.431 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.431 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.431 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.432 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.432 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.432 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_ENABLED": { 2024-09-15T22:28:01.432 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-15T22:28:01.432 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.432 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.432 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.432 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.432 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.432 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.432 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.432 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.432 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.432 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.433 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.433 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.433 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-15T22:28:01.433 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-15T22:28:01.433 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.433 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.433 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.433 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-15T22:28:01.433 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.433 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.433 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.433 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.433 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.434 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.434 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.434 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.434 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-15T22:28:01.434 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-15T22:28:01.434 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.434 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.434 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.434 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-15T22:28:01.434 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.434 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.434 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.434 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.435 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.435 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.435 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.435 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.435 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-15T22:28:01.435 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-15T22:28:01.435 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.435 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.435 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.435 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8", 2024-09-15T22:28:01.435 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.435 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.435 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.436 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.436 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.436 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.436 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.436 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.436 INFO:teuthology.orchestra.run.smithi001.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-15T22:28:01.436 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-15T22:28:01.436 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.436 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.436 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.436 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "45", 2024-09-15T22:28:01.436 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.436 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.437 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.437 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.437 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.437 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.437 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.437 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.437 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ACCESS_KEY": { 2024-09-15T22:28:01.437 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-15T22:28:01.437 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.437 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.437 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.437 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.437 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.438 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.438 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.438 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.438 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.438 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.438 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.438 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.438 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-15T22:28:01.438 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-15T22:28:01.438 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.438 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.438 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.438 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-15T22:28:01.439 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.439 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.439 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.439 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.439 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.439 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.439 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.439 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.439 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SECRET_KEY": { 2024-09-15T22:28:01.439 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-15T22:28:01.439 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.439 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.439 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.440 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.440 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.440 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.440 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.440 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.440 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.440 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.440 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.440 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.440 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SSL_VERIFY": { 2024-09-15T22:28:01.440 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-15T22:28:01.440 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.440 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.440 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.441 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.441 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.441 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.441 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.441 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.441 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.441 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.441 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.441 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.441 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-15T22:28:01.441 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-15T22:28:01.441 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.441 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.441 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.442 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-15T22:28:01.442 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.442 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.442 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.442 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.442 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.442 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.442 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.442 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.442 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-15T22:28:01.442 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-15T22:28:01.442 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.442 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.442 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.443 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-15T22:28:01.443 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.443 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.443 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.443 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.443 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.443 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.443 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.443 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.443 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-15T22:28:01.443 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-15T22:28:01.443 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.443 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.443 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.444 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-15T22:28:01.444 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.444 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.444 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.444 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.444 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.444 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.444 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.444 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.444 INFO:teuthology.orchestra.run.smithi001.stdout: "cross_origin_url": { 2024-09-15T22:28:01.444 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cross_origin_url", 2024-09-15T22:28:01.444 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.444 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.445 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.445 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.445 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.445 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.445 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.445 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.445 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.445 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.445 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.445 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.445 INFO:teuthology.orchestra.run.smithi001.stdout: "crt_file": { 2024-09-15T22:28:01.445 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crt_file", 2024-09-15T22:28:01.445 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.445 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.445 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.446 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.446 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.446 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.446 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.446 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.446 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.446 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.446 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.446 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.446 INFO:teuthology.orchestra.run.smithi001.stdout: "debug": { 2024-09-15T22:28:01.446 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "debug", 2024-09-15T22:28:01.446 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.446 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.446 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.446 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.447 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.447 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.447 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.447 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable/disable debug options", 2024-09-15T22:28:01.447 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.447 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.447 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.447 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.447 INFO:teuthology.orchestra.run.smithi001.stdout: "jwt_token_ttl": { 2024-09-15T22:28:01.447 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "jwt_token_ttl", 2024-09-15T22:28:01.447 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.447 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.447 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.447 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "28800", 2024-09-15T22:28:01.448 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.448 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.448 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.448 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.448 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.448 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.448 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.448 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.448 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-15T22:28:01.448 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-15T22:28:01.448 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.448 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.448 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.448 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.449 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.449 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.449 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.449 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.449 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.449 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.449 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.449 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.449 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.449 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.449 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.449 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.449 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.449 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.449 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.450 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.450 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.450 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.450 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.450 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.450 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.450 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.450 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.450 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.450 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.450 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.450 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.450 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.450 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.450 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.451 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.451 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.451 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.451 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.451 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.451 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.451 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.451 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.451 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.451 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.451 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.451 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.451 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.451 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.451 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.452 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.452 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.452 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.452 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.452 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.452 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.452 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.452 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.452 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.452 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.452 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.452 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.452 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.452 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.453 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.453 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.453 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.453 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.453 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.453 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.453 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.453 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.453 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.453 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.453 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.453 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.453 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.453 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.454 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.454 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.454 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.454 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.454 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.454 INFO:teuthology.orchestra.run.smithi001.stdout: "motd": { 2024-09-15T22:28:01.454 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "motd", 2024-09-15T22:28:01.454 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.454 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.454 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.454 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.454 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.454 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.455 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.455 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "The message of the day", 2024-09-15T22:28:01.455 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.455 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.455 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.455 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.455 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect_resolve_ip_addr": { 2024-09-15T22:28:01.455 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "redirect_resolve_ip_addr", 2024-09-15T22:28:01.455 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.455 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.455 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.455 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.455 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.456 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.456 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.456 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.456 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.456 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.456 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.456 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.456 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-15T22:28:01.456 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-15T22:28:01.456 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.456 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.456 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.456 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-15T22:28:01.457 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.457 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.457 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.457 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.457 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.457 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.457 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.457 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.457 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-15T22:28:01.457 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-15T22:28:01.457 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.457 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.457 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.457 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8080", 2024-09-15T22:28:01.458 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.458 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.458 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.458 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.458 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.458 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.458 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.458 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.458 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-15T22:28:01.458 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-15T22:28:01.458 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.458 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.458 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.459 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.459 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.459 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.459 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.459 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.459 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.459 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.459 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.459 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.459 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl_server_port": { 2024-09-15T22:28:01.459 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl_server_port", 2024-09-15T22:28:01.459 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.459 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.459 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.460 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8443", 2024-09-15T22:28:01.460 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.460 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.460 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.460 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.460 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.460 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.460 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.460 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.460 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-15T22:28:01.460 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-15T22:28:01.460 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.460 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.460 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.461 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "redirect", 2024-09-15T22:28:01.461 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.461 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.461 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.461 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.461 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect" 2024-09-15T22:28:01.461 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.461 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.461 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.461 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.461 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.461 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.461 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-15T22:28:01.461 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-15T22:28:01.461 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.462 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.462 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.462 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-15T22:28:01.462 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-15T22:28:01.462 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-15T22:28:01.462 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.462 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.462 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.462 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.462 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.462 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.462 INFO:teuthology.orchestra.run.smithi001.stdout: "url_prefix": { 2024-09-15T22:28:01.462 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url_prefix", 2024-09-15T22:28:01.462 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.463 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.463 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.463 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.463 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.463 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.463 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.463 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.463 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.463 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.463 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.463 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.463 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.463 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.463 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.464 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "devicehealth", 2024-09-15T22:28:01.464 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.464 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.464 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.464 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_monitoring": { 2024-09-15T22:28:01.464 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_monitoring", 2024-09-15T22:28:01.464 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.464 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.464 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.464 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.464 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.464 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.464 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.465 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "monitor device health metrics", 2024-09-15T22:28:01.465 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.465 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.465 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.465 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.465 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.465 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.465 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.465 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.465 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.465 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.465 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.465 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.466 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.466 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.466 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.466 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.466 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.466 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.466 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.466 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.466 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.466 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.466 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.466 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.466 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.466 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.467 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.467 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.467 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.467 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.467 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.467 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.467 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.467 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.467 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.467 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.467 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.467 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.467 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.468 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.468 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.468 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.468 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.468 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.468 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.468 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.468 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.468 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.468 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.468 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.468 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.468 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.469 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.469 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.469 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.469 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.469 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.469 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.469 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.469 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.469 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.469 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.469 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.469 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.469 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.469 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.470 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.470 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.470 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.470 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.470 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.470 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.470 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.470 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.470 INFO:teuthology.orchestra.run.smithi001.stdout: "mark_out_threshold": { 2024-09-15T22:28:01.470 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mark_out_threshold", 2024-09-15T22:28:01.470 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:01.470 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.470 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.470 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2419200", 2024-09-15T22:28:01.471 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.471 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.471 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.471 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-15T22:28:01.471 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.471 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.471 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.471 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.471 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": { 2024-09-15T22:28:01.471 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_name", 2024-09-15T22:28:01.471 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.471 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.471 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.472 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "device_health_metrics", 2024-09-15T22:28:01.472 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.472 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.472 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.472 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-15T22:28:01.472 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.472 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.472 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.472 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.472 INFO:teuthology.orchestra.run.smithi001.stdout: "retention_period": { 2024-09-15T22:28:01.472 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retention_period", 2024-09-15T22:28:01.472 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:01.473 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.473 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.473 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15552000", 2024-09-15T22:28:01.473 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.473 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.473 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.473 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain device health metrics", 2024-09-15T22:28:01.473 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.473 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.473 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.473 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.473 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_frequency": { 2024-09-15T22:28:01.473 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_frequency", 2024-09-15T22:28:01.473 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:01.474 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.474 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.474 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-15T22:28:01.474 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.474 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.474 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.474 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-15T22:28:01.474 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.474 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.474 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.474 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.474 INFO:teuthology.orchestra.run.smithi001.stdout: "self_heal": { 2024-09-15T22:28:01.474 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "self_heal", 2024-09-15T22:28:01.474 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.475 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.475 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.475 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.475 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.475 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.475 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.475 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-15T22:28:01.475 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.475 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.475 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.475 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.475 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-15T22:28:01.475 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-15T22:28:01.475 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:01.476 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.476 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.476 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-15T22:28:01.476 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.476 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.476 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.476 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and check device health", 2024-09-15T22:28:01.476 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.476 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.476 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.476 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.476 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_threshold": { 2024-09-15T22:28:01.476 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_threshold", 2024-09-15T22:28:01.477 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:01.477 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.477 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.477 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7257600", 2024-09-15T22:28:01.477 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.477 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.477 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.477 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-15T22:28:01.477 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.477 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.477 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.477 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.477 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.477 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.478 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.478 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "diskprediction_local", 2024-09-15T22:28:01.478 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.478 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.478 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.478 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.478 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.478 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.478 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.478 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.478 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.478 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.478 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.478 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.479 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.479 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.479 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.479 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.479 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.479 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.479 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.479 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.479 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.479 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.479 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.479 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.479 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.480 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.480 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.480 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.480 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.480 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.480 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.480 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.480 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.480 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.480 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.480 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.480 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.480 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.481 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.481 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.481 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.481 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.481 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.481 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.481 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.481 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.481 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.481 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.482 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.482 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.482 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.482 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.482 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.482 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.482 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.482 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.482 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.482 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.482 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.482 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.482 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.482 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.483 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.483 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.483 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.483 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.483 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.483 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.483 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.483 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.483 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.483 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.483 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.483 INFO:teuthology.orchestra.run.smithi001.stdout: "predict_interval": { 2024-09-15T22:28:01.483 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predict_interval", 2024-09-15T22:28:01.483 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.484 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.484 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.484 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-15T22:28:01.484 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.484 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.484 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.484 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.484 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.484 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.484 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.484 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.484 INFO:teuthology.orchestra.run.smithi001.stdout: "predictor_model": { 2024-09-15T22:28:01.484 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predictor_model", 2024-09-15T22:28:01.485 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.485 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.485 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.485 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "prophetstor", 2024-09-15T22:28:01.485 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.485 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.485 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.485 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.485 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.485 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.485 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.485 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.485 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-15T22:28:01.486 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-15T22:28:01.486 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.486 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.486 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.486 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-15T22:28:01.486 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.486 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.486 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.486 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.486 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.486 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.486 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.486 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.487 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.487 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.487 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.487 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "influx", 2024-09-15T22:28:01.487 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": false, 2024-09-15T22:28:01.487 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "influxdb python module not found", 2024-09-15T22:28:01.487 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.487 INFO:teuthology.orchestra.run.smithi001.stdout: "batch_size": { 2024-09-15T22:28:01.487 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "batch_size", 2024-09-15T22:28:01.487 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.487 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.487 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.487 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5000", 2024-09-15T22:28:01.487 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.488 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.488 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.488 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-15T22:28:01.488 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.488 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.488 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.488 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.488 INFO:teuthology.orchestra.run.smithi001.stdout: "database": { 2024-09-15T22:28:01.488 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "database", 2024-09-15T22:28:01.488 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.488 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.488 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.489 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "ceph", 2024-09-15T22:28:01.489 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.489 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.489 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.489 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-15T22:28:01.489 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.489 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.489 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.489 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.489 INFO:teuthology.orchestra.run.smithi001.stdout: "hostname": { 2024-09-15T22:28:01.489 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hostname", 2024-09-15T22:28:01.489 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.489 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.490 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.490 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.490 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.490 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.490 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.490 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server hostname", 2024-09-15T22:28:01.490 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.490 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.490 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.490 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.490 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-15T22:28:01.490 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-15T22:28:01.490 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:01.491 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.491 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.491 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "30", 2024-09-15T22:28:01.491 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "5", 2024-09-15T22:28:01.491 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.491 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.491 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-15T22:28:01.491 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.491 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.491 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.491 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.491 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.491 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.492 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.492 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.492 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.492 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.492 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.492 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.492 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.492 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.492 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.492 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.492 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.492 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.492 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.493 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.493 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.493 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.493 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.493 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.493 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.493 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.493 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.493 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.493 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.493 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.493 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.493 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.493 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.494 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.494 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.494 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.494 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.494 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.494 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.494 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.494 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.494 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.494 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.494 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.494 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.494 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.494 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.495 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.495 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.495 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.495 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.495 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.495 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.495 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.495 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.495 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.495 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.495 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.495 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.495 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.495 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.496 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.496 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.496 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.496 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.496 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.496 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.496 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.496 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.496 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.496 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.496 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.496 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.496 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.496 INFO:teuthology.orchestra.run.smithi001.stdout: "password": { 2024-09-15T22:28:01.497 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "password", 2024-09-15T22:28:01.497 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.497 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.497 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.497 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.497 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.497 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.497 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.497 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "password of InfluxDB server user", 2024-09-15T22:28:01.497 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.497 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.497 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.497 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.497 INFO:teuthology.orchestra.run.smithi001.stdout: "port": { 2024-09-15T22:28:01.497 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "port", 2024-09-15T22:28:01.498 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.498 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.498 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.498 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8086", 2024-09-15T22:28:01.498 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.498 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.498 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.498 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server port", 2024-09-15T22:28:01.498 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.498 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.498 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.498 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.498 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-15T22:28:01.498 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-15T22:28:01.499 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.499 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.499 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.499 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "false", 2024-09-15T22:28:01.499 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.499 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.499 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.499 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T22:28:01.499 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.499 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.499 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.499 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.499 INFO:teuthology.orchestra.run.smithi001.stdout: "threads": { 2024-09-15T22:28:01.499 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threads", 2024-09-15T22:28:01.500 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.500 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.500 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.500 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-15T22:28:01.500 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-15T22:28:01.500 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "32", 2024-09-15T22:28:01.500 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.500 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-15T22:28:01.500 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.500 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.500 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.500 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.500 INFO:teuthology.orchestra.run.smithi001.stdout: "username": { 2024-09-15T22:28:01.500 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "username", 2024-09-15T22:28:01.501 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.501 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.501 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.501 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.501 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.501 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.501 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.501 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "username of InfluxDB server user", 2024-09-15T22:28:01.501 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.501 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.501 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.501 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.501 INFO:teuthology.orchestra.run.smithi001.stdout: "verify_ssl": { 2024-09-15T22:28:01.501 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "verify_ssl", 2024-09-15T22:28:01.502 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.502 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.502 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.502 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "true", 2024-09-15T22:28:01.502 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.502 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.502 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.502 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T22:28:01.502 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.502 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.502 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.502 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.502 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.502 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.503 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.503 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "insights", 2024-09-15T22:28:01.503 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.503 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.503 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.503 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.503 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.503 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.503 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.503 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.503 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.503 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.503 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.503 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.503 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.504 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.504 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.504 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.504 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.504 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.504 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.504 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.504 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.504 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.504 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.504 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.504 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.504 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.505 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.505 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.505 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.505 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.505 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.505 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.505 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.505 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.505 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.505 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.505 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.505 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.505 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.505 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.505 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.506 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.506 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.506 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.506 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.506 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.506 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.506 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.506 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.506 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.506 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.506 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.506 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.506 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.506 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.507 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.507 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.507 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.507 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.507 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.507 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.507 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.507 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.507 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.507 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.507 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.507 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.507 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.507 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.508 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.508 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.508 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.508 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.508 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.508 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.508 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.508 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "iostat", 2024-09-15T22:28:01.508 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.508 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.508 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.508 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.508 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.508 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.509 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.509 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.509 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.509 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.509 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.509 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.509 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.509 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.509 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.509 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.509 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.509 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.509 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.509 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.510 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.510 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.510 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.510 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.510 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.510 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.510 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.510 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.510 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.510 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.510 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.510 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.510 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.510 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.510 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.510 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.511 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.511 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.511 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.511 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.511 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.511 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.511 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.511 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.511 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.511 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.511 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.511 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.511 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.511 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.512 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.512 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.512 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.512 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.512 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.512 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.512 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.512 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.512 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.512 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.512 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.512 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.512 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.512 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.512 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.513 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.513 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.513 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.513 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.513 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.513 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.513 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.513 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.513 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.513 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.513 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.513 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "k8sevents", 2024-09-15T22:28:01.513 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.513 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.514 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.514 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_event_retention_days": { 2024-09-15T22:28:01.514 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ceph_event_retention_days", 2024-09-15T22:28:01.514 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.514 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.514 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.514 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7", 2024-09-15T22:28:01.514 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.514 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.514 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.514 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-15T22:28:01.514 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.514 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.514 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.515 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.515 INFO:teuthology.orchestra.run.smithi001.stdout: "config_check_secs": { 2024-09-15T22:28:01.515 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_check_secs", 2024-09-15T22:28:01.515 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.515 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.515 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.515 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-15T22:28:01.515 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "10", 2024-09-15T22:28:01.515 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.515 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.515 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-15T22:28:01.515 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.515 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.515 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.516 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.516 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.516 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.516 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.516 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.516 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.516 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.516 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.516 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.516 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.516 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.516 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.516 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.516 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.517 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.517 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.517 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.517 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.517 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.517 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.517 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.517 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.517 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.517 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.517 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.517 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.517 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.517 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.518 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.518 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.518 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.518 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.518 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.518 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.518 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.518 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.518 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.518 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.518 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.518 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.518 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.518 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.518 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.519 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.519 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.519 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.519 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.519 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.519 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.519 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.519 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.519 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.519 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.519 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.519 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.519 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.519 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.519 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.520 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.520 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.520 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.520 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.520 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.520 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.520 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.520 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.520 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.520 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.520 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.520 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.520 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.520 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.521 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.521 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.521 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "localpool", 2024-09-15T22:28:01.521 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.521 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.521 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.521 INFO:teuthology.orchestra.run.smithi001.stdout: "failure_domain": { 2024-09-15T22:28:01.521 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "failure_domain", 2024-09-15T22:28:01.521 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.521 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.521 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.521 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "host", 2024-09-15T22:28:01.521 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.521 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.522 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.522 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "failure domain for any created local pool", 2024-09-15T22:28:01.522 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-15T22:28:01.522 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.522 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.522 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.522 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.522 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.522 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.522 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.522 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.522 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.522 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.523 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.523 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.523 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.523 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.523 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.523 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.523 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.523 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.523 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.523 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.523 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.523 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.523 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.524 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.524 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.524 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.524 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.524 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.524 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.524 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.524 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.524 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.524 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.524 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.524 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.524 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.525 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.525 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.525 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.525 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.525 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.525 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.528 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.528 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.528 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.529 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.529 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.529 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.529 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.529 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.529 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.529 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.529 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.529 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.529 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.529 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.529 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.529 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.530 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.530 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.530 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.530 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.530 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.530 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.530 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.530 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.530 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.530 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.530 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.530 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.530 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.530 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.531 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.531 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": { 2024-09-15T22:28:01.531 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_size", 2024-09-15T22:28:01.531 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.531 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.531 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.531 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.531 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.531 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.531 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.531 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default min_size for any created local pool", 2024-09-15T22:28:01.531 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-15T22:28:01.531 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.532 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.532 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.532 INFO:teuthology.orchestra.run.smithi001.stdout: "num_rep": { 2024-09-15T22:28:01.532 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "num_rep", 2024-09-15T22:28:01.532 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.532 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.532 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.532 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3", 2024-09-15T22:28:01.532 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.532 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.532 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.532 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default replica count for any created local pool", 2024-09-15T22:28:01.532 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.533 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.533 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.533 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.533 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": { 2024-09-15T22:28:01.533 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_num", 2024-09-15T22:28:01.533 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.533 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.533 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.533 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "128", 2024-09-15T22:28:01.533 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.533 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.533 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.533 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default pg_num for any created local pool", 2024-09-15T22:28:01.533 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.534 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.534 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.534 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.534 INFO:teuthology.orchestra.run.smithi001.stdout: "prefix": { 2024-09-15T22:28:01.534 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prefix", 2024-09-15T22:28:01.534 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.534 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.534 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.534 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.534 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.534 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.534 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.534 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name prefix for any created local pool", 2024-09-15T22:28:01.535 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.535 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.535 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.535 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.535 INFO:teuthology.orchestra.run.smithi001.stdout: "subtree": { 2024-09-15T22:28:01.535 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "subtree", 2024-09-15T22:28:01.535 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.535 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.535 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.535 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "rack", 2024-09-15T22:28:01.535 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.535 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.535 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.536 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-15T22:28:01.536 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-15T22:28:01.536 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.536 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.536 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.536 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.536 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.536 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.536 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mds_autoscaler", 2024-09-15T22:28:01.536 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.536 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.536 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.536 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.536 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.537 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.537 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.537 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.537 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.537 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.537 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.537 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.537 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.537 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.537 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.537 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.537 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.537 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.537 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.538 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.538 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.538 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.538 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.538 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.538 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.538 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.538 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.538 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.538 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.538 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.538 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.538 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.539 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.539 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.539 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.539 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.539 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.539 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.539 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.539 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.539 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.539 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.539 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.539 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.539 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.539 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.540 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.540 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.540 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.540 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.540 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.540 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.540 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.540 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.540 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.540 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.540 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.540 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.540 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.540 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.541 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.541 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.541 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.541 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.541 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.541 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.541 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.541 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.541 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.541 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.541 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.541 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.541 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.542 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.542 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.542 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.542 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirroring", 2024-09-15T22:28:01.542 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.542 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.542 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.542 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.542 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.542 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.542 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.542 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.542 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.543 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.543 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.543 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.543 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.543 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.543 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.543 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.543 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.543 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.543 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.543 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.543 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.543 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.543 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.544 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.544 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.544 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.544 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.544 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.544 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.544 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.544 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.544 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.544 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.544 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.544 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.544 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.545 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.545 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.545 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.545 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.545 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.545 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.545 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.545 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.545 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.545 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.545 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.545 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.545 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.545 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.546 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.546 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.546 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.546 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.546 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.546 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.546 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.546 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.546 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.546 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.546 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.546 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.546 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.546 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.547 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.547 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.547 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.547 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.547 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.547 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.547 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.547 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.547 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.547 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.547 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.547 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.547 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "nfs", 2024-09-15T22:28:01.548 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.548 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.548 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.548 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.548 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.548 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.548 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.548 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.548 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.548 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.548 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.548 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.548 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.549 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.549 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.549 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.549 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.549 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.549 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.549 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.549 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.549 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.549 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.549 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.549 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.549 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.549 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.550 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.550 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.550 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.550 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.550 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.550 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.550 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.550 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.550 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.550 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.550 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.550 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.550 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.550 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.550 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.551 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.551 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.551 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.551 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.551 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.551 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.551 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.551 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.551 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.551 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.551 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.551 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.551 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.551 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.551 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.551 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.552 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.552 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.552 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.552 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.552 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.552 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.552 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.552 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.552 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.552 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.552 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.552 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.552 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.553 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.553 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.553 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.553 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.553 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.553 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-15T22:28:01.553 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.553 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.553 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.553 INFO:teuthology.orchestra.run.smithi001.stdout: "fail_fs": { 2024-09-15T22:28:01.553 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "fail_fs", 2024-09-15T22:28:01.553 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.553 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.554 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.554 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.554 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.554 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.554 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.554 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-15T22:28:01.554 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.554 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.554 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.554 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.554 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.554 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.554 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.554 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.555 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.555 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.555 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.555 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.555 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.555 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.555 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.555 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.555 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.555 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.555 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.555 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.556 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.556 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.556 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.556 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.556 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.556 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.556 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.556 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.556 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.556 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.556 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.556 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.556 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.556 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.557 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.557 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.557 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.557 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.557 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.557 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.557 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.557 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.557 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.557 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.557 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.557 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.557 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.558 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.558 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.558 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.558 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.558 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.558 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.558 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.558 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.558 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.558 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.558 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.558 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.558 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.558 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.558 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.559 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.559 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.559 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.559 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.559 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.559 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.559 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.559 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.559 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.559 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.559 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.559 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.559 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator": { 2024-09-15T22:28:01.559 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-15T22:28:01.559 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.560 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.560 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.560 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.560 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.560 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.560 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.560 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm", 2024-09-15T22:28:01.560 INFO:teuthology.orchestra.run.smithi001.stdout: "rook", 2024-09-15T22:28:01.560 INFO:teuthology.orchestra.run.smithi001.stdout: "test_orchestrator" 2024-09-15T22:28:01.560 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.560 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Orchestrator backend", 2024-09-15T22:28:01.561 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.561 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.561 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.561 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.561 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.561 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.561 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.561 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_perf_query", 2024-09-15T22:28:01.561 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.561 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.561 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.561 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.561 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.561 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.562 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.562 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.562 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.562 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.562 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.562 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.562 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.562 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.562 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.562 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.562 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.562 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.562 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.562 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.562 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.562 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.563 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.563 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.563 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.563 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.563 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.563 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.563 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.563 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.563 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.563 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.563 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.563 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.563 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.563 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.563 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.564 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.564 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.564 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.564 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.564 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.564 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.564 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.564 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.564 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.564 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.564 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.564 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.564 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.565 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.565 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.565 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.565 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.565 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.565 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.565 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.565 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.565 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.565 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.565 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.565 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.565 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.565 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.565 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.566 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.566 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.566 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.566 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.566 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.566 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.566 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.566 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.566 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.566 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.566 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.566 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_support", 2024-09-15T22:28:01.566 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.566 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.567 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.567 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.567 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.567 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.567 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.567 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.567 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.567 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.567 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.567 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.567 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.567 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.567 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.567 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.568 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.568 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.568 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.568 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.568 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.568 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.568 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.568 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.568 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.568 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.568 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.568 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.568 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.568 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.569 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.569 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.569 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.569 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.569 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.569 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.569 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.569 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.569 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.569 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.569 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.569 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.569 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.569 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.569 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.570 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.570 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.570 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.570 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.570 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.570 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.570 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.570 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.570 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.570 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.570 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.570 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.570 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.570 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.571 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.571 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.571 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.571 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.571 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.571 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.571 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.571 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.571 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.571 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.571 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.571 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.571 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.571 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.572 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.572 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.572 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.572 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_autoscaler", 2024-09-15T22:28:01.572 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.572 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.572 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.572 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.572 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.572 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.572 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.572 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.572 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.572 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.572 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.573 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.573 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.573 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.573 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.573 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.573 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.573 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.573 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.573 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.573 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.573 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.573 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.573 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.573 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.574 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.574 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.574 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.574 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.574 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.574 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.574 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.574 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.574 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.574 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.574 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.574 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.574 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.574 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.575 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.575 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.575 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.575 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.575 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.575 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.575 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.575 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.575 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.575 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.575 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.575 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.576 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.576 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.576 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.576 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.576 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.576 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.576 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.576 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.576 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.576 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.576 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.576 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.576 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.576 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.577 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.577 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.577 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.577 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.577 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.577 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.577 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.577 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.577 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-15T22:28:01.577 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-15T22:28:01.577 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:01.577 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.577 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.578 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-15T22:28:01.578 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.578 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.578 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.578 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.578 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.578 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.578 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.578 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.578 INFO:teuthology.orchestra.run.smithi001.stdout: "threshold": { 2024-09-15T22:28:01.578 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threshold", 2024-09-15T22:28:01.578 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-15T22:28:01.578 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.579 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.579 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-15T22:28:01.579 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1.0", 2024-09-15T22:28:01.579 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.579 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.579 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "scaling threshold", 2024-09-15T22:28:01.579 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-15T22:28:01.579 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.579 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.579 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.579 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.579 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.579 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.580 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "progress", 2024-09-15T22:28:01.580 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.580 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.580 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.580 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_pg_recovery_event": { 2024-09-15T22:28:01.580 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_pg_recovery_event", 2024-09-15T22:28:01.580 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.580 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.580 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.580 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.580 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.580 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.580 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.580 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-15T22:28:01.581 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.581 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.581 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.581 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.581 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-15T22:28:01.581 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-15T22:28:01.581 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.581 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.581 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.581 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.581 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.581 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.581 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.582 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.582 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.582 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.582 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.582 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.582 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.582 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.582 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.582 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.582 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.582 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.582 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.583 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.583 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.583 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.583 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.583 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.583 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.583 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.583 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.583 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.583 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.583 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.583 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.583 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.583 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.584 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.584 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.584 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.584 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.584 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.584 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.584 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.584 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.584 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.584 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.584 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.584 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.584 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.585 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.585 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.585 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.585 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.585 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.585 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.585 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.585 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.585 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.585 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.585 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.585 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.585 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.585 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.586 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.586 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.586 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.586 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.586 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.586 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.586 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.586 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.586 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.586 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.586 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.586 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.586 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.587 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.587 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.587 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.587 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.587 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.587 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.587 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.587 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.587 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.587 INFO:teuthology.orchestra.run.smithi001.stdout: "max_completed_events": { 2024-09-15T22:28:01.587 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_completed_events", 2024-09-15T22:28:01.587 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.587 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.587 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.588 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "50", 2024-09-15T22:28:01.588 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.588 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.588 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.588 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "number of past completed events to remember", 2024-09-15T22:28:01.588 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.588 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.588 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.588 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.588 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-15T22:28:01.588 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-15T22:28:01.588 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:01.588 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.588 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.589 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-15T22:28:01.589 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.589 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.589 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.589 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long the module is going to sleep", 2024-09-15T22:28:01.589 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.589 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.589 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.589 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.589 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.589 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.589 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.589 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus", 2024-09-15T22:28:01.590 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.590 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.590 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.590 INFO:teuthology.orchestra.run.smithi001.stdout: "cache": { 2024-09-15T22:28:01.590 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cache", 2024-09-15T22:28:01.590 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.590 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.590 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.590 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.590 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.590 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.590 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.590 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.590 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.591 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.591 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.591 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.591 INFO:teuthology.orchestra.run.smithi001.stdout: "exclude_perf_counters": { 2024-09-15T22:28:01.591 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "exclude_perf_counters", 2024-09-15T22:28:01.591 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.591 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.591 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.591 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.591 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.591 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.591 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.591 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-15T22:28:01.592 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-15T22:28:01.592 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.592 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.592 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.592 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.592 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.592 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.592 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.592 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.592 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.592 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.592 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.592 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.593 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.593 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.593 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.593 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.593 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.593 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.593 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.593 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.593 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.593 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.593 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.593 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.593 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.593 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.594 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.594 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.594 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.594 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.594 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.594 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.594 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.594 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.594 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.594 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.594 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.594 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.594 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.595 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.595 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.595 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.595 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.595 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.595 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.595 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.595 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.595 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.595 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.595 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.595 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.596 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.596 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.596 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.596 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.596 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.596 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.596 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.596 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.596 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.596 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.596 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.596 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.597 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.597 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.597 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.597 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.597 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.597 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.597 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.597 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.597 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.597 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.597 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools": { 2024-09-15T22:28:01.597 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools", 2024-09-15T22:28:01.597 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.598 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.598 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.598 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.598 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.598 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.598 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.598 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.598 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.598 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.598 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.598 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.598 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-15T22:28:01.598 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-15T22:28:01.598 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.599 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.599 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.599 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "300", 2024-09-15T22:28:01.599 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.599 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.599 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.599 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.599 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.599 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.599 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.599 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.599 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_interval": { 2024-09-15T22:28:01.599 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_interval", 2024-09-15T22:28:01.599 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-15T22:28:01.599 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.600 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.600 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15.0", 2024-09-15T22:28:01.600 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.600 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.600 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.600 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.600 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.600 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.600 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.600 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.600 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-15T22:28:01.600 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-15T22:28:01.600 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.600 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.601 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.601 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-15T22:28:01.601 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.601 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.601 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.601 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-15T22:28:01.601 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.601 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.601 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.601 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.601 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-15T22:28:01.601 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-15T22:28:01.601 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.602 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.602 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.602 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "9283", 2024-09-15T22:28:01.602 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.602 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.602 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.602 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-15T22:28:01.602 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.602 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.602 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.602 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.602 INFO:teuthology.orchestra.run.smithi001.stdout: "stale_cache_strategy": { 2024-09-15T22:28:01.602 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stale_cache_strategy", 2024-09-15T22:28:01.602 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.602 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.603 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.603 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "log", 2024-09-15T22:28:01.603 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.603 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.603 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.603 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.603 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.603 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.603 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.603 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.603 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-15T22:28:01.603 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-15T22:28:01.603 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.603 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.604 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.604 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "default", 2024-09-15T22:28:01.604 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.604 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.604 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.604 INFO:teuthology.orchestra.run.smithi001.stdout: "default", 2024-09-15T22:28:01.604 INFO:teuthology.orchestra.run.smithi001.stdout: "error" 2024-09-15T22:28:01.604 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.604 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.604 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.604 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.604 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.604 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.604 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-15T22:28:01.605 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-15T22:28:01.605 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.605 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.605 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.605 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-15T22:28:01.605 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-15T22:28:01.605 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-15T22:28:01.605 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.605 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.605 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.605 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.605 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.605 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.605 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.606 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.606 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.606 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_support", 2024-09-15T22:28:01.606 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.606 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.606 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.606 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.606 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.606 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.606 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.606 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.606 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.606 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.606 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.606 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.607 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.607 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.607 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.607 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.607 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.607 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.607 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.607 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.607 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.607 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.607 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.607 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.607 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.607 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.608 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.608 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.608 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.608 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.608 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.608 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.608 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.608 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.608 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.608 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.608 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.608 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.608 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.609 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.609 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.609 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.609 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.609 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.609 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.609 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.609 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.609 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.609 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.609 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.609 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.609 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.609 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.610 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.610 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.610 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.610 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.610 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.610 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.610 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.610 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.610 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.610 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.610 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.610 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.610 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.610 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.610 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.611 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.611 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.611 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.611 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.611 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.611 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_snap_create": { 2024-09-15T22:28:01.611 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_snap_create", 2024-09-15T22:28:01.611 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.611 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.611 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.611 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-15T22:28:01.611 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.611 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.612 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.612 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.612 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.612 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.612 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.612 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.612 INFO:teuthology.orchestra.run.smithi001.stdout: "mirror_snapshot_schedule": { 2024-09-15T22:28:01.612 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirror_snapshot_schedule", 2024-09-15T22:28:01.612 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.612 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.612 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.612 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.612 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.613 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.613 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.613 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.613 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.613 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.613 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.613 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.613 INFO:teuthology.orchestra.run.smithi001.stdout: "trash_purge_schedule": { 2024-09-15T22:28:01.613 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "trash_purge_schedule", 2024-09-15T22:28:01.613 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.613 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.613 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.613 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.614 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.614 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.614 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.614 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.614 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.614 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.614 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.614 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.614 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.614 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.614 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.614 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "restful", 2024-09-15T22:28:01.614 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.614 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.615 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.615 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_auth": { 2024-09-15T22:28:01.615 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_auth", 2024-09-15T22:28:01.615 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.615 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.615 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.615 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.615 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.615 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.615 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.615 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.615 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.615 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.615 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.616 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.616 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-15T22:28:01.616 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-15T22:28:01.616 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.616 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.616 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.616 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.616 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.616 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.616 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.616 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.616 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.616 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.616 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.619 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.619 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.619 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.619 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.619 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.619 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.619 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.619 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.619 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.619 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.619 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.619 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.619 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.619 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.619 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.620 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.620 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.620 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.620 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.620 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.620 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.620 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.620 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.620 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.620 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.620 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.620 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.620 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.620 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.620 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.621 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.621 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.621 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.621 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.621 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.621 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.621 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.621 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.621 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.621 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.621 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.621 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-15T22:28:01.621 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-15T22:28:01.622 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.622 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.622 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.622 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.622 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.622 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.622 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.622 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.622 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.622 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.622 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.622 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.622 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-15T22:28:01.622 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-15T22:28:01.623 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.623 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.623 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.623 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.623 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.623 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.623 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.623 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.623 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.623 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.623 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.623 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.623 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.623 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.624 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.624 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rgw", 2024-09-15T22:28:01.624 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.624 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.624 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.624 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.624 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.624 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.624 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.624 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.624 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.624 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.624 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.624 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.624 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.624 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.625 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.625 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.625 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.625 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.625 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.625 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.625 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.625 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.625 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.625 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.625 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.625 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.625 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.626 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.626 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.626 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.626 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.626 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.626 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.626 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.626 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.626 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.626 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.626 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.626 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.626 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.626 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.627 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.627 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.627 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.627 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.627 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.627 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.627 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.627 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.627 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.627 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.627 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.627 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.627 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.628 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.628 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.628 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.628 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.628 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.628 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.628 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.628 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.628 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.628 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.628 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.628 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.628 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.628 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.629 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.629 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.629 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.629 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.629 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.629 INFO:teuthology.orchestra.run.smithi001.stdout: "secondary_zone_period_retry_limit": { 2024-09-15T22:28:01.629 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-15T22:28:01.629 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.629 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.629 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.629 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-15T22:28:01.629 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.629 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.630 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.630 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-15T22:28:01.630 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.630 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.630 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.630 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.630 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.630 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.630 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.630 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rook", 2024-09-15T22:28:01.630 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.630 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.630 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.630 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.631 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.631 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.631 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.631 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.631 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.631 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.631 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.631 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.631 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.631 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.631 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.631 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.631 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.631 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.632 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.632 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.632 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.632 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.632 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.632 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.632 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.632 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.632 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.632 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.632 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.632 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.633 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.633 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.633 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.633 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.633 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.633 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.633 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.633 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.633 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.633 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.633 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.633 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.633 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.633 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.634 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.634 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.634 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.634 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.634 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.634 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.634 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.634 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.634 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.634 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.634 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.634 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.634 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.635 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.635 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.635 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.635 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.635 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.635 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.635 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.635 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.635 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.635 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.635 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.635 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.635 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.636 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.636 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.636 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.636 INFO:teuthology.orchestra.run.smithi001.stdout: "storage_class": { 2024-09-15T22:28:01.636 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "storage_class", 2024-09-15T22:28:01.636 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.636 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.636 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.636 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "local", 2024-09-15T22:28:01.636 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.636 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.636 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.636 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-15T22:28:01.637 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.637 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.637 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.637 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.637 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.637 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.637 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.637 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "selftest", 2024-09-15T22:28:01.637 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.637 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.637 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.637 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.637 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.637 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.637 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.638 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.638 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.638 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.638 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.638 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.638 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.638 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.638 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.638 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.638 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.638 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.638 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.638 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.638 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.639 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.639 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.639 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.639 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.639 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.639 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.639 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.639 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.639 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.639 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.639 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.639 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.639 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.640 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.640 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.640 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.640 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.640 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.640 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.640 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.640 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.640 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.640 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.640 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.640 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.640 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.641 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.641 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.641 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.641 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.641 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.641 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.641 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.641 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.641 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.641 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.641 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.641 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.641 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.641 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.642 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.642 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.642 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.642 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.642 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.642 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.642 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.642 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.642 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.642 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.642 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.642 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.642 INFO:teuthology.orchestra.run.smithi001.stdout: "roption1": { 2024-09-15T22:28:01.643 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption1", 2024-09-15T22:28:01.643 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.643 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.643 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.643 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.643 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.643 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.643 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.643 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.643 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.643 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.643 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.643 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.643 INFO:teuthology.orchestra.run.smithi001.stdout: "roption2": { 2024-09-15T22:28:01.644 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption2", 2024-09-15T22:28:01.644 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.644 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.644 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.644 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "xyz", 2024-09-15T22:28:01.644 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.644 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.644 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.644 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.644 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.644 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.644 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.644 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.644 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption1": { 2024-09-15T22:28:01.645 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption1", 2024-09-15T22:28:01.645 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.645 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.645 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.645 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.645 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.645 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.645 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.645 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.645 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.645 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.645 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.645 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.645 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption2": { 2024-09-15T22:28:01.646 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption2", 2024-09-15T22:28:01.646 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.646 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.646 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.646 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.646 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.646 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.646 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.646 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.646 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.646 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.646 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.646 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.646 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption3": { 2024-09-15T22:28:01.647 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption3", 2024-09-15T22:28:01.647 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-15T22:28:01.647 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.647 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.647 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.647 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.647 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.647 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.647 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.647 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.647 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.647 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.647 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.647 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption4": { 2024-09-15T22:28:01.647 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption4", 2024-09-15T22:28:01.648 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.648 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.648 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.648 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.648 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.648 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.648 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.648 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.648 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.648 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.648 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.648 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.648 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption5": { 2024-09-15T22:28:01.649 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption5", 2024-09-15T22:28:01.649 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.649 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.649 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.649 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.649 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.649 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.649 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.649 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.649 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.649 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.649 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.649 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.650 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption6": { 2024-09-15T22:28:01.650 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption6", 2024-09-15T22:28:01.650 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.650 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.650 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.650 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.650 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.650 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.650 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.650 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.650 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.650 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.650 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.650 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.651 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption7": { 2024-09-15T22:28:01.651 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption7", 2024-09-15T22:28:01.651 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.651 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.651 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.651 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.651 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-15T22:28:01.651 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "42", 2024-09-15T22:28:01.651 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.651 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.651 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.651 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.651 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.651 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.651 INFO:teuthology.orchestra.run.smithi001.stdout: "testkey": { 2024-09-15T22:28:01.652 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testkey", 2024-09-15T22:28:01.652 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.652 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.652 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.652 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.652 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.652 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.652 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.652 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.652 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.652 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.652 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.652 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.652 INFO:teuthology.orchestra.run.smithi001.stdout: "testlkey": { 2024-09-15T22:28:01.653 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testlkey", 2024-09-15T22:28:01.653 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.653 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.653 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.653 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.653 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.653 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.653 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.653 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.653 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.653 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.653 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.653 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.653 INFO:teuthology.orchestra.run.smithi001.stdout: "testnewline": { 2024-09-15T22:28:01.654 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testnewline", 2024-09-15T22:28:01.654 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.654 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.654 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.654 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.654 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.654 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.654 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.654 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.654 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.654 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.654 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.654 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.654 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.655 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.655 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.655 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snap_schedule", 2024-09-15T22:28:01.655 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.655 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.655 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.655 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_m_granularity": { 2024-09-15T22:28:01.655 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_m_granularity", 2024-09-15T22:28:01.655 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.655 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.655 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.655 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.655 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.655 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.656 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.656 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow minute scheduled snapshots", 2024-09-15T22:28:01.656 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.656 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.656 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.656 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.656 INFO:teuthology.orchestra.run.smithi001.stdout: "dump_on_update": { 2024-09-15T22:28:01.656 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dump_on_update", 2024-09-15T22:28:01.656 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.656 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.656 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.656 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.656 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.657 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.657 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.657 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "dump database to debug log on update", 2024-09-15T22:28:01.657 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.657 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.657 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.657 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.657 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.657 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.657 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.657 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.657 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.657 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.658 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.658 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.658 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.658 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.658 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.658 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.658 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.658 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.658 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.658 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.658 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.658 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.658 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.658 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.659 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.659 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.659 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.659 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.659 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.659 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.659 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.659 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.659 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.659 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.659 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.659 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.659 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.660 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.660 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.660 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.660 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.660 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.660 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.660 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.660 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.660 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.660 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.660 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.660 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.660 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.660 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.661 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.661 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.661 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.661 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.661 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.661 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.661 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.661 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.661 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.661 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.661 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.661 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.661 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.662 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.662 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.662 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.662 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.662 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.662 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.662 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.662 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.662 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.662 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.662 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.662 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.662 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.662 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stats", 2024-09-15T22:28:01.663 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.663 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.663 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.663 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.663 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.663 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.663 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.663 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.663 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.663 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.663 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.663 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.663 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.663 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.664 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.664 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.664 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.664 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.664 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.664 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.664 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.664 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.664 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.664 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.664 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.664 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.665 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.665 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.665 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.665 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.665 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.665 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.665 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.665 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.665 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.665 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.665 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.665 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.665 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.665 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.666 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.666 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.666 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.666 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.666 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.666 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.666 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.666 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.666 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.666 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.666 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.666 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.666 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.667 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.667 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.667 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.667 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.667 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.667 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.667 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.667 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.667 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.667 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.667 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.667 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.667 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.667 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.667 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.668 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.668 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.668 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.668 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.668 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.668 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.668 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.668 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.668 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "status", 2024-09-15T22:28:01.668 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.668 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.668 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.668 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.668 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.669 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.669 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.669 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.669 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.669 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.669 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.669 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.669 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.669 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.669 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.669 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.669 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.669 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.670 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.670 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.670 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.670 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.670 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.670 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.670 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.670 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.670 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.670 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.670 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.670 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.670 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.670 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.671 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.671 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.671 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.671 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.671 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.671 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.671 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.671 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.671 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.671 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.671 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.671 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.671 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.671 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.671 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.672 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.672 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.672 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.672 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.672 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.672 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.672 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.672 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.672 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.672 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.672 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.672 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.672 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.672 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.673 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.673 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.673 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.673 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.673 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.673 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.673 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.673 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.673 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.673 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.673 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.673 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.673 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.673 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.674 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.674 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telegraf", 2024-09-15T22:28:01.674 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.674 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.674 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.674 INFO:teuthology.orchestra.run.smithi001.stdout: "address": { 2024-09-15T22:28:01.674 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "address", 2024-09-15T22:28:01.674 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.674 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.674 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.674 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-15T22:28:01.674 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.674 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.675 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.675 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.675 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.675 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.675 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.675 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.675 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-15T22:28:01.675 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-15T22:28:01.675 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:01.675 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.675 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.675 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15", 2024-09-15T22:28:01.675 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.675 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.676 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.676 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.676 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.676 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.676 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.676 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.676 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.676 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.676 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.676 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.676 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.676 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.676 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.676 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.677 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.677 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.677 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.677 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.677 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.677 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.677 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.677 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.677 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.677 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.677 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.677 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.677 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.678 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.678 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.678 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.678 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.678 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.678 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.678 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.678 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.678 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.678 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.678 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.678 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.678 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.678 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.679 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.679 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.679 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.679 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.679 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.679 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.679 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.679 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.679 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.679 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.679 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.679 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.679 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.679 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.680 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.680 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.680 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.680 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.680 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.680 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.680 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.680 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.680 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.680 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.680 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.680 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.680 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.680 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.681 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.681 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.681 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.681 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.681 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.681 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.681 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.681 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.681 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.681 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.681 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telemetry", 2024-09-15T22:28:01.681 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.681 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.681 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.682 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_basic": { 2024-09-15T22:28:01.682 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_basic", 2024-09-15T22:28:01.682 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.682 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.682 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.682 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.682 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.682 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.682 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.682 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-15T22:28:01.682 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.682 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.682 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.682 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.683 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_crash": { 2024-09-15T22:28:01.683 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_crash", 2024-09-15T22:28:01.683 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.683 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.683 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.683 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.683 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.683 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.683 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.683 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-15T22:28:01.683 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.683 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.683 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.683 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.684 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_device": { 2024-09-15T22:28:01.684 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_device", 2024-09-15T22:28:01.684 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.684 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.684 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.684 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.684 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.684 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.684 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.684 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-15T22:28:01.684 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.684 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.684 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.684 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.685 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_ident": { 2024-09-15T22:28:01.685 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_ident", 2024-09-15T22:28:01.685 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.685 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.685 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.685 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.685 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.685 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.685 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.685 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-15T22:28:01.685 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.685 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.685 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.685 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.686 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_perf": { 2024-09-15T22:28:01.686 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_perf", 2024-09-15T22:28:01.686 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.686 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.686 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.686 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.686 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.686 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.686 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.686 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-15T22:28:01.686 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.686 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.686 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.686 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.687 INFO:teuthology.orchestra.run.smithi001.stdout: "contact": { 2024-09-15T22:28:01.687 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "contact", 2024-09-15T22:28:01.687 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.687 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.687 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.687 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.687 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.687 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.687 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.687 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.687 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.687 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.687 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.688 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.688 INFO:teuthology.orchestra.run.smithi001.stdout: "description": { 2024-09-15T22:28:01.688 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "description", 2024-09-15T22:28:01.688 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.688 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.688 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.688 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.688 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.688 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.688 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.688 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.688 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.688 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.689 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.689 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.689 INFO:teuthology.orchestra.run.smithi001.stdout: "device_url": { 2024-09-15T22:28:01.689 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_url", 2024-09-15T22:28:01.689 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.689 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.689 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.689 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-15T22:28:01.689 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.689 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.689 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.689 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.689 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.689 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.689 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.690 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.690 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-15T22:28:01.690 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-15T22:28:01.690 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.690 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.690 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.690 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.690 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.690 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.690 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.690 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.690 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.690 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.690 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.691 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.691 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-15T22:28:01.691 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-15T22:28:01.691 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.691 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.691 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.691 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "24", 2024-09-15T22:28:01.691 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "8", 2024-09-15T22:28:01.691 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.691 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.691 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.691 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.691 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.692 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.692 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.692 INFO:teuthology.orchestra.run.smithi001.stdout: "last_opt_revision": { 2024-09-15T22:28:01.692 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "last_opt_revision", 2024-09-15T22:28:01.692 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.692 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.692 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.692 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1", 2024-09-15T22:28:01.692 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.692 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.692 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.692 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.692 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.692 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.693 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.693 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.693 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard": { 2024-09-15T22:28:01.693 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard", 2024-09-15T22:28:01.693 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.693 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.693 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.693 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.693 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.693 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.693 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.693 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.693 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.694 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.694 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.694 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.694 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard_description": { 2024-09-15T22:28:01.694 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard_description", 2024-09-15T22:28:01.694 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.694 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.694 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.694 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.694 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.694 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.694 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.694 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.695 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.695 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.695 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.695 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.695 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.695 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.695 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.695 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.695 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.695 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.695 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.695 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.695 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.695 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.696 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.696 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.696 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.696 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.696 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.696 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.696 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.696 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.696 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.696 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.696 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.696 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.696 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.697 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.697 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.697 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.697 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.697 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.697 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.697 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.697 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.697 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.697 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.697 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.697 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.697 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.698 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.698 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.698 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.698 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.698 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.698 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.698 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.698 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.698 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.698 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.698 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.698 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.698 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.698 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.699 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.699 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.699 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.699 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.699 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.699 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.699 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.699 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.699 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.699 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.699 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.699 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.699 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.700 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.700 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.700 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.700 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.700 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.700 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.700 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.700 INFO:teuthology.orchestra.run.smithi001.stdout: "organization": { 2024-09-15T22:28:01.700 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "organization", 2024-09-15T22:28:01.700 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.700 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.700 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.700 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.701 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.701 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.701 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.701 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.701 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.701 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.701 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.701 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.701 INFO:teuthology.orchestra.run.smithi001.stdout: "proxy": { 2024-09-15T22:28:01.701 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "proxy", 2024-09-15T22:28:01.701 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.701 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.701 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.701 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.702 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.702 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.702 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.702 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.702 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.702 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.702 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.702 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.702 INFO:teuthology.orchestra.run.smithi001.stdout: "url": { 2024-09-15T22:28:01.702 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url", 2024-09-15T22:28:01.702 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.702 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.702 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.702 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-15T22:28:01.703 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.703 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.703 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.703 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.703 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.703 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.703 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.703 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.703 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.703 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.703 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.703 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "test_orchestrator", 2024-09-15T22:28:01.703 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.703 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.703 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.704 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.704 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.704 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.704 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.704 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.704 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.704 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.704 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.704 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.704 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.704 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.704 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.704 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.705 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.705 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.705 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.705 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.705 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.705 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.705 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.705 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.705 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.705 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.705 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.705 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.705 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.705 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.705 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.706 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.706 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.706 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.706 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.706 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.706 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.706 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.706 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.706 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.706 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.706 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.706 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.706 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.706 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.707 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.707 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.707 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.707 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.707 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.707 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.707 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.707 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.707 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.707 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.707 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.707 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.707 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.707 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.708 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.708 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.708 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.708 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.708 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.708 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.708 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.708 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.708 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.708 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.708 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.708 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.708 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.709 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.709 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.709 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.709 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.709 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "volumes", 2024-09-15T22:28:01.709 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.709 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.709 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.709 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.709 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.709 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.709 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.709 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.710 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.710 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.710 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.710 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.710 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.710 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.710 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.710 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.710 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.710 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.710 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.710 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.710 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.710 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.710 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.711 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.711 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.711 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.711 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.711 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.711 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.711 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.711 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.711 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.711 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.711 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.711 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.711 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.711 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.712 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.712 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.712 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.712 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.712 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.712 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.712 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.712 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.712 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.712 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.712 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.712 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.712 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.712 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.713 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.713 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.713 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.713 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.713 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.713 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.713 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.713 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.713 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.713 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.713 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.713 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.713 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.713 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.714 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.714 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.714 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.714 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.714 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.714 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.714 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.714 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.714 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_clones": { 2024-09-15T22:28:01.714 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_clones", 2024-09-15T22:28:01.714 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.714 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.714 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.714 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4", 2024-09-15T22:28:01.715 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.715 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.715 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.715 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-15T22:28:01.715 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.715 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.715 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.715 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.715 INFO:teuthology.orchestra.run.smithi001.stdout: "periodic_async_work": { 2024-09-15T22:28:01.715 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "periodic_async_work", 2024-09-15T22:28:01.715 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.715 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.715 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.716 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.716 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.716 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.716 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.716 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Periodically check for async work", 2024-09-15T22:28:01.716 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.716 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.716 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.716 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.716 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_delay": { 2024-09-15T22:28:01.716 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_delay", 2024-09-15T22:28:01.716 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.716 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.716 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.717 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-15T22:28:01.717 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.717 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.717 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.717 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-15T22:28:01.717 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.717 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.717 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.717 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.717 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_no_wait": { 2024-09-15T22:28:01.717 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_no_wait", 2024-09-15T22:28:01.717 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.717 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.718 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.718 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-15T22:28:01.718 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.718 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.718 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.718 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-15T22:28:01.718 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.718 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.718 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.718 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.718 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.718 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.718 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.718 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix", 2024-09-15T22:28:01.719 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-15T22:28:01.719 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-15T22:28:01.719 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-15T22:28:01.719 INFO:teuthology.orchestra.run.smithi001.stdout: "discovery_interval": { 2024-09-15T22:28:01.719 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "discovery_interval", 2024-09-15T22:28:01.719 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-15T22:28:01.719 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.719 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.719 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "100", 2024-09-15T22:28:01.719 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.719 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.719 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.719 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.720 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.720 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.720 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.720 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.720 INFO:teuthology.orchestra.run.smithi001.stdout: "identifier": { 2024-09-15T22:28:01.720 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "identifier", 2024-09-15T22:28:01.720 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.720 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.720 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.720 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.720 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.720 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.720 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.720 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.721 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.721 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.721 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.721 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.721 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-15T22:28:01.721 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-15T22:28:01.721 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-15T22:28:01.721 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.721 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.721 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-15T22:28:01.721 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.721 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.721 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.721 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.722 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.722 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.722 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.722 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.722 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-15T22:28:01.722 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-15T22:28:01.722 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.722 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.722 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.722 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.722 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.722 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.723 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.723 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.723 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.723 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.723 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.723 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.723 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.723 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.723 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.723 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.723 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.723 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.723 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.723 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-15T22:28:01.724 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-15T22:28:01.724 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.724 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.724 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.724 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.724 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.724 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.724 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.724 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.724 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.724 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.724 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.724 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.724 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-15T22:28:01.725 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-15T22:28:01.725 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.725 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.725 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.725 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-15T22:28:01.725 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.725 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.725 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-15T22:28:01.725 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-15T22:28:01.725 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-15T22:28:01.725 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-15T22:28:01.725 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-15T22:28:01.725 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-15T22:28:01.726 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-15T22:28:01.726 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.726 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.726 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.726 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.726 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.726 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.726 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-15T22:28:01.726 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-15T22:28:01.726 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-15T22:28:01.726 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.726 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-15T22:28:01.726 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-15T22:28:01.727 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.727 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.727 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.727 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.727 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.727 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.727 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.727 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.727 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_host": { 2024-09-15T22:28:01.727 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_host", 2024-09-15T22:28:01.727 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.727 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.727 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.727 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-15T22:28:01.728 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.728 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.728 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.728 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.728 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.728 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.728 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.728 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.728 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_port": { 2024-09-15T22:28:01.728 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_port", 2024-09-15T22:28:01.728 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-15T22:28:01.728 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.728 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.729 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10051", 2024-09-15T22:28:01.729 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.729 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.729 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.729 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.729 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.729 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.729 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.729 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.729 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_sender": { 2024-09-15T22:28:01.729 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_sender", 2024-09-15T22:28:01.729 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-15T22:28:01.729 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-15T22:28:01.729 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-15T22:28:01.730 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-15T22:28:01.730 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-15T22:28:01.730 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-15T22:28:01.730 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-15T22:28:01.730 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-15T22:28:01.730 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-15T22:28:01.730 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-15T22:28:01.730 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-15T22:28:01.730 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.730 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.730 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.732 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.732 INFO:teuthology.orchestra.run.smithi001.stdout: "services": { 2024-09-15T22:28:01.732 INFO:teuthology.orchestra.run.smithi001.stdout: "dashboard": "https://172.21.15.1:8443/" 2024-09-15T22:28:01.732 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.732 INFO:teuthology.orchestra.run.smithi001.stdout: "always_on_modules": { 2024-09-15T22:28:01.733 INFO:teuthology.orchestra.run.smithi001.stdout: "octopus": [ 2024-09-15T22:28:01.733 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-09-15T22:28:01.733 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-09-15T22:28:01.733 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-09-15T22:28:01.733 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-09-15T22:28:01.733 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-09-15T22:28:01.733 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-09-15T22:28:01.733 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-09-15T22:28:01.733 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-09-15T22:28:01.733 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-09-15T22:28:01.733 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-09-15T22:28:01.733 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.733 INFO:teuthology.orchestra.run.smithi001.stdout: "pacific": [ 2024-09-15T22:28:01.733 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-09-15T22:28:01.734 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-09-15T22:28:01.734 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-09-15T22:28:01.734 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-09-15T22:28:01.734 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-09-15T22:28:01.734 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-09-15T22:28:01.734 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-09-15T22:28:01.734 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-09-15T22:28:01.734 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-09-15T22:28:01.734 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-09-15T22:28:01.734 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.734 INFO:teuthology.orchestra.run.smithi001.stdout: "quincy": [ 2024-09-15T22:28:01.734 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-09-15T22:28:01.734 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-09-15T22:28:01.734 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-09-15T22:28:01.735 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-09-15T22:28:01.735 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-09-15T22:28:01.735 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-09-15T22:28:01.735 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-09-15T22:28:01.735 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-09-15T22:28:01.735 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-09-15T22:28:01.735 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-09-15T22:28:01.735 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.735 INFO:teuthology.orchestra.run.smithi001.stdout: "reef": [ 2024-09-15T22:28:01.735 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-09-15T22:28:01.735 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-09-15T22:28:01.735 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-09-15T22:28:01.735 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-09-15T22:28:01.735 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-09-15T22:28:01.736 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-09-15T22:28:01.736 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-09-15T22:28:01.736 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-09-15T22:28:01.736 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-09-15T22:28:01.736 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-09-15T22:28:01.736 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-15T22:28:01.736 INFO:teuthology.orchestra.run.smithi001.stdout: "squid": [ 2024-09-15T22:28:01.736 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-09-15T22:28:01.736 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-09-15T22:28:01.736 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-09-15T22:28:01.736 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-09-15T22:28:01.736 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-09-15T22:28:01.736 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-09-15T22:28:01.736 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-09-15T22:28:01.737 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-09-15T22:28:01.737 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-09-15T22:28:01.737 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-09-15T22:28:01.737 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-15T22:28:01.737 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.737 INFO:teuthology.orchestra.run.smithi001.stdout: "last_failure_osd_epoch": 3, 2024-09-15T22:28:01.737 INFO:teuthology.orchestra.run.smithi001.stdout: "active_clients": [ 2024-09-15T22:28:01.737 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.737 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "devicehealth", 2024-09-15T22:28:01.737 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-15T22:28:01.737 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.737 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-15T22:28:01.737 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:0", 2024-09-15T22:28:01.737 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 379317950 2024-09-15T22:28:01.738 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.738 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-15T22:28:01.738 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.738 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.738 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "libcephsqlite", 2024-09-15T22:28:01.738 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-15T22:28:01.738 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.738 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-15T22:28:01.738 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:0", 2024-09-15T22:28:01.738 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2728247418 2024-09-15T22:28:01.738 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.738 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-15T22:28:01.738 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.738 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.739 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_support", 2024-09-15T22:28:01.739 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-15T22:28:01.739 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.739 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-15T22:28:01.739 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:0", 2024-09-15T22:28:01.739 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 193522291 2024-09-15T22:28:01.739 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.739 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-15T22:28:01.739 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:01.739 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.739 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "volumes", 2024-09-15T22:28:01.739 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-15T22:28:01.739 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T22:28:01.739 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-15T22:28:01.740 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:0", 2024-09-15T22:28:01.740 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1354528810 2024-09-15T22:28:01.740 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.740 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-15T22:28:01.740 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:01.740 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-15T22:28:01.740 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-15T22:28:01.742 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:00 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/1236700860' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T22:28:01.742 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:00 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/2709364421' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-15T22:28:01.742 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:00 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/1844732859' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-15T22:28:01.742 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:01 smithi098 ceph-mon[35514]: pgmap v450: 97 pgs: 97 active+clean; 92 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 371 op/s 2024-09-15T22:28:01.742 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:01 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/285966533' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-15T22:28:01.742 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:00 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/1236700860' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T22:28:01.742 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:00 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/2709364421' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-15T22:28:01.742 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:00 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/1844732859' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-15T22:28:01.742 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:01 smithi012 ceph-mon[34883]: pgmap v450: 97 pgs: 97 active+clean; 92 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 371 op/s 2024-09-15T22:28:01.743 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:01 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/285966533' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-15T22:28:01.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.382+0000 7f2e33600640 1 -- 172.21.15.1:0/285966533 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2e140a3250 msgr2=0x7f2e140a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:01.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.382+0000 7f2e33600640 1 --2- 172.21.15.1:0/285966533 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2e140a3250 0x7f2e140a5710 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2e180314e0 tx=0x7f2e18000bc0 comp rx=0 tx=0).stop 2024-09-15T22:28:01.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.382+0000 7f2e33600640 1 -- 172.21.15.1:0/285966533 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e2c103d40 msgr2=0x7f2e2c19a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:01.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.382+0000 7f2e33600640 1 --2- 172.21.15.1:0/285966533 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e2c103d40 0x7f2e2c19a070 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2e2000d950 tx=0x7f2e2000de10 comp rx=0 tx=0).stop 2024-09-15T22:28:01.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.382+0000 7f2e33600640 1 -- 172.21.15.1:0/285966533 shutdown_connections 2024-09-15T22:28:01.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.382+0000 7f2e33600640 1 --2- 172.21.15.1:0/285966533 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f2e140a3250 0x7f2e140a5710 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:01.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.382+0000 7f2e33600640 1 --2- 172.21.15.1:0/285966533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e2c1058f0 0x7f2e2c1a1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:01.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.382+0000 7f2e33600640 1 --2- 172.21.15.1:0/285966533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e2c104f30 0x7f2e2c19a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:01.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.382+0000 7f2e33600640 1 --2- 172.21.15.1:0/285966533 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e2c103d40 0x7f2e2c19a070 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:01.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.382+0000 7f2e33600640 1 -- 172.21.15.1:0/285966533 >> 172.21.15.1:0/285966533 conn(0x7f2e2c0ff4e0 msgr2=0x7f2e2c108300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:28:01.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.382+0000 7f2e33600640 1 -- 172.21.15.1:0/285966533 shutdown_connections 2024-09-15T22:28:01.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:00.382+0000 7f2e33600640 1 -- 172.21.15.1:0/285966533 wait complete. 2024-09-15T22:28:01.751 DEBUG:tasks.check_counter:Getting stats from a 2024-09-15T22:28:01.751 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-15T22:28:01.752 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:01 smithi001 ceph-mon[30843]: pgmap v450: 97 pgs: 97 active+clean; 92 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 371 op/s 2024-09-15T22:28:01.752 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:01 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/285966533' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-15T22:28:02.139 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:28:02.752 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-15T22:28:02.752 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:28:02.752 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 0, 2024-09-15T22:28:02.752 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 2, 2024-09-15T22:28:02.753 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 0, 2024-09-15T22:28:02.753 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 0, 2024-09-15T22:28:02.753 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 4, 2024-09-15T22:28:02.753 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 0, 2024-09-15T22:28:02.753 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.003362089, 2024-09-15T22:28:02.753 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.000000000, 2024-09-15T22:28:02.754 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.000441831, 2024-09-15T22:28:02.754 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:28:02.754 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:02.754 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-15T22:28:02.754 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-15T22:28:02.754 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-15T22:28:02.755 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:02.755 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:02.755 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-15T22:28:02.755 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-15T22:28:02.755 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-15T22:28:02.755 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:02.756 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T22:28:02.756 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T22:28:02.756 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:02.756 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:28:02.756 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 98, 2024-09-15T22:28:02.757 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 93, 2024-09-15T22:28:02.757 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 446784, 2024-09-15T22:28:02.757 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 55200, 2024-09-15T22:28:02.757 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 2, 2024-09-15T22:28:02.757 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 1, 2024-09-15T22:28:02.758 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.021929581, 2024-09-15T22:28:02.758 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.008391960, 2024-09-15T22:28:02.758 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.017967480, 2024-09-15T22:28:02.758 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:28:02.758 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:02.759 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 93, 2024-09-15T22:28:02.759 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.012356640, 2024-09-15T22:28:02.759 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000132867 2024-09-15T22:28:02.759 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:02.759 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:02.759 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-15T22:28:02.759 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-15T22:28:02.760 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-15T22:28:02.760 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:02.760 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 446784, 2024-09-15T22:28:02.760 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 55200 2024-09-15T22:28:02.760 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:02.760 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:28:02.760 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 1, 2024-09-15T22:28:02.760 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 69, 2024-09-15T22:28:02.760 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 160, 2024-09-15T22:28:02.760 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 90672, 2024-09-15T22:28:02.761 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 3, 2024-09-15T22:28:02.761 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 2, 2024-09-15T22:28:02.761 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.008534532, 2024-09-15T22:28:02.761 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.006016002, 2024-09-15T22:28:02.762 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.001417613, 2024-09-15T22:28:02.762 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:28:02.762 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:02.762 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 67, 2024-09-15T22:28:02.762 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.004237080, 2024-09-15T22:28:02.762 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000063240 2024-09-15T22:28:02.762 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:02.762 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:02.762 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-15T22:28:02.762 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-15T22:28:02.762 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-15T22:28:02.762 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:02.763 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-15T22:28:02.763 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 90672 2024-09-15T22:28:02.763 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:02.763 INFO:teuthology.orchestra.run.smithi001.stdout: "cct": { 2024-09-15T22:28:02.763 INFO:teuthology.orchestra.run.smithi001.stdout: "total_workers": 0, 2024-09-15T22:28:02.763 INFO:teuthology.orchestra.run.smithi001.stdout: "unhealthy_workers": 0 2024-09-15T22:28:02.763 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:02.763 INFO:teuthology.orchestra.run.smithi001.stdout: "mempool": { 2024-09-15T22:28:02.763 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:28:02.763 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_items": 0, 2024-09-15T22:28:02.763 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:28:02.763 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:28:02.763 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:28:02.764 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:28:02.764 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:28:02.764 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:28:02.764 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:28:02.764 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:28:02.764 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:28:02.764 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:28:02.764 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:28:02.764 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:28:02.764 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:28:02.765 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_items": 0, 2024-09-15T22:28:02.765 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:28:02.765 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_items": 0, 2024-09-15T22:28:02.765 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:28:02.765 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:28:02.765 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:28:02.765 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:28:02.765 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:28:02.765 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:28:02.766 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:28:02.766 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_items": 0, 2024-09-15T22:28:02.766 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:28:02.766 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:28:02.766 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:28:02.766 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_items": 0, 2024-09-15T22:28:02.766 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_bytes": 0, 2024-09-15T22:28:02.766 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_items": 0, 2024-09-15T22:28:02.766 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:28:02.766 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:28:02.766 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:28:02.766 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:28:02.767 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_bytes": 148823, 2024-09-15T22:28:02.767 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_items": 27, 2024-09-15T22:28:02.767 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:28:02.767 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_items": 0, 2024-09-15T22:28:02.767 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_bytes": 0, 2024-09-15T22:28:02.767 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_items": 0, 2024-09-15T22:28:02.767 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:28:02.767 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_items": 0, 2024-09-15T22:28:02.767 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:28:02.767 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_items": 0, 2024-09-15T22:28:02.767 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_bytes": 0, 2024-09-15T22:28:02.767 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_items": 0, 2024-09-15T22:28:02.768 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:28:02.768 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:28:02.768 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_bytes": 0, 2024-09-15T22:28:02.768 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_items": 0, 2024-09-15T22:28:02.768 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_bytes": 928, 2024-09-15T22:28:02.768 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_items": 2, 2024-09-15T22:28:02.769 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_bytes": 0, 2024-09-15T22:28:02.769 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_items": 0, 2024-09-15T22:28:02.769 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_bytes": 0, 2024-09-15T22:28:02.769 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_items": 0 2024-09-15T22:28:02.769 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:02.769 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:28:02.770 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-15T22:28:02.770 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 104857600, 2024-09-15T22:28:02.770 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-15T22:28:02.770 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 95, 2024-09-15T22:28:02.770 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 430502, 2024-09-15T22:28:02.770 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:02.770 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 95, 2024-09-15T22:28:02.770 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 0, 2024-09-15T22:28:02.770 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 0, 2024-09-15T22:28:02.770 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 95, 2024-09-15T22:28:02.770 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 430502, 2024-09-15T22:28:02.770 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-15T22:28:02.770 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-15T22:28:02.770 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-15T22:28:02.771 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-15T22:28:02.771 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:02.771 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:02.771 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-15T22:28:03.375 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:03 smithi001 ceph-mon[30843]: pgmap v451: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 352 op/s 2024-09-15T22:28:03.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:03 smithi012 ceph-mon[34883]: pgmap v451: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 352 op/s 2024-09-15T22:28:03.560 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:03 smithi098 ceph-mon[35514]: pgmap v451: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 352 op/s 2024-09-15T22:28:03.664 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-15T22:28:03.664 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-15T22:28:03.664 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-09-15T22:28:03.664 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-09-15T22:28:03.664 DEBUG:tasks.check_counter:Getting stats from d 2024-09-15T22:28:03.664 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-15T22:28:04.044 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:28:04.776 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-15T22:28:04.776 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:28:04.776 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 0, 2024-09-15T22:28:04.776 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 2, 2024-09-15T22:28:04.776 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 0, 2024-09-15T22:28:04.776 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 0, 2024-09-15T22:28:04.776 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 4, 2024-09-15T22:28:04.777 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 0, 2024-09-15T22:28:04.777 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.003702637, 2024-09-15T22:28:04.777 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.000000000, 2024-09-15T22:28:04.777 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.000811516, 2024-09-15T22:28:04.777 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:28:04.777 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:04.777 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-15T22:28:04.777 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-15T22:28:04.777 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-15T22:28:04.777 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:04.777 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:04.777 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-15T22:28:04.777 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-15T22:28:04.777 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-15T22:28:04.778 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:04.778 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T22:28:04.778 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T22:28:04.778 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:04.778 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:28:04.778 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 104, 2024-09-15T22:28:04.778 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 99, 2024-09-15T22:28:04.778 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 448416, 2024-09-15T22:28:04.778 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 59040, 2024-09-15T22:28:04.778 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 2, 2024-09-15T22:28:04.778 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 1, 2024-09-15T22:28:04.778 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.025072992, 2024-09-15T22:28:04.778 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.009713105, 2024-09-15T22:28:04.779 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.020994519, 2024-09-15T22:28:04.779 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:28:04.779 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:04.779 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 99, 2024-09-15T22:28:04.779 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.013307186, 2024-09-15T22:28:04.779 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000134416 2024-09-15T22:28:04.779 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:04.779 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:04.779 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-15T22:28:04.779 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-15T22:28:04.779 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-15T22:28:04.779 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:04.779 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 448416, 2024-09-15T22:28:04.779 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 59040 2024-09-15T22:28:04.780 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:04.780 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:28:04.780 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 1, 2024-09-15T22:28:04.780 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 73, 2024-09-15T22:28:04.780 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 160, 2024-09-15T22:28:04.780 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 91376, 2024-09-15T22:28:04.780 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 3, 2024-09-15T22:28:04.780 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 2, 2024-09-15T22:28:04.780 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.010824774, 2024-09-15T22:28:04.780 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.007516080, 2024-09-15T22:28:04.780 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.002070119, 2024-09-15T22:28:04.780 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:28:04.780 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:04.781 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 71, 2024-09-15T22:28:04.781 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.006100017, 2024-09-15T22:28:04.781 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000085915 2024-09-15T22:28:04.781 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:04.781 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:04.781 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-15T22:28:04.781 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-15T22:28:04.781 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-15T22:28:04.781 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:04.781 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-15T22:28:04.781 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 91376 2024-09-15T22:28:04.781 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:04.782 INFO:teuthology.orchestra.run.smithi001.stdout: "cct": { 2024-09-15T22:28:04.782 INFO:teuthology.orchestra.run.smithi001.stdout: "total_workers": 0, 2024-09-15T22:28:04.782 INFO:teuthology.orchestra.run.smithi001.stdout: "unhealthy_workers": 0 2024-09-15T22:28:04.782 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:04.782 INFO:teuthology.orchestra.run.smithi001.stdout: "mempool": { 2024-09-15T22:28:04.782 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:28:04.782 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_items": 0, 2024-09-15T22:28:04.782 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:28:04.782 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:28:04.782 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:28:04.782 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:28:04.782 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:28:04.782 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:28:04.782 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:28:04.783 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:28:04.783 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:28:04.783 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:28:04.783 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:28:04.783 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:28:04.783 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:28:04.783 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_items": 0, 2024-09-15T22:28:04.783 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:28:04.783 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_items": 0, 2024-09-15T22:28:04.783 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:28:04.783 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:28:04.783 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:28:04.783 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:28:04.783 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:28:04.784 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:28:04.784 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:28:04.784 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_items": 0, 2024-09-15T22:28:04.784 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:28:04.784 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:28:04.784 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:28:04.784 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_items": 0, 2024-09-15T22:28:04.784 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_bytes": 0, 2024-09-15T22:28:04.784 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_items": 0, 2024-09-15T22:28:04.784 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:28:04.784 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:28:04.784 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:28:04.785 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:28:04.785 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_bytes": 150885, 2024-09-15T22:28:04.785 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_items": 29, 2024-09-15T22:28:04.785 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:28:04.785 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_items": 0, 2024-09-15T22:28:04.785 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_bytes": 0, 2024-09-15T22:28:04.785 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_items": 0, 2024-09-15T22:28:04.785 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:28:04.785 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_items": 0, 2024-09-15T22:28:04.785 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:28:04.785 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_items": 0, 2024-09-15T22:28:04.785 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_bytes": 0, 2024-09-15T22:28:04.786 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_items": 0, 2024-09-15T22:28:04.786 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:28:04.786 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:28:04.786 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_bytes": 0, 2024-09-15T22:28:04.786 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_items": 0, 2024-09-15T22:28:04.786 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_bytes": 928, 2024-09-15T22:28:04.786 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_items": 2, 2024-09-15T22:28:04.786 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_bytes": 0, 2024-09-15T22:28:04.786 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_items": 0, 2024-09-15T22:28:04.786 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_bytes": 0, 2024-09-15T22:28:04.786 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_items": 0 2024-09-15T22:28:04.786 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:04.786 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:28:04.786 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-15T22:28:04.787 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 104857600, 2024-09-15T22:28:04.787 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-15T22:28:04.787 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 101, 2024-09-15T22:28:04.787 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 431282, 2024-09-15T22:28:04.787 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:04.787 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 101, 2024-09-15T22:28:04.787 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 0, 2024-09-15T22:28:04.787 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 0, 2024-09-15T22:28:04.787 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 101, 2024-09-15T22:28:04.787 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 431282, 2024-09-15T22:28:04.787 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-15T22:28:04.787 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-15T22:28:04.787 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-15T22:28:04.787 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-15T22:28:04.788 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:04.788 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:04.788 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-15T22:28:05.373 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:05 smithi001 ceph-mon[30843]: pgmap v452: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 721 KiB/s wr, 251 op/s 2024-09-15T22:28:05.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:05 smithi012 ceph-mon[34883]: pgmap v452: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 721 KiB/s wr, 251 op/s 2024-09-15T22:28:05.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:05 smithi098 ceph-mon[35514]: pgmap v452: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 721 KiB/s wr, 251 op/s 2024-09-15T22:28:05.724 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-15T22:28:05.724 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-15T22:28:05.724 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-15T22:28:05.724 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-15T22:28:05.724 DEBUG:tasks.check_counter:Getting stats from g 2024-09-15T22:28:05.725 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-15T22:28:06.100 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:28:06.716 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-15T22:28:06.716 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:28:06.716 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 0, 2024-09-15T22:28:06.716 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 2, 2024-09-15T22:28:06.716 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 0, 2024-09-15T22:28:06.716 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 0, 2024-09-15T22:28:06.716 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 4, 2024-09-15T22:28:06.716 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 0, 2024-09-15T22:28:06.716 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.004002944, 2024-09-15T22:28:06.717 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.000000000, 2024-09-15T22:28:06.717 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.000612967, 2024-09-15T22:28:06.717 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:28:06.717 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:06.717 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-15T22:28:06.717 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-15T22:28:06.717 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-15T22:28:06.717 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:06.717 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:06.717 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-15T22:28:06.718 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-15T22:28:06.718 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-15T22:28:06.718 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:06.718 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T22:28:06.718 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T22:28:06.718 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:06.718 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:28:06.718 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 1, 2024-09-15T22:28:06.718 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 70, 2024-09-15T22:28:06.718 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 160, 2024-09-15T22:28:06.718 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 90848, 2024-09-15T22:28:06.719 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 3, 2024-09-15T22:28:06.719 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 2, 2024-09-15T22:28:06.719 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.009696770, 2024-09-15T22:28:06.719 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.006651376, 2024-09-15T22:28:06.719 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.001911097, 2024-09-15T22:28:06.719 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:28:06.719 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:06.719 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 68, 2024-09-15T22:28:06.719 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.004997483, 2024-09-15T22:28:06.719 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000073492 2024-09-15T22:28:06.719 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:06.719 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:06.719 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-15T22:28:06.720 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-15T22:28:06.720 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-15T22:28:06.720 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:06.720 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-15T22:28:06.720 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 90848 2024-09-15T22:28:06.720 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:06.720 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:28:06.720 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 100, 2024-09-15T22:28:06.720 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 95, 2024-09-15T22:28:06.720 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 447328, 2024-09-15T22:28:06.721 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 56480, 2024-09-15T22:28:06.721 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 2, 2024-09-15T22:28:06.721 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 1, 2024-09-15T22:28:06.721 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.023144250, 2024-09-15T22:28:06.721 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.008932227, 2024-09-15T22:28:06.721 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.019115750, 2024-09-15T22:28:06.721 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:28:06.721 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:06.721 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 95, 2024-09-15T22:28:06.721 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.012390796, 2024-09-15T22:28:06.722 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000130429 2024-09-15T22:28:06.722 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:06.722 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:06.722 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-15T22:28:06.722 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-15T22:28:06.722 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-15T22:28:06.722 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:06.722 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 447328, 2024-09-15T22:28:06.722 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 56480 2024-09-15T22:28:06.722 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:06.723 INFO:teuthology.orchestra.run.smithi001.stdout: "cct": { 2024-09-15T22:28:06.723 INFO:teuthology.orchestra.run.smithi001.stdout: "total_workers": 0, 2024-09-15T22:28:06.723 INFO:teuthology.orchestra.run.smithi001.stdout: "unhealthy_workers": 0 2024-09-15T22:28:06.723 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:06.723 INFO:teuthology.orchestra.run.smithi001.stdout: "mempool": { 2024-09-15T22:28:06.723 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:28:06.723 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_items": 0, 2024-09-15T22:28:06.723 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:28:06.723 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:28:06.723 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:28:06.724 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:28:06.724 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:28:06.724 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:28:06.724 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:28:06.724 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:28:06.724 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:28:06.724 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:28:06.724 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:28:06.724 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:28:06.724 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:28:06.724 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_items": 0, 2024-09-15T22:28:06.725 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:28:06.725 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_items": 0, 2024-09-15T22:28:06.725 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:28:06.725 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:28:06.725 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:28:06.725 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:28:06.725 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:28:06.725 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:28:06.725 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:28:06.725 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_items": 0, 2024-09-15T22:28:06.726 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:28:06.726 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:28:06.726 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:28:06.726 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_items": 0, 2024-09-15T22:28:06.726 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_bytes": 0, 2024-09-15T22:28:06.726 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_items": 0, 2024-09-15T22:28:06.726 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:28:06.726 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:28:06.726 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:28:06.726 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:28:06.726 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_bytes": 149854, 2024-09-15T22:28:06.727 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_items": 28, 2024-09-15T22:28:06.727 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:28:06.727 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_items": 0, 2024-09-15T22:28:06.727 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_bytes": 0, 2024-09-15T22:28:06.727 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_items": 0, 2024-09-15T22:28:06.727 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:28:06.727 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_items": 0, 2024-09-15T22:28:06.727 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:28:06.727 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_items": 0, 2024-09-15T22:28:06.727 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_bytes": 0, 2024-09-15T22:28:06.727 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_items": 0, 2024-09-15T22:28:06.727 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:28:06.727 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:28:06.728 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_bytes": 0, 2024-09-15T22:28:06.728 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_items": 0, 2024-09-15T22:28:06.728 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_bytes": 928, 2024-09-15T22:28:06.728 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_items": 2, 2024-09-15T22:28:06.728 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_bytes": 0, 2024-09-15T22:28:06.728 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_items": 0, 2024-09-15T22:28:06.728 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_bytes": 0, 2024-09-15T22:28:06.728 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_items": 0 2024-09-15T22:28:06.728 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:06.728 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:28:06.728 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-15T22:28:06.728 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 104857600, 2024-09-15T22:28:06.729 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-15T22:28:06.729 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 97, 2024-09-15T22:28:06.729 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 430762, 2024-09-15T22:28:06.729 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:06.729 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 97, 2024-09-15T22:28:06.729 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 0, 2024-09-15T22:28:06.729 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 0, 2024-09-15T22:28:06.729 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 97, 2024-09-15T22:28:06.729 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 430762, 2024-09-15T22:28:06.729 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-15T22:28:06.729 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-15T22:28:06.729 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-15T22:28:06.730 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-15T22:28:06.730 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:06.730 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:06.730 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-15T22:28:07.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:07 smithi001 ceph-mon[30843]: pgmap v453: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 722 KiB/s wr, 256 op/s 2024-09-15T22:28:07.495 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:07 smithi012 ceph-mon[34883]: pgmap v453: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 722 KiB/s wr, 256 op/s 2024-09-15T22:28:07.560 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:07 smithi098 ceph-mon[35514]: pgmap v453: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 722 KiB/s wr, 256 op/s 2024-09-15T22:28:07.656 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-15T22:28:07.656 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-15T22:28:07.656 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-09-15T22:28:07.656 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-09-15T22:28:07.656 DEBUG:tasks.check_counter:Getting stats from j 2024-09-15T22:28:07.656 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-15T22:28:08.036 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:28:08.596 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-15T22:28:08.596 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:28:08.596 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 106, 2024-09-15T22:28:08.597 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 101, 2024-09-15T22:28:08.597 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 448960, 2024-09-15T22:28:08.597 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 60320, 2024-09-15T22:28:08.597 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 4, 2024-09-15T22:28:08.597 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 0, 2024-09-15T22:28:08.597 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.026790815, 2024-09-15T22:28:08.597 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.009924789, 2024-09-15T22:28:08.597 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.018444191, 2024-09-15T22:28:08.597 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:28:08.597 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:08.597 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 101, 2024-09-15T22:28:08.597 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.014507415, 2024-09-15T22:28:08.597 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000143637 2024-09-15T22:28:08.598 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:08.598 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:08.598 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-15T22:28:08.598 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-15T22:28:08.598 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-15T22:28:08.598 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:08.598 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 448960, 2024-09-15T22:28:08.598 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 60320 2024-09-15T22:28:08.598 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:08.598 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:28:08.598 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 1, 2024-09-15T22:28:08.598 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 75, 2024-09-15T22:28:08.598 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 160, 2024-09-15T22:28:08.598 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 91728, 2024-09-15T22:28:08.599 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 3, 2024-09-15T22:28:08.599 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 2, 2024-09-15T22:28:08.599 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.008982785, 2024-09-15T22:28:08.599 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.006204216, 2024-09-15T22:28:08.599 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.001659091, 2024-09-15T22:28:08.599 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:28:08.599 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:08.599 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 73, 2024-09-15T22:28:08.599 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.004437595, 2024-09-15T22:28:08.599 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000060788 2024-09-15T22:28:08.599 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:08.599 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:08.599 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-15T22:28:08.600 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-15T22:28:08.600 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-15T22:28:08.600 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:08.600 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-15T22:28:08.600 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 91728 2024-09-15T22:28:08.600 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:08.600 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:28:08.600 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 0, 2024-09-15T22:28:08.600 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 2, 2024-09-15T22:28:08.600 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 0, 2024-09-15T22:28:08.600 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 0, 2024-09-15T22:28:08.600 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 2, 2024-09-15T22:28:08.600 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 1, 2024-09-15T22:28:08.600 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.000672884, 2024-09-15T22:28:08.601 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.000000000, 2024-09-15T22:28:08.601 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.000496526, 2024-09-15T22:28:08.601 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:28:08.601 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:08.601 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-15T22:28:08.601 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-15T22:28:08.601 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-15T22:28:08.601 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:08.601 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:08.601 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-15T22:28:08.601 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-15T22:28:08.601 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-15T22:28:08.602 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:08.602 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T22:28:08.602 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T22:28:08.602 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:08.602 INFO:teuthology.orchestra.run.smithi001.stdout: "cct": { 2024-09-15T22:28:08.602 INFO:teuthology.orchestra.run.smithi001.stdout: "total_workers": 0, 2024-09-15T22:28:08.602 INFO:teuthology.orchestra.run.smithi001.stdout: "unhealthy_workers": 0 2024-09-15T22:28:08.602 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:08.602 INFO:teuthology.orchestra.run.smithi001.stdout: "mempool": { 2024-09-15T22:28:08.602 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:28:08.602 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_items": 0, 2024-09-15T22:28:08.602 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:28:08.602 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:28:08.602 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:28:08.603 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:28:08.603 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:28:08.603 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:28:08.603 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:28:08.603 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:28:08.603 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:28:08.603 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:28:08.603 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:28:08.603 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:28:08.603 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:28:08.603 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_items": 0, 2024-09-15T22:28:08.604 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:28:08.604 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_items": 0, 2024-09-15T22:28:08.604 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:28:08.604 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:28:08.604 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:28:08.604 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:28:08.604 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:28:08.604 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:28:08.604 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:28:08.604 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_items": 0, 2024-09-15T22:28:08.604 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:28:08.604 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:28:08.604 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:28:08.605 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_items": 0, 2024-09-15T22:28:08.605 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_bytes": 0, 2024-09-15T22:28:08.605 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_items": 0, 2024-09-15T22:28:08.605 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:28:08.605 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:28:08.605 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:28:08.605 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:28:08.605 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_bytes": 148840, 2024-09-15T22:28:08.605 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_items": 28, 2024-09-15T22:28:08.605 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:28:08.605 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_items": 0, 2024-09-15T22:28:08.605 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_bytes": 0, 2024-09-15T22:28:08.605 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_items": 0, 2024-09-15T22:28:08.606 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:28:08.606 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_items": 0, 2024-09-15T22:28:08.606 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:28:08.606 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_items": 0, 2024-09-15T22:28:08.606 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_bytes": 0, 2024-09-15T22:28:08.606 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_items": 0, 2024-09-15T22:28:08.606 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:28:08.606 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:28:08.606 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_bytes": 0, 2024-09-15T22:28:08.606 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_items": 0, 2024-09-15T22:28:08.606 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_bytes": 928, 2024-09-15T22:28:08.606 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_items": 2, 2024-09-15T22:28:08.606 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_bytes": 0, 2024-09-15T22:28:08.606 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_items": 0, 2024-09-15T22:28:08.607 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_bytes": 0, 2024-09-15T22:28:08.607 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_items": 0 2024-09-15T22:28:08.607 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T22:28:08.607 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:28:08.607 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-15T22:28:08.607 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 104857600, 2024-09-15T22:28:08.607 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-15T22:28:08.607 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 103, 2024-09-15T22:28:08.607 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 431542, 2024-09-15T22:28:08.607 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:08.608 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 103, 2024-09-15T22:28:08.608 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 0, 2024-09-15T22:28:08.608 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 0, 2024-09-15T22:28:08.608 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 103, 2024-09-15T22:28:08.608 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 431542, 2024-09-15T22:28:08.608 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-15T22:28:08.608 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-15T22:28:08.608 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-15T22:28:08.608 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-15T22:28:08.608 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:08.608 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T22:28:08.608 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-15T22:28:09.284 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:09 smithi001 ceph-mon[30843]: pgmap v454: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 358 KiB/s wr, 121 op/s 2024-09-15T22:28:09.321 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-15T22:28:09.321 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-15T22:28:09.321 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-15T22:28:09.321 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-15T22:28:09.321 DEBUG:tasks.check_counter:Getting stats from b 2024-09-15T22:28:09.321 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-15T22:28:09.349 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:09 smithi012 ceph-mon[34883]: pgmap v454: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 358 KiB/s wr, 121 op/s 2024-09-15T22:28:09.560 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:09 smithi098 ceph-mon[35514]: pgmap v454: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 358 KiB/s wr, 121 op/s 2024-09-15T22:28:09.586 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:28:10.060 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-15T22:28:10.060 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:28:10.060 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 20401, 2024-09-15T22:28:10.060 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 46871, 2024-09-15T22:28:10.061 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 7047974, 2024-09-15T22:28:10.061 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 39338472, 2024-09-15T22:28:10.061 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 13, 2024-09-15T22:28:10.061 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 9, 2024-09-15T22:28:10.061 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 1.274463449, 2024-09-15T22:28:10.061 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.641919450, 2024-09-15T22:28:10.061 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.926887951, 2024-09-15T22:28:10.061 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.099234605, 2024-09-15T22:28:10.061 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:10.061 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 46866, 2024-09-15T22:28:10.061 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 1.056776511, 2024-09-15T22:28:10.061 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000022548 2024-09-15T22:28:10.061 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.062 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:10.062 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 27036, 2024-09-15T22:28:10.062 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.007359767, 2024-09-15T22:28:10.062 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000272 2024-09-15T22:28:10.062 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.062 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 498656, 2024-09-15T22:28:10.062 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 63280 2024-09-15T22:28:10.062 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.062 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:28:10.062 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 15958, 2024-09-15T22:28:10.062 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 24492, 2024-09-15T22:28:10.062 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 11935122, 2024-09-15T22:28:10.062 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 21971448, 2024-09-15T22:28:10.062 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 8, 2024-09-15T22:28:10.063 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 5, 2024-09-15T22:28:10.063 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 1.105666207, 2024-09-15T22:28:10.063 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.489431058, 2024-09-15T22:28:10.063 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.558890667, 2024-09-15T22:28:10.063 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.100694149, 2024-09-15T22:28:10.063 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:10.063 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 24493, 2024-09-15T22:28:10.063 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.622160035, 2024-09-15T22:28:10.063 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000025401 2024-09-15T22:28:10.063 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.063 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:10.063 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 32280, 2024-09-15T22:28:10.064 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.005743573, 2024-09-15T22:28:10.064 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000177 2024-09-15T22:28:10.064 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.064 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-09-15T22:28:10.064 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 200768 2024-09-15T22:28:10.064 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.064 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:28:10.064 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 26990, 2024-09-15T22:28:10.064 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 27279, 2024-09-15T22:28:10.064 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 9824060, 2024-09-15T22:28:10.064 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 30171951, 2024-09-15T22:28:10.064 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 10, 2024-09-15T22:28:10.065 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 6, 2024-09-15T22:28:10.065 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 1.396769036, 2024-09-15T22:28:10.065 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.573290169, 2024-09-15T22:28:10.065 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.861803435, 2024-09-15T22:28:10.065 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.107544388, 2024-09-15T22:28:10.065 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:10.065 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 27279, 2024-09-15T22:28:10.065 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.593457431, 2024-09-15T22:28:10.065 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000021755 2024-09-15T22:28:10.066 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.066 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:10.066 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 45995, 2024-09-15T22:28:10.066 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.006383908, 2024-09-15T22:28:10.066 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000138 2024-09-15T22:28:10.066 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.066 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T22:28:10.066 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T22:28:10.066 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.066 INFO:teuthology.orchestra.run.smithi012.stdout: "cct": { 2024-09-15T22:28:10.066 INFO:teuthology.orchestra.run.smithi012.stdout: "total_workers": 1, 2024-09-15T22:28:10.066 INFO:teuthology.orchestra.run.smithi012.stdout: "unhealthy_workers": 0 2024-09-15T22:28:10.066 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.067 INFO:teuthology.orchestra.run.smithi012.stdout: "finisher-MDSRank": { 2024-09-15T22:28:10.067 INFO:teuthology.orchestra.run.smithi012.stdout: "queue_len": 0, 2024-09-15T22:28:10.067 INFO:teuthology.orchestra.run.smithi012.stdout: "complete_latency": { 2024-09-15T22:28:10.067 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 2828, 2024-09-15T22:28:10.067 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 9.257139221, 2024-09-15T22:28:10.067 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.003273387 2024-09-15T22:28:10.067 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-15T22:28:10.067 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.067 INFO:teuthology.orchestra.run.smithi012.stdout: "finisher-PurgeQueue": { 2024-09-15T22:28:10.067 INFO:teuthology.orchestra.run.smithi012.stdout: "queue_len": 0, 2024-09-15T22:28:10.067 INFO:teuthology.orchestra.run.smithi012.stdout: "complete_latency": { 2024-09-15T22:28:10.067 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 13303, 2024-09-15T22:28:10.067 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 1.713727176, 2024-09-15T22:28:10.067 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000128822 2024-09-15T22:28:10.068 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-15T22:28:10.068 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.068 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": { 2024-09-15T22:28:10.068 INFO:teuthology.orchestra.run.smithi012.stdout: "request": 11206, 2024-09-15T22:28:10.068 INFO:teuthology.orchestra.run.smithi012.stdout: "reply": 11165, 2024-09-15T22:28:10.068 INFO:teuthology.orchestra.run.smithi012.stdout: "reply_latency": { 2024-09-15T22:28:10.068 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 11165, 2024-09-15T22:28:10.068 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 22.618529447, 2024-09-15T22:28:10.068 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.002025842 2024-09-15T22:28:10.068 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.068 INFO:teuthology.orchestra.run.smithi012.stdout: "slow_reply": 0, 2024-09-15T22:28:10.068 INFO:teuthology.orchestra.run.smithi012.stdout: "forward": 41, 2024-09-15T22:28:10.068 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_fetch_complete": 1, 2024-09-15T22:28:10.068 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_fetch_keys": 0, 2024-09-15T22:28:10.069 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_commit": 12, 2024-09-15T22:28:10.069 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_split": 0, 2024-09-15T22:28:10.069 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_merge": 1, 2024-09-15T22:28:10.069 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes": 556, 2024-09-15T22:28:10.069 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_top": 254, 2024-09-15T22:28:10.069 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_bottom": 126, 2024-09-15T22:28:10.069 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_pin_tail": 176, 2024-09-15T22:28:10.069 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_pinned": 191, 2024-09-15T22:28:10.069 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_expired": 2071, 2024-09-15T22:28:10.069 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_with_caps": 0, 2024-09-15T22:28:10.069 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": 0, 2024-09-15T22:28:10.069 INFO:teuthology.orchestra.run.smithi012.stdout: "subtrees": 4, 2024-09-15T22:28:10.069 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse": 15973, 2024-09-15T22:28:10.070 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_hit": 13902, 2024-09-15T22:28:10.070 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_forward": 39, 2024-09-15T22:28:10.070 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_discover": 1027, 2024-09-15T22:28:10.070 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_dir_fetch": 0, 2024-09-15T22:28:10.070 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_remote_ino": 0, 2024-09-15T22:28:10.070 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_lock": 5, 2024-09-15T22:28:10.070 INFO:teuthology.orchestra.run.smithi012.stdout: "load_cent": 9320, 2024-09-15T22:28:10.070 INFO:teuthology.orchestra.run.smithi012.stdout: "q": 0, 2024-09-15T22:28:10.070 INFO:teuthology.orchestra.run.smithi012.stdout: "exported": 9, 2024-09-15T22:28:10.070 INFO:teuthology.orchestra.run.smithi012.stdout: "exported_inodes": 96, 2024-09-15T22:28:10.070 INFO:teuthology.orchestra.run.smithi012.stdout: "imported": 26, 2024-09-15T22:28:10.070 INFO:teuthology.orchestra.run.smithi012.stdout: "imported_inodes": 8015, 2024-09-15T22:28:10.070 INFO:teuthology.orchestra.run.smithi012.stdout: "openino_dir_fetch": 0, 2024-09-15T22:28:10.071 INFO:teuthology.orchestra.run.smithi012.stdout: "openino_backtrace_fetch": 0, 2024-09-15T22:28:10.071 INFO:teuthology.orchestra.run.smithi012.stdout: "openino_peer_discover": 15, 2024-09-15T22:28:10.071 INFO:teuthology.orchestra.run.smithi012.stdout: "root_rfiles": 3343, 2024-09-15T22:28:10.071 INFO:teuthology.orchestra.run.smithi012.stdout: "root_rbytes": 23882834, 2024-09-15T22:28:10.071 INFO:teuthology.orchestra.run.smithi012.stdout: "root_rsnaps": 0, 2024-09-15T22:28:10.071 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_backtrace_fetch": 0, 2024-09-15T22:28:10.071 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_set_tag": 0, 2024-09-15T22:28:10.071 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T22:28:10.071 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_inotable_repaired": 0, 2024-09-15T22:28:10.071 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_dir_inodes": 0, 2024-09-15T22:28:10.071 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T22:28:10.071 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_dirfrag_rstats": 0, 2024-09-15T22:28:10.071 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_file_inodes": 0, 2024-09-15T22:28:10.072 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_inode_file_caps": 14, 2024-09-15T22:28:10.072 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_revoke": 1841, 2024-09-15T22:28:10.072 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_grant": 10253, 2024-09-15T22:28:10.072 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_trunc": 34, 2024-09-15T22:28:10.072 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T22:28:10.072 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T22:28:10.072 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_caps": 5571, 2024-09-15T22:28:10.072 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_caps_dirty": 3499, 2024-09-15T22:28:10.072 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_cap_release": 95, 2024-09-15T22:28:10.072 INFO:teuthology.orchestra.run.smithi012.stdout: "process_request_cap_release": 9736 2024-09-15T22:28:10.072 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.072 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_cache": { 2024-09-15T22:28:10.072 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_update": 1534, 2024-09-15T22:28:10.073 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_update_receipt": 2843, 2024-09-15T22:28:10.073 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_try_discover": 1910, 2024-09-15T22:28:10.073 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_send_discover": 1909, 2024-09-15T22:28:10.073 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_handle_discover": 3059, 2024-09-15T22:28:10.073 INFO:teuthology.orchestra.run.smithi012.stdout: "num_strays": 157, 2024-09-15T22:28:10.073 INFO:teuthology.orchestra.run.smithi012.stdout: "num_strays_delayed": 0, 2024-09-15T22:28:10.073 INFO:teuthology.orchestra.run.smithi012.stdout: "num_strays_enqueuing": 0, 2024-09-15T22:28:10.073 INFO:teuthology.orchestra.run.smithi012.stdout: "strays_created": 8209, 2024-09-15T22:28:10.073 INFO:teuthology.orchestra.run.smithi012.stdout: "strays_enqueued": 8017, 2024-09-15T22:28:10.073 INFO:teuthology.orchestra.run.smithi012.stdout: "strays_reintegrated": 34, 2024-09-15T22:28:10.073 INFO:teuthology.orchestra.run.smithi012.stdout: "strays_migrated": 5, 2024-09-15T22:28:10.073 INFO:teuthology.orchestra.run.smithi012.stdout: "num_recovering_processing": 0, 2024-09-15T22:28:10.073 INFO:teuthology.orchestra.run.smithi012.stdout: "num_recovering_enqueued": 0, 2024-09-15T22:28:10.074 INFO:teuthology.orchestra.run.smithi012.stdout: "num_recovering_prioritized": 0, 2024-09-15T22:28:10.074 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_started": 0, 2024-09-15T22:28:10.074 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_completed": 0, 2024-09-15T22:28:10.074 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_quiesce_path": 0, 2024-09-15T22:28:10.074 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_quiesce_inode": 0, 2024-09-15T22:28:10.074 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T22:28:10.074 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_exportdir": 9, 2024-09-15T22:28:10.074 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_flush": 0, 2024-09-15T22:28:10.074 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_fragmentdir": 1, 2024-09-15T22:28:10.074 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_fragstats": 0, 2024-09-15T22:28:10.075 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_inodestats": 0 2024-09-15T22:28:10.075 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.075 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_log": { 2024-09-15T22:28:10.075 INFO:teuthology.orchestra.run.smithi012.stdout: "evlrg": 2, 2024-09-15T22:28:10.075 INFO:teuthology.orchestra.run.smithi012.stdout: "evadd": 26301, 2024-09-15T22:28:10.075 INFO:teuthology.orchestra.run.smithi012.stdout: "evex": 0, 2024-09-15T22:28:10.075 INFO:teuthology.orchestra.run.smithi012.stdout: "evtrm": 0, 2024-09-15T22:28:10.075 INFO:teuthology.orchestra.run.smithi012.stdout: "ev": 26301, 2024-09-15T22:28:10.075 INFO:teuthology.orchestra.run.smithi012.stdout: "evexg": 0, 2024-09-15T22:28:10.075 INFO:teuthology.orchestra.run.smithi012.stdout: "evexd": 0, 2024-09-15T22:28:10.075 INFO:teuthology.orchestra.run.smithi012.stdout: "segadd": 34, 2024-09-15T22:28:10.075 INFO:teuthology.orchestra.run.smithi012.stdout: "segex": 0, 2024-09-15T22:28:10.075 INFO:teuthology.orchestra.run.smithi012.stdout: "segtrm": 0, 2024-09-15T22:28:10.076 INFO:teuthology.orchestra.run.smithi012.stdout: "seg": 34, 2024-09-15T22:28:10.076 INFO:teuthology.orchestra.run.smithi012.stdout: "segmjr": 4, 2024-09-15T22:28:10.076 INFO:teuthology.orchestra.run.smithi012.stdout: "segexg": 0, 2024-09-15T22:28:10.076 INFO:teuthology.orchestra.run.smithi012.stdout: "segexd": 0, 2024-09-15T22:28:10.076 INFO:teuthology.orchestra.run.smithi012.stdout: "expos": 4194304, 2024-09-15T22:28:10.076 INFO:teuthology.orchestra.run.smithi012.stdout: "wrpos": 59950574, 2024-09-15T22:28:10.076 INFO:teuthology.orchestra.run.smithi012.stdout: "rdpos": 0, 2024-09-15T22:28:10.076 INFO:teuthology.orchestra.run.smithi012.stdout: "jlat": { 2024-09-15T22:28:10.076 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 1476, 2024-09-15T22:28:10.076 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 10.896639390, 2024-09-15T22:28:10.076 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.007382547 2024-09-15T22:28:10.076 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.076 INFO:teuthology.orchestra.run.smithi012.stdout: "replayed": 0 2024-09-15T22:28:10.077 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.077 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_mem": { 2024-09-15T22:28:10.077 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 188, 2024-09-15T22:28:10.077 INFO:teuthology.orchestra.run.smithi012.stdout: "ino+": 9163, 2024-09-15T22:28:10.077 INFO:teuthology.orchestra.run.smithi012.stdout: "ino-": 8975, 2024-09-15T22:28:10.077 INFO:teuthology.orchestra.run.smithi012.stdout: "dir": 205, 2024-09-15T22:28:10.077 INFO:teuthology.orchestra.run.smithi012.stdout: "dir+": 1861, 2024-09-15T22:28:10.077 INFO:teuthology.orchestra.run.smithi012.stdout: "dir-": 1656, 2024-09-15T22:28:10.077 INFO:teuthology.orchestra.run.smithi012.stdout: "dn": 593, 2024-09-15T22:28:10.077 INFO:teuthology.orchestra.run.smithi012.stdout: "dn+": 18735, 2024-09-15T22:28:10.077 INFO:teuthology.orchestra.run.smithi012.stdout: "dn-": 18142, 2024-09-15T22:28:10.077 INFO:teuthology.orchestra.run.smithi012.stdout: "cap": 0, 2024-09-15T22:28:10.077 INFO:teuthology.orchestra.run.smithi012.stdout: "cap+": 8414, 2024-09-15T22:28:10.078 INFO:teuthology.orchestra.run.smithi012.stdout: "cap-": 8414, 2024-09-15T22:28:10.078 INFO:teuthology.orchestra.run.smithi012.stdout: "rss": 120432, 2024-09-15T22:28:10.078 INFO:teuthology.orchestra.run.smithi012.stdout: "heap": 223520 2024-09-15T22:28:10.078 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.078 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_server": { 2024-09-15T22:28:10.078 INFO:teuthology.orchestra.run.smithi012.stdout: "dispatch_client_request": 16809, 2024-09-15T22:28:10.078 INFO:teuthology.orchestra.run.smithi012.stdout: "dispatch_server_request": 262, 2024-09-15T22:28:10.078 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_request": 11206, 2024-09-15T22:28:10.078 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_session": 113, 2024-09-15T22:28:10.078 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_peer_request": 529, 2024-09-15T22:28:10.078 INFO:teuthology.orchestra.run.smithi012.stdout: "req_create_latency": { 2024-09-15T22:28:10.078 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 142, 2024-09-15T22:28:10.078 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.179521321, 2024-09-15T22:28:10.078 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.001264234 2024-09-15T22:28:10.079 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.079 INFO:teuthology.orchestra.run.smithi012.stdout: "req_getattr_latency": { 2024-09-15T22:28:10.079 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 13, 2024-09-15T22:28:10.079 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.080715133, 2024-09-15T22:28:10.079 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.006208856 2024-09-15T22:28:10.079 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.079 INFO:teuthology.orchestra.run.smithi012.stdout: "req_getfilelock_latency": { 2024-09-15T22:28:10.079 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:10.079 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:10.079 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:10.079 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.079 INFO:teuthology.orchestra.run.smithi012.stdout: "req_link_latency": { 2024-09-15T22:28:10.079 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 49, 2024-09-15T22:28:10.079 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.074570823, 2024-09-15T22:28:10.080 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.001521853 2024-09-15T22:28:10.080 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.080 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookup_latency": { 2024-09-15T22:28:10.080 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 1348, 2024-09-15T22:28:10.080 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.452956942, 2024-09-15T22:28:10.080 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000336021 2024-09-15T22:28:10.080 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.080 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookuphash_latency": { 2024-09-15T22:28:10.080 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:10.080 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:10.080 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:10.080 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.080 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookupino_latency": { 2024-09-15T22:28:10.080 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:10.081 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:10.081 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:10.081 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.081 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookupname_latency": { 2024-09-15T22:28:10.081 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:10.081 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:10.081 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:10.081 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.081 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookupparent_latency": { 2024-09-15T22:28:10.081 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:10.081 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:10.081 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:10.081 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.082 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookupsnap_latency": { 2024-09-15T22:28:10.082 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:10.082 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:10.082 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:10.082 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.082 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lssnap_latency": { 2024-09-15T22:28:10.082 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:10.082 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:10.082 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:10.082 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.082 INFO:teuthology.orchestra.run.smithi012.stdout: "req_mkdir_latency": { 2024-09-15T22:28:10.082 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 101, 2024-09-15T22:28:10.082 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.107466191, 2024-09-15T22:28:10.083 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.001064021 2024-09-15T22:28:10.083 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.083 INFO:teuthology.orchestra.run.smithi012.stdout: "req_mknod_latency": { 2024-09-15T22:28:10.083 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 97, 2024-09-15T22:28:10.083 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.099981535, 2024-09-15T22:28:10.083 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.001030737 2024-09-15T22:28:10.083 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.083 INFO:teuthology.orchestra.run.smithi012.stdout: "req_mksnap_latency": { 2024-09-15T22:28:10.083 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:10.083 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:10.083 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:10.083 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.083 INFO:teuthology.orchestra.run.smithi012.stdout: "req_open_latency": { 2024-09-15T22:28:10.083 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:10.084 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:10.084 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:10.084 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.084 INFO:teuthology.orchestra.run.smithi012.stdout: "req_readdir_latency": { 2024-09-15T22:28:10.084 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 864, 2024-09-15T22:28:10.084 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.752317207, 2024-09-15T22:28:10.084 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000870737 2024-09-15T22:28:10.084 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.084 INFO:teuthology.orchestra.run.smithi012.stdout: "req_rename_latency": { 2024-09-15T22:28:10.084 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 131, 2024-09-15T22:28:10.084 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.688581096, 2024-09-15T22:28:10.084 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.005256344 2024-09-15T22:28:10.084 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.085 INFO:teuthology.orchestra.run.smithi012.stdout: "req_renamesnap_latency": { 2024-09-15T22:28:10.085 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:10.085 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:10.085 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:10.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.085 INFO:teuthology.orchestra.run.smithi012.stdout: "req_snapdiff_latency": { 2024-09-15T22:28:10.085 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:10.085 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:10.085 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:10.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.085 INFO:teuthology.orchestra.run.smithi012.stdout: "req_rmdir_latency": { 2024-09-15T22:28:10.085 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 869, 2024-09-15T22:28:10.085 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 10.922884880, 2024-09-15T22:28:10.085 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.012569487 2024-09-15T22:28:10.086 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.086 INFO:teuthology.orchestra.run.smithi012.stdout: "req_rmsnap_latency": { 2024-09-15T22:28:10.086 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:10.086 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:10.086 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:10.086 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.086 INFO:teuthology.orchestra.run.smithi012.stdout: "req_rmxattr_latency": { 2024-09-15T22:28:10.086 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:10.086 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:10.086 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:10.086 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.086 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setattr_latency": { 2024-09-15T22:28:10.086 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 35, 2024-09-15T22:28:10.086 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.036798148, 2024-09-15T22:28:10.087 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.001051375 2024-09-15T22:28:10.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.087 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setdirlayout_latency": { 2024-09-15T22:28:10.087 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:10.087 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:10.087 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:10.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.087 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setfilelock_latency": { 2024-09-15T22:28:10.087 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:10.087 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:10.087 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:10.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.087 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setlayout_latency": { 2024-09-15T22:28:10.088 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:10.088 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:10.088 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:10.088 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.088 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setxattr_latency": { 2024-09-15T22:28:10.088 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:10.088 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:10.088 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:10.088 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.088 INFO:teuthology.orchestra.run.smithi012.stdout: "req_symlink_latency": { 2024-09-15T22:28:10.088 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 85, 2024-09-15T22:28:10.088 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.093081938, 2024-09-15T22:28:10.088 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.001095081 2024-09-15T22:28:10.089 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.089 INFO:teuthology.orchestra.run.smithi012.stdout: "req_unlink_latency": { 2024-09-15T22:28:10.089 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 7431, 2024-09-15T22:28:10.089 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 9.129654233, 2024-09-15T22:28:10.089 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.001228590 2024-09-15T22:28:10.089 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.089 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_revoke_eviction": 0, 2024-09-15T22:28:10.089 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_acquisition_throttle": 0, 2024-09-15T22:28:10.089 INFO:teuthology.orchestra.run.smithi012.stdout: "req_getvxattr_latency": { 2024-09-15T22:28:10.089 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:10.089 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:10.089 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:10.089 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-15T22:28:10.089 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.090 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_sessions": { 2024-09-15T22:28:10.090 INFO:teuthology.orchestra.run.smithi012.stdout: "session_count": 1, 2024-09-15T22:28:10.090 INFO:teuthology.orchestra.run.smithi012.stdout: "session_add": 2, 2024-09-15T22:28:10.090 INFO:teuthology.orchestra.run.smithi012.stdout: "session_remove": 1, 2024-09-15T22:28:10.090 INFO:teuthology.orchestra.run.smithi012.stdout: "sessions_open": 1, 2024-09-15T22:28:10.090 INFO:teuthology.orchestra.run.smithi012.stdout: "sessions_stale": 0, 2024-09-15T22:28:10.090 INFO:teuthology.orchestra.run.smithi012.stdout: "total_load": 8034, 2024-09-15T22:28:10.090 INFO:teuthology.orchestra.run.smithi012.stdout: "average_load": 8034, 2024-09-15T22:28:10.090 INFO:teuthology.orchestra.run.smithi012.stdout: "avg_session_uptime": 189, 2024-09-15T22:28:10.090 INFO:teuthology.orchestra.run.smithi012.stdout: "mdthresh_evicted": 0 2024-09-15T22:28:10.090 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.090 INFO:teuthology.orchestra.run.smithi012.stdout: "mempool": { 2024-09-15T22:28:10.090 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:28:10.090 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_items": 0, 2024-09-15T22:28:10.091 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:28:10.091 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:28:10.091 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:28:10.091 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:28:10.091 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:28:10.091 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:28:10.091 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:28:10.091 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:28:10.091 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:28:10.091 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:28:10.091 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:28:10.091 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:28:10.091 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:28:10.092 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_items": 0, 2024-09-15T22:28:10.092 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:28:10.092 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_items": 0, 2024-09-15T22:28:10.092 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:28:10.092 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:28:10.092 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:28:10.092 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:28:10.092 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:28:10.092 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:28:10.092 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:28:10.092 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_items": 0, 2024-09-15T22:28:10.092 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:28:10.093 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:28:10.093 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:28:10.093 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_items": 0, 2024-09-15T22:28:10.093 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_bytes": 0, 2024-09-15T22:28:10.093 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_items": 0, 2024-09-15T22:28:10.093 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:28:10.093 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:28:10.093 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:28:10.093 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:28:10.093 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_bytes": 289159, 2024-09-15T22:28:10.093 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_items": 272, 2024-09-15T22:28:10.093 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:28:10.093 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_items": 0, 2024-09-15T22:28:10.093 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_bytes": 0, 2024-09-15T22:28:10.094 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_items": 0, 2024-09-15T22:28:10.094 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:28:10.094 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_items": 0, 2024-09-15T22:28:10.094 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:28:10.094 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_items": 0, 2024-09-15T22:28:10.094 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_bytes": 7888, 2024-09-15T22:28:10.094 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_items": 163, 2024-09-15T22:28:10.094 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:28:10.094 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:28:10.094 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_bytes": 0, 2024-09-15T22:28:10.094 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_items": 0, 2024-09-15T22:28:10.094 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_bytes": 1201437, 2024-09-15T22:28:10.094 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_items": 33407, 2024-09-15T22:28:10.094 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_bytes": 0, 2024-09-15T22:28:10.095 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_items": 0, 2024-09-15T22:28:10.095 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_bytes": 0, 2024-09-15T22:28:10.095 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_items": 0 2024-09-15T22:28:10.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.095 INFO:teuthology.orchestra.run.smithi012.stdout: "objecter": { 2024-09-15T22:28:10.095 INFO:teuthology.orchestra.run.smithi012.stdout: "op_active": 0, 2024-09-15T22:28:10.095 INFO:teuthology.orchestra.run.smithi012.stdout: "op_laggy": 0, 2024-09-15T22:28:10.095 INFO:teuthology.orchestra.run.smithi012.stdout: "op_send": 10517, 2024-09-15T22:28:10.095 INFO:teuthology.orchestra.run.smithi012.stdout: "op_send_bytes": 57177805, 2024-09-15T22:28:10.095 INFO:teuthology.orchestra.run.smithi012.stdout: "op_resend": 33, 2024-09-15T22:28:10.095 INFO:teuthology.orchestra.run.smithi012.stdout: "op_reply": 10517, 2024-09-15T22:28:10.095 INFO:teuthology.orchestra.run.smithi012.stdout: "op_latency": { 2024-09-15T22:28:10.096 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 10517, 2024-09-15T22:28:10.096 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 35.643674057, 2024-09-15T22:28:10.096 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.003389148 2024-09-15T22:28:10.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.096 INFO:teuthology.orchestra.run.smithi012.stdout: "op_inflight": 0, 2024-09-15T22:28:10.096 INFO:teuthology.orchestra.run.smithi012.stdout: "oplen_avg": { 2024-09-15T22:28:10.096 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 10517, 2024-09-15T22:28:10.096 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 10650 2024-09-15T22:28:10.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.096 INFO:teuthology.orchestra.run.smithi012.stdout: "op": 10517, 2024-09-15T22:28:10.096 INFO:teuthology.orchestra.run.smithi012.stdout: "op_r": 202, 2024-09-15T22:28:10.096 INFO:teuthology.orchestra.run.smithi012.stdout: "op_w": 10315, 2024-09-15T22:28:10.096 INFO:teuthology.orchestra.run.smithi012.stdout: "op_rmw": 0, 2024-09-15T22:28:10.097 INFO:teuthology.orchestra.run.smithi012.stdout: "op_pg": 0, 2024-09-15T22:28:10.097 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_stat": 0, 2024-09-15T22:28:10.097 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_create": 10, 2024-09-15T22:28:10.097 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_read": 201, 2024-09-15T22:28:10.097 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_write": 1677, 2024-09-15T22:28:10.097 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_writefull": 100, 2024-09-15T22:28:10.097 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_writesame": 0, 2024-09-15T22:28:10.097 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_append": 0, 2024-09-15T22:28:10.097 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_zero": 0, 2024-09-15T22:28:10.097 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_truncate": 0, 2024-09-15T22:28:10.097 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_delete": 8407, 2024-09-15T22:28:10.097 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_mapext": 0, 2024-09-15T22:28:10.097 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_sparse_read": 0, 2024-09-15T22:28:10.098 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_clonerange": 0, 2024-09-15T22:28:10.098 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_getxattr": 0, 2024-09-15T22:28:10.098 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_setxattr": 20, 2024-09-15T22:28:10.098 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_cmpxattr": 0, 2024-09-15T22:28:10.098 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_rmxattr": 0, 2024-09-15T22:28:10.098 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_resetxattrs": 0, 2024-09-15T22:28:10.098 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_call": 0, 2024-09-15T22:28:10.098 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_watch": 0, 2024-09-15T22:28:10.098 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_notify": 0, 2024-09-15T22:28:10.098 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T22:28:10.098 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_pgls": 0, 2024-09-15T22:28:10.098 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_pgls_filter": 0, 2024-09-15T22:28:10.098 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_other": 41, 2024-09-15T22:28:10.098 INFO:teuthology.orchestra.run.smithi012.stdout: "linger_active": 0, 2024-09-15T22:28:10.099 INFO:teuthology.orchestra.run.smithi012.stdout: "linger_send": 0, 2024-09-15T22:28:10.099 INFO:teuthology.orchestra.run.smithi012.stdout: "linger_resend": 0, 2024-09-15T22:28:10.099 INFO:teuthology.orchestra.run.smithi012.stdout: "linger_ping": 0, 2024-09-15T22:28:10.099 INFO:teuthology.orchestra.run.smithi012.stdout: "poolop_active": 0, 2024-09-15T22:28:10.099 INFO:teuthology.orchestra.run.smithi012.stdout: "poolop_send": 0, 2024-09-15T22:28:10.099 INFO:teuthology.orchestra.run.smithi012.stdout: "poolop_resend": 0, 2024-09-15T22:28:10.099 INFO:teuthology.orchestra.run.smithi012.stdout: "poolstat_active": 0, 2024-09-15T22:28:10.099 INFO:teuthology.orchestra.run.smithi012.stdout: "poolstat_send": 0, 2024-09-15T22:28:10.099 INFO:teuthology.orchestra.run.smithi012.stdout: "poolstat_resend": 0, 2024-09-15T22:28:10.099 INFO:teuthology.orchestra.run.smithi012.stdout: "statfs_active": 0, 2024-09-15T22:28:10.099 INFO:teuthology.orchestra.run.smithi012.stdout: "statfs_send": 0, 2024-09-15T22:28:10.099 INFO:teuthology.orchestra.run.smithi012.stdout: "statfs_resend": 0, 2024-09-15T22:28:10.099 INFO:teuthology.orchestra.run.smithi012.stdout: "command_active": 0, 2024-09-15T22:28:10.100 INFO:teuthology.orchestra.run.smithi012.stdout: "command_send": 0, 2024-09-15T22:28:10.100 INFO:teuthology.orchestra.run.smithi012.stdout: "command_resend": 0, 2024-09-15T22:28:10.100 INFO:teuthology.orchestra.run.smithi012.stdout: "map_epoch": 86, 2024-09-15T22:28:10.100 INFO:teuthology.orchestra.run.smithi012.stdout: "map_full": 0, 2024-09-15T22:28:10.100 INFO:teuthology.orchestra.run.smithi012.stdout: "map_inc": 4, 2024-09-15T22:28:10.100 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_sessions": 12, 2024-09-15T22:28:10.100 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_session_open": 12, 2024-09-15T22:28:10.100 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_session_close": 0, 2024-09-15T22:28:10.100 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_laggy": 0, 2024-09-15T22:28:10.100 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_wr": 137, 2024-09-15T22:28:10.100 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_rd": 2, 2024-09-15T22:28:10.100 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_del": 55 2024-09-15T22:28:10.100 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.100 INFO:teuthology.orchestra.run.smithi012.stdout: "oft": { 2024-09-15T22:28:10.101 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_total_objs": 1, 2024-09-15T22:28:10.101 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_total_kv_pairs": 0, 2024-09-15T22:28:10.101 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_total_updates": 0, 2024-09-15T22:28:10.101 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_total_removes": 0 2024-09-15T22:28:10.101 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.101 INFO:teuthology.orchestra.run.smithi012.stdout: "osd-slow-ops": { 2024-09-15T22:28:10.101 INFO:teuthology.orchestra.run.smithi012.stdout: "slow_ops_count": 0 2024-09-15T22:28:10.101 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.101 INFO:teuthology.orchestra.run.smithi012.stdout: "purge_queue": { 2024-09-15T22:28:10.101 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executing_ops": 0, 2024-09-15T22:28:10.101 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executing_ops_high_water": 17, 2024-09-15T22:28:10.101 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executing": 0, 2024-09-15T22:28:10.101 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executing_high_water": 10, 2024-09-15T22:28:10.102 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executed_ops": 8378, 2024-09-15T22:28:10.102 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executed": 8017, 2024-09-15T22:28:10.102 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_item_in_journal": 0 2024-09-15T22:28:10.102 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.102 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:28:10.102 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-15T22:28:10.102 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 104857600, 2024-09-15T22:28:10.102 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-15T22:28:10.102 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 63345, 2024-09-15T22:28:10.102 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 23366855, 2024-09-15T22:28:10.103 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:10.103 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 63345, 2024-09-15T22:28:10.103 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2024-09-15T22:28:10.103 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2024-09-15T22:28:10.103 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 63345, 2024-09-15T22:28:10.103 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 23366855, 2024-09-15T22:28:10.103 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-15T22:28:10.103 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:10.103 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:10.103 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:10.103 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-15T22:28:10.103 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.103 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-objecter_bytes": { 2024-09-15T22:28:10.104 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-15T22:28:10.104 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 104857600, 2024-09-15T22:28:10.104 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-15T22:28:10.104 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 0, 2024-09-15T22:28:10.104 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 0, 2024-09-15T22:28:10.104 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:10.104 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 0, 2024-09-15T22:28:10.104 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 10517, 2024-09-15T22:28:10.104 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 57987530, 2024-09-15T22:28:10.104 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 10517, 2024-09-15T22:28:10.104 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 57987530, 2024-09-15T22:28:10.104 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-15T22:28:10.105 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:10.105 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:10.105 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:10.105 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-15T22:28:10.105 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.105 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-objecter_ops": { 2024-09-15T22:28:10.105 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-15T22:28:10.105 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 1024, 2024-09-15T22:28:10.105 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-15T22:28:10.105 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 0, 2024-09-15T22:28:10.105 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 0, 2024-09-15T22:28:10.105 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:10.105 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 0, 2024-09-15T22:28:10.105 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 10517, 2024-09-15T22:28:10.106 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 10517, 2024-09-15T22:28:10.106 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 10517, 2024-09-15T22:28:10.106 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 10517, 2024-09-15T22:28:10.106 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-15T22:28:10.106 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:10.106 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:10.106 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:10.106 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-15T22:28:10.106 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.106 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-write_buf_throttle": { 2024-09-15T22:28:10.106 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-15T22:28:10.106 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 3758096384, 2024-09-15T22:28:10.106 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-15T22:28:10.106 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 8017, 2024-09-15T22:28:10.107 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 809741, 2024-09-15T22:28:10.107 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:10.107 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 8017, 2024-09-15T22:28:10.107 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2024-09-15T22:28:10.107 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2024-09-15T22:28:10.107 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 201, 2024-09-15T22:28:10.107 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 809741, 2024-09-15T22:28:10.107 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-15T22:28:10.107 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:10.107 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:10.107 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:10.107 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-15T22:28:10.107 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:10.107 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-write_buf_throttle-0x563a36a8e500": { 2024-09-15T22:28:10.108 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-15T22:28:10.108 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 3758096384, 2024-09-15T22:28:10.108 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-15T22:28:10.108 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 26301, 2024-09-15T22:28:10.108 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 55756270, 2024-09-15T22:28:10.108 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:10.108 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 26301, 2024-09-15T22:28:10.108 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2024-09-15T22:28:10.108 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2024-09-15T22:28:10.108 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 1476, 2024-09-15T22:28:10.108 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 55756270, 2024-09-15T22:28:10.108 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-15T22:28:10.108 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:10.108 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:10.108 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:10.109 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-15T22:28:10.109 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-15T22:28:10.109 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-15T22:28:11.070 INFO:tasks.check_counter:Daemon mds.b mds.exported=9 2024-09-15T22:28:11.070 INFO:tasks.check_counter:Daemon mds.b mds.imported=26 2024-09-15T22:28:11.070 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=1534 2024-09-15T22:28:11.071 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=2843 2024-09-15T22:28:11.071 DEBUG:tasks.check_counter:Getting stats from e 2024-09-15T22:28:11.071 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-15T22:28:11.362 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:28:11.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:11 smithi001 ceph-mon[30843]: pgmap v455: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 181 KiB/s wr, 104 op/s 2024-09-15T22:28:11.483 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:11 smithi012 ceph-mon[34883]: pgmap v455: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 181 KiB/s wr, 104 op/s 2024-09-15T22:28:11.560 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:11 smithi098 ceph-mon[35514]: pgmap v455: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 181 KiB/s wr, 104 op/s 2024-09-15T22:28:11.943 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-15T22:28:11.943 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:28:11.944 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 0, 2024-09-15T22:28:11.944 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 2, 2024-09-15T22:28:11.944 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 0, 2024-09-15T22:28:11.944 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 0, 2024-09-15T22:28:11.944 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 4, 2024-09-15T22:28:11.944 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 0, 2024-09-15T22:28:11.944 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.001076794, 2024-09-15T22:28:11.944 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.000000000, 2024-09-15T22:28:11.944 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.000161081, 2024-09-15T22:28:11.944 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:28:11.944 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:11.944 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:11.944 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:11.945 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:11.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:11.945 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:11.945 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:11.945 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:11.945 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:11.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:11.945 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T22:28:11.945 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T22:28:11.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:11.945 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:28:11.945 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 105, 2024-09-15T22:28:11.945 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 100, 2024-09-15T22:28:11.946 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 448688, 2024-09-15T22:28:11.946 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 59680, 2024-09-15T22:28:11.946 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 2, 2024-09-15T22:28:11.946 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 1, 2024-09-15T22:28:11.946 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.018336246, 2024-09-15T22:28:11.946 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.006713008, 2024-09-15T22:28:11.946 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.016048435, 2024-09-15T22:28:11.946 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:28:11.946 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:11.947 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 100, 2024-09-15T22:28:11.947 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.009046482, 2024-09-15T22:28:11.947 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000090464 2024-09-15T22:28:11.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:11.947 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:11.947 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:11.947 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:11.947 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:11.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:11.948 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 448688, 2024-09-15T22:28:11.948 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 59680 2024-09-15T22:28:11.948 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:11.948 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:28:11.948 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 1, 2024-09-15T22:28:11.949 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 74, 2024-09-15T22:28:11.949 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 160, 2024-09-15T22:28:11.949 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 91552, 2024-09-15T22:28:11.949 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 3, 2024-09-15T22:28:11.950 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 2, 2024-09-15T22:28:11.950 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.004512952, 2024-09-15T22:28:11.950 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.003235721, 2024-09-15T22:28:11.950 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.000532504, 2024-09-15T22:28:11.950 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:28:11.950 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:11.951 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 72, 2024-09-15T22:28:11.951 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.002881783, 2024-09-15T22:28:11.951 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000040024 2024-09-15T22:28:11.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:11.951 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:11.951 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:11.952 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:11.952 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:11.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:11.952 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-15T22:28:11.952 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 91552 2024-09-15T22:28:11.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:11.953 INFO:teuthology.orchestra.run.smithi012.stdout: "cct": { 2024-09-15T22:28:11.953 INFO:teuthology.orchestra.run.smithi012.stdout: "total_workers": 0, 2024-09-15T22:28:11.953 INFO:teuthology.orchestra.run.smithi012.stdout: "unhealthy_workers": 0 2024-09-15T22:28:11.953 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:11.953 INFO:teuthology.orchestra.run.smithi012.stdout: "mempool": { 2024-09-15T22:28:11.953 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:28:11.954 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_items": 0, 2024-09-15T22:28:11.954 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:28:11.954 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:28:11.954 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:28:11.954 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:28:11.954 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:28:11.955 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:28:11.955 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:28:11.955 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:28:11.955 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:28:11.955 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:28:11.955 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:28:11.956 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:28:11.956 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:28:11.956 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_items": 0, 2024-09-15T22:28:11.956 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:28:11.956 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_items": 0, 2024-09-15T22:28:11.957 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:28:11.957 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:28:11.957 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:28:11.957 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:28:11.957 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:28:11.957 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:28:11.958 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:28:11.958 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_items": 0, 2024-09-15T22:28:11.958 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:28:11.958 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:28:11.958 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:28:11.958 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_items": 0, 2024-09-15T22:28:11.959 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_bytes": 0, 2024-09-15T22:28:11.959 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_items": 0, 2024-09-15T22:28:11.959 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:28:11.959 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:28:11.959 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:28:11.959 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:28:11.960 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_bytes": 148779, 2024-09-15T22:28:11.960 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_items": 27, 2024-09-15T22:28:11.960 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:28:11.960 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_items": 0, 2024-09-15T22:28:11.961 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_bytes": 0, 2024-09-15T22:28:11.961 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_items": 0, 2024-09-15T22:28:11.961 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:28:11.961 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_items": 0, 2024-09-15T22:28:11.961 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:28:11.961 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_items": 0, 2024-09-15T22:28:11.961 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_bytes": 0, 2024-09-15T22:28:11.962 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_items": 0, 2024-09-15T22:28:11.962 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:28:11.962 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:28:11.962 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_bytes": 0, 2024-09-15T22:28:11.962 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_items": 0, 2024-09-15T22:28:11.962 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_bytes": 928, 2024-09-15T22:28:11.962 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_items": 2, 2024-09-15T22:28:11.963 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_bytes": 0, 2024-09-15T22:28:11.963 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_items": 0, 2024-09-15T22:28:11.963 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_bytes": 0, 2024-09-15T22:28:11.963 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_items": 0 2024-09-15T22:28:11.963 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:11.963 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:28:11.963 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-15T22:28:11.963 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 104857600, 2024-09-15T22:28:11.963 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-15T22:28:11.963 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 102, 2024-09-15T22:28:11.963 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 431412, 2024-09-15T22:28:11.963 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:11.964 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 102, 2024-09-15T22:28:11.964 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2024-09-15T22:28:11.964 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2024-09-15T22:28:11.964 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 102, 2024-09-15T22:28:11.964 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 431412, 2024-09-15T22:28:11.964 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-15T22:28:11.964 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:11.964 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:11.964 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:11.964 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-15T22:28:11.964 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-15T22:28:11.964 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-15T22:28:12.613 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.e 2024-09-15T22:28:12.613 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.e 2024-09-15T22:28:12.613 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.e 2024-09-15T22:28:12.613 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.e 2024-09-15T22:28:12.613 DEBUG:tasks.check_counter:Getting stats from h 2024-09-15T22:28:12.614 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-15T22:28:12.864 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:28:13.240 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:13 smithi012 ceph-mon[34883]: pgmap v456: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 73 KiB/s wr, 58 op/s 2024-09-15T22:28:13.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:13 smithi001 ceph-mon[30843]: pgmap v456: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 73 KiB/s wr, 58 op/s 2024-09-15T22:28:13.505 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-15T22:28:13.505 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:28:13.505 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 768, 2024-09-15T22:28:13.506 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 770, 2024-09-15T22:28:13.506 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 25389353, 2024-09-15T22:28:13.506 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 244231, 2024-09-15T22:28:13.506 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 7, 2024-09-15T22:28:13.507 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 3, 2024-09-15T22:28:13.507 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.078963804, 2024-09-15T22:28:13.507 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.020452712, 2024-09-15T22:28:13.507 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.032802229, 2024-09-15T22:28:13.508 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.019437826, 2024-09-15T22:28:13.508 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:13.508 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 768, 2024-09-15T22:28:13.508 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.027417655, 2024-09-15T22:28:13.508 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000035700 2024-09-15T22:28:13.509 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.509 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:13.509 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.509 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.510 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.510 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.510 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T22:28:13.510 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T22:28:13.510 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.511 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:28:13.511 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 239, 2024-09-15T22:28:13.511 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 231, 2024-09-15T22:28:13.511 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 21485860, 2024-09-15T22:28:13.512 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 99618, 2024-09-15T22:28:13.512 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 5, 2024-09-15T22:28:13.512 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 4, 2024-09-15T22:28:13.512 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.034756823, 2024-09-15T22:28:13.512 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.009027236, 2024-09-15T22:28:13.513 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.027406801, 2024-09-15T22:28:13.513 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.002640152, 2024-09-15T22:28:13.513 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:13.513 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 230, 2024-09-15T22:28:13.513 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.010590501, 2024-09-15T22:28:13.514 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000046045 2024-09-15T22:28:13.514 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.514 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:13.514 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.515 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.515 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.515 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.515 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 481968, 2024-09-15T22:28:13.515 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 59488 2024-09-15T22:28:13.516 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.516 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:28:13.516 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 70, 2024-09-15T22:28:13.516 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 140, 2024-09-15T22:28:13.517 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 9638794, 2024-09-15T22:28:13.517 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 221966, 2024-09-15T22:28:13.517 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 6, 2024-09-15T22:28:13.517 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 5, 2024-09-15T22:28:13.517 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.015652541, 2024-09-15T22:28:13.518 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.004518521, 2024-09-15T22:28:13.518 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.008738198, 2024-09-15T22:28:13.518 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.001344582, 2024-09-15T22:28:13.518 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:13.519 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 139, 2024-09-15T22:28:13.519 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.010880522, 2024-09-15T22:28:13.519 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000078277 2024-09-15T22:28:13.519 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.519 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:13.520 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.520 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.520 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.520 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.520 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-09-15T22:28:13.521 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 201296 2024-09-15T22:28:13.521 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.521 INFO:teuthology.orchestra.run.smithi012.stdout: "cct": { 2024-09-15T22:28:13.521 INFO:teuthology.orchestra.run.smithi012.stdout: "total_workers": 1, 2024-09-15T22:28:13.521 INFO:teuthology.orchestra.run.smithi012.stdout: "unhealthy_workers": 0 2024-09-15T22:28:13.522 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.522 INFO:teuthology.orchestra.run.smithi012.stdout: "finisher-MDSRank": { 2024-09-15T22:28:13.522 INFO:teuthology.orchestra.run.smithi012.stdout: "queue_len": 0, 2024-09-15T22:28:13.522 INFO:teuthology.orchestra.run.smithi012.stdout: "complete_latency": { 2024-09-15T22:28:13.523 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 1634, 2024-09-15T22:28:13.523 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.037513538, 2024-09-15T22:28:13.523 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000022958 2024-09-15T22:28:13.523 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-15T22:28:13.523 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.524 INFO:teuthology.orchestra.run.smithi012.stdout: "finisher-PurgeQueue": { 2024-09-15T22:28:13.524 INFO:teuthology.orchestra.run.smithi012.stdout: "queue_len": 0, 2024-09-15T22:28:13.524 INFO:teuthology.orchestra.run.smithi012.stdout: "complete_latency": { 2024-09-15T22:28:13.524 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.524 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.524 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.524 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-15T22:28:13.525 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.525 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": { 2024-09-15T22:28:13.525 INFO:teuthology.orchestra.run.smithi012.stdout: "request": 0, 2024-09-15T22:28:13.525 INFO:teuthology.orchestra.run.smithi012.stdout: "reply": 0, 2024-09-15T22:28:13.525 INFO:teuthology.orchestra.run.smithi012.stdout: "reply_latency": { 2024-09-15T22:28:13.525 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.526 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.526 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.526 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.526 INFO:teuthology.orchestra.run.smithi012.stdout: "slow_reply": 0, 2024-09-15T22:28:13.526 INFO:teuthology.orchestra.run.smithi012.stdout: "forward": 0, 2024-09-15T22:28:13.526 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_fetch_complete": 0, 2024-09-15T22:28:13.526 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_fetch_keys": 0, 2024-09-15T22:28:13.526 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_commit": 0, 2024-09-15T22:28:13.526 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_split": 0, 2024-09-15T22:28:13.526 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_merge": 0, 2024-09-15T22:28:13.526 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes": 10755, 2024-09-15T22:28:13.527 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_top": 0, 2024-09-15T22:28:13.527 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_bottom": 10755, 2024-09-15T22:28:13.527 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_pin_tail": 0, 2024-09-15T22:28:13.527 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_pinned": 10755, 2024-09-15T22:28:13.527 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_expired": 0, 2024-09-15T22:28:13.527 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_with_caps": 0, 2024-09-15T22:28:13.527 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": 0, 2024-09-15T22:28:13.527 INFO:teuthology.orchestra.run.smithi012.stdout: "subtrees": 1, 2024-09-15T22:28:13.527 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse": 0, 2024-09-15T22:28:13.527 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_hit": 0, 2024-09-15T22:28:13.527 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_forward": 0, 2024-09-15T22:28:13.527 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_discover": 0, 2024-09-15T22:28:13.527 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_dir_fetch": 0, 2024-09-15T22:28:13.528 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_remote_ino": 0, 2024-09-15T22:28:13.528 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_lock": 0, 2024-09-15T22:28:13.528 INFO:teuthology.orchestra.run.smithi012.stdout: "load_cent": 0, 2024-09-15T22:28:13.528 INFO:teuthology.orchestra.run.smithi012.stdout: "q": 0, 2024-09-15T22:28:13.528 INFO:teuthology.orchestra.run.smithi012.stdout: "exported": 0, 2024-09-15T22:28:13.528 INFO:teuthology.orchestra.run.smithi012.stdout: "exported_inodes": 0, 2024-09-15T22:28:13.528 INFO:teuthology.orchestra.run.smithi012.stdout: "imported": 0, 2024-09-15T22:28:13.528 INFO:teuthology.orchestra.run.smithi012.stdout: "imported_inodes": 0, 2024-09-15T22:28:13.528 INFO:teuthology.orchestra.run.smithi012.stdout: "openino_dir_fetch": 0, 2024-09-15T22:28:13.528 INFO:teuthology.orchestra.run.smithi012.stdout: "openino_backtrace_fetch": 0, 2024-09-15T22:28:13.528 INFO:teuthology.orchestra.run.smithi012.stdout: "openino_peer_discover": 0, 2024-09-15T22:28:13.528 INFO:teuthology.orchestra.run.smithi012.stdout: "root_rfiles": 0, 2024-09-15T22:28:13.528 INFO:teuthology.orchestra.run.smithi012.stdout: "root_rbytes": 0, 2024-09-15T22:28:13.529 INFO:teuthology.orchestra.run.smithi012.stdout: "root_rsnaps": 0, 2024-09-15T22:28:13.529 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_backtrace_fetch": 0, 2024-09-15T22:28:13.529 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_set_tag": 0, 2024-09-15T22:28:13.529 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T22:28:13.529 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_inotable_repaired": 0, 2024-09-15T22:28:13.529 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_dir_inodes": 0, 2024-09-15T22:28:13.529 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T22:28:13.529 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_dirfrag_rstats": 0, 2024-09-15T22:28:13.529 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_file_inodes": 0, 2024-09-15T22:28:13.529 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_inode_file_caps": 0, 2024-09-15T22:28:13.530 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_revoke": 0, 2024-09-15T22:28:13.530 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_grant": 0, 2024-09-15T22:28:13.530 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_trunc": 0, 2024-09-15T22:28:13.530 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T22:28:13.530 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T22:28:13.530 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_caps": 0, 2024-09-15T22:28:13.530 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_caps_dirty": 0, 2024-09-15T22:28:13.530 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_cap_release": 0, 2024-09-15T22:28:13.530 INFO:teuthology.orchestra.run.smithi012.stdout: "process_request_cap_release": 0 2024-09-15T22:28:13.531 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.531 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_cache": { 2024-09-15T22:28:13.531 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_update": 0, 2024-09-15T22:28:13.531 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_update_receipt": 0, 2024-09-15T22:28:13.531 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_try_discover": 0, 2024-09-15T22:28:13.531 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_send_discover": 0, 2024-09-15T22:28:13.531 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_handle_discover": 0, 2024-09-15T22:28:13.531 INFO:teuthology.orchestra.run.smithi012.stdout: "num_strays": 0, 2024-09-15T22:28:13.532 INFO:teuthology.orchestra.run.smithi012.stdout: "num_strays_delayed": 0, 2024-09-15T22:28:13.532 INFO:teuthology.orchestra.run.smithi012.stdout: "num_strays_enqueuing": 0, 2024-09-15T22:28:13.532 INFO:teuthology.orchestra.run.smithi012.stdout: "strays_created": 0, 2024-09-15T22:28:13.532 INFO:teuthology.orchestra.run.smithi012.stdout: "strays_enqueued": 0, 2024-09-15T22:28:13.532 INFO:teuthology.orchestra.run.smithi012.stdout: "strays_reintegrated": 0, 2024-09-15T22:28:13.532 INFO:teuthology.orchestra.run.smithi012.stdout: "strays_migrated": 0, 2024-09-15T22:28:13.532 INFO:teuthology.orchestra.run.smithi012.stdout: "num_recovering_processing": 0, 2024-09-15T22:28:13.532 INFO:teuthology.orchestra.run.smithi012.stdout: "num_recovering_enqueued": 0, 2024-09-15T22:28:13.533 INFO:teuthology.orchestra.run.smithi012.stdout: "num_recovering_prioritized": 0, 2024-09-15T22:28:13.533 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_started": 0, 2024-09-15T22:28:13.533 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_completed": 0, 2024-09-15T22:28:13.533 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_quiesce_path": 0, 2024-09-15T22:28:13.533 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_quiesce_inode": 0, 2024-09-15T22:28:13.533 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T22:28:13.533 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_exportdir": 0, 2024-09-15T22:28:13.533 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_flush": 0, 2024-09-15T22:28:13.533 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_fragmentdir": 0, 2024-09-15T22:28:13.534 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_fragstats": 0, 2024-09-15T22:28:13.534 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_inodestats": 0 2024-09-15T22:28:13.534 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.534 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_log": { 2024-09-15T22:28:13.534 INFO:teuthology.orchestra.run.smithi012.stdout: "evlrg": 0, 2024-09-15T22:28:13.534 INFO:teuthology.orchestra.run.smithi012.stdout: "evadd": 0, 2024-09-15T22:28:13.534 INFO:teuthology.orchestra.run.smithi012.stdout: "evex": 0, 2024-09-15T22:28:13.534 INFO:teuthology.orchestra.run.smithi012.stdout: "evtrm": 0, 2024-09-15T22:28:13.535 INFO:teuthology.orchestra.run.smithi012.stdout: "ev": 26301, 2024-09-15T22:28:13.535 INFO:teuthology.orchestra.run.smithi012.stdout: "evexg": 0, 2024-09-15T22:28:13.535 INFO:teuthology.orchestra.run.smithi012.stdout: "evexd": 0, 2024-09-15T22:28:13.535 INFO:teuthology.orchestra.run.smithi012.stdout: "segadd": 0, 2024-09-15T22:28:13.535 INFO:teuthology.orchestra.run.smithi012.stdout: "segex": 0, 2024-09-15T22:28:13.535 INFO:teuthology.orchestra.run.smithi012.stdout: "segtrm": 0, 2024-09-15T22:28:13.535 INFO:teuthology.orchestra.run.smithi012.stdout: "seg": 34, 2024-09-15T22:28:13.535 INFO:teuthology.orchestra.run.smithi012.stdout: "segmjr": 4, 2024-09-15T22:28:13.536 INFO:teuthology.orchestra.run.smithi012.stdout: "segexg": 0, 2024-09-15T22:28:13.536 INFO:teuthology.orchestra.run.smithi012.stdout: "segexd": 0, 2024-09-15T22:28:13.536 INFO:teuthology.orchestra.run.smithi012.stdout: "expos": 4194304, 2024-09-15T22:28:13.536 INFO:teuthology.orchestra.run.smithi012.stdout: "wrpos": 59950574, 2024-09-15T22:28:13.536 INFO:teuthology.orchestra.run.smithi012.stdout: "rdpos": 59949436, 2024-09-15T22:28:13.536 INFO:teuthology.orchestra.run.smithi012.stdout: "jlat": { 2024-09-15T22:28:13.536 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.536 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.537 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.537 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.537 INFO:teuthology.orchestra.run.smithi012.stdout: "replayed": 26301 2024-09-15T22:28:13.537 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.537 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_mem": { 2024-09-15T22:28:13.537 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 170, 2024-09-15T22:28:13.537 INFO:teuthology.orchestra.run.smithi012.stdout: "ino+": 8224, 2024-09-15T22:28:13.537 INFO:teuthology.orchestra.run.smithi012.stdout: "ino-": 8054, 2024-09-15T22:28:13.538 INFO:teuthology.orchestra.run.smithi012.stdout: "dir": 179, 2024-09-15T22:28:13.538 INFO:teuthology.orchestra.run.smithi012.stdout: "dir+": 906, 2024-09-15T22:28:13.538 INFO:teuthology.orchestra.run.smithi012.stdout: "dir-": 727, 2024-09-15T22:28:13.538 INFO:teuthology.orchestra.run.smithi012.stdout: "dn": 10755, 2024-09-15T22:28:13.538 INFO:teuthology.orchestra.run.smithi012.stdout: "dn+": 16819, 2024-09-15T22:28:13.538 INFO:teuthology.orchestra.run.smithi012.stdout: "dn-": 6064, 2024-09-15T22:28:13.538 INFO:teuthology.orchestra.run.smithi012.stdout: "cap": 0, 2024-09-15T22:28:13.538 INFO:teuthology.orchestra.run.smithi012.stdout: "cap+": 0, 2024-09-15T22:28:13.538 INFO:teuthology.orchestra.run.smithi012.stdout: "cap-": 0, 2024-09-15T22:28:13.539 INFO:teuthology.orchestra.run.smithi012.stdout: "rss": 72680, 2024-09-15T22:28:13.539 INFO:teuthology.orchestra.run.smithi012.stdout: "heap": 215328 2024-09-15T22:28:13.539 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.539 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_server": { 2024-09-15T22:28:13.539 INFO:teuthology.orchestra.run.smithi012.stdout: "dispatch_client_request": 0, 2024-09-15T22:28:13.539 INFO:teuthology.orchestra.run.smithi012.stdout: "dispatch_server_request": 0, 2024-09-15T22:28:13.539 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_request": 0, 2024-09-15T22:28:13.539 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_session": 0, 2024-09-15T22:28:13.540 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_peer_request": 0, 2024-09-15T22:28:13.540 INFO:teuthology.orchestra.run.smithi012.stdout: "req_create_latency": { 2024-09-15T22:28:13.540 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.540 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.540 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.540 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.540 INFO:teuthology.orchestra.run.smithi012.stdout: "req_getattr_latency": { 2024-09-15T22:28:13.540 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.541 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.541 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.541 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.541 INFO:teuthology.orchestra.run.smithi012.stdout: "req_getfilelock_latency": { 2024-09-15T22:28:13.541 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.541 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.541 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.541 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.542 INFO:teuthology.orchestra.run.smithi012.stdout: "req_link_latency": { 2024-09-15T22:28:13.542 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.542 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.542 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.542 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.542 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookup_latency": { 2024-09-15T22:28:13.542 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.542 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.543 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.543 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.543 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookuphash_latency": { 2024-09-15T22:28:13.543 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.543 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.543 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.543 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.543 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookupino_latency": { 2024-09-15T22:28:13.543 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.544 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.544 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.544 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.544 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookupname_latency": { 2024-09-15T22:28:13.544 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.544 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.544 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.545 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.545 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookupparent_latency": { 2024-09-15T22:28:13.545 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.545 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.545 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.545 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.545 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookupsnap_latency": { 2024-09-15T22:28:13.545 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.545 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.546 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.546 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.546 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lssnap_latency": { 2024-09-15T22:28:13.546 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.546 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.546 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.546 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.546 INFO:teuthology.orchestra.run.smithi012.stdout: "req_mkdir_latency": { 2024-09-15T22:28:13.547 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.547 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.547 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.547 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.547 INFO:teuthology.orchestra.run.smithi012.stdout: "req_mknod_latency": { 2024-09-15T22:28:13.547 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.548 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.548 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.548 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.548 INFO:teuthology.orchestra.run.smithi012.stdout: "req_mksnap_latency": { 2024-09-15T22:28:13.548 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.548 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.548 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.548 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.548 INFO:teuthology.orchestra.run.smithi012.stdout: "req_open_latency": { 2024-09-15T22:28:13.548 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.549 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.549 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.549 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.549 INFO:teuthology.orchestra.run.smithi012.stdout: "req_readdir_latency": { 2024-09-15T22:28:13.549 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.549 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.549 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.549 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.549 INFO:teuthology.orchestra.run.smithi012.stdout: "req_rename_latency": { 2024-09-15T22:28:13.550 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.550 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.550 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.550 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.550 INFO:teuthology.orchestra.run.smithi012.stdout: "req_renamesnap_latency": { 2024-09-15T22:28:13.550 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.551 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.551 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.551 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.551 INFO:teuthology.orchestra.run.smithi012.stdout: "req_snapdiff_latency": { 2024-09-15T22:28:13.551 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.552 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.552 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.552 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.552 INFO:teuthology.orchestra.run.smithi012.stdout: "req_rmdir_latency": { 2024-09-15T22:28:13.552 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.553 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.553 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.553 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.553 INFO:teuthology.orchestra.run.smithi012.stdout: "req_rmsnap_latency": { 2024-09-15T22:28:13.553 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.553 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.554 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.554 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.554 INFO:teuthology.orchestra.run.smithi012.stdout: "req_rmxattr_latency": { 2024-09-15T22:28:13.554 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.554 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.555 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.555 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.555 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setattr_latency": { 2024-09-15T22:28:13.555 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.555 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.555 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.556 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.556 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setdirlayout_latency": { 2024-09-15T22:28:13.556 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.556 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.556 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.556 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.557 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setfilelock_latency": { 2024-09-15T22:28:13.557 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.557 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.557 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.557 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.557 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setlayout_latency": { 2024-09-15T22:28:13.558 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.558 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.558 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.558 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.558 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setxattr_latency": { 2024-09-15T22:28:13.559 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.559 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.559 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.559 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.559 INFO:teuthology.orchestra.run.smithi012.stdout: "req_symlink_latency": { 2024-09-15T22:28:13.559 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.560 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.560 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.560 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.560 INFO:teuthology.orchestra.run.smithi012.stdout: "req_unlink_latency": { 2024-09-15T22:28:13.560 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.560 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.561 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.561 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.561 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_revoke_eviction": 0, 2024-09-15T22:28:13.561 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_acquisition_throttle": 0, 2024-09-15T22:28:13.561 INFO:teuthology.orchestra.run.smithi012.stdout: "req_getvxattr_latency": { 2024-09-15T22:28:13.561 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.562 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.562 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.562 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-15T22:28:13.562 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.562 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_sessions": { 2024-09-15T22:28:13.562 INFO:teuthology.orchestra.run.smithi012.stdout: "session_count": 1, 2024-09-15T22:28:13.563 INFO:teuthology.orchestra.run.smithi012.stdout: "session_add": 2, 2024-09-15T22:28:13.563 INFO:teuthology.orchestra.run.smithi012.stdout: "session_remove": 1, 2024-09-15T22:28:13.563 INFO:teuthology.orchestra.run.smithi012.stdout: "sessions_open": 1, 2024-09-15T22:28:13.563 INFO:teuthology.orchestra.run.smithi012.stdout: "sessions_stale": 0, 2024-09-15T22:28:13.563 INFO:teuthology.orchestra.run.smithi012.stdout: "total_load": 0, 2024-09-15T22:28:13.564 INFO:teuthology.orchestra.run.smithi012.stdout: "average_load": 0, 2024-09-15T22:28:13.564 INFO:teuthology.orchestra.run.smithi012.stdout: "avg_session_uptime": 1540, 2024-09-15T22:28:13.564 INFO:teuthology.orchestra.run.smithi012.stdout: "mdthresh_evicted": 0 2024-09-15T22:28:13.564 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.564 INFO:teuthology.orchestra.run.smithi012.stdout: "mempool": { 2024-09-15T22:28:13.564 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:28:13.565 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_items": 0, 2024-09-15T22:28:13.565 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:28:13.565 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:28:13.565 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:28:13.565 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:28:13.566 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:28:13.566 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:28:13.566 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:28:13.566 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:28:13.566 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:28:13.566 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:28:13.567 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:28:13.567 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:28:13.567 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:28:13.567 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_items": 0, 2024-09-15T22:28:13.567 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:28:13.567 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_items": 0, 2024-09-15T22:28:13.567 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:28:13.568 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:28:13.568 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:28:13.568 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:28:13.568 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:28:13.568 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:28:13.568 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:28:13.569 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_items": 0, 2024-09-15T22:28:13.569 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:28:13.569 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:28:13.569 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:28:13.569 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_items": 0, 2024-09-15T22:28:13.569 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_bytes": 0, 2024-09-15T22:28:13.570 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_items": 0, 2024-09-15T22:28:13.570 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:28:13.570 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:28:13.570 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:28:13.570 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:28:13.570 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_bytes": 227386, 2024-09-15T22:28:13.570 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_items": 222, 2024-09-15T22:28:13.570 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:28:13.570 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_items": 0, 2024-09-15T22:28:13.571 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_bytes": 0, 2024-09-15T22:28:13.571 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_items": 0, 2024-09-15T22:28:13.571 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:28:13.571 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_items": 0, 2024-09-15T22:28:13.571 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:28:13.571 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_items": 0, 2024-09-15T22:28:13.571 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_bytes": 7888, 2024-09-15T22:28:13.571 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_items": 163, 2024-09-15T22:28:13.571 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:28:13.571 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:28:13.572 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_bytes": 0, 2024-09-15T22:28:13.572 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_items": 0, 2024-09-15T22:28:13.572 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_bytes": 8236995, 2024-09-15T22:28:13.572 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_items": 75745, 2024-09-15T22:28:13.572 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_bytes": 0, 2024-09-15T22:28:13.572 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_items": 0, 2024-09-15T22:28:13.573 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_bytes": 0, 2024-09-15T22:28:13.573 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_items": 0 2024-09-15T22:28:13.573 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.573 INFO:teuthology.orchestra.run.smithi012.stdout: "objecter": { 2024-09-15T22:28:13.573 INFO:teuthology.orchestra.run.smithi012.stdout: "op_active": 0, 2024-09-15T22:28:13.573 INFO:teuthology.orchestra.run.smithi012.stdout: "op_laggy": 0, 2024-09-15T22:28:13.573 INFO:teuthology.orchestra.run.smithi012.stdout: "op_send": 959, 2024-09-15T22:28:13.573 INFO:teuthology.orchestra.run.smithi012.stdout: "op_send_bytes": 21, 2024-09-15T22:28:13.573 INFO:teuthology.orchestra.run.smithi012.stdout: "op_resend": 3, 2024-09-15T22:28:13.573 INFO:teuthology.orchestra.run.smithi012.stdout: "op_reply": 959, 2024-09-15T22:28:13.573 INFO:teuthology.orchestra.run.smithi012.stdout: "op_latency": { 2024-09-15T22:28:13.573 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 959, 2024-09-15T22:28:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.833992334, 2024-09-15T22:28:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000869647 2024-09-15T22:28:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: "op_inflight": 0, 2024-09-15T22:28:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: "oplen_avg": { 2024-09-15T22:28:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 959, 2024-09-15T22:28:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 960 2024-09-15T22:28:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: "op": 959, 2024-09-15T22:28:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: "op_r": 959, 2024-09-15T22:28:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: "op_w": 0, 2024-09-15T22:28:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: "op_rmw": 0, 2024-09-15T22:28:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: "op_pg": 0, 2024-09-15T22:28:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_stat": 565, 2024-09-15T22:28:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_create": 0, 2024-09-15T22:28:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_read": 392, 2024-09-15T22:28:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_write": 0, 2024-09-15T22:28:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_writefull": 0, 2024-09-15T22:28:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_writesame": 0, 2024-09-15T22:28:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_append": 0, 2024-09-15T22:28:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_zero": 0, 2024-09-15T22:28:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_truncate": 0, 2024-09-15T22:28:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_delete": 0, 2024-09-15T22:28:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_mapext": 0, 2024-09-15T22:28:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_sparse_read": 0, 2024-09-15T22:28:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_clonerange": 0, 2024-09-15T22:28:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_getxattr": 1, 2024-09-15T22:28:13.576 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_setxattr": 0, 2024-09-15T22:28:13.576 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_cmpxattr": 0, 2024-09-15T22:28:13.576 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_rmxattr": 0, 2024-09-15T22:28:13.576 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_resetxattrs": 0, 2024-09-15T22:28:13.576 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_call": 0, 2024-09-15T22:28:13.576 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_watch": 0, 2024-09-15T22:28:13.576 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_notify": 0, 2024-09-15T22:28:13.576 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T22:28:13.576 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_pgls": 0, 2024-09-15T22:28:13.576 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_pgls_filter": 0, 2024-09-15T22:28:13.576 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_other": 0, 2024-09-15T22:28:13.576 INFO:teuthology.orchestra.run.smithi012.stdout: "linger_active": 0, 2024-09-15T22:28:13.576 INFO:teuthology.orchestra.run.smithi012.stdout: "linger_send": 0, 2024-09-15T22:28:13.577 INFO:teuthology.orchestra.run.smithi012.stdout: "linger_resend": 0, 2024-09-15T22:28:13.577 INFO:teuthology.orchestra.run.smithi012.stdout: "linger_ping": 0, 2024-09-15T22:28:13.577 INFO:teuthology.orchestra.run.smithi012.stdout: "poolop_active": 0, 2024-09-15T22:28:13.577 INFO:teuthology.orchestra.run.smithi012.stdout: "poolop_send": 0, 2024-09-15T22:28:13.577 INFO:teuthology.orchestra.run.smithi012.stdout: "poolop_resend": 0, 2024-09-15T22:28:13.577 INFO:teuthology.orchestra.run.smithi012.stdout: "poolstat_active": 0, 2024-09-15T22:28:13.577 INFO:teuthology.orchestra.run.smithi012.stdout: "poolstat_send": 0, 2024-09-15T22:28:13.577 INFO:teuthology.orchestra.run.smithi012.stdout: "poolstat_resend": 0, 2024-09-15T22:28:13.577 INFO:teuthology.orchestra.run.smithi012.stdout: "statfs_active": 0, 2024-09-15T22:28:13.577 INFO:teuthology.orchestra.run.smithi012.stdout: "statfs_send": 0, 2024-09-15T22:28:13.577 INFO:teuthology.orchestra.run.smithi012.stdout: "statfs_resend": 0, 2024-09-15T22:28:13.577 INFO:teuthology.orchestra.run.smithi012.stdout: "command_active": 0, 2024-09-15T22:28:13.577 INFO:teuthology.orchestra.run.smithi012.stdout: "command_send": 0, 2024-09-15T22:28:13.577 INFO:teuthology.orchestra.run.smithi012.stdout: "command_resend": 0, 2024-09-15T22:28:13.578 INFO:teuthology.orchestra.run.smithi012.stdout: "map_epoch": 86, 2024-09-15T22:28:13.578 INFO:teuthology.orchestra.run.smithi012.stdout: "map_full": 0, 2024-09-15T22:28:13.578 INFO:teuthology.orchestra.run.smithi012.stdout: "map_inc": 4, 2024-09-15T22:28:13.578 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_sessions": 9, 2024-09-15T22:28:13.578 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_session_open": 9, 2024-09-15T22:28:13.578 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_session_close": 0, 2024-09-15T22:28:13.578 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_laggy": 0, 2024-09-15T22:28:13.578 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_wr": 0, 2024-09-15T22:28:13.578 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_rd": 2, 2024-09-15T22:28:13.578 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_del": 0 2024-09-15T22:28:13.578 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.578 INFO:teuthology.orchestra.run.smithi012.stdout: "oft": { 2024-09-15T22:28:13.578 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_total_objs": 0, 2024-09-15T22:28:13.579 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_total_kv_pairs": 0, 2024-09-15T22:28:13.579 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_total_updates": 0, 2024-09-15T22:28:13.579 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_total_removes": 0 2024-09-15T22:28:13.579 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.579 INFO:teuthology.orchestra.run.smithi012.stdout: "osd-slow-ops": { 2024-09-15T22:28:13.579 INFO:teuthology.orchestra.run.smithi012.stdout: "slow_ops_count": 0 2024-09-15T22:28:13.579 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.579 INFO:teuthology.orchestra.run.smithi012.stdout: "purge_queue": { 2024-09-15T22:28:13.579 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executing_ops": 0, 2024-09-15T22:28:13.579 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executing_ops_high_water": 0, 2024-09-15T22:28:13.579 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executing": 0, 2024-09-15T22:28:13.579 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executing_high_water": 0, 2024-09-15T22:28:13.579 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executed_ops": 0, 2024-09-15T22:28:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executed": 0, 2024-09-15T22:28:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_item_in_journal": 0 2024-09-15T22:28:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:28:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-15T22:28:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 104857600, 2024-09-15T22:28:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-15T22:28:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 1073, 2024-09-15T22:28:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 56408634, 2024-09-15T22:28:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 1073, 2024-09-15T22:28:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2024-09-15T22:28:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2024-09-15T22:28:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 1073, 2024-09-15T22:28:13.581 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 56408634, 2024-09-15T22:28:13.581 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-15T22:28:13.581 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.581 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.581 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.581 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-15T22:28:13.581 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.581 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-objecter_bytes": { 2024-09-15T22:28:13.581 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-15T22:28:13.581 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 104857600, 2024-09-15T22:28:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-15T22:28:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 0, 2024-09-15T22:28:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 0, 2024-09-15T22:28:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 0, 2024-09-15T22:28:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 959, 2024-09-15T22:28:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 55758089, 2024-09-15T22:28:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 959, 2024-09-15T22:28:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 55758089, 2024-09-15T22:28:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-15T22:28:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.583 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-15T22:28:13.583 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.583 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-objecter_ops": { 2024-09-15T22:28:13.583 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-15T22:28:13.583 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 1024, 2024-09-15T22:28:13.583 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-15T22:28:13.583 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 0, 2024-09-15T22:28:13.583 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 0, 2024-09-15T22:28:13.583 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:13.583 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 0, 2024-09-15T22:28:13.583 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 959, 2024-09-15T22:28:13.583 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 959, 2024-09-15T22:28:13.583 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 959, 2024-09-15T22:28:13.583 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 959, 2024-09-15T22:28:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-15T22:28:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-15T22:28:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-write_buf_throttle": { 2024-09-15T22:28:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-15T22:28:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 3758096384, 2024-09-15T22:28:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-15T22:28:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 0, 2024-09-15T22:28:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 0, 2024-09-15T22:28:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 0, 2024-09-15T22:28:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2024-09-15T22:28:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2024-09-15T22:28:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 0, 2024-09-15T22:28:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 0, 2024-09-15T22:28:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-15T22:28:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-15T22:28:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-write_buf_throttle-0x555c3284e6e0": { 2024-09-15T22:28:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-15T22:28:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 3758096384, 2024-09-15T22:28:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-15T22:28:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 0, 2024-09-15T22:28:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 0, 2024-09-15T22:28:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 0, 2024-09-15T22:28:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2024-09-15T22:28:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2024-09-15T22:28:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 0, 2024-09-15T22:28:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 0, 2024-09-15T22:28:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-15T22:28:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-15T22:28:13.587 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-15T22:28:13.587 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-15T22:28:13.587 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:13 smithi098 ceph-mon[35514]: pgmap v456: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 73 KiB/s wr, 58 op/s 2024-09-15T22:28:14.257 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-15T22:28:14.258 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-15T22:28:14.258 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-15T22:28:14.258 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2024-09-15T22:28:14.258 DEBUG:tasks.check_counter:Getting stats from k 2024-09-15T22:28:14.258 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-15T22:28:14.508 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:28:14.998 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-15T22:28:14.998 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:28:14.998 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 4, 2024-09-15T22:28:14.998 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 4, 2024-09-15T22:28:14.998 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 3024, 2024-09-15T22:28:14.998 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 448, 2024-09-15T22:28:14.998 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 4, 2024-09-15T22:28:14.998 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 0, 2024-09-15T22:28:14.998 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.003142309, 2024-09-15T22:28:14.999 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.000043306, 2024-09-15T22:28:14.999 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.002310702, 2024-09-15T22:28:14.999 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:28:14.999 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:14.999 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 3, 2024-09-15T22:28:14.999 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.004299820, 2024-09-15T22:28:14.999 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.001433273 2024-09-15T22:28:14.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:14.999 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:14.999 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:14.999 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:14.999 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:15.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:15.000 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-15T22:28:15.000 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 448 2024-09-15T22:28:15.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:15.000 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:28:15.000 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 1, 2024-09-15T22:28:15.000 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 77, 2024-09-15T22:28:15.000 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 160, 2024-09-15T22:28:15.000 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 92080, 2024-09-15T22:28:15.000 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 3, 2024-09-15T22:28:15.000 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 2, 2024-09-15T22:28:15.000 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.005785954, 2024-09-15T22:28:15.001 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.003821832, 2024-09-15T22:28:15.001 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.000946275, 2024-09-15T22:28:15.001 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:28:15.001 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:15.001 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 75, 2024-09-15T22:28:15.001 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.004401712, 2024-09-15T22:28:15.001 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000058689 2024-09-15T22:28:15.001 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:15.001 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:15.001 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:15.001 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:15.001 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:15.001 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:15.002 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-15T22:28:15.002 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 92080 2024-09-15T22:28:15.002 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:15.002 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:28:15.002 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 105, 2024-09-15T22:28:15.002 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 102, 2024-09-15T22:28:15.002 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 447376, 2024-09-15T22:28:15.002 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 61488, 2024-09-15T22:28:15.002 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 2, 2024-09-15T22:28:15.002 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 1, 2024-09-15T22:28:15.002 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.017182861, 2024-09-15T22:28:15.002 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.007033019, 2024-09-15T22:28:15.002 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.014338184, 2024-09-15T22:28:15.003 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:28:15.003 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:15.003 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 101, 2024-09-15T22:28:15.003 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.005782462, 2024-09-15T22:28:15.003 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000057252 2024-09-15T22:28:15.003 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:15.003 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:15.003 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:15.003 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:15.003 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:15.003 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:15.003 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 447376, 2024-09-15T22:28:15.003 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 61488 2024-09-15T22:28:15.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:15.004 INFO:teuthology.orchestra.run.smithi012.stdout: "cct": { 2024-09-15T22:28:15.004 INFO:teuthology.orchestra.run.smithi012.stdout: "total_workers": 0, 2024-09-15T22:28:15.004 INFO:teuthology.orchestra.run.smithi012.stdout: "unhealthy_workers": 0 2024-09-15T22:28:15.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:15.004 INFO:teuthology.orchestra.run.smithi012.stdout: "mempool": { 2024-09-15T22:28:15.004 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:28:15.004 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_items": 0, 2024-09-15T22:28:15.004 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:28:15.004 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:28:15.004 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:28:15.004 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:28:15.005 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:28:15.005 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:28:15.005 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:28:15.005 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:28:15.005 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:28:15.005 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:28:15.005 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:28:15.005 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:28:15.005 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:28:15.005 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_items": 0, 2024-09-15T22:28:15.005 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:28:15.005 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_items": 0, 2024-09-15T22:28:15.005 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:28:15.006 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:28:15.006 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:28:15.006 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:28:15.006 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:28:15.006 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:28:15.006 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:28:15.006 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_items": 0, 2024-09-15T22:28:15.006 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:28:15.006 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:28:15.006 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:28:15.006 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_items": 0, 2024-09-15T22:28:15.006 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_bytes": 0, 2024-09-15T22:28:15.006 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_items": 0, 2024-09-15T22:28:15.006 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:28:15.007 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:28:15.007 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:28:15.007 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:28:15.007 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_bytes": 148823, 2024-09-15T22:28:15.007 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_items": 27, 2024-09-15T22:28:15.007 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:28:15.007 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_items": 0, 2024-09-15T22:28:15.007 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_bytes": 0, 2024-09-15T22:28:15.007 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_items": 0, 2024-09-15T22:28:15.007 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:28:15.007 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_items": 0, 2024-09-15T22:28:15.007 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:28:15.007 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_items": 0, 2024-09-15T22:28:15.007 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_bytes": 0, 2024-09-15T22:28:15.008 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_items": 0, 2024-09-15T22:28:15.008 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:28:15.008 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:28:15.008 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_bytes": 0, 2024-09-15T22:28:15.008 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_items": 0, 2024-09-15T22:28:15.008 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_bytes": 928, 2024-09-15T22:28:15.008 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_items": 2, 2024-09-15T22:28:15.008 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_bytes": 0, 2024-09-15T22:28:15.008 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_items": 0, 2024-09-15T22:28:15.008 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_bytes": 0, 2024-09-15T22:28:15.008 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_items": 0 2024-09-15T22:28:15.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-15T22:28:15.008 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:28:15.009 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-15T22:28:15.009 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 104857600, 2024-09-15T22:28:15.009 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-15T22:28:15.009 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 106, 2024-09-15T22:28:15.009 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 432569, 2024-09-15T22:28:15.009 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:15.009 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 106, 2024-09-15T22:28:15.009 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2024-09-15T22:28:15.009 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2024-09-15T22:28:15.009 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 106, 2024-09-15T22:28:15.009 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 432569, 2024-09-15T22:28:15.009 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-15T22:28:15.009 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-15T22:28:15.009 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-15T22:28:15.010 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-15T22:28:15.010 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-15T22:28:15.010 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-15T22:28:15.010 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-15T22:28:15.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:15 smithi012 ceph-mon[34883]: pgmap v457: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-15T22:28:15.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:15 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:28:15.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:15 smithi001 ceph-mon[30843]: pgmap v457: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-15T22:28:15.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:15 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:28:15.560 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:15 smithi098 ceph-mon[35514]: pgmap v457: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-15T22:28:15.560 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:15 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:28:15.672 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-15T22:28:15.672 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-15T22:28:15.672 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-09-15T22:28:15.672 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-09-15T22:28:15.672 DEBUG:tasks.check_counter:Getting stats from c 2024-09-15T22:28:15.673 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-15T22:28:15.916 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:28:16.287 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:16 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:28:16.287 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:16 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:28:16.287 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:16 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:28:16.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:16 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:28:16.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:16 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:28:16.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:16 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:28:16.393 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-15T22:28:16.393 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:28:16.393 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 14020, 2024-09-15T22:28:16.393 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 23649, 2024-09-15T22:28:16.394 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 9746601, 2024-09-15T22:28:16.394 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 24620885, 2024-09-15T22:28:16.394 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 8, 2024-09-15T22:28:16.394 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 3, 2024-09-15T22:28:16.394 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 1.089015730, 2024-09-15T22:28:16.394 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.547469433, 2024-09-15T22:28:16.394 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.554376500, 2024-09-15T22:28:16.394 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.045959106, 2024-09-15T22:28:16.394 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:16.394 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 23650, 2024-09-15T22:28:16.394 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.476866344, 2024-09-15T22:28:16.395 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000020163 2024-09-15T22:28:16.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.395 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:16.395 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 33769, 2024-09-15T22:28:16.395 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.006602191, 2024-09-15T22:28:16.395 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000195 2024-09-15T22:28:16.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.395 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 494320, 2024-09-15T22:28:16.395 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 65120 2024-09-15T22:28:16.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.395 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:28:16.395 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 26090, 2024-09-15T22:28:16.396 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 25874, 2024-09-15T22:28:16.396 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 8526735, 2024-09-15T22:28:16.396 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 18190806, 2024-09-15T22:28:16.396 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 10, 2024-09-15T22:28:16.396 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 6, 2024-09-15T22:28:16.396 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 1.268625320, 2024-09-15T22:28:16.396 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.531965597, 2024-09-15T22:28:16.396 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.801562820, 2024-09-15T22:28:16.396 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.074908086, 2024-09-15T22:28:16.396 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:16.396 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 25872, 2024-09-15T22:28:16.396 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.565913448, 2024-09-15T22:28:16.397 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000021873 2024-09-15T22:28:16.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.397 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:16.397 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 45966, 2024-09-15T22:28:16.397 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.006926384, 2024-09-15T22:28:16.397 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000150 2024-09-15T22:28:16.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.397 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-15T22:28:16.397 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 202640 2024-09-15T22:28:16.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.397 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:28:16.397 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 14306, 2024-09-15T22:28:16.397 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 31635, 2024-09-15T22:28:16.398 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 5055672, 2024-09-15T22:28:16.398 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 24609522, 2024-09-15T22:28:16.398 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 13, 2024-09-15T22:28:16.398 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 10, 2024-09-15T22:28:16.398 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.914799482, 2024-09-15T22:28:16.398 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.464121085, 2024-09-15T22:28:16.398 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.390934318, 2024-09-15T22:28:16.398 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.089271913, 2024-09-15T22:28:16.398 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:16.398 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 31632, 2024-09-15T22:28:16.398 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 1.082924848, 2024-09-15T22:28:16.398 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000034235 2024-09-15T22:28:16.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.399 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:16.399 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 17805, 2024-09-15T22:28:16.399 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.004946990, 2024-09-15T22:28:16.399 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000277 2024-09-15T22:28:16.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.399 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 4608, 2024-09-15T22:28:16.399 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 1888 2024-09-15T22:28:16.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.399 INFO:teuthology.orchestra.run.smithi098.stdout: "cct": { 2024-09-15T22:28:16.399 INFO:teuthology.orchestra.run.smithi098.stdout: "total_workers": 1, 2024-09-15T22:28:16.399 INFO:teuthology.orchestra.run.smithi098.stdout: "unhealthy_workers": 0 2024-09-15T22:28:16.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.399 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-MDSRank": { 2024-09-15T22:28:16.400 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-09-15T22:28:16.400 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-09-15T22:28:16.400 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 2520, 2024-09-15T22:28:16.400 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 5.263908900, 2024-09-15T22:28:16.400 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.002088852 2024-09-15T22:28:16.400 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:16.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.400 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-PurgeQueue": { 2024-09-15T22:28:16.400 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-09-15T22:28:16.400 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-09-15T22:28:16.400 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 8709, 2024-09-15T22:28:16.400 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 1.057362417, 2024-09-15T22:28:16.400 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000121410 2024-09-15T22:28:16.401 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:16.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.401 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-09-15T22:28:16.401 INFO:teuthology.orchestra.run.smithi098.stdout: "request": 8111, 2024-09-15T22:28:16.401 INFO:teuthology.orchestra.run.smithi098.stdout: "reply": 8070, 2024-09-15T22:28:16.401 INFO:teuthology.orchestra.run.smithi098.stdout: "reply_latency": { 2024-09-15T22:28:16.401 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 8070, 2024-09-15T22:28:16.401 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 17.299600867, 2024-09-15T22:28:16.401 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.002143692 2024-09-15T22:28:16.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.401 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_reply": 0, 2024-09-15T22:28:16.401 INFO:teuthology.orchestra.run.smithi098.stdout: "forward": 39, 2024-09-15T22:28:16.401 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_complete": 8, 2024-09-15T22:28:16.401 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_keys": 0, 2024-09-15T22:28:16.402 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_commit": 11, 2024-09-15T22:28:16.402 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_split": 0, 2024-09-15T22:28:16.402 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_merge": 0, 2024-09-15T22:28:16.402 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes": 392, 2024-09-15T22:28:16.402 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_top": 186, 2024-09-15T22:28:16.402 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_bottom": 121, 2024-09-15T22:28:16.402 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pin_tail": 85, 2024-09-15T22:28:16.402 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pinned": 124, 2024-09-15T22:28:16.402 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_expired": 2291, 2024-09-15T22:28:16.402 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_with_caps": 1, 2024-09-15T22:28:16.402 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": 1, 2024-09-15T22:28:16.402 INFO:teuthology.orchestra.run.smithi098.stdout: "subtrees": 4, 2024-09-15T22:28:16.402 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse": 12957, 2024-09-15T22:28:16.402 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_hit": 10950, 2024-09-15T22:28:16.403 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_forward": 36, 2024-09-15T22:28:16.403 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_discover": 982, 2024-09-15T22:28:16.403 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_dir_fetch": 0, 2024-09-15T22:28:16.403 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_remote_ino": 0, 2024-09-15T22:28:16.403 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_lock": 12, 2024-09-15T22:28:16.403 INFO:teuthology.orchestra.run.smithi098.stdout: "load_cent": 4950, 2024-09-15T22:28:16.403 INFO:teuthology.orchestra.run.smithi098.stdout: "q": 0, 2024-09-15T22:28:16.403 INFO:teuthology.orchestra.run.smithi098.stdout: "exported": 12, 2024-09-15T22:28:16.403 INFO:teuthology.orchestra.run.smithi098.stdout: "exported_inodes": 379, 2024-09-15T22:28:16.403 INFO:teuthology.orchestra.run.smithi098.stdout: "imported": 39, 2024-09-15T22:28:16.404 INFO:teuthology.orchestra.run.smithi098.stdout: "imported_inodes": 5648, 2024-09-15T22:28:16.404 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_dir_fetch": 0, 2024-09-15T22:28:16.404 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_backtrace_fetch": 0, 2024-09-15T22:28:16.404 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_peer_discover": 14, 2024-09-15T22:28:16.404 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rfiles": 3343, 2024-09-15T22:28:16.404 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rbytes": 23882834, 2024-09-15T22:28:16.404 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rsnaps": 0, 2024-09-15T22:28:16.404 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_fetch": 0, 2024-09-15T22:28:16.404 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_set_tag": 0, 2024-09-15T22:28:16.404 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T22:28:16.404 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_inotable_repaired": 0, 2024-09-15T22:28:16.404 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_inodes": 0, 2024-09-15T22:28:16.405 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T22:28:16.405 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dirfrag_rstats": 0, 2024-09-15T22:28:16.405 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_file_inodes": 0, 2024-09-15T22:28:16.405 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_inode_file_caps": 10, 2024-09-15T22:28:16.405 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_revoke": 1753, 2024-09-15T22:28:16.405 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_grant": 7104, 2024-09-15T22:28:16.405 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_trunc": 20, 2024-09-15T22:28:16.405 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T22:28:16.405 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T22:28:16.405 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps": 2995, 2024-09-15T22:28:16.405 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps_dirty": 375, 2024-09-15T22:28:16.405 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_cap_release": 63, 2024-09-15T22:28:16.405 INFO:teuthology.orchestra.run.smithi098.stdout: "process_request_cap_release": 6877 2024-09-15T22:28:16.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.406 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_cache": { 2024-09-15T22:28:16.406 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update": 1566, 2024-09-15T22:28:16.406 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update_receipt": 2743, 2024-09-15T22:28:16.406 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_try_discover": 1834, 2024-09-15T22:28:16.406 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_send_discover": 1856, 2024-09-15T22:28:16.406 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_handle_discover": 3133, 2024-09-15T22:28:16.406 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays": 67, 2024-09-15T22:28:16.406 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_delayed": 0, 2024-09-15T22:28:16.406 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_enqueuing": 0, 2024-09-15T22:28:16.406 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_created": 5302, 2024-09-15T22:28:16.406 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_enqueued": 5212, 2024-09-15T22:28:16.406 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_reintegrated": 29, 2024-09-15T22:28:16.406 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_migrated": 1, 2024-09-15T22:28:16.407 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_processing": 0, 2024-09-15T22:28:16.407 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_enqueued": 0, 2024-09-15T22:28:16.407 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_prioritized": 0, 2024-09-15T22:28:16.407 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_started": 0, 2024-09-15T22:28:16.407 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_completed": 0, 2024-09-15T22:28:16.407 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_path": 0, 2024-09-15T22:28:16.407 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_inode": 0, 2024-09-15T22:28:16.407 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T22:28:16.407 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_exportdir": 12, 2024-09-15T22:28:16.407 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_flush": 0, 2024-09-15T22:28:16.407 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragmentdir": 0, 2024-09-15T22:28:16.407 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragstats": 0, 2024-09-15T22:28:16.407 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_inodestats": 0 2024-09-15T22:28:16.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.408 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_log": { 2024-09-15T22:28:16.408 INFO:teuthology.orchestra.run.smithi098.stdout: "evlrg": 1, 2024-09-15T22:28:16.408 INFO:teuthology.orchestra.run.smithi098.stdout: "evadd": 16262, 2024-09-15T22:28:16.408 INFO:teuthology.orchestra.run.smithi098.stdout: "evex": 0, 2024-09-15T22:28:16.408 INFO:teuthology.orchestra.run.smithi098.stdout: "evtrm": 0, 2024-09-15T22:28:16.408 INFO:teuthology.orchestra.run.smithi098.stdout: "ev": 16262, 2024-09-15T22:28:16.408 INFO:teuthology.orchestra.run.smithi098.stdout: "evexg": 0, 2024-09-15T22:28:16.408 INFO:teuthology.orchestra.run.smithi098.stdout: "evexd": 0, 2024-09-15T22:28:16.408 INFO:teuthology.orchestra.run.smithi098.stdout: "segadd": 24, 2024-09-15T22:28:16.408 INFO:teuthology.orchestra.run.smithi098.stdout: "segex": 0, 2024-09-15T22:28:16.408 INFO:teuthology.orchestra.run.smithi098.stdout: "segtrm": 0, 2024-09-15T22:28:16.408 INFO:teuthology.orchestra.run.smithi098.stdout: "seg": 24, 2024-09-15T22:28:16.408 INFO:teuthology.orchestra.run.smithi098.stdout: "segmjr": 3, 2024-09-15T22:28:16.408 INFO:teuthology.orchestra.run.smithi098.stdout: "segexg": 0, 2024-09-15T22:28:16.409 INFO:teuthology.orchestra.run.smithi098.stdout: "segexd": 0, 2024-09-15T22:28:16.409 INFO:teuthology.orchestra.run.smithi098.stdout: "expos": 4194304, 2024-09-15T22:28:16.409 INFO:teuthology.orchestra.run.smithi098.stdout: "wrpos": 38412404, 2024-09-15T22:28:16.409 INFO:teuthology.orchestra.run.smithi098.stdout: "rdpos": 0, 2024-09-15T22:28:16.409 INFO:teuthology.orchestra.run.smithi098.stdout: "jlat": { 2024-09-15T22:28:16.409 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1237, 2024-09-15T22:28:16.409 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 4.264107570, 2024-09-15T22:28:16.409 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.003447136 2024-09-15T22:28:16.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.409 INFO:teuthology.orchestra.run.smithi098.stdout: "replayed": 0 2024-09-15T22:28:16.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.410 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_mem": { 2024-09-15T22:28:16.410 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 90, 2024-09-15T22:28:16.410 INFO:teuthology.orchestra.run.smithi098.stdout: "ino+": 6499, 2024-09-15T22:28:16.410 INFO:teuthology.orchestra.run.smithi098.stdout: "ino-": 6409, 2024-09-15T22:28:16.410 INFO:teuthology.orchestra.run.smithi098.stdout: "dir": 96, 2024-09-15T22:28:16.410 INFO:teuthology.orchestra.run.smithi098.stdout: "dir+": 1882, 2024-09-15T22:28:16.410 INFO:teuthology.orchestra.run.smithi098.stdout: "dir-": 1786, 2024-09-15T22:28:16.410 INFO:teuthology.orchestra.run.smithi098.stdout: "dn": 392, 2024-09-15T22:28:16.410 INFO:teuthology.orchestra.run.smithi098.stdout: "dn+": 13008, 2024-09-15T22:28:16.410 INFO:teuthology.orchestra.run.smithi098.stdout: "dn-": 12616, 2024-09-15T22:28:16.410 INFO:teuthology.orchestra.run.smithi098.stdout: "cap": 1, 2024-09-15T22:28:16.410 INFO:teuthology.orchestra.run.smithi098.stdout: "cap+": 5745, 2024-09-15T22:28:16.410 INFO:teuthology.orchestra.run.smithi098.stdout: "cap-": 5744, 2024-09-15T22:28:16.411 INFO:teuthology.orchestra.run.smithi098.stdout: "rss": 105232, 2024-09-15T22:28:16.411 INFO:teuthology.orchestra.run.smithi098.stdout: "heap": 223520 2024-09-15T22:28:16.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.411 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_server": { 2024-09-15T22:28:16.411 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_client_request": 13703, 2024-09-15T22:28:16.411 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_server_request": 255, 2024-09-15T22:28:16.411 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_request": 8111, 2024-09-15T22:28:16.411 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_session": 59, 2024-09-15T22:28:16.411 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_peer_request": 564, 2024-09-15T22:28:16.411 INFO:teuthology.orchestra.run.smithi098.stdout: "req_create_latency": { 2024-09-15T22:28:16.411 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 79, 2024-09-15T22:28:16.411 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.088544642, 2024-09-15T22:28:16.411 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.001120818 2024-09-15T22:28:16.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.412 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getattr_latency": { 2024-09-15T22:28:16.412 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 8, 2024-09-15T22:28:16.412 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.006393002, 2024-09-15T22:28:16.412 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000799125 2024-09-15T22:28:16.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.412 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getfilelock_latency": { 2024-09-15T22:28:16.412 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:16.412 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:16.412 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:16.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.412 INFO:teuthology.orchestra.run.smithi098.stdout: "req_link_latency": { 2024-09-15T22:28:16.412 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 17, 2024-09-15T22:28:16.412 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.030284559, 2024-09-15T22:28:16.413 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.001781444 2024-09-15T22:28:16.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.413 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookup_latency": { 2024-09-15T22:28:16.413 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1577, 2024-09-15T22:28:16.413 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.618835186, 2024-09-15T22:28:16.413 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000392412 2024-09-15T22:28:16.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.413 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookuphash_latency": { 2024-09-15T22:28:16.413 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:16.413 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:16.414 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:16.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.414 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupino_latency": { 2024-09-15T22:28:16.414 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1, 2024-09-15T22:28:16.414 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000109833, 2024-09-15T22:28:16.414 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000109833 2024-09-15T22:28:16.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.414 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupname_latency": { 2024-09-15T22:28:16.414 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:16.414 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:16.415 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:16.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.415 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupparent_latency": { 2024-09-15T22:28:16.415 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:16.415 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:16.415 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:16.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.415 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupsnap_latency": { 2024-09-15T22:28:16.415 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:16.415 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:16.415 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:16.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.416 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lssnap_latency": { 2024-09-15T22:28:16.417 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:16.417 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:16.417 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:16.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.417 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mkdir_latency": { 2024-09-15T22:28:16.417 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 38, 2024-09-15T22:28:16.417 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.033470363, 2024-09-15T22:28:16.417 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000880799 2024-09-15T22:28:16.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.417 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mknod_latency": { 2024-09-15T22:28:16.417 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 38, 2024-09-15T22:28:16.418 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.040123726, 2024-09-15T22:28:16.418 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.001055887 2024-09-15T22:28:16.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.418 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mksnap_latency": { 2024-09-15T22:28:16.418 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:16.418 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:16.418 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:16.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.418 INFO:teuthology.orchestra.run.smithi098.stdout: "req_open_latency": { 2024-09-15T22:28:16.418 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:16.418 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:16.418 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:16.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.419 INFO:teuthology.orchestra.run.smithi098.stdout: "req_readdir_latency": { 2024-09-15T22:28:16.419 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 842, 2024-09-15T22:28:16.419 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 1.002385238, 2024-09-15T22:28:16.419 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.001190481 2024-09-15T22:28:16.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.419 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rename_latency": { 2024-09-15T22:28:16.419 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 68, 2024-09-15T22:28:16.419 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.500596248, 2024-09-15T22:28:16.419 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.007361709 2024-09-15T22:28:16.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.419 INFO:teuthology.orchestra.run.smithi098.stdout: "req_renamesnap_latency": { 2024-09-15T22:28:16.419 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:16.419 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:16.419 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:16.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.420 INFO:teuthology.orchestra.run.smithi098.stdout: "req_snapdiff_latency": { 2024-09-15T22:28:16.420 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:16.420 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:16.420 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:16.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.420 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmdir_latency": { 2024-09-15T22:28:16.420 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 824, 2024-09-15T22:28:16.420 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 9.304116933, 2024-09-15T22:28:16.420 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.011291404 2024-09-15T22:28:16.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.420 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmsnap_latency": { 2024-09-15T22:28:16.420 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:16.420 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:16.421 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:16.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.421 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmxattr_latency": { 2024-09-15T22:28:16.421 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:16.421 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:16.421 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:16.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.421 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setattr_latency": { 2024-09-15T22:28:16.421 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 20, 2024-09-15T22:28:16.421 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.017761838, 2024-09-15T22:28:16.421 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000888091 2024-09-15T22:28:16.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.422 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setdirlayout_latency": { 2024-09-15T22:28:16.422 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:16.422 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:16.422 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:16.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.422 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setfilelock_latency": { 2024-09-15T22:28:16.422 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:16.422 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:16.422 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:16.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.422 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setlayout_latency": { 2024-09-15T22:28:16.422 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:16.423 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:16.423 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:16.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.423 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setxattr_latency": { 2024-09-15T22:28:16.423 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:16.423 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:16.423 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:16.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.423 INFO:teuthology.orchestra.run.smithi098.stdout: "req_symlink_latency": { 2024-09-15T22:28:16.423 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 37, 2024-09-15T22:28:16.423 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.032547582, 2024-09-15T22:28:16.423 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000879664 2024-09-15T22:28:16.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.423 INFO:teuthology.orchestra.run.smithi098.stdout: "req_unlink_latency": { 2024-09-15T22:28:16.423 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 4521, 2024-09-15T22:28:16.424 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 5.624431717, 2024-09-15T22:28:16.424 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.001244068 2024-09-15T22:28:16.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.424 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_revoke_eviction": 0, 2024-09-15T22:28:16.424 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_acquisition_throttle": 0, 2024-09-15T22:28:16.424 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getvxattr_latency": { 2024-09-15T22:28:16.424 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:16.424 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:16.424 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:16.424 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:16.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.424 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_sessions": { 2024-09-15T22:28:16.424 INFO:teuthology.orchestra.run.smithi098.stdout: "session_count": 1, 2024-09-15T22:28:16.425 INFO:teuthology.orchestra.run.smithi098.stdout: "session_add": 2, 2024-09-15T22:28:16.425 INFO:teuthology.orchestra.run.smithi098.stdout: "session_remove": 1, 2024-09-15T22:28:16.425 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_open": 1, 2024-09-15T22:28:16.425 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_stale": 0, 2024-09-15T22:28:16.425 INFO:teuthology.orchestra.run.smithi098.stdout: "total_load": 6735, 2024-09-15T22:28:16.425 INFO:teuthology.orchestra.run.smithi098.stdout: "average_load": 6735, 2024-09-15T22:28:16.425 INFO:teuthology.orchestra.run.smithi098.stdout: "avg_session_uptime": 192, 2024-09-15T22:28:16.425 INFO:teuthology.orchestra.run.smithi098.stdout: "mdthresh_evicted": 0 2024-09-15T22:28:16.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.425 INFO:teuthology.orchestra.run.smithi098.stdout: "mempool": { 2024-09-15T22:28:16.425 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:28:16.425 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_items": 0, 2024-09-15T22:28:16.425 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:28:16.426 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:28:16.426 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:28:16.426 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:28:16.426 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:28:16.426 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:28:16.426 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:28:16.426 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:28:16.426 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:28:16.426 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:28:16.426 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:28:16.426 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:28:16.426 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:28:16.426 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_items": 0, 2024-09-15T22:28:16.426 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:28:16.427 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_items": 0, 2024-09-15T22:28:16.427 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:28:16.427 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:28:16.427 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:28:16.427 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:28:16.427 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:28:16.427 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:28:16.427 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:28:16.427 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_items": 0, 2024-09-15T22:28:16.427 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:28:16.427 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:28:16.427 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:28:16.427 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_items": 0, 2024-09-15T22:28:16.428 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_bytes": 0, 2024-09-15T22:28:16.428 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_items": 0, 2024-09-15T22:28:16.428 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:28:16.428 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:28:16.428 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:28:16.428 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:28:16.428 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_bytes": 301311, 2024-09-15T22:28:16.428 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_items": 184, 2024-09-15T22:28:16.428 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:28:16.428 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_items": 0, 2024-09-15T22:28:16.428 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_bytes": 0, 2024-09-15T22:28:16.428 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_items": 0, 2024-09-15T22:28:16.428 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:28:16.428 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_items": 0, 2024-09-15T22:28:16.429 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:28:16.429 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_items": 0, 2024-09-15T22:28:16.429 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_bytes": 7888, 2024-09-15T22:28:16.429 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_items": 163, 2024-09-15T22:28:16.429 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:28:16.429 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:28:16.429 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_bytes": 0, 2024-09-15T22:28:16.429 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_items": 0, 2024-09-15T22:28:16.429 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_bytes": 654970, 2024-09-15T22:28:16.429 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_items": 17475, 2024-09-15T22:28:16.429 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_bytes": 0, 2024-09-15T22:28:16.429 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_items": 0, 2024-09-15T22:28:16.429 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_bytes": 0, 2024-09-15T22:28:16.430 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_items": 0 2024-09-15T22:28:16.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.430 INFO:teuthology.orchestra.run.smithi098.stdout: "objecter": { 2024-09-15T22:28:16.430 INFO:teuthology.orchestra.run.smithi098.stdout: "op_active": 0, 2024-09-15T22:28:16.430 INFO:teuthology.orchestra.run.smithi098.stdout: "op_laggy": 0, 2024-09-15T22:28:16.430 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send": 7195, 2024-09-15T22:28:16.430 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send_bytes": 34960133, 2024-09-15T22:28:16.430 INFO:teuthology.orchestra.run.smithi098.stdout: "op_resend": 28, 2024-09-15T22:28:16.430 INFO:teuthology.orchestra.run.smithi098.stdout: "op_reply": 7195, 2024-09-15T22:28:16.430 INFO:teuthology.orchestra.run.smithi098.stdout: "op_latency": { 2024-09-15T22:28:16.430 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 7195, 2024-09-15T22:28:16.430 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 21.571723517, 2024-09-15T22:28:16.430 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.002998154 2024-09-15T22:28:16.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.431 INFO:teuthology.orchestra.run.smithi098.stdout: "op_inflight": 0, 2024-09-15T22:28:16.431 INFO:teuthology.orchestra.run.smithi098.stdout: "oplen_avg": { 2024-09-15T22:28:16.431 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 7195, 2024-09-15T22:28:16.431 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 7317 2024-09-15T22:28:16.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.431 INFO:teuthology.orchestra.run.smithi098.stdout: "op": 7195, 2024-09-15T22:28:16.431 INFO:teuthology.orchestra.run.smithi098.stdout: "op_r": 167, 2024-09-15T22:28:16.431 INFO:teuthology.orchestra.run.smithi098.stdout: "op_w": 7028, 2024-09-15T22:28:16.431 INFO:teuthology.orchestra.run.smithi098.stdout: "op_rmw": 0, 2024-09-15T22:28:16.431 INFO:teuthology.orchestra.run.smithi098.stdout: "op_pg": 0, 2024-09-15T22:28:16.431 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_stat": 0, 2024-09-15T22:28:16.431 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_create": 10, 2024-09-15T22:28:16.431 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_read": 159, 2024-09-15T22:28:16.431 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_write": 1396, 2024-09-15T22:28:16.432 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writefull": 70, 2024-09-15T22:28:16.432 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writesame": 0, 2024-09-15T22:28:16.432 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_append": 0, 2024-09-15T22:28:16.432 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_zero": 0, 2024-09-15T22:28:16.432 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_truncate": 0, 2024-09-15T22:28:16.432 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_delete": 5463, 2024-09-15T22:28:16.432 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_mapext": 0, 2024-09-15T22:28:16.432 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_sparse_read": 0, 2024-09-15T22:28:16.432 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_clonerange": 0, 2024-09-15T22:28:16.432 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_getxattr": 7, 2024-09-15T22:28:16.432 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_setxattr": 20, 2024-09-15T22:28:16.432 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_cmpxattr": 0, 2024-09-15T22:28:16.432 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_rmxattr": 0, 2024-09-15T22:28:16.433 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_resetxattrs": 0, 2024-09-15T22:28:16.433 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_call": 0, 2024-09-15T22:28:16.433 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_watch": 0, 2024-09-15T22:28:16.433 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_notify": 0, 2024-09-15T22:28:16.433 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T22:28:16.433 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls": 0, 2024-09-15T22:28:16.433 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls_filter": 0, 2024-09-15T22:28:16.433 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_other": 25, 2024-09-15T22:28:16.433 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_active": 0, 2024-09-15T22:28:16.433 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_send": 0, 2024-09-15T22:28:16.433 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_resend": 0, 2024-09-15T22:28:16.433 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_ping": 0, 2024-09-15T22:28:16.433 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_active": 0, 2024-09-15T22:28:16.434 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_send": 0, 2024-09-15T22:28:16.434 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_resend": 0, 2024-09-15T22:28:16.434 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_active": 0, 2024-09-15T22:28:16.434 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_send": 0, 2024-09-15T22:28:16.434 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_resend": 0, 2024-09-15T22:28:16.434 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_active": 0, 2024-09-15T22:28:16.434 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_send": 0, 2024-09-15T22:28:16.434 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_resend": 0, 2024-09-15T22:28:16.434 INFO:teuthology.orchestra.run.smithi098.stdout: "command_active": 0, 2024-09-15T22:28:16.434 INFO:teuthology.orchestra.run.smithi098.stdout: "command_send": 0, 2024-09-15T22:28:16.434 INFO:teuthology.orchestra.run.smithi098.stdout: "command_resend": 0, 2024-09-15T22:28:16.434 INFO:teuthology.orchestra.run.smithi098.stdout: "map_epoch": 86, 2024-09-15T22:28:16.434 INFO:teuthology.orchestra.run.smithi098.stdout: "map_full": 0, 2024-09-15T22:28:16.434 INFO:teuthology.orchestra.run.smithi098.stdout: "map_inc": 4, 2024-09-15T22:28:16.435 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_sessions": 12, 2024-09-15T22:28:16.435 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_open": 12, 2024-09-15T22:28:16.435 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_close": 0, 2024-09-15T22:28:16.435 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_laggy": 0, 2024-09-15T22:28:16.435 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_wr": 112, 2024-09-15T22:28:16.435 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_rd": 16, 2024-09-15T22:28:16.435 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_del": 39 2024-09-15T22:28:16.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.435 INFO:teuthology.orchestra.run.smithi098.stdout: "oft": { 2024-09-15T22:28:16.435 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_objs": 1, 2024-09-15T22:28:16.435 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_kv_pairs": 0, 2024-09-15T22:28:16.435 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_updates": 0, 2024-09-15T22:28:16.435 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_removes": 0 2024-09-15T22:28:16.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.436 INFO:teuthology.orchestra.run.smithi098.stdout: "osd-slow-ops": { 2024-09-15T22:28:16.436 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_ops_count": 0 2024-09-15T22:28:16.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.436 INFO:teuthology.orchestra.run.smithi098.stdout: "purge_queue": { 2024-09-15T22:28:16.436 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops": 0, 2024-09-15T22:28:16.436 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops_high_water": 18, 2024-09-15T22:28:16.436 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing": 0, 2024-09-15T22:28:16.436 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_high_water": 10, 2024-09-15T22:28:16.436 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed_ops": 5443, 2024-09-15T22:28:16.436 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed": 5212, 2024-09-15T22:28:16.436 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_item_in_journal": 0 2024-09-15T22:28:16.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.436 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:28:16.436 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-15T22:28:16.437 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-09-15T22:28:16.437 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-15T22:28:16.437 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 54412, 2024-09-15T22:28:16.437 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 18600456, 2024-09-15T22:28:16.437 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:16.437 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 54412, 2024-09-15T22:28:16.437 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-15T22:28:16.437 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-15T22:28:16.437 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 54412, 2024-09-15T22:28:16.437 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 18600456, 2024-09-15T22:28:16.437 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-15T22:28:16.437 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:16.437 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:16.437 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:16.438 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:16.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.438 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_bytes": { 2024-09-15T22:28:16.438 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-15T22:28:16.438 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-09-15T22:28:16.438 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-15T22:28:16.438 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-09-15T22:28:16.438 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-09-15T22:28:16.438 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:16.438 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-09-15T22:28:16.438 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 7195, 2024-09-15T22:28:16.438 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 35486433, 2024-09-15T22:28:16.438 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 7195, 2024-09-15T22:28:16.439 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 35486433, 2024-09-15T22:28:16.439 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-15T22:28:16.439 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:16.439 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:16.439 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:16.439 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:16.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.439 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_ops": { 2024-09-15T22:28:16.439 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-15T22:28:16.439 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 1024, 2024-09-15T22:28:16.439 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-15T22:28:16.439 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-09-15T22:28:16.440 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-09-15T22:28:16.440 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:16.440 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-09-15T22:28:16.440 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 7195, 2024-09-15T22:28:16.440 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 7195, 2024-09-15T22:28:16.440 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 7195, 2024-09-15T22:28:16.440 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 7195, 2024-09-15T22:28:16.440 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-15T22:28:16.440 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:16.440 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:16.440 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:16.440 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:16.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.441 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle": { 2024-09-15T22:28:16.441 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-15T22:28:16.441 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-09-15T22:28:16.441 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-15T22:28:16.441 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 5212, 2024-09-15T22:28:16.441 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 526428, 2024-09-15T22:28:16.441 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:16.441 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 5212, 2024-09-15T22:28:16.441 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-15T22:28:16.441 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-15T22:28:16.441 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 159, 2024-09-15T22:28:16.441 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 526428, 2024-09-15T22:28:16.441 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-15T22:28:16.442 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:16.442 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:16.442 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:16.442 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:16.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:16.442 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle-0x555d455e0500": { 2024-09-15T22:28:16.442 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-15T22:28:16.442 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-09-15T22:28:16.442 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-15T22:28:16.442 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 16262, 2024-09-15T22:28:16.442 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 34218100, 2024-09-15T22:28:16.442 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:16.442 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 16262, 2024-09-15T22:28:16.442 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-15T22:28:16.442 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-15T22:28:16.442 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 1237, 2024-09-15T22:28:16.443 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 34218100, 2024-09-15T22:28:16.443 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-15T22:28:16.443 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:16.443 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:16.443 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:16.443 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:16.443 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:16.443 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-15T22:28:16.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:16 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:28:16.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:16 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:28:16.496 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:16 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' 2024-09-15T22:28:17.264 INFO:tasks.check_counter:Daemon mds.c mds.exported=12 2024-09-15T22:28:17.264 INFO:tasks.check_counter:Daemon mds.c mds.imported=39 2024-09-15T22:28:17.264 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=1566 2024-09-15T22:28:17.264 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=2743 2024-09-15T22:28:17.264 DEBUG:tasks.check_counter:Getting stats from f 2024-09-15T22:28:17.264 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-15T22:28:17.510 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:28:17.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:17 smithi012 ceph-mon[34883]: pgmap v458: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-09-15T22:28:17.771 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:17 smithi098 ceph-mon[35514]: pgmap v458: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-09-15T22:28:17.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:17 smithi001 ceph-mon[30843]: pgmap v458: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-09-15T22:28:18.007 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-15T22:28:18.007 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:28:18.007 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 672, 2024-09-15T22:28:18.007 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 674, 2024-09-15T22:28:18.007 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 29558025, 2024-09-15T22:28:18.007 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 213706, 2024-09-15T22:28:18.007 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 7, 2024-09-15T22:28:18.007 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 3, 2024-09-15T22:28:18.007 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.072877813, 2024-09-15T22:28:18.007 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.018524617, 2024-09-15T22:28:18.008 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.029736572, 2024-09-15T22:28:18.008 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.018467512, 2024-09-15T22:28:18.008 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:18.008 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 672, 2024-09-15T22:28:18.008 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.028042336, 2024-09-15T22:28:18.008 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000041729 2024-09-15T22:28:18.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.008 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:18.008 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.008 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.008 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.008 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T22:28:18.008 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T22:28:18.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.009 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:28:18.009 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 85, 2024-09-15T22:28:18.009 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 157, 2024-09-15T22:28:18.009 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 20997468, 2024-09-15T22:28:18.009 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 228770, 2024-09-15T22:28:18.009 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 6, 2024-09-15T22:28:18.009 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 5, 2024-09-15T22:28:18.009 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.023085010, 2024-09-15T22:28:18.009 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.004677569, 2024-09-15T22:28:18.009 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.015552011, 2024-09-15T22:28:18.009 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.001637989, 2024-09-15T22:28:18.010 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:18.010 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 156, 2024-09-15T22:28:18.010 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.016206837, 2024-09-15T22:28:18.010 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000103889 2024-09-15T22:28:18.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.010 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:18.010 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.010 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.010 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.011 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-09-15T22:28:18.011 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 203264 2024-09-15T22:28:18.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.011 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:28:18.011 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 446, 2024-09-15T22:28:18.011 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 438, 2024-09-15T22:28:18.011 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 15137590, 2024-09-15T22:28:18.011 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 166191, 2024-09-15T22:28:18.011 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 4, 2024-09-15T22:28:18.011 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 3, 2024-09-15T22:28:18.011 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.052266967, 2024-09-15T22:28:18.011 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.016843920, 2024-09-15T22:28:18.012 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.029990833, 2024-09-15T22:28:18.012 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.008650077, 2024-09-15T22:28:18.012 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:18.012 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 437, 2024-09-15T22:28:18.012 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.139327456, 2024-09-15T22:28:18.012 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000318827 2024-09-15T22:28:18.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.013 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:18.013 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.013 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.013 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.013 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 482944, 2024-09-15T22:28:18.013 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 61568 2024-09-15T22:28:18.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.013 INFO:teuthology.orchestra.run.smithi098.stdout: "cct": { 2024-09-15T22:28:18.013 INFO:teuthology.orchestra.run.smithi098.stdout: "total_workers": 1, 2024-09-15T22:28:18.014 INFO:teuthology.orchestra.run.smithi098.stdout: "unhealthy_workers": 0 2024-09-15T22:28:18.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.014 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-MDSRank": { 2024-09-15T22:28:18.014 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-09-15T22:28:18.014 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-09-15T22:28:18.014 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1773, 2024-09-15T22:28:18.014 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.227378332, 2024-09-15T22:28:18.014 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000128244 2024-09-15T22:28:18.015 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:18.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.015 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-PurgeQueue": { 2024-09-15T22:28:18.015 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-09-15T22:28:18.015 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-09-15T22:28:18.015 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.015 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.015 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.015 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:18.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.015 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-09-15T22:28:18.015 INFO:teuthology.orchestra.run.smithi098.stdout: "request": 0, 2024-09-15T22:28:18.015 INFO:teuthology.orchestra.run.smithi098.stdout: "reply": 0, 2024-09-15T22:28:18.016 INFO:teuthology.orchestra.run.smithi098.stdout: "reply_latency": { 2024-09-15T22:28:18.016 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.016 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.016 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.016 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_reply": 0, 2024-09-15T22:28:18.016 INFO:teuthology.orchestra.run.smithi098.stdout: "forward": 0, 2024-09-15T22:28:18.016 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_complete": 0, 2024-09-15T22:28:18.017 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_keys": 0, 2024-09-15T22:28:18.017 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_commit": 0, 2024-09-15T22:28:18.017 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_split": 0, 2024-09-15T22:28:18.017 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_merge": 0, 2024-09-15T22:28:18.017 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes": 1056, 2024-09-15T22:28:18.017 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_top": 725, 2024-09-15T22:28:18.017 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_bottom": 331, 2024-09-15T22:28:18.017 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pin_tail": 0, 2024-09-15T22:28:18.017 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pinned": 19, 2024-09-15T22:28:18.017 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_expired": 0, 2024-09-15T22:28:18.017 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_with_caps": 0, 2024-09-15T22:28:18.017 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": 0, 2024-09-15T22:28:18.017 INFO:teuthology.orchestra.run.smithi098.stdout: "subtrees": 2, 2024-09-15T22:28:18.017 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse": 0, 2024-09-15T22:28:18.018 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_hit": 0, 2024-09-15T22:28:18.018 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_forward": 0, 2024-09-15T22:28:18.018 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_discover": 0, 2024-09-15T22:28:18.018 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_dir_fetch": 0, 2024-09-15T22:28:18.018 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_remote_ino": 0, 2024-09-15T22:28:18.018 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_lock": 0, 2024-09-15T22:28:18.018 INFO:teuthology.orchestra.run.smithi098.stdout: "load_cent": 0, 2024-09-15T22:28:18.018 INFO:teuthology.orchestra.run.smithi098.stdout: "q": 0, 2024-09-15T22:28:18.018 INFO:teuthology.orchestra.run.smithi098.stdout: "exported": 0, 2024-09-15T22:28:18.018 INFO:teuthology.orchestra.run.smithi098.stdout: "exported_inodes": 0, 2024-09-15T22:28:18.018 INFO:teuthology.orchestra.run.smithi098.stdout: "imported": 0, 2024-09-15T22:28:18.018 INFO:teuthology.orchestra.run.smithi098.stdout: "imported_inodes": 0, 2024-09-15T22:28:18.018 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_dir_fetch": 0, 2024-09-15T22:28:18.019 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_backtrace_fetch": 0, 2024-09-15T22:28:18.019 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_peer_discover": 0, 2024-09-15T22:28:18.019 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rfiles": 4, 2024-09-15T22:28:18.019 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rbytes": 234, 2024-09-15T22:28:18.019 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rsnaps": 0, 2024-09-15T22:28:18.019 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_fetch": 0, 2024-09-15T22:28:18.019 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_set_tag": 0, 2024-09-15T22:28:18.019 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T22:28:18.019 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_inotable_repaired": 0, 2024-09-15T22:28:18.019 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_inodes": 0, 2024-09-15T22:28:18.019 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T22:28:18.019 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dirfrag_rstats": 0, 2024-09-15T22:28:18.019 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_file_inodes": 0, 2024-09-15T22:28:18.020 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_inode_file_caps": 0, 2024-09-15T22:28:18.020 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_revoke": 0, 2024-09-15T22:28:18.020 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_grant": 0, 2024-09-15T22:28:18.020 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_trunc": 0, 2024-09-15T22:28:18.020 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T22:28:18.020 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T22:28:18.020 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps": 0, 2024-09-15T22:28:18.020 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps_dirty": 0, 2024-09-15T22:28:18.020 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_cap_release": 0, 2024-09-15T22:28:18.020 INFO:teuthology.orchestra.run.smithi098.stdout: "process_request_cap_release": 0 2024-09-15T22:28:18.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.020 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_cache": { 2024-09-15T22:28:18.021 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update": 0, 2024-09-15T22:28:18.021 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update_receipt": 0, 2024-09-15T22:28:18.021 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_try_discover": 0, 2024-09-15T22:28:18.021 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_send_discover": 0, 2024-09-15T22:28:18.021 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_handle_discover": 0, 2024-09-15T22:28:18.021 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays": 0, 2024-09-15T22:28:18.021 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_delayed": 0, 2024-09-15T22:28:18.021 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_enqueuing": 0, 2024-09-15T22:28:18.021 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_created": 0, 2024-09-15T22:28:18.021 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_enqueued": 0, 2024-09-15T22:28:18.021 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_reintegrated": 0, 2024-09-15T22:28:18.021 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_migrated": 0, 2024-09-15T22:28:18.021 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_processing": 0, 2024-09-15T22:28:18.022 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_enqueued": 0, 2024-09-15T22:28:18.022 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_prioritized": 0, 2024-09-15T22:28:18.022 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_started": 0, 2024-09-15T22:28:18.022 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_completed": 0, 2024-09-15T22:28:18.022 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_path": 0, 2024-09-15T22:28:18.022 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_inode": 0, 2024-09-15T22:28:18.022 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T22:28:18.022 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_exportdir": 0, 2024-09-15T22:28:18.022 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_flush": 0, 2024-09-15T22:28:18.022 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragmentdir": 0, 2024-09-15T22:28:18.022 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragstats": 0, 2024-09-15T22:28:18.022 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_inodestats": 0 2024-09-15T22:28:18.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.022 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_log": { 2024-09-15T22:28:18.023 INFO:teuthology.orchestra.run.smithi098.stdout: "evlrg": 0, 2024-09-15T22:28:18.023 INFO:teuthology.orchestra.run.smithi098.stdout: "evadd": 0, 2024-09-15T22:28:18.023 INFO:teuthology.orchestra.run.smithi098.stdout: "evex": 0, 2024-09-15T22:28:18.023 INFO:teuthology.orchestra.run.smithi098.stdout: "evtrm": 0, 2024-09-15T22:28:18.023 INFO:teuthology.orchestra.run.smithi098.stdout: "ev": 28952, 2024-09-15T22:28:18.023 INFO:teuthology.orchestra.run.smithi098.stdout: "evexg": 0, 2024-09-15T22:28:18.023 INFO:teuthology.orchestra.run.smithi098.stdout: "evexd": 0, 2024-09-15T22:28:18.023 INFO:teuthology.orchestra.run.smithi098.stdout: "segadd": 0, 2024-09-15T22:28:18.023 INFO:teuthology.orchestra.run.smithi098.stdout: "segex": 0, 2024-09-15T22:28:18.023 INFO:teuthology.orchestra.run.smithi098.stdout: "segtrm": 0, 2024-09-15T22:28:18.023 INFO:teuthology.orchestra.run.smithi098.stdout: "seg": 2, 2024-09-15T22:28:18.023 INFO:teuthology.orchestra.run.smithi098.stdout: "segmjr": 16, 2024-09-15T22:28:18.024 INFO:teuthology.orchestra.run.smithi098.stdout: "segexg": 0, 2024-09-15T22:28:18.024 INFO:teuthology.orchestra.run.smithi098.stdout: "segexd": 0, 2024-09-15T22:28:18.024 INFO:teuthology.orchestra.run.smithi098.stdout: "expos": 69065703, 2024-09-15T22:28:18.024 INFO:teuthology.orchestra.run.smithi098.stdout: "wrpos": 69096932, 2024-09-15T22:28:18.024 INFO:teuthology.orchestra.run.smithi098.stdout: "rdpos": 69094095, 2024-09-15T22:28:18.024 INFO:teuthology.orchestra.run.smithi098.stdout: "jlat": { 2024-09-15T22:28:18.024 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.024 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.024 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.024 INFO:teuthology.orchestra.run.smithi098.stdout: "replayed": 28952 2024-09-15T22:28:18.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.025 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_mem": { 2024-09-15T22:28:18.025 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 23, 2024-09-15T22:28:18.025 INFO:teuthology.orchestra.run.smithi098.stdout: "ino+": 13871, 2024-09-15T22:28:18.025 INFO:teuthology.orchestra.run.smithi098.stdout: "ino-": 13848, 2024-09-15T22:28:18.025 INFO:teuthology.orchestra.run.smithi098.stdout: "dir": 18, 2024-09-15T22:28:18.025 INFO:teuthology.orchestra.run.smithi098.stdout: "dir+": 1771, 2024-09-15T22:28:18.025 INFO:teuthology.orchestra.run.smithi098.stdout: "dir-": 1753, 2024-09-15T22:28:18.025 INFO:teuthology.orchestra.run.smithi098.stdout: "dn": 1056, 2024-09-15T22:28:18.025 INFO:teuthology.orchestra.run.smithi098.stdout: "dn+": 15558, 2024-09-15T22:28:18.025 INFO:teuthology.orchestra.run.smithi098.stdout: "dn-": 14502, 2024-09-15T22:28:18.025 INFO:teuthology.orchestra.run.smithi098.stdout: "cap": 0, 2024-09-15T22:28:18.025 INFO:teuthology.orchestra.run.smithi098.stdout: "cap+": 0, 2024-09-15T22:28:18.026 INFO:teuthology.orchestra.run.smithi098.stdout: "cap-": 0, 2024-09-15T22:28:18.026 INFO:teuthology.orchestra.run.smithi098.stdout: "rss": 72124, 2024-09-15T22:28:18.026 INFO:teuthology.orchestra.run.smithi098.stdout: "heap": 215328 2024-09-15T22:28:18.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.026 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_server": { 2024-09-15T22:28:18.026 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_client_request": 0, 2024-09-15T22:28:18.026 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_server_request": 0, 2024-09-15T22:28:18.026 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_request": 0, 2024-09-15T22:28:18.026 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_session": 0, 2024-09-15T22:28:18.026 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_peer_request": 0, 2024-09-15T22:28:18.026 INFO:teuthology.orchestra.run.smithi098.stdout: "req_create_latency": { 2024-09-15T22:28:18.026 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.026 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.027 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.027 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getattr_latency": { 2024-09-15T22:28:18.027 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.027 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.027 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.027 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getfilelock_latency": { 2024-09-15T22:28:18.027 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.027 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.027 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.027 INFO:teuthology.orchestra.run.smithi098.stdout: "req_link_latency": { 2024-09-15T22:28:18.027 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.028 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.028 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.028 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookup_latency": { 2024-09-15T22:28:18.028 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.028 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.028 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.028 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookuphash_latency": { 2024-09-15T22:28:18.028 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.028 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.028 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.029 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupino_latency": { 2024-09-15T22:28:18.029 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.029 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.029 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.029 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupname_latency": { 2024-09-15T22:28:18.029 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.029 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.029 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.029 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupparent_latency": { 2024-09-15T22:28:18.029 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.029 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.030 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.030 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupsnap_latency": { 2024-09-15T22:28:18.030 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.030 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.030 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.030 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lssnap_latency": { 2024-09-15T22:28:18.030 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.030 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.030 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.031 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mkdir_latency": { 2024-09-15T22:28:18.031 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.031 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.031 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.031 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mknod_latency": { 2024-09-15T22:28:18.032 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.032 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.032 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.032 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mksnap_latency": { 2024-09-15T22:28:18.032 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.032 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.032 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.032 INFO:teuthology.orchestra.run.smithi098.stdout: "req_open_latency": { 2024-09-15T22:28:18.032 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.032 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.033 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.033 INFO:teuthology.orchestra.run.smithi098.stdout: "req_readdir_latency": { 2024-09-15T22:28:18.033 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.033 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.033 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.033 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rename_latency": { 2024-09-15T22:28:18.033 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.033 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.033 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.033 INFO:teuthology.orchestra.run.smithi098.stdout: "req_renamesnap_latency": { 2024-09-15T22:28:18.034 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.034 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.034 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.034 INFO:teuthology.orchestra.run.smithi098.stdout: "req_snapdiff_latency": { 2024-09-15T22:28:18.034 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.034 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.034 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.034 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmdir_latency": { 2024-09-15T22:28:18.034 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.034 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.035 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.035 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmsnap_latency": { 2024-09-15T22:28:18.035 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.035 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.035 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.035 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmxattr_latency": { 2024-09-15T22:28:18.035 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.035 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.035 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.035 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setattr_latency": { 2024-09-15T22:28:18.036 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.036 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.036 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.036 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setdirlayout_latency": { 2024-09-15T22:28:18.036 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.036 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.036 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.036 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setfilelock_latency": { 2024-09-15T22:28:18.036 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.036 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.036 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.037 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setlayout_latency": { 2024-09-15T22:28:18.037 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.037 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.037 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.037 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setxattr_latency": { 2024-09-15T22:28:18.037 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.037 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.037 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.037 INFO:teuthology.orchestra.run.smithi098.stdout: "req_symlink_latency": { 2024-09-15T22:28:18.037 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.037 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.038 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.038 INFO:teuthology.orchestra.run.smithi098.stdout: "req_unlink_latency": { 2024-09-15T22:28:18.038 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.038 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.038 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.038 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_revoke_eviction": 0, 2024-09-15T22:28:18.038 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_acquisition_throttle": 0, 2024-09-15T22:28:18.038 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getvxattr_latency": { 2024-09-15T22:28:18.038 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.038 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.038 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.038 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:18.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.039 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_sessions": { 2024-09-15T22:28:18.039 INFO:teuthology.orchestra.run.smithi098.stdout: "session_count": 1, 2024-09-15T22:28:18.039 INFO:teuthology.orchestra.run.smithi098.stdout: "session_add": 2, 2024-09-15T22:28:18.039 INFO:teuthology.orchestra.run.smithi098.stdout: "session_remove": 1, 2024-09-15T22:28:18.039 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_open": 1, 2024-09-15T22:28:18.039 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_stale": 0, 2024-09-15T22:28:18.039 INFO:teuthology.orchestra.run.smithi098.stdout: "total_load": 0, 2024-09-15T22:28:18.039 INFO:teuthology.orchestra.run.smithi098.stdout: "average_load": 0, 2024-09-15T22:28:18.039 INFO:teuthology.orchestra.run.smithi098.stdout: "avg_session_uptime": 1526, 2024-09-15T22:28:18.039 INFO:teuthology.orchestra.run.smithi098.stdout: "mdthresh_evicted": 0 2024-09-15T22:28:18.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.039 INFO:teuthology.orchestra.run.smithi098.stdout: "mempool": { 2024-09-15T22:28:18.039 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:28:18.039 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_items": 0, 2024-09-15T22:28:18.040 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:28:18.040 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:28:18.040 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:28:18.040 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:28:18.040 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:28:18.040 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:28:18.040 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:28:18.040 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:28:18.040 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:28:18.040 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:28:18.040 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:28:18.040 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:28:18.040 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:28:18.040 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_items": 0, 2024-09-15T22:28:18.040 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:28:18.041 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_items": 0, 2024-09-15T22:28:18.041 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:28:18.041 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:28:18.041 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:28:18.041 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:28:18.041 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:28:18.041 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:28:18.041 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:28:18.041 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_items": 0, 2024-09-15T22:28:18.041 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:28:18.041 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:28:18.041 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:28:18.041 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_items": 0, 2024-09-15T22:28:18.042 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_bytes": 0, 2024-09-15T22:28:18.042 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_items": 0, 2024-09-15T22:28:18.042 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:28:18.042 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:28:18.042 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:28:18.042 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:28:18.042 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_bytes": 213457, 2024-09-15T22:28:18.042 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_items": 60, 2024-09-15T22:28:18.042 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:28:18.042 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_items": 0, 2024-09-15T22:28:18.042 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_bytes": 0, 2024-09-15T22:28:18.042 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_items": 0, 2024-09-15T22:28:18.043 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:28:18.043 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_items": 0, 2024-09-15T22:28:18.043 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:28:18.043 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_items": 0, 2024-09-15T22:28:18.043 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_bytes": 7888, 2024-09-15T22:28:18.043 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_items": 163, 2024-09-15T22:28:18.043 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:28:18.043 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:28:18.043 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_bytes": 0, 2024-09-15T22:28:18.043 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_items": 0, 2024-09-15T22:28:18.043 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_bytes": 817818, 2024-09-15T22:28:18.043 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_items": 4513, 2024-09-15T22:28:18.043 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_bytes": 0, 2024-09-15T22:28:18.043 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_items": 0, 2024-09-15T22:28:18.044 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_bytes": 0, 2024-09-15T22:28:18.044 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_items": 0 2024-09-15T22:28:18.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.044 INFO:teuthology.orchestra.run.smithi098.stdout: "objecter": { 2024-09-15T22:28:18.044 INFO:teuthology.orchestra.run.smithi098.stdout: "op_active": 0, 2024-09-15T22:28:18.044 INFO:teuthology.orchestra.run.smithi098.stdout: "op_laggy": 0, 2024-09-15T22:28:18.044 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send": 1081, 2024-09-15T22:28:18.044 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send_bytes": 26, 2024-09-15T22:28:18.044 INFO:teuthology.orchestra.run.smithi098.stdout: "op_resend": 4, 2024-09-15T22:28:18.044 INFO:teuthology.orchestra.run.smithi098.stdout: "op_reply": 1081, 2024-09-15T22:28:18.044 INFO:teuthology.orchestra.run.smithi098.stdout: "op_latency": { 2024-09-15T22:28:18.044 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1081, 2024-09-15T22:28:18.044 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 1.000987205, 2024-09-15T22:28:18.045 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000925982 2024-09-15T22:28:18.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.045 INFO:teuthology.orchestra.run.smithi098.stdout: "op_inflight": 0, 2024-09-15T22:28:18.045 INFO:teuthology.orchestra.run.smithi098.stdout: "oplen_avg": { 2024-09-15T22:28:18.045 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1081, 2024-09-15T22:28:18.045 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 1082 2024-09-15T22:28:18.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.045 INFO:teuthology.orchestra.run.smithi098.stdout: "op": 1081, 2024-09-15T22:28:18.045 INFO:teuthology.orchestra.run.smithi098.stdout: "op_r": 1081, 2024-09-15T22:28:18.045 INFO:teuthology.orchestra.run.smithi098.stdout: "op_w": 0, 2024-09-15T22:28:18.045 INFO:teuthology.orchestra.run.smithi098.stdout: "op_rmw": 0, 2024-09-15T22:28:18.045 INFO:teuthology.orchestra.run.smithi098.stdout: "op_pg": 0, 2024-09-15T22:28:18.045 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_stat": 658, 2024-09-15T22:28:18.045 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_create": 0, 2024-09-15T22:28:18.046 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_read": 420, 2024-09-15T22:28:18.046 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_write": 0, 2024-09-15T22:28:18.046 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writefull": 0, 2024-09-15T22:28:18.046 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writesame": 0, 2024-09-15T22:28:18.046 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_append": 0, 2024-09-15T22:28:18.046 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_zero": 0, 2024-09-15T22:28:18.046 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_truncate": 0, 2024-09-15T22:28:18.046 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_delete": 0, 2024-09-15T22:28:18.046 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_mapext": 0, 2024-09-15T22:28:18.046 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_sparse_read": 0, 2024-09-15T22:28:18.046 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_clonerange": 0, 2024-09-15T22:28:18.046 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_getxattr": 2, 2024-09-15T22:28:18.046 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_setxattr": 0, 2024-09-15T22:28:18.046 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_cmpxattr": 0, 2024-09-15T22:28:18.046 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_rmxattr": 0, 2024-09-15T22:28:18.047 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_resetxattrs": 0, 2024-09-15T22:28:18.047 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_call": 0, 2024-09-15T22:28:18.047 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_watch": 0, 2024-09-15T22:28:18.047 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_notify": 0, 2024-09-15T22:28:18.047 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T22:28:18.047 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls": 0, 2024-09-15T22:28:18.047 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls_filter": 0, 2024-09-15T22:28:18.047 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_other": 0, 2024-09-15T22:28:18.047 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_active": 0, 2024-09-15T22:28:18.047 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_send": 0, 2024-09-15T22:28:18.047 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_resend": 0, 2024-09-15T22:28:18.047 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_ping": 0, 2024-09-15T22:28:18.047 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_active": 0, 2024-09-15T22:28:18.047 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_send": 0, 2024-09-15T22:28:18.048 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_resend": 0, 2024-09-15T22:28:18.048 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_active": 0, 2024-09-15T22:28:18.048 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_send": 0, 2024-09-15T22:28:18.048 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_resend": 0, 2024-09-15T22:28:18.048 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_active": 0, 2024-09-15T22:28:18.048 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_send": 0, 2024-09-15T22:28:18.048 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_resend": 0, 2024-09-15T22:28:18.048 INFO:teuthology.orchestra.run.smithi098.stdout: "command_active": 0, 2024-09-15T22:28:18.048 INFO:teuthology.orchestra.run.smithi098.stdout: "command_send": 0, 2024-09-15T22:28:18.048 INFO:teuthology.orchestra.run.smithi098.stdout: "command_resend": 0, 2024-09-15T22:28:18.048 INFO:teuthology.orchestra.run.smithi098.stdout: "map_epoch": 86, 2024-09-15T22:28:18.048 INFO:teuthology.orchestra.run.smithi098.stdout: "map_full": 0, 2024-09-15T22:28:18.048 INFO:teuthology.orchestra.run.smithi098.stdout: "map_inc": 4, 2024-09-15T22:28:18.048 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_sessions": 8, 2024-09-15T22:28:18.049 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_open": 8, 2024-09-15T22:28:18.049 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_close": 0, 2024-09-15T22:28:18.049 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_laggy": 0, 2024-09-15T22:28:18.049 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_wr": 0, 2024-09-15T22:28:18.049 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_rd": 2, 2024-09-15T22:28:18.049 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_del": 0 2024-09-15T22:28:18.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.049 INFO:teuthology.orchestra.run.smithi098.stdout: "oft": { 2024-09-15T22:28:18.049 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_objs": 0, 2024-09-15T22:28:18.049 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_kv_pairs": 0, 2024-09-15T22:28:18.049 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_updates": 0, 2024-09-15T22:28:18.049 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_removes": 0 2024-09-15T22:28:18.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.049 INFO:teuthology.orchestra.run.smithi098.stdout: "osd-slow-ops": { 2024-09-15T22:28:18.050 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_ops_count": 0 2024-09-15T22:28:18.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.050 INFO:teuthology.orchestra.run.smithi098.stdout: "purge_queue": { 2024-09-15T22:28:18.050 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops": 0, 2024-09-15T22:28:18.050 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops_high_water": 0, 2024-09-15T22:28:18.050 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing": 0, 2024-09-15T22:28:18.050 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_high_water": 0, 2024-09-15T22:28:18.050 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed_ops": 0, 2024-09-15T22:28:18.050 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed": 0, 2024-09-15T22:28:18.050 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_item_in_journal": 0 2024-09-15T22:28:18.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.050 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:28:18.050 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-15T22:28:18.050 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-09-15T22:28:18.051 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-15T22:28:18.051 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 1199, 2024-09-15T22:28:18.051 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 65576168, 2024-09-15T22:28:18.051 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:18.051 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 1199, 2024-09-15T22:28:18.051 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-15T22:28:18.051 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-15T22:28:18.051 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 1199, 2024-09-15T22:28:18.051 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 65576168, 2024-09-15T22:28:18.051 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-15T22:28:18.051 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.051 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.051 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.051 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:18.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.052 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_bytes": { 2024-09-15T22:28:18.052 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-15T22:28:18.052 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-09-15T22:28:18.052 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-15T22:28:18.052 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-09-15T22:28:18.052 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-09-15T22:28:18.052 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:18.052 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-09-15T22:28:18.052 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 1081, 2024-09-15T22:28:18.052 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 64905439, 2024-09-15T22:28:18.052 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 1081, 2024-09-15T22:28:18.052 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 64905439, 2024-09-15T22:28:18.052 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-15T22:28:18.052 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.053 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.053 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.053 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:18.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.053 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_ops": { 2024-09-15T22:28:18.053 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-15T22:28:18.053 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 1024, 2024-09-15T22:28:18.053 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-15T22:28:18.053 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-09-15T22:28:18.053 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-09-15T22:28:18.053 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:18.053 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-09-15T22:28:18.053 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 1081, 2024-09-15T22:28:18.053 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 1081, 2024-09-15T22:28:18.054 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 1081, 2024-09-15T22:28:18.054 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 1081, 2024-09-15T22:28:18.054 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-15T22:28:18.054 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.054 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.054 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.054 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:18.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.054 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle": { 2024-09-15T22:28:18.054 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-15T22:28:18.054 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-09-15T22:28:18.054 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-15T22:28:18.054 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-09-15T22:28:18.055 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-09-15T22:28:18.055 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:18.055 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-09-15T22:28:18.055 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-15T22:28:18.055 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-15T22:28:18.055 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 0, 2024-09-15T22:28:18.055 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 0, 2024-09-15T22:28:18.055 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-15T22:28:18.055 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.055 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.055 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.055 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:18.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:18.055 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle-0x5591a588e6e0": { 2024-09-15T22:28:18.055 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-15T22:28:18.056 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-09-15T22:28:18.056 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-15T22:28:18.056 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-09-15T22:28:18.056 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-09-15T22:28:18.056 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:18.056 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-09-15T22:28:18.056 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-15T22:28:18.056 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-15T22:28:18.056 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 0, 2024-09-15T22:28:18.056 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 0, 2024-09-15T22:28:18.056 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-15T22:28:18.056 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:18.056 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:18.056 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:18.057 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:18.057 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:18.057 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-15T22:28:18.789 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-15T22:28:18.790 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-15T22:28:18.790 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-15T22:28:18.790 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-15T22:28:18.790 DEBUG:tasks.check_counter:Getting stats from i 2024-09-15T22:28:18.790 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-15T22:28:19.033 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:28:19.510 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-15T22:28:19.511 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:28:19.511 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 28477, 2024-09-15T22:28:19.511 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 18821, 2024-09-15T22:28:19.511 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 10651769, 2024-09-15T22:28:19.511 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 46117733, 2024-09-15T22:28:19.511 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 35, 2024-09-15T22:28:19.511 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 3, 2024-09-15T22:28:19.511 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 1.446438319, 2024-09-15T22:28:19.511 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.610126324, 2024-09-15T22:28:19.511 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.738480455, 2024-09-15T22:28:19.512 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.255315223, 2024-09-15T22:28:19.512 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:19.512 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 18820, 2024-09-15T22:28:19.512 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 5.232239937, 2024-09-15T22:28:19.512 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000278014 2024-09-15T22:28:19.512 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.512 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:19.512 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 34036, 2024-09-15T22:28:19.512 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.004068827, 2024-09-15T22:28:19.512 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000119 2024-09-15T22:28:19.512 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.512 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 504944, 2024-09-15T22:28:19.512 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 65744 2024-09-15T22:28:19.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.513 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:28:19.513 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 35580, 2024-09-15T22:28:19.513 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 77089, 2024-09-15T22:28:19.513 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 13013547, 2024-09-15T22:28:19.513 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 58837613, 2024-09-15T22:28:19.513 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 12, 2024-09-15T22:28:19.513 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 5, 2024-09-15T22:28:19.513 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 2.123670828, 2024-09-15T22:28:19.513 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 1.106441750, 2024-09-15T22:28:19.514 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 1.342467541, 2024-09-15T22:28:19.514 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.210467713, 2024-09-15T22:28:19.514 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:19.514 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 77088, 2024-09-15T22:28:19.514 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 15.512725700, 2024-09-15T22:28:19.514 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000201233 2024-09-15T22:28:19.514 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.514 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:19.514 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 51553, 2024-09-15T22:28:19.514 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.011646876, 2024-09-15T22:28:19.515 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000225 2024-09-15T22:28:19.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.515 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 57168, 2024-09-15T22:28:19.515 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 238800 2024-09-15T22:28:19.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.516 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:28:19.516 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 27381, 2024-09-15T22:28:19.516 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 18915, 2024-09-15T22:28:19.516 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 10111071, 2024-09-15T22:28:19.516 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 31283475, 2024-09-15T22:28:19.516 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 10, 2024-09-15T22:28:19.516 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 6, 2024-09-15T22:28:19.516 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 1.240189727, 2024-09-15T22:28:19.516 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.478839250, 2024-09-15T22:28:19.516 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.725535751, 2024-09-15T22:28:19.516 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.213191457, 2024-09-15T22:28:19.517 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:19.517 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 18913, 2024-09-15T22:28:19.517 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 9.634806423, 2024-09-15T22:28:19.517 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000509427 2024-09-15T22:28:19.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.517 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:19.517 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 33092, 2024-09-15T22:28:19.517 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.004402019, 2024-09-15T22:28:19.517 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000133 2024-09-15T22:28:19.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.517 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T22:28:19.517 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T22:28:19.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.518 INFO:teuthology.orchestra.run.smithi098.stdout: "cct": { 2024-09-15T22:28:19.518 INFO:teuthology.orchestra.run.smithi098.stdout: "total_workers": 1, 2024-09-15T22:28:19.518 INFO:teuthology.orchestra.run.smithi098.stdout: "unhealthy_workers": 0 2024-09-15T22:28:19.518 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.518 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-MDSRank": { 2024-09-15T22:28:19.518 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-09-15T22:28:19.518 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-09-15T22:28:19.518 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 3817, 2024-09-15T22:28:19.518 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 18.507554866, 2024-09-15T22:28:19.518 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.004848717 2024-09-15T22:28:19.519 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:19.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.519 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-PurgeQueue": { 2024-09-15T22:28:19.519 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-09-15T22:28:19.519 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-09-15T22:28:19.519 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 2420, 2024-09-15T22:28:19.519 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.169530551, 2024-09-15T22:28:19.519 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000070053 2024-09-15T22:28:19.520 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:19.520 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.520 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-09-15T22:28:19.520 INFO:teuthology.orchestra.run.smithi098.stdout: "request": 17164, 2024-09-15T22:28:19.520 INFO:teuthology.orchestra.run.smithi098.stdout: "reply": 17078, 2024-09-15T22:28:19.520 INFO:teuthology.orchestra.run.smithi098.stdout: "reply_latency": { 2024-09-15T22:28:19.520 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 17078, 2024-09-15T22:28:19.520 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 58.732424004, 2024-09-15T22:28:19.520 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.003439069 2024-09-15T22:28:19.520 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.521 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_reply": 0, 2024-09-15T22:28:19.521 INFO:teuthology.orchestra.run.smithi098.stdout: "forward": 86, 2024-09-15T22:28:19.521 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_complete": 11, 2024-09-15T22:28:19.521 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_keys": 0, 2024-09-15T22:28:19.521 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_commit": 1878, 2024-09-15T22:28:19.521 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_split": 8, 2024-09-15T22:28:19.521 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_merge": 0, 2024-09-15T22:28:19.521 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes": 22, 2024-09-15T22:28:19.521 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_top": 3, 2024-09-15T22:28:19.521 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_bottom": 9, 2024-09-15T22:28:19.521 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pin_tail": 10, 2024-09-15T22:28:19.521 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pinned": 17, 2024-09-15T22:28:19.522 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_expired": 16689, 2024-09-15T22:28:19.522 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_with_caps": 2, 2024-09-15T22:28:19.522 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": 2, 2024-09-15T22:28:19.522 INFO:teuthology.orchestra.run.smithi098.stdout: "subtrees": 4, 2024-09-15T22:28:19.522 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse": 22345, 2024-09-15T22:28:19.522 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_hit": 20111, 2024-09-15T22:28:19.522 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_forward": 12, 2024-09-15T22:28:19.522 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_discover": 1648, 2024-09-15T22:28:19.522 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_dir_fetch": 3, 2024-09-15T22:28:19.522 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_remote_ino": 1, 2024-09-15T22:28:19.522 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_lock": 14, 2024-09-15T22:28:19.522 INFO:teuthology.orchestra.run.smithi098.stdout: "load_cent": 135, 2024-09-15T22:28:19.522 INFO:teuthology.orchestra.run.smithi098.stdout: "q": 0, 2024-09-15T22:28:19.523 INFO:teuthology.orchestra.run.smithi098.stdout: "exported": 57, 2024-09-15T22:28:19.523 INFO:teuthology.orchestra.run.smithi098.stdout: "exported_inodes": 13277, 2024-09-15T22:28:19.523 INFO:teuthology.orchestra.run.smithi098.stdout: "imported": 13, 2024-09-15T22:28:19.523 INFO:teuthology.orchestra.run.smithi098.stdout: "imported_inodes": 89, 2024-09-15T22:28:19.523 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_dir_fetch": 0, 2024-09-15T22:28:19.523 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_backtrace_fetch": 0, 2024-09-15T22:28:19.523 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_peer_discover": 1, 2024-09-15T22:28:19.523 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rfiles": 4, 2024-09-15T22:28:19.523 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rbytes": 234, 2024-09-15T22:28:19.523 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rsnaps": 0, 2024-09-15T22:28:19.523 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_fetch": 0, 2024-09-15T22:28:19.523 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_set_tag": 0, 2024-09-15T22:28:19.523 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T22:28:19.523 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_inotable_repaired": 0, 2024-09-15T22:28:19.524 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_inodes": 0, 2024-09-15T22:28:19.524 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T22:28:19.524 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dirfrag_rstats": 0, 2024-09-15T22:28:19.524 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_file_inodes": 0, 2024-09-15T22:28:19.524 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_inode_file_caps": 22, 2024-09-15T22:28:19.524 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_revoke": 648, 2024-09-15T22:28:19.524 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_grant": 13770, 2024-09-15T22:28:19.524 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_trunc": 187, 2024-09-15T22:28:19.524 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T22:28:19.524 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T22:28:19.524 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps": 11458, 2024-09-15T22:28:19.524 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps_dirty": 10345, 2024-09-15T22:28:19.524 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_cap_release": 132, 2024-09-15T22:28:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: "process_request_cap_release": 4001 2024-09-15T22:28:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_cache": { 2024-09-15T22:28:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update": 313, 2024-09-15T22:28:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update_receipt": 4694, 2024-09-15T22:28:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_try_discover": 3131, 2024-09-15T22:28:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_send_discover": 3144, 2024-09-15T22:28:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_handle_discover": 728, 2024-09-15T22:28:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays": 0, 2024-09-15T22:28:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_delayed": 0, 2024-09-15T22:28:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_enqueuing": 0, 2024-09-15T22:28:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_created": 1054, 2024-09-15T22:28:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_enqueued": 1008, 2024-09-15T22:28:19.526 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_reintegrated": 48, 2024-09-15T22:28:19.526 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_migrated": 3, 2024-09-15T22:28:19.526 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_processing": 0, 2024-09-15T22:28:19.526 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_enqueued": 0, 2024-09-15T22:28:19.526 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_prioritized": 0, 2024-09-15T22:28:19.526 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_started": 0, 2024-09-15T22:28:19.526 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_completed": 0, 2024-09-15T22:28:19.526 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_path": 0, 2024-09-15T22:28:19.526 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_inode": 0, 2024-09-15T22:28:19.526 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T22:28:19.526 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_exportdir": 57, 2024-09-15T22:28:19.526 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_flush": 0, 2024-09-15T22:28:19.526 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragmentdir": 8, 2024-09-15T22:28:19.526 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragstats": 0, 2024-09-15T22:28:19.527 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_inodestats": 0 2024-09-15T22:28:19.527 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.527 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_log": { 2024-09-15T22:28:19.527 INFO:teuthology.orchestra.run.smithi098.stdout: "evlrg": 0, 2024-09-15T22:28:19.527 INFO:teuthology.orchestra.run.smithi098.stdout: "evadd": 28952, 2024-09-15T22:28:19.527 INFO:teuthology.orchestra.run.smithi098.stdout: "evex": 28935, 2024-09-15T22:28:19.527 INFO:teuthology.orchestra.run.smithi098.stdout: "evtrm": 28935, 2024-09-15T22:28:19.527 INFO:teuthology.orchestra.run.smithi098.stdout: "ev": 17, 2024-09-15T22:28:19.527 INFO:teuthology.orchestra.run.smithi098.stdout: "evexg": 0, 2024-09-15T22:28:19.527 INFO:teuthology.orchestra.run.smithi098.stdout: "evexd": 23, 2024-09-15T22:28:19.527 INFO:teuthology.orchestra.run.smithi098.stdout: "segadd": 44, 2024-09-15T22:28:19.527 INFO:teuthology.orchestra.run.smithi098.stdout: "segex": 43, 2024-09-15T22:28:19.527 INFO:teuthology.orchestra.run.smithi098.stdout: "segtrm": 43, 2024-09-15T22:28:19.528 INFO:teuthology.orchestra.run.smithi098.stdout: "seg": 1, 2024-09-15T22:28:19.528 INFO:teuthology.orchestra.run.smithi098.stdout: "segmjr": 1, 2024-09-15T22:28:19.528 INFO:teuthology.orchestra.run.smithi098.stdout: "segexg": 0, 2024-09-15T22:28:19.528 INFO:teuthology.orchestra.run.smithi098.stdout: "segexd": 1, 2024-09-15T22:28:19.528 INFO:teuthology.orchestra.run.smithi098.stdout: "expos": 69065703, 2024-09-15T22:28:19.528 INFO:teuthology.orchestra.run.smithi098.stdout: "wrpos": 69096932, 2024-09-15T22:28:19.528 INFO:teuthology.orchestra.run.smithi098.stdout: "rdpos": 0, 2024-09-15T22:28:19.528 INFO:teuthology.orchestra.run.smithi098.stdout: "jlat": { 2024-09-15T22:28:19.528 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 2527, 2024-09-15T22:28:19.528 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 130.308739309, 2024-09-15T22:28:19.529 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.051566576 2024-09-15T22:28:19.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.529 INFO:teuthology.orchestra.run.smithi098.stdout: "replayed": 0 2024-09-15T22:28:19.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.529 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_mem": { 2024-09-15T22:28:19.529 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 24, 2024-09-15T22:28:19.529 INFO:teuthology.orchestra.run.smithi098.stdout: "ino+": 15492, 2024-09-15T22:28:19.529 INFO:teuthology.orchestra.run.smithi098.stdout: "ino-": 15468, 2024-09-15T22:28:19.529 INFO:teuthology.orchestra.run.smithi098.stdout: "dir": 23, 2024-09-15T22:28:19.529 INFO:teuthology.orchestra.run.smithi098.stdout: "dir+": 3432, 2024-09-15T22:28:19.529 INFO:teuthology.orchestra.run.smithi098.stdout: "dir-": 3409, 2024-09-15T22:28:19.529 INFO:teuthology.orchestra.run.smithi098.stdout: "dn": 22, 2024-09-15T22:28:19.529 INFO:teuthology.orchestra.run.smithi098.stdout: "dn+": 18839, 2024-09-15T22:28:19.529 INFO:teuthology.orchestra.run.smithi098.stdout: "dn-": 18817, 2024-09-15T22:28:19.530 INFO:teuthology.orchestra.run.smithi098.stdout: "cap": 2, 2024-09-15T22:28:19.530 INFO:teuthology.orchestra.run.smithi098.stdout: "cap+": 13864, 2024-09-15T22:28:19.530 INFO:teuthology.orchestra.run.smithi098.stdout: "cap-": 13862, 2024-09-15T22:28:19.530 INFO:teuthology.orchestra.run.smithi098.stdout: "rss": 135732, 2024-09-15T22:28:19.530 INFO:teuthology.orchestra.run.smithi098.stdout: "heap": 231712 2024-09-15T22:28:19.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.530 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_server": { 2024-09-15T22:28:19.530 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_client_request": 18671, 2024-09-15T22:28:19.530 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_server_request": 181, 2024-09-15T22:28:19.530 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_request": 17164, 2024-09-15T22:28:19.530 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_session": 256, 2024-09-15T22:28:19.530 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_peer_request": 432, 2024-09-15T22:28:19.530 INFO:teuthology.orchestra.run.smithi098.stdout: "req_create_latency": { 2024-09-15T22:28:19.530 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 11422, 2024-09-15T22:28:19.531 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 20.839853825, 2024-09-15T22:28:19.531 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.001824536 2024-09-15T22:28:19.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.531 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getattr_latency": { 2024-09-15T22:28:19.531 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 58, 2024-09-15T22:28:19.531 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.093743801, 2024-09-15T22:28:19.531 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.001616272 2024-09-15T22:28:19.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.531 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getfilelock_latency": { 2024-09-15T22:28:19.531 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:19.531 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:19.531 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:19.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.532 INFO:teuthology.orchestra.run.smithi098.stdout: "req_link_latency": { 2024-09-15T22:28:19.532 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 196, 2024-09-15T22:28:19.532 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 5.729301399, 2024-09-15T22:28:19.532 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.029231129 2024-09-15T22:28:19.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.532 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookup_latency": { 2024-09-15T22:28:19.532 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 721, 2024-09-15T22:28:19.532 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.514143063, 2024-09-15T22:28:19.532 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000713097 2024-09-15T22:28:19.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.532 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookuphash_latency": { 2024-09-15T22:28:19.532 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:19.532 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:19.533 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:19.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.533 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupino_latency": { 2024-09-15T22:28:19.533 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1, 2024-09-15T22:28:19.533 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000170649, 2024-09-15T22:28:19.533 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000170649 2024-09-15T22:28:19.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.533 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupname_latency": { 2024-09-15T22:28:19.533 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:19.533 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:19.533 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:19.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.533 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupparent_latency": { 2024-09-15T22:28:19.533 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:19.534 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:19.534 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:19.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.534 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupsnap_latency": { 2024-09-15T22:28:19.534 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:19.534 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:19.534 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:19.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.535 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lssnap_latency": { 2024-09-15T22:28:19.535 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:19.535 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:19.535 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:19.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.535 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mkdir_latency": { 2024-09-15T22:28:19.535 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1690, 2024-09-15T22:28:19.535 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 5.667323112, 2024-09-15T22:28:19.535 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.003353445 2024-09-15T22:28:19.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.535 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mknod_latency": { 2024-09-15T22:28:19.536 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 352, 2024-09-15T22:28:19.536 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 2.111251382, 2024-09-15T22:28:19.536 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.005997873 2024-09-15T22:28:19.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.536 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mksnap_latency": { 2024-09-15T22:28:19.536 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:19.536 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:19.536 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:19.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.536 INFO:teuthology.orchestra.run.smithi098.stdout: "req_open_latency": { 2024-09-15T22:28:19.536 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 49, 2024-09-15T22:28:19.536 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.019302413, 2024-09-15T22:28:19.536 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000393926 2024-09-15T22:28:19.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.537 INFO:teuthology.orchestra.run.smithi098.stdout: "req_readdir_latency": { 2024-09-15T22:28:19.537 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 288, 2024-09-15T22:28:19.537 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 3.061354192, 2024-09-15T22:28:19.537 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.010629702 2024-09-15T22:28:19.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.537 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rename_latency": { 2024-09-15T22:28:19.537 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 420, 2024-09-15T22:28:19.537 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 4.802642282, 2024-09-15T22:28:19.537 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.011434862 2024-09-15T22:28:19.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.538 INFO:teuthology.orchestra.run.smithi098.stdout: "req_renamesnap_latency": { 2024-09-15T22:28:19.538 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:19.538 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:19.538 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:19.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.538 INFO:teuthology.orchestra.run.smithi098.stdout: "req_snapdiff_latency": { 2024-09-15T22:28:19.538 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:19.538 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:19.539 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:19.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.539 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmdir_latency": { 2024-09-15T22:28:19.539 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 345, 2024-09-15T22:28:19.539 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 3.996663730, 2024-09-15T22:28:19.539 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.011584532 2024-09-15T22:28:19.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.539 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmsnap_latency": { 2024-09-15T22:28:19.539 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:19.539 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:19.539 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:19.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.540 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmxattr_latency": { 2024-09-15T22:28:19.540 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:19.540 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:19.540 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:19.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.540 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setattr_latency": { 2024-09-15T22:28:19.540 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 191, 2024-09-15T22:28:19.540 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 5.612476921, 2024-09-15T22:28:19.541 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.029384695 2024-09-15T22:28:19.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.541 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setdirlayout_latency": { 2024-09-15T22:28:19.541 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:19.541 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:19.541 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:19.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.541 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setfilelock_latency": { 2024-09-15T22:28:19.541 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:19.541 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:19.541 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:19.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.541 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setlayout_latency": { 2024-09-15T22:28:19.541 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:19.542 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:19.542 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:19.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.542 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setxattr_latency": { 2024-09-15T22:28:19.542 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 7, 2024-09-15T22:28:19.542 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.019683490, 2024-09-15T22:28:19.542 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.002811927 2024-09-15T22:28:19.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.542 INFO:teuthology.orchestra.run.smithi098.stdout: "req_symlink_latency": { 2024-09-15T22:28:19.542 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 390, 2024-09-15T22:28:19.542 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 3.082456218, 2024-09-15T22:28:19.542 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.007903733 2024-09-15T22:28:19.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.542 INFO:teuthology.orchestra.run.smithi098.stdout: "req_unlink_latency": { 2024-09-15T22:28:19.543 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 948, 2024-09-15T22:28:19.543 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 3.182057527, 2024-09-15T22:28:19.543 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.003356600 2024-09-15T22:28:19.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.543 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_revoke_eviction": 0, 2024-09-15T22:28:19.543 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_acquisition_throttle": 0, 2024-09-15T22:28:19.543 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getvxattr_latency": { 2024-09-15T22:28:19.543 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:19.543 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:19.544 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:19.544 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:19.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.544 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_sessions": { 2024-09-15T22:28:19.544 INFO:teuthology.orchestra.run.smithi098.stdout: "session_count": 1, 2024-09-15T22:28:19.544 INFO:teuthology.orchestra.run.smithi098.stdout: "session_add": 2, 2024-09-15T22:28:19.544 INFO:teuthology.orchestra.run.smithi098.stdout: "session_remove": 1, 2024-09-15T22:28:19.544 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_open": 1, 2024-09-15T22:28:19.545 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_stale": 0, 2024-09-15T22:28:19.545 INFO:teuthology.orchestra.run.smithi098.stdout: "total_load": 6294, 2024-09-15T22:28:19.545 INFO:teuthology.orchestra.run.smithi098.stdout: "average_load": 6294, 2024-09-15T22:28:19.545 INFO:teuthology.orchestra.run.smithi098.stdout: "avg_session_uptime": 199, 2024-09-15T22:28:19.545 INFO:teuthology.orchestra.run.smithi098.stdout: "mdthresh_evicted": 0 2024-09-15T22:28:19.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.545 INFO:teuthology.orchestra.run.smithi098.stdout: "mempool": { 2024-09-15T22:28:19.545 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_bytes": 360, 2024-09-15T22:28:19.545 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_items": 360, 2024-09-15T22:28:19.545 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:28:19.545 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:28:19.546 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:28:19.546 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:28:19.546 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:28:19.546 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:28:19.546 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:28:19.546 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:28:19.546 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:28:19.546 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:28:19.546 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:28:19.546 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:28:19.546 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:28:19.546 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_items": 0, 2024-09-15T22:28:19.546 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:28:19.546 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_items": 0, 2024-09-15T22:28:19.547 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:28:19.547 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:28:19.547 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:28:19.547 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:28:19.547 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:28:19.547 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:28:19.547 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:28:19.547 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_items": 0, 2024-09-15T22:28:19.547 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:28:19.547 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:28:19.547 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:28:19.547 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_items": 0, 2024-09-15T22:28:19.547 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_bytes": 0, 2024-09-15T22:28:19.547 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_items": 0, 2024-09-15T22:28:19.548 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:28:19.548 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:28:19.548 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:28:19.548 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:28:19.548 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_bytes": 301152, 2024-09-15T22:28:19.548 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_items": 116, 2024-09-15T22:28:19.548 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_bytes": 528, 2024-09-15T22:28:19.548 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_items": 6, 2024-09-15T22:28:19.549 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_bytes": 0, 2024-09-15T22:28:19.549 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_items": 0, 2024-09-15T22:28:19.549 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:28:19.549 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_items": 0, 2024-09-15T22:28:19.549 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:28:19.549 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_items": 0, 2024-09-15T22:28:19.549 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_bytes": 7888, 2024-09-15T22:28:19.549 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_items": 163, 2024-09-15T22:28:19.549 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:28:19.549 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:28:19.550 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_bytes": 0, 2024-09-15T22:28:19.550 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_items": 0, 2024-09-15T22:28:19.550 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_bytes": 103085, 2024-09-15T22:28:19.550 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_items": 616, 2024-09-15T22:28:19.550 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_bytes": 0, 2024-09-15T22:28:19.550 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_items": 0, 2024-09-15T22:28:19.550 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_bytes": 0, 2024-09-15T22:28:19.550 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_items": 0 2024-09-15T22:28:19.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.550 INFO:teuthology.orchestra.run.smithi098.stdout: "objecter": { 2024-09-15T22:28:19.550 INFO:teuthology.orchestra.run.smithi098.stdout: "op_active": 0, 2024-09-15T22:28:19.550 INFO:teuthology.orchestra.run.smithi098.stdout: "op_laggy": 0, 2024-09-15T22:28:19.550 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send": 19116, 2024-09-15T22:28:19.550 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send_bytes": 84018878, 2024-09-15T22:28:19.550 INFO:teuthology.orchestra.run.smithi098.stdout: "op_resend": 37, 2024-09-15T22:28:19.551 INFO:teuthology.orchestra.run.smithi098.stdout: "op_reply": 19116, 2024-09-15T22:28:19.551 INFO:teuthology.orchestra.run.smithi098.stdout: "op_latency": { 2024-09-15T22:28:19.551 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 19116, 2024-09-15T22:28:19.551 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 3873.074525315, 2024-09-15T22:28:19.551 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.202609046 2024-09-15T22:28:19.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.551 INFO:teuthology.orchestra.run.smithi098.stdout: "op_inflight": 0, 2024-09-15T22:28:19.551 INFO:teuthology.orchestra.run.smithi098.stdout: "oplen_avg": { 2024-09-15T22:28:19.551 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 19116, 2024-09-15T22:28:19.551 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 46150 2024-09-15T22:28:19.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.551 INFO:teuthology.orchestra.run.smithi098.stdout: "op": 19116, 2024-09-15T22:28:19.551 INFO:teuthology.orchestra.run.smithi098.stdout: "op_r": 95, 2024-09-15T22:28:19.551 INFO:teuthology.orchestra.run.smithi098.stdout: "op_w": 19021, 2024-09-15T22:28:19.552 INFO:teuthology.orchestra.run.smithi098.stdout: "op_rmw": 0, 2024-09-15T22:28:19.552 INFO:teuthology.orchestra.run.smithi098.stdout: "op_pg": 0, 2024-09-15T22:28:19.552 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_stat": 391, 2024-09-15T22:28:19.552 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_create": 12125, 2024-09-15T22:28:19.552 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_read": 84, 2024-09-15T22:28:19.552 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_write": 2611, 2024-09-15T22:28:19.552 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writefull": 110, 2024-09-15T22:28:19.552 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writesame": 0, 2024-09-15T22:28:19.552 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_append": 0, 2024-09-15T22:28:19.552 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_zero": 0, 2024-09-15T22:28:19.552 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_truncate": 8, 2024-09-15T22:28:19.552 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_delete": 1965, 2024-09-15T22:28:19.552 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_mapext": 0, 2024-09-15T22:28:19.552 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_sparse_read": 0, 2024-09-15T22:28:19.553 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_clonerange": 0, 2024-09-15T22:28:19.553 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_getxattr": 11, 2024-09-15T22:28:19.553 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_setxattr": 24524, 2024-09-15T22:28:19.553 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_cmpxattr": 0, 2024-09-15T22:28:19.553 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_rmxattr": 0, 2024-09-15T22:28:19.553 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_resetxattrs": 0, 2024-09-15T22:28:19.553 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_call": 0, 2024-09-15T22:28:19.553 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_watch": 0, 2024-09-15T22:28:19.553 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_notify": 0, 2024-09-15T22:28:19.553 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T22:28:19.553 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls": 0, 2024-09-15T22:28:19.553 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls_filter": 0, 2024-09-15T22:28:19.553 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_other": 225, 2024-09-15T22:28:19.553 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_active": 0, 2024-09-15T22:28:19.554 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_send": 0, 2024-09-15T22:28:19.554 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_resend": 0, 2024-09-15T22:28:19.554 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_ping": 0, 2024-09-15T22:28:19.554 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_active": 0, 2024-09-15T22:28:19.554 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_send": 0, 2024-09-15T22:28:19.554 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_resend": 0, 2024-09-15T22:28:19.554 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_active": 0, 2024-09-15T22:28:19.554 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_send": 0, 2024-09-15T22:28:19.554 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_resend": 0, 2024-09-15T22:28:19.554 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_active": 0, 2024-09-15T22:28:19.554 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_send": 0, 2024-09-15T22:28:19.554 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_resend": 0, 2024-09-15T22:28:19.554 INFO:teuthology.orchestra.run.smithi098.stdout: "command_active": 0, 2024-09-15T22:28:19.554 INFO:teuthology.orchestra.run.smithi098.stdout: "command_send": 0, 2024-09-15T22:28:19.555 INFO:teuthology.orchestra.run.smithi098.stdout: "command_resend": 0, 2024-09-15T22:28:19.555 INFO:teuthology.orchestra.run.smithi098.stdout: "map_epoch": 86, 2024-09-15T22:28:19.555 INFO:teuthology.orchestra.run.smithi098.stdout: "map_full": 0, 2024-09-15T22:28:19.555 INFO:teuthology.orchestra.run.smithi098.stdout: "map_inc": 4, 2024-09-15T22:28:19.555 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_sessions": 12, 2024-09-15T22:28:19.555 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_open": 12, 2024-09-15T22:28:19.555 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_close": 0, 2024-09-15T22:28:19.555 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_laggy": 0, 2024-09-15T22:28:19.555 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_wr": 3838, 2024-09-15T22:28:19.555 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_rd": 22, 2024-09-15T22:28:19.555 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_del": 236 2024-09-15T22:28:19.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.555 INFO:teuthology.orchestra.run.smithi098.stdout: "oft": { 2024-09-15T22:28:19.555 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_objs": 1, 2024-09-15T22:28:19.556 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_kv_pairs": 0, 2024-09-15T22:28:19.556 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_updates": 0, 2024-09-15T22:28:19.556 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_removes": 0 2024-09-15T22:28:19.556 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.556 INFO:teuthology.orchestra.run.smithi098.stdout: "osd-slow-ops": { 2024-09-15T22:28:19.556 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_ops_count": 0 2024-09-15T22:28:19.556 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.556 INFO:teuthology.orchestra.run.smithi098.stdout: "purge_queue": { 2024-09-15T22:28:19.556 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops": 0, 2024-09-15T22:28:19.556 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops_high_water": 16, 2024-09-15T22:28:19.556 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing": 0, 2024-09-15T22:28:19.556 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_high_water": 10, 2024-09-15T22:28:19.557 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed_ops": 1423, 2024-09-15T22:28:19.557 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed": 1008, 2024-09-15T22:28:19.557 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_item_in_journal": 0 2024-09-15T22:28:19.557 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.557 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:28:19.557 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-15T22:28:19.557 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-09-15T22:28:19.557 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-15T22:28:19.557 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 91434, 2024-09-15T22:28:19.557 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 25995692, 2024-09-15T22:28:19.557 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:19.557 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 91434, 2024-09-15T22:28:19.557 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-15T22:28:19.558 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-15T22:28:19.558 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 91434, 2024-09-15T22:28:19.558 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 25995692, 2024-09-15T22:28:19.558 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-15T22:28:19.558 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:19.558 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:19.558 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:19.558 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:19.558 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.558 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_bytes": { 2024-09-15T22:28:19.558 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-15T22:28:19.558 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-09-15T22:28:19.558 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-15T22:28:19.558 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-09-15T22:28:19.559 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-09-15T22:28:19.559 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:19.559 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-09-15T22:28:19.559 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 19116, 2024-09-15T22:28:19.559 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 84120510, 2024-09-15T22:28:19.559 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 19116, 2024-09-15T22:28:19.559 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 84120510, 2024-09-15T22:28:19.559 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-15T22:28:19.559 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:19.559 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:19.560 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:19.560 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:19.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.560 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_ops": { 2024-09-15T22:28:19.560 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-15T22:28:19.560 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 1024, 2024-09-15T22:28:19.560 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-15T22:28:19.560 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-09-15T22:28:19.560 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-09-15T22:28:19.560 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:19.560 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-09-15T22:28:19.560 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 19116, 2024-09-15T22:28:19.560 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 19116, 2024-09-15T22:28:19.560 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 19116, 2024-09-15T22:28:19.561 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 19116, 2024-09-15T22:28:19.561 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-15T22:28:19.561 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:19.561 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:19.561 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:19.561 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:19.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.561 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle": { 2024-09-15T22:28:19.561 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-15T22:28:19.561 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-09-15T22:28:19.561 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-15T22:28:19.561 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 1008, 2024-09-15T22:28:19.561 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 101808, 2024-09-15T22:28:19.561 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:19.562 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 1008, 2024-09-15T22:28:19.562 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-15T22:28:19.562 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-15T22:28:19.562 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 84, 2024-09-15T22:28:19.562 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 101808, 2024-09-15T22:28:19.562 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-15T22:28:19.562 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:19.562 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:19.562 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:19.562 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:19.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:19.562 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle-0x55a31083c500": { 2024-09-15T22:28:19.562 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-15T22:28:19.562 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-09-15T22:28:19.563 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-15T22:28:19.563 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 28952, 2024-09-15T22:28:19.563 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 64902628, 2024-09-15T22:28:19.563 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:19.563 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 28952, 2024-09-15T22:28:19.563 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-15T22:28:19.563 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-15T22:28:19.563 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 2527, 2024-09-15T22:28:19.563 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 64902628, 2024-09-15T22:28:19.563 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-15T22:28:19.563 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:19.563 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:19.563 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:19.563 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:19.564 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:19.564 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-15T22:28:19.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:19 smithi012 ceph-mon[34883]: pgmap v459: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-15T22:28:19.802 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:19 smithi098 ceph-mon[35514]: pgmap v459: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-15T22:28:19.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:19 smithi001 ceph-mon[30843]: pgmap v459: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-15T22:28:20.314 INFO:tasks.check_counter:Daemon mds.i mds.exported=57 2024-09-15T22:28:20.314 INFO:tasks.check_counter:Daemon mds.i mds.imported=13 2024-09-15T22:28:20.314 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=313 2024-09-15T22:28:20.314 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=4694 2024-09-15T22:28:20.315 DEBUG:tasks.check_counter:Getting stats from l 2024-09-15T22:28:20.315 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-15T22:28:20.565 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:28:21.006 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-15T22:28:21.006 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:28:21.006 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 277, 2024-09-15T22:28:21.006 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 277, 2024-09-15T22:28:21.006 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 12657781, 2024-09-15T22:28:21.006 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 87326, 2024-09-15T22:28:21.006 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 7, 2024-09-15T22:28:21.006 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 3, 2024-09-15T22:28:21.006 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.034573875, 2024-09-15T22:28:21.006 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.007282911, 2024-09-15T22:28:21.007 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.017001691, 2024-09-15T22:28:21.007 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.007298067, 2024-09-15T22:28:21.007 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:21.007 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 276, 2024-09-15T22:28:21.007 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.016519560, 2024-09-15T22:28:21.007 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000059853 2024-09-15T22:28:21.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.007 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:21.007 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.007 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.007 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.007 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-15T22:28:21.008 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 448 2024-09-15T22:28:21.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.008 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:28:21.008 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 387, 2024-09-15T22:28:21.008 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 379, 2024-09-15T22:28:21.008 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 13798336, 2024-09-15T22:28:21.008 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 149219, 2024-09-15T22:28:21.008 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 5, 2024-09-15T22:28:21.008 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 4, 2024-09-15T22:28:21.008 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.047416814, 2024-09-15T22:28:21.008 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.013122224, 2024-09-15T22:28:21.008 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.029376369, 2024-09-15T22:28:21.008 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.007940992, 2024-09-15T22:28:21.009 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:21.009 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 378, 2024-09-15T22:28:21.009 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.036342167, 2024-09-15T22:28:21.009 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000096143 2024-09-15T22:28:21.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.009 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:21.009 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.009 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.009 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.009 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 485040, 2024-09-15T22:28:21.010 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 64944 2024-09-15T22:28:21.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.010 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:28:21.010 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 409, 2024-09-15T22:28:21.010 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 487, 2024-09-15T22:28:21.010 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 8518436, 2024-09-15T22:28:21.010 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 334880, 2024-09-15T22:28:21.010 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 5, 2024-09-15T22:28:21.010 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 4, 2024-09-15T22:28:21.010 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.046518802, 2024-09-15T22:28:21.010 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.014972858, 2024-09-15T22:28:21.010 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.015259628, 2024-09-15T22:28:21.010 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.012000089, 2024-09-15T22:28:21.010 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:28:21.011 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 485, 2024-09-15T22:28:21.011 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.021437347, 2024-09-15T22:28:21.011 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000044200 2024-09-15T22:28:21.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.011 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:28:21.011 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.011 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.011 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.011 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-15T22:28:21.011 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 205136 2024-09-15T22:28:21.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.011 INFO:teuthology.orchestra.run.smithi098.stdout: "cct": { 2024-09-15T22:28:21.012 INFO:teuthology.orchestra.run.smithi098.stdout: "total_workers": 1, 2024-09-15T22:28:21.012 INFO:teuthology.orchestra.run.smithi098.stdout: "unhealthy_workers": 0 2024-09-15T22:28:21.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.012 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-MDSRank": { 2024-09-15T22:28:21.012 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-09-15T22:28:21.012 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-09-15T22:28:21.012 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1603, 2024-09-15T22:28:21.012 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.041238190, 2024-09-15T22:28:21.012 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000025725 2024-09-15T22:28:21.012 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:21.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.012 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-PurgeQueue": { 2024-09-15T22:28:21.012 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-09-15T22:28:21.013 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-09-15T22:28:21.013 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.013 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.013 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.013 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:21.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.017 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-09-15T22:28:21.017 INFO:teuthology.orchestra.run.smithi098.stdout: "request": 0, 2024-09-15T22:28:21.017 INFO:teuthology.orchestra.run.smithi098.stdout: "reply": 0, 2024-09-15T22:28:21.017 INFO:teuthology.orchestra.run.smithi098.stdout: "reply_latency": { 2024-09-15T22:28:21.017 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.017 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.017 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.017 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_reply": 0, 2024-09-15T22:28:21.018 INFO:teuthology.orchestra.run.smithi098.stdout: "forward": 0, 2024-09-15T22:28:21.018 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_complete": 0, 2024-09-15T22:28:21.018 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_keys": 0, 2024-09-15T22:28:21.018 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_commit": 0, 2024-09-15T22:28:21.018 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_split": 0, 2024-09-15T22:28:21.018 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_merge": 0, 2024-09-15T22:28:21.018 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes": 6362, 2024-09-15T22:28:21.018 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_top": 4, 2024-09-15T22:28:21.018 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_bottom": 6358, 2024-09-15T22:28:21.018 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pin_tail": 0, 2024-09-15T22:28:21.018 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pinned": 6356, 2024-09-15T22:28:21.018 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_expired": 0, 2024-09-15T22:28:21.018 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_with_caps": 0, 2024-09-15T22:28:21.019 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": 0, 2024-09-15T22:28:21.019 INFO:teuthology.orchestra.run.smithi098.stdout: "subtrees": 1, 2024-09-15T22:28:21.019 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse": 0, 2024-09-15T22:28:21.019 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_hit": 0, 2024-09-15T22:28:21.019 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_forward": 0, 2024-09-15T22:28:21.019 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_discover": 0, 2024-09-15T22:28:21.019 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_dir_fetch": 0, 2024-09-15T22:28:21.019 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_remote_ino": 0, 2024-09-15T22:28:21.019 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_lock": 0, 2024-09-15T22:28:21.019 INFO:teuthology.orchestra.run.smithi098.stdout: "load_cent": 0, 2024-09-15T22:28:21.019 INFO:teuthology.orchestra.run.smithi098.stdout: "q": 0, 2024-09-15T22:28:21.019 INFO:teuthology.orchestra.run.smithi098.stdout: "exported": 0, 2024-09-15T22:28:21.019 INFO:teuthology.orchestra.run.smithi098.stdout: "exported_inodes": 0, 2024-09-15T22:28:21.019 INFO:teuthology.orchestra.run.smithi098.stdout: "imported": 0, 2024-09-15T22:28:21.020 INFO:teuthology.orchestra.run.smithi098.stdout: "imported_inodes": 0, 2024-09-15T22:28:21.020 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_dir_fetch": 0, 2024-09-15T22:28:21.020 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_backtrace_fetch": 0, 2024-09-15T22:28:21.020 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_peer_discover": 0, 2024-09-15T22:28:21.020 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rfiles": 0, 2024-09-15T22:28:21.020 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rbytes": 0, 2024-09-15T22:28:21.020 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rsnaps": 0, 2024-09-15T22:28:21.020 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_fetch": 0, 2024-09-15T22:28:21.020 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_set_tag": 0, 2024-09-15T22:28:21.020 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T22:28:21.020 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_inotable_repaired": 0, 2024-09-15T22:28:21.020 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_inodes": 0, 2024-09-15T22:28:21.020 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T22:28:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dirfrag_rstats": 0, 2024-09-15T22:28:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_file_inodes": 0, 2024-09-15T22:28:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_inode_file_caps": 0, 2024-09-15T22:28:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_revoke": 0, 2024-09-15T22:28:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_grant": 0, 2024-09-15T22:28:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_trunc": 0, 2024-09-15T22:28:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T22:28:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T22:28:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps": 0, 2024-09-15T22:28:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps_dirty": 0, 2024-09-15T22:28:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_cap_release": 0, 2024-09-15T22:28:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: "process_request_cap_release": 0 2024-09-15T22:28:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_cache": { 2024-09-15T22:28:21.022 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update": 0, 2024-09-15T22:28:21.022 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update_receipt": 0, 2024-09-15T22:28:21.022 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_try_discover": 0, 2024-09-15T22:28:21.022 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_send_discover": 0, 2024-09-15T22:28:21.022 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_handle_discover": 0, 2024-09-15T22:28:21.022 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays": 0, 2024-09-15T22:28:21.022 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_delayed": 0, 2024-09-15T22:28:21.022 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_enqueuing": 0, 2024-09-15T22:28:21.022 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_created": 0, 2024-09-15T22:28:21.022 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_enqueued": 0, 2024-09-15T22:28:21.022 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_reintegrated": 0, 2024-09-15T22:28:21.022 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_migrated": 0, 2024-09-15T22:28:21.022 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_processing": 0, 2024-09-15T22:28:21.023 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_enqueued": 0, 2024-09-15T22:28:21.023 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_prioritized": 0, 2024-09-15T22:28:21.023 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_started": 0, 2024-09-15T22:28:21.023 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_completed": 0, 2024-09-15T22:28:21.023 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_path": 0, 2024-09-15T22:28:21.023 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_inode": 0, 2024-09-15T22:28:21.023 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T22:28:21.024 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_exportdir": 0, 2024-09-15T22:28:21.024 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_flush": 0, 2024-09-15T22:28:21.024 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragmentdir": 0, 2024-09-15T22:28:21.024 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragstats": 0, 2024-09-15T22:28:21.024 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_inodestats": 0 2024-09-15T22:28:21.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.024 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_log": { 2024-09-15T22:28:21.024 INFO:teuthology.orchestra.run.smithi098.stdout: "evlrg": 0, 2024-09-15T22:28:21.024 INFO:teuthology.orchestra.run.smithi098.stdout: "evadd": 0, 2024-09-15T22:28:21.024 INFO:teuthology.orchestra.run.smithi098.stdout: "evex": 0, 2024-09-15T22:28:21.024 INFO:teuthology.orchestra.run.smithi098.stdout: "evtrm": 0, 2024-09-15T22:28:21.025 INFO:teuthology.orchestra.run.smithi098.stdout: "ev": 16262, 2024-09-15T22:28:21.025 INFO:teuthology.orchestra.run.smithi098.stdout: "evexg": 0, 2024-09-15T22:28:21.025 INFO:teuthology.orchestra.run.smithi098.stdout: "evexd": 0, 2024-09-15T22:28:21.025 INFO:teuthology.orchestra.run.smithi098.stdout: "segadd": 0, 2024-09-15T22:28:21.025 INFO:teuthology.orchestra.run.smithi098.stdout: "segex": 0, 2024-09-15T22:28:21.025 INFO:teuthology.orchestra.run.smithi098.stdout: "segtrm": 0, 2024-09-15T22:28:21.025 INFO:teuthology.orchestra.run.smithi098.stdout: "seg": 24, 2024-09-15T22:28:21.025 INFO:teuthology.orchestra.run.smithi098.stdout: "segmjr": 3, 2024-09-15T22:28:21.025 INFO:teuthology.orchestra.run.smithi098.stdout: "segexg": 0, 2024-09-15T22:28:21.025 INFO:teuthology.orchestra.run.smithi098.stdout: "segexd": 0, 2024-09-15T22:28:21.025 INFO:teuthology.orchestra.run.smithi098.stdout: "expos": 4194304, 2024-09-15T22:28:21.025 INFO:teuthology.orchestra.run.smithi098.stdout: "wrpos": 38412404, 2024-09-15T22:28:21.025 INFO:teuthology.orchestra.run.smithi098.stdout: "rdpos": 38411266, 2024-09-15T22:28:21.025 INFO:teuthology.orchestra.run.smithi098.stdout: "jlat": { 2024-09-15T22:28:21.026 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.026 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.026 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.026 INFO:teuthology.orchestra.run.smithi098.stdout: "replayed": 16262 2024-09-15T22:28:21.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.026 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_mem": { 2024-09-15T22:28:21.026 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 80, 2024-09-15T22:28:21.026 INFO:teuthology.orchestra.run.smithi098.stdout: "ino+": 5573, 2024-09-15T22:28:21.026 INFO:teuthology.orchestra.run.smithi098.stdout: "ino-": 5493, 2024-09-15T22:28:21.026 INFO:teuthology.orchestra.run.smithi098.stdout: "dir": 85, 2024-09-15T22:28:21.026 INFO:teuthology.orchestra.run.smithi098.stdout: "dir+": 928, 2024-09-15T22:28:21.026 INFO:teuthology.orchestra.run.smithi098.stdout: "dir-": 843, 2024-09-15T22:28:21.026 INFO:teuthology.orchestra.run.smithi098.stdout: "dn": 6362, 2024-09-15T22:28:21.027 INFO:teuthology.orchestra.run.smithi098.stdout: "dn+": 11227, 2024-09-15T22:28:21.027 INFO:teuthology.orchestra.run.smithi098.stdout: "dn-": 4865, 2024-09-15T22:28:21.027 INFO:teuthology.orchestra.run.smithi098.stdout: "cap": 0, 2024-09-15T22:28:21.027 INFO:teuthology.orchestra.run.smithi098.stdout: "cap+": 0, 2024-09-15T22:28:21.027 INFO:teuthology.orchestra.run.smithi098.stdout: "cap-": 0, 2024-09-15T22:28:21.027 INFO:teuthology.orchestra.run.smithi098.stdout: "rss": 66124, 2024-09-15T22:28:21.027 INFO:teuthology.orchestra.run.smithi098.stdout: "heap": 215328 2024-09-15T22:28:21.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.027 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_server": { 2024-09-15T22:28:21.028 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_client_request": 0, 2024-09-15T22:28:21.028 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_server_request": 0, 2024-09-15T22:28:21.028 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_request": 0, 2024-09-15T22:28:21.028 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_session": 0, 2024-09-15T22:28:21.028 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_peer_request": 0, 2024-09-15T22:28:21.028 INFO:teuthology.orchestra.run.smithi098.stdout: "req_create_latency": { 2024-09-15T22:28:21.028 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.028 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.028 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.028 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getattr_latency": { 2024-09-15T22:28:21.028 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.028 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.028 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.029 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getfilelock_latency": { 2024-09-15T22:28:21.029 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.029 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.029 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.029 INFO:teuthology.orchestra.run.smithi098.stdout: "req_link_latency": { 2024-09-15T22:28:21.029 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.029 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.029 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.029 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookup_latency": { 2024-09-15T22:28:21.029 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.029 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.030 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.030 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookuphash_latency": { 2024-09-15T22:28:21.030 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.030 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.030 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.030 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupino_latency": { 2024-09-15T22:28:21.030 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.030 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.030 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.030 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupname_latency": { 2024-09-15T22:28:21.030 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.030 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.031 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.031 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupparent_latency": { 2024-09-15T22:28:21.031 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.031 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.031 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.031 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupsnap_latency": { 2024-09-15T22:28:21.031 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.031 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.031 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.031 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lssnap_latency": { 2024-09-15T22:28:21.031 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.032 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.032 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.032 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mkdir_latency": { 2024-09-15T22:28:21.032 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.033 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.033 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.033 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mknod_latency": { 2024-09-15T22:28:21.033 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.033 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.033 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.033 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mksnap_latency": { 2024-09-15T22:28:21.033 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.033 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.033 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.034 INFO:teuthology.orchestra.run.smithi098.stdout: "req_open_latency": { 2024-09-15T22:28:21.034 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.034 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.034 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.034 INFO:teuthology.orchestra.run.smithi098.stdout: "req_readdir_latency": { 2024-09-15T22:28:21.034 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.034 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.034 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.034 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rename_latency": { 2024-09-15T22:28:21.034 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.034 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.035 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.035 INFO:teuthology.orchestra.run.smithi098.stdout: "req_renamesnap_latency": { 2024-09-15T22:28:21.035 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.035 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.035 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.035 INFO:teuthology.orchestra.run.smithi098.stdout: "req_snapdiff_latency": { 2024-09-15T22:28:21.035 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.035 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.035 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.035 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmdir_latency": { 2024-09-15T22:28:21.036 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.036 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.036 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.036 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmsnap_latency": { 2024-09-15T22:28:21.036 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.036 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.036 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.036 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmxattr_latency": { 2024-09-15T22:28:21.036 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.036 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.036 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.037 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setattr_latency": { 2024-09-15T22:28:21.037 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.037 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.037 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.037 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setdirlayout_latency": { 2024-09-15T22:28:21.037 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.037 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.037 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.038 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setfilelock_latency": { 2024-09-15T22:28:21.038 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.038 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.038 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.038 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setlayout_latency": { 2024-09-15T22:28:21.038 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.038 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.038 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.038 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setxattr_latency": { 2024-09-15T22:28:21.038 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.038 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.039 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.039 INFO:teuthology.orchestra.run.smithi098.stdout: "req_symlink_latency": { 2024-09-15T22:28:21.039 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.039 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.039 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.039 INFO:teuthology.orchestra.run.smithi098.stdout: "req_unlink_latency": { 2024-09-15T22:28:21.039 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.039 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.039 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.039 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_revoke_eviction": 0, 2024-09-15T22:28:21.039 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_acquisition_throttle": 0, 2024-09-15T22:28:21.040 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getvxattr_latency": { 2024-09-15T22:28:21.040 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.040 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.040 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.040 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:21.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.040 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_sessions": { 2024-09-15T22:28:21.040 INFO:teuthology.orchestra.run.smithi098.stdout: "session_count": 1, 2024-09-15T22:28:21.040 INFO:teuthology.orchestra.run.smithi098.stdout: "session_add": 2, 2024-09-15T22:28:21.040 INFO:teuthology.orchestra.run.smithi098.stdout: "session_remove": 1, 2024-09-15T22:28:21.040 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_open": 1, 2024-09-15T22:28:21.040 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_stale": 0, 2024-09-15T22:28:21.040 INFO:teuthology.orchestra.run.smithi098.stdout: "total_load": 0, 2024-09-15T22:28:21.040 INFO:teuthology.orchestra.run.smithi098.stdout: "average_load": 0, 2024-09-15T22:28:21.041 INFO:teuthology.orchestra.run.smithi098.stdout: "avg_session_uptime": 1530, 2024-09-15T22:28:21.041 INFO:teuthology.orchestra.run.smithi098.stdout: "mdthresh_evicted": 0 2024-09-15T22:28:21.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.041 INFO:teuthology.orchestra.run.smithi098.stdout: "mempool": { 2024-09-15T22:28:21.041 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:28:21.041 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_items": 0, 2024-09-15T22:28:21.041 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:28:21.041 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:28:21.041 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:28:21.041 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:28:21.041 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:28:21.041 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:28:21.041 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:28:21.041 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:28:21.042 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:28:21.042 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:28:21.042 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:28:21.042 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:28:21.042 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:28:21.042 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_items": 0, 2024-09-15T22:28:21.042 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:28:21.042 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_items": 0, 2024-09-15T22:28:21.042 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:28:21.042 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:28:21.042 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:28:21.042 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:28:21.042 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:28:21.042 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:28:21.043 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:28:21.043 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_items": 0, 2024-09-15T22:28:21.043 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:28:21.043 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:28:21.043 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:28:21.043 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_items": 0, 2024-09-15T22:28:21.043 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_bytes": 0, 2024-09-15T22:28:21.043 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_items": 0, 2024-09-15T22:28:21.043 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:28:21.043 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:28:21.043 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:28:21.043 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:28:21.043 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_bytes": 216759, 2024-09-15T22:28:21.043 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_items": 130, 2024-09-15T22:28:21.044 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:28:21.044 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_items": 0, 2024-09-15T22:28:21.044 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_bytes": 0, 2024-09-15T22:28:21.044 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_items": 0, 2024-09-15T22:28:21.044 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:28:21.044 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_items": 0, 2024-09-15T22:28:21.044 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:28:21.044 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_items": 0, 2024-09-15T22:28:21.044 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_bytes": 7888, 2024-09-15T22:28:21.044 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_items": 163, 2024-09-15T22:28:21.044 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:28:21.044 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:28:21.044 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_bytes": 0, 2024-09-15T22:28:21.044 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_items": 0, 2024-09-15T22:28:21.045 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_bytes": 4793673, 2024-09-15T22:28:21.045 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_items": 43454, 2024-09-15T22:28:21.045 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_bytes": 0, 2024-09-15T22:28:21.045 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_items": 0, 2024-09-15T22:28:21.045 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_bytes": 0, 2024-09-15T22:28:21.045 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_items": 0 2024-09-15T22:28:21.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.045 INFO:teuthology.orchestra.run.smithi098.stdout: "objecter": { 2024-09-15T22:28:21.045 INFO:teuthology.orchestra.run.smithi098.stdout: "op_active": 0, 2024-09-15T22:28:21.045 INFO:teuthology.orchestra.run.smithi098.stdout: "op_laggy": 0, 2024-09-15T22:28:21.045 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send": 946, 2024-09-15T22:28:21.045 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send_bytes": 21, 2024-09-15T22:28:21.045 INFO:teuthology.orchestra.run.smithi098.stdout: "op_resend": 3, 2024-09-15T22:28:21.045 INFO:teuthology.orchestra.run.smithi098.stdout: "op_reply": 946, 2024-09-15T22:28:21.045 INFO:teuthology.orchestra.run.smithi098.stdout: "op_latency": { 2024-09-15T22:28:21.046 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 946, 2024-09-15T22:28:21.046 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.813989598, 2024-09-15T22:28:21.046 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000860454 2024-09-15T22:28:21.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.046 INFO:teuthology.orchestra.run.smithi098.stdout: "op_inflight": 0, 2024-09-15T22:28:21.046 INFO:teuthology.orchestra.run.smithi098.stdout: "oplen_avg": { 2024-09-15T22:28:21.046 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 946, 2024-09-15T22:28:21.046 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 947 2024-09-15T22:28:21.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.046 INFO:teuthology.orchestra.run.smithi098.stdout: "op": 946, 2024-09-15T22:28:21.046 INFO:teuthology.orchestra.run.smithi098.stdout: "op_r": 946, 2024-09-15T22:28:21.046 INFO:teuthology.orchestra.run.smithi098.stdout: "op_w": 0, 2024-09-15T22:28:21.046 INFO:teuthology.orchestra.run.smithi098.stdout: "op_rmw": 0, 2024-09-15T22:28:21.046 INFO:teuthology.orchestra.run.smithi098.stdout: "op_pg": 0, 2024-09-15T22:28:21.047 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_stat": 564, 2024-09-15T22:28:21.047 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_create": 0, 2024-09-15T22:28:21.047 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_read": 380, 2024-09-15T22:28:21.047 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_write": 0, 2024-09-15T22:28:21.047 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writefull": 0, 2024-09-15T22:28:21.047 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writesame": 0, 2024-09-15T22:28:21.047 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_append": 0, 2024-09-15T22:28:21.047 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_zero": 0, 2024-09-15T22:28:21.047 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_truncate": 0, 2024-09-15T22:28:21.047 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_delete": 0, 2024-09-15T22:28:21.047 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_mapext": 0, 2024-09-15T22:28:21.047 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_sparse_read": 0, 2024-09-15T22:28:21.047 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_clonerange": 0, 2024-09-15T22:28:21.047 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_getxattr": 1, 2024-09-15T22:28:21.048 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_setxattr": 0, 2024-09-15T22:28:21.048 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_cmpxattr": 0, 2024-09-15T22:28:21.048 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_rmxattr": 0, 2024-09-15T22:28:21.048 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_resetxattrs": 0, 2024-09-15T22:28:21.048 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_call": 0, 2024-09-15T22:28:21.048 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_watch": 0, 2024-09-15T22:28:21.048 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_notify": 0, 2024-09-15T22:28:21.048 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T22:28:21.048 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls": 0, 2024-09-15T22:28:21.048 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls_filter": 0, 2024-09-15T22:28:21.049 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_other": 0, 2024-09-15T22:28:21.049 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_active": 0, 2024-09-15T22:28:21.049 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_send": 0, 2024-09-15T22:28:21.049 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_resend": 0, 2024-09-15T22:28:21.049 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_ping": 0, 2024-09-15T22:28:21.049 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_active": 0, 2024-09-15T22:28:21.049 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_send": 0, 2024-09-15T22:28:21.049 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_resend": 0, 2024-09-15T22:28:21.049 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_active": 0, 2024-09-15T22:28:21.049 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_send": 0, 2024-09-15T22:28:21.049 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_resend": 0, 2024-09-15T22:28:21.049 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_active": 0, 2024-09-15T22:28:21.049 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_send": 0, 2024-09-15T22:28:21.049 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_resend": 0, 2024-09-15T22:28:21.050 INFO:teuthology.orchestra.run.smithi098.stdout: "command_active": 0, 2024-09-15T22:28:21.050 INFO:teuthology.orchestra.run.smithi098.stdout: "command_send": 0, 2024-09-15T22:28:21.050 INFO:teuthology.orchestra.run.smithi098.stdout: "command_resend": 0, 2024-09-15T22:28:21.050 INFO:teuthology.orchestra.run.smithi098.stdout: "map_epoch": 86, 2024-09-15T22:28:21.050 INFO:teuthology.orchestra.run.smithi098.stdout: "map_full": 0, 2024-09-15T22:28:21.050 INFO:teuthology.orchestra.run.smithi098.stdout: "map_inc": 4, 2024-09-15T22:28:21.050 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_sessions": 8, 2024-09-15T22:28:21.050 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_open": 8, 2024-09-15T22:28:21.050 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_close": 0, 2024-09-15T22:28:21.050 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_laggy": 0, 2024-09-15T22:28:21.050 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_wr": 0, 2024-09-15T22:28:21.050 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_rd": 2, 2024-09-15T22:28:21.050 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_del": 0 2024-09-15T22:28:21.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.050 INFO:teuthology.orchestra.run.smithi098.stdout: "oft": { 2024-09-15T22:28:21.051 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_objs": 0, 2024-09-15T22:28:21.051 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_kv_pairs": 0, 2024-09-15T22:28:21.051 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_updates": 0, 2024-09-15T22:28:21.051 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_removes": 0 2024-09-15T22:28:21.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.051 INFO:teuthology.orchestra.run.smithi098.stdout: "osd-slow-ops": { 2024-09-15T22:28:21.051 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_ops_count": 0 2024-09-15T22:28:21.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.051 INFO:teuthology.orchestra.run.smithi098.stdout: "purge_queue": { 2024-09-15T22:28:21.051 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops": 0, 2024-09-15T22:28:21.051 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops_high_water": 0, 2024-09-15T22:28:21.051 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing": 0, 2024-09-15T22:28:21.051 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_high_water": 0, 2024-09-15T22:28:21.051 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed_ops": 0, 2024-09-15T22:28:21.052 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed": 0, 2024-09-15T22:28:21.052 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_item_in_journal": 0 2024-09-15T22:28:21.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.052 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:28:21.052 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-15T22:28:21.052 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-09-15T22:28:21.052 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-15T22:28:21.052 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 1069, 2024-09-15T22:28:21.052 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 34869085, 2024-09-15T22:28:21.052 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:21.052 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 1069, 2024-09-15T22:28:21.052 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-15T22:28:21.052 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-15T22:28:21.052 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 1069, 2024-09-15T22:28:21.053 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 34869085, 2024-09-15T22:28:21.053 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-15T22:28:21.053 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.053 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.053 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.053 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:21.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.053 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_bytes": { 2024-09-15T22:28:21.053 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-15T22:28:21.053 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-09-15T22:28:21.053 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-15T22:28:21.053 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-09-15T22:28:21.053 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-09-15T22:28:21.053 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:21.054 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-09-15T22:28:21.054 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 946, 2024-09-15T22:28:21.054 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 34218105, 2024-09-15T22:28:21.054 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 946, 2024-09-15T22:28:21.054 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 34218105, 2024-09-15T22:28:21.054 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-15T22:28:21.054 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.054 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.054 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.054 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:21.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.054 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_ops": { 2024-09-15T22:28:21.054 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-15T22:28:21.054 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 1024, 2024-09-15T22:28:21.054 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-15T22:28:21.055 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-09-15T22:28:21.055 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-09-15T22:28:21.055 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:21.055 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-09-15T22:28:21.055 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 946, 2024-09-15T22:28:21.055 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 946, 2024-09-15T22:28:21.055 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 946, 2024-09-15T22:28:21.055 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 946, 2024-09-15T22:28:21.055 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-15T22:28:21.055 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.055 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.055 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.055 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:21.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.056 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle": { 2024-09-15T22:28:21.056 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-15T22:28:21.056 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-09-15T22:28:21.056 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-15T22:28:21.056 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-09-15T22:28:21.056 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-09-15T22:28:21.056 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:21.056 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-09-15T22:28:21.056 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-15T22:28:21.056 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-15T22:28:21.056 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 0, 2024-09-15T22:28:21.056 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 0, 2024-09-15T22:28:21.056 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-15T22:28:21.056 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.057 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.057 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.057 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:21.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-15T22:28:21.057 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle-0x55ee611ae6e0": { 2024-09-15T22:28:21.057 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-15T22:28:21.057 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-09-15T22:28:21.057 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-15T22:28:21.057 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-09-15T22:28:21.057 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-09-15T22:28:21.057 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-15T22:28:21.057 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-09-15T22:28:21.057 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-15T22:28:21.057 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-15T22:28:21.058 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 0, 2024-09-15T22:28:21.058 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 0, 2024-09-15T22:28:21.058 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-15T22:28:21.058 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-15T22:28:21.058 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-15T22:28:21.058 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-15T22:28:21.058 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:21.058 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-15T22:28:21.058 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-15T22:28:21.577 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:21 smithi098 ceph-mon[35514]: pgmap v460: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-15T22:28:21.746 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:21 smithi012 ceph-mon[34883]: pgmap v460: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-15T22:28:21.827 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-15T22:28:21.827 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-15T22:28:21.827 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-09-15T22:28:21.827 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-09-15T22:28:21.827 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-15T22:28:21.839 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-15T22:28:21.839 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T22:28:21.839 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:28:21.875 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:21 smithi001 ceph-mon[30843]: pgmap v460: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-15T22:28:21.881 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T22:28:21.881 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:28:21.962 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-15T22:28:22.388 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:28:22.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.993+0000 7f01c6800640 1 -- 172.21.15.1:0/166871177 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01c0074e30 msgr2=0x7f01c010dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:22.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.993+0000 7f01c6800640 1 --2- 172.21.15.1:0/166871177 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01c0074e30 0x7f01c010dd40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f01ac009900 tx=0x7f01ac02a480 comp rx=0 tx=0).stop 2024-09-15T22:28:22.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.993+0000 7f01c6800640 1 -- 172.21.15.1:0/166871177 shutdown_connections 2024-09-15T22:28:22.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.993+0000 7f01c6800640 1 --2- 172.21.15.1:0/166871177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01c010e280 0x7f01c0110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:22.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.993+0000 7f01c6800640 1 --2- 172.21.15.1:0/166871177 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01c0074e30 0x7f01c010dd40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:22.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.993+0000 7f01c6800640 1 --2- 172.21.15.1:0/166871177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01c0074510 0x7f01c00748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:22.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.993+0000 7f01c6800640 1 -- 172.21.15.1:0/166871177 >> 172.21.15.1:0/166871177 conn(0x7f01c00fd6e0 msgr2=0x7f01c00ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:28:22.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.993+0000 7f01c6800640 1 -- 172.21.15.1:0/166871177 shutdown_connections 2024-09-15T22:28:22.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.993+0000 7f01c6800640 1 -- 172.21.15.1:0/166871177 wait complete. 2024-09-15T22:28:22.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.994+0000 7f01c6800640 1 Processor -- start 2024-09-15T22:28:22.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.994+0000 7f01c6800640 1 -- start start 2024-09-15T22:28:22.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.995+0000 7f01c6800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01c0074510 0x7f01c019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:22.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.995+0000 7f01c6800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01c0074e30 0x7f01c019aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:22.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.995+0000 7f01c6800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01c010e280 0x7f01c019edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:22.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.995+0000 7f01c6800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f01c0113fb0 con 0x7f01c0074510 2024-09-15T22:28:22.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.995+0000 7f01c6800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f01c0113e30 con 0x7f01c010e280 2024-09-15T22:28:22.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.995+0000 7f01c6800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f01c0114130 con 0x7f01c0074e30 2024-09-15T22:28:22.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.995+0000 7f01c5400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01c0074510 0x7f01c019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:22.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.995+0000 7f01c4a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01c0074e30 0x7f01c019aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:22.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.995+0000 7f01c5400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01c0074510 0x7f01c019a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60708/0 (socket says 172.21.15.1:60708) 2024-09-15T22:28:22.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.995+0000 7f01c4a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01c0074e30 0x7f01c019aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.1:34220/0 (socket says 172.21.15.1:34220) 2024-09-15T22:28:22.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.995+0000 7f01c5400640 1 -- 172.21.15.1:0/1863252548 learned_addr learned my addr 172.21.15.1:0/1863252548 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:28:22.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.995+0000 7f01c5e00640 1 --2- 172.21.15.1:0/1863252548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01c010e280 0x7f01c019edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:22.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.995+0000 7f01c4a00640 1 -- 172.21.15.1:0/1863252548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01c010e280 msgr2=0x7f01c019edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:22.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.995+0000 7f01c4a00640 1 --2- 172.21.15.1:0/1863252548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01c010e280 0x7f01c019edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:22.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.995+0000 7f01c4a00640 1 -- 172.21.15.1:0/1863252548 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01c0074510 msgr2=0x7f01c019a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:22.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.995+0000 7f01c4a00640 1 --2- 172.21.15.1:0/1863252548 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01c0074510 0x7f01c019a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:22.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.995+0000 7f01c4a00640 1 -- 172.21.15.1:0/1863252548 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c019f490 con 0x7f01c0074e30 2024-09-15T22:28:22.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.995+0000 7f01c5400640 1 --2- 172.21.15.1:0/1863252548 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01c0074510 0x7f01c019a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:28:22.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.996+0000 7f01c4a00640 1 --2- 172.21.15.1:0/1863252548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01c0074e30 0x7f01c019aa20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f01ac005940 tx=0x7f01ac0040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:28:22.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.996+0000 7f01be000640 1 -- 172.21.15.1:0/1863252548 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ac03f030 con 0x7f01c0074e30 2024-09-15T22:28:22.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.996+0000 7f01c6800640 1 -- 172.21.15.1:0/1863252548 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01c019f720 con 0x7f01c0074e30 2024-09-15T22:28:22.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.996+0000 7f01c6800640 1 -- 172.21.15.1:0/1863252548 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01c01a7060 con 0x7f01c0074e30 2024-09-15T22:28:22.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.996+0000 7f01be000640 1 -- 172.21.15.1:0/1863252548 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01ac0044c0 con 0x7f01c0074e30 2024-09-15T22:28:22.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.996+0000 7f01be000640 1 -- 172.21.15.1:0/1863252548 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ac049060 con 0x7f01c0074e30 2024-09-15T22:28:22.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:22.997+0000 7f01c6800640 1 -- 172.21.15.1:0/1863252548 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01c00748f0 con 0x7f01c0074e30 2024-09-15T22:28:23.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:23.000+0000 7f01be000640 1 -- 172.21.15.1:0/1863252548 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f01ac042030 con 0x7f01c0074e30 2024-09-15T22:28:23.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:23.001+0000 7f01be000640 1 --2- 172.21.15.1:0/1863252548 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f01a80a32c0 0x7f01a80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:23.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:23.001+0000 7f01be000640 1 -- 172.21.15.1:0/1863252548 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f01ac0efaa0 con 0x7f01c0074e30 2024-09-15T22:28:23.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:23.001+0000 7f01c5400640 1 --2- 172.21.15.1:0/1863252548 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f01a80a32c0 0x7f01a80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:23.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:23.002+0000 7f01c5400640 1 --2- 172.21.15.1:0/1863252548 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f01a80a32c0 0x7f01a80a5780 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f01b4011550 tx=0x7f01b4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:28:23.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:23.003+0000 7f01be000640 1 -- 172.21.15.1:0/1863252548 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f01ac0bc0b0 con 0x7f01c0074e30 2024-09-15T22:28:23.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:23.203+0000 7f01c6800640 1 -- 172.21.15.1:0/1863252548 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f01c0109430 con 0x7f01c0074e30 2024-09-15T22:28:23.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:23.203+0000 7f01be000640 1 -- 172.21.15.1:0/1863252548 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v86) ==== 81+0+579 (secure 0 0 0) 0x7f01ac0dc0c0 con 0x7f01c0074e30 2024-09-15T22:28:23.204 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6800/3145051160 2024-09-16T22:15:31.433375+0000 2024-09-15T22:28:23.205 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/3101438101 2024-09-16T22:15:31.433375+0000 2024-09-15T22:28:23.205 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/4159811089 2024-09-16T22:15:31.433375+0000 2024-09-15T22:28:23.205 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6801/3145051160 2024-09-16T22:15:31.433375+0000 2024-09-15T22:28:23.205 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/2785155592 2024-09-16T22:15:31.433375+0000 2024-09-15T22:28:23.205 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/714180295 2024-09-16T22:15:03.937536+0000 2024-09-15T22:28:23.205 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6801/215291238 2024-09-16T22:15:03.937536+0000 2024-09-15T22:28:23.205 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6800/215291238 2024-09-16T22:15:03.937536+0000 2024-09-15T22:28:23.205 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/1842817732 2024-09-16T22:15:03.937536+0000 2024-09-15T22:28:23.205 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/3888009741 2024-09-16T22:15:03.937536+0000 2024-09-15T22:28:23.205 INFO:teuthology.orchestra.run.smithi001.stderr:listed 10 entries 2024-09-15T22:28:23.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:23.206+0000 7f01c6800640 1 -- 172.21.15.1:0/1863252548 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f01a80a32c0 msgr2=0x7f01a80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:23.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:23.206+0000 7f01c6800640 1 --2- 172.21.15.1:0/1863252548 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f01a80a32c0 0x7f01a80a5780 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f01b4011550 tx=0x7f01b4005f90 comp rx=0 tx=0).stop 2024-09-15T22:28:23.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:23.206+0000 7f01c6800640 1 -- 172.21.15.1:0/1863252548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01c0074e30 msgr2=0x7f01c019aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:23.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:23.206+0000 7f01c6800640 1 --2- 172.21.15.1:0/1863252548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01c0074e30 0x7f01c019aa20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f01ac005940 tx=0x7f01ac0040c0 comp rx=0 tx=0).stop 2024-09-15T22:28:23.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:23.206+0000 7f01c6800640 1 -- 172.21.15.1:0/1863252548 shutdown_connections 2024-09-15T22:28:23.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:23.206+0000 7f01c6800640 1 --2- 172.21.15.1:0/1863252548 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f01a80a32c0 0x7f01a80a5780 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:23.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:23.206+0000 7f01c6800640 1 --2- 172.21.15.1:0/1863252548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01c010e280 0x7f01c019edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:23.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:23.206+0000 7f01c6800640 1 --2- 172.21.15.1:0/1863252548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01c0074e30 0x7f01c019aa20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:23.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:23.206+0000 7f01c6800640 1 --2- 172.21.15.1:0/1863252548 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01c0074510 0x7f01c019a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:23.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:23.206+0000 7f01c6800640 1 -- 172.21.15.1:0/1863252548 >> 172.21.15.1:0/1863252548 conn(0x7f01c00fd6e0 msgr2=0x7f01c00fef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:28:23.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:23.206+0000 7f01c6800640 1 -- 172.21.15.1:0/1863252548 shutdown_connections 2024-09-15T22:28:23.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:23.206+0000 7f01c6800640 1 -- 172.21.15.1:0/1863252548 wait complete. 2024-09-15T22:28:23.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:23 smithi012 ceph-mon[34883]: pgmap v461: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-15T22:28:23.793 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:23 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/1863252548' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T22:28:23.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:23 smithi098 ceph-mon[35514]: pgmap v461: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-15T22:28:23.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:23 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/1863252548' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T22:28:23.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:23 smithi001 ceph-mon[30843]: pgmap v461: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-15T22:28:23.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:23 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/1863252548' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T22:28:24.073 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T22:28:24.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:28:24.073 DEBUG:teuthology.orchestra.run.smithi001:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-15T22:28:24.186 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi001.front.sepia.ceph.com 2024-09-15T22:28:24.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:28:24.187 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T22:28:24.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:28:24.276 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2024-09-15T22:28:24.331 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T22:28:24.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:28:24.332 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:28:24.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:28:24.392 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link delete ceph-brx 2024-09-15T22:28:24.722 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-15T22:28:24.732 INFO:tasks.cephadm:Teardown begin 2024-09-15T22:28:24.733 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T22:28:24.733 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:28:25.113 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:28:25.542 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:25 smithi001 ceph-mon[30843]: pgmap v462: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-15T22:28:25.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:25 smithi012 ceph-mon[34883]: pgmap v462: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-15T22:28:25.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:25 smithi098 ceph-mon[35514]: pgmap v462: 97 pgs: 97 active+clean; 90 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-15T22:28:25.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.827+0000 7f626c600640 1 -- 172.21.15.1:0/2255990814 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6264103ff0 msgr2=0x7f62641043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:25.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.827+0000 7f626c600640 1 --2- 172.21.15.1:0/2255990814 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6264103ff0 0x7f62641043d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6258009900 tx=0x7f625802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:28:25.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.827+0000 7f626c600640 1 -- 172.21.15.1:0/2255990814 shutdown_connections 2024-09-15T22:28:25.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.827+0000 7f626c600640 1 --2- 172.21.15.1:0/2255990814 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6264109120 0x7f6264110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:25.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.827+0000 7f626c600640 1 --2- 172.21.15.1:0/2255990814 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62641049a0 0x7f62641089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:25.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.827+0000 7f626c600640 1 --2- 172.21.15.1:0/2255990814 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6264103ff0 0x7f62641043d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:25.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.827+0000 7f626c600640 1 -- 172.21.15.1:0/2255990814 >> 172.21.15.1:0/2255990814 conn(0x7f62640ffa90 msgr2=0x7f6264101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:28:25.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.827+0000 7f626c600640 1 -- 172.21.15.1:0/2255990814 shutdown_connections 2024-09-15T22:28:25.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.827+0000 7f626c600640 1 -- 172.21.15.1:0/2255990814 wait complete. 2024-09-15T22:28:25.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.828+0000 7f626c600640 1 Processor -- start 2024-09-15T22:28:25.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.828+0000 7f626c600640 1 -- start start 2024-09-15T22:28:25.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.829+0000 7f626c600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6264103ff0 0x7f6264076700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:25.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.829+0000 7f626c600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62641049a0 0x7f6264076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:25.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.829+0000 7f626c600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6264109120 0x7f6264077180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:25.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.829+0000 7f626c600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6264114120 con 0x7f62641049a0 2024-09-15T22:28:25.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.829+0000 7f626c600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6264113fa0 con 0x7f6264109120 2024-09-15T22:28:25.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.829+0000 7f626c600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f62641142a0 con 0x7f6264103ff0 2024-09-15T22:28:25.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.829+0000 7f6269200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62641049a0 0x7f6264076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:25.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.829+0000 7f626a600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6264109120 0x7f6264077180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:25.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.829+0000 7f6269c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6264103ff0 0x7f6264076700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:25.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.829+0000 7f6269200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62641049a0 0x7f6264076c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60718/0 (socket says 172.21.15.1:60718) 2024-09-15T22:28:25.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.829+0000 7f6269200640 1 -- 172.21.15.1:0/2798237264 learned_addr learned my addr 172.21.15.1:0/2798237264 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:28:25.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.829+0000 7f626a600640 1 -- 172.21.15.1:0/2798237264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6264103ff0 msgr2=0x7f6264076700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:25.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.829+0000 7f626a600640 1 --2- 172.21.15.1:0/2798237264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6264103ff0 0x7f6264076700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:25.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.829+0000 7f626a600640 1 -- 172.21.15.1:0/2798237264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62641049a0 msgr2=0x7f6264076c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:25.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.829+0000 7f626a600640 1 --2- 172.21.15.1:0/2798237264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62641049a0 0x7f6264076c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:25.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.829+0000 7f626a600640 1 -- 172.21.15.1:0/2798237264 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62641aac80 con 0x7f6264109120 2024-09-15T22:28:25.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.829+0000 7f6269c00640 1 --2- 172.21.15.1:0/2798237264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6264103ff0 0x7f6264076700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:28:25.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.830+0000 7f626a600640 1 --2- 172.21.15.1:0/2798237264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6264109120 0x7f6264077180 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f625c00eab0 tx=0x7f625c00ef70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:28:25.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.830+0000 7f6262000640 1 -- 172.21.15.1:0/2798237264 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625c00cea0 con 0x7f6264109120 2024-09-15T22:28:25.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.830+0000 7f6262000640 1 -- 172.21.15.1:0/2798237264 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f625c005020 con 0x7f6264109120 2024-09-15T22:28:25.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.830+0000 7f626c600640 1 -- 172.21.15.1:0/2798237264 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62641aaf70 con 0x7f6264109120 2024-09-15T22:28:25.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.830+0000 7f6262000640 1 -- 172.21.15.1:0/2798237264 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625c0107a0 con 0x7f6264109120 2024-09-15T22:28:25.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.830+0000 7f626c600640 1 -- 172.21.15.1:0/2798237264 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62641ab420 con 0x7f6264109120 2024-09-15T22:28:25.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.831+0000 7f626c600640 1 -- 172.21.15.1:0/2798237264 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62641054d0 con 0x7f6264109120 2024-09-15T22:28:25.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.833+0000 7f6262000640 1 -- 172.21.15.1:0/2798237264 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f625c005540 con 0x7f6264109120 2024-09-15T22:28:25.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.834+0000 7f6262000640 1 --2- 172.21.15.1:0/2798237264 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f624c0a3240 0x7f624c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:25.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.835+0000 7f6262000640 1 -- 172.21.15.1:0/2798237264 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f625c0cff50 con 0x7f6264109120 2024-09-15T22:28:25.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.835+0000 7f6269c00640 1 --2- 172.21.15.1:0/2798237264 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f624c0a3240 0x7f624c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:25.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.835+0000 7f6269c00640 1 --2- 172.21.15.1:0/2798237264 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f624c0a3240 0x7f624c0a5700 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6258009230 tx=0x7f62580058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:28:25.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:25.837+0000 7f6262000640 1 -- 172.21.15.1:0/2798237264 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f625c09cbb0 con 0x7f6264109120 2024-09-15T22:28:26.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:26.063+0000 7f626c600640 1 -- 172.21.15.1:0/2798237264 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f62641043d0 con 0x7f6264109120 2024-09-15T22:28:26.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:26.064+0000 7f6262000640 1 -- 172.21.15.1:0/2798237264 <== mon.2 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11891 (secure 0 0 0) 0x7f62641043d0 con 0x7f6264109120 2024-09-15T22:28:26.065 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:28:26.065 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":29,"btime":"2024-09-15T22:27:44:051534+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2417768032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2417768032},{"type":"v1","addr":"172.21.15.1:6835","nonce":2417768032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14493,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2957993064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2957993064},{"type":"v1","addr":"172.21.15.1:6837","nonce":2957993064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14529,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3887277479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3887277479},{"type":"v1","addr":"172.21.15.1:6839","nonce":3887277479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14541,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/1674822398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":1674822398},{"type":"v1","addr":"172.21.15.1:6841","nonce":1674822398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3122570659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3122570659},{"type":"v1","addr":"172.21.15.12:6833","nonce":3122570659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2901262900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2901262900},{"type":"v1","addr":"172.21.15.12:6835","nonce":2901262900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:22:51.743282+0000","modified":"2024-09-15T22:27:43.369266+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24538,"mds_1":24524,"mds_2":24520},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/94050093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":94050093},{"type":"v1","addr":"172.21.15.98:6833","nonce":94050093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6837/2378138381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2378138381},{"type":"v1","addr":"172.21.15.12:6837","nonce":2378138381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1848806705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1848806705},{"type":"v1","addr":"172.21.15.98:6835","nonce":1848806705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.98:6837/493594054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":493594054},{"type":"v1","addr":"172.21.15.98:6837","nonce":493594054}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.12:6839/1469511155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":1469511155},{"type":"v1","addr":"172.21.15.12:6839","nonce":1469511155}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.98:6839/2831161859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2831161859},{"type":"v1","addr":"172.21.15.98:6839","nonce":2831161859}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24538,"qdb_cluster":[24538,24524,24520]},"id":1}]} 2024-09-15T22:28:26.066 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 29 2024-09-15T22:28:26.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:26.066+0000 7f626c600640 1 -- 172.21.15.1:0/2798237264 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f624c0a3240 msgr2=0x7f624c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:26.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:26.066+0000 7f626c600640 1 --2- 172.21.15.1:0/2798237264 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f624c0a3240 0x7f624c0a5700 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6258009230 tx=0x7f62580058d0 comp rx=0 tx=0).stop 2024-09-15T22:28:26.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:26.066+0000 7f626c600640 1 -- 172.21.15.1:0/2798237264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6264109120 msgr2=0x7f6264077180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:26.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:26.066+0000 7f626c600640 1 --2- 172.21.15.1:0/2798237264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6264109120 0x7f6264077180 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f625c00eab0 tx=0x7f625c00ef70 comp rx=0 tx=0).stop 2024-09-15T22:28:26.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:26.066+0000 7f626c600640 1 -- 172.21.15.1:0/2798237264 shutdown_connections 2024-09-15T22:28:26.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:26.066+0000 7f626c600640 1 --2- 172.21.15.1:0/2798237264 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f624c0a3240 0x7f624c0a5700 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:26.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:26.066+0000 7f626c600640 1 --2- 172.21.15.1:0/2798237264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6264109120 0x7f6264077180 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:26.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:26.066+0000 7f626c600640 1 --2- 172.21.15.1:0/2798237264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62641049a0 0x7f6264076c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:26.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:26.066+0000 7f626c600640 1 --2- 172.21.15.1:0/2798237264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6264103ff0 0x7f6264076700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:26.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:26.066+0000 7f626c600640 1 -- 172.21.15.1:0/2798237264 >> 172.21.15.1:0/2798237264 conn(0x7f62640ffa90 msgr2=0x7f6264100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:28:26.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:26.067+0000 7f626c600640 1 -- 172.21.15.1:0/2798237264 shutdown_connections 2024-09-15T22:28:26.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:26.067+0000 7f626c600640 1 -- 172.21.15.1:0/2798237264 wait complete. 2024-09-15T22:28:26.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:26 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/2798237264' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:28:26.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:26 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/2798237264' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:28:26.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:26 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/2798237264' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:28:27.030 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:28:27.417 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:28:27.737 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:27 smithi001 ceph-mon[30843]: pgmap v463: 97 pgs: 97 active+clean; 90 MiB data, 898 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-15T22:28:27.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:27 smithi012 ceph-mon[34883]: pgmap v463: 97 pgs: 97 active+clean; 90 MiB data, 898 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-15T22:28:27.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:27 smithi098 ceph-mon[35514]: pgmap v463: 97 pgs: 97 active+clean; 90 MiB data, 898 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-15T22:28:28.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.033+0000 7f8387200640 1 -- 172.21.15.1:0/1874739538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8380112870 msgr2=0x7f8380114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:28.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.033+0000 7f8387200640 1 --2- 172.21.15.1:0/1874739538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8380112870 0x7f8380114c60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f837c009ca0 tx=0x7f837c02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:28:28.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.033+0000 7f8387200640 1 -- 172.21.15.1:0/1874739538 shutdown_connections 2024-09-15T22:28:28.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.033+0000 7f8387200640 1 --2- 172.21.15.1:0/1874739538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8380112870 0x7f8380114c60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:28.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.033+0000 7f8387200640 1 --2- 172.21.15.1:0/1874739538 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8380077040 0x7f8380112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:28.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.033+0000 7f8387200640 1 --2- 172.21.15.1:0/1874739538 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8380076720 0x7f8380076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:28.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.033+0000 7f8387200640 1 -- 172.21.15.1:0/1874739538 >> 172.21.15.1:0/1874739538 conn(0x7f83800ff8d0 msgr2=0x7f8380101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:28:28.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.033+0000 7f8387200640 1 -- 172.21.15.1:0/1874739538 shutdown_connections 2024-09-15T22:28:28.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.033+0000 7f8387200640 1 -- 172.21.15.1:0/1874739538 wait complete. 2024-09-15T22:28:28.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.034+0000 7f8387200640 1 Processor -- start 2024-09-15T22:28:28.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.034+0000 7f8387200640 1 -- start start 2024-09-15T22:28:28.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.035+0000 7f8387200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8380076720 0x7f83801a4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:28.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.035+0000 7f8387200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8380077040 0x7f83801a4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:28.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.035+0000 7f8387200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8380112870 0x7f838019e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:28.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.035+0000 7f8387200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8380118400 con 0x7f8380076720 2024-09-15T22:28:28.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.035+0000 7f8387200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8380118280 con 0x7f8380077040 2024-09-15T22:28:28.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.035+0000 7f8387200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8380118580 con 0x7f8380112870 2024-09-15T22:28:28.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.035+0000 7f8385e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8380076720 0x7f83801a4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:28.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.035+0000 7f8385e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8380076720 0x7f83801a4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48140/0 (socket says 172.21.15.1:48140) 2024-09-15T22:28:28.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.035+0000 7f8385400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8380077040 0x7f83801a4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:28.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.035+0000 7f8385e00640 1 -- 172.21.15.1:0/185122800 learned_addr learned my addr 172.21.15.1:0/185122800 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:28:28.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.035+0000 7f8386800640 1 --2- 172.21.15.1:0/185122800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8380112870 0x7f838019e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:28.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.036+0000 7f8385400640 1 -- 172.21.15.1:0/185122800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8380112870 msgr2=0x7f838019e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:28.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.036+0000 7f8385400640 1 --2- 172.21.15.1:0/185122800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8380112870 0x7f838019e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:28.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.036+0000 7f8385400640 1 -- 172.21.15.1:0/185122800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8380076720 msgr2=0x7f83801a4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:28.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.036+0000 7f8385400640 1 --2- 172.21.15.1:0/185122800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8380076720 0x7f83801a4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:28.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.036+0000 7f8385400640 1 -- 172.21.15.1:0/185122800 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f838019ef80 con 0x7f8380077040 2024-09-15T22:28:28.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.036+0000 7f8385e00640 1 --2- 172.21.15.1:0/185122800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8380076720 0x7f83801a4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:28:28.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.036+0000 7f8385400640 1 --2- 172.21.15.1:0/185122800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8380077040 0x7f83801a4b80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f837000e9f0 tx=0x7f837000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:28:28.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.036+0000 7f837aa00640 1 -- 172.21.15.1:0/185122800 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f837000ccc0 con 0x7f8380077040 2024-09-15T22:28:28.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.036+0000 7f8387200640 1 -- 172.21.15.1:0/185122800 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f838019f270 con 0x7f8380077040 2024-09-15T22:28:28.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.036+0000 7f837aa00640 1 -- 172.21.15.1:0/185122800 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8370010910 con 0x7f8380077040 2024-09-15T22:28:28.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.036+0000 7f837aa00640 1 -- 172.21.15.1:0/185122800 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8370018880 con 0x7f8380077040 2024-09-15T22:28:28.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.037+0000 7f8387200640 1 -- 172.21.15.1:0/185122800 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83801ab5c0 con 0x7f8380077040 2024-09-15T22:28:28.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.038+0000 7f8387200640 1 -- 172.21.15.1:0/185122800 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8380077e60 con 0x7f8380077040 2024-09-15T22:28:28.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.040+0000 7f837aa00640 1 -- 172.21.15.1:0/185122800 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f8370010ac0 con 0x7f8380077040 2024-09-15T22:28:28.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.041+0000 7f837aa00640 1 --2- 172.21.15.1:0/185122800 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f83680a32c0 0x7f83680a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:28.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.041+0000 7f837aa00640 1 -- 172.21.15.1:0/185122800 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f83700cfe10 con 0x7f8380077040 2024-09-15T22:28:28.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.041+0000 7f8385e00640 1 --2- 172.21.15.1:0/185122800 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f83680a32c0 0x7f83680a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:28.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.042+0000 7f8385e00640 1 --2- 172.21.15.1:0/185122800 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f83680a32c0 0x7f83680a5780 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8374005fd0 tx=0x7f837400b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:28:28.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.043+0000 7f837aa00640 1 -- 172.21.15.1:0/185122800 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f837009c420 con 0x7f8380077040 2024-09-15T22:28:28.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.262+0000 7f8387200640 1 -- 172.21.15.1:0/185122800 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f838010da00 con 0x7f8380077040 2024-09-15T22:28:28.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.263+0000 7f837aa00640 1 -- 172.21.15.1:0/185122800 <== mon.2 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11891 (secure 0 0 0) 0x7f83700a0720 con 0x7f8380077040 2024-09-15T22:28:28.264 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:28:28.265 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":29,"btime":"2024-09-15T22:27:44:051534+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2417768032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2417768032},{"type":"v1","addr":"172.21.15.1:6835","nonce":2417768032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14493,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2957993064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2957993064},{"type":"v1","addr":"172.21.15.1:6837","nonce":2957993064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14529,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3887277479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3887277479},{"type":"v1","addr":"172.21.15.1:6839","nonce":3887277479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14541,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/1674822398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":1674822398},{"type":"v1","addr":"172.21.15.1:6841","nonce":1674822398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3122570659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3122570659},{"type":"v1","addr":"172.21.15.12:6833","nonce":3122570659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2901262900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2901262900},{"type":"v1","addr":"172.21.15.12:6835","nonce":2901262900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:22:51.743282+0000","modified":"2024-09-15T22:27:43.369266+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24538,"mds_1":24524,"mds_2":24520},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/94050093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":94050093},{"type":"v1","addr":"172.21.15.98:6833","nonce":94050093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6837/2378138381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2378138381},{"type":"v1","addr":"172.21.15.12:6837","nonce":2378138381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1848806705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1848806705},{"type":"v1","addr":"172.21.15.98:6835","nonce":1848806705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24520":{"gid":24520,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.98:6837/493594054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":493594054},{"type":"v1","addr":"172.21.15.98:6837","nonce":493594054}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.12:6839/1469511155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":1469511155},{"type":"v1","addr":"172.21.15.12:6839","nonce":1469511155}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.98:6839/2831161859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2831161859},{"type":"v1","addr":"172.21.15.98:6839","nonce":2831161859}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24538,"qdb_cluster":[24538,24524,24520]},"id":1}]} 2024-09-15T22:28:28.265 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 29 2024-09-15T22:28:28.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.265+0000 7f8387200640 1 -- 172.21.15.1:0/185122800 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f83680a32c0 msgr2=0x7f83680a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:28.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.265+0000 7f8387200640 1 --2- 172.21.15.1:0/185122800 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f83680a32c0 0x7f83680a5780 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8374005fd0 tx=0x7f837400b480 comp rx=0 tx=0).stop 2024-09-15T22:28:28.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.265+0000 7f8387200640 1 -- 172.21.15.1:0/185122800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8380077040 msgr2=0x7f83801a4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:28.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.265+0000 7f8387200640 1 --2- 172.21.15.1:0/185122800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8380077040 0x7f83801a4b80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f837000e9f0 tx=0x7f837000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:28:28.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.265+0000 7f8387200640 1 -- 172.21.15.1:0/185122800 shutdown_connections 2024-09-15T22:28:28.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.265+0000 7f8387200640 1 --2- 172.21.15.1:0/185122800 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f83680a32c0 0x7f83680a5780 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:28.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.265+0000 7f8387200640 1 --2- 172.21.15.1:0/185122800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8380112870 0x7f838019e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:28.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.265+0000 7f8387200640 1 --2- 172.21.15.1:0/185122800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8380077040 0x7f83801a4b80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:28.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.265+0000 7f8387200640 1 --2- 172.21.15.1:0/185122800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8380076720 0x7f83801a4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:28.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.265+0000 7f8387200640 1 -- 172.21.15.1:0/185122800 >> 172.21.15.1:0/185122800 conn(0x7f83800ff8d0 msgr2=0x7f8380101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:28:28.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.266+0000 7f8387200640 1 -- 172.21.15.1:0/185122800 shutdown_connections 2024-09-15T22:28:28.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:28.266+0000 7f8387200640 1 -- 172.21.15.1:0/185122800 wait complete. 2024-09-15T22:28:28.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:28 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/185122800' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:28:28.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:28 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/185122800' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:28:28.814 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:28 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/185122800' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:28:29.266 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:28:29.648 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:28:29.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:29 smithi012 ceph-mon[34883]: pgmap v464: 97 pgs: 97 active+clean; 90 MiB data, 898 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-15T22:28:29.787 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:29 smithi001 ceph-mon[30843]: pgmap v464: 97 pgs: 97 active+clean; 90 MiB data, 898 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-15T22:28:29.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:29 smithi098 ceph-mon[35514]: pgmap v464: 97 pgs: 97 active+clean; 90 MiB data, 898 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-15T22:28:30.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.225+0000 7f3ea8e00640 1 -- 172.21.15.1:0/1771005162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ea41019c0 msgr2=0x7f3ea4101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:30.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.225+0000 7f3ea8e00640 1 --2- 172.21.15.1:0/1771005162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ea41019c0 0x7f3ea4101e20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009930 tx=0x7f3e9002a420 comp rx=0 tx=0).stop 2024-09-15T22:28:30.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.225+0000 7f3ea8e00640 1 -- 172.21.15.1:0/1771005162 shutdown_connections 2024-09-15T22:28:30.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.225+0000 7f3ea8e00640 1 --2- 172.21.15.1:0/1771005162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ea4102360 0x7f3ea410e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:30.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.225+0000 7f3ea8e00640 1 --2- 172.21.15.1:0/1771005162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ea41019c0 0x7f3ea4101e20 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:30.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.225+0000 7f3ea8e00640 1 --2- 172.21.15.1:0/1771005162 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ea41079c0 0x7f3ea4107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:30.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.225+0000 7f3ea8e00640 1 -- 172.21.15.1:0/1771005162 >> 172.21.15.1:0/1771005162 conn(0x7f3ea40fd740 msgr2=0x7f3ea40ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:28:30.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.225+0000 7f3ea8e00640 1 -- 172.21.15.1:0/1771005162 shutdown_connections 2024-09-15T22:28:30.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.225+0000 7f3ea8e00640 1 -- 172.21.15.1:0/1771005162 wait complete. 2024-09-15T22:28:30.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.226+0000 7f3ea8e00640 1 Processor -- start 2024-09-15T22:28:30.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.226+0000 7f3ea8e00640 1 -- start start 2024-09-15T22:28:30.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.226+0000 7f3ea8e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ea41019c0 0x7f3ea419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:30.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.226+0000 7f3ea8e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ea4102360 0x7f3ea419a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:30.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.227+0000 7f3ea8e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ea41079c0 0x7f3ea419ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:30.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.227+0000 7f3ea8e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea4111e10 con 0x7f3ea41019c0 2024-09-15T22:28:30.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.227+0000 7f3ea8e00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea4111c90 con 0x7f3ea41079c0 2024-09-15T22:28:30.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.227+0000 7f3ea8e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea4111f90 con 0x7f3ea4102360 2024-09-15T22:28:30.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.227+0000 7f3ea3400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ea41019c0 0x7f3ea419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:30.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.227+0000 7f3ea3400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ea41019c0 0x7f3ea419a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48156/0 (socket says 172.21.15.1:48156) 2024-09-15T22:28:30.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.227+0000 7f3ea3400640 1 -- 172.21.15.1:0/1091877502 learned_addr learned my addr 172.21.15.1:0/1091877502 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:28:30.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.227+0000 7f3ea2a00640 1 --2- 172.21.15.1:0/1091877502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ea4102360 0x7f3ea419a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:30.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.227+0000 7f3ea3e00640 1 --2- 172.21.15.1:0/1091877502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ea41079c0 0x7f3ea419ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:30.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.227+0000 7f3ea3400640 1 -- 172.21.15.1:0/1091877502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ea4102360 msgr2=0x7f3ea419a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:30.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.227+0000 7f3ea3400640 1 --2- 172.21.15.1:0/1091877502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ea4102360 0x7f3ea419a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:30.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.227+0000 7f3ea3400640 1 -- 172.21.15.1:0/1091877502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ea41079c0 msgr2=0x7f3ea419ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:30.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.227+0000 7f3ea3400640 1 --2- 172.21.15.1:0/1091877502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ea41079c0 0x7f3ea419ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:30.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.227+0000 7f3ea3400640 1 -- 172.21.15.1:0/1091877502 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ea419f460 con 0x7f3ea41019c0 2024-09-15T22:28:30.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.227+0000 7f3ea2a00640 1 --2- 172.21.15.1:0/1091877502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ea4102360 0x7f3ea419a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:28:30.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.227+0000 7f3ea3e00640 1 --2- 172.21.15.1:0/1091877502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ea41079c0 0x7f3ea419ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:28:30.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.227+0000 7f3ea3400640 1 --2- 172.21.15.1:0/1091877502 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ea41019c0 0x7f3ea419a4b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3e9400e9f0 tx=0x7f3e9400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:28:30.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.228+0000 7f3e9be00640 1 -- 172.21.15.1:0/1091877502 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9400cd80 con 0x7f3ea41019c0 2024-09-15T22:28:30.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.228+0000 7f3e9be00640 1 -- 172.21.15.1:0/1091877502 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e94010910 con 0x7f3ea41019c0 2024-09-15T22:28:30.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.228+0000 7f3e9be00640 1 -- 172.21.15.1:0/1091877502 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e94018990 con 0x7f3ea41019c0 2024-09-15T22:28:30.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.228+0000 7f3ea8e00640 1 -- 172.21.15.1:0/1091877502 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ea419f750 con 0x7f3ea41019c0 2024-09-15T22:28:30.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.228+0000 7f3ea8e00640 1 -- 172.21.15.1:0/1091877502 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ea41a7030 con 0x7f3ea41019c0 2024-09-15T22:28:30.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.229+0000 7f3ea8e00640 1 -- 172.21.15.1:0/1091877502 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ea4101e20 con 0x7f3ea41019c0 2024-09-15T22:28:30.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.231+0000 7f3e9be00640 1 -- 172.21.15.1:0/1091877502 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f3e94010ac0 con 0x7f3ea41019c0 2024-09-15T22:28:30.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.232+0000 7f3e9be00640 1 --2- 172.21.15.1:0/1091877502 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3e880a3240 0x7f3e880a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:30.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.232+0000 7f3e9be00640 1 -- 172.21.15.1:0/1091877502 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7f3e940d01c0 con 0x7f3ea41019c0 2024-09-15T22:28:30.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.233+0000 7f3ea2a00640 1 --2- 172.21.15.1:0/1091877502 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3e880a3240 0x7f3e880a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:30.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.233+0000 7f3ea2a00640 1 --2- 172.21.15.1:0/1091877502 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3e880a3240 0x7f3e880a5700 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3e90006010 tx=0x7f3e90005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:28:30.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.235+0000 7f3e9be00640 1 -- 172.21.15.1:0/1091877502 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3e9409ce20 con 0x7f3ea41019c0 2024-09-15T22:28:30.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.423+0000 7f3ea8e00640 1 -- 172.21.15.1:0/1091877502 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3ea41a72d0 con 0x7f3ea41019c0 2024-09-15T22:28:30.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.424+0000 7f3e9be00640 1 -- 172.21.15.1:0/1091877502 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+22787 (secure 0 0 0) 0x7f3e9409c720 con 0x7f3ea41019c0 2024-09-15T22:28:30.425 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T22:28:30.426 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":86,"fsid":"c1228c44-73af-11ef-bceb-c7b262605968","created":"2024-09-15T22:14:39.004556+0000","modified":"2024-09-15T22:24:33.423260+0000","last_up_change":"2024-09-15T22:21:53.270221+0000","last_in_change":"2024-09-15T22:21:30.911945+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:17:56.059390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:22:47.262081+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:22:49.746577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28228d47-bbb7-4103-a4fb-3e126769f8bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6803","nonce":3588868833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6805","nonce":3588868833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6809","nonce":3588868833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":3588868833},{"type":"v1","addr":"172.21.15.1:6807","nonce":3588868833}]},"public_addr":"172.21.15.1:6803/3588868833","cluster_addr":"172.21.15.1:6805/3588868833","heartbeat_back_addr":"172.21.15.1:6809/3588868833","heartbeat_front_addr":"172.21.15.1:6807/3588868833","state":["exists","up"]},{"osd":1,"uuid":"d90dd2c1-2047-4491-8730-30793a354aa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6801","nonce":3951165354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6803","nonce":3951165354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6807","nonce":3951165354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3951165354},{"type":"v1","addr":"172.21.15.12:6805","nonce":3951165354}]},"public_addr":"172.21.15.12:6801/3951165354","cluster_addr":"172.21.15.12:6803/3951165354","heartbeat_back_addr":"172.21.15.12:6807/3951165354","heartbeat_front_addr":"172.21.15.12:6805/3951165354","state":["exists","up"]},{"osd":2,"uuid":"22e38f44-88d3-4461-a57e-6dc4857ec48f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6801","nonce":1633982971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6803","nonce":1633982971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6807","nonce":1633982971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1633982971},{"type":"v1","addr":"172.21.15.98:6805","nonce":1633982971}]},"public_addr":"172.21.15.98:6801/1633982971","cluster_addr":"172.21.15.98:6803/1633982971","heartbeat_back_addr":"172.21.15.98:6807/1633982971","heartbeat_front_addr":"172.21.15.98:6805/1633982971","state":["exists","up"]},{"osd":3,"uuid":"dd9d6e97-af81-442a-ac0d-543e440a8d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6811","nonce":3706738461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6813","nonce":3706738461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6817","nonce":3706738461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3706738461},{"type":"v1","addr":"172.21.15.1:6815","nonce":3706738461}]},"public_addr":"172.21.15.1:6811/3706738461","cluster_addr":"172.21.15.1:6813/3706738461","heartbeat_back_addr":"172.21.15.1:6817/3706738461","heartbeat_front_addr":"172.21.15.1:6815/3706738461","state":["exists","up"]},{"osd":4,"uuid":"50116baa-dd99-4dbb-a7a1-2268f04052f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6809","nonce":4057902964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6811","nonce":4057902964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6815","nonce":4057902964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":4057902964},{"type":"v1","addr":"172.21.15.12:6813","nonce":4057902964}]},"public_addr":"172.21.15.12:6809/4057902964","cluster_addr":"172.21.15.12:6811/4057902964","heartbeat_back_addr":"172.21.15.12:6815/4057902964","heartbeat_front_addr":"172.21.15.12:6813/4057902964","state":["exists","up"]},{"osd":5,"uuid":"56ab0694-2f21-46c4-a086-44f72c271c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6809","nonce":4043567619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6811","nonce":4043567619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6815","nonce":4043567619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4043567619},{"type":"v1","addr":"172.21.15.98:6813","nonce":4043567619}]},"public_addr":"172.21.15.98:6809/4043567619","cluster_addr":"172.21.15.98:6811/4043567619","heartbeat_back_addr":"172.21.15.98:6815/4043567619","heartbeat_front_addr":"172.21.15.98:6813/4043567619","state":["exists","up"]},{"osd":6,"uuid":"5ca0d114-4894-428e-bcd3-2ebd24d10a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6819","nonce":2236861161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6821","nonce":2236861161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6825","nonce":2236861161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2236861161},{"type":"v1","addr":"172.21.15.1:6823","nonce":2236861161}]},"public_addr":"172.21.15.1:6819/2236861161","cluster_addr":"172.21.15.1:6821/2236861161","heartbeat_back_addr":"172.21.15.1:6825/2236861161","heartbeat_front_addr":"172.21.15.1:6823/2236861161","state":["exists","up"]},{"osd":7,"uuid":"db99cc6e-1717-4958-bf11-65aca94476b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6817","nonce":133202448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6819","nonce":133202448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6823","nonce":133202448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":133202448},{"type":"v1","addr":"172.21.15.12:6821","nonce":133202448}]},"public_addr":"172.21.15.12:6817/133202448","cluster_addr":"172.21.15.12:6819/133202448","heartbeat_back_addr":"172.21.15.12:6823/133202448","heartbeat_front_addr":"172.21.15.12:6821/133202448","state":["exists","up"]},{"osd":8,"uuid":"4d3b6574-49f7-47f6-b36b-4da14ca290f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6817","nonce":3701478409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6819","nonce":3701478409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6823","nonce":3701478409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3701478409},{"type":"v1","addr":"172.21.15.98:6821","nonce":3701478409}]},"public_addr":"172.21.15.98:6817/3701478409","cluster_addr":"172.21.15.98:6819/3701478409","heartbeat_back_addr":"172.21.15.98:6823/3701478409","heartbeat_front_addr":"172.21.15.98:6821/3701478409","state":["exists","up"]},{"osd":9,"uuid":"7dd2fe25-1b75-48e5-86c7-c7a3ab85053f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6827","nonce":2580755002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6829","nonce":2580755002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6833","nonce":2580755002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":2580755002},{"type":"v1","addr":"172.21.15.1:6831","nonce":2580755002}]},"public_addr":"172.21.15.1:6827/2580755002","cluster_addr":"172.21.15.1:6829/2580755002","heartbeat_back_addr":"172.21.15.1:6833/2580755002","heartbeat_front_addr":"172.21.15.1:6831/2580755002","state":["exists","up"]},{"osd":10,"uuid":"fcad11dc-0a1b-44a2-ac32-74100e317255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6825","nonce":3989063573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6827","nonce":3989063573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6831","nonce":3989063573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3989063573},{"type":"v1","addr":"172.21.15.12:6829","nonce":3989063573}]},"public_addr":"172.21.15.12:6825/3989063573","cluster_addr":"172.21.15.12:6827/3989063573","heartbeat_back_addr":"172.21.15.12:6831/3989063573","heartbeat_front_addr":"172.21.15.12:6829/3989063573","state":["exists","up"]},{"osd":11,"uuid":"f4e717bb-586d-4fe2-9e6b-f574be4db36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6825","nonce":839956167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6827","nonce":839956167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6831","nonce":839956167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":839956167},{"type":"v1","addr":"172.21.15.98:6829","nonce":839956167}]},"public_addr":"172.21.15.98:6825/839956167","cluster_addr":"172.21.15.98:6827/839956167","heartbeat_back_addr":"172.21.15.98:6831/839956167","heartbeat_front_addr":"172.21.15.98:6829/839956167","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:17:01.990618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:17:28.259003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:17:52.825080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:18:22.724038+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:18:48.383663+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:19:13.246563+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:19:42.318469+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:20:08.809160+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:20:32.628925+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:21:02.280217+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:21:27.897758+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:21:52.055015+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":1,"to":2}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6800/3145051160":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/3101438101":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/4159811089":"2024-09-16T22:15:31.433375+0000","172.21.15.1:6801/3145051160":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/2785155592":"2024-09-16T22:15:31.433375+0000","172.21.15.1:0/714180295":"2024-09-16T22:15:03.937536+0000","172.21.15.1:6801/215291238":"2024-09-16T22:15:03.937536+0000","172.21.15.1:6800/215291238":"2024-09-16T22:15:03.937536+0000","172.21.15.1:0/1842817732":"2024-09-16T22:15:03.937536+0000","172.21.15.1:0/3888009741":"2024-09-16T22:15:03.937536+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:28:30.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.427+0000 7f3ea8e00640 1 -- 172.21.15.1:0/1091877502 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3e880a3240 msgr2=0x7f3e880a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:30.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.427+0000 7f3ea8e00640 1 --2- 172.21.15.1:0/1091877502 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3e880a3240 0x7f3e880a5700 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3e90006010 tx=0x7f3e90005a20 comp rx=0 tx=0).stop 2024-09-15T22:28:30.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.427+0000 7f3ea8e00640 1 -- 172.21.15.1:0/1091877502 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ea41019c0 msgr2=0x7f3ea419a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:30.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.427+0000 7f3ea8e00640 1 --2- 172.21.15.1:0/1091877502 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ea41019c0 0x7f3ea419a4b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3e9400e9f0 tx=0x7f3e9400eeb0 comp rx=0 tx=0).stop 2024-09-15T22:28:30.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.427+0000 7f3ea8e00640 1 -- 172.21.15.1:0/1091877502 shutdown_connections 2024-09-15T22:28:30.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.427+0000 7f3ea8e00640 1 --2- 172.21.15.1:0/1091877502 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f3e880a3240 0x7f3e880a5700 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:30.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.427+0000 7f3ea8e00640 1 --2- 172.21.15.1:0/1091877502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ea41079c0 0x7f3ea419ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:30.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.427+0000 7f3ea8e00640 1 --2- 172.21.15.1:0/1091877502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ea4102360 0x7f3ea419a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:30.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.427+0000 7f3ea8e00640 1 --2- 172.21.15.1:0/1091877502 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ea41019c0 0x7f3ea419a4b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:30.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.427+0000 7f3ea8e00640 1 -- 172.21.15.1:0/1091877502 >> 172.21.15.1:0/1091877502 conn(0x7f3ea40fd740 msgr2=0x7f3ea410d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:28:30.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.427+0000 7f3ea8e00640 1 -- 172.21.15.1:0/1091877502 shutdown_connections 2024-09-15T22:28:30.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:30.427+0000 7f3ea8e00640 1 -- 172.21.15.1:0/1091877502 wait complete. 2024-09-15T22:28:30.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:30 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/1091877502' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:28:30.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:30 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/1091877502' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:28:30.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:30 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/1091877502' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:28:31.309 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-15T22:28:31.625 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:31 smithi001 ceph-mon[30843]: pgmap v465: 97 pgs: 97 active+clean; 90 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-15T22:28:31.700 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:28:31.745 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:31 smithi012 ceph-mon[34883]: pgmap v465: 97 pgs: 97 active+clean; 90 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-15T22:28:31.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:31 smithi098 ceph-mon[35514]: pgmap v465: 97 pgs: 97 active+clean; 90 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-15T22:28:32.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.264+0000 7fb54c400640 1 -- 172.21.15.1:0/1903333052 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb544112a30 msgr2=0x7fb544114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:32.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.264+0000 7fb54c400640 1 --2- 172.21.15.1:0/1903333052 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb544112a30 0x7fb544114e20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb53c009be0 tx=0x7fb53c02a6c0 comp rx=0 tx=0).stop 2024-09-15T22:28:32.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.264+0000 7fb54c400640 1 -- 172.21.15.1:0/1903333052 shutdown_connections 2024-09-15T22:28:32.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.264+0000 7fb54c400640 1 --2- 172.21.15.1:0/1903333052 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb544112a30 0x7fb544114e20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:32.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.264+0000 7fb54c400640 1 --2- 172.21.15.1:0/1903333052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb544077040 0x7fb5441124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:32.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.264+0000 7fb54c400640 1 --2- 172.21.15.1:0/1903333052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb544076720 0x7fb544076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:32.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.264+0000 7fb54c400640 1 -- 172.21.15.1:0/1903333052 >> 172.21.15.1:0/1903333052 conn(0x7fb5440ffa90 msgr2=0x7fb544101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:28:32.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.265+0000 7fb54c400640 1 -- 172.21.15.1:0/1903333052 shutdown_connections 2024-09-15T22:28:32.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.265+0000 7fb54c400640 1 -- 172.21.15.1:0/1903333052 wait complete. 2024-09-15T22:28:32.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.266+0000 7fb54c400640 1 Processor -- start 2024-09-15T22:28:32.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.266+0000 7fb54c400640 1 -- start start 2024-09-15T22:28:32.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.266+0000 7fb54c400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb544076720 0x7fb5441a4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:32.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.266+0000 7fb54c400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb544077040 0x7fb5441a4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:32.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.266+0000 7fb54c400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb544112a30 0x7fb54419e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:32.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.266+0000 7fb54c400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb544118520 con 0x7fb544112a30 2024-09-15T22:28:32.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.266+0000 7fb54c400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb5441183a0 con 0x7fb544077040 2024-09-15T22:28:32.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.266+0000 7fb54c400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb5441186a0 con 0x7fb544076720 2024-09-15T22:28:32.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.266+0000 7fb54a400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb544112a30 0x7fb54419e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:32.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.266+0000 7fb54a400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb544112a30 0x7fb54419e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48164/0 (socket says 172.21.15.1:48164) 2024-09-15T22:28:32.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.266+0000 7fb549a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb544076720 0x7fb5441a4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:32.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.266+0000 7fb549000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb544077040 0x7fb5441a4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:32.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.266+0000 7fb54a400640 1 -- 172.21.15.1:0/2705704763 learned_addr learned my addr 172.21.15.1:0/2705704763 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:28:32.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.267+0000 7fb549000640 1 -- 172.21.15.1:0/2705704763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb544076720 msgr2=0x7fb5441a4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:32.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.267+0000 7fb549000640 1 --2- 172.21.15.1:0/2705704763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb544076720 0x7fb5441a4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:32.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.267+0000 7fb549000640 1 -- 172.21.15.1:0/2705704763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb544112a30 msgr2=0x7fb54419e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:32.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.267+0000 7fb549000640 1 --2- 172.21.15.1:0/2705704763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb544112a30 0x7fb54419e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:32.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.267+0000 7fb549000640 1 -- 172.21.15.1:0/2705704763 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb54419f020 con 0x7fb544077040 2024-09-15T22:28:32.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.267+0000 7fb549000640 1 --2- 172.21.15.1:0/2705704763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb544077040 0x7fb5441a4c70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb53000e9f0 tx=0x7fb53000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:28:32.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.267+0000 7fb542000640 1 -- 172.21.15.1:0/2705704763 <== mon.2 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb53000ccc0 con 0x7fb544077040 2024-09-15T22:28:32.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.268+0000 7fb54c400640 1 -- 172.21.15.1:0/2705704763 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb54419f310 con 0x7fb544077040 2024-09-15T22:28:32.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.268+0000 7fb542000640 1 -- 172.21.15.1:0/2705704763 <== mon.2 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb530010910 con 0x7fb544077040 2024-09-15T22:28:32.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.268+0000 7fb542000640 1 -- 172.21.15.1:0/2705704763 <== mon.2 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb530018790 con 0x7fb544077040 2024-09-15T22:28:32.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.268+0000 7fb54c400640 1 -- 172.21.15.1:0/2705704763 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5441ab600 con 0x7fb544077040 2024-09-15T22:28:32.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.269+0000 7fb54c400640 1 -- 172.21.15.1:0/2705704763 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb544076b00 con 0x7fb544077040 2024-09-15T22:28:32.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.271+0000 7fb542000640 1 -- 172.21.15.1:0/2705704763 <== mon.2 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fb530010ac0 con 0x7fb544077040 2024-09-15T22:28:32.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.272+0000 7fb542000640 1 --2- 172.21.15.1:0/2705704763 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb52c0a32c0 0x7fb52c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:32.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.272+0000 7fb542000640 1 -- 172.21.15.1:0/2705704763 <== mon.2 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8335+0+0 (secure 0 0 0) 0x7fb5300cfc90 con 0x7fb544077040 2024-09-15T22:28:32.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.272+0000 7fb549a00640 1 --2- 172.21.15.1:0/2705704763 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb52c0a32c0 0x7fb52c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:32.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.273+0000 7fb549a00640 1 --2- 172.21.15.1:0/2705704763 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb52c0a32c0 0x7fb52c0a5780 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb54419fa30 tx=0x7fb538009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:28:32.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.276+0000 7fb542000640 1 -- 172.21.15.1:0/2705704763 <== mon.2 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb53009c8f0 con 0x7fb544077040 2024-09-15T22:28:32.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.503+0000 7fb54c400640 1 -- 172.21.15.1:0/2705704763 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb54419fe20 con 0x7fb544077040 2024-09-15T22:28:32.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.511+0000 7fb542000640 1 -- 172.21.15.1:0/2705704763 <== mon.2 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v30) ==== 161+0+0 (secure 0 0 0) 0x7fb53009c1f0 con 0x7fb544077040 2024-09-15T22:28:32.512 INFO:teuthology.orchestra.run.smithi001.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T22:28:32.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.513+0000 7fb54c400640 1 -- 172.21.15.1:0/2705704763 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb52c0a32c0 msgr2=0x7fb52c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:32.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.513+0000 7fb54c400640 1 --2- 172.21.15.1:0/2705704763 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb52c0a32c0 0x7fb52c0a5780 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb54419fa30 tx=0x7fb538009260 comp rx=0 tx=0).stop 2024-09-15T22:28:32.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.513+0000 7fb54c400640 1 -- 172.21.15.1:0/2705704763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb544077040 msgr2=0x7fb5441a4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:32.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.513+0000 7fb54c400640 1 --2- 172.21.15.1:0/2705704763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb544077040 0x7fb5441a4c70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb53000e9f0 tx=0x7fb53000edf0 comp rx=0 tx=0).stop 2024-09-15T22:28:32.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.513+0000 7fb54c400640 1 -- 172.21.15.1:0/2705704763 shutdown_connections 2024-09-15T22:28:32.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.513+0000 7fb54c400640 1 --2- 172.21.15.1:0/2705704763 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7fb52c0a32c0 0x7fb52c0a5780 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:32.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.513+0000 7fb54c400640 1 --2- 172.21.15.1:0/2705704763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb544112a30 0x7fb54419e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:32.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.513+0000 7fb54c400640 1 --2- 172.21.15.1:0/2705704763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb544077040 0x7fb5441a4c70 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:32.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.513+0000 7fb54c400640 1 --2- 172.21.15.1:0/2705704763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb544076720 0x7fb5441a4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:32.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.513+0000 7fb54c400640 1 -- 172.21.15.1:0/2705704763 >> 172.21.15.1:0/2705704763 conn(0x7fb5440ffa90 msgr2=0x7fb544101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:28:32.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.514+0000 7fb54c400640 1 -- 172.21.15.1:0/2705704763 shutdown_connections 2024-09-15T22:28:32.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:32.514+0000 7fb54c400640 1 -- 172.21.15.1:0/2705704763 wait complete. 2024-09-15T22:28:32.811 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 15 22:28:32 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-f[65458]: ignoring --setuser ceph since I am not root 2024-09-15T22:28:32.811 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 15 22:28:32 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-f[65458]: ignoring --setgroup ceph since I am not root 2024-09-15T22:28:32.811 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 15 22:28:32 smithi098 ceph-mds[65462]: -- 172.21.15.98:0/192172888 <== mon.1 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a868d15860 con 0x55a868cf3400 2024-09-15T22:28:32.811 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 15 22:28:32 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-f[65458]: starting mds.f at 2024-09-15T22:28:32.811 INFO:journalctl@ceph.mds.l.smithi098.stdout:Sep 15 22:28:32 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-l[65144]: ignoring --setuser ceph since I am not root 2024-09-15T22:28:32.811 INFO:journalctl@ceph.mds.l.smithi098.stdout:Sep 15 22:28:32 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-l[65144]: ignoring --setgroup ceph since I am not root 2024-09-15T22:28:32.811 INFO:journalctl@ceph.mds.l.smithi098.stdout:Sep 15 22:28:32 smithi098 ceph-mds[65148]: -- 172.21.15.98:0/1273834865 <== mon.1 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d680c4dc20 con 0x55d680c2b000 2024-09-15T22:28:32.812 INFO:journalctl@ceph.mds.l.smithi098.stdout:Sep 15 22:28:32 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-l[65144]: starting mds.l at 2024-09-15T22:28:32.812 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 15 22:28:32 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-c[65758]: ignoring --setuser ceph since I am not root 2024-09-15T22:28:32.812 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 15 22:28:32 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-c[65758]: ignoring --setgroup ceph since I am not root 2024-09-15T22:28:32.812 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 15 22:28:32 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-c[65758]: starting mds.c at 2024-09-15T22:28:32.812 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 15 22:28:32 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-i[66060]: ignoring --setuser ceph since I am not root 2024-09-15T22:28:32.812 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 15 22:28:32 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-i[66060]: ignoring --setgroup ceph since I am not root 2024-09-15T22:28:32.812 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 15 22:28:32 smithi098 ceph-mds[66064]: -- 172.21.15.98:0/3320006984 <== mon.1 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5619058d1860 con 0x5619058af000 2024-09-15T22:28:32.813 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 15 22:28:32 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-i[66060]: starting mds.i at 2024-09-15T22:28:32.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:32 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mon-a[30839]: 2024-09-15T22:28:32.504+0000 7fbde5c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:28:32.996 INFO:journalctl@ceph.mds.b.smithi012.stdout:Sep 15 22:28:32 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-b[65028]: ignoring --setuser ceph since I am not root 2024-09-15T22:28:32.996 INFO:journalctl@ceph.mds.b.smithi012.stdout:Sep 15 22:28:32 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-b[65028]: ignoring --setgroup ceph since I am not root 2024-09-15T22:28:32.996 INFO:journalctl@ceph.mds.b.smithi012.stdout:Sep 15 22:28:32 smithi012 ceph-mds[65032]: -- 172.21.15.12:0/3864942698 <== mon.2 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55eba41af860 con 0x55eba418d400 2024-09-15T22:28:32.996 INFO:journalctl@ceph.mds.b.smithi012.stdout:Sep 15 22:28:32 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-b[65028]: starting mds.b at 2024-09-15T22:28:32.996 INFO:journalctl@ceph.mds.h.smithi012.stdout:Sep 15 22:28:32 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-h[64726]: ignoring --setuser ceph since I am not root 2024-09-15T22:28:32.997 INFO:journalctl@ceph.mds.h.smithi012.stdout:Sep 15 22:28:32 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-h[64726]: ignoring --setgroup ceph since I am not root 2024-09-15T22:28:32.997 INFO:journalctl@ceph.mds.h.smithi012.stdout:Sep 15 22:28:32 smithi012 ceph-mds[64730]: -- 172.21.15.12:0/3008488407 <== mon.2 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5600596fbc20 con 0x5600596d8800 2024-09-15T22:28:32.997 INFO:journalctl@ceph.mds.h.smithi012.stdout:Sep 15 22:28:32 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-h[64726]: starting mds.h at 2024-09-15T22:28:33.350 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T22:28:33.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:33 smithi001 ceph-mon[30843]: pgmap v466: 97 pgs: 97 active+clean; 90 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-15T22:28:33.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:33 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/2705704763' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-15T22:28:33.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:33 smithi001 ceph-mon[30843]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-15T22:28:33.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:33 smithi001 ceph-mon[30843]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-15T22:28:33.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:33 smithi001 ceph-mon[30843]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:28:33.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:33 smithi001 ceph-mon[30843]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-15T22:28:33.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:33 smithi001 ceph-mon[30843]: osdmap e87: 12 total, 12 up, 12 in 2024-09-15T22:28:33.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:33 smithi001 ceph-mon[30843]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-15T22:28:33.733 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:28:33.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:33 smithi098 ceph-mon[35514]: pgmap v466: 97 pgs: 97 active+clean; 90 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-15T22:28:33.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:33 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/2705704763' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-15T22:28:33.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:33 smithi098 ceph-mon[35514]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-15T22:28:33.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:33 smithi098 ceph-mon[35514]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-15T22:28:33.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:33 smithi098 ceph-mon[35514]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:28:33.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:33 smithi098 ceph-mon[35514]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-15T22:28:33.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:33 smithi098 ceph-mon[35514]: osdmap e87: 12 total, 12 up, 12 in 2024-09-15T22:28:33.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:33 smithi098 ceph-mon[35514]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-15T22:28:33.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:33 smithi012 ceph-mon[34883]: pgmap v466: 97 pgs: 97 active+clean; 90 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-15T22:28:33.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:33 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/2705704763' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-15T22:28:33.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:33 smithi012 ceph-mon[34883]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-15T22:28:33.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:33 smithi012 ceph-mon[34883]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-15T22:28:33.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:33 smithi012 ceph-mon[34883]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:28:33.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:33 smithi012 ceph-mon[34883]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-15T22:28:33.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:33 smithi012 ceph-mon[34883]: osdmap e87: 12 total, 12 up, 12 in 2024-09-15T22:28:33.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:33 smithi012 ceph-mon[34883]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-15T22:28:34.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.339+0000 7f3428a00640 1 -- 172.21.15.1:0/3353111257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34241047e0 msgr2=0x7f3424108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:34.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.339+0000 7f3428a00640 1 --2- 172.21.15.1:0/3353111257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34241047e0 0x7f3424108830 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f340c009900 tx=0x7f340c02a410 comp rx=0 tx=0).stop 2024-09-15T22:28:34.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.339+0000 7f3428a00640 1 -- 172.21.15.1:0/3353111257 shutdown_connections 2024-09-15T22:28:34.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.339+0000 7f3428a00640 1 --2- 172.21.15.1:0/3353111257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3424108f60 0x7f3424110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:34.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.339+0000 7f3428a00640 1 --2- 172.21.15.1:0/3353111257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34241047e0 0x7f3424108830 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:34.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.339+0000 7f3428a00640 1 --2- 172.21.15.1:0/3353111257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3424103e30 0x7f3424104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:34.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.339+0000 7f3428a00640 1 -- 172.21.15.1:0/3353111257 >> 172.21.15.1:0/3353111257 conn(0x7f34240ff8d0 msgr2=0x7f3424101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:28:34.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.339+0000 7f3428a00640 1 -- 172.21.15.1:0/3353111257 shutdown_connections 2024-09-15T22:28:34.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.339+0000 7f3428a00640 1 -- 172.21.15.1:0/3353111257 wait complete. 2024-09-15T22:28:34.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.340+0000 7f3428a00640 1 Processor -- start 2024-09-15T22:28:34.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.340+0000 7f3428a00640 1 -- start start 2024-09-15T22:28:34.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.340+0000 7f3428a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3424103e30 0x7f342419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:34.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.341+0000 7f3428a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34241047e0 0x7f342419a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:34.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.341+0000 7f3428a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3424108f60 0x7f342419ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:34.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.341+0000 7f3428a00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3424113fc0 con 0x7f34241047e0 2024-09-15T22:28:34.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.341+0000 7f3428a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3424113e40 con 0x7f3424103e30 2024-09-15T22:28:34.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.341+0000 7f3428a00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3424114140 con 0x7f3424108f60 2024-09-15T22:28:34.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.341+0000 7f3419e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34241047e0 0x7f342419a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:34.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.341+0000 7f3419e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34241047e0 0x7f342419a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48190/0 (socket says 172.21.15.1:48190) 2024-09-15T22:28:34.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.341+0000 7f3419e00640 1 -- 172.21.15.1:0/3002537551 learned_addr learned my addr 172.21.15.1:0/3002537551 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:28:34.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.341+0000 7f3422800640 1 --2- 172.21.15.1:0/3002537551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3424103e30 0x7f342419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:34.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.341+0000 7f3423200640 1 --2- 172.21.15.1:0/3002537551 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3424108f60 0x7f342419ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:34.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.341+0000 7f3419e00640 1 -- 172.21.15.1:0/3002537551 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3424108f60 msgr2=0x7f342419ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:34.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.341+0000 7f3419e00640 1 --2- 172.21.15.1:0/3002537551 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3424108f60 0x7f342419ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:34.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.341+0000 7f3419e00640 1 -- 172.21.15.1:0/3002537551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3424103e30 msgr2=0x7f342419a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:34.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.341+0000 7f3419e00640 1 --2- 172.21.15.1:0/3002537551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3424103e30 0x7f342419a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:34.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.341+0000 7f3419e00640 1 -- 172.21.15.1:0/3002537551 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f342419f410 con 0x7f34241047e0 2024-09-15T22:28:34.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.341+0000 7f3423200640 1 --2- 172.21.15.1:0/3002537551 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3424108f60 0x7f342419ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:28:34.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.342+0000 7f3419e00640 1 --2- 172.21.15.1:0/3002537551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34241047e0 0x7f342419a9a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f340c006010 tx=0x7f340c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:28:34.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.342+0000 7f341be00640 1 -- 172.21.15.1:0/3002537551 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340c03f030 con 0x7f34241047e0 2024-09-15T22:28:34.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.342+0000 7f341be00640 1 -- 172.21.15.1:0/3002537551 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f340c004440 con 0x7f34241047e0 2024-09-15T22:28:34.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.342+0000 7f341be00640 1 -- 172.21.15.1:0/3002537551 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340c035070 con 0x7f34241047e0 2024-09-15T22:28:34.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.342+0000 7f3428a00640 1 -- 172.21.15.1:0/3002537551 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f342419f6a0 con 0x7f34241047e0 2024-09-15T22:28:34.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.342+0000 7f3428a00640 1 -- 172.21.15.1:0/3002537551 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f342419fb30 con 0x7f34241047e0 2024-09-15T22:28:34.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.343+0000 7f3428a00640 1 -- 172.21.15.1:0/3002537551 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3424104210 con 0x7f34241047e0 2024-09-15T22:28:34.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.345+0000 7f341be00640 1 -- 172.21.15.1:0/3002537551 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f340c042030 con 0x7f34241047e0 2024-09-15T22:28:34.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.346+0000 7f341be00640 1 --2- 172.21.15.1:0/3002537551 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f34080a32c0 0x7f34080a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:34.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.346+0000 7f341be00640 1 -- 172.21.15.1:0/3002537551 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8593+0+0 (secure 0 0 0) 0x7f340c0efe50 con 0x7f34241047e0 2024-09-15T22:28:34.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.347+0000 7f3422800640 1 --2- 172.21.15.1:0/3002537551 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f34080a32c0 0x7f34080a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:34.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.347+0000 7f3422800640 1 --2- 172.21.15.1:0/3002537551 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f34080a32c0 0x7f34080a5780 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3414005fd0 tx=0x7f3414009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:28:34.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.351+0000 7f341be00640 1 -- 172.21.15.1:0/3002537551 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f340c0bc9a0 con 0x7f34241047e0 2024-09-15T22:28:34.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:34.576+0000 7f3428a00640 1 -- 172.21.15.1:0/3002537551 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f342402d7c0 con 0x7f34241047e0 2024-09-15T22:28:34.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:34 smithi098 ceph-mon[35514]: mds.? [v2:172.21.15.12:6836/3917957844,v1:172.21.15.12:6838/3917957844] up:boot 2024-09-15T22:28:34.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:34 smithi098 ceph-mon[35514]: mds.? [v2:172.21.15.12:6837/2836428703,v1:172.21.15.12:6839/2836428703] up:boot 2024-09-15T22:28:34.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:34 smithi098 ceph-mon[35514]: mds.? [v2:172.21.15.98:6832/3099204151,v1:172.21.15.98:6833/3099204151] up:boot 2024-09-15T22:28:34.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:34 smithi098 ceph-mon[35514]: mds.? [v2:172.21.15.98:6834/599206578,v1:172.21.15.98:6835/599206578] up:boot 2024-09-15T22:28:34.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:34 smithi098 ceph-mon[35514]: mds.? [v2:172.21.15.98:6836/3942750633,v1:172.21.15.98:6837/3942750633] up:boot 2024-09-15T22:28:34.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:34 smithi098 ceph-mon[35514]: mds.? [v2:172.21.15.98:6838/3944364459,v1:172.21.15.98:6839/3944364459] up:boot 2024-09-15T22:28:34.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:34 smithi098 ceph-mon[35514]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-15T22:28:34.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:34 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T22:28:34.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:34 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T22:28:34.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:34 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T22:28:34.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:34 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T22:28:34.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:34 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T22:28:34.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:34 smithi098 ceph-mon[35514]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T22:28:34.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:34 smithi001 ceph-mon[30843]: mds.? [v2:172.21.15.12:6836/3917957844,v1:172.21.15.12:6838/3917957844] up:boot 2024-09-15T22:28:34.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:34 smithi001 ceph-mon[30843]: mds.? [v2:172.21.15.12:6837/2836428703,v1:172.21.15.12:6839/2836428703] up:boot 2024-09-15T22:28:34.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:34 smithi001 ceph-mon[30843]: mds.? [v2:172.21.15.98:6832/3099204151,v1:172.21.15.98:6833/3099204151] up:boot 2024-09-15T22:28:34.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:34 smithi001 ceph-mon[30843]: mds.? [v2:172.21.15.98:6834/599206578,v1:172.21.15.98:6835/599206578] up:boot 2024-09-15T22:28:34.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:34 smithi001 ceph-mon[30843]: mds.? [v2:172.21.15.98:6836/3942750633,v1:172.21.15.98:6837/3942750633] up:boot 2024-09-15T22:28:34.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:34 smithi001 ceph-mon[30843]: mds.? [v2:172.21.15.98:6838/3944364459,v1:172.21.15.98:6839/3944364459] up:boot 2024-09-15T22:28:34.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:34 smithi001 ceph-mon[30843]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-15T22:28:34.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:34 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T22:28:34.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:34 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T22:28:34.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:34 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T22:28:34.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:34 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T22:28:34.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:34 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T22:28:34.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:34 smithi001 ceph-mon[30843]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T22:28:34.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:34 smithi012 ceph-mon[34883]: mds.? [v2:172.21.15.12:6836/3917957844,v1:172.21.15.12:6838/3917957844] up:boot 2024-09-15T22:28:34.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:34 smithi012 ceph-mon[34883]: mds.? [v2:172.21.15.12:6837/2836428703,v1:172.21.15.12:6839/2836428703] up:boot 2024-09-15T22:28:34.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:34 smithi012 ceph-mon[34883]: mds.? [v2:172.21.15.98:6832/3099204151,v1:172.21.15.98:6833/3099204151] up:boot 2024-09-15T22:28:34.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:34 smithi012 ceph-mon[34883]: mds.? [v2:172.21.15.98:6834/599206578,v1:172.21.15.98:6835/599206578] up:boot 2024-09-15T22:28:34.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:34 smithi012 ceph-mon[34883]: mds.? [v2:172.21.15.98:6836/3942750633,v1:172.21.15.98:6837/3942750633] up:boot 2024-09-15T22:28:34.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:34 smithi012 ceph-mon[34883]: mds.? [v2:172.21.15.98:6838/3944364459,v1:172.21.15.98:6839/3944364459] up:boot 2024-09-15T22:28:34.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:34 smithi012 ceph-mon[34883]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-15T22:28:34.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:34 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T22:28:34.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:34 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T22:28:34.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:34 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T22:28:34.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:34 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T22:28:34.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:34 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T22:28:34.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:34 smithi012 ceph-mon[34883]: from='mgr.14150 172.21.15.1:0/1923902718' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T22:28:35.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:35.518+0000 7f341be00640 1 -- 172.21.15.1:0/3002537551 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) ==== 104+0+0 (secure 0 0 0) 0x7f340c0bc2a0 con 0x7f34241047e0 2024-09-15T22:28:35.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:35.521+0000 7f3428a00640 1 -- 172.21.15.1:0/3002537551 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f34080a32c0 msgr2=0x7f34080a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:35.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:35.521+0000 7f3428a00640 1 --2- 172.21.15.1:0/3002537551 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f34080a32c0 0x7f34080a5780 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3414005fd0 tx=0x7f3414009500 comp rx=0 tx=0).stop 2024-09-15T22:28:35.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:35.521+0000 7f3428a00640 1 -- 172.21.15.1:0/3002537551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34241047e0 msgr2=0x7f342419a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:35.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:35.521+0000 7f3428a00640 1 --2- 172.21.15.1:0/3002537551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34241047e0 0x7f342419a9a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f340c006010 tx=0x7f340c004040 comp rx=0 tx=0).stop 2024-09-15T22:28:35.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:35.522+0000 7f3428a00640 1 -- 172.21.15.1:0/3002537551 shutdown_connections 2024-09-15T22:28:35.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:35.522+0000 7f3428a00640 1 --2- 172.21.15.1:0/3002537551 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f34080a32c0 0x7f34080a5780 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:35.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:35.522+0000 7f3428a00640 1 --2- 172.21.15.1:0/3002537551 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3424108f60 0x7f342419ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:35.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:35.522+0000 7f3428a00640 1 --2- 172.21.15.1:0/3002537551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34241047e0 0x7f342419a9a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:35.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:35.522+0000 7f3428a00640 1 --2- 172.21.15.1:0/3002537551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3424103e30 0x7f342419a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:35.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:35.522+0000 7f3428a00640 1 -- 172.21.15.1:0/3002537551 >> 172.21.15.1:0/3002537551 conn(0x7f34240ff8d0 msgr2=0x7f3424100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:28:35.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:35.522+0000 7f3428a00640 1 -- 172.21.15.1:0/3002537551 shutdown_connections 2024-09-15T22:28:35.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:35.522+0000 7f3428a00640 1 -- 172.21.15.1:0/3002537551 wait complete. 2024-09-15T22:28:35.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:35 smithi098 ceph-mon[35514]: pgmap v468: 97 pgs: 97 active+clean; 90 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-15T22:28:35.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:35 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/3002537551' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:28:35.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:35 smithi001 ceph-mon[30843]: pgmap v468: 97 pgs: 97 active+clean; 90 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-15T22:28:35.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:35 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/3002537551' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:28:35.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:35 smithi012 ceph-mon[34883]: pgmap v468: 97 pgs: 97 active+clean; 90 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-15T22:28:35.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:35 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/3002537551' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:28:36.615 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T22:28:36.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:36 smithi098 ceph-mon[35514]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-15T22:28:36.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:36 smithi098 ceph-mon[35514]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-15T22:28:36.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:36 smithi098 ceph-mon[35514]: Cluster is now healthy 2024-09-15T22:28:36.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:36 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/3002537551' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-15T22:28:36.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:36 smithi098 ceph-mon[35514]: fsmap 12 up:standby 2024-09-15T22:28:36.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:36 smithi001 ceph-mon[30843]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-15T22:28:36.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:36 smithi001 ceph-mon[30843]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-15T22:28:36.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:36 smithi001 ceph-mon[30843]: Cluster is now healthy 2024-09-15T22:28:36.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:36 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/3002537551' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-15T22:28:36.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:36 smithi001 ceph-mon[30843]: fsmap 12 up:standby 2024-09-15T22:28:36.996 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:28:36.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:36 smithi012 ceph-mon[34883]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-15T22:28:36.997 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:36 smithi012 ceph-mon[34883]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-15T22:28:36.997 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:36 smithi012 ceph-mon[34883]: Cluster is now healthy 2024-09-15T22:28:36.997 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:36 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/3002537551' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-15T22:28:36.997 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:36 smithi012 ceph-mon[34883]: fsmap 12 up:standby 2024-09-15T22:28:37.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.575+0000 7f32ba800640 1 -- 172.21.15.1:0/1519511494 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32b4104010 msgr2=0x7f32b41043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:37.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.575+0000 7f32ba800640 1 --2- 172.21.15.1:0/1519511494 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32b4104010 0x7f32b41043f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f32a4009900 tx=0x7f32a402a410 comp rx=0 tx=0).stop 2024-09-15T22:28:37.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.575+0000 7f32ba800640 1 -- 172.21.15.1:0/1519511494 shutdown_connections 2024-09-15T22:28:37.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.575+0000 7f32ba800640 1 --2- 172.21.15.1:0/1519511494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32b4109140 0x7f32b4110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:37.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.575+0000 7f32ba800640 1 --2- 172.21.15.1:0/1519511494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b41049c0 0x7f32b4108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:37.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.575+0000 7f32ba800640 1 --2- 172.21.15.1:0/1519511494 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32b4104010 0x7f32b41043f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:37.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.575+0000 7f32ba800640 1 -- 172.21.15.1:0/1519511494 >> 172.21.15.1:0/1519511494 conn(0x7f32b40ffa50 msgr2=0x7f32b4101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:28:37.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.575+0000 7f32ba800640 1 -- 172.21.15.1:0/1519511494 shutdown_connections 2024-09-15T22:28:37.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.575+0000 7f32ba800640 1 -- 172.21.15.1:0/1519511494 wait complete. 2024-09-15T22:28:37.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.576+0000 7f32ba800640 1 Processor -- start 2024-09-15T22:28:37.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.576+0000 7f32ba800640 1 -- start start 2024-09-15T22:28:37.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.577+0000 7f32ba800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32b4104010 0x7f32b419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:37.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.577+0000 7f32ba800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32b41049c0 0x7f32b419ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:37.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.577+0000 7f32ba800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b4109140 0x7f32b419ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:37.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.577+0000 7f32ba800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f32b41141c0 con 0x7f32b4104010 2024-09-15T22:28:37.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.577+0000 7f32ba800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f32b4114040 con 0x7f32b4109140 2024-09-15T22:28:37.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.577+0000 7f32ba800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f32b4114340 con 0x7f32b41049c0 2024-09-15T22:28:37.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.577+0000 7f32b3400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32b4104010 0x7f32b419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:37.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.577+0000 7f32b3400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32b4104010 0x7f32b419a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36996/0 (socket says 172.21.15.1:36996) 2024-09-15T22:28:37.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.577+0000 7f32b3400640 1 -- 172.21.15.1:0/3603079256 learned_addr learned my addr 172.21.15.1:0/3603079256 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:28:37.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.577+0000 7f32abe00640 1 --2- 172.21.15.1:0/3603079256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32b41049c0 0x7f32b419ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:37.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.577+0000 7f32b3e00640 1 --2- 172.21.15.1:0/3603079256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b4109140 0x7f32b419ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:37.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.577+0000 7f32b3400640 1 -- 172.21.15.1:0/3603079256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32b41049c0 msgr2=0x7f32b419ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:37.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.577+0000 7f32b3400640 1 --2- 172.21.15.1:0/3603079256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32b41049c0 0x7f32b419ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:37.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.577+0000 7f32b3400640 1 -- 172.21.15.1:0/3603079256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b4109140 msgr2=0x7f32b419ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:37.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.577+0000 7f32b3400640 1 --2- 172.21.15.1:0/3603079256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b4109140 0x7f32b419ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:37.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.577+0000 7f32b3400640 1 -- 172.21.15.1:0/3603079256 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b419f5f0 con 0x7f32b4104010 2024-09-15T22:28:37.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.577+0000 7f32abe00640 1 --2- 172.21.15.1:0/3603079256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32b41049c0 0x7f32b419ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:28:37.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.578+0000 7f32b3400640 1 --2- 172.21.15.1:0/3603079256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32b4104010 0x7f32b419a640 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f32a4004770 tx=0x7f32a4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:28:37.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.578+0000 7f32b0c00640 1 -- 172.21.15.1:0/3603079256 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a403f070 con 0x7f32b4104010 2024-09-15T22:28:37.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.578+0000 7f32ba800640 1 -- 172.21.15.1:0/3603079256 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32b419f880 con 0x7f32b4104010 2024-09-15T22:28:37.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.578+0000 7f32b0c00640 1 -- 172.21.15.1:0/3603079256 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32a4031ca0 con 0x7f32b4104010 2024-09-15T22:28:37.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.578+0000 7f32b0c00640 1 -- 172.21.15.1:0/3603079256 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a4035030 con 0x7f32b4104010 2024-09-15T22:28:37.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.578+0000 7f32ba800640 1 -- 172.21.15.1:0/3603079256 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32b41a71c0 con 0x7f32b4104010 2024-09-15T22:28:37.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.579+0000 7f32ba800640 1 -- 172.21.15.1:0/3603079256 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32b41043f0 con 0x7f32b4104010 2024-09-15T22:28:37.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.581+0000 7f32b0c00640 1 -- 172.21.15.1:0/3603079256 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f32a4042070 con 0x7f32b4104010 2024-09-15T22:28:37.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.583+0000 7f32b0c00640 1 --2- 172.21.15.1:0/3603079256 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f32980a32c0 0x7f32980a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:37.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.583+0000 7f32b0c00640 1 -- 172.21.15.1:0/3603079256 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8593+0+0 (secure 0 0 0) 0x7f32a40f07d0 con 0x7f32b4104010 2024-09-15T22:28:37.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.583+0000 7f32abe00640 1 --2- 172.21.15.1:0/3603079256 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f32980a32c0 0x7f32980a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:37.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.584+0000 7f32abe00640 1 --2- 172.21.15.1:0/3603079256 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f32980a32c0 0x7f32980a5780 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f32b40ffe70 tx=0x7f329c00b5f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:28:37.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.585+0000 7f32b0c00640 1 -- 172.21.15.1:0/3603079256 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f32a40bd320 con 0x7f32b4104010 2024-09-15T22:28:37.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:37.770+0000 7f32ba800640 1 -- 172.21.15.1:0/3603079256 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f32b410c320 con 0x7f32b4104010 2024-09-15T22:28:37.772 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:37 smithi001 ceph-mon[30843]: pgmap v469: 97 pgs: 97 active+clean; 90 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-15T22:28:37.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:37 smithi098 ceph-mon[35514]: pgmap v469: 97 pgs: 97 active+clean; 90 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-15T22:28:37.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:37 smithi012 ceph-mon[34883]: pgmap v469: 97 pgs: 97 active+clean; 90 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-15T22:28:38.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:38.537+0000 7f32b0c00640 1 -- 172.21.15.1:0/3603079256 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v88) ==== 181+0+0 (secure 0 0 0) 0x7f32a40bcc20 con 0x7f32b4104010 2024-09-15T22:28:38.539 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' removed 2024-09-15T22:28:38.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:38.541+0000 7f32ba800640 1 -- 172.21.15.1:0/3603079256 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f32980a32c0 msgr2=0x7f32980a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:38.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:38.541+0000 7f32ba800640 1 --2- 172.21.15.1:0/3603079256 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f32980a32c0 0x7f32980a5780 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f32b40ffe70 tx=0x7f329c00b5f0 comp rx=0 tx=0).stop 2024-09-15T22:28:38.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:38.541+0000 7f32ba800640 1 -- 172.21.15.1:0/3603079256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32b4104010 msgr2=0x7f32b419a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:38.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:38.541+0000 7f32ba800640 1 --2- 172.21.15.1:0/3603079256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32b4104010 0x7f32b419a640 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f32a4004770 tx=0x7f32a4003c10 comp rx=0 tx=0).stop 2024-09-15T22:28:38.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:38.541+0000 7f32ba800640 1 -- 172.21.15.1:0/3603079256 shutdown_connections 2024-09-15T22:28:38.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:38.541+0000 7f32ba800640 1 --2- 172.21.15.1:0/3603079256 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f32980a32c0 0x7f32980a5780 secure :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f32b40ffe70 tx=0x7f329c00b5f0 comp rx=0 tx=0).stop 2024-09-15T22:28:38.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:38.541+0000 7f32ba800640 1 --2- 172.21.15.1:0/3603079256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b4109140 0x7f32b419ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:38.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:38.541+0000 7f32ba800640 1 --2- 172.21.15.1:0/3603079256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32b41049c0 0x7f32b419ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:38.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:38.541+0000 7f32ba800640 1 --2- 172.21.15.1:0/3603079256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32b4104010 0x7f32b419a640 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:38.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:38.541+0000 7f32ba800640 1 -- 172.21.15.1:0/3603079256 >> 172.21.15.1:0/3603079256 conn(0x7f32b40ffa50 msgr2=0x7f32b4100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:28:38.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:38.542+0000 7f32ba800640 1 -- 172.21.15.1:0/3603079256 shutdown_connections 2024-09-15T22:28:38.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:38.542+0000 7f32ba800640 1 -- 172.21.15.1:0/3603079256 wait complete. 2024-09-15T22:28:38.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:38 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/3603079256' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T22:28:38.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:38 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/3603079256' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T22:28:38.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:38 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/3603079256' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T22:28:39.708 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c1228c44-73af-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T22:28:39.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:39 smithi098 ceph-mon[35514]: pgmap v470: 97 pgs: 97 active+clean; 90 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 204 B/s wr, 4 op/s 2024-09-15T22:28:39.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:39 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/3603079256' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T22:28:39.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:39 smithi098 ceph-mon[35514]: osdmap e88: 12 total, 12 up, 12 in 2024-09-15T22:28:39.875 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:39 smithi001 ceph-mon[30843]: pgmap v470: 97 pgs: 97 active+clean; 90 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 204 B/s wr, 4 op/s 2024-09-15T22:28:39.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:39 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/3603079256' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T22:28:39.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:39 smithi001 ceph-mon[30843]: osdmap e88: 12 total, 12 up, 12 in 2024-09-15T22:28:39.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:39 smithi012 ceph-mon[34883]: pgmap v470: 97 pgs: 97 active+clean; 90 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 204 B/s wr, 4 op/s 2024-09-15T22:28:39.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:39 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/3603079256' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T22:28:39.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:39 smithi012 ceph-mon[34883]: osdmap e88: 12 total, 12 up, 12 in 2024-09-15T22:28:40.094 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:28:40.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.641+0000 7f35f8a00640 1 -- 172.21.15.1:0/3046679971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35f4108f60 msgr2=0x7f35f4110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:40.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.641+0000 7f35f8a00640 1 --2- 172.21.15.1:0/3046679971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35f4108f60 0x7f35f4110ae0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f35ec009ca0 tx=0x7f35ec02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:28:40.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.641+0000 7f35f8a00640 1 -- 172.21.15.1:0/3046679971 shutdown_connections 2024-09-15T22:28:40.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.641+0000 7f35f8a00640 1 --2- 172.21.15.1:0/3046679971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35f4108f60 0x7f35f4110ae0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:40.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.641+0000 7f35f8a00640 1 --2- 172.21.15.1:0/3046679971 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35f41047e0 0x7f35f4108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:40.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.641+0000 7f35f8a00640 1 --2- 172.21.15.1:0/3046679971 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35f4103e30 0x7f35f4104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:40.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.641+0000 7f35f8a00640 1 -- 172.21.15.1:0/3046679971 >> 172.21.15.1:0/3046679971 conn(0x7f35f40ff8d0 msgr2=0x7f35f4101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:28:40.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.641+0000 7f35f8a00640 1 -- 172.21.15.1:0/3046679971 shutdown_connections 2024-09-15T22:28:40.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.641+0000 7f35f8a00640 1 -- 172.21.15.1:0/3046679971 wait complete. 2024-09-15T22:28:40.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.642+0000 7f35f8a00640 1 Processor -- start 2024-09-15T22:28:40.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.642+0000 7f35f8a00640 1 -- start start 2024-09-15T22:28:40.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.643+0000 7f35f8a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35f4103e30 0x7f35f419a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:40.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.643+0000 7f35f8a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35f41047e0 0x7f35f419a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:40.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.643+0000 7f35f8a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35f4108f60 0x7f35f419ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:40.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.643+0000 7f35f8a00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f35f4114010 con 0x7f35f4108f60 2024-09-15T22:28:40.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.643+0000 7f35f8a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f35f4113e90 con 0x7f35f41047e0 2024-09-15T22:28:40.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.643+0000 7f35f8a00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f35f4114190 con 0x7f35f4103e30 2024-09-15T22:28:40.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.643+0000 7f35f3e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35f4108f60 0x7f35f419ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:40.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.643+0000 7f35f3e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35f4108f60 0x7f35f419ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37020/0 (socket says 172.21.15.1:37020) 2024-09-15T22:28:40.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.643+0000 7f35f3e00640 1 -- 172.21.15.1:0/3867512706 learned_addr learned my addr 172.21.15.1:0/3867512706 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T22:28:40.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.643+0000 7f35f3400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35f4103e30 0x7f35f419a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:40.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.643+0000 7f35eaa00640 1 --2- 172.21.15.1:0/3867512706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35f41047e0 0x7f35f419a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:40.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.644+0000 7f35f3e00640 1 -- 172.21.15.1:0/3867512706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35f4103e30 msgr2=0x7f35f419a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:40.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.644+0000 7f35f3e00640 1 --2- 172.21.15.1:0/3867512706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35f4103e30 0x7f35f419a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:40.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.644+0000 7f35f3e00640 1 -- 172.21.15.1:0/3867512706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35f41047e0 msgr2=0x7f35f419a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:40.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.644+0000 7f35f3e00640 1 --2- 172.21.15.1:0/3867512706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35f41047e0 0x7f35f419a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:40.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.644+0000 7f35f3e00640 1 -- 172.21.15.1:0/3867512706 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f419f360 con 0x7f35f4108f60 2024-09-15T22:28:40.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.644+0000 7f35eaa00640 1 --2- 172.21.15.1:0/3867512706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35f41047e0 0x7f35f419a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:28:40.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.644+0000 7f35f3e00640 1 --2- 172.21.15.1:0/3867512706 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35f4108f60 0x7f35f419ec80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f35ec005e30 tx=0x7f35ec003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:28:40.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.645+0000 7f35f0c00640 1 -- 172.21.15.1:0/3867512706 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ec031650 con 0x7f35f4108f60 2024-09-15T22:28:40.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.645+0000 7f35f0c00640 1 -- 172.21.15.1:0/3867512706 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35ec0317f0 con 0x7f35f4108f60 2024-09-15T22:28:40.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.645+0000 7f35f8a00640 1 -- 172.21.15.1:0/3867512706 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35f419f5f0 con 0x7f35f4108f60 2024-09-15T22:28:40.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.645+0000 7f35f0c00640 1 -- 172.21.15.1:0/3867512706 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ec02f9d0 con 0x7f35f4108f60 2024-09-15T22:28:40.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.645+0000 7f35f8a00640 1 -- 172.21.15.1:0/3867512706 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35f41a6f30 con 0x7f35f4108f60 2024-09-15T22:28:40.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.646+0000 7f35f8a00640 1 -- 172.21.15.1:0/3867512706 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35f4104210 con 0x7f35f4108f60 2024-09-15T22:28:40.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.648+0000 7f35f0c00640 1 -- 172.21.15.1:0/3867512706 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f35ec02fbf0 con 0x7f35f4108f60 2024-09-15T22:28:40.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.649+0000 7f35f0c00640 1 --2- 172.21.15.1:0/3867512706 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f35d80a3240 0x7f35d80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:40.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.649+0000 7f35f0c00640 1 -- 172.21.15.1:0/3867512706 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8089+0+0 (secure 0 0 0) 0x7f35ec0f0bf0 con 0x7f35f4108f60 2024-09-15T22:28:40.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.649+0000 7f35f3400640 1 --2- 172.21.15.1:0/3867512706 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f35d80a3240 0x7f35d80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:40.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.650+0000 7f35f3400640 1 --2- 172.21.15.1:0/3867512706 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f35d80a3240 0x7f35d80a5700 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f35e4009bd0 tx=0x7f35e4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:28:40.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.653+0000 7f35f0c00640 1 -- 172.21.15.1:0/3867512706 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f35ec0bd950 con 0x7f35f4108f60 2024-09-15T22:28:40.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:40.837+0000 7f35f8a00640 1 -- 172.21.15.1:0/3867512706 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f35f41a7100 con 0x7f35f4108f60 2024-09-15T22:28:41.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:41.548+0000 7f35f0c00640 1 -- 172.21.15.1:0/3867512706 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v89) ==== 169+0+0 (secure 0 0 0) 0x7f35ec0bd250 con 0x7f35f4108f60 2024-09-15T22:28:41.550 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' removed 2024-09-15T22:28:41.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:41.552+0000 7f35f8a00640 1 -- 172.21.15.1:0/3867512706 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f35d80a3240 msgr2=0x7f35d80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:41.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:41.552+0000 7f35f8a00640 1 --2- 172.21.15.1:0/3867512706 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f35d80a3240 0x7f35d80a5700 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f35e4009bd0 tx=0x7f35e4005f90 comp rx=0 tx=0).stop 2024-09-15T22:28:41.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:41.552+0000 7f35f8a00640 1 -- 172.21.15.1:0/3867512706 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35f4108f60 msgr2=0x7f35f419ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:41.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:41.552+0000 7f35f8a00640 1 --2- 172.21.15.1:0/3867512706 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35f4108f60 0x7f35f419ec80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f35ec005e30 tx=0x7f35ec003d00 comp rx=0 tx=0).stop 2024-09-15T22:28:41.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:41.553+0000 7f35f8a00640 1 -- 172.21.15.1:0/3867512706 shutdown_connections 2024-09-15T22:28:41.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:41.553+0000 7f35f8a00640 1 --2- 172.21.15.1:0/3867512706 >> [v2:172.21.15.1:6800/3816767836,v1:172.21.15.1:6801/3816767836] conn(0x7f35d80a3240 0x7f35d80a5700 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:41.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:41.553+0000 7f35f8a00640 1 --2- 172.21.15.1:0/3867512706 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35f4108f60 0x7f35f419ec80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:41.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:41.553+0000 7f35f8a00640 1 --2- 172.21.15.1:0/3867512706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35f41047e0 0x7f35f419a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:41.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:41.553+0000 7f35f8a00640 1 --2- 172.21.15.1:0/3867512706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35f4103e30 0x7f35f419a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:41.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:41.553+0000 7f35f8a00640 1 -- 172.21.15.1:0/3867512706 >> 172.21.15.1:0/3867512706 conn(0x7f35f40ff8d0 msgr2=0x7f35f4101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:28:41.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:41.553+0000 7f35f8a00640 1 -- 172.21.15.1:0/3867512706 shutdown_connections 2024-09-15T22:28:41.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T22:28:41.553+0000 7f35f8a00640 1 -- 172.21.15.1:0/3867512706 wait complete. 2024-09-15T22:28:41.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:41 smithi098 ceph-mon[35514]: pgmap v472: 65 pgs: 65 active+clean; 577 KiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:28:41.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:41 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/3867512706' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T22:28:41.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:41 smithi001 ceph-mon[30843]: pgmap v472: 65 pgs: 65 active+clean; 577 KiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:28:41.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:41 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/3867512706' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T22:28:41.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:41 smithi012 ceph-mon[34883]: pgmap v472: 65 pgs: 65 active+clean; 577 KiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:28:41.996 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:41 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/3867512706' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T22:28:42.673 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:28:42.732 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:28:42.769 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:28:42.803 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-15T22:28:42.804 DEBUG:teuthology.orchestra.run.smithi001:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-15T22:28:42.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:42 smithi098 ceph-mon[35514]: from='client.? 172.21.15.1:0/3867512706' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T22:28:42.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:42 smithi098 ceph-mon[35514]: osdmap e89: 12 total, 12 up, 12 in 2024-09-15T22:28:42.839 DEBUG:teuthology.orchestra.run.smithi012:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-15T22:28:42.856 DEBUG:teuthology.orchestra.run.smithi098:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-15T22:28:42.875 INFO:tasks.cephadm:Stopping all daemons... 2024-09-15T22:28:42.875 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-15T22:28:42.875 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-c1228c44-73af-11ef-bceb-c7b262605968@mon.a 2024-09-15T22:28:42.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:42 smithi001 ceph-mon[30843]: from='client.? 172.21.15.1:0/3867512706' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T22:28:42.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:42 smithi001 ceph-mon[30843]: osdmap e89: 12 total, 12 up, 12 in 2024-09-15T22:28:42.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:42 smithi012 ceph-mon[34883]: from='client.? 172.21.15.1:0/3867512706' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T22:28:42.995 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:42 smithi012 ceph-mon[34883]: osdmap e89: 12 total, 12 up, 12 in 2024-09-15T22:28:43.323 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:42 smithi001 systemd[1]: Stopping Ceph mon.a for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:28:43.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:43 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mon-a[30839]: 2024-09-15T22:28:43.320+0000 7fbdeca00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:28:43.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:43 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mon-a[30839]: 2024-09-15T22:28:43.320+0000 7fbdeca00640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-15T22:28:43.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:43 smithi001 podman[83270]: 2024-09-15 22:28:43.352067911 +0000 UTC m=+0.197038522 container died 93496c21faa2a5b285d83b78e0f0cf306818f4919b273d82a4007d8cfe7337b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True) 2024-09-15T22:28:44.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:44 smithi001 podman[83270]: 2024-09-15 22:28:44.001202861 +0000 UTC m=+0.846173472 container cleanup 93496c21faa2a5b285d83b78e0f0cf306818f4919b273d82a4007d8cfe7337b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mon-a, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-15T22:28:44.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:44 smithi001 bash[83270]: ceph-c1228c44-73af-11ef-bceb-c7b262605968-mon-a 2024-09-15T22:28:44.491 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 15 22:28:44 smithi001 podman[83281]: 2024-09-15 22:28:44.227776097 +0000 UTC m=+0.858593047 container remove 93496c21faa2a5b285d83b78e0f0cf306818f4919b273d82a4007d8cfe7337b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mon-a, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-15T22:28:44.513 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mon.a.service' 2024-09-15T22:28:44.607 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:28:44.607 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-15T22:28:44.607 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-15T22:28:44.607 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-c1228c44-73af-11ef-bceb-c7b262605968@mon.b 2024-09-15T22:28:44.923 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:44 smithi012 systemd[1]: Stopping Ceph mon.b for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:28:45.245 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:44 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mon-b[34879]: 2024-09-15T22:28:44.921+0000 7f57144e2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:28:45.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:44 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mon-b[34879]: 2024-09-15T22:28:44.921+0000 7f57144e2640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-15T22:28:45.246 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:45 smithi012 podman[67839]: 2024-09-15 22:28:45.095193508 +0000 UTC m=+0.292300946 container died 1137457537d64027d1d8abdf857d281ea7b48fb71a4924ca58423eeab47c865c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mon-b, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-15T22:28:45.725 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:45 smithi012 podman[67839]: 2024-09-15 22:28:45.473563835 +0000 UTC m=+0.670671311 container cleanup 1137457537d64027d1d8abdf857d281ea7b48fb71a4924ca58423eeab47c865c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mon-b, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-15T22:28:45.725 INFO:journalctl@ceph.mon.b.smithi012.stdout:Sep 15 22:28:45 smithi012 bash[67839]: ceph-c1228c44-73af-11ef-bceb-c7b262605968-mon-b 2024-09-15T22:28:45.906 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mon.b.service' 2024-09-15T22:28:45.947 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:28:45.947 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-15T22:28:45.947 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-15T22:28:45.947 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-c1228c44-73af-11ef-bceb-c7b262605968@mon.c 2024-09-15T22:28:46.269 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:45 smithi098 systemd[1]: Stopping Ceph mon.c for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:28:46.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:46 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mon-c[35510]: 2024-09-15T22:28:46.267+0000 7f5e5387c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:28:46.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:46 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mon-c[35510]: 2024-09-15T22:28:46.267+0000 7f5e5387c640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-15T22:28:46.561 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:46 smithi098 podman[69022]: 2024-09-15 22:28:46.329216627 +0000 UTC m=+0.189238115 container died bf69844b3137623f695a1f47fa21545cc964819d5219179432bfde35b8c0d36b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mon-c, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-15T22:28:46.845 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:46 smithi098 podman[69022]: 2024-09-15 22:28:46.651062229 +0000 UTC m=+0.511083709 container cleanup bf69844b3137623f695a1f47fa21545cc964819d5219179432bfde35b8c0d36b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-15T22:28:46.845 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 15 22:28:46 smithi098 bash[69022]: ceph-c1228c44-73af-11ef-bceb-c7b262605968-mon-c 2024-09-15T22:28:47.065 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mon.c.service' 2024-09-15T22:28:47.108 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:28:47.109 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-15T22:28:47.109 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-15T22:28:47.109 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-c1228c44-73af-11ef-bceb-c7b262605968@mgr.x 2024-09-15T22:28:47.535 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:28:47 smithi001 systemd[1]: Stopping Ceph mgr.x for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:28:47.876 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:28:47 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:28:47.532+0000 7f80c6600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:28:47.876 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:28:47 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x[31066]: 2024-09-15T22:28:47.532+0000 7f80c6600640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-15T22:28:47.876 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:28:47 smithi001 podman[83392]: 2024-09-15 22:28:47.616580023 +0000 UTC m=+0.206183609 container died 3c111bd85901850cdda8eb5cbe879bde1ef55c9f73e45141bbe3bf4771dd40b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, ceph=True) 2024-09-15T22:28:48.437 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:28:48 smithi001 podman[83392]: 2024-09-15 22:28:48.423405073 +0000 UTC m=+1.013008649 container cleanup 3c111bd85901850cdda8eb5cbe879bde1ef55c9f73e45141bbe3bf4771dd40b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e) 2024-09-15T22:28:48.437 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:28:48 smithi001 bash[83392]: ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x 2024-09-15T22:28:48.875 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 15 22:28:48 smithi001 podman[83404]: 2024-09-15 22:28:48.616879313 +0000 UTC m=+0.990148261 container remove 3c111bd85901850cdda8eb5cbe879bde1ef55c9f73e45141bbe3bf4771dd40b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-15T22:28:48.941 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-15T22:28:49.019 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:28:49.019 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-15T22:28:49.019 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-15T22:28:49.020 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-c1228c44-73af-11ef-bceb-c7b262605968@mgr.y 2024-09-15T22:28:49.332 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:28:49 smithi012 systemd[1]: Stopping Ceph mgr.y for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:28:49.613 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:28:49 smithi012 podman[67965]: 2024-09-15 22:28:49.331748856 +0000 UTC m=+0.118788971 container died 6f9a44e75bf685e5a74cbc839057c965a73fdcf6440119c1e3f774a0edbf0873 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-15T22:28:49.896 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:28:49 smithi012 podman[67965]: 2024-09-15 22:28:49.719263272 +0000 UTC m=+0.506303389 container cleanup 6f9a44e75bf685e5a74cbc839057c965a73fdcf6440119c1e3f774a0edbf0873 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-15T22:28:49.896 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:28:49 smithi012 bash[67965]: ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-y 2024-09-15T22:28:50.160 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:28:49 smithi012 podman[67978]: 2024-09-15 22:28:49.895527781 +0000 UTC m=+0.559712263 container remove 6f9a44e75bf685e5a74cbc839057c965a73fdcf6440119c1e3f774a0edbf0873 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:28:50.160 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 15 22:28:49 smithi012 systemd[1]: ceph-c1228c44-73af-11ef-bceb-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-09-15T22:28:50.173 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-15T22:28:50.209 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:28:50.209 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-15T22:28:50.209 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-15T22:28:50.209 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-c1228c44-73af-11ef-bceb-c7b262605968@mgr.z 2024-09-15T22:28:50.561 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:28:50 smithi098 systemd[1]: Stopping Ceph mgr.z for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:28:50.834 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:28:50 smithi098 podman[69147]: 2024-09-15 22:28:50.652213203 +0000 UTC m=+0.254593241 container died a9d1b7bf2db14913712645a4df33da3039e955a6a8b396896bd3384bc3a9cc36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-z, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-15T22:28:51.310 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:28:51 smithi098 podman[69147]: 2024-09-15 22:28:51.014847919 +0000 UTC m=+0.617227959 container cleanup a9d1b7bf2db14913712645a4df33da3039e955a6a8b396896bd3384bc3a9cc36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-z, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-15T22:28:51.310 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 15 22:28:51 smithi098 bash[69147]: ceph-c1228c44-73af-11ef-bceb-c7b262605968-mgr-z 2024-09-15T22:28:51.500 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-15T22:28:51.538 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:28:51.538 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-15T22:28:51.538 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-15T22:28:51.539 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.0 2024-09-15T22:28:51.876 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 15 22:28:51 smithi001 systemd[1]: Stopping Ceph osd.0 for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:28:52.376 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 15 22:28:51 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-0[42251]: 2024-09-15T22:28:51.993+0000 7ffa44400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:28:52.376 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 15 22:28:51 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-0[42251]: 2024-09-15T22:28:51.993+0000 7ffa44400640 -1 osd.0 89 *** Got signal Terminated *** 2024-09-15T22:28:52.376 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 15 22:28:51 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-0[42251]: 2024-09-15T22:28:51.993+0000 7ffa44400640 -1 osd.0 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:28:57.876 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 15 22:28:57 smithi001 podman[83524]: 2024-09-15 22:28:57.544405701 +0000 UTC m=+5.715332251 container died 1a95f53f08adbfb2294c0b46fcea69748fccb7aa015b29ed3e1524f007e2b6fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-0, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-15T22:28:58.376 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 15 22:28:58 smithi001 podman[83524]: 2024-09-15 22:28:58.153853099 +0000 UTC m=+6.324779631 container cleanup 1a95f53f08adbfb2294c0b46fcea69748fccb7aa015b29ed3e1524f007e2b6fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS) 2024-09-15T22:28:58.376 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 15 22:28:58 smithi001 bash[83524]: ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-0 2024-09-15T22:28:58.860 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 15 22:28:58 smithi001 podman[83544]: 2024-09-15 22:28:58.396543598 +0000 UTC m=+0.841222607 container remove 1a95f53f08adbfb2294c0b46fcea69748fccb7aa015b29ed3e1524f007e2b6fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-15T22:28:59.126 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 15 22:28:58 smithi001 podman[83633]: 2024-09-15 22:28:58.76394815 +0000 UTC m=+0.027380850 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:28:59.126 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 15 22:28:58 smithi001 podman[83633]: 2024-09-15 22:28:58.872301741 +0000 UTC m=+0.135734439 container create 3461addac90a2ac824f47282d3e2dd4a915e0f015c13153aa7becdf2c330f958 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-0-deactivate, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:28:59.440 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 15 22:28:59 smithi001 podman[83633]: 2024-09-15 22:28:59.166880821 +0000 UTC m=+0.430313524 container init 3461addac90a2ac824f47282d3e2dd4a915e0f015c13153aa7becdf2c330f958 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-15T22:28:59.441 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 15 22:28:59 smithi001 podman[83633]: 2024-09-15 22:28:59.174574634 +0000 UTC m=+0.438007342 container start 3461addac90a2ac824f47282d3e2dd4a915e0f015c13153aa7becdf2c330f958 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-15T22:28:59.441 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 15 22:28:59 smithi001 podman[83633]: 2024-09-15 22:28:59.25828696 +0000 UTC m=+0.521719686 container attach 3461addac90a2ac824f47282d3e2dd4a915e0f015c13153aa7becdf2c330f958 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-0-deactivate, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-15T22:28:59.803 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 15 22:28:59 smithi001 podman[83633]: 2024-09-15 22:28:59.439753557 +0000 UTC m=+0.703186273 container died 3461addac90a2ac824f47282d3e2dd4a915e0f015c13153aa7becdf2c330f958 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:29:00.259 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.0.service' 2024-09-15T22:29:00.336 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:29:00.336 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-15T22:29:00.336 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-15T22:29:00.336 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.1 2024-09-15T22:29:00.699 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 15 22:29:00 smithi012 systemd[1]: Stopping Ceph osd.1 for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:29:00.997 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 15 22:29:00 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-1[39380]: 2024-09-15T22:29:00.697+0000 7f1401378640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:29:00.997 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 15 22:29:00 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-1[39380]: 2024-09-15T22:29:00.697+0000 7f1401378640 -1 osd.1 89 *** Got signal Terminated *** 2024-09-15T22:29:00.997 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 15 22:29:00 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-1[39380]: 2024-09-15T22:29:00.697+0000 7f1401378640 -1 osd.1 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:29:06.333 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 15 22:29:06 smithi012 podman[68103]: 2024-09-15 22:29:06.025109954 +0000 UTC m=+5.499018693 container died f1c81fa06c80ff0ef934891cf4cdade62f4fbc25f4e6352507cc56d088edc3db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-1, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-15T22:29:06.683 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 15 22:29:06 smithi012 podman[68103]: 2024-09-15 22:29:06.430742945 +0000 UTC m=+5.904651672 container cleanup f1c81fa06c80ff0ef934891cf4cdade62f4fbc25f4e6352507cc56d088edc3db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-1, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-15T22:29:06.683 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 15 22:29:06 smithi012 bash[68103]: ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-1 2024-09-15T22:29:06.995 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 15 22:29:06 smithi012 podman[68118]: 2024-09-15 22:29:06.682057939 +0000 UTC m=+0.655322959 container remove f1c81fa06c80ff0ef934891cf4cdade62f4fbc25f4e6352507cc56d088edc3db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-1, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-15T22:29:07.361 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 15 22:29:07 smithi012 podman[68207]: 2024-09-15 22:29:07.00847769 +0000 UTC m=+0.015958404 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:29:07.361 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 15 22:29:07 smithi012 podman[68207]: 2024-09-15 22:29:07.116036033 +0000 UTC m=+0.123516741 container create f5ea047403c0056006164bb90a1eed1b9e947317f1931ab52dcc460ab17f97d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-15T22:29:07.361 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 15 22:29:07 smithi012 podman[68207]: 2024-09-15 22:29:07.360214892 +0000 UTC m=+0.367695598 container init f5ea047403c0056006164bb90a1eed1b9e947317f1931ab52dcc460ab17f97d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:29:07.746 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 15 22:29:07 smithi012 podman[68207]: 2024-09-15 22:29:07.363588639 +0000 UTC m=+0.371069344 container start f5ea047403c0056006164bb90a1eed1b9e947317f1931ab52dcc460ab17f97d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:29:07.746 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 15 22:29:07 smithi012 podman[68207]: 2024-09-15 22:29:07.443700814 +0000 UTC m=+0.451181528 container attach f5ea047403c0056006164bb90a1eed1b9e947317f1931ab52dcc460ab17f97d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0) 2024-09-15T22:29:07.746 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 15 22:29:07 smithi012 podman[68207]: 2024-09-15 22:29:07.554536943 +0000 UTC m=+0.562017651 container died f5ea047403c0056006164bb90a1eed1b9e947317f1931ab52dcc460ab17f97d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-15T22:29:08.158 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.1.service' 2024-09-15T22:29:08.200 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:29:08.201 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-15T22:29:08.201 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-15T22:29:08.201 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.2 2024-09-15T22:29:08.521 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 15 22:29:08 smithi098 systemd[1]: Stopping Ceph osd.2 for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:29:08.810 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 15 22:29:08 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-2[40519]: 2024-09-15T22:29:08.519+0000 7f348ef72640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:29:08.810 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 15 22:29:08 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-2[40519]: 2024-09-15T22:29:08.519+0000 7f348ef72640 -1 osd.2 89 *** Got signal Terminated *** 2024-09-15T22:29:08.810 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 15 22:29:08 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-2[40519]: 2024-09-15T22:29:08.519+0000 7f348ef72640 -1 osd.2 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:29:14.205 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 15 22:29:13 smithi098 podman[69282]: 2024-09-15 22:29:13.926529979 +0000 UTC m=+5.522514352 container died f7d62e81ad6e6b201bddba73110f2933ef37b570297847596ee55a13f85740fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731) 2024-09-15T22:29:14.560 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 15 22:29:14 smithi098 podman[69282]: 2024-09-15 22:29:14.294806219 +0000 UTC m=+5.890790602 container cleanup f7d62e81ad6e6b201bddba73110f2933ef37b570297847596ee55a13f85740fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-15T22:29:14.561 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 15 22:29:14 smithi098 bash[69282]: ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-2 2024-09-15T22:29:14.878 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 15 22:29:14 smithi098 podman[69297]: 2024-09-15 22:29:14.571139242 +0000 UTC m=+0.639562139 container remove f7d62e81ad6e6b201bddba73110f2933ef37b570297847596ee55a13f85740fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-2, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-15T22:29:15.129 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 15 22:29:14 smithi098 podman[69383]: 2024-09-15 22:29:14.780448496 +0000 UTC m=+0.015692029 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:29:15.129 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 15 22:29:14 smithi098 podman[69383]: 2024-09-15 22:29:14.905449281 +0000 UTC m=+0.140692848 container create 6e5c78602f80d41e7a1716285796ec7b82e45a484f933202035d20e11656deb2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=) 2024-09-15T22:29:15.129 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 15 22:29:15 smithi098 podman[69383]: 2024-09-15 22:29:15.124509417 +0000 UTC m=+0.359752939 container init 6e5c78602f80d41e7a1716285796ec7b82e45a484f933202035d20e11656deb2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-15T22:29:15.560 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 15 22:29:15 smithi098 podman[69383]: 2024-09-15 22:29:15.128253727 +0000 UTC m=+0.363497252 container start 6e5c78602f80d41e7a1716285796ec7b82e45a484f933202035d20e11656deb2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:29:15.561 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 15 22:29:15 smithi098 podman[69383]: 2024-09-15 22:29:15.224611517 +0000 UTC m=+0.459855046 container attach 6e5c78602f80d41e7a1716285796ec7b82e45a484f933202035d20e11656deb2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731) 2024-09-15T22:29:15.561 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 15 22:29:15 smithi098 podman[69383]: 2024-09-15 22:29:15.320975654 +0000 UTC m=+0.556219191 container died 6e5c78602f80d41e7a1716285796ec7b82e45a484f933202035d20e11656deb2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731) 2024-09-15T22:29:15.943 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.2.service' 2024-09-15T22:29:15.984 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:29:15.984 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-15T22:29:15.984 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-15T22:29:15.984 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.3 2024-09-15T22:29:16.376 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 15 22:29:16 smithi001 systemd[1]: Stopping Ceph osd.3 for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:29:16.876 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 15 22:29:16 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-3[48779]: 2024-09-15T22:29:16.401+0000 7f0c1b400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:29:16.876 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 15 22:29:16 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-3[48779]: 2024-09-15T22:29:16.401+0000 7f0c1b400640 -1 osd.3 89 *** Got signal Terminated *** 2024-09-15T22:29:16.876 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 15 22:29:16 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-3[48779]: 2024-09-15T22:29:16.401+0000 7f0c1b400640 -1 osd.3 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:29:18.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:18 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:18.012+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:19.245 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:18 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:18.998+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:20.245 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:19 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:19.977+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:20.995 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:20 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:20.973+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:21.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:21 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:21.100+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:22.055 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 15 22:29:21 smithi001 podman[83737]: 2024-09-15 22:29:21.79372762 +0000 UTC m=+5.510543436 container stop c48da10274ef68899d9e7410e754c60af3aac24a71ce7c7fd786e9d04cedbcc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-15T22:29:22.056 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 15 22:29:21 smithi001 podman[83737]: 2024-09-15 22:29:21.81959721 +0000 UTC m=+5.536413032 container died c48da10274ef68899d9e7410e754c60af3aac24a71ce7c7fd786e9d04cedbcc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-3, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-15T22:29:22.245 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:21 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:21.985+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:22.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:22 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:22.053+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:22.561 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:22 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:29:22.099+0000 7f4598950640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.010670+0000 front 2024-09-15T22:28:56.010778+0000 (oldest deadline 2024-09-15T22:29:21.310686+0000) 2024-09-15T22:29:22.626 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 15 22:29:22 smithi001 podman[83737]: 2024-09-15 22:29:22.340489418 +0000 UTC m=+6.057305225 container cleanup c48da10274ef68899d9e7410e754c60af3aac24a71ce7c7fd786e9d04cedbcc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-3, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:29:22.626 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 15 22:29:22 smithi001 bash[83737]: ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-3 2024-09-15T22:29:22.626 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 15 22:29:22 smithi001 podman[83754]: 2024-09-15 22:29:22.58367884 +0000 UTC m=+0.774378963 container remove c48da10274ef68899d9e7410e754c60af3aac24a71ce7c7fd786e9d04cedbcc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-15T22:29:22.626 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:22 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:22.559+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.903401+0000 front 2024-09-15T22:28:56.903572+0000 (oldest deadline 2024-09-15T22:29:21.603501+0000) 2024-09-15T22:29:23.058 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:23 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:29:23.057+0000 7f4598950640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.010670+0000 front 2024-09-15T22:28:56.010778+0000 (oldest deadline 2024-09-15T22:29:21.310686+0000) 2024-09-15T22:29:23.059 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:22 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:22.740+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:23.245 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:22 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:22.989+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:23.271 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:23 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:23.056+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:23.271 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 15 22:29:23 smithi001 podman[83851]: 2024-09-15 22:29:23.05443348 +0000 UTC m=+0.028048359 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:29:23.271 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 15 22:29:23 smithi001 podman[83851]: 2024-09-15 22:29:23.16798209 +0000 UTC m=+0.141596969 container create 79ed671dba1bcd9c072e0c8e7c94c8ea9c92665a291da0ac4232902f4be1ca50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:29:23.609 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 15 22:29:23 smithi001 podman[83851]: 2024-09-15 22:29:23.353846009 +0000 UTC m=+0.327460893 container init 79ed671dba1bcd9c072e0c8e7c94c8ea9c92665a291da0ac4232902f4be1ca50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-15T22:29:23.610 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 15 22:29:23 smithi001 podman[83851]: 2024-09-15 22:29:23.360827586 +0000 UTC m=+0.334442465 container start 79ed671dba1bcd9c072e0c8e7c94c8ea9c92665a291da0ac4232902f4be1ca50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-15T22:29:23.610 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 15 22:29:23 smithi001 podman[83851]: 2024-09-15 22:29:23.47326013 +0000 UTC m=+0.446875043 container attach 79ed671dba1bcd9c072e0c8e7c94c8ea9c92665a291da0ac4232902f4be1ca50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=) 2024-09-15T22:29:23.876 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 15 22:29:23 smithi001 podman[83851]: 2024-09-15 22:29:23.624874804 +0000 UTC m=+0.598489695 container died 79ed671dba1bcd9c072e0c8e7c94c8ea9c92665a291da0ac4232902f4be1ca50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-15T22:29:23.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:23 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:23.607+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.903401+0000 front 2024-09-15T22:28:56.903572+0000 (oldest deadline 2024-09-15T22:29:21.603501+0000) 2024-09-15T22:29:24.056 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:23 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:23.747+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:24.245 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:23 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:23.961+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:24.310 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:24 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:29:24.055+0000 7f4598950640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.010670+0000 front 2024-09-15T22:28:56.010778+0000 (oldest deadline 2024-09-15T22:29:21.310686+0000) 2024-09-15T22:29:24.368 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:24 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:24.060+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:24.396 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.3.service' 2024-09-15T22:29:24.474 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:29:24.475 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-15T22:29:24.475 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-15T22:29:24.475 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.4 2024-09-15T22:29:24.800 INFO:journalctl@ceph.osd.4.smithi012.stdout:Sep 15 22:29:24 smithi012 systemd[1]: Stopping Ceph osd.4 for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:29:25.019 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:24 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:24.627+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.903401+0000 front 2024-09-15T22:28:56.903572+0000 (oldest deadline 2024-09-15T22:29:21.603501+0000) 2024-09-15T22:29:25.029 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:24 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:24.745+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:25.245 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:24 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:24.999+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:25.246 INFO:journalctl@ceph.osd.4.smithi012.stdout:Sep 15 22:29:24 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-4[46037]: 2024-09-15T22:29:24.798+0000 7f56feb3a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:29:25.246 INFO:journalctl@ceph.osd.4.smithi012.stdout:Sep 15 22:29:24 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-4[46037]: 2024-09-15T22:29:24.798+0000 7f56feb3a640 -1 osd.4 89 *** Got signal Terminated *** 2024-09-15T22:29:25.246 INFO:journalctl@ceph.osd.4.smithi012.stdout:Sep 15 22:29:24 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-4[46037]: 2024-09-15T22:29:24.798+0000 7f56feb3a640 -1 osd.4 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:29:25.310 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:25 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:29:25.027+0000 7f4598950640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.010670+0000 front 2024-09-15T22:28:56.010778+0000 (oldest deadline 2024-09-15T22:29:21.310686+0000) 2024-09-15T22:29:25.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:25 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:25.018+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:26.053 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:25 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:25.696+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:26.069 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:25 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:25.639+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.903401+0000 front 2024-09-15T22:28:56.903572+0000 (oldest deadline 2024-09-15T22:29:21.603501+0000) 2024-09-15T22:29:26.245 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:25 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:25.957+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:26.310 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:26 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:29:26.051+0000 7f4598950640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.010670+0000 front 2024-09-15T22:28:56.010778+0000 (oldest deadline 2024-09-15T22:29:21.310686+0000) 2024-09-15T22:29:26.375 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:26 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:26.067+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:26.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:26 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:26.592+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.903401+0000 front 2024-09-15T22:28:56.903572+0000 (oldest deadline 2024-09-15T22:29:21.603501+0000) 2024-09-15T22:29:27.031 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:26 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:26.656+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:27.245 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:26 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:26.973+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:27.310 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:27 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:29:27.029+0000 7f4598950640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.010670+0000 front 2024-09-15T22:28:56.010778+0000 (oldest deadline 2024-09-15T22:29:21.310686+0000) 2024-09-15T22:29:27.310 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:27 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:29:27.029+0000 7f4598950640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:01.311227+0000 front 2024-09-15T22:29:01.311237+0000 (oldest deadline 2024-09-15T22:29:26.611171+0000) 2024-09-15T22:29:27.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:27 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:27.060+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:27.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:27 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:27.578+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.903401+0000 front 2024-09-15T22:28:56.903572+0000 (oldest deadline 2024-09-15T22:29:21.603501+0000) 2024-09-15T22:29:28.009 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:27 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:27.653+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:28.245 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:28 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:28.022+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:28.246 INFO:journalctl@ceph.osd.4.smithi012.stdout:Sep 15 22:29:28 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-4[46037]: 2024-09-15T22:29:28.068+0000 7f56f7137640 -1 osd.4 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:04.115107+0000 front 2024-09-15T22:29:04.115060+0000 (oldest deadline 2024-09-15T22:29:27.615300+0000) 2024-09-15T22:29:28.246 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:27 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:27.825+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.212379+0000 front 2024-09-15T22:29:03.212352+0000 (oldest deadline 2024-09-15T22:29:27.312583+0000) 2024-09-15T22:29:28.310 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:28 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:29:28.008+0000 7f4598950640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.010670+0000 front 2024-09-15T22:28:56.010778+0000 (oldest deadline 2024-09-15T22:29:21.310686+0000) 2024-09-15T22:29:28.310 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:28 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:29:28.008+0000 7f4598950640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:01.311227+0000 front 2024-09-15T22:29:01.311237+0000 (oldest deadline 2024-09-15T22:29:26.611171+0000) 2024-09-15T22:29:28.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:28 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:28.067+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:28.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:28 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:28.594+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.903401+0000 front 2024-09-15T22:28:56.903572+0000 (oldest deadline 2024-09-15T22:29:21.603501+0000) 2024-09-15T22:29:28.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:28 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:28.594+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.905425+0000 front 2024-09-15T22:29:03.905051+0000 (oldest deadline 2024-09-15T22:29:28.005184+0000) 2024-09-15T22:29:29.030 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:28 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:28.614+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.408482+0000 front 2024-09-15T22:29:02.408233+0000 (oldest deadline 2024-09-15T22:29:28.308312+0000) 2024-09-15T22:29:29.031 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:28 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:28.669+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:29.106 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:28 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:28.850+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.212379+0000 front 2024-09-15T22:29:03.212352+0000 (oldest deadline 2024-09-15T22:29:27.312583+0000) 2024-09-15T22:29:29.106 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:29 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:29.021+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:29.106 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:29 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:29.021+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:29:29.310 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:29 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:29:29.029+0000 7f4598950640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.010670+0000 front 2024-09-15T22:28:56.010778+0000 (oldest deadline 2024-09-15T22:29:21.310686+0000) 2024-09-15T22:29:29.310 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:29 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:29:29.029+0000 7f4598950640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:01.311227+0000 front 2024-09-15T22:29:01.311237+0000 (oldest deadline 2024-09-15T22:29:26.611171+0000) 2024-09-15T22:29:29.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:29 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:29.070+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:29.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:29 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:29.070+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:29:29.495 INFO:journalctl@ceph.osd.4.smithi012.stdout:Sep 15 22:29:29 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-4[46037]: 2024-09-15T22:29:29.104+0000 7f56f7137640 -1 osd.4 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:04.115107+0000 front 2024-09-15T22:29:04.115060+0000 (oldest deadline 2024-09-15T22:29:27.615300+0000) 2024-09-15T22:29:29.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:29 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:29.566+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.903401+0000 front 2024-09-15T22:28:56.903572+0000 (oldest deadline 2024-09-15T22:29:21.603501+0000) 2024-09-15T22:29:29.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:29 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:29.566+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.905425+0000 front 2024-09-15T22:29:03.905051+0000 (oldest deadline 2024-09-15T22:29:28.005184+0000) 2024-09-15T22:29:30.032 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:29 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:29.663+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.408482+0000 front 2024-09-15T22:29:02.408233+0000 (oldest deadline 2024-09-15T22:29:28.308312+0000) 2024-09-15T22:29:30.032 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:29 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:29.699+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:30.032 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:29 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:29.699+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:29:30.192 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:29 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:29.900+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.212379+0000 front 2024-09-15T22:29:03.212352+0000 (oldest deadline 2024-09-15T22:29:27.312583+0000) 2024-09-15T22:29:30.193 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:30 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:30.045+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:30.193 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:30 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:30.045+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:29:30.310 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:30 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:29:30.031+0000 7f4598950640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.010670+0000 front 2024-09-15T22:28:56.010778+0000 (oldest deadline 2024-09-15T22:29:21.310686+0000) 2024-09-15T22:29:30.310 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:30 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:29:30.031+0000 7f4598950640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:01.311227+0000 front 2024-09-15T22:29:01.311237+0000 (oldest deadline 2024-09-15T22:29:26.611171+0000) 2024-09-15T22:29:30.375 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:30 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:30.110+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:30.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:30 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:30.110+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:29:30.467 INFO:journalctl@ceph.osd.4.smithi012.stdout:Sep 15 22:29:30 smithi012 podman[68333]: 2024-09-15 22:29:30.191140239 +0000 UTC m=+5.514505672 container died 9d21040d36e13224dcdd7353c0fdd5bd9e1bda4cd0f835cb75e04374c5d83f05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-15T22:29:30.745 INFO:journalctl@ceph.osd.4.smithi012.stdout:Sep 15 22:29:30 smithi012 podman[68333]: 2024-09-15 22:29:30.557013334 +0000 UTC m=+5.880378751 container cleanup 9d21040d36e13224dcdd7353c0fdd5bd9e1bda4cd0f835cb75e04374c5d83f05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e) 2024-09-15T22:29:30.745 INFO:journalctl@ceph.osd.4.smithi012.stdout:Sep 15 22:29:30 smithi012 bash[68333]: ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-4 2024-09-15T22:29:30.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:30 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:30.579+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.903401+0000 front 2024-09-15T22:28:56.903572+0000 (oldest deadline 2024-09-15T22:29:21.603501+0000) 2024-09-15T22:29:30.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:30 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:30.579+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.905425+0000 front 2024-09-15T22:29:03.905051+0000 (oldest deadline 2024-09-15T22:29:28.005184+0000) 2024-09-15T22:29:31.026 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:30 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:30.677+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.408482+0000 front 2024-09-15T22:29:02.408233+0000 (oldest deadline 2024-09-15T22:29:28.308312+0000) 2024-09-15T22:29:31.027 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:30 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:30.714+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:31.027 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:30 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:30.714+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:29:31.168 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:30 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:30.923+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.212379+0000 front 2024-09-15T22:29:03.212352+0000 (oldest deadline 2024-09-15T22:29:27.312583+0000) 2024-09-15T22:29:31.168 INFO:journalctl@ceph.osd.4.smithi012.stdout:Sep 15 22:29:30 smithi012 podman[68350]: 2024-09-15 22:29:30.833340068 +0000 UTC m=+0.637755542 container remove 9d21040d36e13224dcdd7353c0fdd5bd9e1bda4cd0f835cb75e04374c5d83f05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-15T22:29:31.168 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:31 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:31.035+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:31.169 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:31 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:31.035+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:29:31.310 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:31 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:29:31.025+0000 7f4598950640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.010670+0000 front 2024-09-15T22:28:56.010778+0000 (oldest deadline 2024-09-15T22:29:21.310686+0000) 2024-09-15T22:29:31.310 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:31 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:29:31.025+0000 7f4598950640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:01.311227+0000 front 2024-09-15T22:29:01.311237+0000 (oldest deadline 2024-09-15T22:29:26.611171+0000) 2024-09-15T22:29:31.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:31 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:31.079+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:31.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:31 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:31.079+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:29:31.479 INFO:journalctl@ceph.osd.4.smithi012.stdout:Sep 15 22:29:31 smithi012 podman[68438]: 2024-09-15 22:29:31.167442735 +0000 UTC m=+0.097508652 container create 1b895f92ef68f945bb08523634a3c332beb2acb174b87acbe94e97ebb3e8975d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e) 2024-09-15T22:29:31.479 INFO:journalctl@ceph.osd.4.smithi012.stdout:Sep 15 22:29:31 smithi012 podman[68438]: 2024-09-15 22:29:31.085613375 +0000 UTC m=+0.015679310 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:29:31.479 INFO:journalctl@ceph.osd.4.smithi012.stdout:Sep 15 22:29:31 smithi012 podman[68438]: 2024-09-15 22:29:31.395047993 +0000 UTC m=+0.325113911 container init 1b895f92ef68f945bb08523634a3c332beb2acb174b87acbe94e97ebb3e8975d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-15T22:29:31.479 INFO:journalctl@ceph.osd.4.smithi012.stdout:Sep 15 22:29:31 smithi012 podman[68438]: 2024-09-15 22:29:31.398463156 +0000 UTC m=+0.328529072 container start 1b895f92ef68f945bb08523634a3c332beb2acb174b87acbe94e97ebb3e8975d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-15T22:29:31.479 INFO:journalctl@ceph.osd.4.smithi012.stdout:Sep 15 22:29:31 smithi012 podman[68438]: 2024-09-15 22:29:31.478215638 +0000 UTC m=+0.408281576 container attach 1b895f92ef68f945bb08523634a3c332beb2acb174b87acbe94e97ebb3e8975d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True) 2024-09-15T22:29:31.745 INFO:journalctl@ceph.osd.4.smithi012.stdout:Sep 15 22:29:31 smithi012 podman[68438]: 2024-09-15 22:29:31.585926663 +0000 UTC m=+0.515992585 container died 1b895f92ef68f945bb08523634a3c332beb2acb174b87acbe94e97ebb3e8975d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, ceph=True, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:29:32.013 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:31 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:31.752+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:32.013 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:31 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:31.752+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:29:32.014 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:31 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:31.694+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.408482+0000 front 2024-09-15T22:29:02.408233+0000 (oldest deadline 2024-09-15T22:29:28.308312+0000) 2024-09-15T22:29:32.079 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:31 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:31.628+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.903401+0000 front 2024-09-15T22:28:56.903572+0000 (oldest deadline 2024-09-15T22:29:21.603501+0000) 2024-09-15T22:29:32.080 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:31 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:31.628+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.905425+0000 front 2024-09-15T22:29:03.905051+0000 (oldest deadline 2024-09-15T22:29:28.005184+0000) 2024-09-15T22:29:32.216 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:31 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:31.874+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.212379+0000 front 2024-09-15T22:29:03.212352+0000 (oldest deadline 2024-09-15T22:29:27.312583+0000) 2024-09-15T22:29:32.216 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:32 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:32.039+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:32.216 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:32 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:32.039+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:29:32.236 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.4.service' 2024-09-15T22:29:32.280 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:29:32.280 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-15T22:29:32.280 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-15T22:29:32.281 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.5 2024-09-15T22:29:32.308 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:32 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:29:32.012+0000 7f4598950640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.010670+0000 front 2024-09-15T22:28:56.010778+0000 (oldest deadline 2024-09-15T22:29:21.310686+0000) 2024-09-15T22:29:32.308 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:32 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:29:32.012+0000 7f4598950640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:01.311227+0000 front 2024-09-15T22:29:01.311237+0000 (oldest deadline 2024-09-15T22:29:26.611171+0000) 2024-09-15T22:29:32.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:32 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:32.078+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:32.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:32 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:32.078+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:29:32.560 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:32 smithi098 systemd[1]: Stopping Ceph osd.5 for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:29:32.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:32 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:32.579+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.903401+0000 front 2024-09-15T22:28:56.903572+0000 (oldest deadline 2024-09-15T22:29:21.603501+0000) 2024-09-15T22:29:32.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:32 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:32.579+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.905425+0000 front 2024-09-15T22:29:03.905051+0000 (oldest deadline 2024-09-15T22:29:28.005184+0000) 2024-09-15T22:29:33.050 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:32 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:32.710+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:33.050 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:32 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:32.710+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:29:33.051 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:32 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:29:32.573+0000 7f459c34b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:29:33.051 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:32 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:29:32.573+0000 7f459c34b640 -1 osd.5 89 *** Got signal Terminated *** 2024-09-15T22:29:33.051 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:32 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:29:32.573+0000 7f459c34b640 -1 osd.5 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:29:33.051 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:32 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:32.710+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.408482+0000 front 2024-09-15T22:29:02.408233+0000 (oldest deadline 2024-09-15T22:29:28.308312+0000) 2024-09-15T22:29:33.245 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:32 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:32.923+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.212379+0000 front 2024-09-15T22:29:03.212352+0000 (oldest deadline 2024-09-15T22:29:27.312583+0000) 2024-09-15T22:29:33.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:33 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:33.050+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:33.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:33 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:33.050+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:29:33.310 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:33 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:29:33.049+0000 7f4598950640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.010670+0000 front 2024-09-15T22:28:56.010778+0000 (oldest deadline 2024-09-15T22:29:21.310686+0000) 2024-09-15T22:29:33.311 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:33 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:29:33.049+0000 7f4598950640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:01.311227+0000 front 2024-09-15T22:29:01.311237+0000 (oldest deadline 2024-09-15T22:29:26.611171+0000) 2024-09-15T22:29:33.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:33 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:33.127+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:33.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:33 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:33.127+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:29:33.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:33 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:33.613+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.903401+0000 front 2024-09-15T22:28:56.903572+0000 (oldest deadline 2024-09-15T22:29:21.603501+0000) 2024-09-15T22:29:33.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:33 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:33.613+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.905425+0000 front 2024-09-15T22:29:03.905051+0000 (oldest deadline 2024-09-15T22:29:28.005184+0000) 2024-09-15T22:29:34.021 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:33 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:33.669+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:34.021 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:33 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:33.669+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:29:34.021 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:33 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:33.720+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.408482+0000 front 2024-09-15T22:29:02.408233+0000 (oldest deadline 2024-09-15T22:29:28.308312+0000) 2024-09-15T22:29:34.245 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:33 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:33.945+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.212379+0000 front 2024-09-15T22:29:03.212352+0000 (oldest deadline 2024-09-15T22:29:27.312583+0000) 2024-09-15T22:29:34.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:34 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:34.075+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:34.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:34 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:34.075+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:29:34.310 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:34 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:29:34.019+0000 7f4598950640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.010670+0000 front 2024-09-15T22:28:56.010778+0000 (oldest deadline 2024-09-15T22:29:21.310686+0000) 2024-09-15T22:29:34.310 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:34 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:29:34.019+0000 7f4598950640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:01.311227+0000 front 2024-09-15T22:29:01.311237+0000 (oldest deadline 2024-09-15T22:29:26.611171+0000) 2024-09-15T22:29:34.311 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:34 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:29:34.019+0000 7f4598950640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:11.113342+0000 front 2024-09-15T22:29:11.113371+0000 (oldest deadline 2024-09-15T22:29:34.013434+0000) 2024-09-15T22:29:34.625 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:34 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:34.162+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:34.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:34 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:34.162+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:29:35.051 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:34 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:34.691+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.408482+0000 front 2024-09-15T22:29:02.408233+0000 (oldest deadline 2024-09-15T22:29:28.308312+0000) 2024-09-15T22:29:35.051 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:34 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:34.648+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:35.052 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:34 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:34.648+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:29:35.126 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:34 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:34.624+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.903401+0000 front 2024-09-15T22:28:56.903572+0000 (oldest deadline 2024-09-15T22:29:21.603501+0000) 2024-09-15T22:29:35.126 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:34 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:34.624+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.905425+0000 front 2024-09-15T22:29:03.905051+0000 (oldest deadline 2024-09-15T22:29:28.005184+0000) 2024-09-15T22:29:35.245 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:34 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:34.975+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.212379+0000 front 2024-09-15T22:29:03.212352+0000 (oldest deadline 2024-09-15T22:29:27.312583+0000) 2024-09-15T22:29:35.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:35 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:35.114+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:35.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:35 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:35.114+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:29:35.310 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:35 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:29:35.050+0000 7f4598950640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.010670+0000 front 2024-09-15T22:28:56.010778+0000 (oldest deadline 2024-09-15T22:29:21.310686+0000) 2024-09-15T22:29:35.310 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:35 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:29:35.050+0000 7f4598950640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:01.311227+0000 front 2024-09-15T22:29:01.311237+0000 (oldest deadline 2024-09-15T22:29:26.611171+0000) 2024-09-15T22:29:35.310 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:35 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:29:35.050+0000 7f4598950640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:11.113342+0000 front 2024-09-15T22:29:11.113371+0000 (oldest deadline 2024-09-15T22:29:34.013434+0000) 2024-09-15T22:29:35.625 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:35 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:35.132+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:35.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:35 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:35.132+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:29:36.060 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:35 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:35.734+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.408482+0000 front 2024-09-15T22:29:02.408233+0000 (oldest deadline 2024-09-15T22:29:28.308312+0000) 2024-09-15T22:29:36.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:35 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:35.629+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:36.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:35 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:35.629+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:29:36.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:35 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:35.629+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:29:36.126 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:35 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:35.668+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.903401+0000 front 2024-09-15T22:28:56.903572+0000 (oldest deadline 2024-09-15T22:29:21.603501+0000) 2024-09-15T22:29:36.126 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:35 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:35.668+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.905425+0000 front 2024-09-15T22:29:03.905051+0000 (oldest deadline 2024-09-15T22:29:28.005184+0000) 2024-09-15T22:29:36.126 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:35 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:35.668+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:10.806824+0000 front 2024-09-15T22:29:10.806793+0000 (oldest deadline 2024-09-15T22:29:35.506784+0000) 2024-09-15T22:29:36.245 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:35 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:35.960+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.212379+0000 front 2024-09-15T22:29:03.212352+0000 (oldest deadline 2024-09-15T22:29:27.312583+0000) 2024-09-15T22:29:36.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:36 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:36.079+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:36.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:36 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:36.079+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:29:36.560 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:36 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:29:36.098+0000 7f4598950640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.010670+0000 front 2024-09-15T22:28:56.010778+0000 (oldest deadline 2024-09-15T22:29:21.310686+0000) 2024-09-15T22:29:36.561 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:36 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:29:36.098+0000 7f4598950640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:01.311227+0000 front 2024-09-15T22:29:01.311237+0000 (oldest deadline 2024-09-15T22:29:26.611171+0000) 2024-09-15T22:29:36.561 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:36 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:29:36.098+0000 7f4598950640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:11.113342+0000 front 2024-09-15T22:29:11.113371+0000 (oldest deadline 2024-09-15T22:29:34.013434+0000) 2024-09-15T22:29:36.625 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:36 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:36.142+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:36.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:36 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:36.142+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:29:37.060 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:36 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:36.746+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.408482+0000 front 2024-09-15T22:29:02.408233+0000 (oldest deadline 2024-09-15T22:29:28.308312+0000) 2024-09-15T22:29:37.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:36 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:36.592+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:37.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:36 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:36.592+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:29:37.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:36 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:36.592+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:29:37.126 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:36 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:36.693+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.903401+0000 front 2024-09-15T22:28:56.903572+0000 (oldest deadline 2024-09-15T22:29:21.603501+0000) 2024-09-15T22:29:37.126 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:36 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:36.693+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.905425+0000 front 2024-09-15T22:29:03.905051+0000 (oldest deadline 2024-09-15T22:29:28.005184+0000) 2024-09-15T22:29:37.126 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:36 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:36.693+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:10.806824+0000 front 2024-09-15T22:29:10.806793+0000 (oldest deadline 2024-09-15T22:29:35.506784+0000) 2024-09-15T22:29:37.495 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:37 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:37.002+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.212379+0000 front 2024-09-15T22:29:03.212352+0000 (oldest deadline 2024-09-15T22:29:27.312583+0000) 2024-09-15T22:29:37.495 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:37 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:37.118+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:37.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:37 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:37.118+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:29:37.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:37 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:37.118+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:29:37.560 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:37 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:29:37.117+0000 7f4598950640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.010670+0000 front 2024-09-15T22:28:56.010778+0000 (oldest deadline 2024-09-15T22:29:21.310686+0000) 2024-09-15T22:29:37.560 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:37 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:29:37.117+0000 7f4598950640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:01.311227+0000 front 2024-09-15T22:29:01.311237+0000 (oldest deadline 2024-09-15T22:29:26.611171+0000) 2024-09-15T22:29:37.561 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:37 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5[47041]: 2024-09-15T22:29:37.117+0000 7f4598950640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:11.113342+0000 front 2024-09-15T22:29:11.113371+0000 (oldest deadline 2024-09-15T22:29:34.013434+0000) 2024-09-15T22:29:37.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:37 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:37.158+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:37.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:37 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:37.158+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:29:37.980 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:37 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:37.765+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.408482+0000 front 2024-09-15T22:29:02.408233+0000 (oldest deadline 2024-09-15T22:29:28.308312+0000) 2024-09-15T22:29:37.980 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:37 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:37.625+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:37.980 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:37 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:37.625+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:29:37.981 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:37 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:37.625+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:29:38.126 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:37 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:37.645+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.903401+0000 front 2024-09-15T22:28:56.903572+0000 (oldest deadline 2024-09-15T22:29:21.603501+0000) 2024-09-15T22:29:38.126 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:37 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:37.645+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.905425+0000 front 2024-09-15T22:29:03.905051+0000 (oldest deadline 2024-09-15T22:29:28.005184+0000) 2024-09-15T22:29:38.126 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:37 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:37.645+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:10.806824+0000 front 2024-09-15T22:29:10.806793+0000 (oldest deadline 2024-09-15T22:29:35.506784+0000) 2024-09-15T22:29:38.258 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:37 smithi098 podman[69497]: 2024-09-15 22:29:37.979333048 +0000 UTC m=+5.501824232 container died e086eae72b1bcc1c7b9ad61bc7b287fe97e57307fb1a273f2ef4ad998bfc72e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-15T22:29:38.495 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:38 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:38.017+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.212379+0000 front 2024-09-15T22:29:03.212352+0000 (oldest deadline 2024-09-15T22:29:27.312583+0000) 2024-09-15T22:29:38.495 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:38 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:38.074+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:38.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:38 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:38.074+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:29:38.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:38 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:38.074+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:29:38.525 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:38 smithi098 podman[69497]: 2024-09-15 22:29:38.332067828 +0000 UTC m=+5.854558996 container cleanup e086eae72b1bcc1c7b9ad61bc7b287fe97e57307fb1a273f2ef4ad998bfc72e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:29:38.526 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:38 smithi098 bash[69497]: ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5 2024-09-15T22:29:38.617 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:38 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:38.171+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:38.617 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:38 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:38.171+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:29:38.811 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:38 smithi098 podman[69514]: 2024-09-15 22:29:38.524922983 +0000 UTC m=+0.534912501 container remove e086eae72b1bcc1c7b9ad61bc7b287fe97e57307fb1a273f2ef4ad998bfc72e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0) 2024-09-15T22:29:38.811 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:38 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:38.584+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:38.811 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:38 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:38.584+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:29:38.811 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:38 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:38.584+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:29:38.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:38 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:38.616+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.903401+0000 front 2024-09-15T22:28:56.903572+0000 (oldest deadline 2024-09-15T22:29:21.603501+0000) 2024-09-15T22:29:38.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:38 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:38.616+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.905425+0000 front 2024-09-15T22:29:03.905051+0000 (oldest deadline 2024-09-15T22:29:28.005184+0000) 2024-09-15T22:29:38.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:38 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:38.616+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:10.806824+0000 front 2024-09-15T22:29:10.806793+0000 (oldest deadline 2024-09-15T22:29:35.506784+0000) 2024-09-15T22:29:39.078 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:38 smithi098 podman[69601]: 2024-09-15 22:29:38.842446404 +0000 UTC m=+0.015567543 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:29:39.078 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:38 smithi098 podman[69601]: 2024-09-15 22:29:38.950740983 +0000 UTC m=+0.123862109 container create 5b0acef3522b60800a3b85a04e5b808d0a105e1944ed953d5858427ec9e16038 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-15T22:29:39.078 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:38 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:38.811+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.408482+0000 front 2024-09-15T22:29:02.408233+0000 (oldest deadline 2024-09-15T22:29:28.308312+0000) 2024-09-15T22:29:39.079 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:38 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:38.811+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.909589+0000 front 2024-09-15T22:29:12.909663+0000 (oldest deadline 2024-09-15T22:29:38.209717+0000) 2024-09-15T22:29:39.495 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:39 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:39.066+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.212379+0000 front 2024-09-15T22:29:03.212352+0000 (oldest deadline 2024-09-15T22:29:27.312583+0000) 2024-09-15T22:29:39.495 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:39 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:39.066+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.013621+0000 front 2024-09-15T22:29:12.013766+0000 (oldest deadline 2024-09-15T22:29:38.414145+0000) 2024-09-15T22:29:39.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:39 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:39.051+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:39.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:39 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:39.051+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:29:39.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:39 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:39.051+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:29:39.538 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:39 smithi098 podman[69601]: 2024-09-15 22:29:39.153282482 +0000 UTC m=+0.326403624 container init 5b0acef3522b60800a3b85a04e5b808d0a105e1944ed953d5858427ec9e16038 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e) 2024-09-15T22:29:39.538 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:39 smithi098 podman[69601]: 2024-09-15 22:29:39.156852613 +0000 UTC m=+0.329973748 container start 5b0acef3522b60800a3b85a04e5b808d0a105e1944ed953d5858427ec9e16038 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-15T22:29:39.538 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:39 smithi098 podman[69601]: 2024-09-15 22:29:39.228058873 +0000 UTC m=+0.401180009 container attach 5b0acef3522b60800a3b85a04e5b808d0a105e1944ed953d5858427ec9e16038 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-15T22:29:39.538 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 15 22:29:39 smithi098 podman[69601]: 2024-09-15 22:29:39.353363 +0000 UTC m=+0.526484136 container died 5b0acef3522b60800a3b85a04e5b808d0a105e1944ed953d5858427ec9e16038 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-15T22:29:39.587 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:39 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:39.168+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:39.587 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:39 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:39.168+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:29:39.587 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:39 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:39.168+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.755660+0000 front 2024-09-15T22:29:12.755596+0000 (oldest deadline 2024-09-15T22:29:38.655769+0000) 2024-09-15T22:29:39.811 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:39 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:39.778+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.408482+0000 front 2024-09-15T22:29:02.408233+0000 (oldest deadline 2024-09-15T22:29:28.308312+0000) 2024-09-15T22:29:39.811 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:39 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:39.778+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.909589+0000 front 2024-09-15T22:29:12.909663+0000 (oldest deadline 2024-09-15T22:29:38.209717+0000) 2024-09-15T22:29:39.811 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:39 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:39.536+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:39.811 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:39 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:39.536+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:29:39.811 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:39 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:39.536+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:29:39.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:39 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:39.586+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.903401+0000 front 2024-09-15T22:28:56.903572+0000 (oldest deadline 2024-09-15T22:29:21.603501+0000) 2024-09-15T22:29:39.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:39 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:39.586+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.905425+0000 front 2024-09-15T22:29:03.905051+0000 (oldest deadline 2024-09-15T22:29:28.005184+0000) 2024-09-15T22:29:39.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:39 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:39.586+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:10.806824+0000 front 2024-09-15T22:29:10.806793+0000 (oldest deadline 2024-09-15T22:29:35.506784+0000) 2024-09-15T22:29:39.969 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.5.service' 2024-09-15T22:29:40.054 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:29:40.054 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-15T22:29:40.054 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-15T22:29:40.055 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.6 2024-09-15T22:29:40.376 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:40 smithi001 systemd[1]: Stopping Ceph osd.6 for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:29:40.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:40 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:40.122+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:40.377 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:40 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:40.122+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:29:40.377 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:40 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:40.122+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.755660+0000 front 2024-09-15T22:29:12.755596+0000 (oldest deadline 2024-09-15T22:29:38.655769+0000) 2024-09-15T22:29:40.495 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:40 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:40.067+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.212379+0000 front 2024-09-15T22:29:03.212352+0000 (oldest deadline 2024-09-15T22:29:27.312583+0000) 2024-09-15T22:29:40.496 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:40 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:40.067+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.013621+0000 front 2024-09-15T22:29:12.013766+0000 (oldest deadline 2024-09-15T22:29:38.414145+0000) 2024-09-15T22:29:40.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:40 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:40.058+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:40.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:40 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:40.058+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:29:40.497 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:40 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:40.058+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:29:40.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:40 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:40.497+0000 7f2a40000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:29:40.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:40 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:40.497+0000 7f2a40000640 -1 osd.6 89 *** Got signal Terminated *** 2024-09-15T22:29:40.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:40 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:40.497+0000 7f2a40000640 -1 osd.6 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:29:40.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:40 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:40.571+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.903401+0000 front 2024-09-15T22:28:56.903572+0000 (oldest deadline 2024-09-15T22:29:21.603501+0000) 2024-09-15T22:29:40.877 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:40 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:40.571+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.905425+0000 front 2024-09-15T22:29:03.905051+0000 (oldest deadline 2024-09-15T22:29:28.005184+0000) 2024-09-15T22:29:40.877 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:40 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:40.571+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:10.806824+0000 front 2024-09-15T22:29:10.806793+0000 (oldest deadline 2024-09-15T22:29:35.506784+0000) 2024-09-15T22:29:41.060 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:40 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:40.791+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.408482+0000 front 2024-09-15T22:29:02.408233+0000 (oldest deadline 2024-09-15T22:29:28.308312+0000) 2024-09-15T22:29:41.060 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:40 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:40.791+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.909589+0000 front 2024-09-15T22:29:12.909663+0000 (oldest deadline 2024-09-15T22:29:38.209717+0000) 2024-09-15T22:29:41.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:40 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:40.585+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:41.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:40 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:40.585+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:29:41.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:40 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:40.585+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:29:41.495 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:41 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:41.073+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.212379+0000 front 2024-09-15T22:29:03.212352+0000 (oldest deadline 2024-09-15T22:29:27.312583+0000) 2024-09-15T22:29:41.495 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:41 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:41.073+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.013621+0000 front 2024-09-15T22:29:12.013766+0000 (oldest deadline 2024-09-15T22:29:38.414145+0000) 2024-09-15T22:29:41.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:41 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:41.105+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:41.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:41 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:41.105+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:29:41.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:41 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:41.105+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:29:41.603 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:41 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:41.157+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:41.603 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:41 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:41.157+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:29:41.604 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:41 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:41.157+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.755660+0000 front 2024-09-15T22:29:12.755596+0000 (oldest deadline 2024-09-15T22:29:38.655769+0000) 2024-09-15T22:29:41.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:41 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:41.601+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.903401+0000 front 2024-09-15T22:28:56.903572+0000 (oldest deadline 2024-09-15T22:29:21.603501+0000) 2024-09-15T22:29:41.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:41 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:41.601+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.905425+0000 front 2024-09-15T22:29:03.905051+0000 (oldest deadline 2024-09-15T22:29:28.005184+0000) 2024-09-15T22:29:41.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:41 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:41.601+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:10.806824+0000 front 2024-09-15T22:29:10.806793+0000 (oldest deadline 2024-09-15T22:29:35.506784+0000) 2024-09-15T22:29:42.060 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:41 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:41.784+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.408482+0000 front 2024-09-15T22:29:02.408233+0000 (oldest deadline 2024-09-15T22:29:28.308312+0000) 2024-09-15T22:29:42.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:41 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:41.784+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.909589+0000 front 2024-09-15T22:29:12.909663+0000 (oldest deadline 2024-09-15T22:29:38.209717+0000) 2024-09-15T22:29:42.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:41 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:41.633+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:42.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:41 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:41.633+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:29:42.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:41 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:41.633+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:29:42.495 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:42 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:42.120+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.212379+0000 front 2024-09-15T22:29:03.212352+0000 (oldest deadline 2024-09-15T22:29:27.312583+0000) 2024-09-15T22:29:42.496 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:42 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:42.120+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.013621+0000 front 2024-09-15T22:29:12.013766+0000 (oldest deadline 2024-09-15T22:29:38.414145+0000) 2024-09-15T22:29:42.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:42 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:42.068+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:42.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:42 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:42.068+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:29:42.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:42 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:42.068+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:29:42.554 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:42 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:42.138+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:42.554 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:42 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:42.138+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:29:42.554 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:42 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:42.138+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.755660+0000 front 2024-09-15T22:29:12.755596+0000 (oldest deadline 2024-09-15T22:29:38.655769+0000) 2024-09-15T22:29:42.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:42 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:42.553+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.903401+0000 front 2024-09-15T22:28:56.903572+0000 (oldest deadline 2024-09-15T22:29:21.603501+0000) 2024-09-15T22:29:42.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:42 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:42.553+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.905425+0000 front 2024-09-15T22:29:03.905051+0000 (oldest deadline 2024-09-15T22:29:28.005184+0000) 2024-09-15T22:29:42.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:42 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:42.553+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:10.806824+0000 front 2024-09-15T22:29:10.806793+0000 (oldest deadline 2024-09-15T22:29:35.506784+0000) 2024-09-15T22:29:42.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:42 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:42.553+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:17.207782+0000 front 2024-09-15T22:29:17.207849+0000 (oldest deadline 2024-09-15T22:29:42.507888+0000) 2024-09-15T22:29:43.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:42 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:42.747+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.408482+0000 front 2024-09-15T22:29:02.408233+0000 (oldest deadline 2024-09-15T22:29:28.308312+0000) 2024-09-15T22:29:43.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:42 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:42.747+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.909589+0000 front 2024-09-15T22:29:12.909663+0000 (oldest deadline 2024-09-15T22:29:38.209717+0000) 2024-09-15T22:29:43.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:42 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:42.664+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:43.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:42 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:42.664+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:29:43.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:42 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:42.664+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:29:43.495 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:43 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:43.142+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.212379+0000 front 2024-09-15T22:29:03.212352+0000 (oldest deadline 2024-09-15T22:29:27.312583+0000) 2024-09-15T22:29:43.496 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:43 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:43.142+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.013621+0000 front 2024-09-15T22:29:12.013766+0000 (oldest deadline 2024-09-15T22:29:38.414145+0000) 2024-09-15T22:29:43.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:43 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:43.115+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:43.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:43 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:43.115+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:29:43.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:43 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:43.115+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:29:43.559 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:43 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:43.184+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:43.559 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:43 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:43.184+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:29:43.559 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:43 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:43.184+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.755660+0000 front 2024-09-15T22:29:12.755596+0000 (oldest deadline 2024-09-15T22:29:38.655769+0000) 2024-09-15T22:29:43.559 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:43 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:43.184+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.656200+0000 front 2024-09-15T22:29:18.656345+0000 (oldest deadline 2024-09-15T22:29:42.756132+0000) 2024-09-15T22:29:43.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:43 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:43.558+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.903401+0000 front 2024-09-15T22:28:56.903572+0000 (oldest deadline 2024-09-15T22:29:21.603501+0000) 2024-09-15T22:29:43.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:43 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:43.558+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.905425+0000 front 2024-09-15T22:29:03.905051+0000 (oldest deadline 2024-09-15T22:29:28.005184+0000) 2024-09-15T22:29:43.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:43 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:43.558+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:10.806824+0000 front 2024-09-15T22:29:10.806793+0000 (oldest deadline 2024-09-15T22:29:35.506784+0000) 2024-09-15T22:29:43.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:43 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:43.558+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:17.207782+0000 front 2024-09-15T22:29:17.207849+0000 (oldest deadline 2024-09-15T22:29:42.507888+0000) 2024-09-15T22:29:44.060 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:43 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:43.738+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.408482+0000 front 2024-09-15T22:29:02.408233+0000 (oldest deadline 2024-09-15T22:29:28.308312+0000) 2024-09-15T22:29:44.060 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:43 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:43.738+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.909589+0000 front 2024-09-15T22:29:12.909663+0000 (oldest deadline 2024-09-15T22:29:38.209717+0000) 2024-09-15T22:29:44.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:43 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:43.626+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:44.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:43 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:43.626+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:29:44.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:43 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:43.626+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:29:44.495 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:44 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:44.123+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.212379+0000 front 2024-09-15T22:29:03.212352+0000 (oldest deadline 2024-09-15T22:29:27.312583+0000) 2024-09-15T22:29:44.496 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:44 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:44.123+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.013621+0000 front 2024-09-15T22:29:12.013766+0000 (oldest deadline 2024-09-15T22:29:38.414145+0000) 2024-09-15T22:29:44.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:44 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:44.090+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:44.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:44 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:44.090+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:29:44.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:44 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:44.090+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:29:44.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:44 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:44.090+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.446800+0000 front 2024-09-15T22:29:18.446729+0000 (oldest deadline 2024-09-15T22:29:43.146500+0000) 2024-09-15T22:29:44.606 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:44 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:44.191+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:44.607 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:44 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:44.191+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:29:44.607 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:44 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:44.191+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.755660+0000 front 2024-09-15T22:29:12.755596+0000 (oldest deadline 2024-09-15T22:29:38.655769+0000) 2024-09-15T22:29:44.607 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:44 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:44.191+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.656200+0000 front 2024-09-15T22:29:18.656345+0000 (oldest deadline 2024-09-15T22:29:42.756132+0000) 2024-09-15T22:29:44.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:44 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:44.605+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:56.903401+0000 front 2024-09-15T22:28:56.903572+0000 (oldest deadline 2024-09-15T22:29:21.603501+0000) 2024-09-15T22:29:44.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:44 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:44.605+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.905425+0000 front 2024-09-15T22:29:03.905051+0000 (oldest deadline 2024-09-15T22:29:28.005184+0000) 2024-09-15T22:29:44.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:44 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:44.605+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:10.806824+0000 front 2024-09-15T22:29:10.806793+0000 (oldest deadline 2024-09-15T22:29:35.506784+0000) 2024-09-15T22:29:44.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:44 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6[55315]: 2024-09-15T22:29:44.605+0000 7f2a3ba00640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:17.207782+0000 front 2024-09-15T22:29:17.207849+0000 (oldest deadline 2024-09-15T22:29:42.507888+0000) 2024-09-15T22:29:45.060 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:44 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:44.737+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.408482+0000 front 2024-09-15T22:29:02.408233+0000 (oldest deadline 2024-09-15T22:29:28.308312+0000) 2024-09-15T22:29:45.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:44 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:44.737+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.909589+0000 front 2024-09-15T22:29:12.909663+0000 (oldest deadline 2024-09-15T22:29:38.209717+0000) 2024-09-15T22:29:45.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:44 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:44.737+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.210350+0000 front 2024-09-15T22:29:18.210464+0000 (oldest deadline 2024-09-15T22:29:44.110380+0000) 2024-09-15T22:29:45.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:44 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:44.604+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:45.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:44 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:44.604+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:29:45.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:44 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:44.604+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:29:45.495 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:45 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:45.105+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.212379+0000 front 2024-09-15T22:29:03.212352+0000 (oldest deadline 2024-09-15T22:29:27.312583+0000) 2024-09-15T22:29:45.496 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:45 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:45.105+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.013621+0000 front 2024-09-15T22:29:12.013766+0000 (oldest deadline 2024-09-15T22:29:38.414145+0000) 2024-09-15T22:29:45.496 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:45 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:45.105+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:20.115221+0000 front 2024-09-15T22:29:20.115171+0000 (oldest deadline 2024-09-15T22:29:44.815004+0000) 2024-09-15T22:29:45.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:45 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:45.059+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:45.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:45 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:45.059+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:29:45.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:45 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:45.059+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:29:45.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:45 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:45.059+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.446800+0000 front 2024-09-15T22:29:18.446729+0000 (oldest deadline 2024-09-15T22:29:43.146500+0000) 2024-09-15T22:29:45.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:45 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:45.143+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:45.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:45 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:45.143+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:29:45.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:45 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:45.143+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.755660+0000 front 2024-09-15T22:29:12.755596+0000 (oldest deadline 2024-09-15T22:29:38.655769+0000) 2024-09-15T22:29:45.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:45 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:45.143+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.656200+0000 front 2024-09-15T22:29:18.656345+0000 (oldest deadline 2024-09-15T22:29:42.756132+0000) 2024-09-15T22:29:45.810 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:45 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:45.556+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:45.810 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:45 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:45.556+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:29:45.811 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:45 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:45.556+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:29:45.811 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:45 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:45.556+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:29:45.811 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:45 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:45.707+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.408482+0000 front 2024-09-15T22:29:02.408233+0000 (oldest deadline 2024-09-15T22:29:28.308312+0000) 2024-09-15T22:29:45.811 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:45 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:45.707+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.909589+0000 front 2024-09-15T22:29:12.909663+0000 (oldest deadline 2024-09-15T22:29:38.209717+0000) 2024-09-15T22:29:45.811 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:45 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:45.707+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.210350+0000 front 2024-09-15T22:29:18.210464+0000 (oldest deadline 2024-09-15T22:29:44.110380+0000) 2024-09-15T22:29:46.256 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:46 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:46.165+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:46.256 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:46 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:46.165+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:29:46.256 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:46 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:46.165+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.755660+0000 front 2024-09-15T22:29:12.755596+0000 (oldest deadline 2024-09-15T22:29:38.655769+0000) 2024-09-15T22:29:46.256 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:46 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:46.165+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.656200+0000 front 2024-09-15T22:29:18.656345+0000 (oldest deadline 2024-09-15T22:29:42.756132+0000) 2024-09-15T22:29:46.256 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:45 smithi001 podman[83952]: 2024-09-15 22:29:45.965614581 +0000 UTC m=+5.614879956 container died d5601d38dfd270b3503a733e763c7a936c46f302fc39c94bef42651facff6e46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e) 2024-09-15T22:29:46.495 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:46 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:46.140+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.212379+0000 front 2024-09-15T22:29:03.212352+0000 (oldest deadline 2024-09-15T22:29:27.312583+0000) 2024-09-15T22:29:46.496 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:46 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:46.140+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.013621+0000 front 2024-09-15T22:29:12.013766+0000 (oldest deadline 2024-09-15T22:29:38.414145+0000) 2024-09-15T22:29:46.496 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:46 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:46.140+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:20.115221+0000 front 2024-09-15T22:29:20.115171+0000 (oldest deadline 2024-09-15T22:29:44.815004+0000) 2024-09-15T22:29:46.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:46 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:46.067+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:46.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:46 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:46.067+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:29:46.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:46 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:46.067+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:29:46.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:46 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:46.067+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.446800+0000 front 2024-09-15T22:29:18.446729+0000 (oldest deadline 2024-09-15T22:29:43.146500+0000) 2024-09-15T22:29:46.508 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:46 smithi001 podman[83952]: 2024-09-15 22:29:46.502128994 +0000 UTC m=+6.151394367 container cleanup d5601d38dfd270b3503a733e763c7a936c46f302fc39c94bef42651facff6e46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2) 2024-09-15T22:29:46.508 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:46 smithi001 bash[83952]: ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6 2024-09-15T22:29:46.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:46 smithi001 podman[83971]: 2024-09-15 22:29:46.750964362 +0000 UTC m=+0.771869011 container remove d5601d38dfd270b3503a733e763c7a936c46f302fc39c94bef42651facff6e46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0) 2024-09-15T22:29:47.060 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:46 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:46.594+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:47.060 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:46 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:46.594+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:29:47.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:46 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:46.594+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:29:47.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:46 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:46.594+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:29:47.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:46 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:46.741+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.408482+0000 front 2024-09-15T22:29:02.408233+0000 (oldest deadline 2024-09-15T22:29:28.308312+0000) 2024-09-15T22:29:47.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:46 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:46.741+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.909589+0000 front 2024-09-15T22:29:12.909663+0000 (oldest deadline 2024-09-15T22:29:38.209717+0000) 2024-09-15T22:29:47.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:46 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:46.741+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.210350+0000 front 2024-09-15T22:29:18.210464+0000 (oldest deadline 2024-09-15T22:29:44.110380+0000) 2024-09-15T22:29:47.459 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:47 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:47.177+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:47.459 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:47 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:47.177+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:29:47.459 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:47 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:47.177+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.755660+0000 front 2024-09-15T22:29:12.755596+0000 (oldest deadline 2024-09-15T22:29:38.655769+0000) 2024-09-15T22:29:47.459 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:47 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:47.177+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.656200+0000 front 2024-09-15T22:29:18.656345+0000 (oldest deadline 2024-09-15T22:29:42.756132+0000) 2024-09-15T22:29:47.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:47 smithi001 podman[84058]: 2024-09-15 22:29:47.226404515 +0000 UTC m=+0.027176586 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:29:47.460 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:47 smithi001 podman[84058]: 2024-09-15 22:29:47.329316511 +0000 UTC m=+0.130088581 container create f31b643c0848ad92c970e0920131f7e5593bee826f9ebc59772880f40a741610 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-15T22:29:47.495 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:47 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:47.186+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.212379+0000 front 2024-09-15T22:29:03.212352+0000 (oldest deadline 2024-09-15T22:29:27.312583+0000) 2024-09-15T22:29:47.495 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:47 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:47.186+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.013621+0000 front 2024-09-15T22:29:12.013766+0000 (oldest deadline 2024-09-15T22:29:38.414145+0000) 2024-09-15T22:29:47.496 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:47 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:47.186+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:20.115221+0000 front 2024-09-15T22:29:20.115171+0000 (oldest deadline 2024-09-15T22:29:44.815004+0000) 2024-09-15T22:29:47.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:47 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:47.041+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:47.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:47 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:47.041+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:29:47.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:47 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:47.041+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:29:47.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:47 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:47.041+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.446800+0000 front 2024-09-15T22:29:18.446729+0000 (oldest deadline 2024-09-15T22:29:43.146500+0000) 2024-09-15T22:29:47.716 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:47 smithi001 podman[84058]: 2024-09-15 22:29:47.598679744 +0000 UTC m=+0.399451816 container init f31b643c0848ad92c970e0920131f7e5593bee826f9ebc59772880f40a741610 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:29:47.716 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:47 smithi001 podman[84058]: 2024-09-15 22:29:47.605623583 +0000 UTC m=+0.406395655 container start f31b643c0848ad92c970e0920131f7e5593bee826f9ebc59772880f40a741610 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-15T22:29:47.716 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:47 smithi001 podman[84058]: 2024-09-15 22:29:47.714997539 +0000 UTC m=+0.515769633 container attach f31b643c0848ad92c970e0920131f7e5593bee826f9ebc59772880f40a741610 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:29:48.060 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:47 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:47.732+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.408482+0000 front 2024-09-15T22:29:02.408233+0000 (oldest deadline 2024-09-15T22:29:28.308312+0000) 2024-09-15T22:29:48.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:47 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:47.732+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.909589+0000 front 2024-09-15T22:29:12.909663+0000 (oldest deadline 2024-09-15T22:29:38.209717+0000) 2024-09-15T22:29:48.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:47 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:47.732+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.210350+0000 front 2024-09-15T22:29:18.210464+0000 (oldest deadline 2024-09-15T22:29:44.110380+0000) 2024-09-15T22:29:48.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:47 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:47.643+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:48.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:47 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:47.643+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:29:48.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:47 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:47.643+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:29:48.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:47 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:47.643+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:29:48.126 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 15 22:29:47 smithi001 podman[84058]: 2024-09-15 22:29:47.876079841 +0000 UTC m=+0.676851912 container died f31b643c0848ad92c970e0920131f7e5593bee826f9ebc59772880f40a741610 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-6-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e) 2024-09-15T22:29:48.496 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:48 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:48.185+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.212379+0000 front 2024-09-15T22:29:03.212352+0000 (oldest deadline 2024-09-15T22:29:27.312583+0000) 2024-09-15T22:29:48.496 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:48 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:48.185+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.013621+0000 front 2024-09-15T22:29:12.013766+0000 (oldest deadline 2024-09-15T22:29:38.414145+0000) 2024-09-15T22:29:48.496 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:48 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:48.185+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:20.115221+0000 front 2024-09-15T22:29:20.115171+0000 (oldest deadline 2024-09-15T22:29:44.815004+0000) 2024-09-15T22:29:48.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:48 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:48.029+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:48.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:48 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:48.029+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:29:48.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:48 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:48.029+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:29:48.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:48 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:48.029+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.446800+0000 front 2024-09-15T22:29:18.446729+0000 (oldest deadline 2024-09-15T22:29:43.146500+0000) 2024-09-15T22:29:48.586 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:48 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:48.185+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:48.587 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:48 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:48.185+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:29:48.587 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:48 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:48.185+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.755660+0000 front 2024-09-15T22:29:12.755596+0000 (oldest deadline 2024-09-15T22:29:38.655769+0000) 2024-09-15T22:29:48.587 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:48 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:48.185+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.656200+0000 front 2024-09-15T22:29:18.656345+0000 (oldest deadline 2024-09-15T22:29:42.756132+0000) 2024-09-15T22:29:48.621 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.6.service' 2024-09-15T22:29:48.697 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:29:48.697 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-15T22:29:48.697 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-15T22:29:48.697 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.7 2024-09-15T22:29:48.992 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:48 smithi012 systemd[1]: Stopping Ceph osd.7 for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:29:49.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:48 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:48.768+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.408482+0000 front 2024-09-15T22:29:02.408233+0000 (oldest deadline 2024-09-15T22:29:28.308312+0000) 2024-09-15T22:29:49.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:48 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:48.768+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.909589+0000 front 2024-09-15T22:29:12.909663+0000 (oldest deadline 2024-09-15T22:29:38.209717+0000) 2024-09-15T22:29:49.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:48 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:48.768+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.210350+0000 front 2024-09-15T22:29:18.210464+0000 (oldest deadline 2024-09-15T22:29:44.110380+0000) 2024-09-15T22:29:49.062 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:48 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:48.689+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:49.062 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:48 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:48.689+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:29:49.062 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:48 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:48.689+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:29:49.062 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:48 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:48.689+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:29:49.245 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:48 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:48.990+0000 7f8635506640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:29:49.246 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:48 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:48.990+0000 7f8635506640 -1 osd.7 89 *** Got signal Terminated *** 2024-09-15T22:29:49.246 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:48 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:48.990+0000 7f8635506640 -1 osd.7 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:29:49.246 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:49 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:49.203+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.212379+0000 front 2024-09-15T22:29:03.212352+0000 (oldest deadline 2024-09-15T22:29:27.312583+0000) 2024-09-15T22:29:49.246 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:49 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:49.203+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.013621+0000 front 2024-09-15T22:29:12.013766+0000 (oldest deadline 2024-09-15T22:29:38.414145+0000) 2024-09-15T22:29:49.246 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:49 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:49.203+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:20.115221+0000 front 2024-09-15T22:29:20.115171+0000 (oldest deadline 2024-09-15T22:29:44.815004+0000) 2024-09-15T22:29:49.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:49 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:49.012+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:49.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:49 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:49.012+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:29:49.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:49 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:49.012+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:29:49.247 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:49 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:49.012+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.446800+0000 front 2024-09-15T22:29:18.446729+0000 (oldest deadline 2024-09-15T22:29:43.146500+0000) 2024-09-15T22:29:49.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:49 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:49.177+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:49.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:49 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:49.177+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:29:49.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:49 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:49.177+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.755660+0000 front 2024-09-15T22:29:12.755596+0000 (oldest deadline 2024-09-15T22:29:38.655769+0000) 2024-09-15T22:29:49.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:49 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:49.177+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.656200+0000 front 2024-09-15T22:29:18.656345+0000 (oldest deadline 2024-09-15T22:29:42.756132+0000) 2024-09-15T22:29:50.060 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:49 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:49.755+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.408482+0000 front 2024-09-15T22:29:02.408233+0000 (oldest deadline 2024-09-15T22:29:28.308312+0000) 2024-09-15T22:29:50.060 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:49 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:49.755+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.909589+0000 front 2024-09-15T22:29:12.909663+0000 (oldest deadline 2024-09-15T22:29:38.209717+0000) 2024-09-15T22:29:50.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:49 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:49.755+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.210350+0000 front 2024-09-15T22:29:18.210464+0000 (oldest deadline 2024-09-15T22:29:44.110380+0000) 2024-09-15T22:29:50.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:49 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:49.678+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:50.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:49 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:49.678+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:29:50.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:49 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:49.678+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:29:50.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:49 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:49.678+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:29:50.495 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:50 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:50.237+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.212379+0000 front 2024-09-15T22:29:03.212352+0000 (oldest deadline 2024-09-15T22:29:27.312583+0000) 2024-09-15T22:29:50.495 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:50 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:50.237+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.013621+0000 front 2024-09-15T22:29:12.013766+0000 (oldest deadline 2024-09-15T22:29:38.414145+0000) 2024-09-15T22:29:50.496 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:50 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:50.237+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:20.115221+0000 front 2024-09-15T22:29:20.115171+0000 (oldest deadline 2024-09-15T22:29:44.815004+0000) 2024-09-15T22:29:50.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:50 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:50.057+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:50.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:50 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:50.057+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:29:50.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:50 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:50.057+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:29:50.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:50 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:50.057+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.446800+0000 front 2024-09-15T22:29:18.446729+0000 (oldest deadline 2024-09-15T22:29:43.146500+0000) 2024-09-15T22:29:50.627 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:50 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:50.162+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:50.627 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:50 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:50.162+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:29:50.627 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:50 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:50.162+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.755660+0000 front 2024-09-15T22:29:12.755596+0000 (oldest deadline 2024-09-15T22:29:38.655769+0000) 2024-09-15T22:29:50.627 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:50 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:50.162+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.656200+0000 front 2024-09-15T22:29:18.656345+0000 (oldest deadline 2024-09-15T22:29:42.756132+0000) 2024-09-15T22:29:51.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:50 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:50.768+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.408482+0000 front 2024-09-15T22:29:02.408233+0000 (oldest deadline 2024-09-15T22:29:28.308312+0000) 2024-09-15T22:29:51.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:50 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:50.768+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.909589+0000 front 2024-09-15T22:29:12.909663+0000 (oldest deadline 2024-09-15T22:29:38.209717+0000) 2024-09-15T22:29:51.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:50 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:50.768+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.210350+0000 front 2024-09-15T22:29:18.210464+0000 (oldest deadline 2024-09-15T22:29:44.110380+0000) 2024-09-15T22:29:51.062 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:50 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:50.727+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:51.062 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:50 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:50.727+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:29:51.062 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:50 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:50.727+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:29:51.062 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:50 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:50.727+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:29:51.495 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:51 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:51.269+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.212379+0000 front 2024-09-15T22:29:03.212352+0000 (oldest deadline 2024-09-15T22:29:27.312583+0000) 2024-09-15T22:29:51.496 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:51 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:51.269+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.013621+0000 front 2024-09-15T22:29:12.013766+0000 (oldest deadline 2024-09-15T22:29:38.414145+0000) 2024-09-15T22:29:51.496 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:51 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:51.269+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:20.115221+0000 front 2024-09-15T22:29:20.115171+0000 (oldest deadline 2024-09-15T22:29:44.815004+0000) 2024-09-15T22:29:51.496 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:51 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:51.269+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:24.815331+0000 front 2024-09-15T22:29:24.815361+0000 (oldest deadline 2024-09-15T22:29:50.715500+0000) 2024-09-15T22:29:51.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:51 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:51.065+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:51.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:51 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:51.065+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:29:51.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:51 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:51.065+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:29:51.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:51 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:51.065+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.446800+0000 front 2024-09-15T22:29:18.446729+0000 (oldest deadline 2024-09-15T22:29:43.146500+0000) 2024-09-15T22:29:51.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:51 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:51.065+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:25.947982+0000 front 2024-09-15T22:29:25.948006+0000 (oldest deadline 2024-09-15T22:29:50.648107+0000) 2024-09-15T22:29:51.527 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:51 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:51.195+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:51.528 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:51 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:51.195+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:29:51.528 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:51 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:51.195+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.755660+0000 front 2024-09-15T22:29:12.755596+0000 (oldest deadline 2024-09-15T22:29:38.655769+0000) 2024-09-15T22:29:51.528 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:51 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:51.195+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.656200+0000 front 2024-09-15T22:29:18.656345+0000 (oldest deadline 2024-09-15T22:29:42.756132+0000) 2024-09-15T22:29:52.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:51 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:51.737+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.408482+0000 front 2024-09-15T22:29:02.408233+0000 (oldest deadline 2024-09-15T22:29:28.308312+0000) 2024-09-15T22:29:52.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:51 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:51.737+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.909589+0000 front 2024-09-15T22:29:12.909663+0000 (oldest deadline 2024-09-15T22:29:38.209717+0000) 2024-09-15T22:29:52.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:51 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:51.737+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.210350+0000 front 2024-09-15T22:29:18.210464+0000 (oldest deadline 2024-09-15T22:29:44.110380+0000) 2024-09-15T22:29:52.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:51 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:51.737+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:26.411188+0000 front 2024-09-15T22:29:26.411258+0000 (oldest deadline 2024-09-15T22:29:51.711148+0000) 2024-09-15T22:29:52.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:51 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:51.718+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:52.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:51 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:51.718+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:29:52.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:51 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:51.718+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:29:52.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:51 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:51.718+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:29:52.309 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:52 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:52.016+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:52.310 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:52 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:52.016+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:29:52.310 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:52 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:52.016+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:29:52.310 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:52 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:52.016+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.446800+0000 front 2024-09-15T22:29:18.446729+0000 (oldest deadline 2024-09-15T22:29:43.146500+0000) 2024-09-15T22:29:52.310 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:52 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:52.016+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:25.947982+0000 front 2024-09-15T22:29:25.948006+0000 (oldest deadline 2024-09-15T22:29:50.648107+0000) 2024-09-15T22:29:52.552 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:52 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:52.206+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:52.552 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:52 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:52.206+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:29:52.552 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:52 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:52.206+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.755660+0000 front 2024-09-15T22:29:12.755596+0000 (oldest deadline 2024-09-15T22:29:38.655769+0000) 2024-09-15T22:29:52.552 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:52 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:52.206+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.656200+0000 front 2024-09-15T22:29:18.656345+0000 (oldest deadline 2024-09-15T22:29:42.756132+0000) 2024-09-15T22:29:52.745 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:52 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:52.308+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.212379+0000 front 2024-09-15T22:29:03.212352+0000 (oldest deadline 2024-09-15T22:29:27.312583+0000) 2024-09-15T22:29:52.745 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:52 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:52.308+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.013621+0000 front 2024-09-15T22:29:12.013766+0000 (oldest deadline 2024-09-15T22:29:38.414145+0000) 2024-09-15T22:29:52.746 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:52 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:52.308+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:20.115221+0000 front 2024-09-15T22:29:20.115171+0000 (oldest deadline 2024-09-15T22:29:44.815004+0000) 2024-09-15T22:29:52.746 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:52 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:52.308+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:24.815331+0000 front 2024-09-15T22:29:24.815361+0000 (oldest deadline 2024-09-15T22:29:50.715500+0000) 2024-09-15T22:29:52.961 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:52 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:52.698+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:52.962 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:52 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:52.698+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:29:52.962 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:52 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:52.698+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:29:52.962 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:52 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:52.698+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:29:52.962 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:52 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:52.689+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.408482+0000 front 2024-09-15T22:29:02.408233+0000 (oldest deadline 2024-09-15T22:29:28.308312+0000) 2024-09-15T22:29:52.962 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:52 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:52.689+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.909589+0000 front 2024-09-15T22:29:12.909663+0000 (oldest deadline 2024-09-15T22:29:38.209717+0000) 2024-09-15T22:29:52.962 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:52 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:52.689+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.210350+0000 front 2024-09-15T22:29:18.210464+0000 (oldest deadline 2024-09-15T22:29:44.110380+0000) 2024-09-15T22:29:52.962 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:52 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:52.689+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:26.411188+0000 front 2024-09-15T22:29:26.411258+0000 (oldest deadline 2024-09-15T22:29:51.711148+0000) 2024-09-15T22:29:53.354 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:53 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:53.056+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:53.354 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:53 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:53.056+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:29:53.354 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:53 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:53.056+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:29:53.354 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:53 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:53.056+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.446800+0000 front 2024-09-15T22:29:18.446729+0000 (oldest deadline 2024-09-15T22:29:43.146500+0000) 2024-09-15T22:29:53.354 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:53 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:53.056+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:25.947982+0000 front 2024-09-15T22:29:25.948006+0000 (oldest deadline 2024-09-15T22:29:50.648107+0000) 2024-09-15T22:29:53.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:53 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:53.251+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:53.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:53 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:53.251+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:29:53.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:53 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:53.251+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.755660+0000 front 2024-09-15T22:29:12.755596+0000 (oldest deadline 2024-09-15T22:29:38.655769+0000) 2024-09-15T22:29:53.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:53 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:53.251+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.656200+0000 front 2024-09-15T22:29:18.656345+0000 (oldest deadline 2024-09-15T22:29:42.756132+0000) 2024-09-15T22:29:53.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:53 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:53.251+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:26.857202+0000 front 2024-09-15T22:29:26.857250+0000 (oldest deadline 2024-09-15T22:29:52.757327+0000) 2024-09-15T22:29:53.745 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:53 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:53.352+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.212379+0000 front 2024-09-15T22:29:03.212352+0000 (oldest deadline 2024-09-15T22:29:27.312583+0000) 2024-09-15T22:29:53.746 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:53 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:53.352+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.013621+0000 front 2024-09-15T22:29:12.013766+0000 (oldest deadline 2024-09-15T22:29:38.414145+0000) 2024-09-15T22:29:53.746 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:53 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:53.352+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:20.115221+0000 front 2024-09-15T22:29:20.115171+0000 (oldest deadline 2024-09-15T22:29:44.815004+0000) 2024-09-15T22:29:53.746 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:53 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7[53053]: 2024-09-15T22:29:53.352+0000 7f862db03640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:24.815331+0000 front 2024-09-15T22:29:24.815361+0000 (oldest deadline 2024-09-15T22:29:50.715500+0000) 2024-09-15T22:29:53.978 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:53 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:53.684+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:53.978 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:53 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:53.684+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:29:53.978 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:53 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:53.684+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:29:53.978 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:53 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:53.684+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:29:53.978 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:53 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:53.684+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:28.556810+0000 front 2024-09-15T22:29:28.556785+0000 (oldest deadline 2024-09-15T22:29:53.256726+0000) 2024-09-15T22:29:53.978 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:53 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:53.733+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.408482+0000 front 2024-09-15T22:29:02.408233+0000 (oldest deadline 2024-09-15T22:29:28.308312+0000) 2024-09-15T22:29:53.978 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:53 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:53.733+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.909589+0000 front 2024-09-15T22:29:12.909663+0000 (oldest deadline 2024-09-15T22:29:38.209717+0000) 2024-09-15T22:29:53.978 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:53 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:53.733+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.210350+0000 front 2024-09-15T22:29:18.210464+0000 (oldest deadline 2024-09-15T22:29:44.110380+0000) 2024-09-15T22:29:53.979 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:53 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:53.733+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:26.411188+0000 front 2024-09-15T22:29:26.411258+0000 (oldest deadline 2024-09-15T22:29:51.711148+0000) 2024-09-15T22:29:54.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:54 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:54.271+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:54.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:54 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:54.271+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:29:54.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:54 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:54.271+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.755660+0000 front 2024-09-15T22:29:12.755596+0000 (oldest deadline 2024-09-15T22:29:38.655769+0000) 2024-09-15T22:29:54.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:54 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:54.271+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.656200+0000 front 2024-09-15T22:29:18.656345+0000 (oldest deadline 2024-09-15T22:29:42.756132+0000) 2024-09-15T22:29:54.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:54 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:54.271+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:26.857202+0000 front 2024-09-15T22:29:26.857250+0000 (oldest deadline 2024-09-15T22:29:52.757327+0000) 2024-09-15T22:29:54.385 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:54 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:54.048+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:54.385 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:54 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:54.048+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:29:54.385 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:54 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:54.048+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:29:54.385 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:54 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:54.048+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.446800+0000 front 2024-09-15T22:29:18.446729+0000 (oldest deadline 2024-09-15T22:29:43.146500+0000) 2024-09-15T22:29:54.385 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:54 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:54.048+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:25.947982+0000 front 2024-09-15T22:29:25.948006+0000 (oldest deadline 2024-09-15T22:29:50.648107+0000) 2024-09-15T22:29:54.643 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:54 smithi012 podman[68540]: 2024-09-15 22:29:54.384162496 +0000 UTC m=+5.480655515 container died 773167e2435defbbb2cee1fbe309d6288cb7df2a2e80da7c83e7d6e32ecaf88a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True) 2024-09-15T22:29:54.993 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:54 smithi012 podman[68540]: 2024-09-15 22:29:54.749101528 +0000 UTC m=+5.845594541 container cleanup 773167e2435defbbb2cee1fbe309d6288cb7df2a2e80da7c83e7d6e32ecaf88a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-15T22:29:54.993 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:54 smithi012 bash[68540]: ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7 2024-09-15T22:29:55.060 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:54 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:54.709+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.408482+0000 front 2024-09-15T22:29:02.408233+0000 (oldest deadline 2024-09-15T22:29:28.308312+0000) 2024-09-15T22:29:55.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:54 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:54.709+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.909589+0000 front 2024-09-15T22:29:12.909663+0000 (oldest deadline 2024-09-15T22:29:38.209717+0000) 2024-09-15T22:29:55.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:54 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:54.709+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.210350+0000 front 2024-09-15T22:29:18.210464+0000 (oldest deadline 2024-09-15T22:29:44.110380+0000) 2024-09-15T22:29:55.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:54 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:54.709+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:26.411188+0000 front 2024-09-15T22:29:26.411258+0000 (oldest deadline 2024-09-15T22:29:51.711148+0000) 2024-09-15T22:29:55.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:54 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:54.681+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:55.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:54 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:54.681+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:29:55.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:54 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:54.681+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:29:55.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:54 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:54.681+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:29:55.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:54 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:54.681+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:28.556810+0000 front 2024-09-15T22:29:28.556785+0000 (oldest deadline 2024-09-15T22:29:53.256726+0000) 2024-09-15T22:29:55.245 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:54 smithi012 podman[68566]: 2024-09-15 22:29:54.992219015 +0000 UTC m=+0.604101095 container remove 773167e2435defbbb2cee1fbe309d6288cb7df2a2e80da7c83e7d6e32ecaf88a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:29:55.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:55 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:55.028+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:55.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:55 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:55.028+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:29:55.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:55 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:55.028+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:29:55.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:55 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:55.028+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.446800+0000 front 2024-09-15T22:29:18.446729+0000 (oldest deadline 2024-09-15T22:29:43.146500+0000) 2024-09-15T22:29:55.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:55 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:55.028+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:25.947982+0000 front 2024-09-15T22:29:25.948006+0000 (oldest deadline 2024-09-15T22:29:50.648107+0000) 2024-09-15T22:29:55.579 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:55 smithi012 podman[68656]: 2024-09-15 22:29:55.221338343 +0000 UTC m=+0.015462842 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:29:55.580 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:55 smithi012 podman[68656]: 2024-09-15 22:29:55.343126023 +0000 UTC m=+0.137250522 container create 5634f59425b4e3b4fd544af652b761a74fdd01984c68cb02793aa853cc359622 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-15T22:29:55.580 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:55 smithi012 podman[68656]: 2024-09-15 22:29:55.578647191 +0000 UTC m=+0.372771690 container init 5634f59425b4e3b4fd544af652b761a74fdd01984c68cb02793aa853cc359622 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-15T22:29:55.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:55 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:55.239+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:55.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:55 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:55.239+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:29:55.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:55 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:55.239+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.755660+0000 front 2024-09-15T22:29:12.755596+0000 (oldest deadline 2024-09-15T22:29:38.655769+0000) 2024-09-15T22:29:55.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:55 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:55.239+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.656200+0000 front 2024-09-15T22:29:18.656345+0000 (oldest deadline 2024-09-15T22:29:42.756132+0000) 2024-09-15T22:29:55.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:55 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:55.239+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:26.857202+0000 front 2024-09-15T22:29:26.857250+0000 (oldest deadline 2024-09-15T22:29:52.757327+0000) 2024-09-15T22:29:55.995 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:55 smithi012 podman[68656]: 2024-09-15 22:29:55.582062248 +0000 UTC m=+0.376186752 container start 5634f59425b4e3b4fd544af652b761a74fdd01984c68cb02793aa853cc359622 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-15T22:29:55.996 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:55 smithi012 podman[68656]: 2024-09-15 22:29:55.687118467 +0000 UTC m=+0.481242986 container attach 5634f59425b4e3b4fd544af652b761a74fdd01984c68cb02793aa853cc359622 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-15T22:29:55.996 INFO:journalctl@ceph.osd.7.smithi012.stdout:Sep 15 22:29:55 smithi012 podman[68656]: 2024-09-15 22:29:55.773155039 +0000 UTC m=+0.567279539 container died 5634f59425b4e3b4fd544af652b761a74fdd01984c68cb02793aa853cc359622 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-7-deactivate, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e) 2024-09-15T22:29:56.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:55 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:55.683+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.408482+0000 front 2024-09-15T22:29:02.408233+0000 (oldest deadline 2024-09-15T22:29:28.308312+0000) 2024-09-15T22:29:56.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:55 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:55.683+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.909589+0000 front 2024-09-15T22:29:12.909663+0000 (oldest deadline 2024-09-15T22:29:38.209717+0000) 2024-09-15T22:29:56.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:55 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:55.683+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.210350+0000 front 2024-09-15T22:29:18.210464+0000 (oldest deadline 2024-09-15T22:29:44.110380+0000) 2024-09-15T22:29:56.062 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:55 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:55.683+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:26.411188+0000 front 2024-09-15T22:29:26.411258+0000 (oldest deadline 2024-09-15T22:29:51.711148+0000) 2024-09-15T22:29:56.062 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:55 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:55.684+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:56.062 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:55 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:55.684+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:29:56.062 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:55 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:55.684+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:29:56.063 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:55 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:55.684+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:29:56.063 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:55 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:55.684+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:28.556810+0000 front 2024-09-15T22:29:28.556785+0000 (oldest deadline 2024-09-15T22:29:53.256726+0000) 2024-09-15T22:29:56.383 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:56 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:56.000+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:56.383 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:56 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:56.000+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:29:56.383 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:56 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:56.000+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:29:56.383 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:56 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:56.000+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.446800+0000 front 2024-09-15T22:29:18.446729+0000 (oldest deadline 2024-09-15T22:29:43.146500+0000) 2024-09-15T22:29:56.383 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:56 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:56.000+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:25.947982+0000 front 2024-09-15T22:29:25.948006+0000 (oldest deadline 2024-09-15T22:29:50.648107+0000) 2024-09-15T22:29:56.407 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.7.service' 2024-09-15T22:29:56.449 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:29:56.449 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-15T22:29:56.449 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-15T22:29:56.449 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.8 2024-09-15T22:29:56.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:56 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:56.279+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:56.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:56 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:56.279+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:29:56.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:56 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:56.279+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.755660+0000 front 2024-09-15T22:29:12.755596+0000 (oldest deadline 2024-09-15T22:29:38.655769+0000) 2024-09-15T22:29:56.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:56 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:56.279+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.656200+0000 front 2024-09-15T22:29:18.656345+0000 (oldest deadline 2024-09-15T22:29:42.756132+0000) 2024-09-15T22:29:56.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:56 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:56.279+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:26.857202+0000 front 2024-09-15T22:29:26.857250+0000 (oldest deadline 2024-09-15T22:29:52.757327+0000) 2024-09-15T22:29:56.728 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:56 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:56.712+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:56.728 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:56 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:56.712+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:29:56.728 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:56 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:56.712+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:29:56.728 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:56 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:56.712+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:29:56.728 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:56 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:56.712+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:28.556810+0000 front 2024-09-15T22:29:28.556785+0000 (oldest deadline 2024-09-15T22:29:53.256726+0000) 2024-09-15T22:29:56.728 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:56 smithi098 systemd[1]: Stopping Ceph osd.8 for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:29:56.728 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:56 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:56.651+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.408482+0000 front 2024-09-15T22:29:02.408233+0000 (oldest deadline 2024-09-15T22:29:28.308312+0000) 2024-09-15T22:29:56.728 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:56 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:56.651+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.909589+0000 front 2024-09-15T22:29:12.909663+0000 (oldest deadline 2024-09-15T22:29:38.209717+0000) 2024-09-15T22:29:56.728 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:56 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:56.651+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.210350+0000 front 2024-09-15T22:29:18.210464+0000 (oldest deadline 2024-09-15T22:29:44.110380+0000) 2024-09-15T22:29:56.729 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:56 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:56.651+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:26.411188+0000 front 2024-09-15T22:29:26.411258+0000 (oldest deadline 2024-09-15T22:29:51.711148+0000) 2024-09-15T22:29:57.060 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:56 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:56.726+0000 7f1638457640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:29:57.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:56 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:56.726+0000 7f1638457640 -1 osd.8 89 *** Got signal Terminated *** 2024-09-15T22:29:57.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:56 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:56.726+0000 7f1638457640 -1 osd.8 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:29:57.245 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:56 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:56.970+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:57.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:56 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:56.970+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:29:57.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:56 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:56.970+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:29:57.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:56 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:56.970+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.446800+0000 front 2024-09-15T22:29:18.446729+0000 (oldest deadline 2024-09-15T22:29:43.146500+0000) 2024-09-15T22:29:57.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:56 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:56.970+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:25.947982+0000 front 2024-09-15T22:29:25.948006+0000 (oldest deadline 2024-09-15T22:29:50.648107+0000) 2024-09-15T22:29:57.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:57 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:57.237+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:57.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:57 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:57.237+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:29:57.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:57 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:57.237+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.755660+0000 front 2024-09-15T22:29:12.755596+0000 (oldest deadline 2024-09-15T22:29:38.655769+0000) 2024-09-15T22:29:57.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:57 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:57.237+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.656200+0000 front 2024-09-15T22:29:18.656345+0000 (oldest deadline 2024-09-15T22:29:42.756132+0000) 2024-09-15T22:29:57.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:57 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:57.237+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:26.857202+0000 front 2024-09-15T22:29:26.857250+0000 (oldest deadline 2024-09-15T22:29:52.757327+0000) 2024-09-15T22:29:58.060 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:57 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:57.677+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.408482+0000 front 2024-09-15T22:29:02.408233+0000 (oldest deadline 2024-09-15T22:29:28.308312+0000) 2024-09-15T22:29:58.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:57 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:57.677+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.909589+0000 front 2024-09-15T22:29:12.909663+0000 (oldest deadline 2024-09-15T22:29:38.209717+0000) 2024-09-15T22:29:58.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:57 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:57.677+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.210350+0000 front 2024-09-15T22:29:18.210464+0000 (oldest deadline 2024-09-15T22:29:44.110380+0000) 2024-09-15T22:29:58.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:57 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:57.677+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:26.411188+0000 front 2024-09-15T22:29:26.411258+0000 (oldest deadline 2024-09-15T22:29:51.711148+0000) 2024-09-15T22:29:58.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:57 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:57.697+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:58.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:57 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:57.697+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:29:58.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:57 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:57.697+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:29:58.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:57 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:57.697+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:29:58.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:57 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:57.697+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:28.556810+0000 front 2024-09-15T22:29:28.556785+0000 (oldest deadline 2024-09-15T22:29:53.256726+0000) 2024-09-15T22:29:58.495 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:58 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:58.006+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:58.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:58 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:58.006+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:29:58.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:58 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:58.006+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:29:58.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:58 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:58.006+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.446800+0000 front 2024-09-15T22:29:18.446729+0000 (oldest deadline 2024-09-15T22:29:43.146500+0000) 2024-09-15T22:29:58.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:58 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:58.006+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:25.947982+0000 front 2024-09-15T22:29:25.948006+0000 (oldest deadline 2024-09-15T22:29:50.648107+0000) 2024-09-15T22:29:58.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:58 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:58.284+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:58.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:58 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:58.284+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:29:58.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:58 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:58.284+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.755660+0000 front 2024-09-15T22:29:12.755596+0000 (oldest deadline 2024-09-15T22:29:38.655769+0000) 2024-09-15T22:29:58.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:58 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:58.284+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.656200+0000 front 2024-09-15T22:29:18.656345+0000 (oldest deadline 2024-09-15T22:29:42.756132+0000) 2024-09-15T22:29:58.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:58 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:58.284+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:26.857202+0000 front 2024-09-15T22:29:26.857250+0000 (oldest deadline 2024-09-15T22:29:52.757327+0000) 2024-09-15T22:29:59.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:58 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:58.684+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.408482+0000 front 2024-09-15T22:29:02.408233+0000 (oldest deadline 2024-09-15T22:29:28.308312+0000) 2024-09-15T22:29:59.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:58 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:58.684+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.909589+0000 front 2024-09-15T22:29:12.909663+0000 (oldest deadline 2024-09-15T22:29:38.209717+0000) 2024-09-15T22:29:59.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:58 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:58.684+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.210350+0000 front 2024-09-15T22:29:18.210464+0000 (oldest deadline 2024-09-15T22:29:44.110380+0000) 2024-09-15T22:29:59.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:58 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:58.684+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:26.411188+0000 front 2024-09-15T22:29:26.411258+0000 (oldest deadline 2024-09-15T22:29:51.711148+0000) 2024-09-15T22:29:59.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:58 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:58.703+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:29:59.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:58 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:58.703+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:29:59.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:58 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:58.703+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:29:59.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:58 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:58.703+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:29:59.062 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:58 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:58.703+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:28.556810+0000 front 2024-09-15T22:29:28.556785+0000 (oldest deadline 2024-09-15T22:29:53.256726+0000) 2024-09-15T22:29:59.245 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:58 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:58.990+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:29:59.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:58 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:58.990+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:29:59.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:58 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:58.990+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:29:59.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:58 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:58.990+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.446800+0000 front 2024-09-15T22:29:18.446729+0000 (oldest deadline 2024-09-15T22:29:43.146500+0000) 2024-09-15T22:29:59.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:58 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:58.990+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:25.947982+0000 front 2024-09-15T22:29:25.948006+0000 (oldest deadline 2024-09-15T22:29:50.648107+0000) 2024-09-15T22:29:59.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:59 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:59.252+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:29:59.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:59 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:59.252+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:29:59.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:59 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:59.252+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.755660+0000 front 2024-09-15T22:29:12.755596+0000 (oldest deadline 2024-09-15T22:29:38.655769+0000) 2024-09-15T22:29:59.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:59 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:59.252+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.656200+0000 front 2024-09-15T22:29:18.656345+0000 (oldest deadline 2024-09-15T22:29:42.756132+0000) 2024-09-15T22:29:59.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:29:59 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:29:59.252+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:26.857202+0000 front 2024-09-15T22:29:26.857250+0000 (oldest deadline 2024-09-15T22:29:52.757327+0000) 2024-09-15T22:30:00.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:59 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:59.749+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:30:00.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:59 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:59.749+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:30:00.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:59 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:59.749+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:30:00.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:59 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:59.749+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:30:00.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:29:59 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:29:59.749+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:28.556810+0000 front 2024-09-15T22:29:28.556785+0000 (oldest deadline 2024-09-15T22:29:53.256726+0000) 2024-09-15T22:30:00.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:59 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:59.691+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.408482+0000 front 2024-09-15T22:29:02.408233+0000 (oldest deadline 2024-09-15T22:29:28.308312+0000) 2024-09-15T22:30:00.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:59 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:59.691+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.909589+0000 front 2024-09-15T22:29:12.909663+0000 (oldest deadline 2024-09-15T22:29:38.209717+0000) 2024-09-15T22:30:00.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:59 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:59.691+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.210350+0000 front 2024-09-15T22:29:18.210464+0000 (oldest deadline 2024-09-15T22:29:44.110380+0000) 2024-09-15T22:30:00.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:29:59 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:29:59.691+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:26.411188+0000 front 2024-09-15T22:29:26.411258+0000 (oldest deadline 2024-09-15T22:29:51.711148+0000) 2024-09-15T22:30:00.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:59 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:59.982+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:30:00.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:59 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:59.982+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:30:00.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:59 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:59.982+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:30:00.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:59 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:59.982+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.446800+0000 front 2024-09-15T22:29:18.446729+0000 (oldest deadline 2024-09-15T22:29:43.146500+0000) 2024-09-15T22:30:00.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:29:59 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:29:59.982+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:25.947982+0000 front 2024-09-15T22:29:25.948006+0000 (oldest deadline 2024-09-15T22:29:50.648107+0000) 2024-09-15T22:30:00.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:00 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:00.265+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:30:00.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:00 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:00.265+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:30:00.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:00 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:00.265+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.755660+0000 front 2024-09-15T22:29:12.755596+0000 (oldest deadline 2024-09-15T22:29:38.655769+0000) 2024-09-15T22:30:00.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:00 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:00.265+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.656200+0000 front 2024-09-15T22:29:18.656345+0000 (oldest deadline 2024-09-15T22:29:42.756132+0000) 2024-09-15T22:30:00.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:00 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:00.265+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:26.857202+0000 front 2024-09-15T22:29:26.857250+0000 (oldest deadline 2024-09-15T22:29:52.757327+0000) 2024-09-15T22:30:01.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:00 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:00.750+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:30:01.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:00 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:00.750+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:30:01.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:00 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:00.750+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:30:01.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:00 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:00.750+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:30:01.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:00 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:00.750+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:28.556810+0000 front 2024-09-15T22:29:28.556785+0000 (oldest deadline 2024-09-15T22:29:53.256726+0000) 2024-09-15T22:30:01.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:00 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:00.750+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:36.157781+0000 front 2024-09-15T22:29:36.157801+0000 (oldest deadline 2024-09-15T22:30:00.257873+0000) 2024-09-15T22:30:01.062 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:30:00 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:30:00.708+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.408482+0000 front 2024-09-15T22:29:02.408233+0000 (oldest deadline 2024-09-15T22:29:28.308312+0000) 2024-09-15T22:30:01.062 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:30:00 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:30:00.708+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.909589+0000 front 2024-09-15T22:29:12.909663+0000 (oldest deadline 2024-09-15T22:29:38.209717+0000) 2024-09-15T22:30:01.062 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:30:00 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:30:00.708+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.210350+0000 front 2024-09-15T22:29:18.210464+0000 (oldest deadline 2024-09-15T22:29:44.110380+0000) 2024-09-15T22:30:01.062 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:30:00 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:30:00.708+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:26.411188+0000 front 2024-09-15T22:29:26.411258+0000 (oldest deadline 2024-09-15T22:29:51.711148+0000) 2024-09-15T22:30:01.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:00 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:00.941+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:30:01.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:00 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:00.941+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:30:01.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:00 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:00.941+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:30:01.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:00 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:00.941+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.446800+0000 front 2024-09-15T22:29:18.446729+0000 (oldest deadline 2024-09-15T22:29:43.146500+0000) 2024-09-15T22:30:01.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:00 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:00.941+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:25.947982+0000 front 2024-09-15T22:29:25.948006+0000 (oldest deadline 2024-09-15T22:29:50.648107+0000) 2024-09-15T22:30:01.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:00 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:00.941+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:37.049750+0000 front 2024-09-15T22:29:37.049867+0000 (oldest deadline 2024-09-15T22:30:00.549575+0000) 2024-09-15T22:30:01.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:01 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:01.279+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:30:01.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:01 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:01.279+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:30:01.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:01 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:01.279+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.755660+0000 front 2024-09-15T22:29:12.755596+0000 (oldest deadline 2024-09-15T22:29:38.655769+0000) 2024-09-15T22:30:01.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:01 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:01.279+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.656200+0000 front 2024-09-15T22:29:18.656345+0000 (oldest deadline 2024-09-15T22:29:42.756132+0000) 2024-09-15T22:30:01.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:01 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:01.279+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:26.857202+0000 front 2024-09-15T22:29:26.857250+0000 (oldest deadline 2024-09-15T22:29:52.757327+0000) 2024-09-15T22:30:02.060 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:30:01 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:30:01.716+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.408482+0000 front 2024-09-15T22:29:02.408233+0000 (oldest deadline 2024-09-15T22:29:28.308312+0000) 2024-09-15T22:30:02.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:30:01 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:30:01.716+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.909589+0000 front 2024-09-15T22:29:12.909663+0000 (oldest deadline 2024-09-15T22:29:38.209717+0000) 2024-09-15T22:30:02.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:30:01 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:30:01.716+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.210350+0000 front 2024-09-15T22:29:18.210464+0000 (oldest deadline 2024-09-15T22:29:44.110380+0000) 2024-09-15T22:30:02.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:30:01 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8[53577]: 2024-09-15T22:30:01.716+0000 7f1634a5c640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:26.411188+0000 front 2024-09-15T22:29:26.411258+0000 (oldest deadline 2024-09-15T22:29:51.711148+0000) 2024-09-15T22:30:02.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:01 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:01.740+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:30:02.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:01 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:01.740+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:30:02.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:01 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:01.740+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:30:02.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:01 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:01.740+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:30:02.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:01 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:01.740+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:28.556810+0000 front 2024-09-15T22:29:28.556785+0000 (oldest deadline 2024-09-15T22:29:53.256726+0000) 2024-09-15T22:30:02.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:01 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:01.740+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:36.157781+0000 front 2024-09-15T22:29:36.157801+0000 (oldest deadline 2024-09-15T22:30:00.257873+0000) 2024-09-15T22:30:02.245 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:01 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:01.990+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:30:02.245 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:01 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:01.990+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:30:02.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:01 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:01.990+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:30:02.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:01 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:01.990+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.446800+0000 front 2024-09-15T22:29:18.446729+0000 (oldest deadline 2024-09-15T22:29:43.146500+0000) 2024-09-15T22:30:02.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:01 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:01.990+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:25.947982+0000 front 2024-09-15T22:29:25.948006+0000 (oldest deadline 2024-09-15T22:29:50.648107+0000) 2024-09-15T22:30:02.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:01 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:01.990+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:37.049750+0000 front 2024-09-15T22:29:37.049867+0000 (oldest deadline 2024-09-15T22:30:00.549575+0000) 2024-09-15T22:30:02.393 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:30:02 smithi098 podman[69717]: 2024-09-15 22:30:02.078397131 +0000 UTC m=+5.435451237 container died be459cf384d7bc3e1fb53e0dc7dfd8f8c6423c8e81606fc0973f6804fc87ab02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-15T22:30:02.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:02 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:02.238+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:30:02.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:02 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:02.238+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:30:02.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:02 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:02.238+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.755660+0000 front 2024-09-15T22:29:12.755596+0000 (oldest deadline 2024-09-15T22:29:38.655769+0000) 2024-09-15T22:30:02.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:02 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:02.238+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.656200+0000 front 2024-09-15T22:29:18.656345+0000 (oldest deadline 2024-09-15T22:29:42.756132+0000) 2024-09-15T22:30:02.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:02 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:02.238+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:26.857202+0000 front 2024-09-15T22:29:26.857250+0000 (oldest deadline 2024-09-15T22:29:52.757327+0000) 2024-09-15T22:30:02.791 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:30:02 smithi098 podman[69717]: 2024-09-15 22:30:02.392765445 +0000 UTC m=+5.749819541 container cleanup be459cf384d7bc3e1fb53e0dc7dfd8f8c6423c8e81606fc0973f6804fc87ab02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:30:02.791 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:30:02 smithi098 bash[69717]: ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8 2024-09-15T22:30:02.791 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:30:02 smithi098 podman[69735]: 2024-09-15 22:30:02.594056494 +0000 UTC m=+0.513018550 container remove be459cf384d7bc3e1fb53e0dc7dfd8f8c6423c8e81606fc0973f6804fc87ab02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, ceph=True) 2024-09-15T22:30:03.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:30:03 smithi098 podman[69826]: 2024-09-15 22:30:02.906051 +0000 UTC m=+0.015883149 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:30:03.061 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:30:03 smithi098 podman[69826]: 2024-09-15 22:30:03.02860565 +0000 UTC m=+0.138437842 container create 6447794df18daee7990dd22d755fdde9ef0b83a9031b5b5d21f97203d7c68aeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-15T22:30:03.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:02 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:02.788+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:30:03.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:02 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:02.788+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:30:03.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:02 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:02.788+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:30:03.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:02 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:02.788+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:30:03.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:02 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:02.788+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:28.556810+0000 front 2024-09-15T22:29:28.556785+0000 (oldest deadline 2024-09-15T22:29:53.256726+0000) 2024-09-15T22:30:03.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:02 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:02.788+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:36.157781+0000 front 2024-09-15T22:29:36.157801+0000 (oldest deadline 2024-09-15T22:30:00.257873+0000) 2024-09-15T22:30:03.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:02 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:02.978+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:30:03.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:02 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:02.978+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:30:03.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:02 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:02.978+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:30:03.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:02 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:02.978+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.446800+0000 front 2024-09-15T22:29:18.446729+0000 (oldest deadline 2024-09-15T22:29:43.146500+0000) 2024-09-15T22:30:03.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:02 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:02.978+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:25.947982+0000 front 2024-09-15T22:29:25.948006+0000 (oldest deadline 2024-09-15T22:29:50.648107+0000) 2024-09-15T22:30:03.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:02 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:02.978+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:37.049750+0000 front 2024-09-15T22:29:37.049867+0000 (oldest deadline 2024-09-15T22:30:00.549575+0000) 2024-09-15T22:30:03.462 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:30:03 smithi098 podman[69826]: 2024-09-15 22:30:03.264585731 +0000 UTC m=+0.374417877 container init 6447794df18daee7990dd22d755fdde9ef0b83a9031b5b5d21f97203d7c68aeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:30:03.462 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:30:03 smithi098 podman[69826]: 2024-09-15 22:30:03.267717654 +0000 UTC m=+0.377549804 container start 6447794df18daee7990dd22d755fdde9ef0b83a9031b5b5d21f97203d7c68aeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-15T22:30:03.462 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:30:03 smithi098 podman[69826]: 2024-09-15 22:30:03.331008859 +0000 UTC m=+0.440841008 container attach 6447794df18daee7990dd22d755fdde9ef0b83a9031b5b5d21f97203d7c68aeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-15T22:30:03.529 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:03 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:03.240+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:30:03.529 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:03 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:03.240+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:30:03.529 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:03 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:03.240+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.755660+0000 front 2024-09-15T22:29:12.755596+0000 (oldest deadline 2024-09-15T22:29:38.655769+0000) 2024-09-15T22:30:03.529 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:03 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:03.240+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.656200+0000 front 2024-09-15T22:29:18.656345+0000 (oldest deadline 2024-09-15T22:29:42.756132+0000) 2024-09-15T22:30:03.529 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:03 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:03.240+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:26.857202+0000 front 2024-09-15T22:29:26.857250+0000 (oldest deadline 2024-09-15T22:29:52.757327+0000) 2024-09-15T22:30:03.760 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:30:03 smithi098 podman[69826]: 2024-09-15 22:30:03.461307041 +0000 UTC m=+0.571139198 container died 6447794df18daee7990dd22d755fdde9ef0b83a9031b5b5d21f97203d7c68aeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-15T22:30:04.013 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 15 22:30:04 smithi098 podman[69849]: 2024-09-15 22:30:04.009464301 +0000 UTC m=+0.536979551 container remove 6447794df18daee7990dd22d755fdde9ef0b83a9031b5b5d21f97203d7c68aeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-15T22:30:04.013 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:03 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:03.760+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:30:04.013 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:03 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:03.760+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:30:04.013 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:03 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:03.760+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:30:04.013 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:03 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:03.760+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:30:04.013 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:03 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:03.760+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:28.556810+0000 front 2024-09-15T22:29:28.556785+0000 (oldest deadline 2024-09-15T22:29:53.256726+0000) 2024-09-15T22:30:04.013 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:03 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:03.760+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:36.157781+0000 front 2024-09-15T22:29:36.157801+0000 (oldest deadline 2024-09-15T22:30:00.257873+0000) 2024-09-15T22:30:04.034 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.8.service' 2024-09-15T22:30:04.072 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:30:04.073 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-15T22:30:04.073 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-15T22:30:04.073 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.9 2024-09-15T22:30:04.245 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:03 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:03.937+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:30:04.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:03 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:03.937+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:30:04.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:03 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:03.937+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:30:04.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:03 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:03.937+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.446800+0000 front 2024-09-15T22:29:18.446729+0000 (oldest deadline 2024-09-15T22:29:43.146500+0000) 2024-09-15T22:30:04.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:03 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:03.937+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:25.947982+0000 front 2024-09-15T22:29:25.948006+0000 (oldest deadline 2024-09-15T22:29:50.648107+0000) 2024-09-15T22:30:04.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:03 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:03.937+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:37.049750+0000 front 2024-09-15T22:29:37.049867+0000 (oldest deadline 2024-09-15T22:30:00.549575+0000) 2024-09-15T22:30:04.484 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:04 smithi001 systemd[1]: Stopping Ceph osd.9 for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:30:04.485 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:04 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:04.264+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:30:04.485 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:04 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:04.264+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:30:04.485 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:04 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:04.264+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.755660+0000 front 2024-09-15T22:29:12.755596+0000 (oldest deadline 2024-09-15T22:29:38.655769+0000) 2024-09-15T22:30:04.485 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:04 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:04.264+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.656200+0000 front 2024-09-15T22:29:18.656345+0000 (oldest deadline 2024-09-15T22:29:42.756132+0000) 2024-09-15T22:30:04.485 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:04 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:04.264+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:26.857202+0000 front 2024-09-15T22:29:26.857250+0000 (oldest deadline 2024-09-15T22:29:52.757327+0000) 2024-09-15T22:30:04.485 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:04 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:04.482+0000 7f0ebf800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:30:04.485 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:04 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:04.482+0000 7f0ebf800640 -1 osd.9 89 *** Got signal Terminated *** 2024-09-15T22:30:04.485 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:04 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:04.482+0000 7f0ebf800640 -1 osd.9 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:30:05.060 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:04 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:04.770+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:30:05.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:04 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:04.770+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:30:05.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:04 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:04.770+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:30:05.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:04 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:04.770+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:30:05.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:04 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:04.770+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:28.556810+0000 front 2024-09-15T22:29:28.556785+0000 (oldest deadline 2024-09-15T22:29:53.256726+0000) 2024-09-15T22:30:05.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:04 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:04.770+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:36.157781+0000 front 2024-09-15T22:29:36.157801+0000 (oldest deadline 2024-09-15T22:30:00.257873+0000) 2024-09-15T22:30:05.245 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:04 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:04.980+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:30:05.245 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:04 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:04.980+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:30:05.245 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:04 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:04.980+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:30:05.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:04 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:04.980+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.446800+0000 front 2024-09-15T22:29:18.446729+0000 (oldest deadline 2024-09-15T22:29:43.146500+0000) 2024-09-15T22:30:05.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:04 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:04.980+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:25.947982+0000 front 2024-09-15T22:29:25.948006+0000 (oldest deadline 2024-09-15T22:29:50.648107+0000) 2024-09-15T22:30:05.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:04 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:04.980+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:37.049750+0000 front 2024-09-15T22:29:37.049867+0000 (oldest deadline 2024-09-15T22:30:00.549575+0000) 2024-09-15T22:30:05.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:05 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:05.267+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:30:05.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:05 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:05.267+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:30:05.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:05 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:05.267+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.755660+0000 front 2024-09-15T22:29:12.755596+0000 (oldest deadline 2024-09-15T22:29:38.655769+0000) 2024-09-15T22:30:05.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:05 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:05.267+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.656200+0000 front 2024-09-15T22:29:18.656345+0000 (oldest deadline 2024-09-15T22:29:42.756132+0000) 2024-09-15T22:30:05.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:05 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:05.267+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:26.857202+0000 front 2024-09-15T22:29:26.857250+0000 (oldest deadline 2024-09-15T22:29:52.757327+0000) 2024-09-15T22:30:06.060 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:05 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:05.781+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:30:06.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:05 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:05.781+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:30:06.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:05 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:05.781+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:30:06.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:05 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:05.781+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:30:06.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:05 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:05.781+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:28.556810+0000 front 2024-09-15T22:29:28.556785+0000 (oldest deadline 2024-09-15T22:29:53.256726+0000) 2024-09-15T22:30:06.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:05 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:05.781+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:36.157781+0000 front 2024-09-15T22:29:36.157801+0000 (oldest deadline 2024-09-15T22:30:00.257873+0000) 2024-09-15T22:30:06.245 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:05 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:05.945+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:30:06.245 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:05 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:05.945+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:30:06.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:05 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:05.945+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:30:06.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:05 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:05.945+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.446800+0000 front 2024-09-15T22:29:18.446729+0000 (oldest deadline 2024-09-15T22:29:43.146500+0000) 2024-09-15T22:30:06.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:05 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:05.945+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:25.947982+0000 front 2024-09-15T22:29:25.948006+0000 (oldest deadline 2024-09-15T22:29:50.648107+0000) 2024-09-15T22:30:06.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:05 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:05.945+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:37.049750+0000 front 2024-09-15T22:29:37.049867+0000 (oldest deadline 2024-09-15T22:30:00.549575+0000) 2024-09-15T22:30:06.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:06 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:06.307+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:30:06.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:06 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:06.307+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:30:06.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:06 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:06.307+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.755660+0000 front 2024-09-15T22:29:12.755596+0000 (oldest deadline 2024-09-15T22:29:38.655769+0000) 2024-09-15T22:30:06.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:06 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:06.307+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.656200+0000 front 2024-09-15T22:29:18.656345+0000 (oldest deadline 2024-09-15T22:29:42.756132+0000) 2024-09-15T22:30:06.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:06 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:06.307+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:26.857202+0000 front 2024-09-15T22:29:26.857250+0000 (oldest deadline 2024-09-15T22:29:52.757327+0000) 2024-09-15T22:30:07.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:06 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:06.932+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:30:07.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:06 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:06.932+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:30:07.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:06 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:06.932+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:30:07.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:06 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:06.932+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.446800+0000 front 2024-09-15T22:29:18.446729+0000 (oldest deadline 2024-09-15T22:29:43.146500+0000) 2024-09-15T22:30:07.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:06 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:06.932+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:25.947982+0000 front 2024-09-15T22:29:25.948006+0000 (oldest deadline 2024-09-15T22:29:50.648107+0000) 2024-09-15T22:30:07.247 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:06 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:06.932+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:37.049750+0000 front 2024-09-15T22:29:37.049867+0000 (oldest deadline 2024-09-15T22:30:00.549575+0000) 2024-09-15T22:30:07.310 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:06 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:06.819+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:30:07.311 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:06 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:06.819+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:30:07.311 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:06 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:06.819+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:30:07.311 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:06 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:06.819+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:30:07.311 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:06 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:06.819+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:28.556810+0000 front 2024-09-15T22:29:28.556785+0000 (oldest deadline 2024-09-15T22:29:53.256726+0000) 2024-09-15T22:30:07.311 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:06 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:06.819+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:36.157781+0000 front 2024-09-15T22:29:36.157801+0000 (oldest deadline 2024-09-15T22:30:00.257873+0000) 2024-09-15T22:30:07.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:07 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:07.275+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:30:07.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:07 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:07.275+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:30:07.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:07 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:07.275+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.755660+0000 front 2024-09-15T22:29:12.755596+0000 (oldest deadline 2024-09-15T22:29:38.655769+0000) 2024-09-15T22:30:07.627 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:07 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:07.275+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.656200+0000 front 2024-09-15T22:29:18.656345+0000 (oldest deadline 2024-09-15T22:29:42.756132+0000) 2024-09-15T22:30:07.627 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:07 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:07.275+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:26.857202+0000 front 2024-09-15T22:29:26.857250+0000 (oldest deadline 2024-09-15T22:29:52.757327+0000) 2024-09-15T22:30:08.245 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:07 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:07.907+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:30:08.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:07 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:07.907+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:30:08.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:07 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:07.907+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:30:08.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:07 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:07.907+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.446800+0000 front 2024-09-15T22:29:18.446729+0000 (oldest deadline 2024-09-15T22:29:43.146500+0000) 2024-09-15T22:30:08.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:07 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:07.907+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:25.947982+0000 front 2024-09-15T22:29:25.948006+0000 (oldest deadline 2024-09-15T22:29:50.648107+0000) 2024-09-15T22:30:08.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:07 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:07.907+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:37.049750+0000 front 2024-09-15T22:29:37.049867+0000 (oldest deadline 2024-09-15T22:30:00.549575+0000) 2024-09-15T22:30:08.310 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:07 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:07.844+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:30:08.310 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:07 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:07.844+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:30:08.311 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:07 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:07.844+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:30:08.311 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:07 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:07.844+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:30:08.311 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:07 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:07.844+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:28.556810+0000 front 2024-09-15T22:29:28.556785+0000 (oldest deadline 2024-09-15T22:29:53.256726+0000) 2024-09-15T22:30:08.311 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:07 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:07.844+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:36.157781+0000 front 2024-09-15T22:29:36.157801+0000 (oldest deadline 2024-09-15T22:30:00.257873+0000) 2024-09-15T22:30:08.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:08 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:08.228+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:30:08.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:08 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:08.228+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:30:08.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:08 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:08.228+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.755660+0000 front 2024-09-15T22:29:12.755596+0000 (oldest deadline 2024-09-15T22:29:38.655769+0000) 2024-09-15T22:30:08.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:08 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:08.228+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.656200+0000 front 2024-09-15T22:29:18.656345+0000 (oldest deadline 2024-09-15T22:29:42.756132+0000) 2024-09-15T22:30:08.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:08 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:08.228+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:26.857202+0000 front 2024-09-15T22:29:26.857250+0000 (oldest deadline 2024-09-15T22:29:52.757327+0000) 2024-09-15T22:30:09.245 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:08 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:08.909+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:30:09.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:08 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:08.909+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:30:09.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:08 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:08.909+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:30:09.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:08 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:08.909+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.446800+0000 front 2024-09-15T22:29:18.446729+0000 (oldest deadline 2024-09-15T22:29:43.146500+0000) 2024-09-15T22:30:09.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:08 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:08.909+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:25.947982+0000 front 2024-09-15T22:29:25.948006+0000 (oldest deadline 2024-09-15T22:29:50.648107+0000) 2024-09-15T22:30:09.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:08 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:08.909+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:37.049750+0000 front 2024-09-15T22:29:37.049867+0000 (oldest deadline 2024-09-15T22:30:00.549575+0000) 2024-09-15T22:30:09.310 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:08 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:08.889+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:30:09.310 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:08 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:08.889+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:30:09.311 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:08 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:08.889+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:30:09.311 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:08 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:08.889+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:30:09.311 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:08 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:08.889+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:28.556810+0000 front 2024-09-15T22:29:28.556785+0000 (oldest deadline 2024-09-15T22:29:53.256726+0000) 2024-09-15T22:30:09.311 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:08 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:08.889+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:36.157781+0000 front 2024-09-15T22:29:36.157801+0000 (oldest deadline 2024-09-15T22:30:00.257873+0000) 2024-09-15T22:30:09.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:09 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:09.263+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:54.251835+0000 front 2024-09-15T22:28:54.251794+0000 (oldest deadline 2024-09-15T22:29:20.152037+0000) 2024-09-15T22:30:09.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:09 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:09.263+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:02.353730+0000 front 2024-09-15T22:29:02.353602+0000 (oldest deadline 2024-09-15T22:29:28.253716+0000) 2024-09-15T22:30:09.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:09 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:09.263+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.755660+0000 front 2024-09-15T22:29:12.755596+0000 (oldest deadline 2024-09-15T22:29:38.655769+0000) 2024-09-15T22:30:09.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:09 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:09.263+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.656200+0000 front 2024-09-15T22:29:18.656345+0000 (oldest deadline 2024-09-15T22:29:42.756132+0000) 2024-09-15T22:30:09.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:09 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9[62337]: 2024-09-15T22:30:09.263+0000 7f0ebb200640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:26.857202+0000 front 2024-09-15T22:29:26.857250+0000 (oldest deadline 2024-09-15T22:29:52.757327+0000) 2024-09-15T22:30:10.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:09 smithi001 podman[84174]: 2024-09-15 22:30:09.85670994 +0000 UTC m=+5.484789623 container died 757de75ff925999845ee0f65f0fac6259151235135d359ef86ab19ac196fe43f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-15T22:30:10.245 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:09 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:09.932+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:30:10.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:09 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:09.932+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:30:10.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:09 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:09.932+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:30:10.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:09 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:09.932+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.446800+0000 front 2024-09-15T22:29:18.446729+0000 (oldest deadline 2024-09-15T22:29:43.146500+0000) 2024-09-15T22:30:10.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:09 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:09.932+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:25.947982+0000 front 2024-09-15T22:29:25.948006+0000 (oldest deadline 2024-09-15T22:29:50.648107+0000) 2024-09-15T22:30:10.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:09 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:09.932+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:37.049750+0000 front 2024-09-15T22:29:37.049867+0000 (oldest deadline 2024-09-15T22:30:00.549575+0000) 2024-09-15T22:30:10.310 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:09 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:09.847+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:30:10.310 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:09 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:09.847+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:30:10.311 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:09 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:09.847+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:30:10.311 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:09 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:09.847+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:30:10.311 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:09 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:09.847+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:28.556810+0000 front 2024-09-15T22:29:28.556785+0000 (oldest deadline 2024-09-15T22:29:53.256726+0000) 2024-09-15T22:30:10.311 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:09 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:09.847+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:36.157781+0000 front 2024-09-15T22:29:36.157801+0000 (oldest deadline 2024-09-15T22:30:00.257873+0000) 2024-09-15T22:30:10.557 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:10 smithi001 podman[84174]: 2024-09-15 22:30:10.304697103 +0000 UTC m=+5.932776826 container cleanup 757de75ff925999845ee0f65f0fac6259151235135d359ef86ab19ac196fe43f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-15T22:30:10.557 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:10 smithi001 bash[84174]: ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9 2024-09-15T22:30:10.875 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:10 smithi001 podman[84190]: 2024-09-15 22:30:10.555905321 +0000 UTC m=+0.691278693 container remove 757de75ff925999845ee0f65f0fac6259151235135d359ef86ab19ac196fe43f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-15T22:30:11.245 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:10 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:10.904+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:30:11.245 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:10 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:10.904+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:30:11.245 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:10 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:10.904+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:30:11.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:10 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:10.904+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.446800+0000 front 2024-09-15T22:29:18.446729+0000 (oldest deadline 2024-09-15T22:29:43.146500+0000) 2024-09-15T22:30:11.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:10 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:10.904+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:25.947982+0000 front 2024-09-15T22:29:25.948006+0000 (oldest deadline 2024-09-15T22:29:50.648107+0000) 2024-09-15T22:30:11.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:10 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:10.904+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:37.049750+0000 front 2024-09-15T22:29:37.049867+0000 (oldest deadline 2024-09-15T22:30:00.549575+0000) 2024-09-15T22:30:11.310 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:10 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:10.820+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:30:11.311 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:10 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:10.820+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:30:11.311 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:10 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:10.820+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:30:11.311 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:10 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:10.820+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:30:11.311 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:10 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:10.820+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:28.556810+0000 front 2024-09-15T22:29:28.556785+0000 (oldest deadline 2024-09-15T22:29:53.256726+0000) 2024-09-15T22:30:11.311 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:10 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:10.820+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:36.157781+0000 front 2024-09-15T22:29:36.157801+0000 (oldest deadline 2024-09-15T22:30:00.257873+0000) 2024-09-15T22:30:11.385 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:11 smithi001 podman[84275]: 2024-09-15 22:30:11.032738859 +0000 UTC m=+0.027535851 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:30:11.385 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:11 smithi001 podman[84275]: 2024-09-15 22:30:11.13158669 +0000 UTC m=+0.126383665 container create 95ef665fbd1b04ea16fdc04a1f8b2cd9f4862d84c113b934dd3d9fc844db5c6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:30:11.385 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:11 smithi001 podman[84275]: 2024-09-15 22:30:11.377140702 +0000 UTC m=+0.371937679 container init 95ef665fbd1b04ea16fdc04a1f8b2cd9f4862d84c113b934dd3d9fc844db5c6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD) 2024-09-15T22:30:11.385 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:11 smithi001 podman[84275]: 2024-09-15 22:30:11.384317396 +0000 UTC m=+0.379114373 container start 95ef665fbd1b04ea16fdc04a1f8b2cd9f4862d84c113b934dd3d9fc844db5c6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-15T22:30:11.648 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:11 smithi001 podman[84275]: 2024-09-15 22:30:11.492455601 +0000 UTC m=+0.487252578 container attach 95ef665fbd1b04ea16fdc04a1f8b2cd9f4862d84c113b934dd3d9fc844db5c6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731) 2024-09-15T22:30:12.004 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 15 22:30:11 smithi001 podman[84298]: 2024-09-15 22:30:11.687919871 +0000 UTC m=+0.026422513 container died 95ef665fbd1b04ea16fdc04a1f8b2cd9f4862d84c113b934dd3d9fc844db5c6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:30:12.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:11 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:11.909+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:30:12.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:11 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:11.909+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:30:12.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:11 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:11.909+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:30:12.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:11 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:11.909+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.446800+0000 front 2024-09-15T22:29:18.446729+0000 (oldest deadline 2024-09-15T22:29:43.146500+0000) 2024-09-15T22:30:12.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:11 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:11.909+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:25.947982+0000 front 2024-09-15T22:29:25.948006+0000 (oldest deadline 2024-09-15T22:29:50.648107+0000) 2024-09-15T22:30:12.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:11 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:11.909+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:37.049750+0000 front 2024-09-15T22:29:37.049867+0000 (oldest deadline 2024-09-15T22:30:00.549575+0000) 2024-09-15T22:30:12.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:11 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:11.909+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-15T22:29:41.050584+0000 front 2024-09-15T22:29:41.050605+0000 (oldest deadline 2024-09-15T22:30:11.650676+0000) 2024-09-15T22:30:12.310 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:11 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:11.816+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:30:12.311 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:11 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:11.816+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:30:12.311 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:11 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:11.816+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:30:12.311 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:11 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:11.816+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:30:12.311 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:11 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:11.816+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:28.556810+0000 front 2024-09-15T22:29:28.556785+0000 (oldest deadline 2024-09-15T22:29:53.256726+0000) 2024-09-15T22:30:12.311 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:11 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:11.816+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:36.157781+0000 front 2024-09-15T22:29:36.157801+0000 (oldest deadline 2024-09-15T22:30:00.257873+0000) 2024-09-15T22:30:12.328 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.9.service' 2024-09-15T22:30:12.404 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:30:12.404 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-15T22:30:12.405 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-15T22:30:12.405 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.10 2024-09-15T22:30:12.710 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:12 smithi012 systemd[1]: Stopping Ceph osd.10 for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:30:12.996 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:12 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:12.707+0000 7fa9c5b7a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:30:12.996 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:12 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:12.707+0000 7fa9c5b7a640 -1 osd.10 89 *** Got signal Terminated *** 2024-09-15T22:30:12.996 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:12 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:12.707+0000 7fa9c5b7a640 -1 osd.10 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:30:12.996 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:12 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:12.884+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:30:12.996 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:12 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:12.884+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:30:12.996 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:12 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:12.884+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:30:12.996 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:12 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:12.884+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.446800+0000 front 2024-09-15T22:29:18.446729+0000 (oldest deadline 2024-09-15T22:29:43.146500+0000) 2024-09-15T22:30:12.996 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:12 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:12.884+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:25.947982+0000 front 2024-09-15T22:29:25.948006+0000 (oldest deadline 2024-09-15T22:29:50.648107+0000) 2024-09-15T22:30:12.996 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:12 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:12.884+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:37.049750+0000 front 2024-09-15T22:29:37.049867+0000 (oldest deadline 2024-09-15T22:30:00.549575+0000) 2024-09-15T22:30:12.996 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:12 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:12.884+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-15T22:29:41.050584+0000 front 2024-09-15T22:29:41.050605+0000 (oldest deadline 2024-09-15T22:30:11.650676+0000) 2024-09-15T22:30:13.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:12 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:12.766+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:30:13.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:12 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:12.766+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:30:13.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:12 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:12.766+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:30:13.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:12 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:12.766+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:30:13.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:12 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:12.766+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:28.556810+0000 front 2024-09-15T22:29:28.556785+0000 (oldest deadline 2024-09-15T22:29:53.256726+0000) 2024-09-15T22:30:13.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:12 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:12.766+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:36.157781+0000 front 2024-09-15T22:29:36.157801+0000 (oldest deadline 2024-09-15T22:30:00.257873+0000) 2024-09-15T22:30:14.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:13 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:13.790+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:30:14.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:13 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:13.790+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:30:14.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:13 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:13.790+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:30:14.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:13 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:13.790+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:30:14.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:13 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:13.790+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:28.556810+0000 front 2024-09-15T22:29:28.556785+0000 (oldest deadline 2024-09-15T22:29:53.256726+0000) 2024-09-15T22:30:14.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:13 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:13.790+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:36.157781+0000 front 2024-09-15T22:29:36.157801+0000 (oldest deadline 2024-09-15T22:30:00.257873+0000) 2024-09-15T22:30:14.245 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:13 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:13.909+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:30:14.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:13 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:13.909+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:30:14.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:13 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:13.909+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:30:14.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:13 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:13.909+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.446800+0000 front 2024-09-15T22:29:18.446729+0000 (oldest deadline 2024-09-15T22:29:43.146500+0000) 2024-09-15T22:30:14.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:13 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:13.909+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:25.947982+0000 front 2024-09-15T22:29:25.948006+0000 (oldest deadline 2024-09-15T22:29:50.648107+0000) 2024-09-15T22:30:14.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:13 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:13.909+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:37.049750+0000 front 2024-09-15T22:29:37.049867+0000 (oldest deadline 2024-09-15T22:30:00.549575+0000) 2024-09-15T22:30:14.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:13 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:13.909+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-15T22:29:41.050584+0000 front 2024-09-15T22:29:41.050605+0000 (oldest deadline 2024-09-15T22:30:11.650676+0000) 2024-09-15T22:30:15.245 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:14 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:14.942+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:30:15.245 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:14 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:14.942+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:30:15.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:14 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:14.942+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:30:15.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:14 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:14.942+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.446800+0000 front 2024-09-15T22:29:18.446729+0000 (oldest deadline 2024-09-15T22:29:43.146500+0000) 2024-09-15T22:30:15.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:14 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:14.942+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:25.947982+0000 front 2024-09-15T22:29:25.948006+0000 (oldest deadline 2024-09-15T22:29:50.648107+0000) 2024-09-15T22:30:15.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:14 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:14.942+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:37.049750+0000 front 2024-09-15T22:29:37.049867+0000 (oldest deadline 2024-09-15T22:30:00.549575+0000) 2024-09-15T22:30:15.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:14 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:14.942+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-15T22:29:41.050584+0000 front 2024-09-15T22:29:41.050605+0000 (oldest deadline 2024-09-15T22:30:11.650676+0000) 2024-09-15T22:30:15.311 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:14 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:14.811+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:30:15.311 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:14 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:14.811+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:30:15.311 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:14 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:14.811+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:30:15.311 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:14 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:14.811+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:30:15.311 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:14 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:14.811+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:28.556810+0000 front 2024-09-15T22:29:28.556785+0000 (oldest deadline 2024-09-15T22:29:53.256726+0000) 2024-09-15T22:30:15.311 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:14 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:14.811+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:36.157781+0000 front 2024-09-15T22:29:36.157801+0000 (oldest deadline 2024-09-15T22:30:00.257873+0000) 2024-09-15T22:30:16.060 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:15 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:15.778+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:30:16.060 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:15 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:15.778+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:30:16.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:15 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:15.778+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:30:16.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:15 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:15.778+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:30:16.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:15 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:15.778+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:28.556810+0000 front 2024-09-15T22:29:28.556785+0000 (oldest deadline 2024-09-15T22:29:53.256726+0000) 2024-09-15T22:30:16.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:15 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:15.778+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:36.157781+0000 front 2024-09-15T22:29:36.157801+0000 (oldest deadline 2024-09-15T22:30:00.257873+0000) 2024-09-15T22:30:16.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:15 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:15.778+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6820 osd.7 since back 2024-09-15T22:29:52.960225+0000 front 2024-09-15T22:29:52.960239+0000 (oldest deadline 2024-09-15T22:30:15.260238+0000) 2024-09-15T22:30:16.245 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:15 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:15.986+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:30:16.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:15 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:15.986+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:30:16.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:15 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:15.986+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:30:16.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:15 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:15.986+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.446800+0000 front 2024-09-15T22:29:18.446729+0000 (oldest deadline 2024-09-15T22:29:43.146500+0000) 2024-09-15T22:30:16.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:15 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:15.986+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:25.947982+0000 front 2024-09-15T22:29:25.948006+0000 (oldest deadline 2024-09-15T22:29:50.648107+0000) 2024-09-15T22:30:16.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:15 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:15.986+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:37.049750+0000 front 2024-09-15T22:29:37.049867+0000 (oldest deadline 2024-09-15T22:30:00.549575+0000) 2024-09-15T22:30:16.246 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:15 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:15.986+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-15T22:29:41.050584+0000 front 2024-09-15T22:29:41.050605+0000 (oldest deadline 2024-09-15T22:30:11.650676+0000) 2024-09-15T22:30:17.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:16 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:16.769+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:30:17.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:16 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:16.769+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:30:17.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:16 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:16.769+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:30:17.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:16 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:16.769+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:30:17.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:16 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:16.769+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:28.556810+0000 front 2024-09-15T22:29:28.556785+0000 (oldest deadline 2024-09-15T22:29:53.256726+0000) 2024-09-15T22:30:17.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:16 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:16.769+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:36.157781+0000 front 2024-09-15T22:29:36.157801+0000 (oldest deadline 2024-09-15T22:30:00.257873+0000) 2024-09-15T22:30:17.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:16 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:16.769+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6820 osd.7 since back 2024-09-15T22:29:52.960225+0000 front 2024-09-15T22:29:52.960239+0000 (oldest deadline 2024-09-15T22:30:15.260238+0000) 2024-09-15T22:30:17.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:17 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:17.035+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:52.040260+0000 front 2024-09-15T22:28:52.040213+0000 (oldest deadline 2024-09-15T22:29:17.940300+0000) 2024-09-15T22:30:17.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:17 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:17.035+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:05.144233+0000 front 2024-09-15T22:29:05.144209+0000 (oldest deadline 2024-09-15T22:29:28.044300+0000) 2024-09-15T22:30:17.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:17 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:17.035+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:12.045444+0000 front 2024-09-15T22:29:12.045489+0000 (oldest deadline 2024-09-15T22:29:36.145532+0000) 2024-09-15T22:30:17.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:17 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:17.035+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:18.446800+0000 front 2024-09-15T22:29:18.446729+0000 (oldest deadline 2024-09-15T22:29:43.146500+0000) 2024-09-15T22:30:17.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:17 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:17.035+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:25.947982+0000 front 2024-09-15T22:29:25.948006+0000 (oldest deadline 2024-09-15T22:29:50.648107+0000) 2024-09-15T22:30:17.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:17 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:17.035+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:37.049750+0000 front 2024-09-15T22:29:37.049867+0000 (oldest deadline 2024-09-15T22:30:00.549575+0000) 2024-09-15T22:30:17.496 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:17 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10[59649]: 2024-09-15T22:30:17.035+0000 7fa9c217f640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-15T22:29:41.050584+0000 front 2024-09-15T22:29:41.050605+0000 (oldest deadline 2024-09-15T22:30:11.650676+0000) 2024-09-15T22:30:18.060 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:17 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:17.763+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:30:18.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:17 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:17.763+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:30:18.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:17 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:17.763+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:30:18.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:17 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:17.763+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:30:18.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:17 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:17.763+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:28.556810+0000 front 2024-09-15T22:29:28.556785+0000 (oldest deadline 2024-09-15T22:29:53.256726+0000) 2024-09-15T22:30:18.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:17 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:17.763+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:36.157781+0000 front 2024-09-15T22:29:36.157801+0000 (oldest deadline 2024-09-15T22:30:00.257873+0000) 2024-09-15T22:30:18.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:17 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:17.763+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6820 osd.7 since back 2024-09-15T22:29:52.960225+0000 front 2024-09-15T22:29:52.960239+0000 (oldest deadline 2024-09-15T22:30:15.260238+0000) 2024-09-15T22:30:18.476 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:18 smithi012 podman[68758]: 2024-09-15 22:30:18.147200941 +0000 UTC m=+5.541581305 container died a96ab2f21028a0747903f248cb0e327d5ee435cf6308c9fad5b07d319efd8433 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e) 2024-09-15T22:30:18.745 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:18 smithi012 podman[68758]: 2024-09-15 22:30:18.549490925 +0000 UTC m=+5.943871289 container cleanup a96ab2f21028a0747903f248cb0e327d5ee435cf6308c9fad5b07d319efd8433 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-15T22:30:18.746 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:18 smithi012 bash[68758]: ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10 2024-09-15T22:30:19.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:18 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:18.771+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:30:19.062 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:18 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:18.771+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:30:19.062 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:18 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:18.771+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:30:19.062 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:18 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:18.771+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:30:19.062 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:18 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:18.771+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:28.556810+0000 front 2024-09-15T22:29:28.556785+0000 (oldest deadline 2024-09-15T22:29:53.256726+0000) 2024-09-15T22:30:19.062 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:18 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:18.771+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:36.157781+0000 front 2024-09-15T22:29:36.157801+0000 (oldest deadline 2024-09-15T22:30:00.257873+0000) 2024-09-15T22:30:19.062 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:18 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:18.771+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6820 osd.7 since back 2024-09-15T22:29:52.960225+0000 front 2024-09-15T22:29:52.960239+0000 (oldest deadline 2024-09-15T22:30:15.260238+0000) 2024-09-15T22:30:19.106 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:18 smithi012 podman[68775]: 2024-09-15 22:30:18.794796277 +0000 UTC m=+0.643110647 container remove a96ab2f21028a0747903f248cb0e327d5ee435cf6308c9fad5b07d319efd8433 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-15T22:30:19.422 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:19 smithi012 podman[68863]: 2024-09-15 22:30:19.007975882 +0000 UTC m=+0.016027288 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:30:19.422 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:19 smithi012 podman[68863]: 2024-09-15 22:30:19.10984766 +0000 UTC m=+0.117899101 container create 503ed400ae162235ca3c37d51c212d14b55f6fd581385bf1d1836dbfa3c98541 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-15T22:30:19.422 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:19 smithi012 podman[68863]: 2024-09-15 22:30:19.337687472 +0000 UTC m=+0.345738877 container init 503ed400ae162235ca3c37d51c212d14b55f6fd581385bf1d1836dbfa3c98541 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-15T22:30:19.422 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:19 smithi012 podman[68863]: 2024-09-15 22:30:19.340846969 +0000 UTC m=+0.348898365 container start 503ed400ae162235ca3c37d51c212d14b55f6fd581385bf1d1836dbfa3c98541 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, ceph=True, GIT_CLEAN=True) 2024-09-15T22:30:19.422 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:19 smithi012 podman[68863]: 2024-09-15 22:30:19.420813563 +0000 UTC m=+0.428864978 container attach 503ed400ae162235ca3c37d51c212d14b55f6fd581385bf1d1836dbfa3c98541 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-15T22:30:19.745 INFO:journalctl@ceph.osd.10.smithi012.stdout:Sep 15 22:30:19 smithi012 podman[68863]: 2024-09-15 22:30:19.535940883 +0000 UTC m=+0.543992279 container died 503ed400ae162235ca3c37d51c212d14b55f6fd581385bf1d1836dbfa3c98541 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:30:20.060 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:19 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:19.726+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:30:20.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:19 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:19.726+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:30:20.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:19 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:19.726+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:30:20.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:19 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:19.726+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:30:20.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:19 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:19.726+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:28.556810+0000 front 2024-09-15T22:29:28.556785+0000 (oldest deadline 2024-09-15T22:29:53.256726+0000) 2024-09-15T22:30:20.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:19 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:19.726+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:36.157781+0000 front 2024-09-15T22:29:36.157801+0000 (oldest deadline 2024-09-15T22:30:00.257873+0000) 2024-09-15T22:30:20.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:19 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:19.726+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6820 osd.7 since back 2024-09-15T22:29:52.960225+0000 front 2024-09-15T22:29:52.960239+0000 (oldest deadline 2024-09-15T22:30:15.260238+0000) 2024-09-15T22:30:20.134 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.10.service' 2024-09-15T22:30:20.178 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:30:20.179 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-15T22:30:20.179 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-15T22:30:20.179 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.11 2024-09-15T22:30:20.560 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:20 smithi098 systemd[1]: Stopping Ceph osd.11 for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:30:21.060 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:20 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:20.729+0000 7fc9a0d20640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:30:21.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:20 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:20.729+0000 7fc9a0d20640 -1 osd.11 89 *** Got signal Terminated *** 2024-09-15T22:30:21.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:20 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:20.729+0000 7fc9a0d20640 -1 osd.11 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:30:21.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:20 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:20.767+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:30:21.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:20 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:20.767+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:30:21.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:20 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:20.767+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:30:21.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:20 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:20.767+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:30:21.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:20 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:20.767+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:28.556810+0000 front 2024-09-15T22:29:28.556785+0000 (oldest deadline 2024-09-15T22:29:53.256726+0000) 2024-09-15T22:30:21.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:20 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:20.767+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:36.157781+0000 front 2024-09-15T22:29:36.157801+0000 (oldest deadline 2024-09-15T22:30:00.257873+0000) 2024-09-15T22:30:21.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:20 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:20.767+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6820 osd.7 since back 2024-09-15T22:29:52.960225+0000 front 2024-09-15T22:29:52.960239+0000 (oldest deadline 2024-09-15T22:30:15.260238+0000) 2024-09-15T22:30:22.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:21 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:21.746+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:30:22.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:21 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:21.746+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:30:22.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:21 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:21.746+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:30:22.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:21 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:21.746+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:30:22.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:21 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:21.746+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:28.556810+0000 front 2024-09-15T22:29:28.556785+0000 (oldest deadline 2024-09-15T22:29:53.256726+0000) 2024-09-15T22:30:22.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:21 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:21.746+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:36.157781+0000 front 2024-09-15T22:29:36.157801+0000 (oldest deadline 2024-09-15T22:30:00.257873+0000) 2024-09-15T22:30:22.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:21 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:21.746+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6820 osd.7 since back 2024-09-15T22:29:52.960225+0000 front 2024-09-15T22:29:52.960239+0000 (oldest deadline 2024-09-15T22:30:15.260238+0000) 2024-09-15T22:30:23.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:22 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:22.746+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:30:23.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:22 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:22.746+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:30:23.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:22 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:22.746+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:30:23.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:22 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:22.746+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:30:23.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:22 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:22.746+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:28.556810+0000 front 2024-09-15T22:29:28.556785+0000 (oldest deadline 2024-09-15T22:29:53.256726+0000) 2024-09-15T22:30:23.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:22 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:22.746+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:36.157781+0000 front 2024-09-15T22:29:36.157801+0000 (oldest deadline 2024-09-15T22:30:00.257873+0000) 2024-09-15T22:30:23.062 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:22 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:22.746+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6820 osd.7 since back 2024-09-15T22:29:52.960225+0000 front 2024-09-15T22:29:52.960239+0000 (oldest deadline 2024-09-15T22:30:15.260238+0000) 2024-09-15T22:30:24.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:23 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:23.777+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:30:24.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:23 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:23.777+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:30:24.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:23 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:23.777+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:30:24.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:23 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:23.777+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:30:24.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:23 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:23.777+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:28.556810+0000 front 2024-09-15T22:29:28.556785+0000 (oldest deadline 2024-09-15T22:29:53.256726+0000) 2024-09-15T22:30:24.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:23 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:23.777+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:36.157781+0000 front 2024-09-15T22:29:36.157801+0000 (oldest deadline 2024-09-15T22:30:00.257873+0000) 2024-09-15T22:30:24.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:23 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:23.777+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6820 osd.7 since back 2024-09-15T22:29:52.960225+0000 front 2024-09-15T22:29:52.960239+0000 (oldest deadline 2024-09-15T22:30:15.260238+0000) 2024-09-15T22:30:24.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:23 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:23.777+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6820 osd.8 since back 2024-09-15T22:29:59.961244+0000 front 2024-09-15T22:29:59.961260+0000 (oldest deadline 2024-09-15T22:30:23.461406+0000) 2024-09-15T22:30:25.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:24 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:24.794+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-15T22:28:55.451465+0000 front 2024-09-15T22:28:55.451438+0000 (oldest deadline 2024-09-15T22:29:22.452133+0000) 2024-09-15T22:30:25.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:24 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:24.794+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6804 osd.1 since back 2024-09-15T22:29:03.553165+0000 front 2024-09-15T22:29:03.553180+0000 (oldest deadline 2024-09-15T22:29:29.453214+0000) 2024-09-15T22:30:25.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:24 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:24.794+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-15T22:29:09.453602+0000 front 2024-09-15T22:29:09.453526+0000 (oldest deadline 2024-09-15T22:29:34.753644+0000) 2024-09-15T22:30:25.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:24 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:24.794+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-15T22:29:19.354940+0000 front 2024-09-15T22:29:19.354977+0000 (oldest deadline 2024-09-15T22:29:45.254929+0000) 2024-09-15T22:30:25.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:24 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:24.794+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6812 osd.4 since back 2024-09-15T22:29:28.556810+0000 front 2024-09-15T22:29:28.556785+0000 (oldest deadline 2024-09-15T22:29:53.256726+0000) 2024-09-15T22:30:25.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:24 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:24.794+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-15T22:29:36.157781+0000 front 2024-09-15T22:29:36.157801+0000 (oldest deadline 2024-09-15T22:30:00.257873+0000) 2024-09-15T22:30:25.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:24 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:24.794+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6820 osd.7 since back 2024-09-15T22:29:52.960225+0000 front 2024-09-15T22:29:52.960239+0000 (oldest deadline 2024-09-15T22:30:15.260238+0000) 2024-09-15T22:30:25.061 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:24 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11[60354]: 2024-09-15T22:30:24.794+0000 7fc99d325640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.98:6820 osd.8 since back 2024-09-15T22:29:59.961244+0000 front 2024-09-15T22:29:59.961260+0000 (oldest deadline 2024-09-15T22:30:23.461406+0000) 2024-09-15T22:30:26.310 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:26 smithi098 podman[69928]: 2024-09-15 22:30:26.043784667 +0000 UTC m=+5.672143947 container died d54278b5aeb3fb701639340da0f267dabe97c15d1a731ee20567f8d9d1548cc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e) 2024-09-15T22:30:26.673 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:26 smithi098 podman[69928]: 2024-09-15 22:30:26.404017642 +0000 UTC m=+6.032376921 container cleanup d54278b5aeb3fb701639340da0f267dabe97c15d1a731ee20567f8d9d1548cc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-8921c8e) 2024-09-15T22:30:26.673 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:26 smithi098 bash[69928]: ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11 2024-09-15T22:30:27.021 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:26 smithi098 podman[69958]: 2024-09-15 22:30:26.671812961 +0000 UTC m=+0.624160228 container remove d54278b5aeb3fb701639340da0f267dabe97c15d1a731ee20567f8d9d1548cc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-15T22:30:27.292 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:27 smithi098 podman[70041]: 2024-09-15 22:30:26.92313251 +0000 UTC m=+0.015538110 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:30:27.292 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:27 smithi098 podman[70041]: 2024-09-15 22:30:27.022580901 +0000 UTC m=+0.114986523 container create 86ce052f76a5ff068eae12448253d3975881d18310973803d265cd0f593af888 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11-deactivate, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-15T22:30:27.292 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:27 smithi098 podman[70041]: 2024-09-15 22:30:27.216596982 +0000 UTC m=+0.309002562 container init 86ce052f76a5ff068eae12448253d3975881d18310973803d265cd0f593af888 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11-deactivate, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True) 2024-09-15T22:30:27.292 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:27 smithi098 podman[70041]: 2024-09-15 22:30:27.219895794 +0000 UTC m=+0.312301377 container start 86ce052f76a5ff068eae12448253d3975881d18310973803d265cd0f593af888 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-15T22:30:27.292 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:27 smithi098 podman[70041]: 2024-09-15 22:30:27.291472306 +0000 UTC m=+0.383877887 container attach 86ce052f76a5ff068eae12448253d3975881d18310973803d265cd0f593af888 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-15T22:30:27.560 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:27 smithi098 podman[70041]: 2024-09-15 22:30:27.408986613 +0000 UTC m=+0.501392201 container died 86ce052f76a5ff068eae12448253d3975881d18310973803d265cd0f593af888 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-15T22:30:27.939 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 15 22:30:27 smithi098 podman[70065]: 2024-09-15 22:30:27.936730127 +0000 UTC m=+0.522078772 container remove 86ce052f76a5ff068eae12448253d3975881d18310973803d265cd0f593af888 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:30:27.955 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@osd.11.service' 2024-09-15T22:30:27.994 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:30:27.994 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-15T22:30:27.994 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-15T22:30:27.994 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.a 2024-09-15T22:30:28.376 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 15 22:30:28 smithi001 systemd[1]: Stopping Ceph mds.a for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:30:28.705 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 15 22:30:28 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-a[69493]: 2024-09-15T22:30:28.400+0000 7f4dd9600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:30:28.705 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 15 22:30:28 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-a[69493]: 2024-09-15T22:30:28.400+0000 7f4dd9600640 -1 mds.a *** got signal Terminated *** 2024-09-15T22:30:31.959 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 15 22:30:31 smithi001 podman[84378]: 2024-09-15 22:30:31.632673326 +0000 UTC m=+3.342384555 container died b0beb6cadcb15c0033610aa15ee1bbf2008ffea0449f87705269fc35a7ed20e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, ceph=True, GIT_CLEAN=True) 2024-09-15T22:30:32.283 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 15 22:30:32 smithi001 podman[84378]: 2024-09-15 22:30:32.064306349 +0000 UTC m=+3.774017577 container cleanup b0beb6cadcb15c0033610aa15ee1bbf2008ffea0449f87705269fc35a7ed20e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-a, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e) 2024-09-15T22:30:32.283 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 15 22:30:32 smithi001 bash[84378]: ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-a 2024-09-15T22:30:32.557 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 15 22:30:32 smithi001 podman[84403]: 2024-09-15 22:30:32.282155214 +0000 UTC m=+0.634556919 container remove b0beb6cadcb15c0033610aa15ee1bbf2008ffea0449f87705269fc35a7ed20e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-a, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0) 2024-09-15T22:30:32.575 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.a.service' 2024-09-15T22:30:32.649 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:30:32.649 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-15T22:30:32.650 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-15T22:30:32.650 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.d 2024-09-15T22:30:32.876 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 15 22:30:32 smithi001 systemd[1]: Stopping Ceph mds.d for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:30:33.376 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 15 22:30:33 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-d[68330]: 2024-09-15T22:30:33.062+0000 7fd4ca600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:30:33.376 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 15 22:30:33 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-d[68330]: 2024-09-15T22:30:33.062+0000 7fd4ca600640 -1 mds.d *** got signal Terminated *** 2024-09-15T22:30:35.802 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 15 22:30:35 smithi001 podman[84511]: 2024-09-15 22:30:35.487559788 +0000 UTC m=+2.550111170 container died 7fb50fc7f87a8726100d277426e690fd0593f580d2f4fa0674dfcbbce1f783d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-d, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, ceph=True) 2024-09-15T22:30:36.126 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 15 22:30:35 smithi001 podman[84511]: 2024-09-15 22:30:35.90958695 +0000 UTC m=+2.972138337 container cleanup 7fb50fc7f87a8726100d277426e690fd0593f580d2f4fa0674dfcbbce1f783d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-d, GIT_CLEAN=True, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-15T22:30:36.126 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 15 22:30:35 smithi001 bash[84511]: ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-d 2024-09-15T22:30:36.441 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 15 22:30:36 smithi001 podman[84525]: 2024-09-15 22:30:36.160850282 +0000 UTC m=+0.655320870 container remove 7fb50fc7f87a8726100d277426e690fd0593f580d2f4fa0674dfcbbce1f783d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-d, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-15T22:30:36.465 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.d.service' 2024-09-15T22:30:36.538 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:30:36.538 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-15T22:30:36.538 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-15T22:30:36.538 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.g 2024-09-15T22:30:36.876 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 15 22:30:36 smithi001 systemd[1]: Stopping Ceph mds.g for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:30:37.376 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 15 22:30:36 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-g[69142]: 2024-09-15T22:30:36.932+0000 7f3181000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:30:37.376 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 15 22:30:36 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-g[69142]: 2024-09-15T22:30:36.932+0000 7f3181000640 -1 mds.g *** got signal Terminated *** 2024-09-15T22:30:40.299 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 15 22:30:40 smithi001 podman[84631]: 2024-09-15 22:30:40.002724067 +0000 UTC m=+3.189224801 container died 400c8e3d39dfbf7defb4a3831e55800ea265767c4124ce637bdd1541b175bcc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-g, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-15T22:30:40.626 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 15 22:30:40 smithi001 podman[84631]: 2024-09-15 22:30:40.405287277 +0000 UTC m=+3.591787997 container cleanup 400c8e3d39dfbf7defb4a3831e55800ea265767c4124ce637bdd1541b175bcc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-g, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-15T22:30:40.626 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 15 22:30:40 smithi001 bash[84631]: ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-g 2024-09-15T22:30:40.900 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 15 22:30:40 smithi001 podman[84643]: 2024-09-15 22:30:40.639666079 +0000 UTC m=+0.632241665 container remove 400c8e3d39dfbf7defb4a3831e55800ea265767c4124ce637bdd1541b175bcc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-g, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:30:40.908 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.g.service' 2024-09-15T22:30:40.980 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:30:40.981 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-15T22:30:40.981 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-15T22:30:40.981 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.j 2024-09-15T22:30:41.376 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 15 22:30:41 smithi001 systemd[1]: Stopping Ceph mds.j for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:30:41.876 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 15 22:30:41 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-j[67944]: 2024-09-15T22:30:41.385+0000 7f54b6c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:30:41.876 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 15 22:30:41 smithi001 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-j[67944]: 2024-09-15T22:30:41.385+0000 7f54b6c00640 -1 mds.j *** got signal Terminated *** 2024-09-15T22:30:43.626 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 15 22:30:43 smithi001 podman[84751]: 2024-09-15 22:30:43.331567706 +0000 UTC m=+2.063602218 container died 39779d0cb834b98540236762f0eb4a18184b0d5d73b7fa758fad5d212b8e6f50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-j, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-15T22:30:44.005 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 15 22:30:43 smithi001 podman[84751]: 2024-09-15 22:30:43.758708875 +0000 UTC m=+2.490743386 container cleanup 39779d0cb834b98540236762f0eb4a18184b0d5d73b7fa758fad5d212b8e6f50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-j, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True) 2024-09-15T22:30:44.005 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 15 22:30:43 smithi001 bash[84751]: ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-j 2024-09-15T22:30:44.253 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 15 22:30:44 smithi001 podman[84762]: 2024-09-15 22:30:44.001236546 +0000 UTC m=+0.658387599 container remove 39779d0cb834b98540236762f0eb4a18184b0d5d73b7fa758fad5d212b8e6f50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-j, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:30:44.278 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.j.service' 2024-09-15T22:30:44.347 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:30:44.347 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-15T22:30:44.347 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-15T22:30:44.347 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.b 2024-09-15T22:30:44.650 INFO:journalctl@ceph.mds.b.smithi012.stdout:Sep 15 22:30:44 smithi012 systemd[1]: Stopping Ceph mds.b for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:30:44.995 INFO:journalctl@ceph.mds.b.smithi012.stdout:Sep 15 22:30:44 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-b[65028]: 2024-09-15T22:30:44.648+0000 7f85de6db640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:30:44.995 INFO:journalctl@ceph.mds.b.smithi012.stdout:Sep 15 22:30:44 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-b[65028]: 2024-09-15T22:30:44.648+0000 7f85de6db640 -1 mds.b *** got signal Terminated *** 2024-09-15T22:30:48.857 INFO:journalctl@ceph.mds.b.smithi012.stdout:Sep 15 22:30:48 smithi012 podman[68975]: 2024-09-15 22:30:48.567629899 +0000 UTC m=+4.019121237 container died 13ce424b84e7f1ea6c71f0d8b304cd2081c59bfe8c1c127a045ae5a10b3db09a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-b, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-15T22:30:49.245 INFO:journalctl@ceph.mds.b.smithi012.stdout:Sep 15 22:30:49 smithi012 podman[68975]: 2024-09-15 22:30:49.047726847 +0000 UTC m=+4.499218183 container cleanup 13ce424b84e7f1ea6c71f0d8b304cd2081c59bfe8c1c127a045ae5a10b3db09a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-15T22:30:49.245 INFO:journalctl@ceph.mds.b.smithi012.stdout:Sep 15 22:30:49 smithi012 bash[68975]: ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-b 2024-09-15T22:30:49.482 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.b.service' 2024-09-15T22:30:49.503 INFO:journalctl@ceph.mds.b.smithi012.stdout:Sep 15 22:30:49 smithi012 podman[68987]: 2024-09-15 22:30:49.307280474 +0000 UTC m=+0.732828531 container remove 13ce424b84e7f1ea6c71f0d8b304cd2081c59bfe8c1c127a045ae5a10b3db09a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-b, RELEASE=squid-8921c8e, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-15T22:30:49.504 INFO:journalctl@ceph.mds.b.smithi012.stdout:Sep 15 22:30:49 smithi012 systemd[1]: ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.b.service: Deactivated successfully. 2024-09-15T22:30:49.504 INFO:journalctl@ceph.mds.b.smithi012.stdout:Sep 15 22:30:49 smithi012 systemd[1]: Stopped Ceph mds.b for c1228c44-73af-11ef-bceb-c7b262605968. 2024-09-15T22:30:49.504 INFO:journalctl@ceph.mds.b.smithi012.stdout:Sep 15 22:30:49 smithi012 systemd[1]: ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.b.service: Consumed 51.686s CPU time. 2024-09-15T22:30:49.516 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:30:49.516 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-15T22:30:49.516 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-15T22:30:49.517 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.e 2024-09-15T22:30:49.828 INFO:journalctl@ceph.mds.e.smithi012.stdout:Sep 15 22:30:49 smithi012 systemd[1]: Stopping Ceph mds.e for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:30:50.245 INFO:journalctl@ceph.mds.e.smithi012.stdout:Sep 15 22:30:49 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-e[64412]: 2024-09-15T22:30:49.826+0000 7f36876d5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:30:50.245 INFO:journalctl@ceph.mds.e.smithi012.stdout:Sep 15 22:30:49 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-e[64412]: 2024-09-15T22:30:49.826+0000 7f36876d5640 -1 mds.e *** got signal Terminated *** 2024-09-15T22:30:54.111 INFO:journalctl@ceph.mds.e.smithi012.stdout:Sep 15 22:30:53 smithi012 podman[69092]: 2024-09-15 22:30:53.835541123 +0000 UTC m=+4.101748775 container died 9e02fdcc515d1f5ec27f96a7cad0d76ad6213c35c3bd20f193e5b2cac185ad3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-15T22:30:54.461 INFO:journalctl@ceph.mds.e.smithi012.stdout:Sep 15 22:30:54 smithi012 podman[69092]: 2024-09-15 22:30:54.209248433 +0000 UTC m=+4.475456081 container cleanup 9e02fdcc515d1f5ec27f96a7cad0d76ad6213c35c3bd20f193e5b2cac185ad3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-e, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-15T22:30:54.461 INFO:journalctl@ceph.mds.e.smithi012.stdout:Sep 15 22:30:54 smithi012 bash[69092]: ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-e 2024-09-15T22:30:54.598 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.e.service' 2024-09-15T22:30:54.632 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:30:54.633 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-15T22:30:54.633 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-15T22:30:54.633 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.h 2024-09-15T22:30:54.995 INFO:journalctl@ceph.mds.h.smithi012.stdout:Sep 15 22:30:54 smithi012 systemd[1]: Stopping Ceph mds.h for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:30:54.995 INFO:journalctl@ceph.mds.h.smithi012.stdout:Sep 15 22:30:54 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-h[64726]: 2024-09-15T22:30:54.962+0000 7f674eabe640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:30:54.996 INFO:journalctl@ceph.mds.h.smithi012.stdout:Sep 15 22:30:54 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-h[64726]: 2024-09-15T22:30:54.962+0000 7f674eabe640 -1 mds.h *** got signal Terminated *** 2024-09-15T22:30:56.856 INFO:journalctl@ceph.mds.h.smithi012.stdout:Sep 15 22:30:56 smithi012 podman[69225]: 2024-09-15 22:30:56.57220435 +0000 UTC m=+1.708318105 container died cb5a0e662b653e0727987732f96949ae98d448a7f381f97be588dd74592fc34e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-15T22:30:57.198 INFO:journalctl@ceph.mds.h.smithi012.stdout:Sep 15 22:30:56 smithi012 podman[69225]: 2024-09-15 22:30:56.946376937 +0000 UTC m=+2.082490692 container cleanup cb5a0e662b653e0727987732f96949ae98d448a7f381f97be588dd74592fc34e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-h, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e) 2024-09-15T22:30:57.198 INFO:journalctl@ceph.mds.h.smithi012.stdout:Sep 15 22:30:56 smithi012 bash[69225]: ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-h 2024-09-15T22:30:57.327 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.h.service' 2024-09-15T22:30:57.360 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:30:57.360 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-15T22:30:57.361 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-15T22:30:57.361 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.k 2024-09-15T22:30:57.495 INFO:journalctl@ceph.mds.k.smithi012.stdout:Sep 15 22:30:57 smithi012 systemd[1]: Stopping Ceph mds.k for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:30:57.995 INFO:journalctl@ceph.mds.k.smithi012.stdout:Sep 15 22:30:57 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-k[64114]: 2024-09-15T22:30:57.658+0000 7f3315b84640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:30:57.995 INFO:journalctl@ceph.mds.k.smithi012.stdout:Sep 15 22:30:57 smithi012 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-k[64114]: 2024-09-15T22:30:57.658+0000 7f3315b84640 -1 mds.k *** got signal Terminated *** 2024-09-15T22:30:59.992 INFO:journalctl@ceph.mds.k.smithi012.stdout:Sep 15 22:30:59 smithi012 podman[69342]: 2024-09-15 22:30:59.686881057 +0000 UTC m=+2.107241833 container died df95c7b72bee5d8c57a8512b63e1acd1ad12b068fecfa138454bb7935b72889e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-k, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:30:59.992 INFO:journalctl@ceph.mds.k.smithi012.stdout:Sep 15 22:30:59 smithi012 podman[69342]: 2024-09-15 22:30:59.991644762 +0000 UTC m=+2.412005538 container cleanup df95c7b72bee5d8c57a8512b63e1acd1ad12b068fecfa138454bb7935b72889e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:31:00.245 INFO:journalctl@ceph.mds.k.smithi012.stdout:Sep 15 22:30:59 smithi012 bash[69342]: ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-k 2024-09-15T22:31:00.245 INFO:journalctl@ceph.mds.k.smithi012.stdout:Sep 15 22:31:00 smithi012 podman[69355]: 2024-09-15 22:31:00.225946868 +0000 UTC m=+0.535590587 container remove df95c7b72bee5d8c57a8512b63e1acd1ad12b068fecfa138454bb7935b72889e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-k, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731) 2024-09-15T22:31:00.375 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.k.service' 2024-09-15T22:31:00.406 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:31:00.406 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-15T22:31:00.406 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-15T22:31:00.407 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.c 2024-09-15T22:31:00.688 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 15 22:31:00 smithi098 systemd[1]: Stopping Ceph mds.c for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:31:00.946 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 15 22:31:00 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-c[65758]: 2024-09-15T22:31:00.703+0000 7f24ecbe6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:31:00.946 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 15 22:31:00 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-c[65758]: 2024-09-15T22:31:00.703+0000 7f24ecbe6640 -1 mds.c *** got signal Terminated *** 2024-09-15T22:31:04.855 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 15 22:31:04 smithi098 podman[70145]: 2024-09-15 22:31:04.587709227 +0000 UTC m=+3.990153427 container died c58abb493dbdb4e40252e71ae8d7be7049b804d7fa59da1b0c8538409bb0003d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-c, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-15T22:31:05.205 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 15 22:31:04 smithi098 podman[70145]: 2024-09-15 22:31:04.945159031 +0000 UTC m=+4.347603231 container cleanup c58abb493dbdb4e40252e71ae8d7be7049b804d7fa59da1b0c8538409bb0003d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-c, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:31:05.206 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 15 22:31:04 smithi098 bash[70145]: ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-c 2024-09-15T22:31:05.381 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.c.service' 2024-09-15T22:31:05.417 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:31:05.417 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-15T22:31:05.417 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-15T22:31:05.417 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.f 2024-09-15T22:31:05.734 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 15 22:31:05 smithi098 systemd[1]: Stopping Ceph mds.f for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:31:06.060 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 15 22:31:05 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-f[65458]: 2024-09-15T22:31:05.732+0000 7fb7ad1dd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:31:06.060 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 15 22:31:05 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-f[65458]: 2024-09-15T22:31:05.732+0000 7fb7ad1dd640 -1 mds.f *** got signal Terminated *** 2024-09-15T22:31:08.842 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 15 22:31:08 smithi098 podman[70278]: 2024-09-15 22:31:08.578452357 +0000 UTC m=+2.947442421 container died fd056ace14bafdf7c5f81a8e554978868d651cc133f0219f5179cae4b3cbe597 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-f, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e) 2024-09-15T22:31:09.159 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 15 22:31:08 smithi098 podman[70278]: 2024-09-15 22:31:08.924437534 +0000 UTC m=+3.293427597 container cleanup fd056ace14bafdf7c5f81a8e554978868d651cc133f0219f5179cae4b3cbe597 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-f, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS) 2024-09-15T22:31:09.160 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 15 22:31:08 smithi098 bash[70278]: ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-f 2024-09-15T22:31:09.305 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.f.service' 2024-09-15T22:31:09.339 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:31:09.339 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-15T22:31:09.339 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-15T22:31:09.340 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.i 2024-09-15T22:31:09.811 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 15 22:31:09 smithi098 systemd[1]: Stopping Ceph mds.i for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:31:09.811 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 15 22:31:09 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-i[66060]: 2024-09-15T22:31:09.652+0000 7f66c73c2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:31:09.811 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 15 22:31:09 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-i[66060]: 2024-09-15T22:31:09.652+0000 7f66c73c2640 -1 mds.i *** got signal Terminated *** 2024-09-15T22:31:12.838 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 15 22:31:12 smithi098 podman[70401]: 2024-09-15 22:31:12.580118549 +0000 UTC m=+3.017354642 container died e2fb1c79b33ca8a3e2ce9bba216fa3b74f9b57ad81cb41908d78fc931ebd8380 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-15T22:31:13.222 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 15 22:31:12 smithi098 podman[70401]: 2024-09-15 22:31:12.928328899 +0000 UTC m=+3.365564999 container cleanup e2fb1c79b33ca8a3e2ce9bba216fa3b74f9b57ad81cb41908d78fc931ebd8380 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-i, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_CLEAN=True) 2024-09-15T22:31:13.222 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 15 22:31:12 smithi098 bash[70401]: ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-i 2024-09-15T22:31:13.363 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.i.service' 2024-09-15T22:31:13.395 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:31:13.396 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-15T22:31:13.396 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-15T22:31:13.396 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.l 2024-09-15T22:31:13.810 INFO:journalctl@ceph.mds.l.smithi098.stdout:Sep 15 22:31:13 smithi098 systemd[1]: Stopping Ceph mds.l for c1228c44-73af-11ef-bceb-c7b262605968... 2024-09-15T22:31:13.811 INFO:journalctl@ceph.mds.l.smithi098.stdout:Sep 15 22:31:13 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-l[65144]: 2024-09-15T22:31:13.706+0000 7f7604ea5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:31:13.811 INFO:journalctl@ceph.mds.l.smithi098.stdout:Sep 15 22:31:13 smithi098 ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-l[65144]: 2024-09-15T22:31:13.706+0000 7f7604ea5640 -1 mds.l *** got signal Terminated *** 2024-09-15T22:31:16.901 INFO:journalctl@ceph.mds.l.smithi098.stdout:Sep 15 22:31:16 smithi098 podman[70522]: 2024-09-15 22:31:16.575204015 +0000 UTC m=+2.965628958 container died 7f597d21822dde1a02b8ae4b372d33d5d6012ebfd857f696f2a7f4589fcd936b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-l, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-15T22:31:17.201 INFO:journalctl@ceph.mds.l.smithi098.stdout:Sep 15 22:31:16 smithi098 podman[70522]: 2024-09-15 22:31:16.998949524 +0000 UTC m=+3.389374499 container cleanup 7f597d21822dde1a02b8ae4b372d33d5d6012ebfd857f696f2a7f4589fcd936b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-l, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:31:17.201 INFO:journalctl@ceph.mds.l.smithi098.stdout:Sep 15 22:31:16 smithi098 bash[70522]: ceph-c1228c44-73af-11ef-bceb-c7b262605968-mds-l 2024-09-15T22:31:17.427 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1228c44-73af-11ef-bceb-c7b262605968@mds.l.service' 2024-09-15T22:31:17.459 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:31:17.460 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-15T22:31:17.460 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c1228c44-73af-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-15T22:31:17.742 INFO:teuthology.orchestra.run.smithi001.stdout:Deleting cluster with fsid: c1228c44-73af-11ef-bceb-c7b262605968 2024-09-15T22:31:21.616 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c1228c44-73af-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-15T22:31:21.824 INFO:teuthology.orchestra.run.smithi012.stdout:Deleting cluster with fsid: c1228c44-73af-11ef-bceb-c7b262605968 2024-09-15T22:31:24.223 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c1228c44-73af-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-15T22:31:24.424 INFO:teuthology.orchestra.run.smithi098.stdout:Deleting cluster with fsid: c1228c44-73af-11ef-bceb-c7b262605968 2024-09-15T22:31:26.859 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:31:26.923 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:31:26.956 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:31:26.983 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-15T22:31:26.984 DEBUG:teuthology.misc:Transferring archived files from smithi001:/var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906236/remote/smithi001/crash 2024-09-15T22:31:26.985 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/crash -- . 2024-09-15T22:31:27.060 INFO:teuthology.orchestra.run.smithi001.stderr:tar: /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-15T22:31:27.060 INFO:teuthology.orchestra.run.smithi001.stderr:tar: Error is not recoverable: exiting now 2024-09-15T22:31:27.064 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906236/remote/smithi012/crash 2024-09-15T22:31:27.065 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/crash -- . 2024-09-15T22:31:27.107 INFO:teuthology.orchestra.run.smithi012.stderr:tar: /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-15T22:31:27.107 INFO:teuthology.orchestra.run.smithi012.stderr:tar: Error is not recoverable: exiting now 2024-09-15T22:31:27.109 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906236/remote/smithi098/crash 2024-09-15T22:31:27.110 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/crash -- . 2024-09-15T22:31:27.151 INFO:teuthology.orchestra.run.smithi098.stderr:tar: /var/lib/ceph/c1228c44-73af-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-15T22:31:27.151 INFO:teuthology.orchestra.run.smithi098.stderr:tar: Error is not recoverable: exiting now 2024-09-15T22:31:27.153 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-15T22:31:27.153 DEBUG:teuthology.orchestra.run.smithi001:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-15T22:31:27.236 INFO:tasks.cephadm:Compressing logs... 2024-09-15T22:31:27.237 DEBUG:teuthology.orchestra.run.smithi001:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T22:31:27.241 DEBUG:teuthology.orchestra.run.smithi012:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T22:31:27.244 DEBUG:teuthology.orchestra.run.smithi098:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T22:31:27.272 INFO:teuthology.orchestra.run.smithi098.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-15T22:31:27.272 INFO:teuthology.orchestra.run.smithi098.stderr:: No such file or directory 2024-09-15T22:31:27.272 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-15T22:31:27.272 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-15T22:31:27.272 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-15T22:31:27.272 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-15T22:31:27.272 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-15T22:31:27.273 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mon.c.log: /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-15T22:31:27.273 INFO:teuthology.orchestra.run.smithi098.stderr: 82.6% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-15T22:31:27.273 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-15T22:31:27.273 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph.log 2024-09-15T22:31:27.273 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.5.log: 90.5% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-15T22:31:27.273 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-15T22:31:27.274 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph.log: 86.2% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-15T22:31:27.282 INFO:teuthology.orchestra.run.smithi012.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-15T22:31:27.282 INFO:teuthology.orchestra.run.smithi012.stderr:: No such file or directory 2024-09-15T22:31:27.282 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-15T22:31:27.282 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-15T22:31:27.282 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-15T22:31:27.283 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-15T22:31:27.283 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-15T22:31:27.283 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-15T22:31:27.283 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-15T22:31:27.283 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-15T22:31:27.283 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph.audit.log: 94.7% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-15T22:31:27.283 INFO:teuthology.orchestra.run.smithi012.stderr: 90.4% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph.audit.log.gzgzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-15T22:31:27.283 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-09-15T22:31:27.283 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph.cephadm.log: 82.6%gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph.log 2024-09-15T22:31:27.283 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-15T22:31:27.283 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-15T22:31:27.283 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mgr.y.log: /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph.log: 86.2% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-15T22:31:27.283 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-15T22:31:27.285 INFO:teuthology.orchestra.run.smithi098.stderr: 90.9% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-15T22:31:27.285 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-15T22:31:27.285 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-15T22:31:27.286 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-15T22:31:27.287 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.h.log: 92.2% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-15T22:31:27.288 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-15T22:31:27.288 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mon.b.log: 90.9% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-15T22:31:27.288 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-15T22:31:27.289 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mgr.z.log: 92.3% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-15T22:31:27.289 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-15T22:31:27.290 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.e.log: 94.5% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-15T22:31:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-15T22:31:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:: No such file or directory 2024-09-15T22:31:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-15T22:31:27.293 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-15T22:31:27.293 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-15T22:31:27.294 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-15T22:31:27.295 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-15T22:31:27.296 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-15T22:31:27.298 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-15T22:31:27.299 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph.cephadm.log: 90.3% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-15T22:31:27.299 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-15T22:31:27.300 INFO:teuthology.orchestra.run.smithi001.stderr: 82.5% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-15T22:31:27.300 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-15T22:31:27.303 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-15T22:31:27.303 INFO:teuthology.orchestra.run.smithi001.stderr: 94.5%/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.g.log: -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-15T22:31:27.303 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph.log 2024-09-15T22:31:27.303 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-15T22:31:27.305 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph.log: /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.d.log: 94.5% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-15T22:31:27.306 INFO:teuthology.orchestra.run.smithi001.stderr: 86.3% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-15T22:31:27.306 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-15T22:31:27.308 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-15T22:31:27.309 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mgr.x.log: 94.5% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-15T22:31:27.309 INFO:teuthology.orchestra.run.smithi001.stderr: 91.0% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-15T22:31:27.310 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-15T22:31:27.311 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-15T22:31:27.314 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 94.7% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-15T22:31:27.324 INFO:teuthology.orchestra.run.smithi001.stderr: 93.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-15T22:31:27.324 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-15T22:31:27.495 INFO:teuthology.orchestra.run.smithi012.stderr: 91.7% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-15T22:31:27.530 INFO:teuthology.orchestra.run.smithi001.stderr: 90.0% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-15T22:31:27.592 INFO:teuthology.orchestra.run.smithi098.stderr: 91.7% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-15T22:31:27.865 INFO:teuthology.orchestra.run.smithi001.stderr: 90.5% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-15T22:31:28.690 INFO:teuthology.orchestra.run.smithi098.stderr: 95.3% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-15T22:31:28.877 INFO:teuthology.orchestra.run.smithi001.stderr: 93.7% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-15T22:31:29.130 INFO:teuthology.orchestra.run.smithi012.stderr: 93.7% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-15T22:31:29.228 INFO:teuthology.orchestra.run.smithi012.stderr: 93.8% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-15T22:31:29.392 INFO:teuthology.orchestra.run.smithi098.stderr: 93.6% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-15T22:31:29.445 INFO:teuthology.orchestra.run.smithi012.stderr: 95.4% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-15T22:31:29.462 INFO:teuthology.orchestra.run.smithi001.stderr: 93.6% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-15T22:31:29.616 INFO:teuthology.orchestra.run.smithi001.stderr: 93.6% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-15T22:31:29.765 INFO:teuthology.orchestra.run.smithi098.stderr: 93.7% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-15T22:31:29.791 INFO:teuthology.orchestra.run.smithi001.stderr: 93.6% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-15T22:31:29.794 INFO:teuthology.orchestra.run.smithi001.stderr: 2024-09-15T22:31:29.794 INFO:teuthology.orchestra.run.smithi001.stderr:real 0m2.524s 2024-09-15T22:31:29.794 INFO:teuthology.orchestra.run.smithi001.stderr:user 0m8.630s 2024-09-15T22:31:29.794 INFO:teuthology.orchestra.run.smithi001.stderr:sys 0m0.823s 2024-09-15T22:31:29.829 INFO:teuthology.orchestra.run.smithi012.stderr: 93.7% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-15T22:31:29.877 INFO:teuthology.orchestra.run.smithi098.stderr: 93.6% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-15T22:31:30.117 INFO:teuthology.orchestra.run.smithi098.stderr: 93.7% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-15T22:31:30.117 INFO:teuthology.orchestra.run.smithi098.stderr: 94.9% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-15T22:31:30.248 INFO:teuthology.orchestra.run.smithi012.stderr: 93.7% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-15T22:31:40.645 INFO:teuthology.orchestra.run.smithi098.stderr: 93.6% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-15T22:31:46.897 INFO:teuthology.orchestra.run.smithi012.stderr: 93.5% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-15T22:31:46.899 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-09-15T22:31:46.899 INFO:teuthology.orchestra.run.smithi012.stderr:real 0m19.640s 2024-09-15T22:31:46.899 INFO:teuthology.orchestra.run.smithi012.stderr:user 0m30.423s 2024-09-15T22:31:46.899 INFO:teuthology.orchestra.run.smithi012.stderr:sys 0m0.932s 2024-09-15T22:31:51.657 INFO:teuthology.orchestra.run.smithi098.stderr: 93.2% -- replaced with /var/log/ceph/c1228c44-73af-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-15T22:31:51.659 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-15T22:31:51.659 INFO:teuthology.orchestra.run.smithi098.stderr:real 0m24.401s 2024-09-15T22:31:51.659 INFO:teuthology.orchestra.run.smithi098.stderr:user 0m50.454s 2024-09-15T22:31:51.659 INFO:teuthology.orchestra.run.smithi098.stderr:sys 0m1.552s 2024-09-15T22:31:51.660 INFO:tasks.cephadm:Archiving logs... 2024-09-15T22:31:51.660 DEBUG:teuthology.misc:Transferring archived files from smithi001:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906236/remote/smithi001/log 2024-09-15T22:31:51.661 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T22:31:52.896 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906236/remote/smithi012/log 2024-09-15T22:31:52.898 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T22:31:57.121 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906236/remote/smithi098/log 2024-09-15T22:31:57.122 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T22:32:03.897 INFO:tasks.cephadm:Removing cluster... 2024-09-15T22:32:03.897 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c1228c44-73af-11ef-bceb-c7b262605968 --force 2024-09-15T22:32:04.183 INFO:teuthology.orchestra.run.smithi001.stdout:Deleting cluster with fsid: c1228c44-73af-11ef-bceb-c7b262605968 2024-09-15T22:32:04.641 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c1228c44-73af-11ef-bceb-c7b262605968 --force 2024-09-15T22:32:04.841 INFO:teuthology.orchestra.run.smithi012.stdout:Deleting cluster with fsid: c1228c44-73af-11ef-bceb-c7b262605968 2024-09-15T22:32:05.121 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c1228c44-73af-11ef-bceb-c7b262605968 --force 2024-09-15T22:32:05.324 INFO:teuthology.orchestra.run.smithi098.stdout:Deleting cluster with fsid: c1228c44-73af-11ef-bceb-c7b262605968 2024-09-15T22:32:05.711 INFO:tasks.cephadm:Removing cephadm ... 2024-09-15T22:32:05.711 DEBUG:teuthology.orchestra.run.smithi001:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-15T22:32:05.751 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-15T22:32:05.770 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-15T22:32:05.786 INFO:tasks.cephadm:Teardown complete 2024-09-15T22:32:05.786 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-15T22:32:05.798 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-15T22:32:05.798 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T22:32:05.803 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T22:32:05.812 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T22:32:05.933 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-15T22:32:05.943 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-15T22:32:05.943 DEBUG:teuthology.orchestra.run.smithi001:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:32:05.948 DEBUG:teuthology.orchestra.run.smithi012:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:32:05.950 DEBUG:teuthology.orchestra.run.smithi098:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:32:05.964 INFO:teuthology.orchestra.run.smithi012.stderr:bash: line 1: ntpq: command not found 2024-09-15T22:32:05.964 INFO:teuthology.orchestra.run.smithi098.stderr:bash: line 1: ntpq: command not found 2024-09-15T22:32:05.968 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T22:32:05.968 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2024-09-15T22:32:05.969 INFO:teuthology.orchestra.run.smithi098.stdout:^* hv01.front.sepia.ceph.com 3 6 377 48 +1089us[+1078us] +/- 39ms 2024-09-15T22:32:05.969 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 48 -945us[ -956us] +/- 50ms 2024-09-15T22:32:05.969 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 49 -643us[ -655us] +/- 61ms 2024-09-15T22:32:05.969 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:32:05.970 INFO:teuthology.orchestra.run.smithi012.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T22:32:05.970 INFO:teuthology.orchestra.run.smithi012.stdout:=============================================================================== 2024-09-15T22:32:05.970 INFO:teuthology.orchestra.run.smithi012.stdout:^* hv01.front.sepia.ceph.com 3 6 377 48 +1096us[+1098us] +/- 39ms 2024-09-15T22:32:05.970 INFO:teuthology.orchestra.run.smithi012.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 51 -958us[ -956us] +/- 50ms 2024-09-15T22:32:05.970 INFO:teuthology.orchestra.run.smithi012.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 49 -629us[ -626us] +/- 61ms 2024-09-15T22:32:05.971 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:32:05.977 INFO:teuthology.orchestra.run.smithi001.stderr:bash: line 1: ntpq: command not found 2024-09-15T22:32:05.985 INFO:teuthology.orchestra.run.smithi001.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T22:32:05.985 INFO:teuthology.orchestra.run.smithi001.stdout:=============================================================================== 2024-09-15T22:32:05.985 INFO:teuthology.orchestra.run.smithi001.stdout:^* hv01.front.sepia.ceph.com 3 6 377 45 +1109us[+1036us] +/- 39ms 2024-09-15T22:32:05.985 INFO:teuthology.orchestra.run.smithi001.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 45 -937us[ -937us] +/- 50ms 2024-09-15T22:32:05.985 INFO:teuthology.orchestra.run.smithi001.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 46 -588us[ -661us] +/- 61ms 2024-09-15T22:32:05.985 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:32:05.986 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-15T22:32:05.997 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-15T22:32:05.997 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-15T22:32:06.007 DEBUG:teuthology.orchestra.run.smithi001:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-15T22:32:06.154 DEBUG:teuthology.orchestra.run.smithi012:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-15T22:32:06.228 DEBUG:teuthology.orchestra.run.smithi098:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-15T22:32:06.296 DEBUG:teuthology.orchestra.run.smithi001:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T22:32:06.356 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:32:06.356 DEBUG:teuthology.orchestra.run.smithi012:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T22:32:06.387 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:32:06.387 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T22:32:06.415 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:32:06.415 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-15T22:32:06.426 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-15T22:32:06.440 INFO:teuthology.task.internal:Duration was 1508.402136 seconds 2024-09-15T22:32:06.440 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-15T22:32:06.450 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-15T22:32:06.450 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T22:32:06.455 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T22:32:06.457 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T22:32:06.495 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T22:32:06.496 INFO:teuthology.orchestra.run.smithi012.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T22:32:06.538 INFO:teuthology.orchestra.run.smithi001.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T22:32:06.937 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-15T22:32:06.938 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi001.front.sepia.ceph.com 2024-09-15T22:32:06.938 DEBUG:teuthology.orchestra.run.smithi001:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T22:32:06.988 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi012.front.sepia.ceph.com 2024-09-15T22:32:06.988 DEBUG:teuthology.orchestra.run.smithi012:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T22:32:07.018 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi098.front.sepia.ceph.com 2024-09-15T22:32:07.019 DEBUG:teuthology.orchestra.run.smithi098:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T22:32:07.046 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-15T22:32:07.046 DEBUG:teuthology.orchestra.run.smithi001:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T22:32:07.050 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T22:32:07.062 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T22:32:07.113 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-15T22:32:07.113 DEBUG:teuthology.orchestra.run.smithi001:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T22:32:07.121 DEBUG:teuthology.orchestra.run.smithi012:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T22:32:07.131 DEBUG:teuthology.orchestra.run.smithi098:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T22:32:07.633 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-15T22:32:07.645 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-15T22:32:07.645 DEBUG:teuthology.orchestra.run.smithi001:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T22:32:07.701 DEBUG:teuthology.orchestra.run.smithi012:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T22:32:07.727 DEBUG:teuthology.orchestra.run.smithi098:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T22:32:07.752 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-15T22:32:07.764 DEBUG:teuthology.orchestra.run.smithi001:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:32:07.768 DEBUG:teuthology.orchestra.run.smithi012:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:32:07.771 DEBUG:teuthology.orchestra.run.smithi098:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:32:07.792 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = core 2024-09-15T22:32:07.816 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = core 2024-09-15T22:32:07.835 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern = core 2024-09-15T22:32:07.865 DEBUG:teuthology.orchestra.run.smithi001:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:32:07.898 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:32:07.898 DEBUG:teuthology.orchestra.run.smithi012:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:32:07.913 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:32:07.913 DEBUG:teuthology.orchestra.run.smithi098:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:32:07.928 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:32:07.928 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-15T22:32:07.941 INFO:teuthology.task.internal:Transferring archived files... 2024-09-15T22:32:07.942 DEBUG:teuthology.misc:Transferring archived files from smithi001:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906236/remote/smithi001 2024-09-15T22:32:07.942 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T22:32:08.016 DEBUG:teuthology.misc:Transferring archived files from smithi012:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906236/remote/smithi012 2024-09-15T22:32:08.016 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T22:32:08.053 DEBUG:teuthology.misc:Transferring archived files from smithi098:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906236/remote/smithi098 2024-09-15T22:32:08.054 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T22:32:08.092 INFO:teuthology.task.internal:Removing archive directory... 2024-09-15T22:32:08.092 DEBUG:teuthology.orchestra.run.smithi001:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T22:32:08.096 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T22:32:08.099 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T22:32:08.141 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-15T22:32:08.156 INFO:teuthology.task.internal:Not uploading archives. 2024-09-15T22:32:08.157 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-15T22:32:08.168 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-15T22:32:08.168 DEBUG:teuthology.orchestra.run.smithi001:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T22:32:08.172 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T22:32:08.174 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T22:32:08.187 INFO:teuthology.orchestra.run.smithi012.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 22:32 /home/ubuntu/cephtest 2024-09-15T22:32:08.197 INFO:teuthology.orchestra.run.smithi098.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 22:32 /home/ubuntu/cephtest 2024-09-15T22:32:08.203 INFO:teuthology.orchestra.run.smithi001.stdout: 393247 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 22:32 /home/ubuntu/cephtest 2024-09-15T22:32:08.205 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-15T22:32:08.217 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-15T22:32:08.278 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/fsstress}} duration: 1508.402135848999 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-15T22:32:08.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T22:32:08.370 INFO:teuthology.run:pass